2024-08-27T02:17:02.244 INFO:root:teuthology version: 1.2.1.dev2+g4d4c5e3 2024-08-27T02:17:02.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-27T02:17:02.354 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755 branch: pr-56597 description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7874755' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: pr-56597 ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d17b22856a85d7d49d47be692c778d4419f41641 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d17b22856a85d7d49d47be692c778d4419f41641 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pr-56597 sha1: d17b22856a85d7d49d47be692c778d4419f41641 owner: scheduled_cbodley@teuthology priority: 99 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4190 sha1: d17b22856a85d7d49d47be692c778d4419f41641 sleep_before_teardown: 0 suite: rgw suite_branch: pr-56597 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d17b22856a85d7d49d47be692c778d4419f41641 targets: smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBJSA6SxrRFrtctC43PntCZKZgJZK6StJ/uM14muOjNfbTiG3V45NJEwg9gvRpUrL7PaOcvtHzT/Fl3bVuvExtw= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMP4AX0xWOO7yyavc905ZdNoOK+MXH9YCjQRxXXUbC+XIRKmYw2uTitFnypBI8FztVv1bGhDHOk/+KnXFjyuVYU= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 4d4c5e30374204f3b32f867e61bb4e1a3880f672 timestamp: 2024-08-26_22:06:30 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-27T02:17:02.355 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa; will attempt to use it 2024-08-27T02:17:02.355 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa/tasks 2024-08-27T02:17:02.356 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-27T02:17:02.357 INFO:teuthology.task.internal:Checking packages... 2024-08-27T02:17:02.377 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd17b22856a85d7d49d47be692c778d4419f41641' 2024-08-27T02:17:02.377 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-27T02:17:02.377 INFO:teuthology.packaging:ref: None 2024-08-27T02:17:02.377 INFO:teuthology.packaging:tag: None 2024-08-27T02:17:02.377 INFO:teuthology.packaging:branch: pr-56597 2024-08-27T02:17:02.377 INFO:teuthology.packaging:sha1: d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:17:02.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=pr-56597 2024-08-27T02:17:02.519 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:17:02.520 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-27T02:17:02.527 INFO:teuthology.task.internal:no buildpackages task found 2024-08-27T02:17:02.527 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-27T02:17:02.549 INFO:teuthology.task.internal:Saving configuration 2024-08-27T02:17:02.566 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-27T02:17:02.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-27T02:17:02.599 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-27 02:11:35.173700', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKKkJ7V5hP2PQ6LINP32KnXRixzHG8ZEVzuzCpBwhCBQ'} 2024-08-27T02:17:02.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-27 02:11:35.175289', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPHnfO4u8B7jJz2/14LB1DG1oS+Rn4U+1be60wkMao+A'} 2024-08-27T02:17:02.621 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-27T02:17:02.628 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-08-27T02:17:02.628 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-08-27T02:17:02.628 INFO:teuthology.run_tasks:Running task console_log... 2024-08-27T02:17:02.691 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff092533ac0>, signals=[15]) 2024-08-27T02:17:02.691 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-27T02:17:02.697 INFO:teuthology.task.internal:Opening connections... 2024-08-27T02:17:02.698 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T02:17:02.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:17:02.777 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T02:17:02.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:17:02.860 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-27T02:17:02.867 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-08-27T02:17:02.872 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-08-27T02:17:02.872 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-27T02:17:02.920 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-27T02:17:02.921 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2024-08-27T02:17:02.921 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-08-27T02:17:02.943 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-08-27T02:17:02.949 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-08-27T02:17:02.949 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-08-27T02:17:02.995 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-27T02:17:02.996 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy 2024-08-27T02:17:02.997 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-08-27T02:17:03.018 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-27T02:17:03.027 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-27T02:17:03.032 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-27T02:17:03.032 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-08-27T02:17:03.034 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-08-27T02:17:03.043 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-27T02:17:03.049 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-27T02:17:03.049 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-08-27T02:17:03.081 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-08-27T02:17:03.167 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-27T02:17:03.219 INFO:teuthology.run_tasks:Running task kernel... 2024-08-27T02:17:03.317 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-27T02:17:03.317 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-27T02:17:03.317 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-27T02:17:03.318 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-27T02:17:03.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:17:03.323 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-08-27T02:17:03.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:17:03.324 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-08-27T02:17:03.368 INFO:teuthology.orchestra.run.smithi181.stdout:5.15.0-56-generic 2024-08-27T02:17:03.368 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.15.0-56-generic 2024-08-27T02:17:03.369 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get clean 2024-08-27T02:17:03.372 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-56-generic 2024-08-27T02:17:03.372 INFO:teuthology.task.kernel:Running kernel on smithi143: 5.15.0-56-generic 2024-08-27T02:17:03.372 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get clean 2024-08-27T02:17:03.481 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2024-08-27T02:17:03.511 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get update 2024-08-27T02:17:05.118 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-27T02:17:05.126 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-27T02:17:05.474 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-27T02:17:05.607 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-08-27T02:17:05.666 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-27T02:17:05.746 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-27T02:17:05.810 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,987 kB] 2024-08-27T02:17:05.957 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-08-27T02:17:05.975 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-27T02:17:05.975 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-27T02:17:05.975 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,384 kB] 2024-08-27T02:17:06.005 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-27T02:17:06.040 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-08-27T02:17:06.054 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-27T02:17:06.054 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,112 kB] 2024-08-27T02:17:06.081 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-27T02:17:06.089 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [726 kB] 2024-08-27T02:17:06.108 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [260 kB] 2024-08-27T02:17:06.114 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.0 kB] 2024-08-27T02:17:06.124 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-27T02:17:06.125 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-08-27T02:17:06.148 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-27T02:17:06.149 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-27T02:17:06.158 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-27T02:17:06.180 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,769 kB] 2024-08-27T02:17:06.196 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-08-27T02:17:06.198 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-08-27T02:17:06.199 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-08-27T02:17:06.200 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-27T02:17:06.200 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-08-27T02:17:06.205 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-27T02:17:06.220 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-08-27T02:17:06.284 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [531 kB] 2024-08-27T02:17:06.286 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-27T02:17:06.287 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-27T02:17:06.289 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [290 kB] 2024-08-27T02:17:06.291 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.2 kB] 2024-08-27T02:17:06.292 INFO:teuthology.orchestra.run.smithi181.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,308 kB] 2024-08-27T02:17:06.312 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,769 kB] 2024-08-27T02:17:06.312 INFO:teuthology.orchestra.run.smithi181.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-27T02:17:06.312 INFO:teuthology.orchestra.run.smithi181.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [398 kB] 2024-08-27T02:17:06.316 INFO:teuthology.orchestra.run.smithi181.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-27T02:17:06.317 INFO:teuthology.orchestra.run.smithi181.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [890 kB] 2024-08-27T02:17:06.324 INFO:teuthology.orchestra.run.smithi181.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [622 kB] 2024-08-27T02:17:06.329 INFO:teuthology.orchestra.run.smithi181.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [175 kB] 2024-08-27T02:17:06.331 INFO:teuthology.orchestra.run.smithi181.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-27T02:17:06.331 INFO:teuthology.orchestra.run.smithi181.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-27T02:17:06.358 INFO:teuthology.orchestra.run.smithi181.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-27T02:17:06.359 INFO:teuthology.orchestra.run.smithi181.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-27T02:17:06.359 INFO:teuthology.orchestra.run.smithi181.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-27T02:17:06.406 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [531 kB] 2024-08-27T02:17:06.415 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [290 kB] 2024-08-27T02:17:06.421 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.2 kB] 2024-08-27T02:17:06.421 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-27T02:17:06.423 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,308 kB] 2024-08-27T02:17:06.430 INFO:teuthology.orchestra.run.smithi181.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,987 kB] 2024-08-27T02:17:06.455 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [398 kB] 2024-08-27T02:17:06.460 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-27T02:17:06.460 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [890 kB] 2024-08-27T02:17:06.469 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [622 kB] 2024-08-27T02:17:06.474 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [175 kB] 2024-08-27T02:17:06.476 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-27T02:17:06.476 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-27T02:17:06.477 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-27T02:17:06.477 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-27T02:17:06.478 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-27T02:17:06.588 INFO:teuthology.orchestra.run.smithi181.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-08-27T02:17:06.602 INFO:teuthology.orchestra.run.smithi181.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-27T02:17:06.603 INFO:teuthology.orchestra.run.smithi181.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-27T02:17:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,384 kB] 2024-08-27T02:17:06.671 INFO:teuthology.orchestra.run.smithi181.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-08-27T02:17:06.688 INFO:teuthology.orchestra.run.smithi181.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-27T02:17:06.688 INFO:teuthology.orchestra.run.smithi181.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [726 kB] 2024-08-27T02:17:06.711 INFO:teuthology.orchestra.run.smithi181.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,112 kB] 2024-08-27T02:17:06.743 INFO:teuthology.orchestra.run.smithi181.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [260 kB] 2024-08-27T02:17:06.759 INFO:teuthology.orchestra.run.smithi181.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.0 kB] 2024-08-27T02:17:06.762 INFO:teuthology.orchestra.run.smithi181.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-08-27T02:17:06.765 INFO:teuthology.orchestra.run.smithi181.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-27T02:17:06.768 INFO:teuthology.orchestra.run.smithi181.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-27T02:17:06.771 INFO:teuthology.orchestra.run.smithi181.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-27T02:17:06.836 INFO:teuthology.orchestra.run.smithi181.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-08-27T02:17:06.837 INFO:teuthology.orchestra.run.smithi181.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-08-27T02:17:06.839 INFO:teuthology.orchestra.run.smithi181.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-08-27T02:17:06.839 INFO:teuthology.orchestra.run.smithi181.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-27T02:17:06.918 INFO:teuthology.orchestra.run.smithi181.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-08-27T02:17:06.918 INFO:teuthology.orchestra.run.smithi181.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-27T02:17:06.919 INFO:teuthology.orchestra.run.smithi181.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-27T02:17:06.919 INFO:teuthology.orchestra.run.smithi181.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-27T02:17:12.324 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 15.7 MB in 4s (3,869 kB/s) 2024-08-27T02:17:12.745 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 15.7 MB in 4s (3,566 kB/s) 2024-08-27T02:17:13.696 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:17:13.714 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-27T02:17:13.777 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:17:13.983 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-08-27T02:17:13.984 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-08-27T02:17:14.143 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-08-27T02:17:14.159 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:17:14.159 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:17:14.160 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:17:14.160 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:17:14.160 INFO:teuthology.orchestra.run.smithi143.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-27T02:17:14.160 INFO:teuthology.orchestra.run.smithi143.stdout: python2.7-minimal 2024-08-27T02:17:14.161 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:17:14.162 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-08-27T02:17:14.162 INFO:teuthology.orchestra.run.smithi143.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-27T02:17:14.162 INFO:teuthology.orchestra.run.smithi143.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-08-27T02:17:14.163 INFO:teuthology.orchestra.run.smithi143.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-08-27T02:17:14.163 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-27T02:17:14.164 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-08-27T02:17:14.164 INFO:teuthology.orchestra.run.smithi143.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-27T02:17:14.164 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2024-08-27T02:17:14.164 INFO:teuthology.orchestra.run.smithi143.stdout: thermald 2024-08-27T02:17:14.209 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-08-27T02:17:14.209 INFO:teuthology.orchestra.run.smithi143.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-27T02:17:14.209 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-08-27T02:17:14.210 INFO:teuthology.orchestra.run.smithi143.stdout: linux-modules-extra-5.15.0-119-generic 2024-08-27T02:17:14.211 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages will be upgraded: 2024-08-27T02:17:14.212 INFO:teuthology.orchestra.run.smithi143.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-27T02:17:14.221 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-08-27T02:17:14.391 INFO:teuthology.orchestra.run.smithi143.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-08-27T02:17:14.391 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 113 MB of archives. 2024-08-27T02:17:14.391 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-27T02:17:14.391 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-08-27T02:17:14.411 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-08-27T02:17:14.411 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-08-27T02:17:14.580 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:17:14.581 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:17:14.581 INFO:teuthology.orchestra.run.smithi181.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:17:14.581 INFO:teuthology.orchestra.run.smithi181.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:17:14.581 INFO:teuthology.orchestra.run.smithi181.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-27T02:17:14.581 INFO:teuthology.orchestra.run.smithi181.stdout: python2.7-minimal 2024-08-27T02:17:14.582 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:17:14.583 INFO:teuthology.orchestra.run.smithi181.stdout:The following additional packages will be installed: 2024-08-27T02:17:14.583 INFO:teuthology.orchestra.run.smithi181.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-27T02:17:14.583 INFO:teuthology.orchestra.run.smithi181.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-08-27T02:17:14.583 INFO:teuthology.orchestra.run.smithi181.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-08-27T02:17:14.584 INFO:teuthology.orchestra.run.smithi181.stdout:Suggested packages: 2024-08-27T02:17:14.584 INFO:teuthology.orchestra.run.smithi181.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-27T02:17:14.584 INFO:teuthology.orchestra.run.smithi181.stdout:Recommended packages: 2024-08-27T02:17:14.585 INFO:teuthology.orchestra.run.smithi181.stdout: thermald 2024-08-27T02:17:14.644 INFO:teuthology.orchestra.run.smithi181.stdout:The following NEW packages will be installed: 2024-08-27T02:17:14.644 INFO:teuthology.orchestra.run.smithi181.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-27T02:17:14.645 INFO:teuthology.orchestra.run.smithi181.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-08-27T02:17:14.645 INFO:teuthology.orchestra.run.smithi181.stdout: linux-modules-extra-5.15.0-119-generic 2024-08-27T02:17:14.646 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages will be upgraded: 2024-08-27T02:17:14.646 INFO:teuthology.orchestra.run.smithi181.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-27T02:17:14.696 INFO:teuthology.orchestra.run.smithi181.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-08-27T02:17:14.696 INFO:teuthology.orchestra.run.smithi181.stdout:Need to get 113 MB of archives. 2024-08-27T02:17:14.696 INFO:teuthology.orchestra.run.smithi181.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-27T02:17:14.697 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-08-27T02:17:15.138 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-08-27T02:17:15.231 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-08-27T02:17:15.785 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-08-27T02:17:16.022 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-08-27T02:17:16.022 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-08-27T02:17:16.022 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-08-27T02:17:16.141 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-08-27T02:17:16.163 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-08-27T02:17:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-08-27T02:17:16.555 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 113 MB in 2s (75.0 MB/s) 2024-08-27T02:17:16.728 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-08-27T02:17:18.385 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-08-27T02:17:18.385 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-08-27T02:17:18.385 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-08-27T02:17:18.706 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-27T02:17:18.711 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:18.732 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-08-27T02:17:18.784 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:18.818 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-08-27T02:17:19.215 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-08-27T02:17:19.395 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-08-27T02:17:20.810 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-08-27T02:17:20.832 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:20.928 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:21.380 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-08-27T02:17:21.400 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:21.430 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:21.554 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-27T02:17:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:21.840 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:23.982 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-08-27T02:17:24.003 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:24.088 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:24.602 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-08-27T02:17:24.622 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:24.660 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:27.855 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-08-27T02:17:27.982 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-27T02:17:28.298 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-08-27T02:17:28.427 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-27T02:17:28.722 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-08-27T02:17:28.744 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-08-27T02:17:28.788 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-27T02:17:31.541 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-08-27T02:17:31.648 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-27T02:17:31.955 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-08-27T02:17:32.085 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-27T02:17:32.388 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-08-27T02:17:32.410 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-08-27T02:17:32.455 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-27T02:17:34.483 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-08-27T02:17:34.519 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:34.557 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:37.097 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-08-27T02:17:37.219 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-27T02:17:37.552 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-27T02:17:37.674 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:37.800 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-08-27T02:17:37.929 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:38.014 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-08-27T02:17:38.052 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-27T02:17:38.089 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:39.277 INFO:teuthology.orchestra.run.smithi181.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-27T02:17:39.277 INFO:teuthology.orchestra.run.smithi181.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-27T02:17:39.277 INFO:teuthology.orchestra.run.smithi181.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-08-27T02:17:39.278 INFO:teuthology.orchestra.run.smithi181.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-08-27T02:17:39.947 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:41.382 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:41.812 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-08-27T02:17:42.336 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-27T02:17:42.711 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-27T02:17:42.766 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-08-27T02:17:42.833 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:42.892 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-08-27T02:17:42.968 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-08-27T02:17:43.019 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:43.093 INFO:teuthology.orchestra.run.smithi181.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-27T02:17:43.093 INFO:teuthology.orchestra.run.smithi181.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-08-27T02:17:43.097 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:44.398 INFO:teuthology.orchestra.run.smithi143.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-27T02:17:44.399 INFO:teuthology.orchestra.run.smithi143.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-27T02:17:44.399 INFO:teuthology.orchestra.run.smithi143.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-08-27T02:17:44.399 INFO:teuthology.orchestra.run.smithi143.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-08-27T02:17:44.557 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:46.642 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:48.052 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-08-27T02:17:48.170 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-08-27T02:17:48.288 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-27T02:17:48.342 INFO:teuthology.orchestra.run.smithi143.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-27T02:17:48.342 INFO:teuthology.orchestra.run.smithi143.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-08-27T02:17:56.882 INFO:teuthology.orchestra.run.smithi181.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-27T02:17:56.882 INFO:teuthology.orchestra.run.smithi181.stdout:Sourcing file `/etc/default/grub' 2024-08-27T02:17:56.900 INFO:teuthology.orchestra.run.smithi181.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-27T02:17:56.920 INFO:teuthology.orchestra.run.smithi181.stdout:Generating grub configuration file ... 2024-08-27T02:17:57.184 INFO:teuthology.orchestra.run.smithi181.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-27T02:17:57.203 INFO:teuthology.orchestra.run.smithi181.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-27T02:17:57.509 INFO:teuthology.orchestra.run.smithi181.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-27T02:17:57.515 INFO:teuthology.orchestra.run.smithi181.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-27T02:17:57.576 INFO:teuthology.orchestra.run.smithi181.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-27T02:17:57.582 INFO:teuthology.orchestra.run.smithi181.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-27T02:17:57.740 INFO:teuthology.orchestra.run.smithi181.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-27T02:17:57.740 INFO:teuthology.orchestra.run.smithi181.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-27T02:17:57.740 INFO:teuthology.orchestra.run.smithi181.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-27T02:17:57.785 INFO:teuthology.orchestra.run.smithi181.stdout:done 2024-08-27T02:17:58.273 DEBUG:teuthology.orchestra.run.smithi181:> dpkg -s linux-image-generic 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Package: linux-image-generic 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Status: install ok installed 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Priority: optional 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Section: kernel 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Installed-Size: 21 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Maintainer: Ubuntu Kernel Team 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: amd64 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Source: linux-meta 2024-08-27T02:17:58.292 INFO:teuthology.orchestra.run.smithi181.stdout:Version: 5.15.0.119.119 2024-08-27T02:17:58.293 INFO:teuthology.orchestra.run.smithi181.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-27T02:17:58.293 INFO:teuthology.orchestra.run.smithi181.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-27T02:17:58.293 INFO:teuthology.orchestra.run.smithi181.stdout:Recommends: thermald 2024-08-27T02:17:58.293 INFO:teuthology.orchestra.run.smithi181.stdout:Description: Generic Linux kernel image 2024-08-27T02:17:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: This package will always depend on the latest generic kernel image 2024-08-27T02:17:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: available. 2024-08-27T02:17:58.293 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-08-27T02:17:58.293 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-27T02:17:58.293 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-27T02:17:58.294 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-27T02:17:58.294 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-08-27T02:17:58.294 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get clean 2024-08-27T02:17:58.449 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get update 2024-08-27T02:17:58.686 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-27T02:17:58.687 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-27T02:17:58.760 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-27T02:17:58.842 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-27T02:18:00.177 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-08-27T02:18:00.195 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-27T02:18:00.255 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-08-27T02:18:00.464 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-08-27T02:18:00.464 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-08-27T02:18:00.642 INFO:teuthology.orchestra.run.smithi181.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-08-27T02:18:00.642 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:18:00.642 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:18:00.643 INFO:teuthology.orchestra.run.smithi181.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:18:00.643 INFO:teuthology.orchestra.run.smithi181.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:18:00.643 INFO:teuthology.orchestra.run.smithi181.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-27T02:18:00.643 INFO:teuthology.orchestra.run.smithi181.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-27T02:18:00.643 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:18:00.681 INFO:teuthology.orchestra.run.smithi181.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-08-27T02:18:00.683 DEBUG:teuthology.orchestra.run.smithi181:> dpkg -s linux-image-generic 2024-08-27T02:18:00.695 INFO:teuthology.orchestra.run.smithi181.stdout:Package: linux-image-generic 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Status: install ok installed 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Priority: optional 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Section: kernel 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Installed-Size: 21 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Maintainer: Ubuntu Kernel Team 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: amd64 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Source: linux-meta 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Version: 5.15.0.119.119 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Recommends: thermald 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout:Description: Generic Linux kernel image 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout: This package will always depend on the latest generic kernel image 2024-08-27T02:18:00.696 INFO:teuthology.orchestra.run.smithi181.stdout: available. 2024-08-27T02:18:00.697 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-08-27T02:18:00.747 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.KtbY8W0xQd 2024-08-27T02:18:00.747 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KtbY8W0xQd 2024-08-27T02:18:00.803 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.KtbY8W0xQd 2024-08-27T02:18:00.918 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.KtbY8W0xQd is 10KB 2024-08-27T02:18:00.931 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.KtbY8W0xQd 2024-08-27T02:18:00.966 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-27T02:18:00.990 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:18:00.990 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-27T02:18:00.990 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-27T02:18:01.053 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-08-27T02:18:01.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo update-grub 2024-08-27T02:18:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub' 2024-08-27T02:18:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-27T02:18:02.219 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-08-27T02:18:02.390 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-27T02:18:02.397 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-27T02:18:02.541 INFO:teuthology.orchestra.run.smithi143.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-27T02:18:02.541 INFO:teuthology.orchestra.run.smithi143.stdout:Sourcing file `/etc/default/grub' 2024-08-27T02:18:02.559 INFO:teuthology.orchestra.run.smithi143.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-27T02:18:02.578 INFO:teuthology.orchestra.run.smithi143.stdout:Generating grub configuration file ... 2024-08-27T02:18:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-27T02:18:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-27T02:18:02.656 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-27T02:18:02.660 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-27T02:18:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-27T02:18:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-27T02:18:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-27T02:18:02.801 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-08-27T02:18:02.814 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-08-27T02:18:02.836 INFO:teuthology.orchestra.run.smithi143.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-27T02:18:02.855 INFO:teuthology.orchestra.run.smithi143.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-27T02:18:03.140 INFO:teuthology.orchestra.run.smithi143.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-27T02:18:03.146 INFO:teuthology.orchestra.run.smithi143.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-27T02:18:03.218 INFO:teuthology.orchestra.run.smithi143.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-27T02:18:03.223 INFO:teuthology.orchestra.run.smithi143.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-27T02:18:03.398 INFO:teuthology.orchestra.run.smithi143.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-27T02:18:03.398 INFO:teuthology.orchestra.run.smithi143.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-27T02:18:03.398 INFO:teuthology.orchestra.run.smithi143.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-27T02:18:03.443 INFO:teuthology.orchestra.run.smithi143.stdout:done 2024-08-27T02:18:03.942 DEBUG:teuthology.orchestra.run.smithi143:> dpkg -s linux-image-generic 2024-08-27T02:18:03.965 INFO:teuthology.orchestra.run.smithi143.stdout:Package: linux-image-generic 2024-08-27T02:18:03.965 INFO:teuthology.orchestra.run.smithi143.stdout:Status: install ok installed 2024-08-27T02:18:03.965 INFO:teuthology.orchestra.run.smithi143.stdout:Priority: optional 2024-08-27T02:18:03.965 INFO:teuthology.orchestra.run.smithi143.stdout:Section: kernel 2024-08-27T02:18:03.965 INFO:teuthology.orchestra.run.smithi143.stdout:Installed-Size: 21 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Maintainer: Ubuntu Kernel Team 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: amd64 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Source: linux-meta 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Version: 5.15.0.119.119 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Recommends: thermald 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout:Description: Generic Linux kernel image 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: This package will always depend on the latest generic kernel image 2024-08-27T02:18:03.966 INFO:teuthology.orchestra.run.smithi143.stdout: available. 2024-08-27T02:18:03.966 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-08-27T02:18:03.966 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-27T02:18:03.967 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-27T02:18:03.967 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-27T02:18:03.967 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi143.front.sepia.ceph.com, path=None, version=distro) 2024-08-27T02:18:03.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get clean 2024-08-27T02:18:04.136 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2024-08-27T02:18:04.254 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-27T02:18:04.262 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-27T02:18:04.280 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-27T02:18:04.374 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-27T02:18:05.609 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:18:05.627 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-27T02:18:05.690 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:18:05.899 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-08-27T02:18:05.900 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-08-27T02:18:06.091 INFO:teuthology.orchestra.run.smithi143.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-08-27T02:18:06.091 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:18:06.092 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:18:06.092 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:18:06.092 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:18:06.093 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-27T02:18:06.093 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-27T02:18:06.093 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:18:06.132 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-08-27T02:18:06.134 DEBUG:teuthology.orchestra.run.smithi143:> dpkg -s linux-image-generic 2024-08-27T02:18:06.149 INFO:teuthology.orchestra.run.smithi143.stdout:Package: linux-image-generic 2024-08-27T02:18:06.149 INFO:teuthology.orchestra.run.smithi143.stdout:Status: install ok installed 2024-08-27T02:18:06.149 INFO:teuthology.orchestra.run.smithi143.stdout:Priority: optional 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Section: kernel 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Installed-Size: 21 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Maintainer: Ubuntu Kernel Team 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: amd64 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Source: linux-meta 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Version: 5.15.0.119.119 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Recommends: thermald 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout:Description: Generic Linux kernel image 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout: This package will always depend on the latest generic kernel image 2024-08-27T02:18:06.150 INFO:teuthology.orchestra.run.smithi143.stdout: available. 2024-08-27T02:18:06.151 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-08-27T02:18:06.194 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.GbJVKe2Dns 2024-08-27T02:18:06.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GbJVKe2Dns 2024-08-27T02:18:06.250 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.GbJVKe2Dns 2024-08-27T02:18:06.362 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.GbJVKe2Dns is 10KB 2024-08-27T02:18:06.374 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.GbJVKe2Dns 2024-08-27T02:18:06.379 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-27T02:18:06.434 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:18:06.434 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-27T02:18:06.434 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-27T02:18:06.498 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-08-27T02:18:06.498 DEBUG:teuthology.orchestra.run.smithi143:> sudo update-grub 2024-08-27T02:18:07.746 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2024-08-27T02:18:07.747 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-27T02:18:07.749 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-08-27T02:18:07.937 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-27T02:18:07.943 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-27T02:18:08.177 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-27T02:18:08.181 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-27T02:18:08.221 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-27T02:18:08.226 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-27T02:18:08.332 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-27T02:18:08.332 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-27T02:18:08.333 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-27T02:18:08.352 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-08-27T02:18:08.355 DEBUG:teuthology.orchestra.run.smithi143:> sudo shutdown -r now 2024-08-27T02:18:32.839 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-27T02:18:32.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-27T02:18:32.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:18:38.363 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-27T02:18:38.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-08-27T02:18:38.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:19:07.323 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-08-27T02:19:16.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-27T02:19:16.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:19:34.715 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-08-27T02:19:38.370 DEBUG:teuthology.orchestra.remote:timed out 2024-08-27T02:19:46.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-27T02:19:46.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:19:47.243 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-08-27T02:19:47.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-08-27T02:19:47.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:19:47.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-08-27T02:19:47.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-27T02:19:47.765 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-08-27T02:19:47.766 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-08-27T02:19:47.811 INFO:teuthology.orchestra.run.smithi181.stdout:5.15.0-119-generic 2024-08-27T02:19:47.811 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-08-27T02:19:47.811 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-27T02:19:47.811 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-27T02:19:48.812 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-27T02:19:48.812 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-27T02:19:48.872 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-08-27T02:19:48.896 DEBUG:teuthology.parallel:result is None 2024-08-27T02:19:59.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-08-27T02:19:59.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:19:59.667 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-08-27T02:20:00.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-08-27T02:20:00.219 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-08-27T02:20:00.219 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-08-27T02:20:00.264 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-119-generic 2024-08-27T02:20:00.264 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-08-27T02:20:00.264 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-27T02:20:00.264 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-27T02:20:01.265 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-27T02:20:01.265 DEBUG:teuthology.orchestra.run.smithi143:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-27T02:20:01.652 INFO:teuthology.orchestra.run.smithi143.stdout:ttyS1 2024-08-27T02:20:01.671 DEBUG:teuthology.parallel:result is None 2024-08-27T02:20:01.671 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-27T02:20:01.678 INFO:teuthology.task.internal:Creating test directory... 2024-08-27T02:20:01.679 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-27T02:20:01.681 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-27T02:20:01.687 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-27T02:20:01.700 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-27T02:20:01.712 INFO:teuthology.task.internal:Creating archive directory... 2024-08-27T02:20:01.712 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-27T02:20:01.729 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-27T02:20:01.751 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-27T02:20:01.764 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-27T02:20:01.764 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-27T02:20:01.785 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-27T02:20:01.800 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-27T02:20:01.808 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-27T02:20:01.809 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-27T02:20:01.817 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-27T02:20:01.818 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-27T02:20:01.824 INFO:teuthology.task.internal:Configuring sudo... 2024-08-27T02:20:01.825 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-27T02:20:01.853 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-27T02:20:01.886 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-27T02:20:01.897 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-27T02:20:01.897 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-27T02:20:01.929 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-27T02:20:01.935 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-27T02:20:01.980 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-27T02:20:02.028 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:20:02.028 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-27T02:20:02.104 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-27T02:20:02.110 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-27T02:20:02.158 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:20:02.158 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-27T02:20:02.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-08-27T02:20:02.231 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-08-27T02:20:02.318 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-27T02:20:02.327 INFO:teuthology.task.internal:Starting timer... 2024-08-27T02:20:02.327 INFO:teuthology.run_tasks:Running task pcp... 2024-08-27T02:20:02.345 INFO:teuthology.run_tasks:Running task selinux... 2024-08-27T02:20:02.360 DEBUG:teuthology.task.selinux:Excluding smithi143: OS 'ubuntu' does not support SELinux 2024-08-27T02:20:02.360 DEBUG:teuthology.task.selinux:Excluding smithi181: OS 'ubuntu' does not support SELinux 2024-08-27T02:20:02.360 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-27T02:20:02.360 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-27T02:20:02.361 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-27T02:20:02.361 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-27T02:20:02.380 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-27T02:20:02.514 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-27T02:20:02.515 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi143.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-27T02:27:29.610 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi143.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-08-27T02:27:29.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-08-27T02:27:29.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:27:29.694 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-08-27T02:27:29.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-08-27T02:27:29.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-27T02:27:29.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-27T02:27:29.850 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-08-27T02:27:29.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-08-27T02:27:29.927 INFO:teuthology.run_tasks:Running task clock... 2024-08-27T02:27:29.938 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-27T02:27:29.938 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-27T02:27:29.939 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-27T02:27:29.941 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-27T02:27:29.941 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-27T02:27:29.967 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-27T02:27:29.967 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Command line: ntpd -gq 2024-08-27T02:27:29.967 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: ---------------------------------------------------- 2024-08-27T02:27:29.967 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: ntp-4 is maintained by Network Time Foundation, 2024-08-27T02:27:29.967 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-27T02:27:29.968 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: corporation. Support and training for ntp-4 are 2024-08-27T02:27:29.968 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: available at https://www.nwtime.org/support 2024-08-27T02:27:29.968 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: ---------------------------------------------------- 2024-08-27T02:27:29.968 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: proto: precision = 0.063 usec (-24) 2024-08-27T02:27:29.968 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: basedate set to 2022-02-04 2024-08-27T02:27:29.968 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: gps base set to 2022-02-06 (week 2196) 2024-08-27T02:27:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-27T02:27:29.969 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-27T02:27:29.969 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: restrict ::: KOD does nothing without LIMITED. 2024-08-27T02:27:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-27T02:27:29.970 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Listen and drop on 0 v6wildcard [::]:123 2024-08-27T02:27:29.970 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-27T02:27:29.970 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Listen normally on 2 lo 127.0.0.1:123 2024-08-27T02:27:29.971 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Listen normally on 3 enp3s0f1 172.21.15.143:123 2024-08-27T02:27:29.971 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Listen normally on 4 lo [::1]:123 2024-08-27T02:27:29.971 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7783%5]:123 2024-08-27T02:27:29.971 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:29 ntpd[18396]: Listening on routing socket on fd #22 for interface updates 2024-08-27T02:27:29.997 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-27T02:27:29.997 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Command line: ntpd -gq 2024-08-27T02:27:29.997 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: ---------------------------------------------------- 2024-08-27T02:27:29.997 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: ntp-4 is maintained by Network Time Foundation, 2024-08-27T02:27:29.997 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-27T02:27:29.997 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: corporation. Support and training for ntp-4 are 2024-08-27T02:27:29.997 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: available at https://www.nwtime.org/support 2024-08-27T02:27:29.998 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: ---------------------------------------------------- 2024-08-27T02:27:29.998 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: proto: precision = 0.044 usec (-24) 2024-08-27T02:27:29.998 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: basedate set to 2022-02-04 2024-08-27T02:27:29.998 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: gps base set to 2022-02-06 (week 2196) 2024-08-27T02:27:29.999 INFO:teuthology.orchestra.run.smithi181.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-27T02:27:29.999 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-27T02:27:29.999 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: restrict ::: KOD does nothing without LIMITED. 2024-08-27T02:27:29.999 INFO:teuthology.orchestra.run.smithi181.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-27T02:27:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Listen and drop on 0 v6wildcard [::]:123 2024-08-27T02:27:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-27T02:27:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Listen normally on 2 lo 127.0.0.1:123 2024-08-27T02:27:30.000 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Listen normally on 3 enp3s0f1 172.21.15.181:123 2024-08-27T02:27:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Listen normally on 4 lo [::1]:123 2024-08-27T02:27:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b9d%5]:123 2024-08-27T02:27:30.001 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:29 ntpd[18365]: Listening on routing socket on fd #22 for interface updates 2024-08-27T02:27:31.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:31.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:31.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:31.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:31.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:31 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:33.968 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:33 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:33.968 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:33 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:33.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:33.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:33 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:34.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:34.971 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:34.971 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.971 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.971 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:34.971 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:34 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:34.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:34 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:34 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:34 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:34.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:34 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:34.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:34 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:34.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:34 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:35.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:35.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:35.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:35.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:35.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:35 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:36.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:36.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:36 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:36.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:36 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:36 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:36 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:36.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:36 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:36.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:36 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:36.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:36 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:37.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:37.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:37.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:37.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:37.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:37.998 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:37.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:37.999 INFO:teuthology.orchestra.run.smithi181.stdout:27 Aug 02:27:37 ntpd[18365]: ntpd: time slew -0.000148 s 2024-08-27T02:27:37.999 INFO:teuthology.orchestra.run.smithi181.stdout:ntpd: time slew -0.000148s 2024-08-27T02:27:37.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:37.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-27T02:27:37.999 INFO:teuthology.orchestra.run.smithi181.stderr:27 Aug 02:27:37 ntpd[18365]: can't open /var/log/ntpstats/loopstats.20240827: Permission denied 2024-08-27T02:27:38.047 INFO:teuthology.orchestra.run.smithi181.stdout: remote refid st t when poll reach delay offset jitter 2024-08-27T02:27:38.048 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================== 2024-08-27T02:27:38.048 INFO:teuthology.orchestra.run.smithi181.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:38.048 INFO:teuthology.orchestra.run.smithi181.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:38.048 INFO:teuthology.orchestra.run.smithi181.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:38.048 INFO:teuthology.orchestra.run.smithi181.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:38.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:38.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:38 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:40.968 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:40.968 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: can't open /var/log/ntpstats/rawstats.20240827: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: can't open /var/log/ntpstats/peerstats.20240827: Permission denied 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stdout:27 Aug 02:27:40 ntpd[18396]: ntpd: time slew -0.002979 s 2024-08-27T02:27:40.969 INFO:teuthology.orchestra.run.smithi143.stdout:ntpd: time slew -0.002979s 2024-08-27T02:27:40.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-27T02:27:40.970 INFO:teuthology.orchestra.run.smithi143.stderr:27 Aug 02:27:40 ntpd[18396]: can't open /var/log/ntpstats/loopstats.20240827: Permission denied 2024-08-27T02:27:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2024-08-27T02:27:41.021 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2024-08-27T02:27:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:41.021 INFO:teuthology.orchestra.run.smithi143.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:41.022 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-27T02:27:41.022 INFO:teuthology.run_tasks:Running task install... 2024-08-27T02:27:41.031 DEBUG:teuthology.task.install:project ceph 2024-08-27T02:27:41.032 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd17b22856a85d7d49d47be692c778d4419f41641'}} 2024-08-27T02:27:41.032 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd17b22856a85d7d49d47be692c778d4419f41641'} 2024-08-27T02:27:41.032 INFO:teuthology.task.install:Using flavor: default 2024-08-27T02:27:41.038 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-27T02:27:41.038 INFO:teuthology.task.install:extra packages: [] 2024-08-27T02:27:41.038 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-key list | grep Ceph 2024-08-27T02:27:41.039 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-key list | grep Ceph 2024-08-27T02:27:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-27T02:27:41.120 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-27T02:27:41.133 INFO:teuthology.orchestra.run.smithi181.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-27T02:27:41.133 INFO:teuthology.orchestra.run.smithi181.stdout:uid [ unknown] Ceph.com (release key) 2024-08-27T02:27:41.134 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-27T02:27:41.134 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-08-27T02:27:41.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:27:41.145 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-27T02:27:41.145 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph.com (release key) 2024-08-27T02:27:41.145 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-27T02:27:41.146 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-08-27T02:27:41.146 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:27:41.289 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default/ 2024-08-27T02:27:41.289 INFO:teuthology.task.install.deb:Package version is 19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:27:41.300 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default/ 2024-08-27T02:27:41.301 INFO:teuthology.task.install.deb:Package version is 19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:27:41.403 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:27:41.403 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-27T02:27:41.410 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:27:41.410 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-27T02:27:41.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get update 2024-08-27T02:27:41.424 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2024-08-27T02:27:41.583 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-27T02:27:41.594 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-27T02:27:41.603 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-27T02:27:41.611 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-27T02:27:41.642 INFO:teuthology.orchestra.run.smithi181.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy InRelease 2024-08-27T02:27:41.645 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy InRelease 2024-08-27T02:27:41.663 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-08-27T02:27:41.666 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-08-27T02:27:41.685 INFO:teuthology.orchestra.run.smithi181.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-27T02:27:41.688 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-27T02:27:41.706 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-08-27T02:27:41.709 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-08-27T02:27:41.716 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-27T02:27:41.725 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-27T02:27:41.733 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-08-27T02:27:41.737 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-08-27T02:27:41.793 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-27T02:27:42.148 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-27T02:27:42.178 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 158 kB in 1s (274 kB/s) 2024-08-27T02:27:42.318 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 157 kB in 1s (224 kB/s) 2024-08-27T02:27:43.186 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-08-27T02:27:43.202 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4504-gd17b2285-1jammy cephadm=19.3.0-4504-gd17b2285-1jammy ceph-mds=19.3.0-4504-gd17b2285-1jammy ceph-mgr=19.3.0-4504-gd17b2285-1jammy ceph-common=19.3.0-4504-gd17b2285-1jammy ceph-fuse=19.3.0-4504-gd17b2285-1jammy ceph-test=19.3.0-4504-gd17b2285-1jammy ceph-volume=19.3.0-4504-gd17b2285-1jammy radosgw=19.3.0-4504-gd17b2285-1jammy python3-rados=19.3.0-4504-gd17b2285-1jammy python3-rgw=19.3.0-4504-gd17b2285-1jammy python3-cephfs=19.3.0-4504-gd17b2285-1jammy python3-rbd=19.3.0-4504-gd17b2285-1jammy libcephfs2=19.3.0-4504-gd17b2285-1jammy libcephfs-dev=19.3.0-4504-gd17b2285-1jammy librados2=19.3.0-4504-gd17b2285-1jammy librbd1=19.3.0-4504-gd17b2285-1jammy rbd-fuse=19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:27:43.266 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-08-27T02:27:43.364 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:27:43.381 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4504-gd17b2285-1jammy cephadm=19.3.0-4504-gd17b2285-1jammy ceph-mds=19.3.0-4504-gd17b2285-1jammy ceph-mgr=19.3.0-4504-gd17b2285-1jammy ceph-common=19.3.0-4504-gd17b2285-1jammy ceph-fuse=19.3.0-4504-gd17b2285-1jammy ceph-test=19.3.0-4504-gd17b2285-1jammy ceph-volume=19.3.0-4504-gd17b2285-1jammy radosgw=19.3.0-4504-gd17b2285-1jammy python3-rados=19.3.0-4504-gd17b2285-1jammy python3-rgw=19.3.0-4504-gd17b2285-1jammy python3-cephfs=19.3.0-4504-gd17b2285-1jammy python3-rbd=19.3.0-4504-gd17b2285-1jammy libcephfs2=19.3.0-4504-gd17b2285-1jammy libcephfs-dev=19.3.0-4504-gd17b2285-1jammy librados2=19.3.0-4504-gd17b2285-1jammy librbd1=19.3.0-4504-gd17b2285-1jammy rbd-fuse=19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:27:43.434 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:27:43.474 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-08-27T02:27:43.475 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-08-27T02:27:43.619 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-08-27T02:27:43.620 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-08-27T02:27:43.682 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:27:43.682 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:27:43.682 INFO:teuthology.orchestra.run.smithi181.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:27:43.683 INFO:teuthology.orchestra.run.smithi181.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:27:43.683 INFO:teuthology.orchestra.run.smithi181.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-27T02:27:43.683 INFO:teuthology.orchestra.run.smithi181.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-27T02:27:43.683 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:27:43.684 INFO:teuthology.orchestra.run.smithi181.stdout:The following additional packages will be installed: 2024-08-27T02:27:43.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-27T02:27:43.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-27T02:27:43.684 INFO:teuthology.orchestra.run.smithi181.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-27T02:27:43.685 INFO:teuthology.orchestra.run.smithi181.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-27T02:27:43.686 INFO:teuthology.orchestra.run.smithi181.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet zip 2024-08-27T02:27:43.687 INFO:teuthology.orchestra.run.smithi181.stdout:Suggested packages: 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout:Recommended packages: 2024-08-27T02:27:43.688 INFO:teuthology.orchestra.run.smithi181.stdout: btrfs-tools 2024-08-27T02:27:43.789 INFO:teuthology.orchestra.run.smithi181.stdout:The following NEW packages will be installed: 2024-08-27T02:27:43.790 INFO:teuthology.orchestra.run.smithi181.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-27T02:27:43.790 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-27T02:27:43.790 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-27T02:27:43.790 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-27T02:27:43.790 INFO:teuthology.orchestra.run.smithi181.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-27T02:27:43.790 INFO:teuthology.orchestra.run.smithi181.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-27T02:27:43.791 INFO:teuthology.orchestra.run.smithi181.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-27T02:27:43.791 INFO:teuthology.orchestra.run.smithi181.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-27T02:27:43.791 INFO:teuthology.orchestra.run.smithi181.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-27T02:27:43.791 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-27T02:27:43.791 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-27T02:27:43.791 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-27T02:27:43.791 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-27T02:27:43.792 INFO:teuthology.orchestra.run.smithi181.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-27T02:27:43.806 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:27:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:27:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:27:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:27:43.806 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-27T02:27:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-27T02:27:43.807 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:27:43.807 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-08-27T02:27:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-27T02:27:43.807 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-27T02:27:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-27T02:27:43.808 INFO:teuthology.orchestra.run.smithi143.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-27T02:27:43.809 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet zip 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-08-27T02:27:43.810 INFO:teuthology.orchestra.run.smithi143.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2024-08-27T02:27:43.811 INFO:teuthology.orchestra.run.smithi143.stdout: btrfs-tools 2024-08-27T02:27:43.912 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-08-27T02:27:43.912 INFO:teuthology.orchestra.run.smithi143.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-27T02:27:43.912 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-27T02:27:43.912 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-27T02:27:43.912 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-27T02:27:43.912 INFO:teuthology.orchestra.run.smithi143.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-27T02:27:43.912 INFO:teuthology.orchestra.run.smithi143.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-27T02:27:43.913 INFO:teuthology.orchestra.run.smithi143.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-27T02:27:43.913 INFO:teuthology.orchestra.run.smithi143.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-27T02:27:43.913 INFO:teuthology.orchestra.run.smithi143.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-27T02:27:43.913 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-27T02:27:43.913 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-27T02:27:43.914 INFO:teuthology.orchestra.run.smithi143.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-27T02:27:43.931 INFO:teuthology.orchestra.run.smithi181.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-08-27T02:27:43.931 INFO:teuthology.orchestra.run.smithi181.stdout:Need to get 251 MB of archives. 2024-08-27T02:27:43.931 INFO:teuthology.orchestra.run.smithi181.stdout:After this operation, 932 MB of additional disk space will be used. 2024-08-27T02:27:43.931 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4504-gd17b2285-1jammy [3,623 kB] 2024-08-27T02:27:43.977 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-27T02:27:44.068 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-08-27T02:27:44.068 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 251 MB of archives. 2024-08-27T02:27:44.068 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 932 MB of additional disk space will be used. 2024-08-27T02:27:44.069 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4504-gd17b2285-1jammy [3,623 kB] 2024-08-27T02:27:44.101 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-27T02:27:44.121 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4504-gd17b2285-1jammy [3,321 kB] 2024-08-27T02:27:44.174 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4504-gd17b2285-1jammy [721 kB] 2024-08-27T02:27:44.186 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4504-gd17b2285-1jammy [356 kB] 2024-08-27T02:27:44.192 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4504-gd17b2285-1jammy [32.8 kB] 2024-08-27T02:27:44.192 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4504-gd17b2285-1jammy [180 kB] 2024-08-27T02:27:44.195 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4504-gd17b2285-1jammy [70.2 kB] 2024-08-27T02:27:44.196 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4504-gd17b2285-1jammy [338 kB] 2024-08-27T02:27:44.201 INFO:teuthology.orchestra.run.smithi181.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4504-gd17b2285-1jammy [7,986 kB] 2024-08-27T02:27:44.342 INFO:teuthology.orchestra.run.smithi181.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4504-gd17b2285-1jammy [112 kB] 2024-08-27T02:27:44.347 INFO:teuthology.orchestra.run.smithi181.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4504-gd17b2285-1jammy [473 kB] 2024-08-27T02:27:44.350 INFO:teuthology.orchestra.run.smithi181.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4504-gd17b2285-1jammy [28.2 MB] 2024-08-27T02:27:44.400 INFO:teuthology.orchestra.run.smithi181.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-27T02:27:44.412 INFO:teuthology.orchestra.run.smithi181.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-27T02:27:44.493 INFO:teuthology.orchestra.run.smithi181.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-27T02:27:44.522 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-27T02:27:44.535 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-27T02:27:44.616 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-27T02:27:44.722 INFO:teuthology.orchestra.run.smithi181.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-27T02:27:44.733 INFO:teuthology.orchestra.run.smithi181.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-27T02:27:44.763 INFO:teuthology.orchestra.run.smithi181.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-27T02:27:44.771 INFO:teuthology.orchestra.run.smithi181.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-27T02:27:44.772 INFO:teuthology.orchestra.run.smithi181.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-27T02:27:44.773 INFO:teuthology.orchestra.run.smithi181.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-27T02:27:44.791 INFO:teuthology.orchestra.run.smithi181.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-27T02:27:44.796 INFO:teuthology.orchestra.run.smithi181.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-27T02:27:44.800 INFO:teuthology.orchestra.run.smithi181.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-27T02:27:44.804 INFO:teuthology.orchestra.run.smithi181.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-27T02:27:44.838 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4504-gd17b2285-1jammy [3,321 kB] 2024-08-27T02:27:44.845 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-27T02:27:44.856 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-27T02:27:44.885 INFO:teuthology.orchestra.run.smithi181.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-27T02:27:44.885 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-27T02:27:44.894 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-27T02:27:44.895 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-27T02:27:44.896 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-27T02:27:44.915 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-27T02:27:44.919 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-27T02:27:44.922 INFO:teuthology.orchestra.run.smithi181.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-27T02:27:44.923 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-27T02:27:44.927 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-27T02:27:45.008 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-27T02:27:45.011 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-27T02:27:45.016 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-27T02:27:45.019 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-27T02:27:45.020 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-27T02:27:45.021 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-27T02:27:45.021 INFO:teuthology.orchestra.run.smithi181.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-27T02:27:45.022 INFO:teuthology.orchestra.run.smithi181.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4504-gd17b2285-1jammy [5,207 kB] 2024-08-27T02:27:45.023 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-27T02:27:45.024 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-27T02:27:45.024 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-27T02:27:45.025 INFO:teuthology.orchestra.run.smithi181.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-27T02:27:45.026 INFO:teuthology.orchestra.run.smithi181.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-27T02:27:45.027 INFO:teuthology.orchestra.run.smithi181.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-27T02:27:45.029 INFO:teuthology.orchestra.run.smithi181.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-27T02:27:45.029 INFO:teuthology.orchestra.run.smithi181.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-27T02:27:45.030 INFO:teuthology.orchestra.run.smithi181.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-27T02:27:45.031 INFO:teuthology.orchestra.run.smithi181.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-27T02:27:45.034 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4504-gd17b2285-1jammy [721 kB] 2024-08-27T02:27:45.048 INFO:teuthology.orchestra.run.smithi181.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-27T02:27:45.058 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4504-gd17b2285-1jammy [356 kB] 2024-08-27T02:27:45.077 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4504-gd17b2285-1jammy [32.8 kB] 2024-08-27T02:27:45.078 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4504-gd17b2285-1jammy [180 kB] 2024-08-27T02:27:45.082 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4504-gd17b2285-1jammy [70.2 kB] 2024-08-27T02:27:45.084 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4504-gd17b2285-1jammy [338 kB] 2024-08-27T02:27:45.090 INFO:teuthology.orchestra.run.smithi181.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4504-gd17b2285-1jammy [251 kB] 2024-08-27T02:27:45.091 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-27T02:27:45.093 INFO:teuthology.orchestra.run.smithi181.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4504-gd17b2285-1jammy [124 kB] 2024-08-27T02:27:45.094 INFO:teuthology.orchestra.run.smithi181.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4504-gd17b2285-1jammy [1,561 kB] 2024-08-27T02:27:45.107 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-27T02:27:45.108 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-27T02:27:45.108 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-27T02:27:45.109 INFO:teuthology.orchestra.run.smithi181.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4504-gd17b2285-1jammy [6,306 kB] 2024-08-27T02:27:45.114 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-27T02:27:45.114 INFO:teuthology.orchestra.run.smithi181.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-27T02:27:45.114 INFO:teuthology.orchestra.run.smithi181.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-27T02:27:45.115 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-27T02:27:45.116 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4504-gd17b2285-1jammy [7,986 kB] 2024-08-27T02:27:45.120 INFO:teuthology.orchestra.run.smithi181.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-27T02:27:45.121 INFO:teuthology.orchestra.run.smithi181.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-27T02:27:45.122 INFO:teuthology.orchestra.run.smithi181.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-27T02:27:45.122 INFO:teuthology.orchestra.run.smithi181.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-27T02:27:45.124 INFO:teuthology.orchestra.run.smithi181.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-27T02:27:45.125 INFO:teuthology.orchestra.run.smithi181.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-27T02:27:45.129 INFO:teuthology.orchestra.run.smithi181.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-27T02:27:45.172 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-27T02:27:45.173 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-27T02:27:45.175 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-27T02:27:45.175 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-27T02:27:45.207 INFO:teuthology.orchestra.run.smithi181.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-27T02:27:45.209 INFO:teuthology.orchestra.run.smithi181.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-27T02:27:45.209 INFO:teuthology.orchestra.run.smithi181.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-27T02:27:45.220 INFO:teuthology.orchestra.run.smithi181.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-27T02:27:45.220 INFO:teuthology.orchestra.run.smithi181.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-27T02:27:45.222 INFO:teuthology.orchestra.run.smithi181.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-27T02:27:45.223 INFO:teuthology.orchestra.run.smithi181.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-27T02:27:45.225 INFO:teuthology.orchestra.run.smithi181.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-27T02:27:45.229 INFO:teuthology.orchestra.run.smithi181.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-27T02:27:45.235 INFO:teuthology.orchestra.run.smithi181.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4504-gd17b2285-1jammy [23.1 MB] 2024-08-27T02:27:45.253 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-27T02:27:45.255 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-27T02:27:45.257 INFO:teuthology.orchestra.run.smithi143.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-27T02:27:45.258 INFO:teuthology.orchestra.run.smithi143.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-27T02:27:45.268 INFO:teuthology.orchestra.run.smithi143.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-27T02:27:45.293 INFO:teuthology.orchestra.run.smithi181.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-27T02:27:45.312 INFO:teuthology.orchestra.run.smithi181.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-27T02:27:45.314 INFO:teuthology.orchestra.run.smithi181.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-27T02:27:45.318 INFO:teuthology.orchestra.run.smithi181.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-27T02:27:45.319 INFO:teuthology.orchestra.run.smithi181.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-27T02:27:45.335 INFO:teuthology.orchestra.run.smithi143.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-27T02:27:45.335 INFO:teuthology.orchestra.run.smithi143.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-27T02:27:45.337 INFO:teuthology.orchestra.run.smithi143.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-27T02:27:45.339 INFO:teuthology.orchestra.run.smithi143.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-27T02:27:45.343 INFO:teuthology.orchestra.run.smithi143.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-27T02:27:45.375 INFO:teuthology.orchestra.run.smithi181.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-27T02:27:45.379 INFO:teuthology.orchestra.run.smithi181.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-27T02:27:45.416 INFO:teuthology.orchestra.run.smithi143.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-27T02:27:45.419 INFO:teuthology.orchestra.run.smithi143.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-27T02:27:45.420 INFO:teuthology.orchestra.run.smithi143.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-27T02:27:45.425 INFO:teuthology.orchestra.run.smithi143.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-27T02:27:45.426 INFO:teuthology.orchestra.run.smithi143.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-27T02:27:45.497 INFO:teuthology.orchestra.run.smithi143.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-27T02:27:45.502 INFO:teuthology.orchestra.run.smithi143.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-27T02:27:45.542 INFO:teuthology.orchestra.run.smithi181.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-27T02:27:45.544 INFO:teuthology.orchestra.run.smithi181.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-27T02:27:45.546 INFO:teuthology.orchestra.run.smithi181.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-27T02:27:45.547 INFO:teuthology.orchestra.run.smithi181.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-27T02:27:45.549 INFO:teuthology.orchestra.run.smithi181.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-27T02:27:45.586 INFO:teuthology.orchestra.run.smithi181.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-27T02:27:45.589 INFO:teuthology.orchestra.run.smithi181.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-27T02:27:45.589 INFO:teuthology.orchestra.run.smithi181.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-27T02:27:45.647 INFO:teuthology.orchestra.run.smithi181.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-27T02:27:45.647 INFO:teuthology.orchestra.run.smithi181.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-27T02:27:45.665 INFO:teuthology.orchestra.run.smithi143.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-27T02:27:45.667 INFO:teuthology.orchestra.run.smithi143.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-27T02:27:45.669 INFO:teuthology.orchestra.run.smithi143.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-27T02:27:45.670 INFO:teuthology.orchestra.run.smithi143.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-27T02:27:45.672 INFO:teuthology.orchestra.run.smithi143.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-27T02:27:45.707 INFO:teuthology.orchestra.run.smithi143.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-27T02:27:45.709 INFO:teuthology.orchestra.run.smithi181.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-27T02:27:45.710 INFO:teuthology.orchestra.run.smithi181.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-27T02:27:45.710 INFO:teuthology.orchestra.run.smithi143.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-27T02:27:45.711 INFO:teuthology.orchestra.run.smithi143.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-27T02:27:45.711 INFO:teuthology.orchestra.run.smithi181.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-27T02:27:45.711 INFO:teuthology.orchestra.run.smithi181.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-27T02:27:45.712 INFO:teuthology.orchestra.run.smithi181.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-27T02:27:45.713 INFO:teuthology.orchestra.run.smithi181.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-27T02:27:45.719 INFO:teuthology.orchestra.run.smithi181.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-27T02:27:45.750 INFO:teuthology.orchestra.run.smithi143.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4504-gd17b2285-1jammy [112 kB] 2024-08-27T02:27:45.752 INFO:teuthology.orchestra.run.smithi143.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4504-gd17b2285-1jammy [473 kB] 2024-08-27T02:27:45.763 INFO:teuthology.orchestra.run.smithi143.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4504-gd17b2285-1jammy [28.2 MB] 2024-08-27T02:27:45.768 INFO:teuthology.orchestra.run.smithi143.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-27T02:27:45.768 INFO:teuthology.orchestra.run.smithi143.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-27T02:27:45.790 INFO:teuthology.orchestra.run.smithi181.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-27T02:27:45.832 INFO:teuthology.orchestra.run.smithi143.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-27T02:27:45.833 INFO:teuthology.orchestra.run.smithi143.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-27T02:27:45.834 INFO:teuthology.orchestra.run.smithi143.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-27T02:27:45.835 INFO:teuthology.orchestra.run.smithi143.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-27T02:27:45.836 INFO:teuthology.orchestra.run.smithi143.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-27T02:27:45.837 INFO:teuthology.orchestra.run.smithi143.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-27T02:27:45.843 INFO:teuthology.orchestra.run.smithi143.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-27T02:27:45.877 INFO:teuthology.orchestra.run.smithi181.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-27T02:27:45.879 INFO:teuthology.orchestra.run.smithi181.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4504-gd17b2285-1jammy [14.0 kB] 2024-08-27T02:27:45.879 INFO:teuthology.orchestra.run.smithi181.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-27T02:27:45.879 INFO:teuthology.orchestra.run.smithi181.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4504-gd17b2285-1jammy [880 kB] 2024-08-27T02:27:45.891 INFO:teuthology.orchestra.run.smithi181.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-27T02:27:45.892 INFO:teuthology.orchestra.run.smithi181.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4504-gd17b2285-1jammy [2,434 kB] 2024-08-27T02:27:45.894 INFO:teuthology.orchestra.run.smithi181.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-27T02:27:45.896 INFO:teuthology.orchestra.run.smithi181.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-27T02:27:45.897 INFO:teuthology.orchestra.run.smithi181.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-27T02:27:45.909 INFO:teuthology.orchestra.run.smithi181.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-27T02:27:45.910 INFO:teuthology.orchestra.run.smithi181.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-27T02:27:45.913 INFO:teuthology.orchestra.run.smithi143.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-27T02:27:45.917 INFO:teuthology.orchestra.run.smithi143.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-27T02:27:45.917 INFO:teuthology.orchestra.run.smithi181.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-27T02:27:45.918 INFO:teuthology.orchestra.run.smithi143.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-27T02:27:45.928 INFO:teuthology.orchestra.run.smithi181.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4504-gd17b2285-1jammy [810 kB] 2024-08-27T02:27:45.938 INFO:teuthology.orchestra.run.smithi181.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4504-gd17b2285-1jammy [159 kB] 2024-08-27T02:27:45.940 INFO:teuthology.orchestra.run.smithi181.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4504-gd17b2285-1jammy [61.3 MB] 2024-08-27T02:27:45.963 INFO:teuthology.orchestra.run.smithi181.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-27T02:27:45.995 INFO:teuthology.orchestra.run.smithi143.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-27T02:27:46.001 INFO:teuthology.orchestra.run.smithi143.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-27T02:27:46.004 INFO:teuthology.orchestra.run.smithi143.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-27T02:27:46.005 INFO:teuthology.orchestra.run.smithi143.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-27T02:27:46.010 INFO:teuthology.orchestra.run.smithi181.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-27T02:27:46.010 INFO:teuthology.orchestra.run.smithi181.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-27T02:27:46.014 INFO:teuthology.orchestra.run.smithi181.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-27T02:27:46.016 INFO:teuthology.orchestra.run.smithi181.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-27T02:27:46.017 INFO:teuthology.orchestra.run.smithi143.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-27T02:27:46.018 INFO:teuthology.orchestra.run.smithi143.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-27T02:27:46.025 INFO:teuthology.orchestra.run.smithi143.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-27T02:27:46.033 INFO:teuthology.orchestra.run.smithi181.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-27T02:27:46.034 INFO:teuthology.orchestra.run.smithi181.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-27T02:27:46.045 INFO:teuthology.orchestra.run.smithi181.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-27T02:27:46.051 INFO:teuthology.orchestra.run.smithi181.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-27T02:27:46.052 INFO:teuthology.orchestra.run.smithi181.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-27T02:27:46.076 INFO:teuthology.orchestra.run.smithi143.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-27T02:27:46.078 INFO:teuthology.orchestra.run.smithi143.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-27T02:27:46.079 INFO:teuthology.orchestra.run.smithi143.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-27T02:27:46.158 INFO:teuthology.orchestra.run.smithi143.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-27T02:27:46.160 INFO:teuthology.orchestra.run.smithi143.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-27T02:27:46.177 INFO:teuthology.orchestra.run.smithi143.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-27T02:27:46.177 INFO:teuthology.orchestra.run.smithi143.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-27T02:27:46.178 INFO:teuthology.orchestra.run.smithi143.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-27T02:27:46.183 INFO:teuthology.orchestra.run.smithi143.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-27T02:27:46.185 INFO:teuthology.orchestra.run.smithi143.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-27T02:27:46.902 INFO:teuthology.orchestra.run.smithi143.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4504-gd17b2285-1jammy [5,207 kB] 2024-08-27T02:27:47.023 INFO:teuthology.orchestra.run.smithi143.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4504-gd17b2285-1jammy [251 kB] 2024-08-27T02:27:47.028 INFO:teuthology.orchestra.run.smithi143.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4504-gd17b2285-1jammy [124 kB] 2024-08-27T02:27:47.042 INFO:teuthology.orchestra.run.smithi143.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4504-gd17b2285-1jammy [1,561 kB] 2024-08-27T02:27:47.098 INFO:teuthology.orchestra.run.smithi143.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4504-gd17b2285-1jammy [6,306 kB] 2024-08-27T02:27:47.337 INFO:teuthology.orchestra.run.smithi143.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4504-gd17b2285-1jammy [23.1 MB] 2024-08-27T02:27:47.905 INFO:teuthology.orchestra.run.smithi181.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4504-gd17b2285-1jammy [8,625 kB] 2024-08-27T02:27:48.070 INFO:teuthology.orchestra.run.smithi143.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4504-gd17b2285-1jammy [14.0 kB] 2024-08-27T02:27:48.070 INFO:teuthology.orchestra.run.smithi143.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4504-gd17b2285-1jammy [880 kB] 2024-08-27T02:27:48.074 INFO:teuthology.orchestra.run.smithi181.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4504-gd17b2285-1jammy [14.2 kB] 2024-08-27T02:27:48.075 INFO:teuthology.orchestra.run.smithi181.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4504-gd17b2285-1jammy [55.7 MB] 2024-08-27T02:27:48.085 INFO:teuthology.orchestra.run.smithi143.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4504-gd17b2285-1jammy [2,434 kB] 2024-08-27T02:27:48.123 INFO:teuthology.orchestra.run.smithi143.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4504-gd17b2285-1jammy [810 kB] 2024-08-27T02:27:48.157 INFO:teuthology.orchestra.run.smithi143.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4504-gd17b2285-1jammy [159 kB] 2024-08-27T02:27:48.168 INFO:teuthology.orchestra.run.smithi143.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4504-gd17b2285-1jammy [61.3 MB] 2024-08-27T02:27:49.847 INFO:teuthology.orchestra.run.smithi181.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4504-gd17b2285-1jammy [130 kB] 2024-08-27T02:27:49.850 INFO:teuthology.orchestra.run.smithi181.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4504-gd17b2285-1jammy [38.9 kB] 2024-08-27T02:27:49.912 INFO:teuthology.orchestra.run.smithi181.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4504-gd17b2285-1jammy [15.9 MB] 2024-08-27T02:27:50.328 INFO:teuthology.orchestra.run.smithi181.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4504-gd17b2285-1jammy [91.3 kB] 2024-08-27T02:27:50.544 INFO:teuthology.orchestra.run.smithi143.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4504-gd17b2285-1jammy [8,625 kB] 2024-08-27T02:27:50.652 INFO:teuthology.orchestra.run.smithi143.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4504-gd17b2285-1jammy [14.2 kB] 2024-08-27T02:27:50.653 INFO:teuthology.orchestra.run.smithi143.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4504-gd17b2285-1jammy [55.7 MB] 2024-08-27T02:27:50.900 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 251 MB in 7s (38.4 MB/s) 2024-08-27T02:27:51.045 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-27T02:27:51.145 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-27T02:27:51.150 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-27T02:27:51.235 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-27T02:27:51.564 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-27T02:27:51.590 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-27T02:27:51.622 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-27T02:27:51.828 INFO:teuthology.orchestra.run.smithi143.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4504-gd17b2285-1jammy [130 kB] 2024-08-27T02:27:51.830 INFO:teuthology.orchestra.run.smithi143.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4504-gd17b2285-1jammy [38.9 kB] 2024-08-27T02:27:51.831 INFO:teuthology.orchestra.run.smithi143.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4504-gd17b2285-1jammy [15.9 MB] 2024-08-27T02:27:51.917 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-27T02:27:51.943 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-27T02:27:51.983 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-27T02:27:52.125 INFO:teuthology.orchestra.run.smithi143.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/pr-56597/d17b22856a85d7d49d47be692c778d4419f41641/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4504-gd17b2285-1jammy [91.3 kB] 2024-08-27T02:27:52.420 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-27T02:27:52.446 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-27T02:27:52.495 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:27:52.696 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 251 MB in 8s (30.6 MB/s) 2024-08-27T02:27:52.848 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-27T02:27:52.859 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-27T02:27:52.874 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-27T02:27:52.915 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:27:52.956 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-27T02:27:52.962 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-27T02:27:53.041 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-27T02:27:53.235 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-27T02:27:53.261 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-27T02:27:53.301 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:27:53.386 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-27T02:27:53.412 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-27T02:27:53.452 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-27T02:27:53.629 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-27T02:27:53.655 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-27T02:27:53.696 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-27T02:27:53.730 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-27T02:27:53.745 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-27T02:27:53.780 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-27T02:27:53.990 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librados2. 2024-08-27T02:27:54.016 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../007-librados2_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:54.057 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librados2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:54.175 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-27T02:27:54.201 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-27T02:27:54.250 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:27:54.451 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librbd1. 2024-08-27T02:27:54.466 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../008-librbd1_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:54.509 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librbd1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:54.619 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-27T02:27:54.635 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-27T02:27:54.669 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:27:54.987 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcephfs2. 2024-08-27T02:27:55.005 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-27T02:27:55.013 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:55.032 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-27T02:27:55.054 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcephfs2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:55.072 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:27:55.340 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rados. 2024-08-27T02:27:55.366 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:55.406 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rados (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:55.408 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-27T02:27:55.435 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-27T02:27:55.475 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-27T02:27:55.718 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-27T02:27:55.744 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:27:55.776 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-ceph-argparse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:55.786 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librados2. 2024-08-27T02:27:55.812 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../007-librados2_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:55.852 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librados2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:55.995 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cephfs. 2024-08-27T02:27:56.010 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:56.045 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cephfs (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:56.322 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librbd1. 2024-08-27T02:27:56.339 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-27T02:27:56.348 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../008-librbd1_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:56.365 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:27:56.388 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librbd1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:56.406 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:56.692 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-27T02:27:56.718 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-27T02:27:56.759 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-27T02:27:57.000 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs2. 2024-08-27T02:27:57.026 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:57.045 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-prettytable. 2024-08-27T02:27:57.072 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-27T02:27:57.103 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-27T02:27:57.158 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:57.356 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rbd. 2024-08-27T02:27:57.373 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:57.410 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rados. 2024-08-27T02:27:57.414 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rbd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:57.425 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:57.460 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rados (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:57.717 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-27T02:27:57.721 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-27T02:27:57.736 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:27:57.744 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-27T02:27:57.779 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-argparse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:57.783 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-27T02:27:58.028 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-27T02:27:58.031 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cephfs. 2024-08-27T02:27:58.043 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-27T02:27:58.046 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:58.086 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-27T02:27:58.089 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cephfs (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:58.384 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-27T02:27:58.411 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:27:58.450 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:58.745 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-27T02:27:58.760 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-27T02:27:58.803 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-27T02:27:58.956 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-27T02:27:58.982 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-27T02:27:59.023 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-27T02:27:59.106 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-prettytable. 2024-08-27T02:27:59.132 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-27T02:27:59.172 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-27T02:27:59.359 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua5.1. 2024-08-27T02:27:59.386 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-27T02:27:59.425 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rbd. 2024-08-27T02:27:59.426 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-27T02:27:59.441 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:27:59.483 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rbd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:27:59.695 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua-any. 2024-08-27T02:27:59.710 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-27T02:27:59.754 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-27T02:27:59.827 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-27T02:27:59.843 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-27T02:27:59.885 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-27T02:27:59.981 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package zip. 2024-08-27T02:27:59.996 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-27T02:28:00.039 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking zip (3.0-12build2) ... 2024-08-27T02:28:00.155 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-27T02:28:00.170 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-27T02:28:00.205 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-27T02:28:00.351 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package unzip. 2024-08-27T02:28:00.377 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-27T02:28:00.418 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-27T02:28:00.482 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-27T02:28:00.509 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-27T02:28:00.549 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-27T02:28:00.763 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package luarocks. 2024-08-27T02:28:00.790 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-27T02:28:00.822 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-27T02:28:00.910 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua5.1. 2024-08-27T02:28:00.937 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-27T02:28:00.977 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-27T02:28:01.171 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librgw2. 2024-08-27T02:28:01.198 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../025-librgw2_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:01.237 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librgw2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:01.280 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-any. 2024-08-27T02:28:01.295 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-27T02:28:01.338 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-27T02:28:01.565 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package zip. 2024-08-27T02:28:01.580 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-27T02:28:01.615 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking zip (3.0-12build2) ... 2024-08-27T02:28:01.865 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rgw. 2024-08-27T02:28:01.880 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:01.901 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package unzip. 2024-08-27T02:28:01.923 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:01.927 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-27T02:28:01.968 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-27T02:28:02.260 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-27T02:28:02.286 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-27T02:28:02.326 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-27T02:28:02.363 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package luarocks. 2024-08-27T02:28:02.390 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-27T02:28:02.430 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-27T02:28:02.587 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libradosstriper1. 2024-08-27T02:28:02.614 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:02.645 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libradosstriper1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:02.812 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librgw2. 2024-08-27T02:28:02.839 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../025-librgw2_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:02.887 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librgw2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:03.065 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-common. 2024-08-27T02:28:03.092 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:03.132 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:03.498 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rgw. 2024-08-27T02:28:03.524 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:03.564 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:03.850 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-27T02:28:03.877 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-27T02:28:03.918 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-27T02:28:04.227 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libradosstriper1. 2024-08-27T02:28:04.254 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:04.294 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libradosstriper1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:04.604 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-base. 2024-08-27T02:28:04.630 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:04.681 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-base (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:04.731 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-common. 2024-08-27T02:28:04.757 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:04.797 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:05.267 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-27T02:28:05.293 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-27T02:28:05.325 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-27T02:28:05.611 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cheroot. 2024-08-27T02:28:05.638 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-27T02:28:05.677 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-27T02:28:05.989 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-27T02:28:06.015 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-27T02:28:06.055 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-27T02:28:06.319 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-base. 2024-08-27T02:28:06.345 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:06.358 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-27T02:28:06.385 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-27T02:28:06.386 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-base (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:06.425 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-27T02:28:06.711 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-27T02:28:06.738 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-27T02:28:06.778 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-27T02:28:06.981 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-27T02:28:07.007 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-27T02:28:07.047 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-27T02:28:07.089 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-tempora. 2024-08-27T02:28:07.115 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-27T02:28:07.155 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-27T02:28:07.350 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cheroot. 2024-08-27T02:28:07.376 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-27T02:28:07.425 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-27T02:28:07.444 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-portend. 2024-08-27T02:28:07.464 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-27T02:28:07.502 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-27T02:28:07.753 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-27T02:28:07.779 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-27T02:28:07.805 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-27T02:28:07.819 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-27T02:28:07.831 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-27T02:28:07.871 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-27T02:28:08.147 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-27T02:28:08.157 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-27T02:28:08.173 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-27T02:28:08.184 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-27T02:28:08.213 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-27T02:28:08.224 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-27T02:28:08.491 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-27T02:28:08.518 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-27T02:28:08.558 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-27T02:28:08.594 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-natsort. 2024-08-27T02:28:08.621 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-27T02:28:08.661 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-27T02:28:08.810 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempora. 2024-08-27T02:28:08.837 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-27T02:28:08.877 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-27T02:28:08.972 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-logutils. 2024-08-27T02:28:08.998 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-27T02:28:09.039 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-27T02:28:09.182 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-portend. 2024-08-27T02:28:09.208 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-27T02:28:09.248 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-27T02:28:09.341 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-27T02:28:09.368 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-27T02:28:09.408 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-27T02:28:09.543 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-27T02:28:09.558 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-27T02:28:09.593 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-27T02:28:09.686 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-mako. 2024-08-27T02:28:09.701 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-27T02:28:09.736 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-27T02:28:09.854 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-27T02:28:09.880 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-27T02:28:09.921 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-27T02:28:10.022 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-27T02:28:10.049 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-27T02:28:10.080 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-27T02:28:10.258 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-natsort. 2024-08-27T02:28:10.284 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-27T02:28:10.324 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-27T02:28:10.375 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-27T02:28:10.402 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-27T02:28:10.441 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-27T02:28:10.595 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-logutils. 2024-08-27T02:28:10.610 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-27T02:28:10.644 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-27T02:28:10.736 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-webob. 2024-08-27T02:28:10.763 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-27T02:28:10.802 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-27T02:28:10.956 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-27T02:28:10.983 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-27T02:28:11.023 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-27T02:28:11.155 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-waitress. 2024-08-27T02:28:11.182 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-27T02:28:11.225 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-27T02:28:11.326 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-mako. 2024-08-27T02:28:11.352 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-27T02:28:11.392 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-27T02:28:11.500 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-tempita. 2024-08-27T02:28:11.527 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-27T02:28:11.558 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-27T02:28:11.712 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-27T02:28:11.739 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-27T02:28:11.779 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-27T02:28:11.861 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-paste. 2024-08-27T02:28:11.888 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-27T02:28:11.927 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-27T02:28:12.083 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-27T02:28:12.109 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-27T02:28:12.149 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-27T02:28:12.239 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-27T02:28:12.255 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-27T02:28:12.289 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-27T02:28:12.452 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webob. 2024-08-27T02:28:12.467 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-27T02:28:12.510 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-27T02:28:12.567 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-27T02:28:12.593 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-27T02:28:12.633 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-27T02:28:12.863 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-waitress. 2024-08-27T02:28:12.890 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-27T02:28:12.933 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-27T02:28:12.936 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-webtest. 2024-08-27T02:28:12.963 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-27T02:28:13.003 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-27T02:28:13.250 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempita. 2024-08-27T02:28:13.276 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-27T02:28:13.314 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pecan. 2024-08-27T02:28:13.316 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-27T02:28:13.341 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-27T02:28:13.380 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-27T02:28:13.569 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-paste. 2024-08-27T02:28:13.584 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-27T02:28:13.628 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-27T02:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-certifi. 2024-08-27T02:28:13.745 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-27T02:28:13.785 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-27T02:28:13.948 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-27T02:28:13.963 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-27T02:28:14.014 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-27T02:28:14.293 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-27T02:28:14.319 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-27T02:28:14.359 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-27T02:28:14.662 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webtest. 2024-08-27T02:28:14.689 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-27T02:28:14.729 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-27T02:28:14.947 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-idna. 2024-08-27T02:28:14.974 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-27T02:28:15.013 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-27T02:28:15.040 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pecan. 2024-08-27T02:28:15.067 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-27T02:28:15.107 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-27T02:28:15.333 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-urllib3. 2024-08-27T02:28:15.359 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-27T02:28:15.391 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-27T02:28:15.471 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-certifi. 2024-08-27T02:28:15.497 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-27T02:28:15.537 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-27T02:28:15.694 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-requests. 2024-08-27T02:28:15.720 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-27T02:28:15.760 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-27T02:28:15.840 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-idna. 2024-08-27T02:28:15.867 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-27T02:28:15.898 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-27T02:28:16.038 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-27T02:28:16.065 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-27T02:28:16.105 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-27T02:28:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-urllib3. 2024-08-27T02:28:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-27T02:28:16.268 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-27T02:28:16.383 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-27T02:28:16.398 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:16.441 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:16.588 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests. 2024-08-27T02:28:16.615 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-27T02:28:16.655 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-27T02:28:16.813 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-27T02:28:16.839 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:16.879 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:17.083 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-27T02:28:17.110 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-27T02:28:17.182 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-27T02:28:17.209 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-27T02:28:17.248 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-27T02:28:17.500 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-27T02:28:17.534 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-openssl. 2024-08-27T02:28:17.561 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-27T02:28:17.601 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-27T02:28:17.921 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr. 2024-08-27T02:28:17.947 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:17.987 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:18.095 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-27T02:28:18.121 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:18.161 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:18.399 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mon. 2024-08-27T02:28:18.425 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:18.473 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mon (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:18.526 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-27T02:28:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:18.575 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-27T02:28:18.905 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-27T02:28:18.944 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-27T02:28:19.085 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-osd. 2024-08-27T02:28:19.112 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:19.151 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-osd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:19.247 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-openssl. 2024-08-27T02:28:19.274 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-27T02:28:19.314 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-27T02:28:19.618 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr. 2024-08-27T02:28:19.644 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:19.676 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:20.054 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mon. 2024-08-27T02:28:20.081 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:20.120 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mon (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:20.230 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph. 2024-08-27T02:28:20.245 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../066-ceph_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:20.288 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:20.608 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-fuse. 2024-08-27T02:28:20.634 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:20.674 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:20.733 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-osd. 2024-08-27T02:28:20.760 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:20.799 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-osd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:21.011 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mds. 2024-08-27T02:28:21.028 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:21.060 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mds (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:21.447 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package cephadm. 2024-08-27T02:28:21.473 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../069-cephadm_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:21.513 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:21.857 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-27T02:28:21.861 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph. 2024-08-27T02:28:21.876 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../066-ceph_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:21.884 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-27T02:28:21.911 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:21.924 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-27T02:28:22.202 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-27T02:28:22.214 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-fuse. 2024-08-27T02:28:22.229 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-27T02:28:22.240 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:22.268 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-27T02:28:22.280 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:22.668 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mds. 2024-08-27T02:28:22.694 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:22.734 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mds (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:23.187 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephadm. 2024-08-27T02:28:23.214 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../069-cephadm_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:23.245 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:23.265 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-babel. 2024-08-27T02:28:23.292 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-27T02:28:23.331 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-27T02:28:23.532 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-27T02:28:23.558 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-27T02:28:23.598 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-27T02:28:23.643 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jinja2. 2024-08-27T02:28:23.669 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-27T02:28:23.709 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-27T02:28:23.893 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-27T02:28:23.908 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-27T02:28:23.943 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-27T02:28:24.037 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-27T02:28:24.064 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:24.103 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:24.449 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-27T02:28:24.475 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-27T02:28:24.515 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-27T02:28:24.843 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-routes. 2024-08-27T02:28:24.869 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-27T02:28:24.898 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-babel. 2024-08-27T02:28:24.909 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-27T02:28:24.925 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-27T02:28:24.964 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-27T02:28:25.271 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-27T02:28:25.298 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:25.318 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jinja2. 2024-08-27T02:28:25.344 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-27T02:28:25.345 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:25.384 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-27T02:28:25.746 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-27T02:28:25.773 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:25.812 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:26.166 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-27T02:28:26.193 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-27T02:28:26.233 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-27T02:28:26.536 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-routes. 2024-08-27T02:28:26.563 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-27T02:28:26.602 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-27T02:28:26.964 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-27T02:28:26.991 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:27.030 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:28.142 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-27T02:28:28.159 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-27T02:28:28.191 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-27T02:28:28.653 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-joblib. 2024-08-27T02:28:28.681 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-27T02:28:28.720 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-27T02:28:29.073 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-27T02:28:29.101 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-27T02:28:29.139 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-27T02:28:29.401 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-sklearn. 2024-08-27T02:28:29.428 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-27T02:28:29.467 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-27T02:28:30.178 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-27T02:28:30.196 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-27T02:28:30.236 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-27T02:28:30.417 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-27T02:28:30.433 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:30.561 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:30.657 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-joblib. 2024-08-27T02:28:30.684 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-27T02:28:30.715 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-27T02:28:31.102 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-27T02:28:31.130 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-27T02:28:31.169 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-27T02:28:31.447 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn. 2024-08-27T02:28:31.474 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-27T02:28:31.505 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-27T02:28:31.531 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cachetools. 2024-08-27T02:28:31.559 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-27T02:28:31.597 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-27T02:28:31.926 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-27T02:28:31.953 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-27T02:28:31.992 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-27T02:28:32.223 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-27T02:28:32.251 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:32.303 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-27T02:28:32.319 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-27T02:28:32.353 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-27T02:28:32.375 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:32.623 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rsa. 2024-08-27T02:28:32.639 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-27T02:28:32.673 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-27T02:28:32.985 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-google-auth. 2024-08-27T02:28:33.013 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-27T02:28:33.052 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-27T02:28:33.312 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cachetools. 2024-08-27T02:28:33.340 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-27T02:28:33.363 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-27T02:28:33.379 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-27T02:28:33.390 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-27T02:28:33.429 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-27T02:28:33.682 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-27T02:28:33.710 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-27T02:28:33.740 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-27T02:28:33.741 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-websocket. 2024-08-27T02:28:33.768 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-27T02:28:33.807 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-27T02:28:34.044 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-27T02:28:34.072 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-27T02:28:34.110 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-27T02:28:34.119 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-27T02:28:34.146 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-27T02:28:34.185 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-27T02:28:34.553 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rsa. 2024-08-27T02:28:34.582 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-27T02:28:34.661 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-27T02:28:34.799 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-27T02:28:34.815 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:34.849 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:35.159 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-google-auth. 2024-08-27T02:28:35.187 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-27T02:28:35.193 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-27T02:28:35.222 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-27T02:28:35.226 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-27T02:28:35.259 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-27T02:28:35.571 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-27T02:28:35.598 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-27T02:28:35.613 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-27T02:28:35.637 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-27T02:28:35.641 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-27T02:28:35.679 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-27T02:28:35.915 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package jq. 2024-08-27T02:28:35.915 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-websocket. 2024-08-27T02:28:35.932 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-27T02:28:35.943 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-27T02:28:35.965 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-27T02:28:35.974 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-27T02:28:36.209 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package socat. 2024-08-27T02:28:36.225 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-27T02:28:36.244 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-27T02:28:36.267 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-27T02:28:36.272 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-27T02:28:36.311 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-27T02:28:36.579 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package xmlstarlet. 2024-08-27T02:28:36.595 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-27T02:28:36.629 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-27T02:28:36.975 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-test. 2024-08-27T02:28:36.991 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:37.000 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-27T02:28:37.030 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:37.033 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-test (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:37.067 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:37.386 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-27T02:28:37.414 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-27T02:28:37.453 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-27T02:28:37.773 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-27T02:28:37.800 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-27T02:28:37.831 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-27T02:28:38.084 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package jq. 2024-08-27T02:28:38.112 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-27T02:28:38.150 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-27T02:28:38.403 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package socat. 2024-08-27T02:28:38.431 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-27T02:28:38.470 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-27T02:28:38.773 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package xmlstarlet. 2024-08-27T02:28:38.801 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-27T02:28:38.840 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-27T02:28:39.169 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-test. 2024-08-27T02:28:39.197 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:39.236 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-test (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:39.546 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-volume. 2024-08-27T02:28:39.574 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:39.612 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-volume (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:39.924 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-27T02:28:39.941 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:39.982 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcephfs-dev (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:40.277 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-27T02:28:40.305 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-27T02:28:40.335 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-27T02:28:40.665 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-27T02:28:40.693 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-27T02:28:40.731 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-27T02:28:41.077 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package nvme-cli. 2024-08-27T02:28:41.104 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-27T02:28:41.143 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-27T02:28:41.573 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package pkg-config. 2024-08-27T02:28:41.601 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-27T02:28:41.640 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-27T02:28:41.865 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-volume. 2024-08-27T02:28:41.893 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4504-gd17b2285-1jammy_all.deb ... 2024-08-27T02:28:41.909 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-27T02:28:41.925 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-27T02:28:41.932 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-volume (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:41.959 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-27T02:28:42.236 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-27T02:28:42.264 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:42.303 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs-dev (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:42.362 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-27T02:28:42.390 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-27T02:28:42.429 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-27T02:28:42.597 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-27T02:28:42.625 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-27T02:28:42.664 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-27T02:28:42.690 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pastescript. 2024-08-27T02:28:42.706 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-27T02:28:42.748 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-27T02:28:42.994 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-27T02:28:43.022 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-27T02:28:43.026 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pluggy. 2024-08-27T02:28:43.043 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-27T02:28:43.060 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-27T02:28:43.076 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-27T02:28:43.363 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-psutil. 2024-08-27T02:28:43.381 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package nvme-cli. 2024-08-27T02:28:43.391 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-27T02:28:43.409 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-27T02:28:43.429 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-27T02:28:43.448 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-27T02:28:43.757 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-py. 2024-08-27T02:28:43.785 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-27T02:28:43.823 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-27T02:28:43.845 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pkg-config. 2024-08-27T02:28:43.873 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-27T02:28:43.903 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-27T02:28:44.127 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pygments. 2024-08-27T02:28:44.154 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-27T02:28:44.165 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-27T02:28:44.193 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-27T02:28:44.193 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-27T02:28:44.231 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-27T02:28:44.643 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-27T02:28:44.851 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-27T02:28:44.851 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-27T02:28:44.851 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-27T02:28:44.851 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-27T02:28:44.851 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-27T02:28:45.004 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastescript. 2024-08-27T02:28:45.016 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-toml. 2024-08-27T02:28:45.032 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-27T02:28:45.044 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-27T02:28:45.062 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-27T02:28:45.091 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-27T02:28:45.358 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pluggy. 2024-08-27T02:28:45.377 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pytest. 2024-08-27T02:28:45.386 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-27T02:28:45.406 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-27T02:28:45.433 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-27T02:28:45.443 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-27T02:28:45.744 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-psutil. 2024-08-27T02:28:45.772 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-27T02:28:45.791 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-simplejson. 2024-08-27T02:28:45.811 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-27T02:28:45.818 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-27T02:28:45.865 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-27T02:28:46.126 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-27T02:28:46.143 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-27T02:28:46.147 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-py. 2024-08-27T02:28:46.175 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-27T02:28:46.184 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-27T02:28:46.214 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-27T02:28:46.534 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pygments. 2024-08-27T02:28:46.562 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-27T02:28:46.600 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-27T02:28:46.913 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package radosgw. 2024-08-27T02:28:46.942 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../116-radosgw_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:46.979 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking radosgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:47.047 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-27T02:28:47.075 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-27T02:28:47.105 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-27T02:28:47.408 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-toml. 2024-08-27T02:28:47.435 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-27T02:28:47.474 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-27T02:28:47.777 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pytest. 2024-08-27T02:28:47.806 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-27T02:28:47.844 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-27T02:28:47.899 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package rbd-fuse. 2024-08-27T02:28:47.915 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:47.957 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking rbd-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:48.189 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplejson. 2024-08-27T02:28:48.217 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-27T02:28:48.229 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-27T02:28:48.255 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-27T02:28:48.487 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-27T02:28:48.544 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-27T02:28:48.572 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-27T02:28:48.605 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-27T02:28:48.610 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-27T02:28:48.864 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-27T02:28:49.202 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-27T02:28:49.340 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package radosgw. 2024-08-27T02:28:49.368 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../116-radosgw_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:49.406 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking radosgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:49.649 INFO:teuthology.orchestra.run.smithi181.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-27T02:28:49.715 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:50.216 INFO:teuthology.orchestra.run.smithi181.stdout:Adding system user cephadm....done 2024-08-27T02:28:50.363 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-27T02:28:50.501 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package rbd-fuse. 2024-08-27T02:28:50.518 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4504-gd17b2285-1jammy_amd64.deb ... 2024-08-27T02:28:50.559 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking rbd-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:50.631 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-27T02:28:50.856 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-27T02:28:50.874 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-27T02:28:51.000 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-27T02:28:51.106 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-27T02:28:51.208 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-27T02:28:51.234 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-27T02:28:51.441 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-27T02:28:51.486 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-27T02:28:51.612 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-27T02:28:51.779 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-27T02:28:51.955 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-27T02:28:52.258 INFO:teuthology.orchestra.run.smithi143.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-27T02:28:52.307 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-27T02:28:52.335 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:52.549 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-27T02:28:52.834 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-27T02:28:52.859 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user cephadm....done 2024-08-27T02:28:52.983 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-27T02:28:53.077 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-27T02:28:53.251 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-27T02:28:53.328 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-27T02:28:53.502 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-27T02:28:53.571 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-27T02:28:53.612 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-27T02:28:53.830 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-ceph-argparse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:53.863 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-27T02:28:54.090 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-27T02:28:54.122 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-27T02:28:54.199 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-27T02:28:54.248 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-27T02:28:54.317 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-27T02:28:54.418 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-27T02:28:54.534 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-27T02:28:54.677 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-27T02:28:54.894 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-27T02:28:55.068 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-27T02:28:55.116 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-27T02:28:55.162 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-27T02:28:55.180 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-27T02:28:55.306 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-27T02:28:55.430 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-27T02:28:55.674 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-27T02:28:55.706 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-27T02:28:55.783 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-27T02:28:55.941 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-27T02:28:56.034 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-27T02:28:56.209 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-27T02:28:56.302 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-27T02:28:56.452 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-argparse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:28:56.594 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up zip (3.0-12build2) ... 2024-08-27T02:28:56.721 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-27T02:28:56.795 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-27T02:28:56.921 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-27T02:28:57.047 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-27T02:28:57.181 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-27T02:28:57.423 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-27T02:28:57.424 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-27T02:28:57.674 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-27T02:28:57.775 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-27T02:28:57.821 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-27T02:28:57.848 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-27T02:28:57.876 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-27T02:28:57.911 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-27T02:28:58.038 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-27T02:28:58.185 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-27T02:28:58.397 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-27T02:28:58.523 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-27T02:28:58.561 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-27T02:28:58.791 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-27T02:28:58.804 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-27T02:28:59.051 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-27T02:28:59.189 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-27T02:28:59.360 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up zip (3.0-12build2) ... 2024-08-27T02:28:59.482 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-27T02:28:59.487 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-27T02:28:59.817 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-27T02:29:00.134 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-27T02:29:00.164 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-27T02:29:00.260 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:00.415 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-27T02:29:00.516 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-27T02:29:00.561 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-27T02:29:00.617 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-27T02:29:00.887 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-27T02:29:00.927 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-27T02:29:01.337 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-27T02:29:01.588 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-27T02:29:01.956 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-27T02:29:02.250 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-27T02:29:02.377 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-27T02:29:02.601 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-27T02:29:02.628 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:29:02.762 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-27T02:29:02.853 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-27T02:29:02.979 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:03.030 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-27T02:29:03.156 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-27T02:29:03.272 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-27T02:29:03.282 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-27T02:29:03.589 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-27T02:29:03.592 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-27T02:29:03.843 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-27T02:29:04.085 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:29:04.186 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-27T02:29:04.480 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-27T02:29:04.704 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-27T02:29:04.739 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-27T02:29:04.956 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:29:04.990 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-27T02:29:05.090 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-27T02:29:05.266 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-27T02:29:05.358 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-27T02:29:05.484 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-27T02:29:05.517 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-27T02:29:05.594 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-27T02:29:05.776 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-27T02:29:05.886 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-27T02:29:05.895 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-27T02:29:06.147 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-27T02:29:06.162 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-27T02:29:06.288 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-27T02:29:06.398 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:29:06.524 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-27T02:29:06.581 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-27T02:29:06.825 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-27T02:29:06.882 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-27T02:29:07.068 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-27T02:29:07.125 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-27T02:29:07.226 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-27T02:29:07.328 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-27T02:29:07.351 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-27T02:29:07.440 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-27T02:29:07.579 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-27T02:29:07.678 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-27T02:29:07.787 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-27T02:29:07.847 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-27T02:29:08.115 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-27T02:29:08.189 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-27T02:29:08.241 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-27T02:29:08.457 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-27T02:29:08.517 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-27T02:29:08.558 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-27T02:29:08.652 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-27T02:29:08.801 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:29:08.926 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-27T02:29:08.945 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-27T02:29:09.252 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-27T02:29:09.254 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-27T02:29:09.522 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-27T02:29:09.545 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-27T02:29:09.648 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-27T02:29:09.774 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-27T02:29:09.813 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-27T02:29:09.862 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-27T02:29:09.947 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-27T02:29:10.118 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-27T02:29:10.223 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-27T02:29:10.261 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-27T02:29:10.483 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-27T02:29:10.646 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-27T02:29:10.802 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-27T02:29:10.905 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-27T02:29:11.031 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-27T02:29:11.179 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-27T02:29:11.282 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-27T02:29:11.409 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-27T02:29:11.456 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-27T02:29:11.727 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-27T02:29:11.783 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-27T02:29:11.909 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librados2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:12.011 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-27T02:29:12.044 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:12.161 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-27T02:29:12.279 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-27T02:29:12.405 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-27T02:29:12.464 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcephfs2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:12.590 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libradosstriper1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:12.673 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-27T02:29:12.716 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-27T02:29:12.949 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-27T02:29:12.992 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librbd1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:13.119 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-modules-core (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:13.236 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:13.295 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-27T02:29:13.440 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-27T02:29:13.440 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-27T02:29:13.671 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-27T02:29:13.938 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcephfs-dev (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:13.956 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-27T02:29:14.064 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rados (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:14.190 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librgw2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:14.292 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-27T02:29:14.316 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-27T02:29:14.402 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librados2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:14.528 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:14.671 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-27T02:29:15.007 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.133 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libradosstriper1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.259 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-27T02:29:15.527 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rbd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.528 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librbd1 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.653 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up rbd-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.654 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-modules-core (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.779 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.780 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.905 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cephfs (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:15.990 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-27T02:29:15.990 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-27T02:29:16.023 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:16.448 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs-dev (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:16.524 INFO:teuthology.orchestra.run.smithi181.stdout:Adding group ceph....done 2024-08-27T02:29:16.574 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rados (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:16.700 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librgw2 (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:16.826 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-27T02:29:16.910 INFO:teuthology.orchestra.run.smithi181.stdout:Adding system user ceph....done 2024-08-27T02:29:17.077 INFO:teuthology.orchestra.run.smithi181.stdout:Setting system user ceph properties....done 2024-08-27T02:29:17.097 INFO:teuthology.orchestra.run.smithi181.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-27T02:29:17.237 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-27T02:29:17.568 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-27T02:29:18.063 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rbd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:18.091 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-test (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:18.189 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up rbd-fuse (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up radosgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:18.316 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:18.442 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cephfs (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:18.551 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-common (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:18.724 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-27T02:29:18.725 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-27T02:29:19.087 INFO:teuthology.orchestra.run.smithi143.stdout:Adding group ceph....done 2024-08-27T02:29:19.202 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-base (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:19.464 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user ceph....done 2024-08-27T02:29:19.540 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-27T02:29:19.623 INFO:teuthology.orchestra.run.smithi143.stdout:Setting system user ceph properties....done 2024-08-27T02:29:19.638 INFO:teuthology.orchestra.run.smithi143.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-27T02:29:19.778 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-27T02:29:19.987 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mds (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:20.138 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-27T02:29:20.214 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-27T02:29:20.214 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-27T02:29:20.629 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-test (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:20.714 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:20.933 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-27T02:29:20.934 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-27T02:29:21.024 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up radosgw (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:21.415 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-osd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:21.637 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-27T02:29:21.637 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-27T02:29:21.697 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-27T02:29:21.697 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-27T02:29:22.123 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-base (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:22.163 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:22.289 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:22.406 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mon (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:22.503 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-27T02:29:22.603 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-27T02:29:22.604 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-27T02:29:22.975 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mds (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:23.116 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:23.187 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-27T02:29:23.187 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-27T02:29:23.267 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:23.393 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-dashboard (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:23.528 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-volume (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:23.703 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:23.880 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-27T02:29:23.938 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-27T02:29:23.939 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-27T02:29:23.998 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-27T02:29:24.150 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-27T02:29:24.455 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-osd (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:24.743 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-27T02:29:24.743 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-27T02:29:25.218 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-27T02:29:25.240 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:25.367 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:25.518 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mon (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:25.724 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-27T02:29:25.724 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-27T02:29:25.838 INFO:teuthology.orchestra.run.smithi181.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-27T02:29:25.841 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-08-27T02:29:25.898 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-08-27T02:29:26.107 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-08-27T02:29:26.107 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-08-27T02:29:26.186 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-cephadm (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:26.303 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:29:26.303 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:29:26.303 INFO:teuthology.orchestra.run.smithi181.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:29:26.303 INFO:teuthology.orchestra.run.smithi181.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:29:26.304 INFO:teuthology.orchestra.run.smithi181.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-27T02:29:26.304 INFO:teuthology.orchestra.run.smithi181.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-27T02:29:26.304 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:29:26.305 INFO:teuthology.orchestra.run.smithi181.stdout:The following additional packages will be installed: 2024-08-27T02:29:26.305 INFO:teuthology.orchestra.run.smithi181.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-27T02:29:26.306 INFO:teuthology.orchestra.run.smithi181.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-27T02:29:26.307 INFO:teuthology.orchestra.run.smithi181.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-08-27T02:29:26.307 INFO:teuthology.orchestra.run.smithi181.stdout:Suggested packages: 2024-08-27T02:29:26.307 INFO:teuthology.orchestra.run.smithi181.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-08-27T02:29:26.307 INFO:teuthology.orchestra.run.smithi181.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-08-27T02:29:26.307 INFO:teuthology.orchestra.run.smithi181.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-08-27T02:29:26.307 INFO:teuthology.orchestra.run.smithi181.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-08-27T02:29:26.307 INFO:teuthology.orchestra.run.smithi181.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-08-27T02:29:26.329 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:26.345 INFO:teuthology.orchestra.run.smithi181.stdout:The following NEW packages will be installed: 2024-08-27T02:29:26.345 INFO:teuthology.orchestra.run.smithi181.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-27T02:29:26.345 INFO:teuthology.orchestra.run.smithi181.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-27T02:29:26.345 INFO:teuthology.orchestra.run.smithi181.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-27T02:29:26.345 INFO:teuthology.orchestra.run.smithi181.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-27T02:29:26.345 INFO:teuthology.orchestra.run.smithi181.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-27T02:29:26.346 INFO:teuthology.orchestra.run.smithi181.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-27T02:29:26.346 INFO:teuthology.orchestra.run.smithi181.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-27T02:29:26.346 INFO:teuthology.orchestra.run.smithi181.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-27T02:29:26.346 INFO:teuthology.orchestra.run.smithi181.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-27T02:29:26.346 INFO:teuthology.orchestra.run.smithi181.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-27T02:29:26.346 INFO:teuthology.orchestra.run.smithi181.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-08-27T02:29:26.347 INFO:teuthology.orchestra.run.smithi181.stdout: s3cmd 2024-08-27T02:29:26.398 INFO:teuthology.orchestra.run.smithi181.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-08-27T02:29:26.398 INFO:teuthology.orchestra.run.smithi181.stdout:Need to get 10.4 MB of archives. 2024-08-27T02:29:26.398 INFO:teuthology.orchestra.run.smithi181.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-08-27T02:29:26.398 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-08-27T02:29:26.416 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-08-27T02:29:26.416 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-08-27T02:29:26.420 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-08-27T02:29:26.454 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-08-27T02:29:26.455 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-dashboard (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:26.469 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-08-27T02:29:26.471 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-08-27T02:29:26.501 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-08-27T02:29:26.521 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-08-27T02:29:26.522 INFO:teuthology.orchestra.run.smithi181.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-08-27T02:29:26.523 INFO:teuthology.orchestra.run.smithi181.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-08-27T02:29:26.569 INFO:teuthology.orchestra.run.smithi181.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-08-27T02:29:26.569 INFO:teuthology.orchestra.run.smithi181.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-08-27T02:29:26.587 INFO:teuthology.orchestra.run.smithi181.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-08-27T02:29:26.587 INFO:teuthology.orchestra.run.smithi181.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-08-27T02:29:26.587 INFO:teuthology.orchestra.run.smithi181.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-08-27T02:29:26.588 INFO:teuthology.orchestra.run.smithi181.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-08-27T02:29:26.589 INFO:teuthology.orchestra.run.smithi181.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-08-27T02:29:26.592 INFO:teuthology.orchestra.run.smithi181.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-08-27T02:29:26.592 INFO:teuthology.orchestra.run.smithi181.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-08-27T02:29:26.598 INFO:teuthology.orchestra.run.smithi181.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-08-27T02:29:26.605 INFO:teuthology.orchestra.run.smithi181.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-08-27T02:29:26.605 INFO:teuthology.orchestra.run.smithi181.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-08-27T02:29:26.606 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-volume (19.3.0-4504-gd17b2285-1jammy) ... 2024-08-27T02:29:26.617 INFO:teuthology.orchestra.run.smithi181.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-08-27T02:29:26.617 INFO:teuthology.orchestra.run.smithi181.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-08-27T02:29:26.618 INFO:teuthology.orchestra.run.smithi181.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-08-27T02:29:26.618 INFO:teuthology.orchestra.run.smithi181.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-08-27T02:29:26.620 INFO:teuthology.orchestra.run.smithi181.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-08-27T02:29:26.623 INFO:teuthology.orchestra.run.smithi181.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-08-27T02:29:26.625 INFO:teuthology.orchestra.run.smithi181.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-08-27T02:29:26.639 INFO:teuthology.orchestra.run.smithi181.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-08-27T02:29:26.639 INFO:teuthology.orchestra.run.smithi181.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-08-27T02:29:26.656 INFO:teuthology.orchestra.run.smithi181.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-08-27T02:29:26.656 INFO:teuthology.orchestra.run.smithi181.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-08-27T02:29:26.657 INFO:teuthology.orchestra.run.smithi181.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-08-27T02:29:26.968 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-27T02:29:27.076 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-27T02:29:27.099 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 10.4 MB in 0s (34.2 MB/s) 2024-08-27T02:29:27.163 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libapache-pom-java. 2024-08-27T02:29:27.204 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-27T02:29:27.223 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-08-27T02:29:27.228 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-08-27T02:29:27.262 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libapache-pom-java (18-1) ... 2024-08-27T02:29:27.515 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-08-27T02:29:27.540 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-08-27T02:29:27.582 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-27T02:29:27.835 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-08-27T02:29:27.862 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-08-27T02:29:27.901 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-27T02:29:28.153 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcdi-api-java. 2024-08-27T02:29:28.182 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-08-27T02:29:28.220 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-08-27T02:29:28.297 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-27T02:29:28.490 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcommons-cli-java. 2024-08-27T02:29:28.510 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-08-27T02:29:28.548 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-08-27T02:29:28.800 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcommons-parent-java. 2024-08-27T02:29:28.816 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-08-27T02:29:28.858 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-08-27T02:29:28.939 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-27T02:29:28.942 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-08-27T02:29:29.045 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:29:29.102 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcommons-io-java. 2024-08-27T02:29:29.119 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-08-27T02:29:29.160 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-08-27T02:29:29.261 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-08-27T02:29:29.262 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-08-27T02:29:29.379 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-08-27T02:29:29.395 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-08-27T02:29:29.437 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-08-27T02:29:29.461 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:29:29.461 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:29:29.461 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:29:29.461 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:29:29.462 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-27T02:29:29.462 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-27T02:29:29.462 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:29:29.463 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-08-27T02:29:29.463 INFO:teuthology.orchestra.run.smithi143.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-27T02:29:29.463 INFO:teuthology.orchestra.run.smithi143.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-27T02:29:29.463 INFO:teuthology.orchestra.run.smithi143.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-27T02:29:29.463 INFO:teuthology.orchestra.run.smithi143.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-27T02:29:29.464 INFO:teuthology.orchestra.run.smithi143.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-27T02:29:29.464 INFO:teuthology.orchestra.run.smithi143.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-27T02:29:29.464 INFO:teuthology.orchestra.run.smithi143.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-27T02:29:29.464 INFO:teuthology.orchestra.run.smithi143.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-27T02:29:29.464 INFO:teuthology.orchestra.run.smithi143.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-27T02:29:29.464 INFO:teuthology.orchestra.run.smithi143.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-27T02:29:29.464 INFO:teuthology.orchestra.run.smithi143.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-08-27T02:29:29.465 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-08-27T02:29:29.465 INFO:teuthology.orchestra.run.smithi143.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-08-27T02:29:29.465 INFO:teuthology.orchestra.run.smithi143.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-08-27T02:29:29.465 INFO:teuthology.orchestra.run.smithi143.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-08-27T02:29:29.465 INFO:teuthology.orchestra.run.smithi143.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-08-27T02:29:29.465 INFO:teuthology.orchestra.run.smithi143.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-08-27T02:29:29.504 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-08-27T02:29:29.504 INFO:teuthology.orchestra.run.smithi143.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-08-27T02:29:29.504 INFO:teuthology.orchestra.run.smithi143.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-08-27T02:29:29.504 INFO:teuthology.orchestra.run.smithi143.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-08-27T02:29:29.505 INFO:teuthology.orchestra.run.smithi143.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-08-27T02:29:29.506 INFO:teuthology.orchestra.run.smithi143.stdout: s3cmd 2024-08-27T02:29:29.686 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-08-27T02:29:29.686 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 10.4 MB of archives. 2024-08-27T02:29:29.686 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-08-27T02:29:29.686 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-08-27T02:29:29.732 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-08-27T02:29:29.760 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-08-27T02:29:29.769 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-08-27T02:29:29.769 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-08-27T02:29:29.786 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-08-27T02:29:29.799 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-27T02:29:29.949 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-08-27T02:29:30.020 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-08-27T02:29:30.027 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-08-27T02:29:30.051 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjsr305-java. 2024-08-27T02:29:30.076 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-08-27T02:29:30.134 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-08-27T02:29:30.162 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-08-27T02:29:30.256 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-08-27T02:29:30.256 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-08-27T02:29:30.260 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-08-27T02:29:30.387 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libguava-java. 2024-08-27T02:29:30.403 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-08-27T02:29:30.404 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-08-27T02:29:30.405 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-08-27T02:29:30.445 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-08-27T02:29:30.446 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libguava-java (29.0-6) ... 2024-08-27T02:29:30.446 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-08-27T02:29:30.447 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-08-27T02:29:30.448 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-08-27T02:29:30.449 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-08-27T02:29:30.454 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-08-27T02:29:30.455 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-08-27T02:29:30.501 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-08-27T02:29:30.504 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-08-27T02:29:30.554 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-08-27T02:29:30.555 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-08-27T02:29:30.556 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-08-27T02:29:30.558 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-08-27T02:29:30.559 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-08-27T02:29:30.584 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-08-27T02:29:30.593 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-08-27T02:29:30.599 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-08-27T02:29:30.664 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-08-27T02:29:30.664 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-08-27T02:29:30.695 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-08-27T02:29:30.696 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-08-27T02:29:30.696 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-08-27T02:29:30.840 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libaopalliance-java. 2024-08-27T02:29:30.868 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-08-27T02:29:30.906 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-08-27T02:29:31.142 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libguice-java. 2024-08-27T02:29:31.145 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 10.4 MB in 1s (8,758 kB/s) 2024-08-27T02:29:31.158 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-08-27T02:29:31.200 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-08-27T02:29:31.237 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libapache-pom-java. 2024-08-27T02:29:31.321 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-08-27T02:29:31.327 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-08-27T02:29:31.369 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libapache-pom-java (18-1) ... 2024-08-27T02:29:31.579 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-08-27T02:29:31.604 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-08-27T02:29:31.613 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-08-27T02:29:31.630 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-08-27T02:29:31.670 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-08-27T02:29:31.672 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-27T02:29:31.908 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-08-27T02:29:31.923 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjansi-native-java. 2024-08-27T02:29:31.924 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-08-27T02:29:31.939 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-08-27T02:29:31.973 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-08-27T02:29:31.986 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-27T02:29:32.200 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjansi-java. 2024-08-27T02:29:32.228 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-08-27T02:29:32.244 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcdi-api-java. 2024-08-27T02:29:32.261 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-08-27T02:29:32.267 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjansi-java (1.18-1) ... 2024-08-27T02:29:32.302 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-08-27T02:29:32.520 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libmaven-parent-java. 2024-08-27T02:29:32.539 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcommons-cli-java. 2024-08-27T02:29:32.545 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-08-27T02:29:32.567 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-08-27T02:29:32.586 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-08-27T02:29:32.605 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-08-27T02:29:32.816 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcommons-parent-java. 2024-08-27T02:29:32.832 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-08-27T02:29:32.838 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-08-27T02:29:32.866 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-08-27T02:29:32.867 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-08-27T02:29:32.913 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-08-27T02:29:33.102 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcommons-io-java. 2024-08-27T02:29:33.118 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-08-27T02:29:33.160 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-08-27T02:29:33.241 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-08-27T02:29:33.269 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-08-27T02:29:33.421 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-08-27T02:29:33.438 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-08-27T02:29:33.479 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-08-27T02:29:33.546 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-08-27T02:29:33.766 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-08-27T02:29:33.782 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-08-27T02:29:33.802 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-08-27T02:29:33.815 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-27T02:29:33.830 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-08-27T02:29:33.877 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-08-27T02:29:34.001 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjsr305-java. 2024-08-27T02:29:34.018 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-08-27T02:29:34.060 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-08-27T02:29:34.198 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-08-27T02:29:34.225 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-08-27T02:29:34.264 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-27T02:29:34.313 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libguava-java. 2024-08-27T02:29:34.341 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-08-27T02:29:34.379 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libguava-java (29.0-6) ... 2024-08-27T02:29:34.483 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-08-27T02:29:34.499 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-08-27T02:29:34.533 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-08-27T02:29:34.893 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libaopalliance-java. 2024-08-27T02:29:34.921 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-08-27T02:29:34.959 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-08-27T02:29:35.002 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-08-27T02:29:35.030 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-08-27T02:29:35.069 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-08-27T02:29:35.187 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libguice-java. 2024-08-27T02:29:35.215 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-08-27T02:29:35.245 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-08-27T02:29:35.321 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-08-27T02:29:35.349 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-08-27T02:29:35.388 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-08-27T02:29:35.609 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-08-27T02:29:35.616 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-08-27T02:29:35.625 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-08-27T02:29:35.644 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-08-27T02:29:35.667 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-08-27T02:29:35.682 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-08-27T02:29:35.928 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-08-27T02:29:35.954 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjansi-native-java. 2024-08-27T02:29:35.954 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-08-27T02:29:35.960 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-08-27T02:29:35.986 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-27T02:29:36.002 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-08-27T02:29:36.239 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libslf4j-java. 2024-08-27T02:29:36.255 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjansi-java. 2024-08-27T02:29:36.255 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-08-27T02:29:36.271 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-08-27T02:29:36.297 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-08-27T02:29:36.318 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjansi-java (1.18-1) ... 2024-08-27T02:29:36.559 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libsisu-inject-java. 2024-08-27T02:29:36.575 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-08-27T02:29:36.618 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-08-27T02:29:36.807 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmaven-parent-java. 2024-08-27T02:29:36.824 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-08-27T02:29:36.857 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-08-27T02:29:36.878 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-08-27T02:29:36.895 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-08-27T02:29:36.937 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-08-27T02:29:37.077 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-08-27T02:29:37.105 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-08-27T02:29:37.143 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-08-27T02:29:37.189 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libmaven3-core-java. 2024-08-27T02:29:37.206 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-08-27T02:29:37.247 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-08-27T02:29:37.421 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-08-27T02:29:37.437 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-08-27T02:29:37.479 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-08-27T02:29:37.619 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libwagon-file-java. 2024-08-27T02:29:37.647 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-08-27T02:29:37.685 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-08-27T02:29:37.707 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-08-27T02:29:37.724 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-08-27T02:29:37.757 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-08-27T02:29:37.913 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-08-27T02:29:37.941 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-08-27T02:29:37.979 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-08-27T02:29:38.287 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-08-27T02:29:38.304 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-08-27T02:29:38.346 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-27T02:29:38.466 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package maven. 2024-08-27T02:29:38.494 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-08-27T02:29:38.540 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking maven (3.6.3-5) ... 2024-08-27T02:29:38.607 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-08-27T02:29:38.635 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-08-27T02:29:38.673 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-08-27T02:29:38.844 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-magic. 2024-08-27T02:29:38.872 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-08-27T02:29:38.901 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-08-27T02:29:38.910 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-08-27T02:29:38.917 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-08-27T02:29:38.959 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-08-27T02:29:39.163 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package s3cmd. 2024-08-27T02:29:39.188 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-08-27T02:29:39.212 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-08-27T02:29:39.221 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-08-27T02:29:39.228 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-08-27T02:29:39.270 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-08-27T02:29:39.506 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-08-27T02:29:39.522 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-08-27T02:29:39.564 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-08-27T02:29:39.567 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-08-27T02:29:39.693 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-08-27T02:29:39.819 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-08-27T02:29:39.851 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-08-27T02:29:39.868 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-08-27T02:29:39.901 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-27T02:29:39.945 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-08-27T02:29:40.063 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-08-27T02:29:40.156 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libslf4j-java. 2024-08-27T02:29:40.163 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-08-27T02:29:40.173 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-08-27T02:29:40.214 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-08-27T02:29:40.265 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-08-27T02:29:40.382 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-08-27T02:29:40.501 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsisu-inject-java. 2024-08-27T02:29:40.517 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-27T02:29:40.517 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-08-27T02:29:40.559 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-08-27T02:29:40.643 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-27T02:29:40.769 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libapache-pom-java (18-1) ... 2024-08-27T02:29:40.845 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-08-27T02:29:40.862 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-08-27T02:29:40.895 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-27T02:29:40.895 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-08-27T02:29:41.021 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-08-27T02:29:41.138 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-27T02:29:41.172 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmaven3-core-java. 2024-08-27T02:29:41.189 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-08-27T02:29:41.231 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-08-27T02:29:41.239 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-08-27T02:29:41.340 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-08-27T02:29:41.591 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-08-27T02:29:41.618 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libwagon-file-java. 2024-08-27T02:29:41.647 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-08-27T02:29:41.684 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-08-27T02:29:41.734 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-08-27T02:29:41.860 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-08-27T02:29:41.920 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-08-27T02:29:41.937 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-08-27T02:29:41.978 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-08-27T02:29:41.986 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libmaven-parent-java (31-2) ... 2024-08-27T02:29:42.112 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcommons-parent-java (43-1) ... 2024-08-27T02:29:42.230 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-08-27T02:29:42.339 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up s3cmd (2.2.0-1) ... 2024-08-27T02:29:42.431 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package maven. 2024-08-27T02:29:42.459 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-08-27T02:29:42.498 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking maven (3.6.3-5) ... 2024-08-27T02:29:42.640 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-08-27T02:29:42.767 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-08-27T02:29:42.817 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-magic. 2024-08-27T02:29:42.846 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-08-27T02:29:42.884 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-08-27T02:29:42.892 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libguava-java (29.0-6) ... 2024-08-27T02:29:43.019 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-08-27T02:29:43.144 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-08-27T02:29:43.203 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package s3cmd. 2024-08-27T02:29:43.232 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-08-27T02:29:43.269 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-08-27T02:29:43.270 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-08-27T02:29:43.396 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-08-27T02:29:43.497 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libguice-java (4.2.3-2) ... 2024-08-27T02:29:43.598 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjansi-java (1.18-1) ... 2024-08-27T02:29:43.640 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-08-27T02:29:43.707 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-27T02:29:43.783 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-08-27T02:29:43.834 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-08-27T02:29:43.909 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-08-27T02:29:43.960 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up maven (3.6.3-5) ... 2024-08-27T02:29:44.035 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-08-27T02:29:44.152 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-08-27T02:29:44.235 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-08-27T02:29:44.270 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-08-27T02:29:44.305 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-27T02:29:44.379 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-08-27T02:29:44.505 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-08-27T02:29:44.639 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-08-27T02:29:44.786 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-08-27T02:29:44.925 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libapache-pom-java (18-1) ... 2024-08-27T02:29:45.068 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-08-27T02:29:45.177 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-08-27T02:29:45.303 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-08-27T02:29:45.429 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-08-27T02:29:45.563 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-08-27T02:29:45.703 INFO:teuthology.orchestra.run.smithi181.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-27T02:29:45.709 DEBUG:teuthology.parallel:result is None 2024-08-27T02:29:45.823 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-08-27T02:29:45.949 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-08-27T02:29:46.091 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-08-27T02:29:46.217 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmaven-parent-java (31-2) ... 2024-08-27T02:29:46.326 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcommons-parent-java (43-1) ... 2024-08-27T02:29:46.427 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-08-27T02:29:46.545 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up s3cmd (2.2.0-1) ... 2024-08-27T02:29:46.846 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-08-27T02:29:46.972 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-08-27T02:29:47.098 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libguava-java (29.0-6) ... 2024-08-27T02:29:47.224 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-08-27T02:29:47.350 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-08-27T02:29:47.476 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-08-27T02:29:47.593 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-08-27T02:29:47.702 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libguice-java (4.2.3-2) ... 2024-08-27T02:29:47.811 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjansi-java (1.18-1) ... 2024-08-27T02:29:47.946 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-08-27T02:29:48.072 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-08-27T02:29:48.198 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up maven (3.6.3-5) ... 2024-08-27T02:29:48.455 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-08-27T02:29:48.527 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-27T02:29:49.935 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-27T02:29:49.939 DEBUG:teuthology.parallel:result is None 2024-08-27T02:29:49.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:29:50.083 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-query -W -f '${Version}' ceph 2024-08-27T02:29:50.102 INFO:teuthology.orchestra.run.smithi143.stdout:19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:29:50.102 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:29:50.102 INFO:teuthology.task.install:The correct ceph version 19.3.0-4504-gd17b2285-1jammy is installed. 2024-08-27T02:29:50.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:29:50.242 DEBUG:teuthology.orchestra.run.smithi181:> dpkg-query -W -f '${Version}' ceph 2024-08-27T02:29:50.261 INFO:teuthology.orchestra.run.smithi181.stdout:19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:29:50.261 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4504-gd17b2285-1jammy 2024-08-27T02:29:50.262 INFO:teuthology.task.install:The correct ceph version 19.3.0-4504-gd17b2285-1jammy is installed. 2024-08-27T02:29:50.263 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-27T02:29:50.263 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:50.264 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-27T02:29:50.278 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:29:50.278 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-27T02:29:50.319 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-27T02:29:50.319 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:50.319 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-08-27T02:29:50.334 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-27T02:29:50.385 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:29:50.385 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-08-27T02:29:50.398 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-27T02:29:50.453 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-27T02:29:50.453 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:50.453 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-27T02:29:50.467 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-27T02:29:50.521 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:29:50.521 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-27T02:29:50.534 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-27T02:29:50.589 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-27T02:29:50.589 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:50.589 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-08-27T02:29:50.601 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-27T02:29:50.654 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:29:50.654 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-08-27T02:29:50.666 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-27T02:29:50.721 INFO:teuthology.run_tasks:Running task ceph... 2024-08-27T02:29:50.802 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-27T02:29:50.802 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-08-27T02:29:50.806 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-08-27T02:29:50.819 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-27T02:29:50.819 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-27T02:29:50.860 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-27T02:29:50.874 INFO:tasks.ceph:Creating extra log directories... 2024-08-27T02:29:50.874 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-27T02:29:50.916 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-27T02:29:50.940 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-27T02:29:50.940 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-27T02:29:50.940 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755', 'branch': 'pr-56597', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7874755', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'pr-56597'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd17b22856a85d7d49d47be692c778d4419f41641'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd17b22856a85d7d49d47be692c778d4419f41641'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pr-56597', 'sha1': 'd17b22856a85d7d49d47be692c778d4419f41641'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 99, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4190, 'sha1': 'd17b22856a85d7d49d47be692c778d4419f41641', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'pr-56597', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd17b22856a85d7d49d47be692c778d4419f41641', 'targets': {'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBJSA6SxrRFrtctC43PntCZKZgJZK6StJ/uM14muOjNfbTiG3V45NJEwg9gvRpUrL7PaOcvtHzT/Fl3bVuvExtw=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMP4AX0xWOO7yyavc905ZdNoOK+MXH9YCjQRxXXUbC+XIRKmYw2uTitFnypBI8FztVv1bGhDHOk/+KnXFjyuVYU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd17b22856a85d7d49d47be692c778d4419f41641'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '4d4c5e30374204f3b32f867e61bb4e1a3880f672', 'timestamp': '2024-08-26_22:06:30', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-27T02:29:50.940 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-27T02:29:50.972 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-27T02:29:50.978 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-08-27T02:29:51.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-08-27T02:29:51.035 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:51.035 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-08-27T02:29:51.079 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-27T02:29:51.079 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-08-27T02:29:51.127 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-27T02:29:51.127 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:51.127 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-08-27T02:29:51.128 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:51.128 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-08-27 02:23:56.042750219 +0000 2024-08-27T02:29:51.128 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-08-27 02:23:55.782752542 +0000 2024-08-27T02:29:51.128 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-08-27 02:23:55.782752542 +0000 2024-08-27T02:29:51.128 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-08-27T02:29:51.128 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-27T02:29:51.181 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-08-27T02:29:51.181 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-08-27T02:29:51.181 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000391411 s, 1.3 MB/s 2024-08-27T02:29:51.182 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-27T02:29:51.240 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-08-27 02:23:56.510746038 +0000 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-08-27 02:23:56.266748219 +0000 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-08-27 02:23:56.266748219 +0000 2024-08-27T02:29:51.292 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-08-27T02:29:51.293 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-27T02:29:51.351 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-08-27T02:29:51.351 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-08-27T02:29:51.351 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000420867 s, 1.2 MB/s 2024-08-27T02:29:51.352 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-27T02:29:51.400 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-08-27T02:29:51.447 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-27T02:29:51.447 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:51.448 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-08-27T02:29:51.448 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:51.448 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-08-27 02:23:56.982741823 +0000 2024-08-27T02:29:51.448 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-08-27 02:23:56.746743930 +0000 2024-08-27T02:29:51.448 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-08-27 02:23:56.746743930 +0000 2024-08-27T02:29:51.448 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-08-27T02:29:51.448 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-27T02:29:51.501 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-08-27T02:29:51.501 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-08-27T02:29:51.502 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000353806 s, 1.4 MB/s 2024-08-27T02:29:51.503 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-27T02:29:51.552 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-08-27T02:29:51.599 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-27T02:29:51.599 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:51.599 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-08-27T02:29:51.599 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:51.599 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-08-27 02:23:57.478737393 +0000 2024-08-27T02:29:51.599 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-08-27 02:23:57.222739679 +0000 2024-08-27T02:29:51.600 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-08-27 02:23:57.222739679 +0000 2024-08-27T02:29:51.600 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: - 2024-08-27T02:29:51.600 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-27T02:29:51.653 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-08-27T02:29:51.654 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-08-27T02:29:51.654 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000388877 s, 1.3 MB/s 2024-08-27T02:29:51.655 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-27T02:29:51.704 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-27T02:29:51.704 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:29:51.704 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-08-27T02:29:51.710 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-27T02:29:51.710 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-08-27T02:29:51.759 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-27T02:29:51.759 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:51.759 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-08-27T02:29:51.759 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:51.759 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-27 02:23:54.862406275 +0000 2024-08-27T02:29:51.759 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-27 02:23:54.634408311 +0000 2024-08-27T02:29:51.759 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-27 02:23:54.634408311 +0000 2024-08-27T02:29:51.760 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-08-27T02:29:51.760 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-27T02:29:51.813 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-27T02:29:51.813 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-27T02:29:51.813 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000390233 s, 1.3 MB/s 2024-08-27T02:29:51.814 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-27T02:29:51.863 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-08-27T02:29:51.911 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-27T02:29:51.911 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:51.911 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-08-27T02:29:51.911 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:51.911 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-27 02:23:55.362401809 +0000 2024-08-27T02:29:51.911 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-27 02:23:55.102404131 +0000 2024-08-27T02:29:51.911 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-27 02:23:55.102404131 +0000 2024-08-27T02:29:51.912 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-08-27T02:29:51.912 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-27T02:29:51.964 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-27T02:29:51.964 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-27T02:29:51.964 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000305494 s, 1.7 MB/s 2024-08-27T02:29:51.965 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-27T02:29:52.011 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-08-27T02:29:52.058 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-27T02:29:52.058 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:52.059 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-08-27T02:29:52.059 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:52.059 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-27 02:23:55.874397235 +0000 2024-08-27T02:29:52.059 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-27 02:23:55.602399664 +0000 2024-08-27T02:29:52.059 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-27 02:23:55.602399664 +0000 2024-08-27T02:29:52.059 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-08-27T02:29:52.059 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-27T02:29:52.112 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-27T02:29:52.113 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-27T02:29:52.113 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000439043 s, 1.2 MB/s 2024-08-27T02:29:52.114 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-27T02:29:52.163 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-08-27T02:29:52.210 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-27T02:29:52.210 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-27T02:29:52.210 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-08-27T02:29:52.210 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-27T02:29:52.210 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-08-27 02:23:56.386392662 +0000 2024-08-27T02:29:52.210 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-08-27 02:23:56.126394984 +0000 2024-08-27T02:29:52.210 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-08-27 02:23:56.126394984 +0000 2024-08-27T02:29:52.211 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-08-27T02:29:52.211 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-27T02:29:52.263 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-08-27T02:29:52.264 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-08-27T02:29:52.264 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000275074 s, 1.9 MB/s 2024-08-27T02:29:52.265 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-27T02:29:52.313 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-27T02:29:52.313 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-27T02:29:52.313 INFO:tasks.ceph:Generating config... 2024-08-27T02:29:52.314 INFO:tasks.ceph:[client] debug rgw = 20 2024-08-27T02:29:52.314 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-08-27T02:29:52.314 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-08-27T02:29:52.314 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] setgroup = ceph 2024-08-27T02:29:52.315 INFO:tasks.ceph:[client] setuser = ceph 2024-08-27T02:29:52.316 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-08-27T02:29:52.316 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-08-27T02:29:52.316 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-08-27T02:29:52.316 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-08-27T02:29:52.316 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-08-27T02:29:52.316 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-27T02:29:52.316 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-27T02:29:52.316 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-27T02:29:52.316 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-27T02:29:52.316 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-27T02:29:52.316 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-08-27T02:29:52.316 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-27T02:29:52.316 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-27T02:29:52.316 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] debug objclass = 20 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-08-27T02:29:52.317 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-27T02:29:52.318 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-08-27T02:29:52.318 INFO:tasks.ceph:Setting up mon.a... 2024-08-27T02:29:52.318 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-27T02:29:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.keyring 2024-08-27T02:29:52.366 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-27T02:29:52.447 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-27T02:29:52.502 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.143'), ('mon.c', '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]'), ('mon.b', '172.21.15.181')] 2024-08-27T02:29:52.503 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790],172.21.15.181', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-08-27T02:29:52.504 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:52.504 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-27T02:29:52.551 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.143 --addv c '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]' --add b 172.21.15.181 --print /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:29:52.641 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:29:52.641 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: generated fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:setting min_mon_release = quincy 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:epoch 0 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:min_mon_release 17 (quincy) 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:election_strategy: 1 2024-08-27T02:29:52.642 INFO:teuthology.orchestra.run.smithi143.stdout:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:29:52.643 INFO:teuthology.orchestra.run.smithi143.stdout:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:29:52.643 INFO:teuthology.orchestra.run.smithi143.stdout:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:29:52.643 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-27T02:29:52.644 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-27T02:29:52.691 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2bd9f312-2905-4c35-8bed-4bbae91a1fc0... 2024-08-27T02:29:52.692 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-27T02:29:52.736 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-27T02:29:52.763 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-08-27T02:29:52.763 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-08-27T02:29:52.763 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-27T02:29:52.763 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-08-27T02:29:52.763 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-27T02:29:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790],172.21.15.181" 2024-08-27T02:29:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: mon client directed command retry = 5 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject socket failures = 5000 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd heartbeat grace = 40 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd_max_pg_log_entries = 10 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd_min_pg_log_entries = 10 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-08-27T02:29:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: bdev async discard = True 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: bdev enable discard = True 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore allocator = bitmap 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 1/20 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 1/20 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: debug objclass = 20 2024-08-27T02:29:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 4/10 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: osd fast shutdown = False 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: osd shutdown pgref assert = True 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-08-27T02:29:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-08-27T02:29:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd crush smoke test = False 2024-08-27T02:29:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: debug rgw = 20 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: debug rgw notification = 20 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw bucket counters cache = True 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw crypt require ssl = False 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw crypt s3 kms backend = testing 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-08-27T02:29:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: rgw max chunk size = 4194304 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: rgw obj stripe size = 6291456 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: rgw reshard progress judge interval = 10 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: rgw s3 auth use sts = True 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: rgw sts key = abcdefghijklmnop 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: rgw torrent flag = True 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: rgw user counters cache = True 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: setgroup = ceph 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: setuser = ceph 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-08-27T02:29:52.774 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-08-27T02:29:52.775 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-08-27T02:29:52.776 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-08-27T02:29:52.777 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790],172.21.15.181" 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: mon client directed command retry = 5 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject socket failures = 5000 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: osd heartbeat grace = 40 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: osd_max_pg_log_entries = 10 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: osd_min_pg_log_entries = 10 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.778 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-08-27T02:29:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-08-27T02:29:52.780 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 1/20 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: debug objclass = 20 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-08-27T02:29:52.781 INFO:teuthology.orchestra.run.smithi181.stdout: osd fast shutdown = False 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: osd shutdown pgref assert = True 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-08-27T02:29:52.782 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-27T02:29:52.783 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd crush smoke test = False 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-08-27T02:29:52.784 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: debug rgw = 20 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: debug rgw notification = 20 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw bucket counters cache = True 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw crypt require ssl = False 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw crypt s3 kms backend = testing 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw max chunk size = 4194304 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw obj stripe size = 6291456 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw reshard progress judge interval = 10 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw s3 auth use sts = True 2024-08-27T02:29:52.785 INFO:teuthology.orchestra.run.smithi181.stdout: rgw sts key = abcdefghijklmnop 2024-08-27T02:29:52.786 INFO:teuthology.orchestra.run.smithi181.stdout: rgw torrent flag = True 2024-08-27T02:29:52.786 INFO:teuthology.orchestra.run.smithi181.stdout: rgw user counters cache = True 2024-08-27T02:29:52.786 INFO:teuthology.orchestra.run.smithi181.stdout: setgroup = ceph 2024-08-27T02:29:52.786 INFO:teuthology.orchestra.run.smithi181.stdout: setuser = ceph 2024-08-27T02:29:52.786 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-08-27T02:29:52.786 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-08-27T02:29:52.786 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-08-27T02:29:52.787 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-27T02:29:52.787 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-27T02:29:52.878 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-27T02:29:52.878 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:52.878 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-27T02:29:52.883 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:52.883 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-27T02:29:52.931 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T02:29:52.931 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:52.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-27T02:29:52.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-27T02:29:52.994 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:29:52.994 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:29:53.047 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T02:29:53.048 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:29:53.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-27T02:29:53.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-27T02:29:53.070 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:29:53.071 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:29:53.118 INFO:tasks.ceph:Setting up mon nodes... 2024-08-27T02:29:53.118 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-27T02:29:53.119 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-27T02:29:53.163 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-27T02:29:53.166 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-27T02:29:53.209 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-27T02:29:53.226 INFO:tasks.ceph:Setting up mds nodes... 2024-08-27T02:29:53.226 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-27T02:29:53.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-27T02:29:53.262 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-27T02:29:53.272 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-27T02:29:53.305 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-27T02:29:53.316 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-27T02:29:53.316 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-27T02:29:53.316 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-27T02:29:53.328 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-27T02:29:53.328 INFO:tasks.ceph:role: osd.0 2024-08-27T02:29:53.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T02:29:53.328 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-27T02:29:53.391 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:29:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:29:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:29:53.391 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:29:53.391 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:29:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:29:53.392 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:29:53.392 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:29:53.392 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:29:53.392 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:29:53.844 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-08-27T02:29:53.846 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-08-27T02:29:53.846 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-27T02:29:53.934 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-27T02:29:53.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:29:53.987 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:29:53.987 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-27T02:29:54.039 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-27T02:29:54.039 INFO:tasks.ceph:role: osd.1 2024-08-27T02:29:54.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T02:29:54.040 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:29:54.103 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:29:54.581 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-08-27T02:29:54.583 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-08-27T02:29:54.583 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-27T02:29:54.732 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-27T02:29:54.743 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:29:54.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:29:54.744 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-27T02:29:54.799 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-27T02:29:54.799 INFO:tasks.ceph:role: osd.2 2024-08-27T02:29:54.799 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T02:29:54.799 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-27T02:29:54.861 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:29:54.862 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:29:55.320 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-08-27T02:29:55.322 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-08-27T02:29:55.322 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-27T02:29:55.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-27T02:29:55.476 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:29:55.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:29:55.477 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-27T02:29:55.535 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-27T02:29:55.535 INFO:tasks.ceph:role: osd.3 2024-08-27T02:29:55.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T02:29:55.535 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-27T02:29:55.597 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:29:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:29:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:29:55.597 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:29:55.598 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:29:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:29:55.598 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:29:55.598 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:29:55.598 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:29:55.598 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:29:56.029 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-08-27T02:29:56.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-08-27T02:29:56.031 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-27T02:29:56.131 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-27T02:29:56.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:29:56.143 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:29:56.143 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:29:56.263 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:56.262+0000 7f98744f57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-27T02:29:56.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:56.262+0000 7f98744f57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-27T02:29:56.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:56.262+0000 7f98744f57c0 -1 bdev(0x55d0767cb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-08-27T02:29:56.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:56.262+0000 7f98744f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-27T02:29:59.401 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-27T02:29:59.416 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:29:59.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:59.498+0000 7f4586aee7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-27T02:29:59.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:59.498+0000 7f4586aee7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-27T02:29:59.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:59.498+0000 7f4586aee7c0 -1 bdev(0x55e7cf36d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-08-27T02:29:59.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:29:59.498+0000 7f4586aee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-27T02:30:02.658 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-27T02:30:02.715 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:02.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:02.794+0000 7ff8bf15e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-27T02:30:02.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:02.794+0000 7ff8bf15e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-27T02:30:02.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:02.794+0000 7ff8bf15e7c0 -1 bdev(0x55cd70065800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-08-27T02:30:02.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:02.794+0000 7ff8bf15e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-27T02:30:05.953 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-27T02:30:06.007 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:06.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:06.086+0000 7f6674e867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-27T02:30:06.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:06.086+0000 7f6674e867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-27T02:30:06.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:06.086+0000 7f6674e867c0 -1 bdev(0x5569cd2c3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-08-27T02:30:06.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:30:06.086+0000 7f6674e867c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-27T02:30:09.234 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-27T02:30:09.291 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-27T02:30:09.306 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-27T02:30:09.306 INFO:tasks.ceph:role: osd.4 2024-08-27T02:30:09.306 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T02:30:09.306 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-27T02:30:09.370 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:30:09.371 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:30:09.843 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-08-27T02:30:09.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-08-27T02:30:09.845 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-27T02:30:09.993 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-27T02:30:10.004 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:30:10.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:30:10.006 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-27T02:30:10.062 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-27T02:30:10.062 INFO:tasks.ceph:role: osd.5 2024-08-27T02:30:10.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T02:30:10.062 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-27T02:30:10.125 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:30:10.125 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:30:10.125 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:30:10.125 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:30:10.125 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:30:10.126 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:30:10.126 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:30:10.126 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:30:10.126 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:30:10.126 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:30:10.551 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-08-27T02:30:10.553 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-08-27T02:30:10.553 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-27T02:30:10.622 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-27T02:30:10.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:30:10.674 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:30:10.674 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-27T02:30:10.728 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-27T02:30:10.728 INFO:tasks.ceph:role: osd.6 2024-08-27T02:30:10.728 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T02:30:10.728 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-27T02:30:10.789 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:30:10.789 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:30:10.789 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:30:10.789 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:30:10.790 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:30:10.790 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:30:10.790 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:30:10.790 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:30:10.790 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:30:10.790 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:30:11.261 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-08-27T02:30:11.263 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-08-27T02:30:11.263 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-27T02:30:11.361 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-27T02:30:11.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:30:11.370 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:30:11.371 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-27T02:30:11.424 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-27T02:30:11.424 INFO:tasks.ceph:role: osd.7 2024-08-27T02:30:11.424 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T02:30:11.424 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-27T02:30:11.486 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-27T02:30:11.487 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-27T02:30:11.487 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-27T02:30:11.946 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-08-27T02:30:11.948 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-08-27T02:30:11.948 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-27T02:30:12.090 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-27T02:30:12.101 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-08-27T02:30:12.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:30:12.102 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:12.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:12.212+0000 7f0a425397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-27T02:30:12.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:12.216+0000 7f0a425397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-27T02:30:12.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:12.216+0000 7f0a425397c0 -1 bdev(0x55b26c9d5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-08-27T02:30:12.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:12.216+0000 7f0a425397c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-27T02:30:15.363 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-27T02:30:15.377 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:15.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:15.452+0000 7f5bed5ac7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-27T02:30:15.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:15.456+0000 7f5bed5ac7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-27T02:30:15.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:15.456+0000 7f5bed5ac7c0 -1 bdev(0x55fd6b10f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-08-27T02:30:15.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:15.456+0000 7f5bed5ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-27T02:30:18.609 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-27T02:30:18.667 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:18.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:18.744+0000 7f1e48d207c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-27T02:30:18.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:18.744+0000 7f1e48d207c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-27T02:30:18.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:18.744+0000 7f1e48d207c0 -1 bdev(0x559943e83800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-08-27T02:30:18.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:18.744+0000 7f1e48d207c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-27T02:30:21.902 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-27T02:30:21.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:22.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:22.036+0000 7f9cac6627c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-27T02:30:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:22.040+0000 7f9cac6627c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-27T02:30:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:22.040+0000 7f9cac6627c0 -1 bdev(0x56027d211800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-08-27T02:30:22.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-08-27T02:30:22.040+0000 7f9cac6627c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-27T02:30:25.201 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-27T02:30:25.259 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-27T02:30:25.259 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:25.259 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-27T02:30:25.273 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:25.273 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-27T02:30:25.330 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:25.330 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-27T02:30:25.389 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:25.389 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-27T02:30:25.441 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:25.441 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-27T02:30:25.497 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:25.497 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-27T02:30:25.510 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:25.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-27T02:30:25.565 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:25.565 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-27T02:30:25.621 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:25.621 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-27T02:30:25.677 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:25.677 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-27T02:30:25.730 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:25.730 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-27T02:30:25.736 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:25.736 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-27T02:30:25.778 INFO:tasks.ceph:Adding keys to all mons... 2024-08-27T02:30:25.778 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-27T02:30:25.780 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-27T02:30:25.824 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2024-08-27T02:30:25.824 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAhOs1mO/zVCRAAO8Nl8gLfSxsTrRQnsl5urg== 2024-08-27T02:30:25.824 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2024-08-27T02:30:25.824 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAkOs1mj+XLDxAAFmCEQ1wjtra1sXBdqwVQIQ== 2024-08-27T02:30:25.824 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2024-08-27T02:30:25.824 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAnOs1muR/9HRAAgLl7i99bqVUGJrHwXOekcg== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAqOs1mVqCPLxAAQXVwnFhWxOBUZMTQ5ejk+A== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAuOs1mBtNoBRAA5ol9nFTKqjG5mBapw9Mbgg== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAhOs1mAGylDBAAM308TM7fEikdOyi6oXIY0Q== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQA0Os1mJrHpDBAAa/aStsgVlRlPNNpcJ7AbZA== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQA3Os1mrS5uGxAABTkmOFJtBvBIk2S+3C9hmQ== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQA6Os1mMEq+LBAAItOXvo/Sf0trZeG3PufM8w== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQA+Os1mgIqiAhAA4ycBMKqbvGAmy8ouWdR3+A== 2024-08-27T02:30:25.825 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2024-08-27T02:30:25.826 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAhOs1mv2m9DxAAJTL2nKXRKp2ts2EWVkIt/g== 2024-08-27T02:30:25.826 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2024-08-27T02:30:25.826 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAhOs1mC8lYEhAAymiQHO6BU41ioN+mY0ajVA== 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAhOs1mO/zVCRAAO8Nl8gLfSxsTrRQnsl5urg== 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAkOs1mj+XLDxAAFmCEQ1wjtra1sXBdqwVQIQ== 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAnOs1muR/9HRAAgLl7i99bqVUGJrHwXOekcg== 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAqOs1mVqCPLxAAQXVwnFhWxOBUZMTQ5ejk+A== 2024-08-27T02:30:25.832 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAuOs1mBtNoBRAA5ol9nFTKqjG5mBapw9Mbgg== 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAhOs1mAGylDBAAM308TM7fEikdOyi6oXIY0Q== 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQA0Os1mJrHpDBAAa/aStsgVlRlPNNpcJ7AbZA== 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQA3Os1mrS5uGxAABTkmOFJtBvBIk2S+3C9hmQ== 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQA6Os1mMEq+LBAAItOXvo/Sf0trZeG3PufM8w== 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQA+Os1mgIqiAhAA4ycBMKqbvGAmy8ouWdR3+A== 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAhOs1mv2m9DxAAJTL2nKXRKp2ts2EWVkIt/g== 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-08-27T02:30:25.833 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAhOs1mC8lYEhAAymiQHO6BU41ioN+mY0ajVA== 2024-08-27T02:30:25.834 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-27T02:30:25.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-27T02:30:25.923 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:25.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.005 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.043 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.085 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.127 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.173 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.212 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.258 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-27T02:30:26.295 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-27T02:30:26.346 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.383 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.428 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.467 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.509 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.551 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.595 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.639 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-27T02:30:26.684 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-27T02:30:26.724 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-27T02:30:26.770 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-27T02:30:26.773 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-27T02:30:26.858 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-27T02:30:26.858 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-27T02:30:26.870 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-27T02:30:26.963 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-27T02:30:26.975 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-27T02:30:27.027 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-27T02:30:27.120 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-27T02:30:27.130 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-27T02:30:27.145 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-27T02:30:27.239 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-27T02:30:27.250 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:27.252 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-27T02:30:27.297 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-27T02:30:27.298 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-27T02:30:27.298 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-27T02:30:27.300 INFO:tasks.ceph.mon.a:Started 2024-08-27T02:30:27.300 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-27T02:30:27.300 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-27T02:30:27.302 INFO:tasks.ceph.mon.c:Started 2024-08-27T02:30:27.302 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-27T02:30:27.302 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-27T02:30:27.343 INFO:tasks.ceph.mon.b:Started 2024-08-27T02:30:27.343 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-27T02:30:27.343 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-27T02:30:27.343 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-27T02:30:27.345 INFO:tasks.ceph.mgr.y:Started 2024-08-27T02:30:27.345 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-27T02:30:27.346 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-27T02:30:27.347 INFO:tasks.ceph.mgr.x:Started 2024-08-27T02:30:27.347 DEBUG:tasks.ceph:set 0 configs 2024-08-27T02:30:27.348 INFO:tasks.ceph:Setting crush tunables to default 2024-08-27T02:30:27.348 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd crush tunables default 2024-08-27T02:30:32.767 INFO:teuthology.orchestra.run.smithi143.stderr:adjusted tunables profile to default 2024-08-27T02:30:32.784 INFO:tasks.ceph:check_enable_crimson: False 2024-08-27T02:30:32.785 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-27T02:30:32.785 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:32.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-27T02:30:32.795 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:32.795 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-27T02:30:32.846 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:32.846 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-27T02:30:32.906 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:30:32.906 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-27T02:30:32.962 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:32.962 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-27T02:30:32.975 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:32.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-27T02:30:33.030 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:33.030 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-27T02:30:33.089 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-08-27T02:30:33.090 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-27T02:30:33.145 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new d507e514-2956-41e1-9e95-23db7e11d2bf 0 2024-08-27T02:30:33.412 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-08-27T02:30:33.430 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 86e299bc-e71b-42e5-aede-b7f685b509ca 1 2024-08-27T02:30:33.637 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-08-27T02:30:33.656 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 26a2b164-aa60-47bf-ac44-f85aebbe9505 2 2024-08-27T02:30:33.864 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-08-27T02:30:33.880 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 6eb8aad7-7383-448d-9847-054191aaf780 3 2024-08-27T02:30:34.070 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-08-27T02:30:34.087 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 0418e412-238a-4d63-ae59-8e7cdf5fdfb8 4 2024-08-27T02:30:34.291 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-08-27T02:30:34.308 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 5e73fea8-56ab-42ff-8e05-537a33b1da58 5 2024-08-27T02:30:34.513 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-08-27T02:30:34.530 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new ad844130-54fa-45ca-a121-2edf1b658b2b 6 2024-08-27T02:30:34.732 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-08-27T02:30:34.749 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new f7f84897-483a-49d9-82a1-baeae11786a2 7 2024-08-27T02:30:34.957 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-08-27T02:30:34.974 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-27T02:30:34.975 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-27T02:30:34.977 INFO:tasks.ceph.osd.0:Started 2024-08-27T02:30:34.977 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-27T02:30:34.977 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-27T02:30:34.980 INFO:tasks.ceph.osd.1:Started 2024-08-27T02:30:34.980 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-27T02:30:34.980 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-27T02:30:34.982 INFO:tasks.ceph.osd.2:Started 2024-08-27T02:30:34.982 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-27T02:30:34.982 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-27T02:30:34.984 INFO:tasks.ceph.osd.3:Started 2024-08-27T02:30:34.985 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-27T02:30:34.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-27T02:30:34.986 INFO:tasks.ceph.osd.4:Started 2024-08-27T02:30:34.987 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-27T02:30:34.987 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-27T02:30:34.988 INFO:tasks.ceph.osd.5:Started 2024-08-27T02:30:34.988 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-27T02:30:34.989 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-27T02:30:34.990 INFO:tasks.ceph.osd.6:Started 2024-08-27T02:30:34.990 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-27T02:30:34.991 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-27T02:30:34.993 INFO:tasks.ceph.osd.7:Started 2024-08-27T02:30:34.993 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-27T02:30:35.245 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:30:35.245 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":10,"fsid":"2bd9f312-2905-4c35-8bed-4bbae91a1fc0","created":"2024-08-27T02:30:32.659875+0000","modified":"2024-08-27T02:30:34.955101+0000","last_up_change":"0.000000","last_in_change":"2024-08-27T02:30:34.955101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d507e514-2956-41e1-9e95-23db7e11d2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86e299bc-e71b-42e5-aede-b7f685b509ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26a2b164-aa60-47bf-ac44-f85aebbe9505","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6eb8aad7-7383-448d-9847-054191aaf780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0418e412-238a-4d63-ae59-8e7cdf5fdfb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5e73fea8-56ab-42ff-8e05-537a33b1da58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad844130-54fa-45ca-a121-2edf1b658b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f7f84897-483a-49d9-82a1-baeae11786a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-27T02:30:35.266 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-27T02:30:35.267 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-27T02:30:35.729 INFO:tasks.ceph.mgr.x.smithi181.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-27T02:30:35.730 INFO:tasks.ceph.mgr.x.smithi181.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-27T02:30:35.730 INFO:tasks.ceph.mgr.x.smithi181.stderr: from numpy import show_config as show_numpy_config 2024-08-27T02:30:36.073 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-27T02:30:36.175 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-08-27T02:30:36.174+0000 7f3d722b67c0 -1 Falling back to public interface 2024-08-27T02:30:36.175 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-08-27T02:30:36.172+0000 7f53a3bf37c0 -1 Falling back to public interface 2024-08-27T02:30:36.301 INFO:teuthology.misc.health.smithi143.stdout: 2024-08-27T02:30:36.301 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":10,"fsid":"2bd9f312-2905-4c35-8bed-4bbae91a1fc0","created":"2024-08-27T02:30:32.659875+0000","modified":"2024-08-27T02:30:34.955101+0000","last_up_change":"0.000000","last_in_change":"2024-08-27T02:30:34.955101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d507e514-2956-41e1-9e95-23db7e11d2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86e299bc-e71b-42e5-aede-b7f685b509ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26a2b164-aa60-47bf-ac44-f85aebbe9505","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6eb8aad7-7383-448d-9847-054191aaf780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0418e412-238a-4d63-ae59-8e7cdf5fdfb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5e73fea8-56ab-42ff-8e05-537a33b1da58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad844130-54fa-45ca-a121-2edf1b658b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f7f84897-483a-49d9-82a1-baeae11786a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-27T02:30:36.315 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-27T02:30:36.359 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-08-27T02:30:36.358+0000 7f9272b5b7c0 -1 Falling back to public interface 2024-08-27T02:30:36.391 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-08-27T02:30:36.388+0000 7f076c0d07c0 -1 Falling back to public interface 2024-08-27T02:30:36.398 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-08-27T02:30:36.396+0000 7f3776a267c0 -1 Falling back to public interface 2024-08-27T02:30:36.431 INFO:tasks.ceph.mgr.y.smithi143.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-27T02:30:36.431 INFO:tasks.ceph.mgr.y.smithi143.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-27T02:30:36.431 INFO:tasks.ceph.mgr.y.smithi143.stderr: from numpy import show_config as show_numpy_config 2024-08-27T02:30:36.591 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-08-27T02:30:36.590+0000 7fb3281727c0 -1 Falling back to public interface 2024-08-27T02:30:36.630 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-08-27T02:30:36.630+0000 7f6fe18bc7c0 -1 Falling back to public interface 2024-08-27T02:30:36.899 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-08-27T02:30:36.896+0000 7f7e747457c0 -1 Falling back to public interface 2024-08-27T02:30:38.635 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-08-27T02:30:38.632+0000 7f3a2b6d0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-27T02:30:38.638 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-08-27T02:30:38.636+0000 7f3a2b6d0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-27T02:30:40.215 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-08-27T02:30:40.214+0000 7f3d722b67c0 -1 osd.2 0 log_to_monitors true 2024-08-27T02:30:40.313 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-08-27T02:30:40.308+0000 7f3776a267c0 -1 osd.7 0 log_to_monitors true 2024-08-27T02:30:40.440 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-08-27T02:30:40.438+0000 7f9272b5b7c0 -1 osd.3 0 log_to_monitors true 2024-08-27T02:30:40.505 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-08-27T02:30:40.500+0000 7f53a3bf37c0 -1 osd.5 0 log_to_monitors true 2024-08-27T02:30:40.522 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-08-27T02:30:40.520+0000 7f076c0d07c0 -1 osd.6 0 log_to_monitors true 2024-08-27T02:30:40.753 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-08-27T02:30:40.754+0000 7fb3281727c0 -1 osd.0 0 log_to_monitors true 2024-08-27T02:30:40.959 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-08-27T02:30:40.956+0000 7f7e747457c0 -1 osd.4 0 log_to_monitors true 2024-08-27T02:30:40.986 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-08-27T02:30:40.986+0000 7f6fe18bc7c0 -1 osd.1 0 log_to_monitors true 2024-08-27T02:30:43.122 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-27T02:30:43.130 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-08-27T02:30:43.130+0000 7f3d6ea71640 -1 osd.2 0 waiting for initial osdmap 2024-08-27T02:30:43.194 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-08-27T02:30:43.194+0000 7f3d66091640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:43.219 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-08-27T02:30:43.218+0000 7f926f316640 -1 osd.3 0 waiting for initial osdmap 2024-08-27T02:30:43.295 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-08-27T02:30:43.294+0000 7f9266936640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:43.369 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-08-27T02:30:43.368+0000 7f0768079640 -1 osd.6 0 waiting for initial osdmap 2024-08-27T02:30:43.381 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-08-27T02:30:43.380+0000 7f53a03ae640 -1 osd.5 0 waiting for initial osdmap 2024-08-27T02:30:43.402 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-08-27T02:30:43.404+0000 7f075feab640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:43.422 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-08-27T02:30:43.424+0000 7f53979ce640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:43.461 INFO:teuthology.misc.health.smithi143.stdout: 2024-08-27T02:30:43.461 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":13,"fsid":"2bd9f312-2905-4c35-8bed-4bbae91a1fc0","created":"2024-08-27T02:30:32.659875+0000","modified":"2024-08-27T02:30:42.699700+0000","last_up_change":"0.000000","last_in_change":"2024-08-27T02:30:34.955101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d507e514-2956-41e1-9e95-23db7e11d2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86e299bc-e71b-42e5-aede-b7f685b509ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26a2b164-aa60-47bf-ac44-f85aebbe9505","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6eb8aad7-7383-448d-9847-054191aaf780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0418e412-238a-4d63-ae59-8e7cdf5fdfb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5e73fea8-56ab-42ff-8e05-537a33b1da58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad844130-54fa-45ca-a121-2edf1b658b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f7f84897-483a-49d9-82a1-baeae11786a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-27T02:30:43.481 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-27T02:30:43.669 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-08-27T02:30:43.668+0000 7f37731e1640 -1 osd.7 0 waiting for initial osdmap 2024-08-27T02:30:43.698 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-08-27T02:30:43.700+0000 7f376a801640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:43.930 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-08-27T02:30:43.932+0000 7f7e706ee640 -1 osd.4 0 waiting for initial osdmap 2024-08-27T02:30:43.975 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-08-27T02:30:43.976+0000 7f7e68520640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:44.104 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-08-27T02:30:44.102+0000 7fb32411b640 -1 osd.0 0 waiting for initial osdmap 2024-08-27T02:30:44.106 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-08-27T02:30:44.106+0000 7f6fde077640 -1 osd.1 0 waiting for initial osdmap 2024-08-27T02:30:44.126 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-08-27T02:30:44.126+0000 7fb31bf4d640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:44.130 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-08-27T02:30:44.130+0000 7f6fd5697640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-27T02:30:50.288 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-27T02:30:50.595 INFO:teuthology.misc.health.smithi143.stdout: 2024-08-27T02:30:50.595 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":18,"fsid":"2bd9f312-2905-4c35-8bed-4bbae91a1fc0","created":"2024-08-27T02:30:32.659875+0000","modified":"2024-08-27T02:30:48.172401+0000","last_up_change":"2024-08-27T02:30:45.152567+0000","last_in_change":"2024-08-27T02:30:34.955101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-27T02:30:45.666848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d507e514-2956-41e1-9e95-23db7e11d2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6817","nonce":203223605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6819","nonce":203223605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6823","nonce":203223605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6821","nonce":203223605}]},"public_addr":"172.21.15.143:6817/203223605","cluster_addr":"172.21.15.143:6819/203223605","heartbeat_back_addr":"172.21.15.143:6823/203223605","heartbeat_front_addr":"172.21.15.143:6821/203223605","state":["exists","up"]},{"osd":1,"uuid":"86e299bc-e71b-42e5-aede-b7f685b509ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6825","nonce":2173528226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6827","nonce":2173528226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6831","nonce":2173528226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6829","nonce":2173528226}]},"public_addr":"172.21.15.143:6825/2173528226","cluster_addr":"172.21.15.143:6827/2173528226","heartbeat_back_addr":"172.21.15.143:6831/2173528226","heartbeat_front_addr":"172.21.15.143:6829/2173528226","state":["exists","up"]},{"osd":2,"uuid":"26a2b164-aa60-47bf-ac44-f85aebbe9505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6801","nonce":2368617930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6803","nonce":2368617930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6807","nonce":2368617930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6805","nonce":2368617930}]},"public_addr":"172.21.15.143:6801/2368617930","cluster_addr":"172.21.15.143:6803/2368617930","heartbeat_back_addr":"172.21.15.143:6807/2368617930","heartbeat_front_addr":"172.21.15.143:6805/2368617930","state":["exists","up"]},{"osd":3,"uuid":"6eb8aad7-7383-448d-9847-054191aaf780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6809","nonce":3382757569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6811","nonce":3382757569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6815","nonce":3382757569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6813","nonce":3382757569}]},"public_addr":"172.21.15.143:6809/3382757569","cluster_addr":"172.21.15.143:6811/3382757569","heartbeat_back_addr":"172.21.15.143:6815/3382757569","heartbeat_front_addr":"172.21.15.143:6813/3382757569","state":["exists","up"]},{"osd":4,"uuid":"0418e412-238a-4d63-ae59-8e7cdf5fdfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6825","nonce":3209286965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6827","nonce":3209286965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6831","nonce":3209286965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6829","nonce":3209286965}]},"public_addr":"172.21.15.181:6825/3209286965","cluster_addr":"172.21.15.181:6827/3209286965","heartbeat_back_addr":"172.21.15.181:6831/3209286965","heartbeat_front_addr":"172.21.15.181:6829/3209286965","state":["exists","up"]},{"osd":5,"uuid":"5e73fea8-56ab-42ff-8e05-537a33b1da58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6801","nonce":2843441581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6803","nonce":2843441581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6807","nonce":2843441581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6805","nonce":2843441581}]},"public_addr":"172.21.15.181:6801/2843441581","cluster_addr":"172.21.15.181:6803/2843441581","heartbeat_back_addr":"172.21.15.181:6807/2843441581","heartbeat_front_addr":"172.21.15.181:6805/2843441581","state":["exists","up"]},{"osd":6,"uuid":"ad844130-54fa-45ca-a121-2edf1b658b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659401645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659401645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659401645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659401645}]},"public_addr":"172.21.15.181:6809/3659401645","cluster_addr":"172.21.15.181:6811/3659401645","heartbeat_back_addr":"172.21.15.181:6815/3659401645","heartbeat_front_addr":"172.21.15.181:6813/3659401645","state":["exists","up"]},{"osd":7,"uuid":"f7f84897-483a-49d9-82a1-baeae11786a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6817","nonce":1853453285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6819","nonce":1853453285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6823","nonce":1853453285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6821","nonce":1853453285}]},"public_addr":"172.21.15.181:6817/1853453285","cluster_addr":"172.21.15.181:6819/1853453285","heartbeat_back_addr":"172.21.15.181:6823/1853453285","heartbeat_front_addr":"172.21.15.181:6821/1853453285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.777253+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.966329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.254168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.453846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:42.001243+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.466919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.551083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.288126+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-27T02:30:50.612 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-27T02:30:50.612 INFO:tasks.ceph:Creating RBD pool 2024-08-27T02:30:50.612 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd pool create rbd 8 2024-08-27T02:30:51.193 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'rbd' created 2024-08-27T02:30:51.223 DEBUG:teuthology.orchestra.run.smithi143:> rbd --cluster ceph pool init rbd 2024-08-27T02:30:51.258 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:30:51.258 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:30:54.304 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-27T02:30:54.305 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-08-27T02:30:54.306 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-27T02:30:54.665 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:30:54.684 INFO:teuthology.orchestra.run.smithi143.stdout:[{"version":9,"timestamp":"2024-08-27T02:30:44.114758+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"5942.669781"}]}] 2024-08-27T02:30:54.684 INFO:tasks.ceph_manager:config epoch is 9 2024-08-27T02:30:54.685 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-27T02:30:54.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-27T02:30:54.685 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-27T02:30:55.034 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:30:55.052 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":3883673734},{"type":"v1","addr":"172.21.15.181:6833","nonce":3883673734}]},"active_addr":"172.21.15.181:6833/3883673734","active_change":"2024-08-27T02:30:37.614352+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4120,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3956094973}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":2654476438}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3178060313}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":1510458032}]}]} 2024-08-27T02:30:55.057 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-27T02:30:55.058 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-27T02:30:55.058 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-27T02:30:55.342 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:30:55.343 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":22,"fsid":"2bd9f312-2905-4c35-8bed-4bbae91a1fc0","created":"2024-08-27T02:30:32.659875+0000","modified":"2024-08-27T02:30:54.213543+0000","last_up_change":"2024-08-27T02:30:45.152567+0000","last_in_change":"2024-08-27T02:30:34.955101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-27T02:30:45.666848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-27T02:30:50.925178+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d507e514-2956-41e1-9e95-23db7e11d2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6817","nonce":203223605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6819","nonce":203223605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6823","nonce":203223605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6821","nonce":203223605}]},"public_addr":"172.21.15.143:6817/203223605","cluster_addr":"172.21.15.143:6819/203223605","heartbeat_back_addr":"172.21.15.143:6823/203223605","heartbeat_front_addr":"172.21.15.143:6821/203223605","state":["exists","up"]},{"osd":1,"uuid":"86e299bc-e71b-42e5-aede-b7f685b509ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6825","nonce":2173528226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6827","nonce":2173528226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6831","nonce":2173528226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6829","nonce":2173528226}]},"public_addr":"172.21.15.143:6825/2173528226","cluster_addr":"172.21.15.143:6827/2173528226","heartbeat_back_addr":"172.21.15.143:6831/2173528226","heartbeat_front_addr":"172.21.15.143:6829/2173528226","state":["exists","up"]},{"osd":2,"uuid":"26a2b164-aa60-47bf-ac44-f85aebbe9505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6801","nonce":2368617930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6803","nonce":2368617930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6807","nonce":2368617930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6805","nonce":2368617930}]},"public_addr":"172.21.15.143:6801/2368617930","cluster_addr":"172.21.15.143:6803/2368617930","heartbeat_back_addr":"172.21.15.143:6807/2368617930","heartbeat_front_addr":"172.21.15.143:6805/2368617930","state":["exists","up"]},{"osd":3,"uuid":"6eb8aad7-7383-448d-9847-054191aaf780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6809","nonce":3382757569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6811","nonce":3382757569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6815","nonce":3382757569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6813","nonce":3382757569}]},"public_addr":"172.21.15.143:6809/3382757569","cluster_addr":"172.21.15.143:6811/3382757569","heartbeat_back_addr":"172.21.15.143:6815/3382757569","heartbeat_front_addr":"172.21.15.143:6813/3382757569","state":["exists","up"]},{"osd":4,"uuid":"0418e412-238a-4d63-ae59-8e7cdf5fdfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6825","nonce":3209286965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6827","nonce":3209286965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6831","nonce":3209286965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6829","nonce":3209286965}]},"public_addr":"172.21.15.181:6825/3209286965","cluster_addr":"172.21.15.181:6827/3209286965","heartbeat_back_addr":"172.21.15.181:6831/3209286965","heartbeat_front_addr":"172.21.15.181:6829/3209286965","state":["exists","up"]},{"osd":5,"uuid":"5e73fea8-56ab-42ff-8e05-537a33b1da58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6801","nonce":2843441581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6803","nonce":2843441581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6807","nonce":2843441581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6805","nonce":2843441581}]},"public_addr":"172.21.15.181:6801/2843441581","cluster_addr":"172.21.15.181:6803/2843441581","heartbeat_back_addr":"172.21.15.181:6807/2843441581","heartbeat_front_addr":"172.21.15.181:6805/2843441581","state":["exists","up"]},{"osd":6,"uuid":"ad844130-54fa-45ca-a121-2edf1b658b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659401645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659401645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659401645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659401645}]},"public_addr":"172.21.15.181:6809/3659401645","cluster_addr":"172.21.15.181:6811/3659401645","heartbeat_back_addr":"172.21.15.181:6815/3659401645","heartbeat_front_addr":"172.21.15.181:6813/3659401645","state":["exists","up"]},{"osd":7,"uuid":"f7f84897-483a-49d9-82a1-baeae11786a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6817","nonce":1853453285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6819","nonce":1853453285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6823","nonce":1853453285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6821","nonce":1853453285}]},"public_addr":"172.21.15.181:6817/1853453285","cluster_addr":"172.21.15.181:6819/1853453285","heartbeat_back_addr":"172.21.15.181:6823/1853453285","heartbeat_front_addr":"172.21.15.181:6821/1853453285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.777253+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.966329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.254168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.453846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:42.001243+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.466919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.551083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.288126+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-27T02:30:55.360 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-27T02:30:55.360 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-27T02:30:55.638 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:30:55.638 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":22,"fsid":"2bd9f312-2905-4c35-8bed-4bbae91a1fc0","created":"2024-08-27T02:30:32.659875+0000","modified":"2024-08-27T02:30:54.213543+0000","last_up_change":"2024-08-27T02:30:45.152567+0000","last_in_change":"2024-08-27T02:30:34.955101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-27T02:30:45.666848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-27T02:30:50.925178+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d507e514-2956-41e1-9e95-23db7e11d2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6817","nonce":203223605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6819","nonce":203223605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6823","nonce":203223605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6821","nonce":203223605}]},"public_addr":"172.21.15.143:6817/203223605","cluster_addr":"172.21.15.143:6819/203223605","heartbeat_back_addr":"172.21.15.143:6823/203223605","heartbeat_front_addr":"172.21.15.143:6821/203223605","state":["exists","up"]},{"osd":1,"uuid":"86e299bc-e71b-42e5-aede-b7f685b509ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6825","nonce":2173528226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6827","nonce":2173528226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6831","nonce":2173528226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6829","nonce":2173528226}]},"public_addr":"172.21.15.143:6825/2173528226","cluster_addr":"172.21.15.143:6827/2173528226","heartbeat_back_addr":"172.21.15.143:6831/2173528226","heartbeat_front_addr":"172.21.15.143:6829/2173528226","state":["exists","up"]},{"osd":2,"uuid":"26a2b164-aa60-47bf-ac44-f85aebbe9505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6801","nonce":2368617930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6803","nonce":2368617930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6807","nonce":2368617930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6805","nonce":2368617930}]},"public_addr":"172.21.15.143:6801/2368617930","cluster_addr":"172.21.15.143:6803/2368617930","heartbeat_back_addr":"172.21.15.143:6807/2368617930","heartbeat_front_addr":"172.21.15.143:6805/2368617930","state":["exists","up"]},{"osd":3,"uuid":"6eb8aad7-7383-448d-9847-054191aaf780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6809","nonce":3382757569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6811","nonce":3382757569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6815","nonce":3382757569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6813","nonce":3382757569}]},"public_addr":"172.21.15.143:6809/3382757569","cluster_addr":"172.21.15.143:6811/3382757569","heartbeat_back_addr":"172.21.15.143:6815/3382757569","heartbeat_front_addr":"172.21.15.143:6813/3382757569","state":["exists","up"]},{"osd":4,"uuid":"0418e412-238a-4d63-ae59-8e7cdf5fdfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6825","nonce":3209286965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6827","nonce":3209286965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6831","nonce":3209286965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6829","nonce":3209286965}]},"public_addr":"172.21.15.181:6825/3209286965","cluster_addr":"172.21.15.181:6827/3209286965","heartbeat_back_addr":"172.21.15.181:6831/3209286965","heartbeat_front_addr":"172.21.15.181:6829/3209286965","state":["exists","up"]},{"osd":5,"uuid":"5e73fea8-56ab-42ff-8e05-537a33b1da58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6801","nonce":2843441581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6803","nonce":2843441581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6807","nonce":2843441581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6805","nonce":2843441581}]},"public_addr":"172.21.15.181:6801/2843441581","cluster_addr":"172.21.15.181:6803/2843441581","heartbeat_back_addr":"172.21.15.181:6807/2843441581","heartbeat_front_addr":"172.21.15.181:6805/2843441581","state":["exists","up"]},{"osd":6,"uuid":"ad844130-54fa-45ca-a121-2edf1b658b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659401645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659401645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659401645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659401645}]},"public_addr":"172.21.15.181:6809/3659401645","cluster_addr":"172.21.15.181:6811/3659401645","heartbeat_back_addr":"172.21.15.181:6815/3659401645","heartbeat_front_addr":"172.21.15.181:6813/3659401645","state":["exists","up"]},{"osd":7,"uuid":"f7f84897-483a-49d9-82a1-baeae11786a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6817","nonce":1853453285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6819","nonce":1853453285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6823","nonce":1853453285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6821","nonce":1853453285}]},"public_addr":"172.21.15.181:6817/1853453285","cluster_addr":"172.21.15.181:6819/1853453285","heartbeat_back_addr":"172.21.15.181:6823/1853453285","heartbeat_front_addr":"172.21.15.181:6821/1853453285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.777253+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.966329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.254168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.453846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:42.001243+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.466919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.551083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.288126+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-27T02:30:55.656 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-27T02:30:55.657 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-27T02:30:55.657 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-27T02:30:55.657 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-27T02:30:55.658 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-27T02:30:55.658 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-27T02:30:55.659 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-27T02:30:55.659 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-27T02:30:55.899 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:55.899 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-27T02:30:55.926 INFO:teuthology.orchestra.run.smithi143.stdout:64424509444 2024-08-27T02:30:55.926 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-27T02:30:55.934 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:55.934 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-27T02:30:55.935 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:55.936 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-27T02:30:55.937 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:55.937 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-27T02:30:55.939 INFO:teuthology.orchestra.run.smithi143.stdout:60129542151 2024-08-27T02:30:55.940 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-27T02:30:55.944 INFO:teuthology.orchestra.run.smithi143.stdout:60129542151 2024-08-27T02:30:55.944 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-27T02:30:55.948 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:55.949 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-27T02:30:56.441 INFO:teuthology.orchestra.run.smithi143.stdout:60129542148 2024-08-27T02:30:56.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-08-27T02:30:56.464 INFO:teuthology.orchestra.run.smithi143.stdout:64424509442 2024-08-27T02:30:56.475 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:56.476 INFO:teuthology.orchestra.run.smithi143.stdout:60129542148 2024-08-27T02:30:56.476 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:56.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.1 2024-08-27T02:30:56.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-08-27T02:30:56.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-08-27T02:30:56.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-08-27T02:30:56.511 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:56.518 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:56.518 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:56.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-08-27T02:30:56.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-08-27T02:30:56.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2024-08-27T02:30:57.464 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-27T02:30:57.496 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-27T02:30:57.502 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-27T02:30:57.510 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-27T02:30:57.512 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-27T02:30:57.533 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-27T02:30:57.541 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-27T02:30:57.541 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-27T02:30:57.982 INFO:teuthology.orchestra.run.smithi143.stdout:60129542148 2024-08-27T02:30:58.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-08-27T02:30:58.020 INFO:teuthology.orchestra.run.smithi143.stdout:64424509442 2024-08-27T02:30:58.020 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:58.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.1 2024-08-27T02:30:58.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-08-27T02:30:58.069 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:58.078 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:58.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2024-08-27T02:30:58.091 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:58.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-08-27T02:30:58.104 INFO:teuthology.orchestra.run.smithi143.stdout:60129542148 2024-08-27T02:30:58.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-08-27T02:30:58.112 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:58.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-08-27T02:30:58.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-08-27T02:30:59.006 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-27T02:30:59.051 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-27T02:30:59.052 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-27T02:30:59.090 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-27T02:30:59.099 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-27T02:30:59.110 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-27T02:30:59.130 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-27T02:30:59.136 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-27T02:30:59.504 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:59.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-08-27T02:30:59.528 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.569 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:59.575 INFO:teuthology.orchestra.run.smithi143.stdout:64424509444 2024-08-27T02:30:59.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-08-27T02:30:59.598 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.1 2024-08-27T02:30:59.603 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.607 INFO:teuthology.orchestra.run.smithi143.stdout:60129542149 2024-08-27T02:30:59.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-08-27T02:30:59.632 INFO:teuthology.orchestra.run.smithi143.stdout:60129542151 2024-08-27T02:30:59.632 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:59.632 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-08-27T02:30:59.660 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-08-27T02:30:59.661 INFO:teuthology.orchestra.run.smithi143.stdout:60129542150 2024-08-27T02:30:59.661 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-08-27T02:30:59.678 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.684 INFO:teuthology.orchestra.run.smithi143.stdout:60129542151 2024-08-27T02:30:59.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-08-27T02:30:59.701 DEBUG:teuthology.parallel:result is None 2024-08-27T02:30:59.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-27T02:30:59.702 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T02:31:00.022 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:31:00.023 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T02:31:00.039 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-27T02:30:59.629878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219208,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":2998272,"data_stored":1792310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.430245"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.326308+0000","last_change":"2024-08-27T02:30:54.326308+0000","last_active":"2024-08-27T02:30:54.326308+0000","last_peered":"2024-08-27T02:30:54.326308+0000","last_clean":"2024-08-27T02:30:54.326308+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T02:30:54.326308+0000","last_undegraded":"2024-08-27T02:30:54.326308+0000","last_fullsized":"2024-08-27T02:30:54.326308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:39.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.235830+0000","last_change":"2024-08-27T02:30:54.235830+0000","last_active":"2024-08-27T02:30:54.235830+0000","last_peered":"2024-08-27T02:30:54.235830+0000","last_clean":"2024-08-27T02:30:54.235830+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T02:30:54.235830+0000","last_undegraded":"2024-08-27T02:30:54.235830+0000","last_fullsized":"2024-08-27T02:30:54.235830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:16.134185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.329145+0000","last_change":"2024-08-27T02:30:54.329145+0000","last_active":"2024-08-27T02:30:54.329145+0000","last_peered":"2024-08-27T02:30:54.329145+0000","last_clean":"2024-08-27T02:30:54.329145+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T02:30:54.329145+0000","last_undegraded":"2024-08-27T02:30:54.329145+0000","last_fullsized":"2024-08-27T02:30:54.329145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:09:53.126738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.235714+0000","last_change":"2024-08-27T02:30:54.235714+0000","last_active":"2024-08-27T02:30:54.235714+0000","last_peered":"2024-08-27T02:30:54.235714+0000","last_clean":"2024-08-27T02:30:54.235714+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T02:30:54.235714+0000","last_undegraded":"2024-08-27T02:30:54.235714+0000","last_fullsized":"2024-08-27T02:30:54.235714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:03:53.967353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.234419+0000","last_change":"2024-08-27T02:30:54.233089+0000","last_active":"2024-08-27T02:30:54.234419+0000","last_peered":"2024-08-27T02:30:54.234419+0000","last_clean":"2024-08-27T02:30:54.234419+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T02:30:54.234419+0000","last_undegraded":"2024-08-27T02:30:54.234419+0000","last_fullsized":"2024-08-27T02:30:54.234419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.225706+0000","last_change":"2024-08-27T02:30:54.225706+0000","last_active":"2024-08-27T02:30:54.225706+0000","last_peered":"2024-08-27T02:30:54.225706+0000","last_clean":"2024-08-27T02:30:54.225706+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T02:30:54.225706+0000","last_undegraded":"2024-08-27T02:30:54.225706+0000","last_fullsized":"2024-08-27T02:30:54.225706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.329044+0000","last_change":"2024-08-27T02:30:54.329044+0000","last_active":"2024-08-27T02:30:54.329044+0000","last_peered":"2024-08-27T02:30:54.329044+0000","last_clean":"2024-08-27T02:30:54.329044+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T02:30:54.329044+0000","last_undegraded":"2024-08-27T02:30:54.329044+0000","last_fullsized":"2024-08-27T02:30:54.329044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:29.700171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.230879+0000","last_change":"2024-08-27T02:30:54.230879+0000","last_active":"2024-08-27T02:30:54.230879+0000","last_peered":"2024-08-27T02:30:54.230879+0000","last_clean":"2024-08-27T02:30:54.230879+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T02:30:54.230879+0000","last_undegraded":"2024-08-27T02:30:54.230879+0000","last_fullsized":"2024-08-27T02:30:54.230879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:44:20.045106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.327712+0000","last_change":"2024-08-27T02:30:47.729098+0000","last_active":"2024-08-27T02:30:54.327712+0000","last_peered":"2024-08-27T02:30:54.327712+0000","last_clean":"2024-08-27T02:30:54.327712+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T02:30:54.327712+0000","last_undegraded":"2024-08-27T02:30:54.327712+0000","last_fullsized":"2024-08-27T02:30:54.327712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_clean_scrub_stamp":"2024-08-27T02:30:46.155361+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:24.032204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":666810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":666810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T02:31:00.040 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T02:31:00.319 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:31:00.319 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T02:31:00.336 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-27T02:30:59.629878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219208,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":2998272,"data_stored":1792310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.430245"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.326308+0000","last_change":"2024-08-27T02:30:54.326308+0000","last_active":"2024-08-27T02:30:54.326308+0000","last_peered":"2024-08-27T02:30:54.326308+0000","last_clean":"2024-08-27T02:30:54.326308+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T02:30:54.326308+0000","last_undegraded":"2024-08-27T02:30:54.326308+0000","last_fullsized":"2024-08-27T02:30:54.326308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:39.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.235830+0000","last_change":"2024-08-27T02:30:54.235830+0000","last_active":"2024-08-27T02:30:54.235830+0000","last_peered":"2024-08-27T02:30:54.235830+0000","last_clean":"2024-08-27T02:30:54.235830+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T02:30:54.235830+0000","last_undegraded":"2024-08-27T02:30:54.235830+0000","last_fullsized":"2024-08-27T02:30:54.235830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:16.134185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.329145+0000","last_change":"2024-08-27T02:30:54.329145+0000","last_active":"2024-08-27T02:30:54.329145+0000","last_peered":"2024-08-27T02:30:54.329145+0000","last_clean":"2024-08-27T02:30:54.329145+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T02:30:54.329145+0000","last_undegraded":"2024-08-27T02:30:54.329145+0000","last_fullsized":"2024-08-27T02:30:54.329145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:09:53.126738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.235714+0000","last_change":"2024-08-27T02:30:54.235714+0000","last_active":"2024-08-27T02:30:54.235714+0000","last_peered":"2024-08-27T02:30:54.235714+0000","last_clean":"2024-08-27T02:30:54.235714+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T02:30:54.235714+0000","last_undegraded":"2024-08-27T02:30:54.235714+0000","last_fullsized":"2024-08-27T02:30:54.235714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:03:53.967353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.234419+0000","last_change":"2024-08-27T02:30:54.233089+0000","last_active":"2024-08-27T02:30:54.234419+0000","last_peered":"2024-08-27T02:30:54.234419+0000","last_clean":"2024-08-27T02:30:54.234419+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T02:30:54.234419+0000","last_undegraded":"2024-08-27T02:30:54.234419+0000","last_fullsized":"2024-08-27T02:30:54.234419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.225706+0000","last_change":"2024-08-27T02:30:54.225706+0000","last_active":"2024-08-27T02:30:54.225706+0000","last_peered":"2024-08-27T02:30:54.225706+0000","last_clean":"2024-08-27T02:30:54.225706+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T02:30:54.225706+0000","last_undegraded":"2024-08-27T02:30:54.225706+0000","last_fullsized":"2024-08-27T02:30:54.225706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.329044+0000","last_change":"2024-08-27T02:30:54.329044+0000","last_active":"2024-08-27T02:30:54.329044+0000","last_peered":"2024-08-27T02:30:54.329044+0000","last_clean":"2024-08-27T02:30:54.329044+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T02:30:54.329044+0000","last_undegraded":"2024-08-27T02:30:54.329044+0000","last_fullsized":"2024-08-27T02:30:54.329044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:29.700171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.230879+0000","last_change":"2024-08-27T02:30:54.230879+0000","last_active":"2024-08-27T02:30:54.230879+0000","last_peered":"2024-08-27T02:30:54.230879+0000","last_clean":"2024-08-27T02:30:54.230879+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T02:30:54.230879+0000","last_undegraded":"2024-08-27T02:30:54.230879+0000","last_fullsized":"2024-08-27T02:30:54.230879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:44:20.045106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-27T02:30:54.327712+0000","last_change":"2024-08-27T02:30:47.729098+0000","last_active":"2024-08-27T02:30:54.327712+0000","last_peered":"2024-08-27T02:30:54.327712+0000","last_clean":"2024-08-27T02:30:54.327712+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T02:30:54.327712+0000","last_undegraded":"2024-08-27T02:30:54.327712+0000","last_fullsized":"2024-08-27T02:30:54.327712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_clean_scrub_stamp":"2024-08-27T02:30:46.155361+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:24.032204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":666810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":666810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T02:31:00.337 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-27T02:31:00.337 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-27T02:31:00.338 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-27T02:31:00.338 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-27T02:31:00.657 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:31:00.657 INFO:teuthology.orchestra.run.smithi143.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-27T02:31:00.674 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-27T02:31:00.674 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-08-27T02:31:00.688 INFO:teuthology.run_tasks:Running task rgw... 2024-08-27T02:31:00.710 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-08-27T02:31:00.710 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-08-27T02:31:00.710 INFO:tasks.rgw:Creating data pools 2024-08-27T02:31:00.711 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-08-27T02:31:00.711 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-08-27T02:31:01.595 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-08-27T02:31:03.392 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'default.rgw.buckets.data' created 2024-08-27T02:31:03.426 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-08-27T02:31:04.412 INFO:teuthology.orchestra.run.smithi143.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-08-27T02:31:04.455 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-08-27T02:31:05.436 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'default.rgw.buckets.index' created 2024-08-27T02:31:05.463 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-08-27T02:31:06.416 INFO:teuthology.orchestra.run.smithi143.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-08-27T02:31:06.457 DEBUG:tasks.rgw:Pools created 2024-08-27T02:31:06.457 INFO:tasks.rgw:Configuring compression type = random 2024-08-27T02:31:06.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-08-27T02:31:06.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-08-27T02:31:06.458 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-08-27T02:31:06.506 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:06.506 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:08.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.525+0000 7f5933333640 0 -- 172.21.15.143:0/1608654941 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d8cc3707f0 msgr2=0x55d8cc370c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2024-08-27T02:31:08.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.533+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.533+0000 7f5932b32640 0 -- 172.21.15.143:0/3566663975 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55d8cc3872f0 msgr2=0x55d8cc3896e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:31:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 20 realm 2024-08-27T02:31:08.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:31:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:08.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.737+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.741+0000 7f593582d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:31:08.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.741+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.741+0000 7f593582d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-08-27T02:31:08.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.741+0000 7f593582d9c0 20 searching for the correct realm 2024-08-27T02:31:08.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:31:08.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:31:08.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:31:08.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:31:08.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:31:08.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:31:08.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:08.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 zone default found 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 4 Realm: () 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:31:08.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:31:08.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 zonegroup default 2024-08-27T02:31:08.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.777+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:08.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.781+0000 7f593582d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:08.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:08.781+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:10.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:10.457+0000 7f593582d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:10.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:10.457+0000 7f593582d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:10.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:10.465+0000 7f593582d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:10.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:10.465+0000 7f593582d9c0 20 started sync module instance, tier type = 2024-08-27T02:31:10.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:10.465+0000 7f593582d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:31:12.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=0 2024-08-27T02:31:12.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=1 2024-08-27T02:31:12.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=2 2024-08-27T02:31:12.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=3 2024-08-27T02:31:12.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=4 2024-08-27T02:31:12.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=5 2024-08-27T02:31:12.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=6 2024-08-27T02:31:12.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 add_watcher() i=7 2024-08-27T02:31:12.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:31:12.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-08-27T02:31:12.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-08-27T02:31:12.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.532+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-08-27T02:31:12.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-08-27T02:31:12.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-08-27T02:31:12.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-08-27T02:31:12.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-08-27T02:31:12.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-08-27T02:31:12.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-08-27T02:31:12.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-08-27T02:31:12.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-08-27T02:31:12.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-08-27T02:31:12.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-08-27T02:31:12.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-08-27T02:31:12.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-08-27T02:31:12.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-08-27T02:31:12.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-08-27T02:31:12.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-08-27T02:31:12.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.536+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-08-27T02:31:12.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-08-27T02:31:12.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-08-27T02:31:12.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-08-27T02:31:12.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-08-27T02:31:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-08-27T02:31:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-08-27T02:31:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-08-27T02:31:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-08-27T02:31:12.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-08-27T02:31:12.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-08-27T02:31:12.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-08-27T02:31:12.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-08-27T02:31:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-08-27T02:31:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.540+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-08-27T02:31:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-08-27T02:31:12.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-08-27T02:31:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-08-27T02:31:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-08-27T02:31:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-08-27T02:31:12.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-08-27T02:31:12.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-08-27T02:31:12.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-08-27T02:31:12.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-08-27T02:31:12.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-08-27T02:31:12.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-08-27T02:31:12.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-08-27T02:31:12.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-08-27T02:31:12.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.544+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-08-27T02:31:12.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-08-27T02:31:12.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-08-27T02:31:12.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-08-27T02:31:12.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-08-27T02:31:12.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-08-27T02:31:12.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-08-27T02:31:12.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-08-27T02:31:12.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-08-27T02:31:12.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-08-27T02:31:12.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-08-27T02:31:12.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-08-27T02:31:12.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.548+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-08-27T02:31:12.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-08-27T02:31:12.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-08-27T02:31:12.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-08-27T02:31:12.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-08-27T02:31:12.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-08-27T02:31:12.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-08-27T02:31:12.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-08-27T02:31:12.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-08-27T02:31:12.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-08-27T02:31:12.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-08-27T02:31:12.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-08-27T02:31:12.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-08-27T02:31:12.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-08-27T02:31:12.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.552+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-08-27T02:31:12.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-08-27T02:31:12.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-08-27T02:31:12.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-08-27T02:31:12.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-08-27T02:31:12.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-08-27T02:31:12.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-08-27T02:31:12.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-08-27T02:31:12.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-08-27T02:31:12.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-08-27T02:31:12.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-08-27T02:31:12.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-08-27T02:31:12.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-08-27T02:31:12.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-08-27T02:31:12.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.556+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-08-27T02:31:12.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-08-27T02:31:12.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.563 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-08-27T02:31:12.563 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-08-27T02:31:12.563 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-08-27T02:31:12.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-08-27T02:31:12.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-08-27T02:31:12.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-08-27T02:31:12.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-08-27T02:31:12.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-08-27T02:31:12.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-08-27T02:31:12.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-08-27T02:31:12.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.560+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-08-27T02:31:12.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-08-27T02:31:12.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-08-27T02:31:12.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-08-27T02:31:12.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-08-27T02:31:12.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-08-27T02:31:12.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-08-27T02:31:12.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-08-27T02:31:12.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-08-27T02:31:12.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-08-27T02:31:12.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-08-27T02:31:12.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-08-27T02:31:12.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-08-27T02:31:12.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-08-27T02:31:12.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.564+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-08-27T02:31:12.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-08-27T02:31:12.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-08-27T02:31:12.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-08-27T02:31:12.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-08-27T02:31:12.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-08-27T02:31:12.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-08-27T02:31:12.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-08-27T02:31:12.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-08-27T02:31:12.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-08-27T02:31:12.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-08-27T02:31:12.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-08-27T02:31:12.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-08-27T02:31:12.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-08-27T02:31:12.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-08-27T02:31:12.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-08-27T02:31:12.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.568+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-08-27T02:31:12.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-08-27T02:31:12.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-08-27T02:31:12.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-08-27T02:31:12.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-08-27T02:31:12.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-08-27T02:31:12.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-08-27T02:31:12.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-08-27T02:31:12.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-08-27T02:31:12.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-08-27T02:31:12.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-08-27T02:31:12.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-08-27T02:31:12.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-08-27T02:31:12.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-08-27T02:31:12.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.572+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-08-27T02:31:12.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-08-27T02:31:12.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-08-27T02:31:12.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-08-27T02:31:12.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-08-27T02:31:12.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-08-27T02:31:12.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-08-27T02:31:12.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-08-27T02:31:12.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-08-27T02:31:12.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-08-27T02:31:12.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-08-27T02:31:12.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-08-27T02:31:12.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-08-27T02:31:12.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-08-27T02:31:12.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.576+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-08-27T02:31:12.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-08-27T02:31:12.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-08-27T02:31:12.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-08-27T02:31:12.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-08-27T02:31:12.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-08-27T02:31:12.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-08-27T02:31:12.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-08-27T02:31:12.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-08-27T02:31:12.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-08-27T02:31:12.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.580+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-08-27T02:31:12.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-08-27T02:31:12.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-08-27T02:31:12.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-08-27T02:31:12.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-08-27T02:31:12.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-08-27T02:31:12.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-08-27T02:31:12.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-08-27T02:31:12.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-08-27T02:31:12.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-08-27T02:31:12.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-08-27T02:31:12.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-08-27T02:31:12.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.584+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-08-27T02:31:12.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-08-27T02:31:12.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-08-27T02:31:12.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-08-27T02:31:12.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-08-27T02:31:12.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-08-27T02:31:12.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-08-27T02:31:12.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-08-27T02:31:12.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-08-27T02:31:12.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-08-27T02:31:12.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.588+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-08-27T02:31:12.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-08-27T02:31:12.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-08-27T02:31:12.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-08-27T02:31:12.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-08-27T02:31:12.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-08-27T02:31:12.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-08-27T02:31:12.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-08-27T02:31:12.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-08-27T02:31:12.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-08-27T02:31:12.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-08-27T02:31:12.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-08-27T02:31:12.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.592+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-08-27T02:31:12.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-08-27T02:31:12.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-08-27T02:31:12.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-08-27T02:31:12.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-08-27T02:31:12.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-08-27T02:31:12.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-08-27T02:31:12.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-08-27T02:31:12.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-08-27T02:31:12.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-08-27T02:31:12.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.596+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-08-27T02:31:12.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-08-27T02:31:12.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-08-27T02:31:12.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-08-27T02:31:12.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-08-27T02:31:12.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-08-27T02:31:12.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-08-27T02:31:12.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-08-27T02:31:12.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-08-27T02:31:12.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-08-27T02:31:12.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-08-27T02:31:12.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-08-27T02:31:12.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-08-27T02:31:12.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-08-27T02:31:12.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.600+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-08-27T02:31:12.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-08-27T02:31:12.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-08-27T02:31:12.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-08-27T02:31:12.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-08-27T02:31:12.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-08-27T02:31:12.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-08-27T02:31:12.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-08-27T02:31:12.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-08-27T02:31:12.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-08-27T02:31:12.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.604+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-08-27T02:31:12.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-08-27T02:31:12.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-08-27T02:31:12.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-08-27T02:31:12.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-08-27T02:31:12.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-08-27T02:31:12.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-08-27T02:31:12.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-08-27T02:31:12.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-08-27T02:31:12.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-08-27T02:31:12.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-08-27T02:31:12.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.608+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-08-27T02:31:12.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-08-27T02:31:12.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-08-27T02:31:12.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-08-27T02:31:12.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-08-27T02:31:12.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-08-27T02:31:12.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-08-27T02:31:12.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.612+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-08-27T02:31:12.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.616+0000 7f593582d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-08-27T02:31:12.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.624+0000 7f57e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:31:12.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.624+0000 7f593582d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:12.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:12.624+0000 7f593582d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.484+0000 7f593582d9c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-08-27T02:31:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.484+0000 7f593582d9c0 5 note: GC not initialized 2024-08-27T02:31:15.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.580+0000 7f57e4fe1640 20 reqs_thread_entry: start 2024-08-27T02:31:15.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.580+0000 7f593582d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:31:15.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.580+0000 7f593582d9c0 20 Filter name: none 2024-08-27T02:31:15.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.580+0000 7f574e7fc640 20 reqs_thread_entry: start 2024-08-27T02:31:15.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.636+0000 7f57e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:31:15.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.644+0000 7f593582d9c0 20 remove_watcher() i=0 2024-08-27T02:31:15.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.644+0000 7f593582d9c0 2 removed watcher, disabling cache 2024-08-27T02:31:15.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.648+0000 7f593582d9c0 20 remove_watcher() i=1 2024-08-27T02:31:15.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.648+0000 7f593582d9c0 20 remove_watcher() i=2 2024-08-27T02:31:15.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.652+0000 7f593582d9c0 20 remove_watcher() i=3 2024-08-27T02:31:15.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.656+0000 7f593582d9c0 20 remove_watcher() i=4 2024-08-27T02:31:15.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.656+0000 7f593582d9c0 20 remove_watcher() i=5 2024-08-27T02:31:15.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.660+0000 7f593582d9c0 20 remove_watcher() i=6 2024-08-27T02:31:15.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.664+0000 7f593582d9c0 20 remove_watcher() i=7 2024-08-27T02:31:15.686 INFO:teuthology.orchestra.run.smithi143.stdout:[] 2024-08-27T02:31:15.686 DEBUG:tasks.util.rgw: json result: [] 2024-08-27T02:31:15.686 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-08-27T02:31:15.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-08-27T02:31:15.687 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-08-27T02:31:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:15.731 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:15.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.756+0000 7ff089ee59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:15.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.756+0000 7ff089ee59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:15.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.760+0000 7feeedffb640 20 reqs_thread_entry: start 2024-08-27T02:31:15.784 INFO:teuthology.orchestra.run.smithi143.stdout:{"id":"3a884aa2-81b8-4172-8e69-44ac4b13efc2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-08-27T02:31:15.784 DEBUG:tasks.util.rgw: json result: {'id': '3a884aa2-81b8-4172-8e69-44ac4b13efc2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-08-27T02:31:15.784 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-08-27T02:31:15.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-08-27T02:31:15.785 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-08-27T02:31:15.856 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:15.856 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:15.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 realm 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:15.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.892+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.896+0000 7f89fbf9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:31:15.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.896+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.896+0000 7f89fbf9a9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-08-27T02:31:15.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.896+0000 7f89fbf9a9c0 20 searching for the correct realm 2024-08-27T02:31:15.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.900+0000 7f89f9aa0640 0 -- 172.21.15.143:0/3734241394 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f89ec0ae050 msgr2=0x7f89ec0f5a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:31:15.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.904+0000 7f89fa2a1640 0 -- 172.21.15.143:0/3734241394 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f89e4034040 msgr2=0x7f89e4034930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:31:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:31:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:31:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:31:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:31:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:31:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:31:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.916+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 zone default found 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 4 Realm: () 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 zonegroup default 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 started sync module instance, tier type = 2024-08-27T02:31:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.920+0000 7f89fbf9a9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:31:15.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.936+0000 7f89fbf9a9c0 20 add_watcher() i=0 2024-08-27T02:31:15.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.936+0000 7f89fbf9a9c0 20 add_watcher() i=1 2024-08-27T02:31:15.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.936+0000 7f89fbf9a9c0 20 add_watcher() i=2 2024-08-27T02:31:15.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.936+0000 7f89fbf9a9c0 20 add_watcher() i=3 2024-08-27T02:31:15.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.936+0000 7f89fbf9a9c0 20 add_watcher() i=4 2024-08-27T02:31:15.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.936+0000 7f89fbf9a9c0 20 add_watcher() i=5 2024-08-27T02:31:15.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.936+0000 7f89fbf9a9c0 20 add_watcher() i=6 2024-08-27T02:31:15.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f89fbf9a9c0 20 add_watcher() i=7 2024-08-27T02:31:15.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f89fbf9a9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:31:15.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f88ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:31:15.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f89fbf9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:15.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f89fbf9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:15.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f89fbf9a9c0 5 note: GC not initialized 2024-08-27T02:31:15.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f88aa7fc640 20 reqs_thread_entry: start 2024-08-27T02:31:15.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f89fbf9a9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:31:15.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f89fbf9a9c0 20 Filter name: none 2024-08-27T02:31:15.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.940+0000 7f881bfff640 20 reqs_thread_entry: start 2024-08-27T02:31:15.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.960+0000 7f88ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:31:15.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.964+0000 7f89fbf9a9c0 20 remove_watcher() i=0 2024-08-27T02:31:15.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.964+0000 7f89fbf9a9c0 2 removed watcher, disabling cache 2024-08-27T02:31:15.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.968+0000 7f89fbf9a9c0 20 remove_watcher() i=1 2024-08-27T02:31:15.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.968+0000 7f89fbf9a9c0 20 remove_watcher() i=2 2024-08-27T02:31:15.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.972+0000 7f89fbf9a9c0 20 remove_watcher() i=3 2024-08-27T02:31:15.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.972+0000 7f89fbf9a9c0 20 remove_watcher() i=4 2024-08-27T02:31:15.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.972+0000 7f89fbf9a9c0 20 remove_watcher() i=5 2024-08-27T02:31:15.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.976+0000 7f89fbf9a9c0 20 remove_watcher() i=6 2024-08-27T02:31:15.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:15.976+0000 7f89fbf9a9c0 20 remove_watcher() i=7 2024-08-27T02:31:15.994 INFO:teuthology.orchestra.run.smithi143.stdout:[] 2024-08-27T02:31:15.994 DEBUG:tasks.util.rgw: json result: [] 2024-08-27T02:31:15.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-08-27T02:31:15.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-08-27T02:31:15.995 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-08-27T02:31:16.079 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:16.079 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:16.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.104+0000 7f7e8cd129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:16.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.104+0000 7f7e8cd129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:16.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.112+0000 7f7d48ff9640 20 reqs_thread_entry: start 2024-08-27T02:31:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:{"id":"3a884aa2-81b8-4172-8e69-44ac4b13efc2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-08-27T02:31:16.136 DEBUG:tasks.util.rgw: json result: {'id': '3a884aa2-81b8-4172-8e69-44ac4b13efc2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-08-27T02:31:16.136 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-08-27T02:31:16.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-08-27T02:31:16.136 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-08-27T02:31:16.207 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:16.208 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:16.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:16.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 realm 2024-08-27T02:31:16.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:16.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:31:16.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:16.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:31:16.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.244+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.248+0000 7f9eea82f9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-08-27T02:31:16.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.248+0000 7f9eea82f9c0 20 searching for the correct realm 2024-08-27T02:31:16.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.252+0000 7f9ee7b34640 0 -- 172.21.15.143:0/3187828858 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f9ee0089260 msgr2=0x7f9ee0090920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:31:16.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.260+0000 7f9ee7b34640 0 -- 172.21.15.143:0/3187828858 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f9db007e2e0 msgr2=0x7f9db00806f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:31:16.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:31:16.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:31:16.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:31:16.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:31:16.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:31:16.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:31:16.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:16.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:31:16.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-08-27T02:31:16.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 zone default found 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 4 Realm: () 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 zonegroup default 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 started sync module instance, tier type = 2024-08-27T02:31:16.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.268+0000 7f9eea82f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:31:16.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=0 2024-08-27T02:31:16.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=1 2024-08-27T02:31:16.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=2 2024-08-27T02:31:16.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=3 2024-08-27T02:31:16.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=4 2024-08-27T02:31:16.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=5 2024-08-27T02:31:16.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=6 2024-08-27T02:31:16.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 20 add_watcher() i=7 2024-08-27T02:31:16.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.288+0000 7f9eea82f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9d9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9eea82f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9eea82f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9eea82f9c0 5 note: GC not initialized 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9d9dfdb640 20 reqs_thread_entry: start 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9eea82f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9eea82f9c0 20 Filter name: none 2024-08-27T02:31:16.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.292+0000 7f9d0f7fe640 20 reqs_thread_entry: start 2024-08-27T02:31:16.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.308+0000 7f9d9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:31:16.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.312+0000 7f9eea82f9c0 20 remove_watcher() i=0 2024-08-27T02:31:16.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.312+0000 7f9eea82f9c0 2 removed watcher, disabling cache 2024-08-27T02:31:16.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.316+0000 7f9eea82f9c0 20 remove_watcher() i=1 2024-08-27T02:31:16.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.316+0000 7f9eea82f9c0 20 remove_watcher() i=2 2024-08-27T02:31:16.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.320+0000 7f9eea82f9c0 20 remove_watcher() i=3 2024-08-27T02:31:16.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.324+0000 7f9eea82f9c0 20 remove_watcher() i=4 2024-08-27T02:31:16.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.324+0000 7f9eea82f9c0 20 remove_watcher() i=5 2024-08-27T02:31:16.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.324+0000 7f9eea82f9c0 20 remove_watcher() i=6 2024-08-27T02:31:16.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.324+0000 7f9eea82f9c0 20 remove_watcher() i=7 2024-08-27T02:31:16.347 INFO:teuthology.orchestra.run.smithi143.stdout:[] 2024-08-27T02:31:16.347 DEBUG:tasks.util.rgw: json result: [] 2024-08-27T02:31:16.347 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-08-27T02:31:16.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-08-27T02:31:16.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-08-27T02:31:16.347 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-08-27T02:31:16.428 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:16.428 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:16.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.456+0000 7fd86f66a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:16.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.456+0000 7fd86f66a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:16.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.460+0000 7fd6a3fff640 20 reqs_thread_entry: start 2024-08-27T02:31:16.480 INFO:teuthology.orchestra.run.smithi143.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-08-27T02:31:16.480 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-08-27T02:31:16.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-08-27T02:31:16.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-08-27T02:31:16.481 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-08-27T02:31:16.561 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:16.561 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:16.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.584+0000 7f10755569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:16.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.584+0000 7f10755569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:16.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.588+0000 7f0f31ffb640 20 reqs_thread_entry: start 2024-08-27T02:31:16.614 INFO:teuthology.orchestra.run.smithi143.stdout:{"id":"3a884aa2-81b8-4172-8e69-44ac4b13efc2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-08-27T02:31:16.614 DEBUG:tasks.util.rgw: json result: {'id': '3a884aa2-81b8-4172-8e69-44ac4b13efc2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-08-27T02:31:16.614 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-08-27T02:31:16.614 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-08-27T02:31:16.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-08-27T02:31:16.615 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-08-27T02:31:16.699 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:16.699 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:16.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.724+0000 7f16933869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:16.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.724+0000 7f16933869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:16.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.728+0000 7f14d6ffd640 20 reqs_thread_entry: start 2024-08-27T02:31:16.748 INFO:teuthology.orchestra.run.smithi143.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-08-27T02:31:16.748 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-08-27T02:31:16.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-08-27T02:31:16.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-08-27T02:31:16.749 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-08-27T02:31:16.828 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:31:16.829 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:31:16.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.852+0000 7ffbd47f19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:31:16.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.852+0000 7ffbd47f19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:31:16.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:31:16.856+0000 7ffa94fe1640 20 reqs_thread_entry: start 2024-08-27T02:31:16.879 INFO:teuthology.orchestra.run.smithi143.stdout:{"id":"3a884aa2-81b8-4172-8e69-44ac4b13efc2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-08-27T02:31:16.879 DEBUG:tasks.util.rgw: json result: {'id': '3a884aa2-81b8-4172-8e69-44ac4b13efc2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-08-27T02:31:16.879 INFO:tasks.rgw:Starting rgw... 2024-08-27T02:31:16.879 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-08-27T02:31:16.879 INFO:tasks.rgw:Using beast as radosgw frontend 2024-08-27T02:31:16.880 DEBUG:teuthology.orchestra.run.smithi143:> sudo echo -n http://smithi143.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-08-27T02:31:16.935 INFO:teuthology.orchestra.run.smithi143.stdout:http://smithi143.front.sepia.ceph.com:80 2024-08-27T02:31:16.935 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-08-27T02:31:16.990 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-08-27T02:31:16.990 INFO:tasks.rgw.client.0:Restarting daemon 2024-08-27T02:31:16.991 DEBUG:teuthology.orchestra.run.smithi143:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-08-27T02:31:17.032 INFO:tasks.rgw.client.0:Started 2024-08-27T02:31:17.032 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi143.front.sepia.ceph.com:80/ 2024-08-27T02:31:17.032 DEBUG:teuthology.orchestra.run.smithi143:> curl http://smithi143.front.sepia.ceph.com:80/ 2024-08-27T02:31:17.068 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-27T02:31:17.069 INFO:teuthology.orchestra.run.smithi143.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-27T02:31:17.069 INFO:teuthology.orchestra.run.smithi143.stderr: Dload Upload Total Spent Left Speed 2024-08-27T02:31:17.069 INFO:teuthology.orchestra.run.smithi143.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-27T02:31:17.069 INFO:teuthology.orchestra.run.smithi143.stderr:curl: (7) Failed to connect to smithi143.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-27T02:31:18.070 DEBUG:teuthology.orchestra.run.smithi143:> curl http://smithi143.front.sepia.ceph.com:80/ 2024-08-27T02:31:18.081 INFO:teuthology.orchestra.run.smithi143.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-27T02:31:18.081 INFO:teuthology.orchestra.run.smithi143.stderr: Dload Upload Total Spent Left Speed 2024-08-27T02:31:18.081 INFO:teuthology.orchestra.run.smithi143.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-27T02:31:18.081 INFO:teuthology.orchestra.run.smithi143.stderr:curl: (7) Failed to connect to smithi143.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-27T02:31:18.081 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-27T02:31:20.083 DEBUG:teuthology.orchestra.run.smithi143:> curl http://smithi143.front.sepia.ceph.com:80/ 2024-08-27T02:31:20.094 INFO:teuthology.orchestra.run.smithi143.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-27T02:31:20.094 INFO:teuthology.orchestra.run.smithi143.stderr: Dload Upload Total Spent Left Speed 2024-08-27T02:31:20.094 INFO:teuthology.orchestra.run.smithi143.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-27T02:31:20.094 INFO:teuthology.orchestra.run.smithi143.stderr:curl: (7) Failed to connect to smithi143.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-27T02:31:20.094 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-27T02:31:24.096 DEBUG:teuthology.orchestra.run.smithi143:> curl http://smithi143.front.sepia.ceph.com:80/ 2024-08-27T02:31:24.107 INFO:teuthology.orchestra.run.smithi143.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-27T02:31:24.107 INFO:teuthology.orchestra.run.smithi143.stderr: Dload Upload Total Spent Left Speed 2024-08-27T02:31:24.107 INFO:teuthology.orchestra.run.smithi143.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-27T02:31:24.107 INFO:teuthology.orchestra.run.smithi143.stderr:curl: (7) Failed to connect to smithi143.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-27T02:31:24.108 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-27T02:31:32.110 DEBUG:teuthology.orchestra.run.smithi143:> curl http://smithi143.front.sepia.ceph.com:80/ 2024-08-27T02:31:32.120 INFO:teuthology.orchestra.run.smithi143.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-27T02:31:32.120 INFO:teuthology.orchestra.run.smithi143.stderr: Dload Upload Total Spent Left Speed 2024-08-27T02:31:32.121 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-08-27T02:31:32.122 INFO:teuthology.orchestra.run.smithi143.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-08-27T02:31:32.122 INFO:teuthology.orchestra.run.smithi143.stderr:curl: (7) Failed to connect to smithi143.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-08-27T02:31:48.123 DEBUG:teuthology.orchestra.run.smithi143:> curl http://smithi143.front.sepia.ceph.com:80/ 2024-08-27T02:31:48.134 INFO:teuthology.orchestra.run.smithi143.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-08-27T02:31:48.135 INFO:teuthology.orchestra.run.smithi143.stderr: Dload Upload Total Spent Left Speed 2024-08-27T02:31:48.612 INFO:teuthology.orchestra.run.smithi143.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 391 0 --:--:-- --:--:-- --:--:-- 392 2024-08-27T02:31:48.614 INFO:teuthology.orchestra.run.smithi143.stdout:anonymous 2024-08-27T02:31:48.614 INFO:teuthology.run_tasks:Running task tox... 2024-08-27T02:31:48.626 INFO:tasks.tox:Deploying tox from pip... 2024-08-27T02:31:48.626 DEBUG:teuthology.orchestra.run.smithi143:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-08-27T02:31:51.943 DEBUG:teuthology.orchestra.run.smithi143:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-08-27T02:31:52.587 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting tox==3.15.0 2024-08-27T02:31:52.682 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-08-27T02:31:52.738 INFO:teuthology.orchestra.run.smithi143.stdout: ---------------------------------------- 82.1/82.1 KB 1.5 MB/s eta 0:00:00 2024-08-27T02:31:52.886 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting filelock<4,>=3.0.0 2024-08-27T02:31:52.903 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading filelock-3.15.4-py3-none-any.whl (16 kB) 2024-08-27T02:31:53.016 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting six<2,>=1.14.0 2024-08-27T02:31:53.031 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-27T02:31:53.161 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting packaging>=14 2024-08-27T02:31:53.176 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-08-27T02:31:53.224 INFO:teuthology.orchestra.run.smithi143.stdout: ---------------------------------------- 54.0/54.0 KB 1.0 MB/s eta 0:00:00 2024-08-27T02:31:53.318 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting pluggy<1,>=0.12.0 2024-08-27T02:31:53.334 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-08-27T02:31:53.471 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting py<2,>=1.4.17 2024-08-27T02:31:53.486 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-08-27T02:31:53.543 INFO:teuthology.orchestra.run.smithi143.stdout: ---------------------------------------- 98.7/98.7 KB 1.7 MB/s eta 0:00:00 2024-08-27T02:31:53.612 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting toml>=0.9.4 2024-08-27T02:31:53.630 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-08-27T02:31:53.910 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-08-27T02:31:53.925 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading virtualenv-20.26.3-py3-none-any.whl (5.7 MB) 2024-08-27T02:31:54.405 INFO:teuthology.orchestra.run.smithi143.stdout: ---------------------------------------- 5.7/5.7 MB 11.9 MB/s eta 0:00:00 2024-08-27T02:31:54.572 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting distlib<1,>=0.3.7 2024-08-27T02:31:54.586 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-08-27T02:31:54.637 INFO:teuthology.orchestra.run.smithi143.stdout: -------------------------------------- 468.9/468.9 KB 10.0 MB/s eta 0:00:00 2024-08-27T02:31:54.744 INFO:teuthology.orchestra.run.smithi143.stdout:Collecting platformdirs<5,>=3.9.1 2024-08-27T02:31:54.759 INFO:teuthology.orchestra.run.smithi143.stdout: Downloading platformdirs-4.2.2-py3-none-any.whl (18 kB) 2024-08-27T02:31:54.940 INFO:teuthology.orchestra.run.smithi143.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-08-27T02:31:56.094 INFO:teuthology.orchestra.run.smithi143.stdout:Successfully installed distlib-0.3.8 filelock-3.15.4 packaging-24.1 platformdirs-4.2.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.3 2024-08-27T02:31:56.175 INFO:teuthology.run_tasks:Running task workunit... 2024-08-27T02:31:56.189 INFO:tasks.workunit:Pulling workunits from ref d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:31:56.189 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-27T02:31:56.190 DEBUG:teuthology.orchestra.run.smithi143:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:31:56.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:31:56.195 INFO:teuthology.orchestra.run.smithi143.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-27T02:31:56.195 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:31:56.243 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-27T02:31:56.244 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-27T02:31:56.291 INFO:tasks.workunit:timeout=3h 2024-08-27T02:31:56.291 INFO:tasks.workunit:cleanup=True 2024-08-27T02:31:56.292 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:31:56.341 INFO:tasks.workunit.client.0.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-27T02:32:51.795 INFO:tasks.workunit.client.0.smithi143.stderr:Updating files: 96% (12289/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-27T02:32:52.586 INFO:tasks.workunit.client.0.smithi143.stderr:Note: switching to 'd17b22856a85d7d49d47be692c778d4419f41641'. 2024-08-27T02:32:52.586 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:32:52.586 INFO:tasks.workunit.client.0.smithi143.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-27T02:32:52.587 INFO:tasks.workunit.client.0.smithi143.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-27T02:32:52.587 INFO:tasks.workunit.client.0.smithi143.stderr:state without impacting any branches by switching back to a branch. 2024-08-27T02:32:52.587 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:32:52.587 INFO:tasks.workunit.client.0.smithi143.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-27T02:32:52.587 INFO:tasks.workunit.client.0.smithi143.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-27T02:32:52.587 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:32:52.588 INFO:tasks.workunit.client.0.smithi143.stderr: git switch -c 2024-08-27T02:32:52.588 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:32:52.588 INFO:tasks.workunit.client.0.smithi143.stderr:Or undo this operation with: 2024-08-27T02:32:52.588 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:32:52.588 INFO:tasks.workunit.client.0.smithi143.stderr: git switch - 2024-08-27T02:32:52.589 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:32:52.589 INFO:tasks.workunit.client.0.smithi143.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-27T02:32:52.589 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:32:52.589 INFO:tasks.workunit.client.0.smithi143.stderr:HEAD is now at d17b22856a8 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-08-27T02:32:52.592 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-27T02:32:52.640 INFO:tasks.workunit.client.0.smithi143.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-27T02:32:52.643 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:32:52.643 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-27T02:32:53.431 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-27T02:32:53.512 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-27T02:32:53.561 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:32:53.562 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:32:53.562 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-27T02:32:53.601 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:32:53.604 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:32:53.605 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-27T02:32:53.651 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-08-27T02:32:53.652 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-08-27T02:32:53.653 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-08-27T02:32:53.704 INFO:tasks.workunit.client.0.smithi143.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-08-27T02:32:53.704 INFO:tasks.workunit.client.0.smithi143.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T02:32:53.705 INFO:tasks.workunit.client.0.smithi143.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T02:32:56.555 INFO:tasks.workunit.client.0.smithi143.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-08-27T02:32:56.556 INFO:tasks.workunit.client.0.smithi143.stderr:++ deactivate nondestructive 2024-08-27T02:32:56.556 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:32:56.556 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:32:56.556 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T02:32:56.556 INFO:tasks.workunit.client.0.smithi143.stderr:++ hash -r 2024-08-27T02:32:56.557 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:32:56.557 INFO:tasks.workunit.client.0.smithi143.stderr:++ unset VIRTUAL_ENV 2024-08-27T02:32:56.557 INFO:tasks.workunit.client.0.smithi143.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-08-27T02:32:56.557 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-08-27T02:32:56.557 INFO:tasks.workunit.client.0.smithi143.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T02:32:56.558 INFO:tasks.workunit.client.0.smithi143.stderr:++ export VIRTUAL_ENV 2024-08-27T02:32:56.558 INFO:tasks.workunit.client.0.smithi143.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T02:32:56.558 INFO:tasks.workunit.client.0.smithi143.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T02:32:56.558 INFO:tasks.workunit.client.0.smithi143.stderr:++ export PATH 2024-08-27T02:32:56.558 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:32:56.559 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -z '' ']' 2024-08-27T02:32:56.559 INFO:tasks.workunit.client.0.smithi143.stderr:++ _OLD_VIRTUAL_PS1= 2024-08-27T02:32:56.559 INFO:tasks.workunit.client.0.smithi143.stderr:++ PS1='(rgw) ' 2024-08-27T02:32:56.559 INFO:tasks.workunit.client.0.smithi143.stderr:++ export PS1 2024-08-27T02:32:56.559 INFO:tasks.workunit.client.0.smithi143.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-08-27T02:32:56.559 INFO:tasks.workunit.client.0.smithi143.stderr:++ export VIRTUAL_ENV_PROMPT 2024-08-27T02:32:56.560 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T02:32:56.560 INFO:tasks.workunit.client.0.smithi143.stderr:++ hash -r 2024-08-27T02:32:56.560 INFO:tasks.workunit.client.0.smithi143.stderr:+ pip install pip --upgrade 2024-08-27T02:32:56.946 INFO:tasks.workunit.client.0.smithi143.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-27T02:32:57.182 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting pip 2024-08-27T02:32:57.299 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-27T02:32:57.619 INFO:tasks.workunit.client.0.smithi143.stdout: ---------------------------------------- 1.8/1.8 MB 5.8 MB/s eta 0:00:00 2024-08-27T02:32:57.695 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: pip 2024-08-27T02:32:57.695 INFO:tasks.workunit.client.0.smithi143.stdout: Attempting uninstall: pip 2024-08-27T02:32:57.696 INFO:tasks.workunit.client.0.smithi143.stdout: Found existing installation: pip 22.0.2 2024-08-27T02:32:57.968 INFO:tasks.workunit.client.0.smithi143.stdout: Uninstalling pip-22.0.2: 2024-08-27T02:32:57.974 INFO:tasks.workunit.client.0.smithi143.stdout: Successfully uninstalled pip-22.0.2 2024-08-27T02:32:58.702 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed pip-24.2 2024-08-27T02:32:58.763 INFO:tasks.workunit.client.0.smithi143.stderr:+ pip install boto3 2024-08-27T02:32:59.870 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting boto3 2024-08-27T02:32:59.915 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading boto3-1.35.6-py3-none-any.whl.metadata (6.6 kB) 2024-08-27T02:33:00.666 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting botocore<1.36.0,>=1.35.6 (from boto3) 2024-08-27T02:33:00.682 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading botocore-1.35.6-py3-none-any.whl.metadata (5.7 kB) 2024-08-27T02:33:00.812 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-08-27T02:33:00.827 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-08-27T02:33:00.987 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-08-27T02:33:01.005 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-08-27T02:33:01.148 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:33:01.170 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-08-27T02:33:01.389 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:33:01.405 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-08-27T02:33:01.678 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:33:01.693 INFO:tasks.workunit.client.0.smithi143.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-27T02:33:01.771 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading boto3-1.35.6-py3-none-any.whl (139 kB) 2024-08-27T02:33:01.874 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading botocore-1.35.6-py3-none-any.whl (12.5 MB) 2024-08-27T02:33:02.130 INFO:tasks.workunit.client.0.smithi143.stdout: ---------------------------------------- 12.5/12.5 MB 51.0 MB/s eta 0:00:00 2024-08-27T02:33:02.148 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-08-27T02:33:02.215 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-08-27T02:33:02.281 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-08-27T02:33:02.339 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-08-27T02:33:02.390 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-27T02:33:02.567 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-08-27T02:33:03.751 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed boto3-1.35.6 botocore-1.35.6 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-08-27T02:33:04.172 INFO:tasks.workunit.client.0.smithi143.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-08-27T02:33:04.321 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-08-27T02:33:04.361 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:04.361 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:04.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.396+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 realm 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.400+0000 7fbbf6ba09c0 20 searching for the correct realm 2024-08-27T02:33:04.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.408+0000 7fbbf4ea7640 0 -- 172.21.15.143:0/3118361901 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fbbe806d1d0 msgr2=0x7fbbe8082190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:04.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.624+0000 7fbbf46a6640 0 -- 172.21.15.143:0/3118361901 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x5610408e0490 msgr2=0x5610408e2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:04.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:04.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:04.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:04.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:04.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:04.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:04.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:04.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 zone default found 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 4 Realm: () 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 zonegroup default 2024-08-27T02:33:04.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.632+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.636+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.636+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.636+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.636+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.636+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.636+0000 7fbbf6ba09c0 20 started sync module instance, tier type = 2024-08-27T02:33:04.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.636+0000 7fbbf6ba09c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.660+0000 7fbbf6ba09c0 20 add_watcher() i=0 2024-08-27T02:33:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.660+0000 7fbbf6ba09c0 20 add_watcher() i=1 2024-08-27T02:33:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.660+0000 7fbbf6ba09c0 20 add_watcher() i=2 2024-08-27T02:33:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.660+0000 7fbbf6ba09c0 20 add_watcher() i=3 2024-08-27T02:33:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.660+0000 7fbbf6ba09c0 20 add_watcher() i=4 2024-08-27T02:33:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.660+0000 7fbbf6ba09c0 20 add_watcher() i=5 2024-08-27T02:33:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.664+0000 7fbbf6ba09c0 20 add_watcher() i=6 2024-08-27T02:33:04.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.664+0000 7fbbf6ba09c0 20 add_watcher() i=7 2024-08-27T02:33:04.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.664+0000 7fbbf6ba09c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:04.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.668+0000 7fbaaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:04.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.668+0000 7fbbf6ba09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:04.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.668+0000 7fbbf6ba09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:04.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.668+0000 7fbbf6ba09c0 5 note: GC not initialized 2024-08-27T02:33:04.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbaa9fdb640 20 reqs_thread_entry: start 2024-08-27T02:33:04.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:04.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 20 Filter name: none 2024-08-27T02:33:04.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fba1b7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:04.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-08-27T02:33:04.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-08-27T02:33:04.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-08-27T02:33:04.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-08-27T02:33:04.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:04.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:04.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-08-27T02:33:04.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-08-27T02:33:04.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-08-27T02:33:04.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.672+0000 7fbbf6ba09c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-08-27T02:33:04.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.676+0000 7fbbf6ba09c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-08-27T02:33:04.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.676+0000 7fbbf6ba09c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-08-27T02:33:04.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.676+0000 7fbbf6ba09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-08-27T02:33:04.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.676+0000 7fbacb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94627802551520 notifier 4668 bl.length()=593 2024-08-27T02:33:04.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.676+0000 7fbacb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-08-27T02:33:04.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.676+0000 7fbacb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-08-27T02:33:04.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.712+0000 7fbbf6ba09c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-08-27T02:33:04.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.712+0000 7fbbf6ba09c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-08-27T02:33:04.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.712+0000 7fbbf6ba09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-08-27T02:33:04.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.712+0000 7fbacb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94627802519312 notifier 4668 bl.length()=186 2024-08-27T02:33:04.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.712+0000 7fbacb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-08-27T02:33:04.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.712+0000 7fbacb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-08-27T02:33:04.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.716+0000 7fbaaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:04.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.720+0000 7fbbf6ba09c0 20 remove_watcher() i=0 2024-08-27T02:33:04.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.720+0000 7fbbf6ba09c0 2 removed watcher, disabling cache 2024-08-27T02:33:04.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.724+0000 7fbbf6ba09c0 20 remove_watcher() i=1 2024-08-27T02:33:04.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.724+0000 7fbbf6ba09c0 20 remove_watcher() i=2 2024-08-27T02:33:04.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.728+0000 7fbbf6ba09c0 20 remove_watcher() i=3 2024-08-27T02:33:04.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.732+0000 7fbbf6ba09c0 20 remove_watcher() i=4 2024-08-27T02:33:04.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.732+0000 7fbbf6ba09c0 20 remove_watcher() i=5 2024-08-27T02:33:04.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.732+0000 7fbbf6ba09c0 20 remove_watcher() i=6 2024-08-27T02:33:04.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:04.736+0000 7fbbf6ba09c0 20 remove_watcher() i=7 2024-08-27T02:33:08.628 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: recalculated bucket check stats are correct 2024-08-27T02:33:08.628 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:08.628 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-08-27T02:33:08.663 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:08.663 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:08.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 realm 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.704+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.708+0000 7f904c8469c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:08.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.708+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.708+0000 7f904c8469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:08.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.708+0000 7f904c8469c0 20 searching for the correct realm 2024-08-27T02:33:08.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.712+0000 7f904a34c640 0 -- 172.21.15.143:0/2028538309 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x5637d094bfd0 msgr2=0x7f90440f48b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:08.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.716+0000 7f904ab4d640 0 -- 172.21.15.143:0/2028538309 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f904002d070 msgr2=0x7f9040063310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:08.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:08.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:08.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:08.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:08.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:08.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:08.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 zone default found 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 4 Realm: () 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 zonegroup default 2024-08-27T02:33:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.728+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.732+0000 7f904c8469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.732+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.732+0000 7f904c8469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.732+0000 7f904c8469c0 20 started sync module instance, tier type = 2024-08-27T02:33:08.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.732+0000 7f904c8469c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:08.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.752+0000 7f904c8469c0 20 add_watcher() i=0 2024-08-27T02:33:08.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.752+0000 7f904c8469c0 20 add_watcher() i=1 2024-08-27T02:33:08.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.752+0000 7f904c8469c0 20 add_watcher() i=2 2024-08-27T02:33:08.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.752+0000 7f904c8469c0 20 add_watcher() i=3 2024-08-27T02:33:08.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.752+0000 7f904c8469c0 20 add_watcher() i=4 2024-08-27T02:33:08.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.752+0000 7f904c8469c0 20 add_watcher() i=5 2024-08-27T02:33:08.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 20 add_watcher() i=6 2024-08-27T02:33:08.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 20 add_watcher() i=7 2024-08-27T02:33:08.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:08.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f8f017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:08.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 5 note: GC not initialized 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f8efb7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 20 Filter name: none 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f8ef97fa640 20 reqs_thread_entry: start 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:08.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.756+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:08.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:08.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:08.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:08.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:08.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:08.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:08.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:08.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:08.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:08.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:08.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:08.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:08.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.760+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:08.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.764+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:08.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.764+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:08.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.764+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:08.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.764+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:08.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.768+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:08.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.768+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:08.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.768+0000 7f904c8469c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:08.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.776+0000 7f8f017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:08.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.784+0000 7f904c8469c0 20 remove_watcher() i=0 2024-08-27T02:33:08.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.784+0000 7f904c8469c0 2 removed watcher, disabling cache 2024-08-27T02:33:08.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.784+0000 7f904c8469c0 20 remove_watcher() i=1 2024-08-27T02:33:08.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.788+0000 7f904c8469c0 20 remove_watcher() i=2 2024-08-27T02:33:08.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.788+0000 7f904c8469c0 20 remove_watcher() i=3 2024-08-27T02:33:08.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.792+0000 7f904c8469c0 20 remove_watcher() i=4 2024-08-27T02:33:08.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.792+0000 7f904c8469c0 20 remove_watcher() i=5 2024-08-27T02:33:08.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.796+0000 7f904c8469c0 20 remove_watcher() i=6 2024-08-27T02:33:08.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.796+0000 7f904c8469c0 20 remove_watcher() i=7 2024-08-27T02:33:08.816 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-08-27T02:33:08.843 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:08.843 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:08.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.880+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 realm 2024-08-27T02:33:08.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:08.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:08.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:08.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.884+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:08.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.888+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:08.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.888+0000 7f96ee76b9c0 20 searching for the correct realm 2024-08-27T02:33:08.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:08.892+0000 7f96ec271640 0 -- 172.21.15.143:0/3398864625 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f96e4018040 msgr2=0x7f96e4029940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:09.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.104+0000 7f96eca72640 0 -- 172.21.15.143:0/3398864625 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f96e002a030 msgr2=0x7f96e0042930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:09.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:09.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:09.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:09.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:09.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:09.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:09.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:09.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:09.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 zone default found 2024-08-27T02:33:09.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 4 Realm: () 2024-08-27T02:33:09.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:09.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:09.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:09.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 zonegroup default 2024-08-27T02:33:09.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.124+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.128+0000 7f96ee76b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.128+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.128+0000 7f96ee76b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.128+0000 7f96ee76b9c0 20 started sync module instance, tier type = 2024-08-27T02:33:09.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.128+0000 7f96ee76b9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:09.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=0 2024-08-27T02:33:09.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=1 2024-08-27T02:33:09.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=2 2024-08-27T02:33:09.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=3 2024-08-27T02:33:09.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=4 2024-08-27T02:33:09.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=5 2024-08-27T02:33:09.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=6 2024-08-27T02:33:09.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 20 add_watcher() i=7 2024-08-27T02:33:09.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.156+0000 7f96ee76b9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:09.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.160+0000 7f95a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:09.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:09.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:09.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 5 note: GC not initialized 2024-08-27T02:33:09.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f95a1fdb640 20 reqs_thread_entry: start 2024-08-27T02:33:09.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:09.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 20 Filter name: none 2024-08-27T02:33:09.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f95137fe640 20 reqs_thread_entry: start 2024-08-27T02:33:09.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:09.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.164+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.168+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:09.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.168+0000 7f96ee76b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:09.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.168+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.168+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:09.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.168+0000 7f96ee76b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.168+0000 7f96ee76b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:09.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.168+0000 7f96ee76b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:09.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.172+0000 7f95a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:09.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.176+0000 7f96ee76b9c0 20 remove_watcher() i=0 2024-08-27T02:33:09.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.176+0000 7f96ee76b9c0 2 removed watcher, disabling cache 2024-08-27T02:33:09.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.180+0000 7f96ee76b9c0 20 remove_watcher() i=1 2024-08-27T02:33:09.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.180+0000 7f96ee76b9c0 20 remove_watcher() i=2 2024-08-27T02:33:09.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.184+0000 7f96ee76b9c0 20 remove_watcher() i=3 2024-08-27T02:33:09.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.184+0000 7f96ee76b9c0 20 remove_watcher() i=4 2024-08-27T02:33:09.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.188+0000 7f96ee76b9c0 20 remove_watcher() i=5 2024-08-27T02:33:09.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.188+0000 7f96ee76b9c0 20 remove_watcher() i=6 2024-08-27T02:33:09.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.192+0000 7f96ee76b9c0 20 remove_watcher() i=7 2024-08-27T02:33:09.209 INFO:tasks.workunit.client.0.smithi143.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-08-27T02:33:09.210 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check unlinked does not report normal entries 2024-08-27T02:33:09.210 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:09.210 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-08-27T02:33:09.241 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:09.241 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:09.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 realm 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:09.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.280+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.284+0000 7f08b960d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:09.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.284+0000 7f08b960d9c0 20 searching for the correct realm 2024-08-27T02:33:09.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.288+0000 7f08b6912640 0 -- 172.21.15.143:0/649675264 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f08a8034060 msgr2=0x7f08a807d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:09.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.296+0000 7f08b7914640 0 -- 172.21.15.143:0/649675264 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f08ac0c0040 msgr2=0x7f08ac0f9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 zone default found 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 4 Realm: () 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 zonegroup default 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.300+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.304+0000 7f08b960d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.304+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.304+0000 7f08b960d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:09.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.304+0000 7f08b960d9c0 20 started sync module instance, tier type = 2024-08-27T02:33:09.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.304+0000 7f08b960d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:09.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.320+0000 7f08b960d9c0 20 add_watcher() i=0 2024-08-27T02:33:09.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.320+0000 7f08b960d9c0 20 add_watcher() i=1 2024-08-27T02:33:09.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.320+0000 7f08b960d9c0 20 add_watcher() i=2 2024-08-27T02:33:09.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.320+0000 7f08b960d9c0 20 add_watcher() i=3 2024-08-27T02:33:09.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.320+0000 7f08b960d9c0 20 add_watcher() i=4 2024-08-27T02:33:09.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.320+0000 7f08b960d9c0 20 add_watcher() i=5 2024-08-27T02:33:09.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.324+0000 7f08b960d9c0 20 add_watcher() i=6 2024-08-27T02:33:09.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.324+0000 7f08b960d9c0 20 add_watcher() i=7 2024-08-27T02:33:09.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.324+0000 7f08b960d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:09.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f076dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 5 note: GC not initialized 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f076cfe1640 20 reqs_thread_entry: start 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 Filter name: none 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f06e67fc640 20 reqs_thread_entry: start 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:09.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:09.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:09.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-08-27T02:33:09.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:09.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-08-27T02:33:09.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:09.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-08-27T02:33:09.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.328+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:09.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.332+0000 7f08b960d9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-08-27T02:33:09.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.332+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:09.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.332+0000 7f08b960d9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-08-27T02:33:09.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.332+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:09.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.332+0000 7f08b960d9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-08-27T02:33:09.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.332+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:09.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-08-27T02:33:09.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:09.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-08-27T02:33:09.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:09.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-08-27T02:33:09.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:09.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-08-27T02:33:09.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:09.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-08-27T02:33:09.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.336+0000 7f08b960d9c0 1 NOTICE: finished all shards (0 entries found) 2024-08-27T02:33:09.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.340+0000 7f076dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:09.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.344+0000 7f08b960d9c0 20 remove_watcher() i=0 2024-08-27T02:33:09.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.344+0000 7f08b960d9c0 2 removed watcher, disabling cache 2024-08-27T02:33:09.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.344+0000 7f08b960d9c0 20 remove_watcher() i=1 2024-08-27T02:33:09.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.348+0000 7f08b960d9c0 20 remove_watcher() i=2 2024-08-27T02:33:09.355 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.348+0000 7f08b960d9c0 20 remove_watcher() i=3 2024-08-27T02:33:09.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.352+0000 7f08b960d9c0 20 remove_watcher() i=4 2024-08-27T02:33:09.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.352+0000 7f08b960d9c0 20 remove_watcher() i=5 2024-08-27T02:33:09.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.356+0000 7f08b960d9c0 20 remove_watcher() i=6 2024-08-27T02:33:09.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:09.356+0000 7f08b960d9c0 20 remove_watcher() i=7 2024-08-27T02:33:09.375 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-27T02:33:09.796 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-08-27T02:33:11.428 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:11.428 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-27T02:33:11.464 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:11.464 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:11.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 realm 2024-08-27T02:33:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:11.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.504+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.508+0000 7fb08ca609c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:11.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.508+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.508+0000 7fb08ca609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:11.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.508+0000 7fb08ca609c0 20 searching for the correct realm 2024-08-27T02:33:11.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.516+0000 7fb089d65640 0 -- 172.21.15.143:0/3976830903 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb07c1071e0 msgr2=0x7fb07c0fd160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:11.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.520+0000 7fb089d65640 0 -- 172.21.15.143:0/3976830903 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7faf5407e680 msgr2=0x7faf54080ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 zone default found 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 4 Realm: () 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 zonegroup default 2024-08-27T02:33:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 started sync module instance, tier type = 2024-08-27T02:33:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.528+0000 7fb08ca609c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:11.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.544+0000 7fb08ca609c0 20 add_watcher() i=0 2024-08-27T02:33:11.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.544+0000 7fb08ca609c0 20 add_watcher() i=1 2024-08-27T02:33:11.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.544+0000 7fb08ca609c0 20 add_watcher() i=2 2024-08-27T02:33:11.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.544+0000 7fb08ca609c0 20 add_watcher() i=3 2024-08-27T02:33:11.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.544+0000 7fb08ca609c0 20 add_watcher() i=4 2024-08-27T02:33:11.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.544+0000 7fb08ca609c0 20 add_watcher() i=5 2024-08-27T02:33:11.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.548+0000 7fb08ca609c0 20 add_watcher() i=6 2024-08-27T02:33:11.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.548+0000 7fb08ca609c0 20 add_watcher() i=7 2024-08-27T02:33:11.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.548+0000 7fb08ca609c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:11.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7faf40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:11.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:11.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:11.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 5 note: GC not initialized 2024-08-27T02:33:11.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7faebb7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:11.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:11.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 Filter name: none 2024-08-27T02:33:11.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7faeb97fa640 20 reqs_thread_entry: start 2024-08-27T02:33:11.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:11.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:11.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:11.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:11.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 INFO: main: starting shard=0 2024-08-27T02:33:11.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:11.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 INFO: main: starting shard=1 2024-08-27T02:33:11.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.552+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:11.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: starting shard=2 2024-08-27T02:33:11.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:11.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: starting shard=3 2024-08-27T02:33:11.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:11.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: starting shard=4 2024-08-27T02:33:11.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:11.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: starting shard=5 2024-08-27T02:33:11.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:11.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 INFO: main: starting shard=6 2024-08-27T02:33:11.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.556+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:11.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: starting shard=7 2024-08-27T02:33:11.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:11.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: starting shard=8 2024-08-27T02:33:11.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:11.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-27T02:33:11.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: starting shard=9 2024-08-27T02:33:11.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:11.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 INFO: main: starting shard=10 2024-08-27T02:33:11.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.560+0000 7fb08ca609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:11.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.564+0000 7fb08ca609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.564+0000 7fb08ca609c0 20 INFO: main: done 2024-08-27T02:33:11.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.564+0000 7faf40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:11.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.568+0000 7fb08ca609c0 20 remove_watcher() i=0 2024-08-27T02:33:11.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.568+0000 7fb08ca609c0 2 removed watcher, disabling cache 2024-08-27T02:33:11.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.568+0000 7fb08ca609c0 20 remove_watcher() i=1 2024-08-27T02:33:11.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.572+0000 7fb08ca609c0 20 remove_watcher() i=2 2024-08-27T02:33:11.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.572+0000 7fb08ca609c0 20 remove_watcher() i=3 2024-08-27T02:33:11.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.576+0000 7fb08ca609c0 20 remove_watcher() i=4 2024-08-27T02:33:11.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.576+0000 7fb08ca609c0 20 remove_watcher() i=5 2024-08-27T02:33:11.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.576+0000 7fb08ca609c0 20 remove_watcher() i=6 2024-08-27T02:33:11.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.580+0000 7fb08ca609c0 20 remove_watcher() i=7 2024-08-27T02:33:11.740 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:11.740 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-27T02:33:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.812+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 realm 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:11.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:11.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.816+0000 7f73e110b9c0 20 searching for the correct realm 2024-08-27T02:33:11.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.824+0000 7f73d6410640 0 -- 172.21.15.143:0/103236555 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f73d0019040 msgr2=0x7f73d001b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:11.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.828+0000 7f73d6410640 0 -- 172.21.15.143:0/103236555 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f72a807e680 msgr2=0x7f72a8080ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 zone default found 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 4 Realm: () 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 zonegroup default 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.836+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.840+0000 7f73e110b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.840+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.840+0000 7f73e110b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:11.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.840+0000 7f73e110b9c0 20 started sync module instance, tier type = 2024-08-27T02:33:11.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.840+0000 7f73e110b9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:11.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=0 2024-08-27T02:33:11.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=1 2024-08-27T02:33:11.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=2 2024-08-27T02:33:11.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=3 2024-08-27T02:33:11.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=4 2024-08-27T02:33:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=5 2024-08-27T02:33:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=6 2024-08-27T02:33:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 20 add_watcher() i=7 2024-08-27T02:33:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.856+0000 7f73e110b9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f72957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 5 note: GC not initialized 2024-08-27T02:33:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f720ffff640 20 reqs_thread_entry: start 2024-08-27T02:33:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 Filter name: none 2024-08-27T02:33:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f720dffb640 20 reqs_thread_entry: start 2024-08-27T02:33:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:11.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:11.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 INFO: main: starting shard=0 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.860+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: starting shard=1 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: starting shard=2 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: starting shard=3 2024-08-27T02:33:11.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:11.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: starting shard=4 2024-08-27T02:33:11.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:11.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 INFO: main: starting shard=5 2024-08-27T02:33:11.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.864+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:11.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-27T02:33:11.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: starting shard=6 2024-08-27T02:33:11.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:11.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: starting shard=7 2024-08-27T02:33:11.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:11.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: starting shard=8 2024-08-27T02:33:11.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:11.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 INFO: main: starting shard=9 2024-08-27T02:33:11.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.868+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:11.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.872+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.872+0000 7f73e110b9c0 20 INFO: main: starting shard=10 2024-08-27T02:33:11.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.872+0000 7f73e110b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:11.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.872+0000 7f73e110b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:11.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.872+0000 7f73e110b9c0 20 INFO: main: done 2024-08-27T02:33:11.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.872+0000 7f72957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:11.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.876+0000 7f73e110b9c0 20 remove_watcher() i=0 2024-08-27T02:33:11.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.876+0000 7f73e110b9c0 2 removed watcher, disabling cache 2024-08-27T02:33:11.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.880+0000 7f73e110b9c0 20 remove_watcher() i=1 2024-08-27T02:33:11.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.880+0000 7f73e110b9c0 20 remove_watcher() i=2 2024-08-27T02:33:11.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.884+0000 7f73e110b9c0 20 remove_watcher() i=3 2024-08-27T02:33:11.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.884+0000 7f73e110b9c0 20 remove_watcher() i=4 2024-08-27T02:33:11.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.888+0000 7f73e110b9c0 20 remove_watcher() i=5 2024-08-27T02:33:11.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.888+0000 7f73e110b9c0 20 remove_watcher() i=6 2024-08-27T02:33:11.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:11.888+0000 7f73e110b9c0 20 remove_watcher() i=7 2024-08-27T02:33:12.116 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:12.116 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-08-27T02:33:12.153 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:12.153 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:12.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 realm 2024-08-27T02:33:12.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:12.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.192+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.196+0000 7fde8bd989c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:12.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.196+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.196+0000 7fde8bd989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:12.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.196+0000 7fde8bd989c0 20 searching for the correct realm 2024-08-27T02:33:12.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.200+0000 7fde8a09f640 0 -- 172.21.15.143:0/2593306473 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x563b4a24eda0 msgr2=0x563b4a251230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:12.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.208+0000 7fde8909d640 0 -- 172.21.15.143:0/2593306473 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fde7c113060 msgr2=0x7fde7c120a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:12.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:12.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 zone default found 2024-08-27T02:33:12.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 4 Realm: () 2024-08-27T02:33:12.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:12.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:12.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:12.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 zonegroup default 2024-08-27T02:33:12.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 started sync module instance, tier type = 2024-08-27T02:33:12.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.216+0000 7fde8bd989c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:12.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.236+0000 7fde8bd989c0 20 add_watcher() i=0 2024-08-27T02:33:12.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.236+0000 7fde8bd989c0 20 add_watcher() i=1 2024-08-27T02:33:12.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.236+0000 7fde8bd989c0 20 add_watcher() i=2 2024-08-27T02:33:12.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.236+0000 7fde8bd989c0 20 add_watcher() i=3 2024-08-27T02:33:12.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.236+0000 7fde8bd989c0 20 add_watcher() i=4 2024-08-27T02:33:12.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.236+0000 7fde8bd989c0 20 add_watcher() i=5 2024-08-27T02:33:12.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.236+0000 7fde8bd989c0 20 add_watcher() i=6 2024-08-27T02:33:12.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 20 add_watcher() i=7 2024-08-27T02:33:12.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:12.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fdd3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 5 note: GC not initialized 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fdd3a7fc640 20 reqs_thread_entry: start 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 20 Filter name: none 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fdcabfff640 20 reqs_thread_entry: start 2024-08-27T02:33:12.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.240+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:12.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:12.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:12.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:12.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: starting shard=0 2024-08-27T02:33:12.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:12.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: starting shard=1 2024-08-27T02:33:12.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:12.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:33:12.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: starting shard=2 2024-08-27T02:33:12.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:12.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 INFO: main: starting shard=3 2024-08-27T02:33:12.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.244+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:12.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: starting shard=4 2024-08-27T02:33:12.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:12.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: starting shard=5 2024-08-27T02:33:12.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:12.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: starting shard=6 2024-08-27T02:33:12.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:12.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 INFO: main: starting shard=7 2024-08-27T02:33:12.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.248+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:12.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: starting shard=8 2024-08-27T02:33:12.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:12.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: starting shard=9 2024-08-27T02:33:12.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:12.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: starting shard=10 2024-08-27T02:33:12.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:12.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fde8bd989c0 20 INFO: main: done 2024-08-27T02:33:12.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.252+0000 7fdd3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:12.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.260+0000 7fde8bd989c0 20 remove_watcher() i=0 2024-08-27T02:33:12.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.260+0000 7fde8bd989c0 2 removed watcher, disabling cache 2024-08-27T02:33:12.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.260+0000 7fde8bd989c0 20 remove_watcher() i=1 2024-08-27T02:33:12.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.264+0000 7fde8bd989c0 20 remove_watcher() i=2 2024-08-27T02:33:12.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.264+0000 7fde8bd989c0 20 remove_watcher() i=3 2024-08-27T02:33:12.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.268+0000 7fde8bd989c0 20 remove_watcher() i=4 2024-08-27T02:33:12.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.268+0000 7fde8bd989c0 20 remove_watcher() i=5 2024-08-27T02:33:12.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.272+0000 7fde8bd989c0 20 remove_watcher() i=6 2024-08-27T02:33:12.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.272+0000 7fde8bd989c0 20 remove_watcher() i=7 2024-08-27T02:33:12.416 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:12.416 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-08-27T02:33:12.452 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:12.452 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:12.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.496+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.496+0000 7f662cab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.496+0000 7f662cab59c0 20 realm 2024-08-27T02:33:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.496+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.500+0000 7f662cab59c0 20 searching for the correct realm 2024-08-27T02:33:12.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.508+0000 7f662adbc640 0 -- 172.21.15.143:0/4277213109 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x563d48d74a20 msgr2=0x563d48d76ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:12.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.512+0000 7f6623fff640 0 -- 172.21.15.143:0/4277213109 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f661c114c20 msgr2=0x7f661c12d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:12.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 zone default found 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 4 Realm: () 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 zonegroup default 2024-08-27T02:33:12.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:12.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 started sync module instance, tier type = 2024-08-27T02:33:12.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.520+0000 7f662cab59c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:12.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.536+0000 7f662cab59c0 20 add_watcher() i=0 2024-08-27T02:33:12.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.536+0000 7f662cab59c0 20 add_watcher() i=1 2024-08-27T02:33:12.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.536+0000 7f662cab59c0 20 add_watcher() i=2 2024-08-27T02:33:12.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.536+0000 7f662cab59c0 20 add_watcher() i=3 2024-08-27T02:33:12.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.536+0000 7f662cab59c0 20 add_watcher() i=4 2024-08-27T02:33:12.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.536+0000 7f662cab59c0 20 add_watcher() i=5 2024-08-27T02:33:12.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.540+0000 7f662cab59c0 20 add_watcher() i=6 2024-08-27T02:33:12.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.540+0000 7f662cab59c0 20 add_watcher() i=7 2024-08-27T02:33:12.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.540+0000 7f662cab59c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:12.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.540+0000 7f64e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 5 note: GC not initialized 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f645b7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 Filter name: none 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f64597fa640 20 reqs_thread_entry: start 2024-08-27T02:33:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 INFO: main: starting shard=0 2024-08-27T02:33:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:12.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 INFO: main: starting shard=1 2024-08-27T02:33:12.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:12.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 INFO: main: starting shard=2 2024-08-27T02:33:12.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.544+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:12.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: starting shard=3 2024-08-27T02:33:12.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:12.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: starting shard=4 2024-08-27T02:33:12.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:12.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: starting shard=5 2024-08-27T02:33:12.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:12.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 INFO: main: starting shard=6 2024-08-27T02:33:12.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.548+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:12.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 INFO: main: starting shard=7 2024-08-27T02:33:12.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:12.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 INFO: main: starting shard=8 2024-08-27T02:33:12.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:12.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 INFO: main: starting shard=9 2024-08-27T02:33:12.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.552+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:12.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.556+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:12.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.556+0000 7f662cab59c0 20 INFO: main: starting shard=10 2024-08-27T02:33:12.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.556+0000 7f662cab59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:12.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.556+0000 7f662cab59c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:33:12.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.556+0000 7f662cab59c0 20 INFO: main: done 2024-08-27T02:33:12.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.556+0000 7f64e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:12.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.560+0000 7f662cab59c0 20 remove_watcher() i=0 2024-08-27T02:33:12.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.560+0000 7f662cab59c0 2 removed watcher, disabling cache 2024-08-27T02:33:12.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.564+0000 7f662cab59c0 20 remove_watcher() i=1 2024-08-27T02:33:12.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.564+0000 7f662cab59c0 20 remove_watcher() i=2 2024-08-27T02:33:12.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.568+0000 7f662cab59c0 20 remove_watcher() i=3 2024-08-27T02:33:12.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.568+0000 7f662cab59c0 20 remove_watcher() i=4 2024-08-27T02:33:12.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.572+0000 7f662cab59c0 20 remove_watcher() i=5 2024-08-27T02:33:12.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.572+0000 7f662cab59c0 20 remove_watcher() i=6 2024-08-27T02:33:12.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:12.576+0000 7f662cab59c0 20 remove_watcher() i=7 2024-08-27T02:33:12.619 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-27T02:33:13.043 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-08-27T02:33:13.454 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check unlinked finds unlistable entries 2024-08-27T02:33:13.455 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:13.455 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-08-27T02:33:13.488 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:13.488 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:13.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.520+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:13.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 realm 2024-08-27T02:33:13.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:13.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:13.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:13.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:13.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.524+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.528+0000 7f41f7a0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:13.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.528+0000 7f41f7a0e9c0 20 searching for the correct realm 2024-08-27T02:33:13.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.532+0000 7f41f5d15640 0 -- 172.21.15.143:0/2467023663 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f41ec0678b0 msgr2=0x7f41ec0768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:13.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.748+0000 7f41f5514640 0 -- 172.21.15.143:0/2467023663 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x560e8f6f4290 msgr2=0x560e8f6f6750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:13.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.752+0000 7f41f7a0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:13.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.752+0000 7f41f7a0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:13.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.752+0000 7f41f7a0e9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:13.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.752+0000 7f41f7a0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:13.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.752+0000 7f41f7a0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:13.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.752+0000 7f41f7a0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:13.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.752+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:13.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:13.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 zone default found 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 4 Realm: () 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 zonegroup default 2024-08-27T02:33:13.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:13.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:13.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.756+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.760+0000 7f41f7a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:13.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.760+0000 7f41f7a0e9c0 20 started sync module instance, tier type = 2024-08-27T02:33:13.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.760+0000 7f41f7a0e9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:13.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.780+0000 7f41f7a0e9c0 20 add_watcher() i=0 2024-08-27T02:33:13.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.780+0000 7f41f7a0e9c0 20 add_watcher() i=1 2024-08-27T02:33:13.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.780+0000 7f41f7a0e9c0 20 add_watcher() i=2 2024-08-27T02:33:13.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.780+0000 7f41f7a0e9c0 20 add_watcher() i=3 2024-08-27T02:33:13.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.780+0000 7f41f7a0e9c0 20 add_watcher() i=4 2024-08-27T02:33:13.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.784+0000 7f41f7a0e9c0 20 add_watcher() i=5 2024-08-27T02:33:13.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.788+0000 7f41f7a0e9c0 20 add_watcher() i=6 2024-08-27T02:33:13.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.788+0000 7f41f7a0e9c0 20 add_watcher() i=7 2024-08-27T02:33:13.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.788+0000 7f41f7a0e9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:13.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f40ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:13.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f41f7a0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:13.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f41f7a0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:13.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f41f7a0e9c0 5 note: GC not initialized 2024-08-27T02:33:13.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f40aa7e4640 20 reqs_thread_entry: start 2024-08-27T02:33:13.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f41f7a0e9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:13.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f41f7a0e9c0 20 Filter name: none 2024-08-27T02:33:13.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f401bfff640 20 reqs_thread_entry: start 2024-08-27T02:33:13.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f41f7a0e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:13.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.792+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:13.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:13.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:13.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:13.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:13.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:13.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:13.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:13.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:13.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:13.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:13.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:13.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-08-27T02:33:13.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:13.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.796+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:13.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.800+0000 7f41f7a0e9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-08-27T02:33:13.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.800+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:13.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.800+0000 7f41f7a0e9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-08-27T02:33:13.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.800+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:13.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.800+0000 7f41f7a0e9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-08-27T02:33:13.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.800+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:13.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.800+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:13.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.804+0000 7f41f7a0e9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-08-27T02:33:13.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.804+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:13.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.804+0000 7f41f7a0e9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-08-27T02:33:13.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.804+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:13.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.804+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:13.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f41f7a0e9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-08-27T02:33:13.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f41f7a0e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:13.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f41f7a0e9c0 1 NOTICE: finished shard 1 (1 entries found) 2024-08-27T02:33:13.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f41f7a0e9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-08-27T02:33:13.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f41f7a0e9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-08-27T02:33:13.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f41f7a0e9c0 1 NOTICE: finished shard 10 (1 entries found) 2024-08-27T02:33:13.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f41f7a0e9c0 1 NOTICE: finished all shards (4 entries found) 2024-08-27T02:33:13.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.808+0000 7f40ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:13.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.816+0000 7f41f7a0e9c0 20 remove_watcher() i=0 2024-08-27T02:33:13.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.816+0000 7f41f7a0e9c0 2 removed watcher, disabling cache 2024-08-27T02:33:13.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.816+0000 7f41f7a0e9c0 20 remove_watcher() i=1 2024-08-27T02:33:13.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.820+0000 7f41f7a0e9c0 20 remove_watcher() i=2 2024-08-27T02:33:13.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.820+0000 7f41f7a0e9c0 20 remove_watcher() i=3 2024-08-27T02:33:13.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.824+0000 7f41f7a0e9c0 20 remove_watcher() i=4 2024-08-27T02:33:13.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.824+0000 7f41f7a0e9c0 20 remove_watcher() i=5 2024-08-27T02:33:13.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.824+0000 7f41f7a0e9c0 20 remove_watcher() i=6 2024-08-27T02:33:13.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:13.828+0000 7f41f7a0e9c0 20 remove_watcher() i=7 2024-08-27T02:33:13.847 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: unlinked entries are not listable 2024-08-27T02:33:13.847 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:14.052 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-08-27T02:33:14.053 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:14.280 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-08-27T02:33:14.280 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:14.280 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-27T02:33:14.321 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:14.321 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:14.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.360+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.360+0000 7fa6276859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:14.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.360+0000 7fa6276859c0 20 realm 2024-08-27T02:33:14.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.360+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:14.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:14.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:14.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:14.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:14.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.364+0000 7fa6276859c0 20 searching for the correct realm 2024-08-27T02:33:14.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.368+0000 7fa62518b640 0 -- 172.21.15.143:0/4181336422 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x5592342d9880 msgr2=0x7fa6200a6400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:14.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.580+0000 7fa62598c640 0 -- 172.21.15.143:0/4181336422 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fa610010040 msgr2=0x7fa610030400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:14.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.596+0000 7fa6276859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.596+0000 7fa6276859c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.596+0000 7fa6276859c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.596+0000 7fa6276859c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.596+0000 7fa6276859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.596+0000 7fa6276859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.596+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:14.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:14.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:14.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 zone default found 2024-08-27T02:33:14.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 4 Realm: () 2024-08-27T02:33:14.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:14.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:14.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:14.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 zonegroup default 2024-08-27T02:33:14.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:14.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:14.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:14.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 started sync module instance, tier type = 2024-08-27T02:33:14.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.600+0000 7fa6276859c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:14.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.624+0000 7fa6276859c0 20 add_watcher() i=0 2024-08-27T02:33:14.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.624+0000 7fa6276859c0 20 add_watcher() i=1 2024-08-27T02:33:14.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.624+0000 7fa6276859c0 20 add_watcher() i=2 2024-08-27T02:33:14.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.624+0000 7fa6276859c0 20 add_watcher() i=3 2024-08-27T02:33:14.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.624+0000 7fa6276859c0 20 add_watcher() i=4 2024-08-27T02:33:14.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.624+0000 7fa6276859c0 20 add_watcher() i=5 2024-08-27T02:33:14.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.624+0000 7fa6276859c0 20 add_watcher() i=6 2024-08-27T02:33:14.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.628+0000 7fa6276859c0 20 add_watcher() i=7 2024-08-27T02:33:14.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.628+0000 7fa6276859c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:14.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.628+0000 7fa4db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:14.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:14.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:14.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 5 note: GC not initialized 2024-08-27T02:33:14.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa4da7e4640 20 reqs_thread_entry: start 2024-08-27T02:33:14.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:14.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 Filter name: none 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa44bfff640 20 reqs_thread_entry: start 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:14.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:14.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:14.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:14.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:14.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:14.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:14.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:14.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:14.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-08-27T02:33:14.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.632+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:14.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.636+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:14.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.636+0000 7fa6276859c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-08-27T02:33:14.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.636+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:14.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.636+0000 7fa6276859c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-08-27T02:33:14.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.636+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:14.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.636+0000 7fa6276859c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-08-27T02:33:14.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.636+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.640+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:14.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.640+0000 7fa6276859c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-08-27T02:33:14.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.640+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:14.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.640+0000 7fa6276859c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-08-27T02:33:14.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.640+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.640+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state: octx=0x5592342a1d70 obj=check-bucket:e state=0x55923454c3b8 s->prefetch_data=0 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state: octx=0x5592342b37d0 obj=check-bucket:d state=0x559234550a88 s->prefetch_data=0 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state: octx=0x5592345519b0 obj=check-bucket:c state=0x559234547748 s->prefetch_data=0 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state: octx=0x55923454e7b0 obj=check-bucket:f state=0x55923454b328 s->prefetch_data=0 2024-08-27T02:33:14.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to cqbu7wqno4ffe2xpz2l59s6qigyg0441 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state_impl: setting s->olh_tag to rbi7bg5idyd1br4jrpigouhju4b3d07z 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rbi7bg5idyd1br4jrpigouhju4b3d07z 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to sywd7r2blksh8uuryu81vt2pd9vmo22o 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state_impl: setting s->olh_tag to cbnkz7hfb33u2dl120fe983q8bb17lkr 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cbnkz7hfb33u2dl120fe983q8bb17lkr 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to u38cvxsxpuahmhv68uvkmt4z8r0zj4z8 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 get_obj_state_impl: setting s->olh_tag to rcz2pf6ddwij5kvgzp0ql8u6n558uofo 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.644+0000 7fa6276859c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rcz2pf6ddwij5kvgzp0ql8u6n558uofo 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.648+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to 0qombkkjoi56mwk9a6mcbr1rwjbd9b23 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.648+0000 7fa6276859c0 20 get_obj_state_impl: setting s->olh_tag to 7e0m4o9o8thai6yfwk2ugsvq9bzabxfc 2024-08-27T02:33:14.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.648+0000 7fa6276859c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7e0m4o9o8thai6yfwk2ugsvq9bzabxfc 2024-08-27T02:33:14.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.648+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.652+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:14.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.652+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:14.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:14.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-08-27T02:33:14.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 olh_log_entry: epoch=2 op=3 key=e[Gjd0yphe7Vw4CbSxDt0NnLhpgkmJuoC] 2024-08-27T02:33:14.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 get_obj_state: octx=0x5592342a1d70 obj=check-bucket:_:Gjd0yphe7Vw4CbSxDt0NnLhpgkmJuoC_e state=0x5592345f32c8 s->prefetch_data=0 2024-08-27T02:33:14.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 10 manifest: total_size = 22 2024-08-27T02:33:14.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2459575371453141147 2024-08-27T02:33:14.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 get_obj_state: octx=0x5592342a1d70 obj=check-bucket:_:Gjd0yphe7Vw4CbSxDt0NnLhpgkmJuoC_e state=0x5592345f32c8 s->prefetch_data=0 2024-08-27T02:33:14.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 prepare_atomic_modification: state is not atomic. state=0x5592345f32c8 2024-08-27T02:33:14.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:14.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.656+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 olh_log_entry: epoch=3 op=3 key=d[L2dEPvMMjI-QLKYR.dE2gjn0VBQeP-I] 2024-08-27T02:33:14.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: octx=0x5592342b37d0 obj=check-bucket:_:L2dEPvMMjI-QLKYR.dE2gjn0VBQeP-I_d state=0x5592345f68f8 s->prefetch_data=0 2024-08-27T02:33:14.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 10 manifest: total_size = 9 2024-08-27T02:33:14.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9601805782191018934 2024-08-27T02:33:14.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: octx=0x5592342b37d0 obj=check-bucket:_:L2dEPvMMjI-QLKYR.dE2gjn0VBQeP-I_d state=0x5592345f68f8 s->prefetch_data=0 2024-08-27T02:33:14.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 prepare_atomic_modification: state is not atomic. state=0x5592345f68f8 2024-08-27T02:33:14.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:14.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-08-27T02:33:14.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 olh_log_entry: epoch=2 op=3 key=f[KWBEc2JCeMJHb0SRQ4VP8h1ZtWvNK1M] 2024-08-27T02:33:14.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: octx=0x55923454e7b0 obj=check-bucket:_:KWBEc2JCeMJHb0SRQ4VP8h1ZtWvNK1M_f state=0x5592345ecf88 s->prefetch_data=0 2024-08-27T02:33:14.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 olh_log_entry: epoch=3 op=3 key=c[17.Rv7-IgECtCkeaym7VSB3Rhq2AMlF] 2024-08-27T02:33:14.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: octx=0x5592345519b0 obj=check-bucket:_:17.Rv7-IgECtCkeaym7VSB3Rhq2AMlF_c state=0x559234606c48 s->prefetch_data=0 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 10 manifest: total_size = 11 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9569395868562394254 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: octx=0x55923454e7b0 obj=check-bucket:_:KWBEc2JCeMJHb0SRQ4VP8h1ZtWvNK1M_f state=0x5592345ecf88 s->prefetch_data=0 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 prepare_atomic_modification: state is not atomic. state=0x5592345ecf88 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 10 manifest: total_size = 22 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16997279640546785437 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 get_obj_state: octx=0x5592345519b0 obj=check-bucket:_:17.Rv7-IgECtCkeaym7VSB3Rhq2AMlF_c state=0x559234606c48 s->prefetch_data=0 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 prepare_atomic_modification: state is not atomic. state=0x559234606c48 2024-08-27T02:33:14.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:14.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-08-27T02:33:14.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:14.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.660+0000 7fa6276859c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:Gjd0yphe7Vw4CbSxDt0NnLhpgkmJuoC_.Ab_en8HwbNNvcRcvtvLhvI2vcg8IagM_0 2024-08-27T02:33:14.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.664+0000 7fa508ff9640 20 handle_completion(): completion ok for obj=e[Gjd0yphe7Vw4CbSxDt0NnLhpgkmJuoC] 2024-08-27T02:33:14.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.668+0000 7fa6276859c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:14.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.668+0000 7fa6276859c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-08-27T02:33:14.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.668+0000 7fa6276859c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:14.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.668+0000 7fa6276859c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:KWBEc2JCeMJHb0SRQ4VP8h1ZtWvNK1M_.-84hrp7saj9dWB7Ndj1A8MVZQrd30A1_0 2024-08-27T02:33:14.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.668+0000 7fa6276859c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:14.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.672+0000 7fa6276859c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:14.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.672+0000 7fa6276859c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-08-27T02:33:14.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.672+0000 7fa6276859c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:14.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.672+0000 7fa6276859c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:L2dEPvMMjI-QLKYR.dE2gjn0VBQeP-I_.T2d8Ke2gdvhDsdeLMBVtuKW8H6YACyI_0 2024-08-27T02:33:14.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 20 get_obj_state: octx=0x5592342a1d70 obj=check-bucket:e state=0x55923454c3b8 s->prefetch_data=0 2024-08-27T02:33:14.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rbi7bg5idyd1br4jrpigouhju4b3d07z 2024-08-27T02:33:14.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:14.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-08-27T02:33:14.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa4f7fff640 20 handle_completion(): completion ok for obj=f[KWBEc2JCeMJHb0SRQ4VP8h1ZtWvNK1M] 2024-08-27T02:33:14.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:14.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:17.Rv7-IgECtCkeaym7VSB3Rhq2AMlF_.jFfVgBJugzXIK08LMDL1DUcZsSFYUB4_0 2024-08-27T02:33:14.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:14.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.676+0000 7fa6276859c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:14.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.680+0000 7fa4f7fff640 20 handle_completion(): completion ok for obj=d[L2dEPvMMjI-QLKYR.dE2gjn0VBQeP-I] 2024-08-27T02:33:14.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.684+0000 7fa508ff9640 20 handle_completion(): completion ok for obj=c[17.Rv7-IgECtCkeaym7VSB3Rhq2AMlF] 2024-08-27T02:33:14.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.684+0000 7fa6276859c0 20 get_obj_state: octx=0x55923454e7b0 obj=check-bucket:f state=0x55923454b328 s->prefetch_data=0 2024-08-27T02:33:14.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.684+0000 7fa6276859c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7e0m4o9o8thai6yfwk2ugsvq9bzabxfc 2024-08-27T02:33:14.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.684+0000 7fa6276859c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:14.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.684+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.684+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.688+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:14.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.688+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.688+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.688+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:14.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.692+0000 7fa6276859c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-08-27T02:33:14.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.692+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:14.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.692+0000 7fa6276859c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-08-27T02:33:14.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.692+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:14.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.692+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:14.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.692+0000 7fa6276859c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-08-27T02:33:14.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.696+0000 7fa6276859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:14.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.696+0000 7fa6276859c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-08-27T02:33:14.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.696+0000 7fa6276859c0 1 NOTICE: finished all shards (4 entries removed) 2024-08-27T02:33:14.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.696+0000 7fa4db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:14.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.700+0000 7fa6276859c0 20 remove_watcher() i=0 2024-08-27T02:33:14.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.700+0000 7fa6276859c0 2 removed watcher, disabling cache 2024-08-27T02:33:14.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.704+0000 7fa6276859c0 20 remove_watcher() i=1 2024-08-27T02:33:14.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.704+0000 7fa6276859c0 20 remove_watcher() i=2 2024-08-27T02:33:14.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.708+0000 7fa6276859c0 20 remove_watcher() i=3 2024-08-27T02:33:14.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.708+0000 7fa6276859c0 20 remove_watcher() i=4 2024-08-27T02:33:14.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.712+0000 7fa6276859c0 20 remove_watcher() i=5 2024-08-27T02:33:14.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.712+0000 7fa6276859c0 20 remove_watcher() i=6 2024-08-27T02:33:14.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:14.712+0000 7fa6276859c0 20 remove_watcher() i=7 2024-08-27T02:33:14.894 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check unlinked does not affect normal entries 2024-08-27T02:33:14.894 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:15.274 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-08-27T02:33:15.274 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:15.274 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-08-27T02:33:15.313 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:15.313 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:15.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.352+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.352+0000 7fa7aab5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.352+0000 7fa7aab5f9c0 20 realm 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.352+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:15.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:15.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:15.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.356+0000 7fa7aab5f9c0 20 searching for the correct realm 2024-08-27T02:33:15.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.364+0000 7fa7a8e66640 0 -- 172.21.15.143:0/756389349 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fa790054260 msgr2=0x7fa790071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:15.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.580+0000 7fa7a8665640 0 -- 172.21.15.143:0/756389349 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x56525758b280 msgr2=0x56525758d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:15.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:15.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:15.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:15.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:15.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:15.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:15.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:15.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.588+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:15.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 zone default found 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 4 Realm: () 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 zonegroup default 2024-08-27T02:33:15.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:15.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:15.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:15.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 started sync module instance, tier type = 2024-08-27T02:33:15.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.592+0000 7fa7aab5f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:15.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.616+0000 7fa7aab5f9c0 20 add_watcher() i=0 2024-08-27T02:33:15.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.616+0000 7fa7aab5f9c0 20 add_watcher() i=1 2024-08-27T02:33:15.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.616+0000 7fa7aab5f9c0 20 add_watcher() i=2 2024-08-27T02:33:15.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.616+0000 7fa7aab5f9c0 20 add_watcher() i=3 2024-08-27T02:33:15.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.616+0000 7fa7aab5f9c0 20 add_watcher() i=4 2024-08-27T02:33:15.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.616+0000 7fa7aab5f9c0 20 add_watcher() i=5 2024-08-27T02:33:15.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.616+0000 7fa7aab5f9c0 20 add_watcher() i=6 2024-08-27T02:33:15.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.620+0000 7fa7aab5f9c0 20 add_watcher() i=7 2024-08-27T02:33:15.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.620+0000 7fa7aab5f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:15.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.624+0000 7fa65efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:15.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.624+0000 7fa7aab5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:15.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.624+0000 7fa7aab5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:15.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.624+0000 7fa7aab5f9c0 5 note: GC not initialized 2024-08-27T02:33:15.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.624+0000 7fa65dfdb640 20 reqs_thread_entry: start 2024-08-27T02:33:15.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.624+0000 7fa7aab5f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:15.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 20 Filter name: none 2024-08-27T02:33:15.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa5cf7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:15.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:15.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:15.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:15.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:15.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:15.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:15.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:15.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:15.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:15.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:15.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:15.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:15.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:15.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-08-27T02:33:15.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.628+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:15.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-08-27T02:33:15.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:15.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-08-27T02:33:15.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:15.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-08-27T02:33:15.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:15.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-08-27T02:33:15.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:15.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-08-27T02:33:15.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.632+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:15.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-08-27T02:33:15.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:15.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-08-27T02:33:15.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:15.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-08-27T02:33:15.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:15.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-08-27T02:33:15.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.636+0000 7fa7aab5f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:15.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.640+0000 7fa7aab5f9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-08-27T02:33:15.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.640+0000 7fa7aab5f9c0 1 NOTICE: finished all shards (0 entries found) 2024-08-27T02:33:15.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.640+0000 7fa65efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:15.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.644+0000 7fa7aab5f9c0 20 remove_watcher() i=0 2024-08-27T02:33:15.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.644+0000 7fa7aab5f9c0 2 removed watcher, disabling cache 2024-08-27T02:33:15.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.648+0000 7fa7aab5f9c0 20 remove_watcher() i=1 2024-08-27T02:33:15.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.648+0000 7fa7aab5f9c0 20 remove_watcher() i=2 2024-08-27T02:33:15.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.652+0000 7fa7aab5f9c0 20 remove_watcher() i=3 2024-08-27T02:33:15.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.656+0000 7fa7aab5f9c0 20 remove_watcher() i=4 2024-08-27T02:33:15.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.656+0000 7fa7aab5f9c0 20 remove_watcher() i=5 2024-08-27T02:33:15.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.656+0000 7fa7aab5f9c0 20 remove_watcher() i=6 2024-08-27T02:33:15.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:15.660+0000 7fa7aab5f9c0 20 remove_watcher() i=7 2024-08-27T02:33:16.131 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-27T02:33:16.166 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:16.166 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:16.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 realm 2024-08-27T02:33:16.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:16.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.208+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.212+0000 7f2d8afa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.212+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.212+0000 7f2d8afa19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:16.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.212+0000 7f2d8afa19c0 20 searching for the correct realm 2024-08-27T02:33:16.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.216+0000 7f2d882a6640 0 -- 172.21.15.143:0/3482580807 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x561188151940 msgr2=0x561188153dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:16.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.224+0000 7f2d88aa7640 0 -- 172.21.15.143:0/3482580807 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f2d7c07d550 msgr2=0x7f2d7c0024c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:16.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.228+0000 7f2d8afa19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:16.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.228+0000 7f2d8afa19c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:16.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.228+0000 7f2d8afa19c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:16.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.228+0000 7f2d8afa19c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:16.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.228+0000 7f2d8afa19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:16.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.228+0000 7f2d8afa19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:16.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.228+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 zone default found 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 4 Realm: () 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 zonegroup default 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 started sync module instance, tier type = 2024-08-27T02:33:16.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.232+0000 7f2d8afa19c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:16.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.252+0000 7f2d8afa19c0 20 add_watcher() i=0 2024-08-27T02:33:16.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.252+0000 7f2d8afa19c0 20 add_watcher() i=1 2024-08-27T02:33:16.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.252+0000 7f2d8afa19c0 20 add_watcher() i=2 2024-08-27T02:33:16.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.252+0000 7f2d8afa19c0 20 add_watcher() i=3 2024-08-27T02:33:16.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.252+0000 7f2d8afa19c0 20 add_watcher() i=4 2024-08-27T02:33:16.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.252+0000 7f2d8afa19c0 20 add_watcher() i=5 2024-08-27T02:33:16.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.256+0000 7f2d8afa19c0 20 add_watcher() i=6 2024-08-27T02:33:16.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.256+0000 7f2d8afa19c0 20 add_watcher() i=7 2024-08-27T02:33:16.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.256+0000 7f2d8afa19c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:16.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2c3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 5 note: GC not initialized 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2c3dfe3640 20 reqs_thread_entry: start 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 Filter name: none 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2baf7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:16.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:16.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:16.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:16.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:16.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 INFO: main: starting shard=0 2024-08-27T02:33:16.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:16.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 INFO: main: starting shard=1 2024-08-27T02:33:16.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:16.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 INFO: main: starting shard=2 2024-08-27T02:33:16.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.260+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:16.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: starting shard=3 2024-08-27T02:33:16.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:16.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: starting shard=4 2024-08-27T02:33:16.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:16.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: starting shard=5 2024-08-27T02:33:16.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:16.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-08-27T02:33:16.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 INFO: main: starting shard=6 2024-08-27T02:33:16.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.264+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:16.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 INFO: main: starting shard=7 2024-08-27T02:33:16.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:16.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 INFO: main: starting shard=8 2024-08-27T02:33:16.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:16.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 INFO: main: starting shard=9 2024-08-27T02:33:16.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.268+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:16.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.272+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.272+0000 7f2d8afa19c0 20 INFO: main: starting shard=10 2024-08-27T02:33:16.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.272+0000 7f2d8afa19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:16.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.272+0000 7f2d8afa19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.272+0000 7f2d8afa19c0 20 INFO: main: done 2024-08-27T02:33:16.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.272+0000 7f2c3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:16.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.276+0000 7f2d8afa19c0 20 remove_watcher() i=0 2024-08-27T02:33:16.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.276+0000 7f2d8afa19c0 2 removed watcher, disabling cache 2024-08-27T02:33:16.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.280+0000 7f2d8afa19c0 20 remove_watcher() i=1 2024-08-27T02:33:16.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.280+0000 7f2d8afa19c0 20 remove_watcher() i=2 2024-08-27T02:33:16.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.284+0000 7f2d8afa19c0 20 remove_watcher() i=3 2024-08-27T02:33:16.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.284+0000 7f2d8afa19c0 20 remove_watcher() i=4 2024-08-27T02:33:16.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.288+0000 7f2d8afa19c0 20 remove_watcher() i=5 2024-08-27T02:33:16.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.288+0000 7f2d8afa19c0 20 remove_watcher() i=6 2024-08-27T02:33:16.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.288+0000 7f2d8afa19c0 20 remove_watcher() i=7 2024-08-27T02:33:16.310 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-27T02:33:16.340 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:16.340 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:16.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 realm 2024-08-27T02:33:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.380+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.384+0000 7f8805ca39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.384+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.384+0000 7f8805ca39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:16.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.384+0000 7f8805ca39c0 20 searching for the correct realm 2024-08-27T02:33:16.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.388+0000 7f8803faa640 0 -- 172.21.15.143:0/903306452 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x5652e2d1df30 msgr2=0x5652e2d203b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:16.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.396+0000 7f8802fa8640 0 -- 172.21.15.143:0/903306452 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f87f40e8440 msgr2=0x7f87f40e8860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:16.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.404+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:16.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 zone default found 2024-08-27T02:33:16.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 4 Realm: () 2024-08-27T02:33:16.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:16.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:16.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:16.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 zonegroup default 2024-08-27T02:33:16.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 started sync module instance, tier type = 2024-08-27T02:33:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.408+0000 7f8805ca39c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:16.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.424+0000 7f8805ca39c0 20 add_watcher() i=0 2024-08-27T02:33:16.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.424+0000 7f8805ca39c0 20 add_watcher() i=1 2024-08-27T02:33:16.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.424+0000 7f8805ca39c0 20 add_watcher() i=2 2024-08-27T02:33:16.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.424+0000 7f8805ca39c0 20 add_watcher() i=3 2024-08-27T02:33:16.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.424+0000 7f8805ca39c0 20 add_watcher() i=4 2024-08-27T02:33:16.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.424+0000 7f8805ca39c0 20 add_watcher() i=5 2024-08-27T02:33:16.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.424+0000 7f8805ca39c0 20 add_watcher() i=6 2024-08-27T02:33:16.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f8805ca39c0 20 add_watcher() i=7 2024-08-27T02:33:16.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f8805ca39c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:16.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f86b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:16.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f8805ca39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:16.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f8805ca39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:16.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f8805ca39c0 5 note: GC not initialized 2024-08-27T02:33:16.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f86b8fe1640 20 reqs_thread_entry: start 2024-08-27T02:33:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f8805ca39c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f8805ca39c0 20 Filter name: none 2024-08-27T02:33:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.428+0000 7f86327fc640 20 reqs_thread_entry: start 2024-08-27T02:33:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: starting shard=0 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: starting shard=1 2024-08-27T02:33:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: starting shard=2 2024-08-27T02:33:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 INFO: main: starting shard=3 2024-08-27T02:33:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.432+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:16.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: starting shard=4 2024-08-27T02:33:16.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: starting shard=5 2024-08-27T02:33:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:16.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: starting shard=6 2024-08-27T02:33:16.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:16.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 INFO: main: starting shard=7 2024-08-27T02:33:16.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.436+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:16.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: starting shard=8 2024-08-27T02:33:16.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:16.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-08-27T02:33:16.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: starting shard=9 2024-08-27T02:33:16.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:16.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: starting shard=10 2024-08-27T02:33:16.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:16.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:16.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.440+0000 7f8805ca39c0 20 INFO: main: done 2024-08-27T02:33:16.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.444+0000 7f86b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:16.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.448+0000 7f8805ca39c0 20 remove_watcher() i=0 2024-08-27T02:33:16.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.448+0000 7f8805ca39c0 2 removed watcher, disabling cache 2024-08-27T02:33:16.454 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.448+0000 7f8805ca39c0 20 remove_watcher() i=1 2024-08-27T02:33:16.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.452+0000 7f8805ca39c0 20 remove_watcher() i=2 2024-08-27T02:33:16.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.452+0000 7f8805ca39c0 20 remove_watcher() i=3 2024-08-27T02:33:16.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.456+0000 7f8805ca39c0 20 remove_watcher() i=4 2024-08-27T02:33:16.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.456+0000 7f8805ca39c0 20 remove_watcher() i=5 2024-08-27T02:33:16.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.460+0000 7f8805ca39c0 20 remove_watcher() i=6 2024-08-27T02:33:16.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.460+0000 7f8805ca39c0 20 remove_watcher() i=7 2024-08-27T02:33:16.479 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check olh finds leftover OLH entries 2024-08-27T02:33:16.480 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:16.480 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-08-27T02:33:16.509 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:16.509 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:16.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.544+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 realm 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.548+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.552+0000 7f621a3199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:16.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.552+0000 7f621a3199c0 20 searching for the correct realm 2024-08-27T02:33:16.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.764+0000 7f6218620640 0 -- 172.21.15.143:0/2242656710 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x561f7b115410 msgr2=0x561f7b117800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:16.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.772+0000 7f621761e640 0 -- 172.21.15.143:0/2242656710 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f6208008040 msgr2=0x7f6208063190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:16.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:16.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:16.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:16.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:16.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:16.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:16.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 zone default found 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 4 Realm: () 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 zonegroup default 2024-08-27T02:33:16.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.788+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.792+0000 7f621a3199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.792+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.792+0000 7f621a3199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.792+0000 7f621a3199c0 20 started sync module instance, tier type = 2024-08-27T02:33:16.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.792+0000 7f621a3199c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:16.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=0 2024-08-27T02:33:16.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=1 2024-08-27T02:33:16.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=2 2024-08-27T02:33:16.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=3 2024-08-27T02:33:16.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=4 2024-08-27T02:33:16.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=5 2024-08-27T02:33:16.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=6 2024-08-27T02:33:16.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 20 add_watcher() i=7 2024-08-27T02:33:16.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.816+0000 7f621a3199c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:16.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f60cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:16.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:16.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:16.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 5 note: GC not initialized 2024-08-27T02:33:16.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f60ccfe1640 20 reqs_thread_entry: start 2024-08-27T02:33:16.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:16.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 20 Filter name: none 2024-08-27T02:33:16.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f60467fc640 20 reqs_thread_entry: start 2024-08-27T02:33:16.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:16.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:16.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:16.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:16.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:16.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.824+0000 7f621a3199c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:16.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:16.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:16.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:16.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:16.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:16.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:16.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 1 NOTICE: finished shard 0 (0 entries found) 2024-08-27T02:33:16.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:16.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 1 NOTICE: finished shard 1 (0 entries found) 2024-08-27T02:33:16.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:16.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 1 NOTICE: finished shard 2 (0 entries found) 2024-08-27T02:33:16.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.828+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:16.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 1 NOTICE: finished shard 3 (0 entries found) 2024-08-27T02:33:16.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:16.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 1 NOTICE: finished shard 4 (0 entries found) 2024-08-27T02:33:16.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:16.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 1 NOTICE: finished shard 5 (1 entries found) 2024-08-27T02:33:16.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:16.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 1 NOTICE: finished shard 6 (0 entries found) 2024-08-27T02:33:16.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.832+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:16.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 1 NOTICE: finished shard 7 (0 entries found) 2024-08-27T02:33:16.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:16.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 1 NOTICE: finished shard 8 (1 entries found) 2024-08-27T02:33:16.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:16.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 1 NOTICE: finished shard 9 (0 entries found) 2024-08-27T02:33:16.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:16.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 1 NOTICE: finished shard 10 (0 entries found) 2024-08-27T02:33:16.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.836+0000 7f621a3199c0 1 NOTICE: finished all shards (2 entries found) 2024-08-27T02:33:16.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.840+0000 7f60cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:16.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.844+0000 7f621a3199c0 20 remove_watcher() i=0 2024-08-27T02:33:16.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.844+0000 7f621a3199c0 2 removed watcher, disabling cache 2024-08-27T02:33:16.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.848+0000 7f621a3199c0 20 remove_watcher() i=1 2024-08-27T02:33:16.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.848+0000 7f621a3199c0 20 remove_watcher() i=2 2024-08-27T02:33:16.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.852+0000 7f621a3199c0 20 remove_watcher() i=3 2024-08-27T02:33:16.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.856+0000 7f621a3199c0 20 remove_watcher() i=4 2024-08-27T02:33:16.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.856+0000 7f621a3199c0 20 remove_watcher() i=5 2024-08-27T02:33:16.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.856+0000 7f621a3199c0 20 remove_watcher() i=6 2024-08-27T02:33:16.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.860+0000 7f621a3199c0 20 remove_watcher() i=7 2024-08-27T02:33:16.879 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-08-27T02:33:16.879 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:16.880 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-27T02:33:16.915 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:16.915 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:16.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 realm 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.956+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.960+0000 7ff81e1169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:16.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.960+0000 7ff81e1169c0 20 searching for the correct realm 2024-08-27T02:33:16.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.964+0000 7ff81b41b640 0 -- 172.21.15.143:0/4219945797 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff80c03a970 msgr2=0x7ff80c01c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:16.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.972+0000 7ff81b41b640 0 -- 172.21.15.143:0/4219945797 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff6e407e6b0 msgr2=0x7ff6e4080ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:16.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:16.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:16.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:16.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:16.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:16.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:16.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 zone default found 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 4 Realm: () 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 zonegroup default 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:16.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:16.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 started sync module instance, tier type = 2024-08-27T02:33:16.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.980+0000 7ff81e1169c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:17.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.996+0000 7ff81e1169c0 20 add_watcher() i=0 2024-08-27T02:33:17.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.996+0000 7ff81e1169c0 20 add_watcher() i=1 2024-08-27T02:33:17.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.996+0000 7ff81e1169c0 20 add_watcher() i=2 2024-08-27T02:33:17.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.996+0000 7ff81e1169c0 20 add_watcher() i=3 2024-08-27T02:33:17.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.996+0000 7ff81e1169c0 20 add_watcher() i=4 2024-08-27T02:33:17.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.996+0000 7ff81e1169c0 20 add_watcher() i=5 2024-08-27T02:33:17.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:16.996+0000 7ff81e1169c0 20 add_watcher() i=6 2024-08-27T02:33:17.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.000+0000 7ff81e1169c0 20 add_watcher() i=7 2024-08-27T02:33:17.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.000+0000 7ff81e1169c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:17.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.000+0000 7ff6d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 5 note: GC not initialized 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff6d0fe1640 20 reqs_thread_entry: start 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 Filter name: none 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff64a7fc640 20 reqs_thread_entry: start 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:17.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:17.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:17.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:17.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:17.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:17.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:17.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:17.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:17.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:17.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:17.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:17.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-08-27T02:33:17.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:17.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-08-27T02:33:17.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:17.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-08-27T02:33:17.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.004+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:17.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-08-27T02:33:17.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:17.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-08-27T02:33:17.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:17.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 20 get_obj_state: octx=0x562395874d60 obj=check-bucket:d state=0x562395b25dd8 s->prefetch_data=0 2024-08-27T02:33:17.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:17.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-08-27T02:33:17.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.008+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:17.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-08-27T02:33:17.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:17.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 get_obj_state: octx=0x5623958867c0 obj=check-bucket:c state=0x562395b219d8 s->prefetch_data=0 2024-08-27T02:33:17.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:17.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-08-27T02:33:17.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:17.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-08-27T02:33:17.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 get_obj_state: setting s->obj_tag to sywd7r2blksh8uuryu81vt2pd9vmo22o 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 get_obj_state_impl: setting s->olh_tag to cbnkz7hfb33u2dl120fe983q8bb17lkr 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 get_obj_state: setting s->obj_tag to u38cvxsxpuahmhv68uvkmt4z8r0zj4z8 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 get_obj_state_impl: setting s->olh_tag to rcz2pf6ddwij5kvgzp0ql8u6n558uofo 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 olh_log_entry: epoch=4 op=3 key=c[6BvCI0C9HpuGlEiWvL34GrMIIfMFPHc] 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.012+0000 7ff81e1169c0 20 get_obj_state: octx=0x562395b6e2a0 obj=check-bucket:_:6BvCI0C9HpuGlEiWvL34GrMIIfMFPHc_c state=0x562395b71cf8 s->prefetch_data=0 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.016+0000 7ff81e1169c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-08-27T02:33:17.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.016+0000 7ff81e1169c0 20 olh_log_entry: epoch=4 op=3 key=d[jC1qtG5UxHABqg8TlK33ZS2WPXVuW47] 2024-08-27T02:33:17.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.016+0000 7ff81e1169c0 20 get_obj_state: octx=0x562395b4e2a0 obj=check-bucket:_:jC1qtG5UxHABqg8TlK33ZS2WPXVuW47_d state=0x562395b721a8 s->prefetch_data=0 2024-08-27T02:33:17.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.016+0000 7ff81e1169c0 20 get_obj_state: octx=0x562395b6e2a0 obj=check-bucket:c state=0x562395b1ce48 s->prefetch_data=0 2024-08-27T02:33:17.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.016+0000 7ff81e1169c0 20 get_obj_state: setting s->obj_tag to u38cvxsxpuahmhv68uvkmt4z8r0zj4z8 2024-08-27T02:33:17.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.016+0000 7ff81e1169c0 20 get_obj_state_impl: setting s->olh_tag to rcz2pf6ddwij5kvgzp0ql8u6n558uofo 2024-08-27T02:33:17.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.016+0000 7ff81e1169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rcz2pf6ddwij5kvgzp0ql8u6n558uofo 2024-08-27T02:33:17.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.020+0000 7ff81e1169c0 20 get_obj_state: octx=0x562395b4e2a0 obj=check-bucket:d state=0x562395b72e28 s->prefetch_data=0 2024-08-27T02:33:17.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.020+0000 7ff81e1169c0 20 get_obj_state: setting s->obj_tag to sywd7r2blksh8uuryu81vt2pd9vmo22o 2024-08-27T02:33:17.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.020+0000 7ff81e1169c0 20 get_obj_state_impl: setting s->olh_tag to cbnkz7hfb33u2dl120fe983q8bb17lkr 2024-08-27T02:33:17.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.020+0000 7ff81e1169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cbnkz7hfb33u2dl120fe983q8bb17lkr 2024-08-27T02:33:17.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.028+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:17.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.028+0000 7ff81e1169c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-08-27T02:33:17.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.032+0000 7ff81e1169c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:17.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.036+0000 7ff81e1169c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-08-27T02:33:17.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.036+0000 7ff81e1169c0 1 NOTICE: finished all shards (2 entries removed) 2024-08-27T02:33:17.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.036+0000 7ff6d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.040+0000 7ff81e1169c0 20 remove_watcher() i=0 2024-08-27T02:33:17.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.040+0000 7ff81e1169c0 2 removed watcher, disabling cache 2024-08-27T02:33:17.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.044+0000 7ff81e1169c0 20 remove_watcher() i=1 2024-08-27T02:33:17.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.048+0000 7ff81e1169c0 20 remove_watcher() i=2 2024-08-27T02:33:17.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.048+0000 7ff81e1169c0 20 remove_watcher() i=3 2024-08-27T02:33:17.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.052+0000 7ff81e1169c0 20 remove_watcher() i=4 2024-08-27T02:33:17.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.052+0000 7ff81e1169c0 20 remove_watcher() i=5 2024-08-27T02:33:17.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.052+0000 7ff81e1169c0 20 remove_watcher() i=6 2024-08-27T02:33:17.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.056+0000 7ff81e1169c0 20 remove_watcher() i=7 2024-08-27T02:33:17.073 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-27T02:33:17.102 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:17.102 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:17.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 realm 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.140+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.144+0000 7f32c781d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:17.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.144+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.144+0000 7f32c781d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:17.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.144+0000 7f32c781d9c0 20 searching for the correct realm 2024-08-27T02:33:17.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.152+0000 7f32bcb22640 0 -- 172.21.15.143:0/4009363796 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f32b8076040 msgr2=0x7f32b8067320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:17.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.156+0000 7f32bcb22640 0 -- 172.21.15.143:0/4009363796 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f319007e6e0 msgr2=0x7f3190080b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:17.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 zone default found 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 4 Realm: () 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 zonegroup default 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.164+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.168+0000 7f32c781d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.168+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.168+0000 7f32c781d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.168+0000 7f32c781d9c0 20 started sync module instance, tier type = 2024-08-27T02:33:17.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.168+0000 7f32c781d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:17.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.188+0000 7f32c781d9c0 20 add_watcher() i=0 2024-08-27T02:33:17.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.188+0000 7f32c781d9c0 20 add_watcher() i=1 2024-08-27T02:33:17.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.188+0000 7f32c781d9c0 20 add_watcher() i=2 2024-08-27T02:33:17.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.188+0000 7f32c781d9c0 20 add_watcher() i=3 2024-08-27T02:33:17.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.188+0000 7f32c781d9c0 20 add_watcher() i=4 2024-08-27T02:33:17.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.188+0000 7f32c781d9c0 20 add_watcher() i=5 2024-08-27T02:33:17.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.188+0000 7f32c781d9c0 20 add_watcher() i=6 2024-08-27T02:33:17.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f32c781d9c0 20 add_watcher() i=7 2024-08-27T02:33:17.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f32c781d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:17.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f317b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f32c781d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:17.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f32c781d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:17.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f32c781d9c0 5 note: GC not initialized 2024-08-27T02:33:17.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f317a7e4640 20 reqs_thread_entry: start 2024-08-27T02:33:17.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.192+0000 7f32c781d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:17.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 Filter name: none 2024-08-27T02:33:17.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f30ebfff640 20 reqs_thread_entry: start 2024-08-27T02:33:17.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:17.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:17.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:17.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:17.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: starting shard=0 2024-08-27T02:33:17.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:17.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: starting shard=1 2024-08-27T02:33:17.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:17.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: starting shard=2 2024-08-27T02:33:17.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:17.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.196+0000 7f32c781d9c0 20 INFO: main: starting shard=3 2024-08-27T02:33:17.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:17.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: starting shard=4 2024-08-27T02:33:17.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:17.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: starting shard=5 2024-08-27T02:33:17.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:17.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: starting shard=6 2024-08-27T02:33:17.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:17.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 INFO: main: starting shard=7 2024-08-27T02:33:17.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.200+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:17.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: starting shard=8 2024-08-27T02:33:17.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:17.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: starting shard=9 2024-08-27T02:33:17.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:17.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: starting shard=10 2024-08-27T02:33:17.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:17.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.204+0000 7f32c781d9c0 20 INFO: main: done 2024-08-27T02:33:17.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.208+0000 7f317b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.212+0000 7f32c781d9c0 20 remove_watcher() i=0 2024-08-27T02:33:17.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.212+0000 7f32c781d9c0 2 removed watcher, disabling cache 2024-08-27T02:33:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.216+0000 7f32c781d9c0 20 remove_watcher() i=1 2024-08-27T02:33:17.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.216+0000 7f32c781d9c0 20 remove_watcher() i=2 2024-08-27T02:33:17.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.220+0000 7f32c781d9c0 20 remove_watcher() i=3 2024-08-27T02:33:17.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.220+0000 7f32c781d9c0 20 remove_watcher() i=4 2024-08-27T02:33:17.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.224+0000 7f32c781d9c0 20 remove_watcher() i=5 2024-08-27T02:33:17.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.224+0000 7f32c781d9c0 20 remove_watcher() i=6 2024-08-27T02:33:17.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.224+0000 7f32c781d9c0 20 remove_watcher() i=7 2024-08-27T02:33:17.245 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-27T02:33:17.274 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:17.274 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:17.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 realm 2024-08-27T02:33:17.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:17.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.312+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.316+0000 7f6c491839c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:17.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.316+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.316+0000 7f6c491839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:17.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.316+0000 7f6c491839c0 20 searching for the correct realm 2024-08-27T02:33:17.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.320+0000 7f6c46488640 0 -- 172.21.15.143:0/3452897216 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x555625e2f850 msgr2=0x555625e31cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:17.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.328+0000 7f6c46488640 0 -- 172.21.15.143:0/3452897216 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f6c380e3070 msgr2=0x7f6c380c1a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.332+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 zone default found 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 4 Realm: () 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 zonegroup default 2024-08-27T02:33:17.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 started sync module instance, tier type = 2024-08-27T02:33:17.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.336+0000 7f6c491839c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:17.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.356+0000 7f6c491839c0 20 add_watcher() i=0 2024-08-27T02:33:17.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.356+0000 7f6c491839c0 20 add_watcher() i=1 2024-08-27T02:33:17.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.356+0000 7f6c491839c0 20 add_watcher() i=2 2024-08-27T02:33:17.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.356+0000 7f6c491839c0 20 add_watcher() i=3 2024-08-27T02:33:17.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.356+0000 7f6c491839c0 20 add_watcher() i=4 2024-08-27T02:33:17.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.356+0000 7f6c491839c0 20 add_watcher() i=5 2024-08-27T02:33:17.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.360+0000 7f6c491839c0 20 add_watcher() i=6 2024-08-27T02:33:17.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.360+0000 7f6c491839c0 20 add_watcher() i=7 2024-08-27T02:33:17.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.360+0000 7f6c491839c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:17.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.360+0000 7f6afd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 5 note: GC not initialized 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6a77fff640 20 reqs_thread_entry: start 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 Filter name: none 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6a75ffb640 20 reqs_thread_entry: start 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:17.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:17.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:17.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:17.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: starting shard=0 2024-08-27T02:33:17.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:17.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: starting shard=1 2024-08-27T02:33:17.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:17.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: starting shard=2 2024-08-27T02:33:17.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:17.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 INFO: main: starting shard=3 2024-08-27T02:33:17.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.364+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:17.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: starting shard=4 2024-08-27T02:33:17.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:17.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: starting shard=5 2024-08-27T02:33:17.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:17.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: starting shard=6 2024-08-27T02:33:17.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:17.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 INFO: main: starting shard=7 2024-08-27T02:33:17.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.368+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:17.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: starting shard=8 2024-08-27T02:33:17.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:17.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: starting shard=9 2024-08-27T02:33:17.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:17.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: starting shard=10 2024-08-27T02:33:17.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:17.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:17.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6c491839c0 20 INFO: main: done 2024-08-27T02:33:17.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.372+0000 7f6afd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.380+0000 7f6c491839c0 20 remove_watcher() i=0 2024-08-27T02:33:17.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.380+0000 7f6c491839c0 2 removed watcher, disabling cache 2024-08-27T02:33:17.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.384+0000 7f6c491839c0 20 remove_watcher() i=1 2024-08-27T02:33:17.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.384+0000 7f6c491839c0 20 remove_watcher() i=2 2024-08-27T02:33:17.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.388+0000 7f6c491839c0 20 remove_watcher() i=3 2024-08-27T02:33:17.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.388+0000 7f6c491839c0 20 remove_watcher() i=4 2024-08-27T02:33:17.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.392+0000 7f6c491839c0 20 remove_watcher() i=5 2024-08-27T02:33:17.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.392+0000 7f6c491839c0 20 remove_watcher() i=6 2024-08-27T02:33:17.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.392+0000 7f6c491839c0 20 remove_watcher() i=7 2024-08-27T02:33:17.411 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-08-27T02:33:17.411 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:17.411 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-08-27T02:33:17.440 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:17.440 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:17.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.476+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 realm 2024-08-27T02:33:17.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:17.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:17.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.480+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.484+0000 7f34c1f4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:17.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.484+0000 7f34c1f4a9c0 20 searching for the correct realm 2024-08-27T02:33:17.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.488+0000 7f34c0251640 0 -- 172.21.15.143:0/3438127351 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f34b40dbba0 msgr2=0x7f34b40b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:17.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.704+0000 7f34bfa50640 0 -- 172.21.15.143:0/3438127351 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x564d671d7aa0 msgr2=0x564d671d9e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:17.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:17.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.712+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:17.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 zone default found 2024-08-27T02:33:17.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 4 Realm: () 2024-08-27T02:33:17.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:17.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:17.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:17.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 zonegroup default 2024-08-27T02:33:17.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:17.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 started sync module instance, tier type = 2024-08-27T02:33:17.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.716+0000 7f34c1f4a9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=0 2024-08-27T02:33:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=1 2024-08-27T02:33:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=2 2024-08-27T02:33:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=3 2024-08-27T02:33:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=4 2024-08-27T02:33:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=5 2024-08-27T02:33:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=6 2024-08-27T02:33:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 20 add_watcher() i=7 2024-08-27T02:33:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.744+0000 7f34c1f4a9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:17.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.748+0000 7f33767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:17.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:17.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 5 note: GC not initialized 2024-08-27T02:33:17.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f33757e2640 20 reqs_thread_entry: start 2024-08-27T02:33:17.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:17.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 Filter name: none 2024-08-27T02:33:17.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f336e7fc640 20 reqs_thread_entry: start 2024-08-27T02:33:17.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:17.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:17.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:17.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:17.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:17.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:17.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:17.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:17.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:17.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:17.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:17.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:17.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.752+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:17.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-08-27T02:33:17.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:17.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-08-27T02:33:17.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:17.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-08-27T02:33:17.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:17.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-08-27T02:33:17.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:17.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-08-27T02:33:17.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.756+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:17.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-08-27T02:33:17.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:17.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-08-27T02:33:17.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:17.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-08-27T02:33:17.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:17.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-08-27T02:33:17.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.760+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:17.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.764+0000 7f34c1f4a9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-08-27T02:33:17.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.764+0000 7f34c1f4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:17.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.764+0000 7f34c1f4a9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-08-27T02:33:17.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.764+0000 7f34c1f4a9c0 1 NOTICE: finished all shards (0 entries found) 2024-08-27T02:33:17.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.764+0000 7f33767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:17.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.768+0000 7f34c1f4a9c0 20 remove_watcher() i=0 2024-08-27T02:33:17.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.768+0000 7f34c1f4a9c0 2 removed watcher, disabling cache 2024-08-27T02:33:17.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.772+0000 7f34c1f4a9c0 20 remove_watcher() i=1 2024-08-27T02:33:17.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.772+0000 7f34c1f4a9c0 20 remove_watcher() i=2 2024-08-27T02:33:17.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.776+0000 7f34c1f4a9c0 20 remove_watcher() i=3 2024-08-27T02:33:17.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.780+0000 7f34c1f4a9c0 20 remove_watcher() i=4 2024-08-27T02:33:17.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.780+0000 7f34c1f4a9c0 20 remove_watcher() i=5 2024-08-27T02:33:17.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.784+0000 7f34c1f4a9c0 20 remove_watcher() i=6 2024-08-27T02:33:17.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:17.784+0000 7f34c1f4a9c0 20 remove_watcher() i=7 2024-08-27T02:33:17.805 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-08-27T02:33:17.805 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:18.015 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-08-27T02:33:18.015 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:33:19.876 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-27T02:33:20.321 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-08-27T02:33:21.916 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:21.917 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-08-27T02:33:21.952 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:21.952 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:21.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:21.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:21.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 realm 2024-08-27T02:33:21.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:21.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:21.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:21.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:21.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:21.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.992+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:21.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.996+0000 7f599c8939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:21.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.996+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:21.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.996+0000 7f599c8939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:22.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:21.996+0000 7f599c8939c0 20 searching for the correct realm 2024-08-27T02:33:22.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.000+0000 7f5999b98640 0 -- 172.21.15.143:0/2782512320 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x555bd3b256f0 msgr2=0x555bd3b27ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:22.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.008+0000 7f599a399640 0 -- 172.21.15.143:0/2782512320 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f59900fbbd0 msgr2=0x7f5990120040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:22.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 zone default found 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 4 Realm: () 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 zonegroup default 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 started sync module instance, tier type = 2024-08-27T02:33:22.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.016+0000 7f599c8939c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:22.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=0 2024-08-27T02:33:22.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=1 2024-08-27T02:33:22.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=2 2024-08-27T02:33:22.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=3 2024-08-27T02:33:22.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=4 2024-08-27T02:33:22.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=5 2024-08-27T02:33:22.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=6 2024-08-27T02:33:22.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 20 add_watcher() i=7 2024-08-27T02:33:22.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.032+0000 7f599c8939c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:22.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f5850fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:22.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:22.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:22.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 5 note: GC not initialized 2024-08-27T02:33:22.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f57cb7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:22.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:22.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 20 Filter name: none 2024-08-27T02:33:22.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f57c97fa640 20 reqs_thread_entry: start 2024-08-27T02:33:22.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:22.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.036+0000 7f599c8939c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: starting shard=0 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: starting shard=1 2024-08-27T02:33:22.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:22.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: starting shard=2 2024-08-27T02:33:22.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:22.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: starting shard=3 2024-08-27T02:33:22.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:22.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: starting shard=4 2024-08-27T02:33:22.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:22.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 INFO: main: starting shard=5 2024-08-27T02:33:22.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.040+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:22.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: starting shard=6 2024-08-27T02:33:22.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:22.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: starting shard=7 2024-08-27T02:33:22.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:22.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: starting shard=8 2024-08-27T02:33:22.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:22.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-27T02:33:22.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 INFO: main: starting shard=9 2024-08-27T02:33:22.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.044+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:22.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.048+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.048+0000 7f599c8939c0 20 INFO: main: starting shard=10 2024-08-27T02:33:22.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.048+0000 7f599c8939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:22.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.048+0000 7f599c8939c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.048+0000 7f599c8939c0 20 INFO: main: done 2024-08-27T02:33:22.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.048+0000 7f5850fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:22.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.056+0000 7f599c8939c0 20 remove_watcher() i=0 2024-08-27T02:33:22.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.056+0000 7f599c8939c0 2 removed watcher, disabling cache 2024-08-27T02:33:22.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.056+0000 7f599c8939c0 20 remove_watcher() i=1 2024-08-27T02:33:22.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.060+0000 7f599c8939c0 20 remove_watcher() i=2 2024-08-27T02:33:22.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.060+0000 7f599c8939c0 20 remove_watcher() i=3 2024-08-27T02:33:22.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.064+0000 7f599c8939c0 20 remove_watcher() i=4 2024-08-27T02:33:22.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.064+0000 7f599c8939c0 20 remove_watcher() i=5 2024-08-27T02:33:22.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.064+0000 7f599c8939c0 20 remove_watcher() i=6 2024-08-27T02:33:22.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.068+0000 7f599c8939c0 20 remove_watcher() i=7 2024-08-27T02:33:22.264 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:22.264 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-08-27T02:33:22.299 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:22.299 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:22.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 realm 2024-08-27T02:33:22.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:22.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.336+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.340+0000 7fd661fb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:22.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.340+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.340+0000 7fd661fb99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:22.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.340+0000 7fd661fb99c0 20 searching for the correct realm 2024-08-27T02:33:22.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.348+0000 7fd65f2be640 0 -- 172.21.15.143:0/463669103 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fd6480f1550 msgr2=0x7fd6480fe470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:22.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.352+0000 7fd65f2be640 0 -- 172.21.15.143:0/463669103 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fd52807e680 msgr2=0x7fd528080ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:22.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:22.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:22.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 zone default found 2024-08-27T02:33:22.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 4 Realm: () 2024-08-27T02:33:22.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:22.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:22.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:22.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 zonegroup default 2024-08-27T02:33:22.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 started sync module instance, tier type = 2024-08-27T02:33:22.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.360+0000 7fd661fb99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:22.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=0 2024-08-27T02:33:22.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=1 2024-08-27T02:33:22.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=2 2024-08-27T02:33:22.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=3 2024-08-27T02:33:22.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=4 2024-08-27T02:33:22.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=5 2024-08-27T02:33:22.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=6 2024-08-27T02:33:22.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 20 add_watcher() i=7 2024-08-27T02:33:22.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.380+0000 7fd661fb99c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:22.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:22.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:22.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:22.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 5 note: GC not initialized 2024-08-27T02:33:22.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd514fe1640 20 reqs_thread_entry: start 2024-08-27T02:33:22.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:22.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 Filter name: none 2024-08-27T02:33:22.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd48e7fc640 20 reqs_thread_entry: start 2024-08-27T02:33:22.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:22.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:22.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:22.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:22.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 INFO: main: starting shard=0 2024-08-27T02:33:22.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.384+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:22.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: starting shard=1 2024-08-27T02:33:22.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:22.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: starting shard=2 2024-08-27T02:33:22.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:22.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: starting shard=3 2024-08-27T02:33:22.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:22.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: starting shard=4 2024-08-27T02:33:22.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:22.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 INFO: main: starting shard=5 2024-08-27T02:33:22.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.388+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:22.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.392+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-08-27T02:33:22.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.392+0000 7fd661fb99c0 20 INFO: main: starting shard=6 2024-08-27T02:33:22.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.392+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:22.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.392+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.392+0000 7fd661fb99c0 20 INFO: main: starting shard=7 2024-08-27T02:33:22.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.392+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: starting shard=8 2024-08-27T02:33:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: starting shard=9 2024-08-27T02:33:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:22.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: starting shard=10 2024-08-27T02:33:22.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:22.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:22.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd661fb99c0 20 INFO: main: done 2024-08-27T02:33:22.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.396+0000 7fd515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:22.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.404+0000 7fd661fb99c0 20 remove_watcher() i=0 2024-08-27T02:33:22.408 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.404+0000 7fd661fb99c0 2 removed watcher, disabling cache 2024-08-27T02:33:22.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.404+0000 7fd661fb99c0 20 remove_watcher() i=1 2024-08-27T02:33:22.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.408+0000 7fd661fb99c0 20 remove_watcher() i=2 2024-08-27T02:33:22.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.408+0000 7fd661fb99c0 20 remove_watcher() i=3 2024-08-27T02:33:22.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.412+0000 7fd661fb99c0 20 remove_watcher() i=4 2024-08-27T02:33:22.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.412+0000 7fd661fb99c0 20 remove_watcher() i=5 2024-08-27T02:33:22.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.416+0000 7fd661fb99c0 20 remove_watcher() i=6 2024-08-27T02:33:22.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.416+0000 7fd661fb99c0 20 remove_watcher() i=7 2024-08-27T02:33:22.640 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:22.640 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-08-27T02:33:22.676 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:22.676 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:22.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.716+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 realm 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:22.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:22.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:22.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:22.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.720+0000 7fef3e6e19c0 20 searching for the correct realm 2024-08-27T02:33:22.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.724+0000 7fef3c9e8640 0 -- 172.21.15.143:0/2595526392 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fef30131290 msgr2=0x7fef300fd310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:22.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:22.932+0000 7fef3c9e8640 0 -- 172.21.15.143:0/2595526392 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fef30131b90 msgr2=0x7fef300ff970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:23.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:23.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:23.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:23.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:23.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:23.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:23.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.164+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:23.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 zone default found 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 4 Realm: () 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 zonegroup default 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 started sync module instance, tier type = 2024-08-27T02:33:23.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.168+0000 7fef3e6e19c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:23.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.192+0000 7fef3e6e19c0 20 add_watcher() i=0 2024-08-27T02:33:23.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.192+0000 7fef3e6e19c0 20 add_watcher() i=1 2024-08-27T02:33:23.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.192+0000 7fef3e6e19c0 20 add_watcher() i=2 2024-08-27T02:33:23.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.192+0000 7fef3e6e19c0 20 add_watcher() i=3 2024-08-27T02:33:23.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.192+0000 7fef3e6e19c0 20 add_watcher() i=4 2024-08-27T02:33:23.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.192+0000 7fef3e6e19c0 20 add_watcher() i=5 2024-08-27T02:33:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.196+0000 7fef3e6e19c0 20 add_watcher() i=6 2024-08-27T02:33:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.196+0000 7fef3e6e19c0 20 add_watcher() i=7 2024-08-27T02:33:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.196+0000 7fef3e6e19c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:23.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.200+0000 7fedf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:23.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.200+0000 7fef3e6e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:23.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.200+0000 7fef3e6e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:23.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.200+0000 7fef3e6e19c0 5 note: GC not initialized 2024-08-27T02:33:23.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.200+0000 7fedf17e2640 20 reqs_thread_entry: start 2024-08-27T02:33:23.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.200+0000 7fef3e6e19c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:23.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 Filter name: none 2024-08-27T02:33:23.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fed62ffd640 20 reqs_thread_entry: start 2024-08-27T02:33:23.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:23.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 INFO: main: starting shard=0 2024-08-27T02:33:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 INFO: main: starting shard=1 2024-08-27T02:33:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.204+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:23.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:33:23.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: starting shard=2 2024-08-27T02:33:23.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:23.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: starting shard=3 2024-08-27T02:33:23.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:23.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: starting shard=4 2024-08-27T02:33:23.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:23.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 INFO: main: starting shard=5 2024-08-27T02:33:23.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.208+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:23.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: starting shard=6 2024-08-27T02:33:23.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:23.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: starting shard=7 2024-08-27T02:33:23.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:23.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: starting shard=8 2024-08-27T02:33:23.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: starting shard=9 2024-08-27T02:33:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:23.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: starting shard=10 2024-08-27T02:33:23.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:23.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fef3e6e19c0 20 INFO: main: done 2024-08-27T02:33:23.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.216+0000 7fedf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:23.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.224+0000 7fef3e6e19c0 20 remove_watcher() i=0 2024-08-27T02:33:23.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.224+0000 7fef3e6e19c0 2 removed watcher, disabling cache 2024-08-27T02:33:23.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.224+0000 7fef3e6e19c0 20 remove_watcher() i=1 2024-08-27T02:33:23.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.228+0000 7fef3e6e19c0 20 remove_watcher() i=2 2024-08-27T02:33:23.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.232+0000 7fef3e6e19c0 20 remove_watcher() i=3 2024-08-27T02:33:23.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.232+0000 7fef3e6e19c0 20 remove_watcher() i=4 2024-08-27T02:33:23.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.236+0000 7fef3e6e19c0 20 remove_watcher() i=5 2024-08-27T02:33:23.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.236+0000 7fef3e6e19c0 20 remove_watcher() i=6 2024-08-27T02:33:23.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.240+0000 7fef3e6e19c0 20 remove_watcher() i=7 2024-08-27T02:33:23.436 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:33:23.437 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-08-27T02:33:23.472 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:23.472 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:23.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.512+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.512+0000 7effcf54f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.512+0000 7effcf54f9c0 20 realm 2024-08-27T02:33:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.512+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:23.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.516+0000 7effcf54f9c0 20 searching for the correct realm 2024-08-27T02:33:23.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.524+0000 7effcd856640 0 -- 172.21.15.143:0/735288123 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55bdcff240d0 msgr2=0x55bdcff264c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:23.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.528+0000 7effcc854640 0 -- 172.21.15.143:0/735288123 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7effc00e1990 msgr2=0x7effc00df430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:23.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.536+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:23.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 zone default found 2024-08-27T02:33:23.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 4 Realm: () 2024-08-27T02:33:23.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:23.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:23.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:23.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 zonegroup default 2024-08-27T02:33:23.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:23.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 started sync module instance, tier type = 2024-08-27T02:33:23.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.540+0000 7effcf54f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:23.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=0 2024-08-27T02:33:23.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=1 2024-08-27T02:33:23.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=2 2024-08-27T02:33:23.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=3 2024-08-27T02:33:23.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=4 2024-08-27T02:33:23.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=5 2024-08-27T02:33:23.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=6 2024-08-27T02:33:23.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 20 add_watcher() i=7 2024-08-27T02:33:23.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.556+0000 7effcf54f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:23.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7efe837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7effcf54f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7effcf54f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7effcf54f9c0 5 note: GC not initialized 2024-08-27T02:33:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7efe827e4640 20 reqs_thread_entry: start 2024-08-27T02:33:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7effcf54f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7effcf54f9c0 20 Filter name: none 2024-08-27T02:33:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7efdf3fff640 20 reqs_thread_entry: start 2024-08-27T02:33:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.560+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T02:33:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: starting shard=0 2024-08-27T02:33:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: starting shard=1 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: starting shard=2 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 INFO: main: starting shard=3 2024-08-27T02:33:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.564+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: starting shard=4 2024-08-27T02:33:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: starting shard=5 2024-08-27T02:33:23.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:23.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: starting shard=6 2024-08-27T02:33:23.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:23.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 INFO: main: starting shard=7 2024-08-27T02:33:23.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.568+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:23.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: starting shard=8 2024-08-27T02:33:23.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:23.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: starting shard=9 2024-08-27T02:33:23.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:23.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:33:23.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: starting shard=10 2024-08-27T02:33:23.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:23.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:33:23.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7effcf54f9c0 20 INFO: main: done 2024-08-27T02:33:23.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.572+0000 7efe837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:23.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.580+0000 7effcf54f9c0 20 remove_watcher() i=0 2024-08-27T02:33:23.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.580+0000 7effcf54f9c0 2 removed watcher, disabling cache 2024-08-27T02:33:23.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.580+0000 7effcf54f9c0 20 remove_watcher() i=1 2024-08-27T02:33:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.584+0000 7effcf54f9c0 20 remove_watcher() i=2 2024-08-27T02:33:23.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.584+0000 7effcf54f9c0 20 remove_watcher() i=3 2024-08-27T02:33:23.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.588+0000 7effcf54f9c0 20 remove_watcher() i=4 2024-08-27T02:33:23.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.588+0000 7effcf54f9c0 20 remove_watcher() i=5 2024-08-27T02:33:23.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.592+0000 7effcf54f9c0 20 remove_watcher() i=6 2024-08-27T02:33:23.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:23.592+0000 7effcf54f9c0 20 remove_watcher() i=7 2024-08-27T02:33:23.640 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-27T02:33:24.072 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-08-27T02:33:24.501 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-08-27T02:33:24.532 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:24.532 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:24.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 realm 2024-08-27T02:33:24.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:24.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.572+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.576+0000 7f5ec9e309c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:24.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.576+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.576+0000 7f5ec9e309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:24.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.576+0000 7f5ec9e309c0 20 searching for the correct realm 2024-08-27T02:33:24.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.580+0000 7f5ec8137640 0 -- 172.21.15.143:0/2435882864 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f5eb806c940 msgr2=0x7f5eb808f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:33:24.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.796+0000 7f5ec7936640 0 -- 172.21.15.143:0/2435882864 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x562108b1dd20 msgr2=0x562108b201e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:24.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:24.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:24.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:24.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:24.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:24.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:24.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:24.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 zone default found 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 4 Realm: () 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 zonegroup default 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.804+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.808+0000 7f5ec9e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.808+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.808+0000 7f5ec9e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.808+0000 7f5ec9e309c0 20 started sync module instance, tier type = 2024-08-27T02:33:24.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.808+0000 7f5ec9e309c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:24.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.828+0000 7f5ec9e309c0 20 add_watcher() i=0 2024-08-27T02:33:24.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.828+0000 7f5ec9e309c0 20 add_watcher() i=1 2024-08-27T02:33:24.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.828+0000 7f5ec9e309c0 20 add_watcher() i=2 2024-08-27T02:33:24.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.828+0000 7f5ec9e309c0 20 add_watcher() i=3 2024-08-27T02:33:24.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.828+0000 7f5ec9e309c0 20 add_watcher() i=4 2024-08-27T02:33:24.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.828+0000 7f5ec9e309c0 20 add_watcher() i=5 2024-08-27T02:33:24.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.828+0000 7f5ec9e309c0 20 add_watcher() i=6 2024-08-27T02:33:24.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.832+0000 7f5ec9e309c0 20 add_watcher() i=7 2024-08-27T02:33:24.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.832+0000 7f5ec9e309c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:24.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5d7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:24.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:24.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:24.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 5 note: GC not initialized 2024-08-27T02:33:24.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5d7cfe1640 20 reqs_thread_entry: start 2024-08-27T02:33:24.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:24.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 20 Filter name: none 2024-08-27T02:33:24.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5cf67fc640 20 reqs_thread_entry: start 2024-08-27T02:33:24.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:24.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:24.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:24.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:24.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:24.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.836+0000 7f5ec9e309c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:24.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:24.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:24.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.840+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:24.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.844+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:24.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.844+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:24.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.844+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:24.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.844+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:24.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.848+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:24.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.848+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:24.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.848+0000 7f5ec9e309c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:24.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.856+0000 7f5d7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:24.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.864+0000 7f5ec9e309c0 20 remove_watcher() i=0 2024-08-27T02:33:24.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.864+0000 7f5ec9e309c0 2 removed watcher, disabling cache 2024-08-27T02:33:24.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.864+0000 7f5ec9e309c0 20 remove_watcher() i=1 2024-08-27T02:33:24.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.868+0000 7f5ec9e309c0 20 remove_watcher() i=2 2024-08-27T02:33:24.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.868+0000 7f5ec9e309c0 20 remove_watcher() i=3 2024-08-27T02:33:24.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.872+0000 7f5ec9e309c0 20 remove_watcher() i=4 2024-08-27T02:33:24.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.872+0000 7f5ec9e309c0 20 remove_watcher() i=5 2024-08-27T02:33:24.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.872+0000 7f5ec9e309c0 20 remove_watcher() i=6 2024-08-27T02:33:24.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.876+0000 7f5ec9e309c0 20 remove_watcher() i=7 2024-08-27T02:33:24.889 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-27T02:33:24.926 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:24.926 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:24.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 realm 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:24.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:24.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.968+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:24.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.972+0000 7f01177d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:24.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.972+0000 7f01177d59c0 20 searching for the correct realm 2024-08-27T02:33:24.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:24.976+0000 7f0115adc640 0 -- 172.21.15.143:0/1011952320 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f010805d040 msgr2=0x7f01080634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:25.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.192+0000 7f01152db640 0 -- 172.21.15.143:0/1011952320 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x562385c496d0 msgr2=0x562385c4bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:25.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:25.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:25.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:25.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:25.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:25.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:25.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:25.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 zone default found 2024-08-27T02:33:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 4 Realm: () 2024-08-27T02:33:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 zonegroup default 2024-08-27T02:33:25.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.200+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.204+0000 7f01177d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.204+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.204+0000 7f01177d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.204+0000 7f01177d59c0 20 started sync module instance, tier type = 2024-08-27T02:33:25.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.204+0000 7f01177d59c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:25.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=0 2024-08-27T02:33:25.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=1 2024-08-27T02:33:25.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=2 2024-08-27T02:33:25.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=3 2024-08-27T02:33:25.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=4 2024-08-27T02:33:25.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=5 2024-08-27T02:33:25.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=6 2024-08-27T02:33:25.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 20 add_watcher() i=7 2024-08-27T02:33:25.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.228+0000 7f01177d59c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:25.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.232+0000 7effcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:25.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.232+0000 7f01177d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:25.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.232+0000 7f01177d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:25.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 5 note: GC not initialized 2024-08-27T02:33:25.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7effca7e4640 20 reqs_thread_entry: start 2024-08-27T02:33:25.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:25.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 20 Filter name: none 2024-08-27T02:33:25.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7eff3bfff640 20 reqs_thread_entry: start 2024-08-27T02:33:25.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-08-27T02:33:25.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:25.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-08-27T02:33:25.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-08-27T02:33:25.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 : miss 2024-08-27T02:33:25.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:25.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 info.flags=0x17 2024-08-27T02:33:25.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 to cache LRU end 2024-08-27T02:33:25.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:33:25.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-08-27T02:33:25.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1 2024-08-27T02:33:25.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.236+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.0 2024-08-27T02:33:25.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-08-27T02:33:25.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:25.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.2 2024-08-27T02:33:25.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-08-27T02:33:25.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.3 2024-08-27T02:33:25.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-08-27T02:33:25.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.4 2024-08-27T02:33:25.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-08-27T02:33:25.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.240+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.244+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.6 2024-08-27T02:33:25.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.244+0000 7f01177d59c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-08-27T02:33:25.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.244+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.7 2024-08-27T02:33:25.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.244+0000 7f01177d59c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-08-27T02:33:25.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.244+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.244+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.9 2024-08-27T02:33:25.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.248+0000 7f01177d59c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-08-27T02:33:25.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.248+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:25.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.248+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:25.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.248+0000 7f01177d59c0 20 get_obj_state: octx=0x5623859d6d70 obj=check-bucket:e state=0x562385c7fd48 s->prefetch_data=0 2024-08-27T02:33:25.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.248+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.248+0000 7f01177d59c0 20 get_obj_state: octx=0x5623859e87d0 obj=check-bucket:d state=0x562385c84818 s->prefetch_data=0 2024-08-27T02:33:25.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.248+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state: octx=0x562385c856a0 obj=check-bucket:c state=0x562385c7b318 s->prefetch_data=0 2024-08-27T02:33:25.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:25.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state: octx=0x562385c81d90 obj=check-bucket:f state=0x562385c7ef78 s->prefetch_data=0 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to dudojdglr3ccti4wp37k8mpad64mzri9 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state_impl: setting s->olh_tag to 1mj9f2itszb5gp9a13j6693ycweh20q5 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1mj9f2itszb5gp9a13j6693ycweh20q5 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to k4ceuhwje1nmiad2uqdjzof2m0t05ahi 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state_impl: setting s->olh_tag to y0e0r9tvmkofhfgyty3lft3oygmgn83f 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y0e0r9tvmkofhfgyty3lft3oygmgn83f 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to 2silehcki7wm1cuxafg65x92jx0vjaya 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state_impl: setting s->olh_tag to q3xtw1zcvjrbh8u2ki9t4i2166uv36f8 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=q3xtw1zcvjrbh8u2ki9t4i2166uv36f8 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to 6a032a3x52uy41efjsp25rz8jinw37le 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 get_obj_state_impl: setting s->olh_tag to 8es5a6wuoxiwpy5j0xd7nfhr9k31gmay 2024-08-27T02:33:25.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.252+0000 7f01177d59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8es5a6wuoxiwpy5j0xd7nfhr9k31gmay 2024-08-27T02:33:25.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.256+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:25.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.256+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.256+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:25.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.256+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:25.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:25.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-08-27T02:33:25.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 olh_log_entry: epoch=2 op=3 key=f[dRSasv4BWmuOXtmt5DYT--pZzENqrzs] 2024-08-27T02:33:25.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 get_obj_state: octx=0x562385c81d90 obj=check-bucket:_:dRSasv4BWmuOXtmt5DYT--pZzENqrzs_f state=0x562385d0d628 s->prefetch_data=0 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 olh_log_entry: epoch=2 op=3 key=e[MIiAyOgrCVGvyckyrXd2F1soYFIZNpu] 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 get_obj_state: octx=0x5623859d6d70 obj=check-bucket:_:MIiAyOgrCVGvyckyrXd2F1soYFIZNpu_e state=0x562385d26bf8 s->prefetch_data=0 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.260+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 olh_log_entry: epoch=3 op=3 key=c[fVBXbpVi.nVM9G9NiLcukUX8TeayybI] 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: octx=0x562385c856a0 obj=check-bucket:_:fVBXbpVi.nVM9G9NiLcukUX8TeayybI_c state=0x562385d2e1a8 s->prefetch_data=0 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 10 manifest: total_size = 11 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1927036793882782174 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: octx=0x562385c856a0 obj=check-bucket:_:fVBXbpVi.nVM9G9NiLcukUX8TeayybI_c state=0x562385d2e1a8 s->prefetch_data=0 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 prepare_atomic_modification: state is not atomic. state=0x562385d2e1a8 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 10 manifest: total_size = 9 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11563414326868584464 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: octx=0x5623859d6d70 obj=check-bucket:_:MIiAyOgrCVGvyckyrXd2F1soYFIZNpu_e state=0x562385d26bf8 s->prefetch_data=0 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 prepare_atomic_modification: state is not atomic. state=0x562385d26bf8 2024-08-27T02:33:25.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 10 manifest: total_size = 9 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4028559300967777482 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: octx=0x562385c81d90 obj=check-bucket:_:dRSasv4BWmuOXtmt5DYT--pZzENqrzs_f state=0x562385d0d628 s->prefetch_data=0 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 prepare_atomic_modification: state is not atomic. state=0x562385d0d628 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 olh_log_entry: epoch=3 op=3 key=d[p0U8z4OuYcVPZO5CA.8KS3o1YAZvKrr] 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: octx=0x5623859e87d0 obj=check-bucket:_:p0U8z4OuYcVPZO5CA.8KS3o1YAZvKrr_d state=0x562385d41f58 s->prefetch_data=0 2024-08-27T02:33:25.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 10 manifest: total_size = 22 2024-08-27T02:33:25.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16580747630841798687 2024-08-27T02:33:25.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 get_obj_state: octx=0x5623859e87d0 obj=check-bucket:_:p0U8z4OuYcVPZO5CA.8KS3o1YAZvKrr_d state=0x562385d41f58 s->prefetch_data=0 2024-08-27T02:33:25.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 prepare_atomic_modification: state is not atomic. state=0x562385d41f58 2024-08-27T02:33:25.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.264+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.268+0000 7f01177d59c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.268+0000 7f01177d59c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.268+0000 7f01177d59c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.268+0000 7f01177d59c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:fVBXbpVi.nVM9G9NiLcukUX8TeayybI_.hcU4zhv1BWhY8bR_9iQOmssFnm9HhEp_0 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.272+0000 7f01177d59c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.272+0000 7f01177d59c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.272+0000 7f01177d59c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:25.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.272+0000 7f01177d59c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:MIiAyOgrCVGvyckyrXd2F1soYFIZNpu_.sA0RXzG2wBB1VqIvY6wwTd-rIKRLXbx_0 2024-08-27T02:33:25.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.276+0000 7efff8ff9640 20 handle_completion(): completion ok for obj=e[MIiAyOgrCVGvyckyrXd2F1soYFIZNpu] 2024-08-27T02:33:25.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.276+0000 7f01177d59c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:25.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.276+0000 7f01177d59c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-08-27T02:33:25.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.276+0000 7f01177d59c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:25.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.276+0000 7f01177d59c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:dRSasv4BWmuOXtmt5DYT--pZzENqrzs_.X1Yw0c0wzpekmglf9Df7YvvCKfMwn3Z_0 2024-08-27T02:33:25.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.276+0000 7f01177d59c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:25.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7efff8ff9640 20 handle_completion(): completion ok for obj=f[dRSasv4BWmuOXtmt5DYT--pZzENqrzs] 2024-08-27T02:33:25.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7effe7fff640 20 handle_completion(): completion ok for obj=c[fVBXbpVi.nVM9G9NiLcukUX8TeayybI] 2024-08-27T02:33:25.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7f01177d59c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:25.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7f01177d59c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:33:25.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7f01177d59c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-08-27T02:33:25.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7f01177d59c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:33:25.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7f01177d59c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1__shadow:p0U8z4OuYcVPZO5CA.8KS3o1YAZvKrr_.0_tRJCsT3UQxYQ-oIcO9gSbLiIOWqz__0 2024-08-27T02:33:25.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.280+0000 7f01177d59c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:25.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.284+0000 7effe7fff640 20 handle_completion(): completion ok for obj=d[p0U8z4OuYcVPZO5CA.8KS3o1YAZvKrr] 2024-08-27T02:33:25.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.284+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.284+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.284+0000 7f01177d59c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:33:25.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.284+0000 7f01177d59c0 20 get_obj_state: octx=0x5623859d6d70 obj=check-bucket:e state=0x562385c7fd48 s->prefetch_data=0 2024-08-27T02:33:25.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.284+0000 7f01177d59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1mj9f2itszb5gp9a13j6693ycweh20q5 2024-08-27T02:33:25.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.288+0000 7f01177d59c0 20 get_obj_state: octx=0x562385c81d90 obj=check-bucket:f state=0x562385c7ef78 s->prefetch_data=0 2024-08-27T02:33:25.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.288+0000 7f01177d59c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8es5a6wuoxiwpy5j0xd7nfhr9k31gmay 2024-08-27T02:33:25.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.288+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.8 2024-08-27T02:33:25.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.288+0000 7f01177d59c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-08-27T02:33:25.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.296+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.296+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.304+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.5 2024-08-27T02:33:25.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.304+0000 7f01177d59c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-08-27T02:33:25.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.304+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:25.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.304+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:25.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.308+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.10 2024-08-27T02:33:25.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.308+0000 7f01177d59c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-08-27T02:33:25.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.308+0000 7f01177d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1.1 2024-08-27T02:33:25.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.308+0000 7f01177d59c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-08-27T02:33:25.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.308+0000 7f01177d59c0 1 NOTICE: finished all shards (4 entries removed) 2024-08-27T02:33:25.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.308+0000 7effcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:25.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.316+0000 7f01177d59c0 20 remove_watcher() i=0 2024-08-27T02:33:25.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.316+0000 7f01177d59c0 2 removed watcher, disabling cache 2024-08-27T02:33:25.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.316+0000 7f01177d59c0 20 remove_watcher() i=1 2024-08-27T02:33:25.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.320+0000 7f01177d59c0 20 remove_watcher() i=2 2024-08-27T02:33:25.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.324+0000 7f01177d59c0 20 remove_watcher() i=3 2024-08-27T02:33:25.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.324+0000 7f01177d59c0 20 remove_watcher() i=4 2024-08-27T02:33:25.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.324+0000 7f01177d59c0 20 remove_watcher() i=5 2024-08-27T02:33:25.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.328+0000 7f01177d59c0 20 remove_watcher() i=6 2024-08-27T02:33:25.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.328+0000 7f01177d59c0 20 remove_watcher() i=7 2024-08-27T02:33:25.883 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-08-27T02:33:25.914 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:33:25.914 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:33:25.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.956+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 realm 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:25.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:33:25.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.960+0000 7fdb3c8809c0 20 searching for the correct realm 2024-08-27T02:33:25.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.968+0000 7fdb39b85640 0 -- 172.21.15.143:0/533353097 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fdb2c089ba0 msgr2=0x7fdb2c077210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:25.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.976+0000 7fdb3ab87640 0 -- 172.21.15.143:0/533353097 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fdb3010ba40 msgr2=0x7fdb3011c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:33:25.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:33:25.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:33:25.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:33:25.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:33:25.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:33:25.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:33:25.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 zone default found 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 4 Realm: () 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 zonegroup default 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.980+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.984+0000 7fdb3c8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.984+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:25.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.984+0000 7fdb3c8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:33:25.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.984+0000 7fdb3c8809c0 20 started sync module instance, tier type = 2024-08-27T02:33:25.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:25.984+0000 7fdb3c8809c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:33:26.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=0 2024-08-27T02:33:26.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=1 2024-08-27T02:33:26.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=2 2024-08-27T02:33:26.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=3 2024-08-27T02:33:26.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=4 2024-08-27T02:33:26.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=5 2024-08-27T02:33:26.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=6 2024-08-27T02:33:26.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 20 add_watcher() i=7 2024-08-27T02:33:26.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.000+0000 7fdb3c8809c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:33:26.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fd9f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 5 note: GC not initialized 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fd96b7fe640 20 reqs_thread_entry: start 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 20 init_complete bucket index max shards: 11 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 20 Filter name: none 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fd9697fa640 20 reqs_thread_entry: start 2024-08-27T02:33:26.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:26.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:26.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.004+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:26.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:26.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fdb3c8809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:26.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:26.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=190 2024-08-27T02:33:26.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fdb3c8809c0 20 rados->read ofs=0 len=0 2024-08-27T02:33:26.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fdb3c8809c0 20 rados_obj.operate() r=0 bl.length=412 2024-08-27T02:33:26.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fdb3c8809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:33:26.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.008+0000 7fd9f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:33:26.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.016+0000 7fdb3c8809c0 20 remove_watcher() i=0 2024-08-27T02:33:26.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.016+0000 7fdb3c8809c0 2 removed watcher, disabling cache 2024-08-27T02:33:26.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.016+0000 7fdb3c8809c0 20 remove_watcher() i=1 2024-08-27T02:33:26.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.020+0000 7fdb3c8809c0 20 remove_watcher() i=2 2024-08-27T02:33:26.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.020+0000 7fdb3c8809c0 20 remove_watcher() i=3 2024-08-27T02:33:26.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.024+0000 7fdb3c8809c0 20 remove_watcher() i=4 2024-08-27T02:33:26.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.024+0000 7fdb3c8809c0 20 remove_watcher() i=5 2024-08-27T02:33:26.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.024+0000 7fdb3c8809c0 20 remove_watcher() i=6 2024-08-27T02:33:26.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:33:26.028+0000 7fdb3c8809c0 20 remove_watcher() i=7 2024-08-27T02:33:26.041 INFO:tasks.workunit.client.0.smithi143.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-08-27T02:33:26.041 INFO:tasks.workunit.client.0.smithi143.stderr:Deleting bucket check-bucket 2024-08-27T02:33:26.578 INFO:tasks.workunit.client.0.smithi143.stderr:Completed bucket check tests 2024-08-27T02:33:26.578 INFO:tasks.workunit.client.0.smithi143.stdout:connected to http://localhost:80 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ deactivate 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ export PATH 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset _OLD_VIRTUAL_PATH 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n '' ']' 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T02:33:26.677 INFO:tasks.workunit.client.0.smithi143.stderr:+ hash -r 2024-08-27T02:33:26.678 INFO:tasks.workunit.client.0.smithi143.stdout:OK. 2024-08-27T02:33:26.678 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n '' ']' 2024-08-27T02:33:26.679 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset VIRTUAL_ENV 2024-08-27T02:33:26.679 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-08-27T02:33:26.679 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' '!' '' = nondestructive ']' 2024-08-27T02:33:26.679 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset -f deactivate 2024-08-27T02:33:26.679 INFO:tasks.workunit.client.0.smithi143.stderr:+ echo OK. 2024-08-27T02:33:26.679 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:33:26.679 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:33:26.739 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-08-27T02:33:26.742 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-27T02:33:27.406 DEBUG:teuthology.parallel:result is None 2024-08-27T02:33:27.407 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:33:27.419 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:33:27.419 DEBUG:teuthology.orchestra.run.smithi143:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:33:27.498 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:33:27.498 INFO:teuthology.run_tasks:Running task workunit... 2024-08-27T02:33:27.509 INFO:tasks.workunit:Pulling workunits from ref d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:33:27.510 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-27T02:33:27.510 DEBUG:teuthology.orchestra.run.smithi143:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:33:27.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:33:27.544 INFO:teuthology.orchestra.run.smithi143.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-27T02:33:27.545 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:33:27.592 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-27T02:33:27.592 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-27T02:33:27.644 INFO:tasks.workunit:timeout=3h 2024-08-27T02:33:27.644 INFO:tasks.workunit:cleanup=True 2024-08-27T02:33:27.645 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:33:27.694 INFO:tasks.workunit.client.0.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-27T02:34:24.350 INFO:tasks.workunit.client.0.smithi143.stderr:Note: switching to 'd17b22856a85d7d49d47be692c778d4419f41641'. 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr:state without impacting any branches by switching back to a branch. 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr: git switch -c 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr:Or undo this operation with: 2024-08-27T02:34:24.351 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:34:24.352 INFO:tasks.workunit.client.0.smithi143.stderr: git switch - 2024-08-27T02:34:24.352 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:34:24.352 INFO:tasks.workunit.client.0.smithi143.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-27T02:34:24.352 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:34:24.352 INFO:tasks.workunit.client.0.smithi143.stderr:HEAD is now at d17b22856a8 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-08-27T02:34:24.357 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-27T02:34:24.405 INFO:tasks.workunit.client.0.smithi143.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-27T02:34:24.408 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:34:24.408 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-27T02:34:24.466 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-27T02:34:24.523 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-27T02:34:24.572 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:34:24.573 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:34:24.573 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-27T02:34:24.617 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:34:24.620 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:34:24.620 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-27T02:34:24.668 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-08-27T02:34:24.669 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-08-27T02:34:24.669 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-08-27T02:34:24.734 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:34:24.734 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 11 tests from 1 test suite. 2024-08-27T02:34:24.734 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:34:24.734 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 11 tests from ClsLock 2024-08-27T02:34:24.735 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-08-27T02:34:25.897 INFO:tasks.workunit.client.0.smithi143.stdout:lock: mylock 2024-08-27T02:34:25.898 INFO:tasks.workunit.client.0.smithi143.stdout: lock_type: exclusive 2024-08-27T02:34:25.898 INFO:tasks.workunit.client.0.smithi143.stdout: tag: 2024-08-27T02:34:25.898 INFO:tasks.workunit.client.0.smithi143.stdout: lockers: 2024-08-27T02:34:25.898 INFO:tasks.workunit.client.0.smithi143.stdout: client.5039 expiration=2024-08-27T02:36:25.888207+0000 addr=v1:172.21.15.143:0/2618254987 cookie= 2024-08-27T02:34:25.906 INFO:tasks.workunit.client.0.smithi143.stdout:lock: mylock 2024-08-27T02:34:25.906 INFO:tasks.workunit.client.0.smithi143.stdout: lock_type: shared 2024-08-27T02:34:25.906 INFO:tasks.workunit.client.0.smithi143.stdout: tag: 2024-08-27T02:34:25.907 INFO:tasks.workunit.client.0.smithi143.stdout: lockers: 2024-08-27T02:34:25.907 INFO:tasks.workunit.client.0.smithi143.stdout: client.5039 expiration=2024-08-27T02:36:25.903622+0000 addr=v1:172.21.15.143:0/2618254987 cookie= 2024-08-27T02:34:25.907 INFO:tasks.workunit.client.0.smithi143.stdout: client.5045 expiration=0.000000 addr=v1:172.21.15.143:0/247103227 cookie= 2024-08-27T02:34:25.909 INFO:tasks.workunit.client.0.smithi143.stdout:lock: mylock 2024-08-27T02:34:25.909 INFO:tasks.workunit.client.0.smithi143.stdout: lock_type: shared 2024-08-27T02:34:25.909 INFO:tasks.workunit.client.0.smithi143.stdout: tag: 2024-08-27T02:34:25.909 INFO:tasks.workunit.client.0.smithi143.stdout: lockers: 2024-08-27T02:34:25.909 INFO:tasks.workunit.client.0.smithi143.stdout: client.5045 expiration=0.000000 addr=v1:172.21.15.143:0/247103227 cookie= 2024-08-27T02:34:26.834 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestMultiLocking (2100 ms) 2024-08-27T02:34:26.834 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestMeta 2024-08-27T02:34:29.150 INFO:tasks.workunit.client.0.smithi143.stdout:lock: mylock 2024-08-27T02:34:29.150 INFO:tasks.workunit.client.0.smithi143.stdout: lock_type: shared 2024-08-27T02:34:29.150 INFO:tasks.workunit.client.0.smithi143.stdout: tag: 2024-08-27T02:34:29.150 INFO:tasks.workunit.client.0.smithi143.stdout: lockers: 2024-08-27T02:34:29.151 INFO:tasks.workunit.client.0.smithi143.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.143:0/3322257773 cookie= 2024-08-27T02:34:29.157 INFO:tasks.workunit.client.0.smithi143.stdout:lock: mylock 2024-08-27T02:34:29.157 INFO:tasks.workunit.client.0.smithi143.stdout: lock_type: exclusive 2024-08-27T02:34:29.157 INFO:tasks.workunit.client.0.smithi143.stdout: tag: new_tag 2024-08-27T02:34:29.157 INFO:tasks.workunit.client.0.smithi143.stdout: lockers: 2024-08-27T02:34:29.157 INFO:tasks.workunit.client.0.smithi143.stdout: client.5190 expiration=0.000000 addr=v1:172.21.15.143:0/3716213832 cookie= 2024-08-27T02:34:29.884 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestMeta (3050 ms) 2024-08-27T02:34:29.885 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestCookie 2024-08-27T02:34:31.958 INFO:tasks.workunit.client.0.smithi143.stdout:lock: mylock 2024-08-27T02:34:31.958 INFO:tasks.workunit.client.0.smithi143.stdout: lock_type: exclusive 2024-08-27T02:34:31.958 INFO:tasks.workunit.client.0.smithi143.stdout: tag: 2024-08-27T02:34:31.958 INFO:tasks.workunit.client.0.smithi143.stdout: lockers: 2024-08-27T02:34:31.962 INFO:tasks.workunit.client.0.smithi143.stdout:lock: mylock 2024-08-27T02:34:31.962 INFO:tasks.workunit.client.0.smithi143.stdout: lock_type: shared 2024-08-27T02:34:31.962 INFO:tasks.workunit.client.0.smithi143.stdout: tag: 2024-08-27T02:34:31.962 INFO:tasks.workunit.client.0.smithi143.stdout: lockers: 2024-08-27T02:34:31.962 INFO:tasks.workunit.client.0.smithi143.stdout: client.5205 expiration=0.000000 addr=v1:172.21.15.143:0/2876989085 cookie= 2024-08-27T02:34:31.962 INFO:tasks.workunit.client.0.smithi143.stdout: client.5205 expiration=0.000000 addr=v1:172.21.15.143:0/2876989085 cookie=new cookie 2024-08-27T02:34:32.946 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestCookie (3062 ms) 2024-08-27T02:34:32.947 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-08-27T02:34:35.950 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestMultipleLocks (3004 ms) 2024-08-27T02:34:35.951 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestLockDuration 2024-08-27T02:34:43.115 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestLockDuration (7163 ms) 2024-08-27T02:34:43.115 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-08-27T02:34:46.120 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestAssertLocked (3006 ms) 2024-08-27T02:34:46.120 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestSetCookie 2024-08-27T02:34:49.203 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestSetCookie (3084 ms) 2024-08-27T02:34:49.203 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestRenew 2024-08-27T02:35:09.867 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestRenew (20664 ms) 2024-08-27T02:35:09.868 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-08-27T02:35:15.979 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6112 ms) 2024-08-27T02:35:15.982 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-08-27T02:35:23.074 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7095 ms) 2024-08-27T02:35:23.074 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-08-27T02:35:31.108 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8034 ms) 2024-08-27T02:35:31.108 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 11 tests from ClsLock (66374 ms total) 2024-08-27T02:35:31.108 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:35:31.108 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:35:31.108 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 11 tests from 1 test suite ran. (66374 ms total) 2024-08-27T02:35:31.109 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 11 tests. 2024-08-27T02:35:31.114 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:35:31.114 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:35:31.168 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-08-27T02:35:31.169 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-08-27T02:35:31.170 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-08-27T02:35:31.233 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:35:31.233 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 4 tests from 1 test suite. 2024-08-27T02:35:31.234 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:35:31.234 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 4 tests from cls_log 2024-08-27T02:35:31.234 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-08-27T02:35:34.154 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_log.test_log_add_same_time (2921 ms) 2024-08-27T02:35:34.154 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-08-27T02:35:37.190 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_log.test_log_add_different_time (3036 ms) 2024-08-27T02:35:37.190 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_log.trim_by_time 2024-08-27T02:35:40.231 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_log.trim_by_time (3037 ms) 2024-08-27T02:35:40.231 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_log.trim_by_marker 2024-08-27T02:35:43.234 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_log.trim_by_marker (3007 ms) 2024-08-27T02:35:43.234 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 4 tests from cls_log (12001 ms total) 2024-08-27T02:35:43.234 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:35:43.234 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:35:43.234 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 4 tests from 1 test suite ran. (12001 ms total) 2024-08-27T02:35:43.235 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 4 tests. 2024-08-27T02:35:43.239 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:35:43.239 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:35:43.296 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-08-27T02:35:43.297 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-08-27T02:35:43.297 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-08-27T02:35:43.362 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:35:43.362 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 10 tests from 1 test suite. 2024-08-27T02:35:43.363 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:35:43.363 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 10 tests from cls_refcount 2024-08-27T02:35:43.363 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_implicit 2024-08-27T02:35:46.315 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_implicit (2953 ms) 2024-08-27T02:35:46.315 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-08-27T02:35:49.383 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3062 ms) 2024-08-27T02:35:49.383 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_put_snap 2024-08-27T02:35:58.426 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_put_snap (9049 ms) 2024-08-27T02:35:58.426 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_explicit 2024-08-27T02:36:01.462 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_explicit (3033 ms) 2024-08-27T02:36:01.462 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.set 2024-08-27T02:36:04.523 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.set (3061 ms) 2024-08-27T02:36:04.523 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-08-27T02:36:11.573 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_implicit_ec (7053 ms) 2024-08-27T02:36:11.573 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-08-27T02:36:18.615 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7042 ms) 2024-08-27T02:36:18.615 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-08-27T02:36:31.738 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_put_snap_ec (13124 ms) 2024-08-27T02:36:31.738 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-08-27T02:36:38.811 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.test_explicit_ec (7072 ms) 2024-08-27T02:36:38.811 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_refcount.set_ec 2024-08-27T02:36:45.890 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_refcount.set_ec (7080 ms) 2024-08-27T02:36:45.890 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 10 tests from cls_refcount (62529 ms total) 2024-08-27T02:36:45.890 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:36:45.891 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:36:45.891 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 10 tests from 1 test suite ran. (62529 ms total) 2024-08-27T02:36:45.891 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 10 tests. 2024-08-27T02:36:45.894 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:36:45.895 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:36:45.955 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-08-27T02:36:45.956 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-08-27T02:36:45.956 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-08-27T02:36:46.025 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:36:46.026 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 18 tests from 1 test suite. 2024-08-27T02:36:46.026 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:36:46.026 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 18 tests from cls_rgw 2024-08-27T02:36:47.893 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_basic 2024-08-27T02:36:47.976 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_basic (83 ms) 2024-08-27T02:36:47.976 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-08-27T02:36:48.062 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (86 ms) 2024-08-27T02:36:48.062 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_remove_object 2024-08-27T02:36:48.181 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_remove_object (119 ms) 2024-08-27T02:36:48.181 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_suggest 2024-08-27T02:36:50.713 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_suggest (2532 ms) 2024-08-27T02:36:50.713 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-08-27T02:36:50.727 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-08-27T02:36:50.727 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_list 2024-08-27T02:36:50.780 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_list (53 ms) 2024-08-27T02:36:50.780 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-08-27T02:37:36.096 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_list_delimited (45316 ms) 2024-08-27T02:37:36.096 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.bi_list 2024-08-27T02:37:36.241 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.bi_list (146 ms) 2024-08-27T02:37:36.241 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.gc_set 2024-08-27T02:37:36.261 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.gc_set (20 ms) 2024-08-27T02:37:36.262 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.gc_list 2024-08-27T02:37:36.282 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.gc_list (21 ms) 2024-08-27T02:37:36.282 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.gc_defer 2024-08-27T02:37:43.173 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.gc_defer (6889 ms) 2024-08-27T02:37:43.173 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.usage_basic 2024-08-27T02:37:43.427 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.usage_basic (255 ms) 2024-08-27T02:37:43.427 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-08-27T02:37:43.430 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-08-27T02:37:43.430 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.usage_clear 2024-08-27T02:37:43.716 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.usage_clear (286 ms) 2024-08-27T02:37:43.716 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-08-27T02:37:43.831 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.bi_log_trim (115 ms) 2024-08-27T02:37:43.831 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-08-27T02:37:43.877 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.index_racing_removes (46 ms) 2024-08-27T02:37:43.877 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-08-27T02:37:43.912 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.reshardlog_list (35 ms) 2024-08-27T02:37:43.912 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-08-27T02:37:43.940 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw.reshardlog_num (28 ms) 2024-08-27T02:37:44.205 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 18 tests from cls_rgw (56048 ms total) 2024-08-27T02:37:44.205 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:37:44.205 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:37:44.205 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 18 tests from 1 test suite ran. (58180 ms total) 2024-08-27T02:37:44.206 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 18 tests. 2024-08-27T02:37:44.212 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:37:44.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:37:44.266 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-08-27T02:37:44.267 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-08-27T02:37:44.267 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-08-27T02:37:44.332 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:37:44.332 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 9 tests from 1 test suite. 2024-08-27T02:37:44.332 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:37:44.332 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 9 tests from cls_rgw_gc 2024-08-27T02:37:44.332 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.init 2024-08-27T02:37:46.218 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.init (1886 ms) 2024-08-27T02:37:46.218 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-08-27T02:37:46.241 INFO:tasks.workunit.client.0.smithi143.stderr:[ ] list info tag = chain-0 2024-08-27T02:37:46.241 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (23 ms) 2024-08-27T02:37:46.241 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-08-27T02:37:46.252 INFO:tasks.workunit.client.0.smithi143.stderr:[ ] next_marker is: = 0/4263 2024-08-27T02:37:46.252 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (11 ms) 2024-08-27T02:37:46.252 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-08-27T02:37:46.267 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (15 ms) 2024-08-27T02:37:46.267 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-08-27T02:37:46.323 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (56 ms) 2024-08-27T02:37:46.323 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-08-27T02:37:46.349 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (26 ms) 2024-08-27T02:37:46.349 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-08-27T02:37:46.367 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-08-27T02:37:46.367 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-08-27T02:37:46.387 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (20 ms) 2024-08-27T02:37:46.387 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_gc.finalize 2024-08-27T02:37:47.235 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_gc.finalize (848 ms) 2024-08-27T02:37:47.235 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 9 tests from cls_rgw_gc (2903 ms total) 2024-08-27T02:37:47.235 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:37:47.236 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:37:47.236 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 9 tests from 1 test suite ran. (2903 ms total) 2024-08-27T02:37:47.236 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 9 tests. 2024-08-27T02:37:47.245 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:37:47.245 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:37:47.310 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-08-27T02:37:47.311 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-08-27T02:37:47.311 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-08-27T02:37:47.387 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:37:47.387 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:37:47.388 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 1 test from 1 test suite. 2024-08-27T02:37:47.388 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:37:49.256 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 1 test from cls_rgw_stats 2024-08-27T02:37:49.256 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] cls_rgw_stats.simulate 2024-08-27T02:37:49.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.295+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=PTKT7BB6ILA0 type=del size=1589625 2024-08-27T02:37:49.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~2VLTUOXIGCE0.0 size=597895 2024-08-27T02:37:49.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.299+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=2VLTUOXIGCE0 tag=VBSCG4UL6CH5 type=write size=1646471 2024-08-27T02:37:49.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.303+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=B2QLBFOWOYW3 type=del size=3691164 2024-08-27T02:37:49.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~D0ACM8TEW047.0 size=1048576 2024-08-27T02:37:49.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.311+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~D0ACM8TEW047.1 size=545229 2024-08-27T02:37:49.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.311+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=D0ACM8TEW047 tag=HFPMZGU1X4WM type=write size=2642381 2024-08-27T02:37:49.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.311+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=2UM2R9B5EYG9 type=del size=3749084 2024-08-27T02:37:49.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~1UA6Q20TDVJE.0 size=63252 2024-08-27T02:37:49.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.315+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=1UA6Q20TDVJE tag=IO4V5X8GWYDM type=write size=1111828 2024-08-27T02:37:49.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.319+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=7IS1FTIMFKXU type=write size=558252 2024-08-27T02:37:49.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~OGXZXVK2UQGP.0 size=27447 2024-08-27T02:37:49.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.323+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=OGXZXVK2UQGP tag=E71K9EM6M4HS type=write size=1076023 2024-08-27T02:37:49.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.323+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=XO4H83X35221 type=del size=3924073 2024-08-27T02:37:49.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.327+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=10F1DPCF94EL type=del size=943954 2024-08-27T02:37:49.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.331+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=I742WLXYFV70 type=del size=3028758 2024-08-27T02:37:49.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~IZ40UWYCM6ZM.0 size=1048576 2024-08-27T02:37:49.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~IZ40UWYCM6ZM.1 size=23463 2024-08-27T02:37:49.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.335+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=IZ40UWYCM6ZM tag=QH8E92O9Q580 type=write size=2120615 2024-08-27T02:37:49.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.339+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=WS2EZQ5YRUCY type=del size=2132614 2024-08-27T02:37:49.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.339+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=TZXU3EJ1SF7J type=write size=763848 2024-08-27T02:37:49.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.343+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=UT3KBF1ROK0K type=del size=1762293 2024-08-27T02:37:49.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.347+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~ZY81O6AZPNEB.0 size=1048576 2024-08-27T02:37:49.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.347+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~ZY81O6AZPNEB.1 size=1048576 2024-08-27T02:37:49.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.351+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~ZY81O6AZPNEB.2 size=454816 2024-08-27T02:37:49.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.351+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=ZY81O6AZPNEB tag=DWRDWP4LIQMH type=write size=3600544 2024-08-27T02:37:49.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.355+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=PTKT7BB6ILA0 type=del 2024-08-27T02:37:49.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.359+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~RNHMQ684SK3L.0 size=627554 2024-08-27T02:37:49.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.359+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=RNHMQ684SK3L tag=0XN62TT919JI type=write size=1676130 2024-08-27T02:37:49.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.359+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~2VLTUOXIGCE0.0 size=597895 2024-08-27T02:37:49.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.363+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=2VLTUOXIGCE0 tag=VBSCG4UL6CH5 type=write size=1646471 2024-08-27T02:37:49.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.371+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~PTGJTSO4QXOT.0 size=1048576 2024-08-27T02:37:49.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.371+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~PTGJTSO4QXOT.1 size=1048576 2024-08-27T02:37:49.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.375+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~PTGJTSO4QXOT.2 size=203537 2024-08-27T02:37:49.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.375+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=PTGJTSO4QXOT tag=B33IX245M7M0 type=write size=3349265 2024-08-27T02:37:49.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.379+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=B2QLBFOWOYW3 type=del 2024-08-27T02:37:49.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.379+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=KLFS18RX5HA8 type=del size=683047 2024-08-27T02:37:49.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~D0ACM8TEW047.0 size=1048576 2024-08-27T02:37:49.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~D0ACM8TEW047.1 size=545229 2024-08-27T02:37:49.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.391+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=D0ACM8TEW047 tag=HFPMZGU1X4WM type=write size=2642381 2024-08-27T02:37:49.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.391+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=935RF1QRREY7 type=del size=1537735 2024-08-27T02:37:49.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.395+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=2UM2R9B5EYG9 type=del 2024-08-27T02:37:49.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.399+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=0J5X6B0PK3SG type=del size=326060 2024-08-27T02:37:49.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.399+0000 7f3e0cc408c0 1 < canceled part key=_multipart_IISECLYEAR19.2~1UA6Q20TDVJE.0 size=63252 2024-08-27T02:37:49.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.403+0000 7f3e0cc408c0 1 < canceled multipart upload key=IISECLYEAR19 upload=1UA6Q20TDVJE tag=IO4V5X8GWYDM type=write size=1111828 2024-08-27T02:37:49.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.403+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=HZNFAX479PYI type=del size=2649797 2024-08-27T02:37:49.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.411+0000 7f3e0cc408c0 1 < suggested remove operation key=HKDJMA7O2DFM tag=7IS1FTIMFKXU type=write 2024-08-27T02:37:49.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.411+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=1TNNDIXRVYW4 type=del size=3145887 2024-08-27T02:37:49.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.415+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~OGXZXVK2UQGP.0 size=27447 2024-08-27T02:37:49.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.419+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=OGXZXVK2UQGP tag=E71K9EM6M4HS type=write size=1076023 2024-08-27T02:37:49.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.423+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=P7ZT13ZKKRDG type=del size=1939401 2024-08-27T02:37:49.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.427+0000 7f3e0cc408c0 1 < suggested update operation key=6QE1HU65GQZZ tag=XO4H83X35221 type=del size=3924073 2024-08-27T02:37:49.429 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.431+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=4AUTA0SBWO1J type=del size=147228 2024-08-27T02:37:49.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.431+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=10F1DPCF94EL type=del 2024-08-27T02:37:49.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.435+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=QSKOCM7AEC2J type=del size=1703739 2024-08-27T02:37:49.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.439+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=I742WLXYFV70 type=del 2024-08-27T02:37:49.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~0BKT68ZDSVFB.0 size=696169 2024-08-27T02:37:49.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.443+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=0BKT68ZDSVFB tag=S3N2F67EVKNB type=write size=1744745 2024-08-27T02:37:49.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.443+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~IZ40UWYCM6ZM.0 size=1048576 2024-08-27T02:37:49.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~IZ40UWYCM6ZM.1 size=23463 2024-08-27T02:37:49.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.451+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=IZ40UWYCM6ZM tag=QH8E92O9Q580 type=write size=2120615 2024-08-27T02:37:49.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.451+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=8BD7365CVZ05 type=del size=2759979 2024-08-27T02:37:49.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.455+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=WS2EZQ5YRUCY type=del 2024-08-27T02:37:49.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.459+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=NEG3U7RTXRQK type=write size=179129 2024-08-27T02:37:49.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.459+0000 7f3e0cc408c0 1 < completed write operation key=ZMN8Y0VQVHLB tag=TZXU3EJ1SF7J type=write size=763848 2024-08-27T02:37:49.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~JKANCWM7XGNP.0 size=611575 2024-08-27T02:37:49.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.463+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=JKANCWM7XGNP tag=U9WLT5BJ453R type=write size=1660151 2024-08-27T02:37:49.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.467+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=UT3KBF1ROK0K type=del 2024-08-27T02:37:49.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.471+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~6QTFAG2S8FMQ.0 size=1048576 2024-08-27T02:37:49.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.471+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~6QTFAG2S8FMQ.1 size=1048576 2024-08-27T02:37:49.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.475+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~6QTFAG2S8FMQ.2 size=660290 2024-08-27T02:37:49.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.475+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=6QTFAG2S8FMQ tag=JPCIBHIH3VCS type=write size=3806018 2024-08-27T02:37:49.476 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~ZY81O6AZPNEB.0 size=1048576 2024-08-27T02:37:49.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.479+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~ZY81O6AZPNEB.1 size=1048576 2024-08-27T02:37:49.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.479+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~ZY81O6AZPNEB.2 size=454816 2024-08-27T02:37:49.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.483+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=ZY81O6AZPNEB tag=DWRDWP4LIQMH type=write size=3600544 2024-08-27T02:37:49.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.487+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~CA4WVOXT6VSM.0 size=762826 2024-08-27T02:37:49.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.487+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=CA4WVOXT6VSM tag=2VO7EAR65BQ7 type=write size=1811402 2024-08-27T02:37:49.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.487+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~RNHMQ684SK3L.0 size=627554 2024-08-27T02:37:49.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.491+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=RNHMQ684SK3L tag=0XN62TT919JI type=write size=1676130 2024-08-27T02:37:49.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.495+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=3VHCWK4IIHO2 type=write size=365078 2024-08-27T02:37:49.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.495+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6YTZJKE4V5HQ.2~PTGJTSO4QXOT.0 size=1048576 2024-08-27T02:37:49.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.495+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~PTGJTSO4QXOT.1 size=1048576 2024-08-27T02:37:49.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~PTGJTSO4QXOT.2 size=203537 2024-08-27T02:37:49.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.503+0000 7f3e0cc408c0 1 < canceled multipart upload key=6YTZJKE4V5HQ upload=PTGJTSO4QXOT tag=B33IX245M7M0 type=write size=3349265 2024-08-27T02:37:49.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.503+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=7X3JK2KKQJKJ type=write size=824152 2024-08-27T02:37:49.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.507+0000 7f3e0cc408c0 1 < canceled operation key=SG9T1RD5EATR tag=KLFS18RX5HA8 type=del size=683047 2024-08-27T02:37:49.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.507+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=4CRLGVXK1Z3Z type=del size=2018119 2024-08-27T02:37:49.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.511+0000 7f3e0cc408c0 1 < canceled operation key=4BV3C9MTIFT5 tag=935RF1QRREY7 type=del size=1537735 2024-08-27T02:37:49.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.515+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=PWK4SHDTAA01 type=write size=461128 2024-08-27T02:37:49.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.519+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=0J5X6B0PK3SG type=del size=326060 2024-08-27T02:37:49.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.523+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=FY1NG3EBCZ6J type=del size=3342283 2024-08-27T02:37:49.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.523+0000 7f3e0cc408c0 -1 < failed to complete operation key=6QE1HU65GQZZ tag=HZNFAX479PYI type=del size=2649797: (22) Invalid argument 2024-08-27T02:37:49.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~9FC4WM8BG8K5.0 size=1048576 2024-08-27T02:37:49.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~9FC4WM8BG8K5.1 size=1048576 2024-08-27T02:37:49.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~9FC4WM8BG8K5.2 size=980416 2024-08-27T02:37:49.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.535+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=9FC4WM8BG8K5 tag=L6UXYKFS4JOT type=write size=4126144 2024-08-27T02:37:49.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.535+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=1TNNDIXRVYW4 type=del 2024-08-27T02:37:49.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.539+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=REBMHKIBYADD type=del size=3960562 2024-08-27T02:37:49.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.543+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=P7ZT13ZKKRDG type=del 2024-08-27T02:37:49.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.547+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=HM4AKOGXLI6F type=del size=3072398 2024-08-27T02:37:49.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.551+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=4AUTA0SBWO1J type=del 2024-08-27T02:37:49.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.551+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=WMILUJA1ISPI type=del size=3372926 2024-08-27T02:37:49.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.559+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=QSKOCM7AEC2J type=del 2024-08-27T02:37:49.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~R2WZPXCPU8F3.0 size=1048576 2024-08-27T02:37:49.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~R2WZPXCPU8F3.1 size=764452 2024-08-27T02:37:49.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.567+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=R2WZPXCPU8F3 tag=YFC7CT4TYZBW type=write size=2861604 2024-08-27T02:37:49.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.567+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~0BKT68ZDSVFB.0 size=696169 2024-08-27T02:37:49.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.575+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=0BKT68ZDSVFB tag=S3N2F67EVKNB type=write size=1744745 2024-08-27T02:37:49.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.575+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=W1MHAON6S1Q4 type=write size=842192 2024-08-27T02:37:49.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.583+0000 7f3e0cc408c0 1 < suggested update operation key=IISECLYEAR19 tag=8BD7365CVZ05 type=del size=2759979 2024-08-27T02:37:49.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.583+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=58ZGRPJFY0P5 type=del size=1767155 2024-08-27T02:37:49.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.587+0000 7f3e0cc408c0 1 < completed write operation key=MKB40KOOCCNT tag=NEG3U7RTXRQK type=write size=179129 2024-08-27T02:37:49.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.591+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=XV7PEMPCZV8X type=del size=3425470 2024-08-27T02:37:49.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.595+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~JKANCWM7XGNP.0 size=611575 2024-08-27T02:37:49.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.599+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=JKANCWM7XGNP tag=U9WLT5BJ453R type=write size=1660151 2024-08-27T02:37:49.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.603+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=MXJWB74FFJFA type=del size=2345589 2024-08-27T02:37:49.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~6QTFAG2S8FMQ.0 size=1048576 2024-08-27T02:37:49.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~6QTFAG2S8FMQ.1 size=1048576 2024-08-27T02:37:49.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~6QTFAG2S8FMQ.2 size=660290 2024-08-27T02:37:49.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.615+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=6QTFAG2S8FMQ tag=JPCIBHIH3VCS type=write size=3806018 2024-08-27T02:37:49.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.615+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=7CBOXTX0U81D type=del size=3787669 2024-08-27T02:37:49.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~CA4WVOXT6VSM.0 size=762826 2024-08-27T02:37:49.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.623+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=CA4WVOXT6VSM tag=2VO7EAR65BQ7 type=write size=1811402 2024-08-27T02:37:49.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.627+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=44EWTFEOGG5P type=del size=828899 2024-08-27T02:37:49.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.627+0000 7f3e0cc408c0 1 < completed write operation key=QVG1NTF6O8L2 tag=3VHCWK4IIHO2 type=write size=365078 2024-08-27T02:37:49.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~5JUGWNK9HGEM.0 size=1048576 2024-08-27T02:37:49.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~5JUGWNK9HGEM.1 size=1048576 2024-08-27T02:37:49.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.639+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~5JUGWNK9HGEM.2 size=708039 2024-08-27T02:37:49.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.639+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=5JUGWNK9HGEM tag=0OAE7UGN85Z0 type=write size=3853767 2024-08-27T02:37:49.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.643+0000 7f3e0cc408c0 1 < suggested remove operation key=SG9T1RD5EATR tag=7X3JK2KKQJKJ type=write 2024-08-27T02:37:49.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.647+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=BMLSG8Y2LM1J type=write size=380889 2024-08-27T02:37:49.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.651+0000 7f3e0cc408c0 1 < suggested remove operation key=6QE1HU65GQZZ tag=4CRLGVXK1Z3Z type=del 2024-08-27T02:37:49.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.655+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=84OGPERA09OC type=del size=3230547 2024-08-27T02:37:49.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.659+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=PWK4SHDTAA01 type=write size=461128 2024-08-27T02:37:49.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.663+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~U4XU8TDHFFX4.0 size=1048576 2024-08-27T02:37:49.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~U4XU8TDHFFX4.1 size=933649 2024-08-27T02:37:49.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.667+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=U4XU8TDHFFX4 tag=KWW3V73LYZO0 type=write size=3030801 2024-08-27T02:37:49.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.667+0000 7f3e0cc408c0 1 < canceled operation key=KTPZGZSQCERQ tag=FY1NG3EBCZ6J type=del size=3342283 2024-08-27T02:37:49.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.675+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~UFHW0Y8EL1T4.0 size=1048576 2024-08-27T02:37:49.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.675+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~UFHW0Y8EL1T4.1 size=477744 2024-08-27T02:37:49.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.675+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=UFHW0Y8EL1T4 tag=A4PYCHPYLJBZ type=write size=2574896 2024-08-27T02:37:49.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.679+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~9FC4WM8BG8K5.0 size=1048576 2024-08-27T02:37:49.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.679+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~9FC4WM8BG8K5.1 size=1048576 2024-08-27T02:37:49.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.683+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~9FC4WM8BG8K5.2 size=980416 2024-08-27T02:37:49.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.687+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=9FC4WM8BG8K5 tag=L6UXYKFS4JOT type=write size=4126144 2024-08-27T02:37:49.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.691+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=ULH4HZ408V4Q type=del size=2380325 2024-08-27T02:37:49.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.691+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=REBMHKIBYADD type=del 2024-08-27T02:37:49.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.695+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=DZXZJTZBA7BD type=del size=1152569 2024-08-27T02:37:49.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.699+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=HM4AKOGXLI6F type=del 2024-08-27T02:37:49.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.703+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=558O922KIO3F type=del size=4071766 2024-08-27T02:37:49.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.707+0000 7f3e0cc408c0 1 < suggested update operation key=QVG1NTF6O8L2 tag=WMILUJA1ISPI type=del size=3372926 2024-08-27T02:37:49.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.711+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=AKDJ3ENIA3D7 type=del size=303456 2024-08-27T02:37:49.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.715+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~R2WZPXCPU8F3.0 size=1048576 2024-08-27T02:37:49.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.715+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~R2WZPXCPU8F3.1 size=764452 2024-08-27T02:37:49.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.723+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=R2WZPXCPU8F3 tag=YFC7CT4TYZBW type=write size=2861604 2024-08-27T02:37:49.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.723+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=I1CM1Z5FW6GK type=del size=4032441 2024-08-27T02:37:49.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.727+0000 7f3e0cc408c0 1 < completed write operation key=HKDJMA7O2DFM tag=W1MHAON6S1Q4 type=write size=842192 2024-08-27T02:37:49.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.731+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=T6YNEUZ0OB50 type=del size=3795559 2024-08-27T02:37:49.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.731+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=58ZGRPJFY0P5 type=del 2024-08-27T02:37:49.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.739+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~23BM8LZ7035F.0 size=1048576 2024-08-27T02:37:49.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.739+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~23BM8LZ7035F.1 size=1048576 2024-08-27T02:37:49.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.743+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~23BM8LZ7035F.2 size=1001602 2024-08-27T02:37:49.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.743+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=23BM8LZ7035F tag=MZXEEOVTN8UQ type=write size=4147330 2024-08-27T02:37:49.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.747+0000 7f3e0cc408c0 -1 < failed to complete operation key=6QE1HU65GQZZ tag=XV7PEMPCZV8X type=del size=3425470: (22) Invalid argument 2024-08-27T02:37:49.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.747+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=SXADW9ULVWG5 type=del size=2337765 2024-08-27T02:37:49.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.751+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=MXJWB74FFJFA type=del 2024-08-27T02:37:49.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~A7GFA6DMXFDL.0 size=33457 2024-08-27T02:37:49.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.759+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=A7GFA6DMXFDL tag=P3WS0G2PO1YC type=write size=1082033 2024-08-27T02:37:49.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.759+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=7CBOXTX0U81D type=del 2024-08-27T02:37:49.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.763+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=K3CDFYY822D7 type=del size=2427767 2024-08-27T02:37:49.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.767+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=44EWTFEOGG5P type=del 2024-08-27T02:37:49.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.767+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=JPWYK31Z0D9W type=del size=3822899 2024-08-27T02:37:49.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~5JUGWNK9HGEM.0 size=1048576 2024-08-27T02:37:49.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.775+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~5JUGWNK9HGEM.1 size=1048576 2024-08-27T02:37:49.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.775+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~5JUGWNK9HGEM.2 size=708039 2024-08-27T02:37:49.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.779+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=5JUGWNK9HGEM tag=0OAE7UGN85Z0 type=write size=3853767 2024-08-27T02:37:49.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~WVHOUKYZW6Z3.0 size=1048576 2024-08-27T02:37:49.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~WVHOUKYZW6Z3.1 size=1048576 2024-08-27T02:37:49.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~WVHOUKYZW6Z3.2 size=752867 2024-08-27T02:37:49.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.791+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=WVHOUKYZW6Z3 tag=ZAQHD3H3UXJ8 type=write size=3898595 2024-08-27T02:37:49.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.791+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=BMLSG8Y2LM1J type=write size=380889 2024-08-27T02:37:49.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.795+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=UA87D9VTRWYJ type=write size=956906 2024-08-27T02:37:49.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.799+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=84OGPERA09OC type=del 2024-08-27T02:37:49.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.799+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=KDBASZUF6VE0 type=del size=2586353 2024-08-27T02:37:49.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.803+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~U4XU8TDHFFX4.0 size=1048576 2024-08-27T02:37:49.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.803+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~U4XU8TDHFFX4.1 size=933649 2024-08-27T02:37:49.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.807+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=U4XU8TDHFFX4 tag=KWW3V73LYZO0 type=write size=3030801 2024-08-27T02:37:49.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.811+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=8LNZ2V54SJS0 type=del size=936257 2024-08-27T02:37:49.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.815+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~UFHW0Y8EL1T4.0 size=1048576 2024-08-27T02:37:49.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.815+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~UFHW0Y8EL1T4.1 size=477744 2024-08-27T02:37:49.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.819+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=UFHW0Y8EL1T4 tag=A4PYCHPYLJBZ type=write size=2574896 2024-08-27T02:37:49.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.823+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=V8O0B9M0UJFP type=del size=2851019 2024-08-27T02:37:49.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.827+0000 7f3e0cc408c0 -1 < failed to complete operation key=QVG1NTF6O8L2 tag=ULH4HZ408V4Q type=del size=2380325: (22) Invalid argument 2024-08-27T02:37:49.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.831+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=QBNXJOAADET0 type=del size=2230909 2024-08-27T02:37:49.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.831+0000 7f3e0cc408c0 1 < canceled operation key=OY551242R8T6 tag=DZXZJTZBA7BD type=del size=1152569 2024-08-27T02:37:49.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.835+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=Q38N1EWMBXTC type=del size=1502068 2024-08-27T02:37:49.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.843+0000 7f3e0cc408c0 1 < suggested update operation key=O66XJ7GJMPCU tag=558O922KIO3F type=del size=4071766 2024-08-27T02:37:49.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.847+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=XN3HJMXB1KIU type=write size=912204 2024-08-27T02:37:49.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.851+0000 7f3e0cc408c0 1 < suggested update operation key=O66XJ7GJMPCU tag=AKDJ3ENIA3D7 type=del size=303456 2024-08-27T02:37:49.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.855+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=U3JM768LGF4W type=del size=2871369 2024-08-27T02:37:49.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.859+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=I1CM1Z5FW6GK type=del 2024-08-27T02:37:49.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.859+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=5CC2M2PSCIM8 type=del size=2610056 2024-08-27T02:37:49.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.863+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=T6YNEUZ0OB50 type=del 2024-08-27T02:37:49.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.867+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=LEWSQKX95AMW type=del size=1227033 2024-08-27T02:37:49.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~23BM8LZ7035F.0 size=1048576 2024-08-27T02:37:49.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.871+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~23BM8LZ7035F.1 size=1048576 2024-08-27T02:37:49.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.875+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~23BM8LZ7035F.2 size=1001602 2024-08-27T02:37:49.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.879+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=23BM8LZ7035F tag=MZXEEOVTN8UQ type=write size=4147330 2024-08-27T02:37:49.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.883+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~A6FR6HXPQPCY.0 size=1048576 2024-08-27T02:37:49.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.887+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~A6FR6HXPQPCY.1 size=634369 2024-08-27T02:37:49.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.887+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=A6FR6HXPQPCY tag=J12OQBEVNAE5 type=write size=2731521 2024-08-27T02:37:49.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.891+0000 7f3e0cc408c0 1 < suggested update operation key=4BV3C9MTIFT5 tag=SXADW9ULVWG5 type=del size=2337765 2024-08-27T02:37:49.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.895+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=Q2ZKKQN8F1BA type=del size=3785171 2024-08-27T02:37:49.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.895+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~A7GFA6DMXFDL.0 size=33457 2024-08-27T02:37:49.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.899+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=A7GFA6DMXFDL tag=P3WS0G2PO1YC type=write size=1082033 2024-08-27T02:37:49.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~FUYEAHG7T976.0 size=1048576 2024-08-27T02:37:49.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~FUYEAHG7T976.1 size=1048576 2024-08-27T02:37:49.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.911+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~FUYEAHG7T976.2 size=631818 2024-08-27T02:37:49.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.911+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=FUYEAHG7T976 tag=F1ZSKXCQH3CM type=write size=3777546 2024-08-27T02:37:49.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.911+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=K3CDFYY822D7 type=del 2024-08-27T02:37:49.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.915+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=I215OXU7ZRIU type=del size=3216383 2024-08-27T02:37:49.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.919+0000 7f3e0cc408c0 1 < suggested update operation key=JLAGXRZVF50G tag=JPWYK31Z0D9W type=del size=3822899 2024-08-27T02:37:49.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.923+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=EBXOGSEJ8VPS type=del size=3852024 2024-08-27T02:37:49.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.927+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~WVHOUKYZW6Z3.0 size=1048576 2024-08-27T02:37:49.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.931+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~WVHOUKYZW6Z3.1 size=1048576 2024-08-27T02:37:49.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.931+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~WVHOUKYZW6Z3.2 size=752867 2024-08-27T02:37:49.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.935+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=WVHOUKYZW6Z3 tag=ZAQHD3H3UXJ8 type=write size=3898595 2024-08-27T02:37:49.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.939+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=U3QHZ5E4ROZU type=del size=1974957 2024-08-27T02:37:49.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.943+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=UA87D9VTRWYJ type=write size=956906 2024-08-27T02:37:49.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.947+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=NQZCLRNYHE8A type=write size=110308 2024-08-27T02:37:49.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.951+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=KDBASZUF6VE0 type=del size=2586353 2024-08-27T02:37:49.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.955+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=TQYUCMR51TLA type=del size=952395 2024-08-27T02:37:49.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.959+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=8LNZ2V54SJS0 type=del 2024-08-27T02:37:49.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.963+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=6EVRTJPONJZP type=write size=545382 2024-08-27T02:37:49.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.967+0000 7f3e0cc408c0 1 < suggested update operation key=2CXWPDABA9XJ tag=V8O0B9M0UJFP type=del size=2851019 2024-08-27T02:37:49.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.971+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=FKOG27RBQFN1 type=write size=259981 2024-08-27T02:37:49.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.975+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=QBNXJOAADET0 type=del 2024-08-27T02:37:49.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~QOC1TUTDU3MB.0 size=1048576 2024-08-27T02:37:49.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.983+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~QOC1TUTDU3MB.1 size=1048576 2024-08-27T02:37:49.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.983+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~QOC1TUTDU3MB.2 size=664763 2024-08-27T02:37:49.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.983+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=QOC1TUTDU3MB tag=NA2UASLKT36E type=write size=3810491 2024-08-27T02:37:49.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.991+0000 7f3e0cc408c0 1 < suggested update operation key=ZMN8Y0VQVHLB tag=Q38N1EWMBXTC type=del size=1502068 2024-08-27T02:37:49.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.995+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~EEQQQIKSJ009.0 size=619576 2024-08-27T02:37:49.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.995+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=EEQQQIKSJ009 tag=EI5T95MXDBUY type=write size=1668152 2024-08-27T02:37:49.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:49.999+0000 7f3e0cc408c0 1 < completed write operation key=0U59R3BXL181 tag=XN3HJMXB1KIU type=write size=912204 2024-08-27T02:37:50.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.003+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=4YA5RO2N722L type=del size=4140434 2024-08-27T02:37:50.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.003+0000 7f3e0cc408c0 -1 < failed to complete operation key=4BV3C9MTIFT5 tag=U3JM768LGF4W type=del size=2871369: (22) Invalid argument 2024-08-27T02:37:50.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~HIC0B5UHJO5Z.0 size=1048576 2024-08-27T02:37:50.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~HIC0B5UHJO5Z.1 size=131570 2024-08-27T02:37:50.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.011+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=HIC0B5UHJO5Z tag=2W7F7R45MWT2 type=write size=2228722 2024-08-27T02:37:50.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.015+0000 7f3e0cc408c0 1 < suggested remove operation key=IISECLYEAR19 tag=5CC2M2PSCIM8 type=del 2024-08-27T02:37:50.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.019+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=Y328UAWFTM5F type=del size=155534 2024-08-27T02:37:50.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.023+0000 7f3e0cc408c0 -1 < failed to complete operation key=ZMN8Y0VQVHLB tag=LEWSQKX95AMW type=del size=1227033: (22) Invalid argument 2024-08-27T02:37:50.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.023+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=2HVFBHAUTBU5 type=del size=3266387 2024-08-27T02:37:50.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.027+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~A6FR6HXPQPCY.0 size=1048576 2024-08-27T02:37:50.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~A6FR6HXPQPCY.1 size=634369 2024-08-27T02:37:50.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.035+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=A6FR6HXPQPCY tag=J12OQBEVNAE5 type=write size=2731521 2024-08-27T02:37:50.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.035+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=IB314ES4JRKK type=del size=1905723 2024-08-27T02:37:50.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.039+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=Q2ZKKQN8F1BA type=del 2024-08-27T02:37:50.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.039+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=BOFDO20LB97T type=del size=4024226 2024-08-27T02:37:50.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~FUYEAHG7T976.0 size=1048576 2024-08-27T02:37:50.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~FUYEAHG7T976.1 size=1048576 2024-08-27T02:37:50.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~FUYEAHG7T976.2 size=631818 2024-08-27T02:37:50.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.051+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=FUYEAHG7T976 tag=F1ZSKXCQH3CM type=write size=3777546 2024-08-27T02:37:50.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.055+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=KRKAPG10AUL0 type=del size=629131 2024-08-27T02:37:50.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.055+0000 7f3e0cc408c0 1 < canceled operation key=0OLVDEQWBCAQ tag=I215OXU7ZRIU type=del size=3216383 2024-08-27T02:37:50.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.059+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=Z4SU0VA3GUGZ type=del size=1305330 2024-08-27T02:37:50.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.063+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=EBXOGSEJ8VPS type=del 2024-08-27T02:37:50.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.063+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=1S388FBJTO0G type=del size=3316260 2024-08-27T02:37:50.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.067+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=U3QHZ5E4ROZU type=del 2024-08-27T02:37:50.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.071+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=IWEQ2V2FE7HC type=del size=2630283 2024-08-27T02:37:50.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.075+0000 7f3e0cc408c0 1 < suggested remove operation key=0U59R3BXL181 tag=NQZCLRNYHE8A type=write 2024-08-27T02:37:50.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.075+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=Q75OH52C4M0A type=del size=1909188 2024-08-27T02:37:50.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.083+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=TQYUCMR51TLA type=del 2024-08-27T02:37:50.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.083+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=2F0Z27H4W0GD type=del size=3323586 2024-08-27T02:37:50.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.087+0000 7f3e0cc408c0 -1 < failed to complete operation key=ZMN8Y0VQVHLB tag=6EVRTJPONJZP type=write size=545382: (22) Invalid argument 2024-08-27T02:37:50.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.091+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~6YIION14TNOL.0 size=833986 2024-08-27T02:37:50.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.091+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=6YIION14TNOL tag=U42OBDXIAQGX type=write size=1882562 2024-08-27T02:37:50.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.095+0000 7f3e0cc408c0 1 < completed write operation key=VSDJU5KQLFKE tag=FKOG27RBQFN1 type=write size=259981 2024-08-27T02:37:50.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~FDRRY3O88DOO.0 size=1048576 2024-08-27T02:37:50.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~FDRRY3O88DOO.1 size=303179 2024-08-27T02:37:50.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.103+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=FDRRY3O88DOO tag=BV0TX6X9RYQ6 type=write size=2400331 2024-08-27T02:37:50.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.103+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~QOC1TUTDU3MB.0 size=1048576 2024-08-27T02:37:50.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~QOC1TUTDU3MB.1 size=1048576 2024-08-27T02:37:50.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~QOC1TUTDU3MB.2 size=664763 2024-08-27T02:37:50.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.111+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=QOC1TUTDU3MB tag=NA2UASLKT36E type=write size=3810491 2024-08-27T02:37:50.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.115+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=568N73H7HABW type=write size=118760 2024-08-27T02:37:50.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~EEQQQIKSJ009.0 size=619576 2024-08-27T02:37:50.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.123+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=EEQQQIKSJ009 tag=EI5T95MXDBUY type=write size=1668152 2024-08-27T02:37:50.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~EIBWED5ZSFT6.0 size=133966 2024-08-27T02:37:50.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.127+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=EIBWED5ZSFT6 tag=F5ZRHRY8J1RE type=write size=1182542 2024-08-27T02:37:50.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.131+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=4YA5RO2N722L type=del 2024-08-27T02:37:50.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~4UQZ33TR5YKS.0 size=1048576 2024-08-27T02:37:50.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~4UQZ33TR5YKS.1 size=1048576 2024-08-27T02:37:50.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.139+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~4UQZ33TR5YKS.2 size=869595 2024-08-27T02:37:50.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.139+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=4UQZ33TR5YKS tag=VUIPOR2RCS0D type=write size=4015323 2024-08-27T02:37:50.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.139+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~HIC0B5UHJO5Z.0 size=1048576 2024-08-27T02:37:50.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.143+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~HIC0B5UHJO5Z.1 size=131570 2024-08-27T02:37:50.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.147+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=HIC0B5UHJO5Z tag=2W7F7R45MWT2 type=write size=2228722 2024-08-27T02:37:50.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.151+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~TDU0S30EN4CU.0 size=1048576 2024-08-27T02:37:50.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.151+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~TDU0S30EN4CU.1 size=1048576 2024-08-27T02:37:50.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~TDU0S30EN4CU.2 size=925162 2024-08-27T02:37:50.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.155+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=TDU0S30EN4CU tag=TT80A113CMWY type=write size=4070890 2024-08-27T02:37:50.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.155+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=Y328UAWFTM5F type=del 2024-08-27T02:37:50.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~OU3SIZW9FC5V.0 size=97414 2024-08-27T02:37:50.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.159+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=OU3SIZW9FC5V tag=SUPRLAO0BSO6 type=write size=1145990 2024-08-27T02:37:50.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.163+0000 7f3e0cc408c0 1 < suggested update operation key=D7YWS7BWXT37 tag=2HVFBHAUTBU5 type=del size=3266387 2024-08-27T02:37:50.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.167+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~0MQDCX7IOMLY.0 size=1048576 2024-08-27T02:37:50.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.171+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~0MQDCX7IOMLY.1 size=309920 2024-08-27T02:37:50.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.171+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=0MQDCX7IOMLY tag=0KM245GH2GDD type=write size=2407072 2024-08-27T02:37:50.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.171+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=IB314ES4JRKK type=del 2024-08-27T02:37:50.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~YSOPUBT5U110.0 size=1048576 2024-08-27T02:37:50.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.179+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~YSOPUBT5U110.1 size=1048576 2024-08-27T02:37:50.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.179+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~YSOPUBT5U110.2 size=702544 2024-08-27T02:37:50.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.179+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=YSOPUBT5U110 tag=HRS46K11U3J8 type=write size=3848272 2024-08-27T02:37:50.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.183+0000 7f3e0cc408c0 1 < suggested remove operation key=B9DPI871LQ7E tag=BOFDO20LB97T type=del 2024-08-27T02:37:50.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~UZMKUV1IQ1OM.0 size=1048576 2024-08-27T02:37:50.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.191+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~UZMKUV1IQ1OM.1 size=1048576 2024-08-27T02:37:50.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.191+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~UZMKUV1IQ1OM.2 size=594266 2024-08-27T02:37:50.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.191+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=UZMKUV1IQ1OM tag=KGXC9CLUEW7Y type=write size=3739994 2024-08-27T02:37:50.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.195+0000 7f3e0cc408c0 1 < suggested remove operation key=HKDJMA7O2DFM tag=KRKAPG10AUL0 type=del 2024-08-27T02:37:50.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~EZESGUHYZ82U.0 size=21446 2024-08-27T02:37:50.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.199+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=EZESGUHYZ82U tag=V7R02SHTFG3N type=write size=1070022 2024-08-27T02:37:50.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.203+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=Z4SU0VA3GUGZ type=del 2024-08-27T02:37:50.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.203+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=QR7V22KTQ8AC type=del size=3731031 2024-08-27T02:37:50.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.207+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=1S388FBJTO0G type=del 2024-08-27T02:37:50.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.211+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~0945O5TVSUMF.0 size=1048576 2024-08-27T02:37:50.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.211+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~0945O5TVSUMF.1 size=829864 2024-08-27T02:37:50.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.211+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=0945O5TVSUMF tag=DH0XFB5QTVEZ type=write size=2927016 2024-08-27T02:37:50.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.215+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=IWEQ2V2FE7HC type=del 2024-08-27T02:37:50.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~4XUMV93I3XCC.0 size=1048576 2024-08-27T02:37:50.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~4XUMV93I3XCC.1 size=130513 2024-08-27T02:37:50.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.219+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=4XUMV93I3XCC tag=OLLTF48IEX3J type=write size=2227665 2024-08-27T02:37:50.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.223+0000 7f3e0cc408c0 1 < canceled operation key=MKB40KOOCCNT tag=Q75OH52C4M0A type=del size=1909188 2024-08-27T02:37:50.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.223+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=1H2TCMNGHKJG type=del size=2482658 2024-08-27T02:37:50.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.227+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=2F0Z27H4W0GD type=del 2024-08-27T02:37:50.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.227+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=ZAVNY6YAR9EO type=del size=1561477 2024-08-27T02:37:50.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~6YIION14TNOL.0 size=833986 2024-08-27T02:37:50.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.235+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=6YIION14TNOL tag=U42OBDXIAQGX type=write size=1882562 2024-08-27T02:37:50.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.239+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~8L7SV3NGUBR3.0 size=1048576 2024-08-27T02:37:50.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.239+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~8L7SV3NGUBR3.1 size=669028 2024-08-27T02:37:50.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.239+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=8L7SV3NGUBR3 tag=DEGC9B2PWB7G type=write size=2766180 2024-08-27T02:37:50.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.243+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~FDRRY3O88DOO.0 size=1048576 2024-08-27T02:37:50.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~FDRRY3O88DOO.1 size=303179 2024-08-27T02:37:50.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.259+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=FDRRY3O88DOO tag=BV0TX6X9RYQ6 type=write size=2400331 2024-08-27T02:37:50.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.263+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=I8KNW2Q6344I type=del size=3372359 2024-08-27T02:37:50.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.267+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=568N73H7HABW type=write size=118760 2024-08-27T02:37:50.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.267+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=QZRJUR8KN88R type=del size=3731419 2024-08-27T02:37:50.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.271+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~EIBWED5ZSFT6.0 size=133966 2024-08-27T02:37:50.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.275+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=EIBWED5ZSFT6 tag=F5ZRHRY8J1RE type=write size=1182542 2024-08-27T02:37:50.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.279+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~H2EMQ28I620V.0 size=1048576 2024-08-27T02:37:50.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.279+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~H2EMQ28I620V.1 size=1048576 2024-08-27T02:37:50.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.283+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~H2EMQ28I620V.2 size=178291 2024-08-27T02:37:50.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.283+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=H2EMQ28I620V tag=IMO7NQ8CWL07 type=write size=3324019 2024-08-27T02:37:50.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.283+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~4UQZ33TR5YKS.0 size=1048576 2024-08-27T02:37:50.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.283+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~4UQZ33TR5YKS.1 size=1048576 2024-08-27T02:37:50.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.287+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~4UQZ33TR5YKS.2 size=869595 2024-08-27T02:37:50.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.291+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=4UQZ33TR5YKS tag=VUIPOR2RCS0D type=write size=4015323 2024-08-27T02:37:50.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~ZPEOFD8R6I2A.0 size=1048576 2024-08-27T02:37:50.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~ZPEOFD8R6I2A.1 size=1048576 2024-08-27T02:37:50.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~ZPEOFD8R6I2A.2 size=867788 2024-08-27T02:37:50.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.295+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=ZPEOFD8R6I2A tag=8DTR2HVRGJMY type=write size=4013516 2024-08-27T02:37:50.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.299+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~TDU0S30EN4CU.0 size=1048576 2024-08-27T02:37:50.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~TDU0S30EN4CU.1 size=1048576 2024-08-27T02:37:50.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~TDU0S30EN4CU.2 size=925162 2024-08-27T02:37:50.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.307+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=TDU0S30EN4CU tag=TT80A113CMWY type=write size=4070890 2024-08-27T02:37:50.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.311+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~R6F5CIMMWXZD.0 size=1048576 2024-08-27T02:37:50.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.311+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~R6F5CIMMWXZD.1 size=1048576 2024-08-27T02:37:50.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~R6F5CIMMWXZD.2 size=578262 2024-08-27T02:37:50.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.315+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=R6F5CIMMWXZD tag=G0454W7JS3TR type=write size=3723990 2024-08-27T02:37:50.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.315+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~OU3SIZW9FC5V.0 size=97414 2024-08-27T02:37:50.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.319+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=OU3SIZW9FC5V tag=SUPRLAO0BSO6 type=write size=1145990 2024-08-27T02:37:50.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.319+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=IIBSTNN5PCG8 type=del size=73805 2024-08-27T02:37:50.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.323+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~0MQDCX7IOMLY.0 size=1048576 2024-08-27T02:37:50.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.323+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~0MQDCX7IOMLY.1 size=309920 2024-08-27T02:37:50.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.327+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=0MQDCX7IOMLY tag=0KM245GH2GDD type=write size=2407072 2024-08-27T02:37:50.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.327+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=BA4O1FIS3G1L type=del size=324764 2024-08-27T02:37:50.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~YSOPUBT5U110.0 size=1048576 2024-08-27T02:37:50.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~YSOPUBT5U110.1 size=1048576 2024-08-27T02:37:50.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.335+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~YSOPUBT5U110.2 size=702544 2024-08-27T02:37:50.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.335+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=YSOPUBT5U110 tag=HRS46K11U3J8 type=write size=3848272 2024-08-27T02:37:50.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.339+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=KJYQUG8QLEM2 type=del size=298872 2024-08-27T02:37:50.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~UZMKUV1IQ1OM.0 size=1048576 2024-08-27T02:37:50.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~UZMKUV1IQ1OM.1 size=1048576 2024-08-27T02:37:50.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~UZMKUV1IQ1OM.2 size=594266 2024-08-27T02:37:50.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.347+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=UZMKUV1IQ1OM tag=KGXC9CLUEW7Y type=write size=3739994 2024-08-27T02:37:50.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.351+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=8BRSNGKOYAQ3 type=del size=2684952 2024-08-27T02:37:50.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.355+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~EZESGUHYZ82U.0 size=21446 2024-08-27T02:37:50.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.359+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=EZESGUHYZ82U tag=V7R02SHTFG3N type=write size=1070022 2024-08-27T02:37:50.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.359+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=4UDVJ09BX4YG type=del size=2673696 2024-08-27T02:37:50.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.363+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=QR7V22KTQ8AC type=del 2024-08-27T02:37:50.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.367+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=G94YAWIPHZMQ type=del size=3706806 2024-08-27T02:37:50.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~0945O5TVSUMF.0 size=1048576 2024-08-27T02:37:50.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~0945O5TVSUMF.1 size=829864 2024-08-27T02:37:50.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.375+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=0945O5TVSUMF tag=DH0XFB5QTVEZ type=write size=2927016 2024-08-27T02:37:50.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.379+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=UN84Z1JXRLUM type=del size=1932627 2024-08-27T02:37:50.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~4XUMV93I3XCC.0 size=1048576 2024-08-27T02:37:50.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~4XUMV93I3XCC.1 size=130513 2024-08-27T02:37:50.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.387+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=4XUMV93I3XCC tag=OLLTF48IEX3J type=write size=2227665 2024-08-27T02:37:50.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.391+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=TZ8M52FF4A91 type=del size=3115975 2024-08-27T02:37:50.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.391+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=1H2TCMNGHKJG type=del 2024-08-27T02:37:50.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.395+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=7RM9VH3WLFXF type=write size=378203 2024-08-27T02:37:50.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.395+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=ZAVNY6YAR9EO type=del 2024-08-27T02:37:50.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.399+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=DZBQUPUI8E3O type=del size=2547471 2024-08-27T02:37:50.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.399+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~8L7SV3NGUBR3.0 size=1048576 2024-08-27T02:37:50.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.399+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~8L7SV3NGUBR3.1 size=669028 2024-08-27T02:37:50.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.403+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=8L7SV3NGUBR3 tag=DEGC9B2PWB7G type=write size=2766180 2024-08-27T02:37:50.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.403+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=CSZEP0Z6O1BL type=del size=3166063 2024-08-27T02:37:50.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.407+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=I8KNW2Q6344I type=del 2024-08-27T02:37:50.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~6J88SMJ9J0M4.0 size=1048576 2024-08-27T02:37:50.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.415+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~6J88SMJ9J0M4.1 size=674621 2024-08-27T02:37:50.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.415+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=6J88SMJ9J0M4 tag=OWZ8X39JGG9S type=write size=2771773 2024-08-27T02:37:50.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.415+0000 7f3e0cc408c0 1 < canceled operation key=OY551242R8T6 tag=QZRJUR8KN88R type=del size=3731419 2024-08-27T02:37:50.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.419+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~GKGMLJWM7EJT.0 size=1048576 2024-08-27T02:37:50.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.423+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~GKGMLJWM7EJT.1 size=1048576 2024-08-27T02:37:50.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.423+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~GKGMLJWM7EJT.2 size=379229 2024-08-27T02:37:50.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.423+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=GKGMLJWM7EJT tag=I1IC86QMXO68 type=write size=3524957 2024-08-27T02:37:50.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.427+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~H2EMQ28I620V.0 size=1048576 2024-08-27T02:37:50.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.427+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~H2EMQ28I620V.1 size=1048576 2024-08-27T02:37:50.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.431+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~H2EMQ28I620V.2 size=178291 2024-08-27T02:37:50.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.435+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=H2EMQ28I620V tag=IMO7NQ8CWL07 type=write size=3324019 2024-08-27T02:37:50.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~LRCJU101YXV9.0 size=1048576 2024-08-27T02:37:50.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~LRCJU101YXV9.1 size=1048576 2024-08-27T02:37:50.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~LRCJU101YXV9.2 size=635291 2024-08-27T02:37:50.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.443+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=LRCJU101YXV9 tag=GGQ3QFWZ03FU type=write size=3781019 2024-08-27T02:37:50.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~ZPEOFD8R6I2A.0 size=1048576 2024-08-27T02:37:50.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~ZPEOFD8R6I2A.1 size=1048576 2024-08-27T02:37:50.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~ZPEOFD8R6I2A.2 size=867788 2024-08-27T02:37:50.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.455+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=ZPEOFD8R6I2A tag=8DTR2HVRGJMY type=write size=4013516 2024-08-27T02:37:50.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~CIHOVZF1O3PQ.0 size=767056 2024-08-27T02:37:50.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.463+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=CIHOVZF1O3PQ tag=2QGZ5HSR5TT5 type=write size=1815632 2024-08-27T02:37:50.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.463+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~R6F5CIMMWXZD.0 size=1048576 2024-08-27T02:37:50.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.467+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~R6F5CIMMWXZD.1 size=1048576 2024-08-27T02:37:50.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.467+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~R6F5CIMMWXZD.2 size=578262 2024-08-27T02:37:50.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.471+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=R6F5CIMMWXZD tag=G0454W7JS3TR type=write size=3723990 2024-08-27T02:37:50.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.475+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=OH1XF6PWSKWP type=del size=1800758 2024-08-27T02:37:50.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.475+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=IIBSTNN5PCG8 type=del 2024-08-27T02:37:50.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.479+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~SYSABG1Q0334.0 size=584613 2024-08-27T02:37:50.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.479+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=SYSABG1Q0334 tag=UPEJH2EPXXN1 type=write size=1633189 2024-08-27T02:37:50.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.483+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=BA4O1FIS3G1L type=del 2024-08-27T02:37:50.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.483+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=45W4TNUOFHTL type=del size=3749821 2024-08-27T02:37:50.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.487+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=KJYQUG8QLEM2 type=del 2024-08-27T02:37:50.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.491+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ZP0DFS5JQGHB.0 size=1048576 2024-08-27T02:37:50.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.491+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ZP0DFS5JQGHB.1 size=1048576 2024-08-27T02:37:50.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.491+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ZP0DFS5JQGHB.2 size=704952 2024-08-27T02:37:50.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.491+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=ZP0DFS5JQGHB tag=4QOPH3CSE940 type=write size=3850680 2024-08-27T02:37:50.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.495+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=8BRSNGKOYAQ3 type=del 2024-08-27T02:37:50.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~911UP0D0TN3X.0 size=1048576 2024-08-27T02:37:50.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~911UP0D0TN3X.1 size=1048576 2024-08-27T02:37:50.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~911UP0D0TN3X.2 size=253456 2024-08-27T02:37:50.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.499+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=911UP0D0TN3X tag=PZ7EVOWXM32U type=write size=3399184 2024-08-27T02:37:50.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.503+0000 7f3e0cc408c0 1 < suggested remove operation key=8VSA6T2H8FDI tag=4UDVJ09BX4YG type=del 2024-08-27T02:37:50.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.507+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~3ZQ2LFCOQSX9.0 size=1048576 2024-08-27T02:37:50.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.511+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~3ZQ2LFCOQSX9.1 size=651049 2024-08-27T02:37:50.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.511+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=3ZQ2LFCOQSX9 tag=AEARXQ0XGL8U type=write size=2748201 2024-08-27T02:37:50.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.511+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=G94YAWIPHZMQ type=del 2024-08-27T02:37:50.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.515+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~J220D6Z0F18A.0 size=1048576 2024-08-27T02:37:50.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.515+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~J220D6Z0F18A.1 size=170957 2024-08-27T02:37:50.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.515+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=J220D6Z0F18A tag=12IGQVHWF95W type=write size=2268109 2024-08-27T02:37:50.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.519+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=UN84Z1JXRLUM type=del 2024-08-27T02:37:50.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.523+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~Q8F32D9CE3QV.0 size=502777 2024-08-27T02:37:50.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.523+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=Q8F32D9CE3QV tag=J1EZCMX6PNWT type=write size=1551353 2024-08-27T02:37:50.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.527+0000 7f3e0cc408c0 1 < suggested remove operation key=KTPZGZSQCERQ tag=TZ8M52FF4A91 type=del 2024-08-27T02:37:50.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~KTILXHC1H13G.0 size=907369 2024-08-27T02:37:50.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.527+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=KTILXHC1H13G tag=PLNYRL8WS5EH type=write size=1955945 2024-08-27T02:37:50.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.531+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=7RM9VH3WLFXF type=write size=378203 2024-08-27T02:37:50.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~HU881017N9F5.0 size=1048576 2024-08-27T02:37:50.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~HU881017N9F5.1 size=942254 2024-08-27T02:37:50.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.535+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=HU881017N9F5 tag=9XYKSW3RI3A0 type=write size=3039406 2024-08-27T02:37:50.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.535+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=DZBQUPUI8E3O type=del 2024-08-27T02:37:50.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.539+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=NWWD7VSINR6G type=del size=1715343 2024-08-27T02:37:50.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.543+0000 7f3e0cc408c0 1 < suggested update operation key=O66XJ7GJMPCU tag=CSZEP0Z6O1BL type=del size=3166063 2024-08-27T02:37:50.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.547+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~VCNDPMLHEW03.0 size=1048576 2024-08-27T02:37:50.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.547+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~VCNDPMLHEW03.1 size=891998 2024-08-27T02:37:50.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.547+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=VCNDPMLHEW03 tag=31F5883Z1R24 type=write size=2989150 2024-08-27T02:37:50.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.551+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~6J88SMJ9J0M4.0 size=1048576 2024-08-27T02:37:50.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.551+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~6J88SMJ9J0M4.1 size=674621 2024-08-27T02:37:50.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.555+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=6J88SMJ9J0M4 tag=OWZ8X39JGG9S type=write size=2771773 2024-08-27T02:37:50.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.559+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~J8NS46KDJO6D.0 size=1048576 2024-08-27T02:37:50.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.559+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~J8NS46KDJO6D.1 size=1048576 2024-08-27T02:37:50.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~J8NS46KDJO6D.2 size=679893 2024-08-27T02:37:50.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.563+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=J8NS46KDJO6D tag=MULB20O1PSEF type=write size=3825621 2024-08-27T02:37:50.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.563+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~GKGMLJWM7EJT.0 size=1048576 2024-08-27T02:37:50.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.563+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~GKGMLJWM7EJT.1 size=1048576 2024-08-27T02:37:50.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.567+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~GKGMLJWM7EJT.2 size=379229 2024-08-27T02:37:50.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.571+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=GKGMLJWM7EJT tag=I1IC86QMXO68 type=write size=3524957 2024-08-27T02:37:50.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.571+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=NQU4U1A04H01 type=del size=806570 2024-08-27T02:37:50.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.575+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~LRCJU101YXV9.0 size=1048576 2024-08-27T02:37:50.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.575+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~LRCJU101YXV9.1 size=1048576 2024-08-27T02:37:50.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~LRCJU101YXV9.2 size=635291 2024-08-27T02:37:50.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.583+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=LRCJU101YXV9 tag=GGQ3QFWZ03FU type=write size=3781019 2024-08-27T02:37:50.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.583+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=2S9ANXNV6HBN type=write size=826259 2024-08-27T02:37:50.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.587+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~CIHOVZF1O3PQ.0 size=767056 2024-08-27T02:37:50.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.591+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=CIHOVZF1O3PQ tag=2QGZ5HSR5TT5 type=write size=1815632 2024-08-27T02:37:50.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.591+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=4AR019L0WGHH type=del size=865909 2024-08-27T02:37:50.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.595+0000 7f3e0cc408c0 1 < canceled operation key=ZMN8Y0VQVHLB tag=OH1XF6PWSKWP type=del size=1800758 2024-08-27T02:37:50.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.599+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~Z5C45M6SGWED.0 size=792864 2024-08-27T02:37:50.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.599+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=Z5C45M6SGWED tag=6XZOBVAFK9R9 type=write size=1841440 2024-08-27T02:37:50.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.599+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~SYSABG1Q0334.0 size=584613 2024-08-27T02:37:50.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.603+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=SYSABG1Q0334 tag=UPEJH2EPXXN1 type=write size=1633189 2024-08-27T02:37:50.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.607+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=X8T3HGUCV89V type=del size=1019588 2024-08-27T02:37:50.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.607+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=45W4TNUOFHTL type=del 2024-08-27T02:37:50.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.611+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~4FCD89DKHSPJ.0 size=1048576 2024-08-27T02:37:50.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.615+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~4FCD89DKHSPJ.1 size=1048576 2024-08-27T02:37:50.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.615+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~4FCD89DKHSPJ.2 size=416091 2024-08-27T02:37:50.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.615+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=4FCD89DKHSPJ tag=AORS8ZOBLAW9 type=write size=3561819 2024-08-27T02:37:50.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~ZP0DFS5JQGHB.0 size=1048576 2024-08-27T02:37:50.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~ZP0DFS5JQGHB.1 size=1048576 2024-08-27T02:37:50.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~ZP0DFS5JQGHB.2 size=704952 2024-08-27T02:37:50.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.623+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=ZP0DFS5JQGHB tag=4QOPH3CSE940 type=write size=3850680 2024-08-27T02:37:50.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~DZPZ8CFLAKT2.0 size=1048576 2024-08-27T02:37:50.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.631+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~DZPZ8CFLAKT2.1 size=1048576 2024-08-27T02:37:50.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.631+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~DZPZ8CFLAKT2.2 size=664466 2024-08-27T02:37:50.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.631+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=DZPZ8CFLAKT2 tag=XAR7MXYZ257R type=write size=3810194 2024-08-27T02:37:50.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.631+0000 7f3e0cc408c0 1 < canceled part key=_multipart_XBURHQSU6IML.2~911UP0D0TN3X.0 size=1048576 2024-08-27T02:37:50.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.635+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~911UP0D0TN3X.1 size=1048576 2024-08-27T02:37:50.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.635+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~911UP0D0TN3X.2 size=253456 2024-08-27T02:37:50.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.639+0000 7f3e0cc408c0 1 < canceled multipart upload key=XBURHQSU6IML upload=911UP0D0TN3X tag=PZ7EVOWXM32U type=write size=3399184 2024-08-27T02:37:50.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.643+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=IZDKYQVS21FZ type=write size=743926 2024-08-27T02:37:50.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.643+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~3ZQ2LFCOQSX9.0 size=1048576 2024-08-27T02:37:50.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.647+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~3ZQ2LFCOQSX9.1 size=651049 2024-08-27T02:37:50.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.651+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=3ZQ2LFCOQSX9 tag=AEARXQ0XGL8U type=write size=2748201 2024-08-27T02:37:50.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.651+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=DNNVC1T7A7DP type=del size=2739902 2024-08-27T02:37:50.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.655+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~J220D6Z0F18A.0 size=1048576 2024-08-27T02:37:50.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.655+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~J220D6Z0F18A.1 size=170957 2024-08-27T02:37:50.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.659+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=J220D6Z0F18A tag=12IGQVHWF95W type=write size=2268109 2024-08-27T02:37:50.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.663+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~Z5KKGQ4H6N6P.0 size=1048576 2024-08-27T02:37:50.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~Z5KKGQ4H6N6P.1 size=1048576 2024-08-27T02:37:50.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~Z5KKGQ4H6N6P.2 size=113137 2024-08-27T02:37:50.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.667+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=Z5KKGQ4H6N6P tag=5ADMGBLVTMGN type=write size=3258865 2024-08-27T02:37:50.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.667+0000 7f3e0cc408c0 1 < canceled part key=_multipart_2CXWPDABA9XJ.2~Q8F32D9CE3QV.0 size=502777 2024-08-27T02:37:50.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.671+0000 7f3e0cc408c0 1 < canceled multipart upload key=2CXWPDABA9XJ upload=Q8F32D9CE3QV tag=J1EZCMX6PNWT type=write size=1551353 2024-08-27T02:37:50.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.675+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~P807VIC2WUS3.0 size=580708 2024-08-27T02:37:50.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.675+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=P807VIC2WUS3 tag=OILFCKYAQV7P type=write size=1629284 2024-08-27T02:37:50.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~KTILXHC1H13G.0 size=907369 2024-08-27T02:37:50.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.679+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=KTILXHC1H13G tag=PLNYRL8WS5EH type=write size=1955945 2024-08-27T02:37:50.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.683+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=Q1GGBFDY229C type=del size=1854917 2024-08-27T02:37:50.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.683+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~HU881017N9F5.0 size=1048576 2024-08-27T02:37:50.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.683+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~HU881017N9F5.1 size=942254 2024-08-27T02:37:50.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.687+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=HU881017N9F5 tag=9XYKSW3RI3A0 type=write size=3039406 2024-08-27T02:37:50.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.691+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=AB3Z7NEW04ZC type=del size=1845840 2024-08-27T02:37:50.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.691+0000 7f3e0cc408c0 1 < canceled operation key=A0RUXE4YL6NR tag=NWWD7VSINR6G type=del size=1715343 2024-08-27T02:37:50.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.695+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=M9GXZ4D15R01 type=del size=1374565 2024-08-27T02:37:50.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.699+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~VCNDPMLHEW03.0 size=1048576 2024-08-27T02:37:50.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.699+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~VCNDPMLHEW03.1 size=891998 2024-08-27T02:37:50.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.703+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=VCNDPMLHEW03 tag=31F5883Z1R24 type=write size=2989150 2024-08-27T02:37:50.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.707+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~0FG9IRNJQLIX.0 size=1048576 2024-08-27T02:37:50.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.711+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~0FG9IRNJQLIX.1 size=1048576 2024-08-27T02:37:50.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.711+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~0FG9IRNJQLIX.2 size=391681 2024-08-27T02:37:50.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.711+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=0FG9IRNJQLIX tag=03X73C0QF0BC type=write size=3537409 2024-08-27T02:37:50.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.711+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0U59R3BXL181.2~J8NS46KDJO6D.0 size=1048576 2024-08-27T02:37:50.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.715+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~J8NS46KDJO6D.1 size=1048576 2024-08-27T02:37:50.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.715+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~J8NS46KDJO6D.2 size=679893 2024-08-27T02:37:50.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.719+0000 7f3e0cc408c0 1 < canceled multipart upload key=0U59R3BXL181 upload=J8NS46KDJO6D tag=MULB20O1PSEF type=write size=3825621 2024-08-27T02:37:50.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.723+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~9COG624P713P.0 size=1048576 2024-08-27T02:37:50.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.723+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~9COG624P713P.1 size=554394 2024-08-27T02:37:50.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.723+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=9COG624P713P tag=NKS0ZC5V10BU type=write size=2651546 2024-08-27T02:37:50.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.727+0000 7f3e0cc408c0 1 < suggested remove operation key=ZMN8Y0VQVHLB tag=NQU4U1A04H01 type=del 2024-08-27T02:37:50.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.731+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~MUPV8XUA9UX6.0 size=1048576 2024-08-27T02:37:50.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.735+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~MUPV8XUA9UX6.1 size=756332 2024-08-27T02:37:50.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.735+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=MUPV8XUA9UX6 tag=E74OYKX853MS type=write size=2853484 2024-08-27T02:37:50.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.735+0000 7f3e0cc408c0 1 < completed write operation key=8VSA6T2H8FDI tag=2S9ANXNV6HBN type=write size=826259 2024-08-27T02:37:50.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.739+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=G1MZ0RG8WAZQ type=del size=1095875 2024-08-27T02:37:50.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.739+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=4AR019L0WGHH type=del 2024-08-27T02:37:50.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.743+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~99T48J62H76F.0 size=1048576 2024-08-27T02:37:50.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.743+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~99T48J62H76F.1 size=1048576 2024-08-27T02:37:50.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.747+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~99T48J62H76F.2 size=262775 2024-08-27T02:37:50.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.747+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=99T48J62H76F tag=F4JHEZQMOQOJ type=write size=3408503 2024-08-27T02:37:50.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.747+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~Z5C45M6SGWED.0 size=792864 2024-08-27T02:37:50.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.751+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=Z5C45M6SGWED tag=6XZOBVAFK9R9 type=write size=1841440 2024-08-27T02:37:50.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.755+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~3LD6WN89IC3L.0 size=1048576 2024-08-27T02:37:50.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.755+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~3LD6WN89IC3L.1 size=601080 2024-08-27T02:37:50.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.755+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=3LD6WN89IC3L tag=QKRS9NZCNPY5 type=write size=2698232 2024-08-27T02:37:50.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.759+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=X8T3HGUCV89V type=del 2024-08-27T02:37:50.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.759+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=ZTZW17BJPW0R type=write size=359067 2024-08-27T02:37:50.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.759+0000 7f3e0cc408c0 1 < canceled part key=_multipart_4BV3C9MTIFT5.2~4FCD89DKHSPJ.0 size=1048576 2024-08-27T02:37:50.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.763+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~4FCD89DKHSPJ.1 size=1048576 2024-08-27T02:37:50.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.763+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~4FCD89DKHSPJ.2 size=416091 2024-08-27T02:37:50.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.767+0000 7f3e0cc408c0 1 < canceled multipart upload key=4BV3C9MTIFT5 upload=4FCD89DKHSPJ tag=AORS8ZOBLAW9 type=write size=3561819 2024-08-27T02:37:50.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.767+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=LP3Z13IE83SA type=del size=3878643 2024-08-27T02:37:50.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~DZPZ8CFLAKT2.0 size=1048576 2024-08-27T02:37:50.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~DZPZ8CFLAKT2.1 size=1048576 2024-08-27T02:37:50.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.771+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~DZPZ8CFLAKT2.2 size=664466 2024-08-27T02:37:50.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.775+0000 7f3e0cc408c0 1 < canceled multipart upload key=1ZIJ9JJTM4ZC upload=DZPZ8CFLAKT2 tag=XAR7MXYZ257R type=write size=3810194 2024-08-27T02:37:50.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~NQI00FYYBNZU.0 size=1048576 2024-08-27T02:37:50.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~NQI00FYYBNZU.1 size=54422 2024-08-27T02:37:50.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.779+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=NQI00FYYBNZU tag=VK7B7BBMQ5M8 type=write size=2151574 2024-08-27T02:37:50.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.783+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=IZDKYQVS21FZ type=write size=743926 2024-08-27T02:37:50.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.783+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=E9PTJ1LN8O66 type=del size=604170 2024-08-27T02:37:50.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.787+0000 7f3e0cc408c0 -1 < no bi entry to suggest for operation key=ZMN8Y0VQVHLB tag=DNNVC1T7A7DP type=del size=2739902: (2) No such file or directory 2024-08-27T02:37:50.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~FYE6635ZOQET.0 size=715390 2024-08-27T02:37:50.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.791+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=FYE6635ZOQET tag=0HMDFLWG4ABH type=write size=1763966 2024-08-27T02:37:50.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.791+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~Z5KKGQ4H6N6P.0 size=1048576 2024-08-27T02:37:50.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.791+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~Z5KKGQ4H6N6P.1 size=1048576 2024-08-27T02:37:50.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.795+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~Z5KKGQ4H6N6P.2 size=113137 2024-08-27T02:37:50.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.799+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=Z5KKGQ4H6N6P tag=5ADMGBLVTMGN type=write size=3258865 2024-08-27T02:37:50.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.799+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=VITYPZDYABMB type=del size=873533 2024-08-27T02:37:50.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.803+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~P807VIC2WUS3.0 size=580708 2024-08-27T02:37:50.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.807+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=P807VIC2WUS3 tag=OILFCKYAQV7P type=write size=1629284 2024-08-27T02:37:50.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.807+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=MB4ANNE6KPMV type=del size=2616446 2024-08-27T02:37:50.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.811+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=Q1GGBFDY229C type=del 2024-08-27T02:37:50.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.811+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=KXL8AIATVGYA type=del size=2923254 2024-08-27T02:37:50.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.815+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=AB3Z7NEW04ZC type=del 2024-08-27T02:37:50.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.815+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=1ZYZ8CCD63ZG type=write size=975928 2024-08-27T02:37:50.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.819+0000 7f3e0cc408c0 1 < canceled operation key=D7YWS7BWXT37 tag=M9GXZ4D15R01 type=del size=1374565 2024-08-27T02:37:50.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.819+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=D12A4W0U2LZK type=del size=3464970 2024-08-27T02:37:50.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.823+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~0FG9IRNJQLIX.0 size=1048576 2024-08-27T02:37:50.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.827+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~0FG9IRNJQLIX.1 size=1048576 2024-08-27T02:37:50.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.827+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~0FG9IRNJQLIX.2 size=391681 2024-08-27T02:37:50.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.831+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=0FG9IRNJQLIX tag=03X73C0QF0BC type=write size=3537409 2024-08-27T02:37:50.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~S4Y41USXMCGE.0 size=1048576 2024-08-27T02:37:50.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.839+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~S4Y41USXMCGE.1 size=1048576 2024-08-27T02:37:50.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.839+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~S4Y41USXMCGE.2 size=449929 2024-08-27T02:37:50.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.839+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=S4Y41USXMCGE tag=46ZVVA7JM5LJ type=write size=3595657 2024-08-27T02:37:50.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.839+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~9COG624P713P.0 size=1048576 2024-08-27T02:37:50.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.843+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~9COG624P713P.1 size=554394 2024-08-27T02:37:50.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.843+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=9COG624P713P tag=NKS0ZC5V10BU type=write size=2651546 2024-08-27T02:37:50.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.847+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=XERVOW99MDEW type=del size=3903803 2024-08-27T02:37:50.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.847+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~MUPV8XUA9UX6.0 size=1048576 2024-08-27T02:37:50.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~MUPV8XUA9UX6.1 size=756332 2024-08-27T02:37:50.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.855+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=MUPV8XUA9UX6 tag=E74OYKX853MS type=write size=2853484 2024-08-27T02:37:50.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.859+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~GMI8DOZ81OC8.0 size=1048576 2024-08-27T02:37:50.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.859+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~GMI8DOZ81OC8.1 size=1048576 2024-08-27T02:37:50.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.859+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~GMI8DOZ81OC8.2 size=12184 2024-08-27T02:37:50.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.859+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=GMI8DOZ81OC8 tag=U1TPZH04TNC0 type=write size=3157912 2024-08-27T02:37:50.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.863+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=G1MZ0RG8WAZQ type=del 2024-08-27T02:37:50.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.863+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=2Y7U1MAWK577 type=del size=2474078 2024-08-27T02:37:50.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~99T48J62H76F.0 size=1048576 2024-08-27T02:37:50.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~99T48J62H76F.1 size=1048576 2024-08-27T02:37:50.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.871+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~99T48J62H76F.2 size=262775 2024-08-27T02:37:50.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.875+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=99T48J62H76F tag=F4JHEZQMOQOJ type=write size=3408503 2024-08-27T02:37:50.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.875+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=7GFLEKR7PPIO type=del size=2208857 2024-08-27T02:37:50.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~3LD6WN89IC3L.0 size=1048576 2024-08-27T02:37:50.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~3LD6WN89IC3L.1 size=601080 2024-08-27T02:37:50.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.883+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=3LD6WN89IC3L tag=QKRS9NZCNPY5 type=write size=2698232 2024-08-27T02:37:50.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.887+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~GTTQKWTASWLY.0 size=1048576 2024-08-27T02:37:50.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.891+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~GTTQKWTASWLY.1 size=1048576 2024-08-27T02:37:50.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.891+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~GTTQKWTASWLY.2 size=978700 2024-08-27T02:37:50.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.891+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=GTTQKWTASWLY tag=DNUWFOISJ0PG type=write size=4124428 2024-08-27T02:37:50.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.895+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=ZTZW17BJPW0R type=write size=359067 2024-08-27T02:37:50.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~FIZZ44CBYG3T.0 size=1048576 2024-08-27T02:37:50.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~FIZZ44CBYG3T.1 size=535879 2024-08-27T02:37:50.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.899+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=FIZZ44CBYG3T tag=VKZ6N20PECTK type=write size=2633031 2024-08-27T02:37:50.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.903+0000 7f3e0cc408c0 1 < suggested remove operation key=6YTZJKE4V5HQ tag=LP3Z13IE83SA type=del 2024-08-27T02:37:50.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~H3TWIXOAI76B.0 size=1048576 2024-08-27T02:37:50.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.911+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~H3TWIXOAI76B.1 size=741048 2024-08-27T02:37:50.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.911+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=H3TWIXOAI76B tag=Q8PYBQ2T84J3 type=write size=2838200 2024-08-27T02:37:50.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.915+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~NQI00FYYBNZU.0 size=1048576 2024-08-27T02:37:50.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.915+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~NQI00FYYBNZU.1 size=54422 2024-08-27T02:37:50.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.919+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=NQI00FYYBNZU tag=VK7B7BBMQ5M8 type=write size=2151574 2024-08-27T02:37:50.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.923+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=UOYQ6G0HEKU6 type=del size=3601650 2024-08-27T02:37:50.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.923+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=E9PTJ1LN8O66 type=del 2024-08-27T02:37:50.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.927+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=C9ACMKS6IR3C type=write size=962579 2024-08-27T02:37:50.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.927+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~FYE6635ZOQET.0 size=715390 2024-08-27T02:37:50.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.931+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=FYE6635ZOQET tag=0HMDFLWG4ABH type=write size=1763966 2024-08-27T02:37:50.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~UFS20TGEQWRR.0 size=1048576 2024-08-27T02:37:50.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~UFS20TGEQWRR.1 size=695014 2024-08-27T02:37:50.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.939+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=UFS20TGEQWRR tag=S63J8Q7FDMIT type=write size=2792166 2024-08-27T02:37:50.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.939+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=VITYPZDYABMB type=del 2024-08-27T02:37:50.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.943+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=BE3TNSJIWUV3 type=del size=4098533 2024-08-27T02:37:50.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.947+0000 7f3e0cc408c0 1 < suggested update operation key=1ZIJ9JJTM4ZC tag=MB4ANNE6KPMV type=del size=2616446 2024-08-27T02:37:50.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.947+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=RCBTB32NEM3O type=del size=2481419 2024-08-27T02:37:50.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.951+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=KXL8AIATVGYA type=del 2024-08-27T02:37:50.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.955+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=SDKT0PI4GI0M type=del size=104461 2024-08-27T02:37:50.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.955+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=1ZYZ8CCD63ZG type=write size=975928 2024-08-27T02:37:50.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.959+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=CP7JQ2UT74QN type=del size=2472008 2024-08-27T02:37:50.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.963+0000 7f3e0cc408c0 1 < suggested remove operation key=SG9T1RD5EATR tag=D12A4W0U2LZK type=del 2024-08-27T02:37:50.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~TYSYLUJB2U8K.0 size=910952 2024-08-27T02:37:50.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.967+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=TYSYLUJB2U8K tag=FUTHQN30E12Z type=write size=1959528 2024-08-27T02:37:50.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.971+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~S4Y41USXMCGE.0 size=1048576 2024-08-27T02:37:50.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.971+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~S4Y41USXMCGE.1 size=1048576 2024-08-27T02:37:50.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.975+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~S4Y41USXMCGE.2 size=449929 2024-08-27T02:37:50.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.979+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=S4Y41USXMCGE tag=46ZVVA7JM5LJ type=write size=3595657 2024-08-27T02:37:50.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.983+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~UCPQ06WANUNJ.0 size=912192 2024-08-27T02:37:50.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.983+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=UCPQ06WANUNJ tag=T8RQUPLRJQLO type=write size=1960768 2024-08-27T02:37:50.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.983+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=XERVOW99MDEW type=del 2024-08-27T02:37:50.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.987+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=GYI3VOXEQS2O type=del size=898736 2024-08-27T02:37:50.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~GMI8DOZ81OC8.0 size=1048576 2024-08-27T02:37:50.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~GMI8DOZ81OC8.1 size=1048576 2024-08-27T02:37:50.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.995+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~GMI8DOZ81OC8.2 size=12184 2024-08-27T02:37:50.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.999+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=GMI8DOZ81OC8 tag=U1TPZH04TNC0 type=write size=3157912 2024-08-27T02:37:50.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:50.999+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=B0J310LTDSOT type=del size=1210 2024-08-27T02:37:51.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.003+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=2Y7U1MAWK577 type=del 2024-08-27T02:37:51.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.003+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=EG2DEETO61X3 type=del size=1766388 2024-08-27T02:37:51.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.011+0000 7f3e0cc408c0 1 < suggested remove operation key=KTPZGZSQCERQ tag=7GFLEKR7PPIO type=del 2024-08-27T02:37:51.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.015+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~AUOX07HOMYR0.0 size=1048576 2024-08-27T02:37:51.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.015+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~AUOX07HOMYR0.1 size=655198 2024-08-27T02:37:51.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.015+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=AUOX07HOMYR0 tag=NTEAHY3K85ED type=write size=2752350 2024-08-27T02:37:51.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~GTTQKWTASWLY.0 size=1048576 2024-08-27T02:37:51.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~GTTQKWTASWLY.1 size=1048576 2024-08-27T02:37:51.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~GTTQKWTASWLY.2 size=978700 2024-08-27T02:37:51.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.027+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=GTTQKWTASWLY tag=DNUWFOISJ0PG type=write size=4124428 2024-08-27T02:37:51.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.031+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~J2M160R0CFBK.0 size=1048576 2024-08-27T02:37:51.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.031+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~J2M160R0CFBK.1 size=96393 2024-08-27T02:37:51.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.031+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=J2M160R0CFBK tag=NT366BFT8IXU type=write size=2193545 2024-08-27T02:37:51.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~FIZZ44CBYG3T.0 size=1048576 2024-08-27T02:37:51.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~FIZZ44CBYG3T.1 size=535879 2024-08-27T02:37:51.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.039+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=FIZZ44CBYG3T tag=VKZ6N20PECTK type=write size=2633031 2024-08-27T02:37:51.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.043+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=GW34Y3103SG0 type=del size=553006 2024-08-27T02:37:51.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~H3TWIXOAI76B.0 size=1048576 2024-08-27T02:37:51.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~H3TWIXOAI76B.1 size=741048 2024-08-27T02:37:51.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.051+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=H3TWIXOAI76B tag=Q8PYBQ2T84J3 type=write size=2838200 2024-08-27T02:37:51.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.055+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=NSE55PH9IDBA type=del size=3678586 2024-08-27T02:37:51.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.055+0000 7f3e0cc408c0 -1 < failed to complete operation key=KTPZGZSQCERQ tag=UOYQ6G0HEKU6 type=del size=3601650: (22) Invalid argument 2024-08-27T02:37:51.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.059+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~GZ1CV8SPAKMZ.0 size=522458 2024-08-27T02:37:51.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.059+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=GZ1CV8SPAKMZ tag=26XRU5AUGN6P type=write size=1571034 2024-08-27T02:37:51.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.063+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=C9ACMKS6IR3C type=write size=962579 2024-08-27T02:37:51.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.067+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~PQN9VYYR2YVS.0 size=275628 2024-08-27T02:37:51.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.067+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=PQN9VYYR2YVS tag=XGOIMPLCBU8U type=write size=1324204 2024-08-27T02:37:51.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~UFS20TGEQWRR.0 size=1048576 2024-08-27T02:37:51.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.071+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~UFS20TGEQWRR.1 size=695014 2024-08-27T02:37:51.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.075+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=UFS20TGEQWRR tag=S63J8Q7FDMIT type=write size=2792166 2024-08-27T02:37:51.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.079+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=2N48VC4X51IZ type=del size=4046013 2024-08-27T02:37:51.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.083+0000 7f3e0cc408c0 1 < suggested update operation key=6YTZJKE4V5HQ tag=BE3TNSJIWUV3 type=del size=4098533 2024-08-27T02:37:51.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.087+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~SA19HOP7EBUP.0 size=178050 2024-08-27T02:37:51.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.087+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=SA19HOP7EBUP tag=2QRW0A0JPLDG type=write size=1226626 2024-08-27T02:37:51.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.087+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=RCBTB32NEM3O type=del 2024-08-27T02:37:51.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.091+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=1JGKSCU29WB9 type=del size=611731 2024-08-27T02:37:51.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.091+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=SDKT0PI4GI0M type=del 2024-08-27T02:37:51.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~TN4JGBBQUY05.0 size=1048576 2024-08-27T02:37:51.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~TN4JGBBQUY05.1 size=1048576 2024-08-27T02:37:51.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~TN4JGBBQUY05.2 size=52314 2024-08-27T02:37:51.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.099+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=TN4JGBBQUY05 tag=2NGSU3KEOLX8 type=write size=3198042 2024-08-27T02:37:51.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.103+0000 7f3e0cc408c0 -1 < failed to complete operation key=KTPZGZSQCERQ tag=CP7JQ2UT74QN type=del size=2472008: (22) Invalid argument 2024-08-27T02:37:51.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~BRPJRF9E1INK.0 size=1048576 2024-08-27T02:37:51.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~BRPJRF9E1INK.1 size=743172 2024-08-27T02:37:51.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.107+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=BRPJRF9E1INK tag=SL6TA2OCG5UC type=write size=2840324 2024-08-27T02:37:51.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.111+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~TYSYLUJB2U8K.0 size=910952 2024-08-27T02:37:51.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.115+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=TYSYLUJB2U8K tag=FUTHQN30E12Z type=write size=1959528 2024-08-27T02:37:51.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.119+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=PF0ADZVDTJNT type=del size=3904856 2024-08-27T02:37:51.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~UCPQ06WANUNJ.0 size=912192 2024-08-27T02:37:51.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.123+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=UCPQ06WANUNJ tag=T8RQUPLRJQLO type=write size=1960768 2024-08-27T02:37:51.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.127+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=MGI4G7MB5J5H type=write size=6689 2024-08-27T02:37:51.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.127+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=GYI3VOXEQS2O type=del 2024-08-27T02:37:51.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.131+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=5GLZB35R7QHO type=write size=3031 2024-08-27T02:37:51.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.135+0000 7f3e0cc408c0 1 < suggested update operation key=B9DPI871LQ7E tag=B0J310LTDSOT type=del size=1210 2024-08-27T02:37:51.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.139+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=09XXQDGWGLNC type=del size=3795798 2024-08-27T02:37:51.141 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.143+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=EG2DEETO61X3 type=del 2024-08-27T02:37:51.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.143+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=NEO8CZBNZEH4 type=write size=711820 2024-08-27T02:37:51.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.147+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~AUOX07HOMYR0.0 size=1048576 2024-08-27T02:37:51.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.151+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~AUOX07HOMYR0.1 size=655198 2024-08-27T02:37:51.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.155+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=AUOX07HOMYR0 tag=NTEAHY3K85ED type=write size=2752350 2024-08-27T02:37:51.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.155+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=NI00L6U0R46S type=del size=2078328 2024-08-27T02:37:51.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~J2M160R0CFBK.0 size=1048576 2024-08-27T02:37:51.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~J2M160R0CFBK.1 size=96393 2024-08-27T02:37:51.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.163+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=J2M160R0CFBK tag=NT366BFT8IXU type=write size=2193545 2024-08-27T02:37:51.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.167+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=F4AJ23Y5CXYE type=del size=3542841 2024-08-27T02:37:51.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.171+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=GW34Y3103SG0 type=del 2024-08-27T02:37:51.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~ZY67SBZJW71F.0 size=1048576 2024-08-27T02:37:51.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~ZY67SBZJW71F.1 size=1048576 2024-08-27T02:37:51.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.179+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~ZY67SBZJW71F.2 size=897450 2024-08-27T02:37:51.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.179+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=ZY67SBZJW71F tag=N3OPTDGD36KT type=write size=4043178 2024-08-27T02:37:51.179 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.179+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=NSE55PH9IDBA type=del 2024-08-27T02:37:51.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.183+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~K2MASHIWD30X.0 size=1048576 2024-08-27T02:37:51.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~K2MASHIWD30X.1 size=1048576 2024-08-27T02:37:51.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~K2MASHIWD30X.2 size=694203 2024-08-27T02:37:51.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.187+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=K2MASHIWD30X tag=MAE2G7C1RE9R type=write size=3839931 2024-08-27T02:37:51.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.191+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~GZ1CV8SPAKMZ.0 size=522458 2024-08-27T02:37:51.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.195+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=GZ1CV8SPAKMZ tag=26XRU5AUGN6P type=write size=1571034 2024-08-27T02:37:51.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.199+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=14P7OMNTBHHB type=del size=739674 2024-08-27T02:37:51.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.199+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~PQN9VYYR2YVS.0 size=275628 2024-08-27T02:37:51.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.203+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=PQN9VYYR2YVS tag=XGOIMPLCBU8U type=write size=1324204 2024-08-27T02:37:51.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.207+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=APDMEYVU0REI type=del size=1573115 2024-08-27T02:37:51.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.211+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=2N48VC4X51IZ type=del 2024-08-27T02:37:51.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.211+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=BNTHFNFH11JP type=del size=4080197 2024-08-27T02:37:51.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.215+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~SA19HOP7EBUP.0 size=178050 2024-08-27T02:37:51.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.219+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=SA19HOP7EBUP tag=2QRW0A0JPLDG type=write size=1226626 2024-08-27T02:37:51.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.223+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=VMN8N21YXMTS type=write size=536176 2024-08-27T02:37:51.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.227+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=1JGKSCU29WB9 type=del 2024-08-27T02:37:51.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.227+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=YUSFXC08VNZ0 type=del size=3689422 2024-08-27T02:37:51.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.227+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0U59R3BXL181.2~TN4JGBBQUY05.0 size=1048576 2024-08-27T02:37:51.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.227+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0U59R3BXL181.2~TN4JGBBQUY05.1 size=1048576 2024-08-27T02:37:51.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~TN4JGBBQUY05.2 size=52314 2024-08-27T02:37:51.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.235+0000 7f3e0cc408c0 1 < canceled multipart upload key=0U59R3BXL181 upload=TN4JGBBQUY05 tag=2NGSU3KEOLX8 type=write size=3198042 2024-08-27T02:37:51.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.243+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~BL1ZFNFNE0IG.0 size=83558 2024-08-27T02:37:51.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.243+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=BL1ZFNFNE0IG tag=1519535JLHC3 type=write size=1132134 2024-08-27T02:37:51.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~BRPJRF9E1INK.0 size=1048576 2024-08-27T02:37:51.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~BRPJRF9E1INK.1 size=743172 2024-08-27T02:37:51.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.255+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=BRPJRF9E1INK tag=SL6TA2OCG5UC type=write size=2840324 2024-08-27T02:37:51.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~ODAXF36NEJ3W.0 size=260784 2024-08-27T02:37:51.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.259+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=ODAXF36NEJ3W tag=D7ARXR3PQ02I type=write size=1309360 2024-08-27T02:37:51.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.259+0000 7f3e0cc408c0 -1 < failed to complete operation key=B9DPI871LQ7E tag=PF0ADZVDTJNT type=del size=3904856: (22) Invalid argument 2024-08-27T02:37:51.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.263+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=IJZS0RNRN1CA type=write size=186033 2024-08-27T02:37:51.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.267+0000 7f3e0cc408c0 1 < completed write operation key=IISECLYEAR19 tag=MGI4G7MB5J5H type=write size=6689 2024-08-27T02:37:51.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.267+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=WFRN997KHRNB type=del size=2059667 2024-08-27T02:37:51.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.275+0000 7f3e0cc408c0 1 < suggested update operation key=4BV3C9MTIFT5 tag=5GLZB35R7QHO type=write size=3031 2024-08-27T02:37:51.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.275+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=AIK4994U7CCJ type=del size=6886 2024-08-27T02:37:51.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.279+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=09XXQDGWGLNC type=del 2024-08-27T02:37:51.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.279+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=0P59DPGY5918 type=del size=1736230 2024-08-27T02:37:51.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.283+0000 7f3e0cc408c0 1 < completed write operation key=UGSWC9ZK9S7S tag=NEO8CZBNZEH4 type=write size=711820 2024-08-27T02:37:51.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.287+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~XR7G9NTR3MKA.0 size=1048576 2024-08-27T02:37:51.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.291+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~XR7G9NTR3MKA.1 size=335133 2024-08-27T02:37:51.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.291+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=XR7G9NTR3MKA tag=STTSHH9QE4G8 type=write size=2432285 2024-08-27T02:37:51.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.291+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=NI00L6U0R46S type=del 2024-08-27T02:37:51.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~YOVGUCT2O60M.0 size=1048576 2024-08-27T02:37:51.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~YOVGUCT2O60M.1 size=1048576 2024-08-27T02:37:51.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~YOVGUCT2O60M.2 size=406201 2024-08-27T02:37:51.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.299+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=YOVGUCT2O60M tag=BQTD4AWW1X6P type=write size=3551929 2024-08-27T02:37:51.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.307+0000 7f3e0cc408c0 1 < suggested update operation key=XBURHQSU6IML tag=F4AJ23Y5CXYE type=del size=3542841 2024-08-27T02:37:51.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.307+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=W45RLNNVNK9C type=del size=9260 2024-08-27T02:37:51.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.307+0000 7f3e0cc408c0 1 < canceled part key=_multipart_MKB40KOOCCNT.2~ZY67SBZJW71F.0 size=1048576 2024-08-27T02:37:51.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~ZY67SBZJW71F.1 size=1048576 2024-08-27T02:37:51.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~ZY67SBZJW71F.2 size=897450 2024-08-27T02:37:51.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.315+0000 7f3e0cc408c0 1 < canceled multipart upload key=MKB40KOOCCNT upload=ZY67SBZJW71F tag=N3OPTDGD36KT type=write size=4043178 2024-08-27T02:37:51.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.319+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~P0TVIP7XW9MU.0 size=1048576 2024-08-27T02:37:51.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~P0TVIP7XW9MU.1 size=1048576 2024-08-27T02:37:51.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~P0TVIP7XW9MU.2 size=901247 2024-08-27T02:37:51.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.323+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=P0TVIP7XW9MU tag=A84OTA0EJFCN type=write size=4046975 2024-08-27T02:37:51.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.327+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~K2MASHIWD30X.0 size=1048576 2024-08-27T02:37:51.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.327+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~K2MASHIWD30X.1 size=1048576 2024-08-27T02:37:51.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~K2MASHIWD30X.2 size=694203 2024-08-27T02:37:51.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.335+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=K2MASHIWD30X tag=MAE2G7C1RE9R type=write size=3839931 2024-08-27T02:37:51.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.343+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~7LO2XUIN4BW1.0 size=1048576 2024-08-27T02:37:51.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.343+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~7LO2XUIN4BW1.1 size=1048576 2024-08-27T02:37:51.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.347+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~7LO2XUIN4BW1.2 size=755454 2024-08-27T02:37:51.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.347+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=7LO2XUIN4BW1 tag=L3HOBFLAM0UU type=write size=3901182 2024-08-27T02:37:51.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.351+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=14P7OMNTBHHB type=del 2024-08-27T02:37:51.355 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.355+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~0ATI6A8U65UK.0 size=1048576 2024-08-27T02:37:51.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.359+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~0ATI6A8U65UK.1 size=1048576 2024-08-27T02:37:51.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.359+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~0ATI6A8U65UK.2 size=531907 2024-08-27T02:37:51.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.359+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=0ATI6A8U65UK tag=KS3H5FNB5HAM type=write size=3677635 2024-08-27T02:37:51.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.363+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=APDMEYVU0REI type=del 2024-08-27T02:37:51.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~ECQD83JRHLHI.0 size=415682 2024-08-27T02:37:51.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.367+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=ECQD83JRHLHI tag=Q3B1D0RDLYWA type=write size=1464258 2024-08-27T02:37:51.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.371+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=BNTHFNFH11JP type=del 2024-08-27T02:37:51.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.375+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~MGFFA9HQMTBE.0 size=765511 2024-08-27T02:37:51.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.375+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=MGFFA9HQMTBE tag=QPZ6OTFM4E0B type=write size=1814087 2024-08-27T02:37:51.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.379+0000 7f3e0cc408c0 1 < canceled operation key=VSDJU5KQLFKE tag=VMN8N21YXMTS type=write size=536176 2024-08-27T02:37:51.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~LSSD9TG30IF2.0 size=1048576 2024-08-27T02:37:51.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~LSSD9TG30IF2.1 size=844567 2024-08-27T02:37:51.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.387+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=LSSD9TG30IF2 tag=VHTY8QMUY8RV type=write size=2941719 2024-08-27T02:37:51.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.391+0000 7f3e0cc408c0 -1 < failed to complete operation key=4BV3C9MTIFT5 tag=YUSFXC08VNZ0 type=del size=3689422: (22) Invalid argument 2024-08-27T02:37:51.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.395+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~88ZNGOFQO6KT.0 size=1048576 2024-08-27T02:37:51.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.395+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~88ZNGOFQO6KT.1 size=853775 2024-08-27T02:37:51.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.395+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=88ZNGOFQO6KT tag=M60L9K6U091R type=write size=2950927 2024-08-27T02:37:51.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.399+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~BL1ZFNFNE0IG.0 size=83558 2024-08-27T02:37:51.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.403+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=BL1ZFNFNE0IG tag=1519535JLHC3 type=write size=1132134 2024-08-27T02:37:51.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.407+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=TZF9EGVWLSAG type=del size=2351497 2024-08-27T02:37:51.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~ODAXF36NEJ3W.0 size=260784 2024-08-27T02:37:51.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.415+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=ODAXF36NEJ3W tag=D7ARXR3PQ02I type=write size=1309360 2024-08-27T02:37:51.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.419+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=39VLBJMKOWYR type=del size=2617887 2024-08-27T02:37:51.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.419+0000 7f3e0cc408c0 1 < completed write operation key=SG9T1RD5EATR tag=IJZS0RNRN1CA type=write size=186033 2024-08-27T02:37:51.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.423+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=DIRUABHO6HMO type=write size=214487 2024-08-27T02:37:51.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.427+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=WFRN997KHRNB type=del 2024-08-27T02:37:51.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.431+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~GTWEXNFXYJM2.0 size=1048576 2024-08-27T02:37:51.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.431+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~GTWEXNFXYJM2.1 size=1048576 2024-08-27T02:37:51.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.435+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~GTWEXNFXYJM2.2 size=365778 2024-08-27T02:37:51.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.435+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=GTWEXNFXYJM2 tag=YPQM6FQMKP11 type=write size=3511506 2024-08-27T02:37:51.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.439+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=AIK4994U7CCJ type=del 2024-08-27T02:37:51.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.439+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=89RPUQHNS14E type=del size=3844210 2024-08-27T02:37:51.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.443+0000 7f3e0cc408c0 1 < canceled operation key=B9DPI871LQ7E tag=0P59DPGY5918 type=del size=1736230 2024-08-27T02:37:51.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.447+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=32GGZ4IFAHFC type=del size=4007931 2024-08-27T02:37:51.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~XR7G9NTR3MKA.0 size=1048576 2024-08-27T02:37:51.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~XR7G9NTR3MKA.1 size=335133 2024-08-27T02:37:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.455+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=XR7G9NTR3MKA tag=STTSHH9QE4G8 type=write size=2432285 2024-08-27T02:37:51.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.459+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=K8Q4WQ3MW2D1 type=write size=556220 2024-08-27T02:37:51.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.463+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~YOVGUCT2O60M.0 size=1048576 2024-08-27T02:37:51.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.467+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~YOVGUCT2O60M.1 size=1048576 2024-08-27T02:37:51.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.471+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~YOVGUCT2O60M.2 size=406201 2024-08-27T02:37:51.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.475+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=YOVGUCT2O60M tag=BQTD4AWW1X6P type=write size=3551929 2024-08-27T02:37:51.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.479+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=9WVU7KKIYB5P type=del size=2936220 2024-08-27T02:37:51.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.483+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=W45RLNNVNK9C type=del 2024-08-27T02:37:51.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.487+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~O39JOFU252PH.0 size=42877 2024-08-27T02:37:51.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.487+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=O39JOFU252PH tag=VS0MBVL7LFQ5 type=write size=1091453 2024-08-27T02:37:51.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.487+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~P0TVIP7XW9MU.0 size=1048576 2024-08-27T02:37:51.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.491+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~P0TVIP7XW9MU.1 size=1048576 2024-08-27T02:37:51.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.491+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~P0TVIP7XW9MU.2 size=901247 2024-08-27T02:37:51.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.495+0000 7f3e0cc408c0 1 < canceled multipart upload key=1ZIJ9JJTM4ZC upload=P0TVIP7XW9MU tag=A84OTA0EJFCN type=write size=4046975 2024-08-27T02:37:51.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.499+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=F2CDAH1ZXTWA type=del size=3809775 2024-08-27T02:37:51.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.503+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~7LO2XUIN4BW1.0 size=1048576 2024-08-27T02:37:51.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.507+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~7LO2XUIN4BW1.1 size=1048576 2024-08-27T02:37:51.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.507+0000 7f3e0cc408c0 1 < canceled part key=_multipart_2CXWPDABA9XJ.2~7LO2XUIN4BW1.2 size=755454 2024-08-27T02:37:51.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.511+0000 7f3e0cc408c0 1 < canceled multipart upload key=2CXWPDABA9XJ upload=7LO2XUIN4BW1 tag=L3HOBFLAM0UU type=write size=3901182 2024-08-27T02:37:51.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.515+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=BYE77JE2WS2N type=write size=782707 2024-08-27T02:37:51.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.519+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~0ATI6A8U65UK.0 size=1048576 2024-08-27T02:37:51.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.519+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~0ATI6A8U65UK.1 size=1048576 2024-08-27T02:37:51.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.523+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~0ATI6A8U65UK.2 size=531907 2024-08-27T02:37:51.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.527+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=0ATI6A8U65UK tag=KS3H5FNB5HAM type=write size=3677635 2024-08-27T02:37:51.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~OADDP1B26OL7.0 size=1048576 2024-08-27T02:37:51.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~OADDP1B26OL7.1 size=1048576 2024-08-27T02:37:51.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~OADDP1B26OL7.2 size=411981 2024-08-27T02:37:51.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.539+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=OADDP1B26OL7 tag=6AZ0OXROE5MU type=write size=3557709 2024-08-27T02:37:51.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.543+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~ECQD83JRHLHI.0 size=415682 2024-08-27T02:37:51.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.551+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=ECQD83JRHLHI tag=Q3B1D0RDLYWA type=write size=1464258 2024-08-27T02:37:51.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.551+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=SNLAS5L6LXH8 type=del size=2093296 2024-08-27T02:37:51.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.555+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~MGFFA9HQMTBE.0 size=765511 2024-08-27T02:37:51.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.559+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=MGFFA9HQMTBE tag=QPZ6OTFM4E0B type=write size=1814087 2024-08-27T02:37:51.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.563+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=S1FOS5Q0UUIA type=write size=714143 2024-08-27T02:37:51.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.563+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~LSSD9TG30IF2.0 size=1048576 2024-08-27T02:37:51.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.567+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~LSSD9TG30IF2.1 size=844567 2024-08-27T02:37:51.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.571+0000 7f3e0cc408c0 1 < canceled multipart upload key=1ZIJ9JJTM4ZC upload=LSSD9TG30IF2 tag=VHTY8QMUY8RV type=write size=2941719 2024-08-27T02:37:51.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.575+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=34SWJ46CBK2N type=del size=607733 2024-08-27T02:37:51.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~88ZNGOFQO6KT.0 size=1048576 2024-08-27T02:37:51.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.579+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~88ZNGOFQO6KT.1 size=853775 2024-08-27T02:37:51.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.583+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=88ZNGOFQO6KT tag=M60L9K6U091R type=write size=2950927 2024-08-27T02:37:51.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.591+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~I56UEHKCPOMV.0 size=531815 2024-08-27T02:37:51.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.591+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=I56UEHKCPOMV tag=HR750JRNUDBS type=write size=1580391 2024-08-27T02:37:51.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.595+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=TZF9EGVWLSAG type=del 2024-08-27T02:37:51.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.595+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=ZSTPBNLW8SJQ type=del size=2322069 2024-08-27T02:37:51.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.599+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=39VLBJMKOWYR type=del 2024-08-27T02:37:51.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.603+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=2800JLMJSQUU type=del size=3223333 2024-08-27T02:37:51.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.607+0000 7f3e0cc408c0 1 < completed write operation key=KTPZGZSQCERQ tag=DIRUABHO6HMO type=write size=214487 2024-08-27T02:37:51.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.611+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~6GORNCNS6ZS2.0 size=798396 2024-08-27T02:37:51.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.611+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=6GORNCNS6ZS2 tag=865Y0RRNG39Q type=write size=1846972 2024-08-27T02:37:51.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.615+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~GTWEXNFXYJM2.0 size=1048576 2024-08-27T02:37:51.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~GTWEXNFXYJM2.1 size=1048576 2024-08-27T02:37:51.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~GTWEXNFXYJM2.2 size=365778 2024-08-27T02:37:51.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.627+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=GTWEXNFXYJM2 tag=YPQM6FQMKP11 type=write size=3511506 2024-08-27T02:37:51.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.631+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~MJ4WD3KV5YHI.0 size=1048576 2024-08-27T02:37:51.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~MJ4WD3KV5YHI.1 size=81158 2024-08-27T02:37:51.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.635+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=MJ4WD3KV5YHI tag=5HKLCEEDK64Z type=write size=2178310 2024-08-27T02:37:51.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.639+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=89RPUQHNS14E type=del 2024-08-27T02:37:51.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.639+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=SON0HUU1TL9D type=del size=4164132 2024-08-27T02:37:51.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.643+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=32GGZ4IFAHFC type=del 2024-08-27T02:37:51.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.651+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~CMC8MQ14F63K.0 size=6415 2024-08-27T02:37:51.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.651+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=CMC8MQ14F63K tag=G65EPE8PQTCX type=write size=1054991 2024-08-27T02:37:51.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.655+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=K8Q4WQ3MW2D1 type=write size=556220 2024-08-27T02:37:51.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.659+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=Q2NU5UZ5HXY1 type=del size=603801 2024-08-27T02:37:51.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.663+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=9WVU7KKIYB5P type=del 2024-08-27T02:37:51.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.663+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=ZB7JJAS9L39U type=del size=1344742 2024-08-27T02:37:51.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.667+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~O39JOFU252PH.0 size=42877 2024-08-27T02:37:51.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.675+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=O39JOFU252PH tag=VS0MBVL7LFQ5 type=write size=1091453 2024-08-27T02:37:51.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.675+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=654AZN58TP22 type=del size=3129057 2024-08-27T02:37:51.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.679+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=F2CDAH1ZXTWA type=del 2024-08-27T02:37:51.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.683+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=CCUQGVVSCOBE type=del size=1116404 2024-08-27T02:37:51.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.687+0000 7f3e0cc408c0 1 < completed write operation key=6QE1HU65GQZZ tag=BYE77JE2WS2N type=write size=782707 2024-08-27T02:37:51.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.691+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=PXED26O6Q78I type=del size=3525625 2024-08-27T02:37:51.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.691+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~OADDP1B26OL7.0 size=1048576 2024-08-27T02:37:51.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.695+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~OADDP1B26OL7.1 size=1048576 2024-08-27T02:37:51.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.699+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~OADDP1B26OL7.2 size=411981 2024-08-27T02:37:51.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.703+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=OADDP1B26OL7 tag=6AZ0OXROE5MU type=write size=3557709 2024-08-27T02:37:51.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.707+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=0SQROU2WDFKA type=del size=414499 2024-08-27T02:37:51.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.711+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=SNLAS5L6LXH8 type=del 2024-08-27T02:37:51.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.715+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=HV5P682OKZVR type=del size=1964708 2024-08-27T02:37:51.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.719+0000 7f3e0cc408c0 1 < completed write operation key=8VSA6T2H8FDI tag=S1FOS5Q0UUIA type=write size=714143 2024-08-27T02:37:51.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.723+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=7KEPD0XNK17C type=del size=1608736 2024-08-27T02:37:51.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.727+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=34SWJ46CBK2N type=del 2024-08-27T02:37:51.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.731+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=QSX1C3ERES9V type=del size=2702869 2024-08-27T02:37:51.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.731+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~I56UEHKCPOMV.0 size=531815 2024-08-27T02:37:51.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.739+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=I56UEHKCPOMV tag=HR750JRNUDBS type=write size=1580391 2024-08-27T02:37:51.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.743+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=VCCAZ35ZE5CE type=del size=1681135 2024-08-27T02:37:51.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.743+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=ZSTPBNLW8SJQ type=del 2024-08-27T02:37:51.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.747+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=3XQIM9GBAB8Z type=del size=275056 2024-08-27T02:37:51.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.751+0000 7f3e0cc408c0 1 < canceled operation key=D7YWS7BWXT37 tag=2800JLMJSQUU type=del size=3223333 2024-08-27T02:37:51.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.755+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~80N8467JG1E7.0 size=185105 2024-08-27T02:37:51.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.755+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=80N8467JG1E7 tag=8KY6F3AZ0DH7 type=write size=1233681 2024-08-27T02:37:51.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.759+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~6GORNCNS6ZS2.0 size=798396 2024-08-27T02:37:51.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.763+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=6GORNCNS6ZS2 tag=865Y0RRNG39Q type=write size=1846972 2024-08-27T02:37:51.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.767+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=TMEMGS42UR8H type=del size=2210845 2024-08-27T02:37:51.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~MJ4WD3KV5YHI.0 size=1048576 2024-08-27T02:37:51.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.771+0000 7f3e0cc408c0 1 < canceled part key=_multipart_KTPZGZSQCERQ.2~MJ4WD3KV5YHI.1 size=81158 2024-08-27T02:37:51.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.775+0000 7f3e0cc408c0 1 < canceled multipart upload key=KTPZGZSQCERQ upload=MJ4WD3KV5YHI tag=5HKLCEEDK64Z type=write size=2178310 2024-08-27T02:37:51.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.783+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~MNBMVY7ZAY5H.0 size=1048576 2024-08-27T02:37:51.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~MNBMVY7ZAY5H.1 size=1048576 2024-08-27T02:37:51.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~MNBMVY7ZAY5H.2 size=672328 2024-08-27T02:37:51.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.787+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=MNBMVY7ZAY5H tag=E8B4HE0CC81U type=write size=3818056 2024-08-27T02:37:51.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.791+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=SON0HUU1TL9D type=del 2024-08-27T02:37:51.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.795+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=JWWUKLKJP5WV type=write size=447185 2024-08-27T02:37:51.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.799+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~CMC8MQ14F63K.0 size=6415 2024-08-27T02:37:51.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.803+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=CMC8MQ14F63K tag=G65EPE8PQTCX type=write size=1054991 2024-08-27T02:37:51.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.807+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=PSPMN91QVZTV type=del size=3364935 2024-08-27T02:37:51.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.815+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=Q2NU5UZ5HXY1 type=del 2024-08-27T02:37:51.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.819+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=WWP7PYHJDLR3 type=write size=170991 2024-08-27T02:37:51.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.823+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=ZB7JJAS9L39U type=del 2024-08-27T02:37:51.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.827+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=HP74AZ7HHNY8 type=del size=4183062 2024-08-27T02:37:51.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.831+0000 7f3e0cc408c0 1 < suggested remove operation key=B9DPI871LQ7E tag=654AZN58TP22 type=del 2024-08-27T02:37:51.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.835+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=NRFIPBSF5ZK5 type=del size=570975 2024-08-27T02:37:51.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.839+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=CCUQGVVSCOBE type=del 2024-08-27T02:37:51.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.839+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=M5IRKJ3SAJU7 type=write size=503234 2024-08-27T02:37:51.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.843+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=PXED26O6Q78I type=del 2024-08-27T02:37:51.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~C9R7MBJTIIFT.0 size=1048576 2024-08-27T02:37:51.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~C9R7MBJTIIFT.1 size=38124 2024-08-27T02:37:51.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.851+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=C9R7MBJTIIFT tag=GZ4KIO04EIN6 type=write size=2135276 2024-08-27T02:37:51.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.855+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=0SQROU2WDFKA type=del 2024-08-27T02:37:51.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.859+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=DGPW6B35HMH8 type=del size=3292018 2024-08-27T02:37:51.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.863+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=HV5P682OKZVR type=del 2024-08-27T02:37:51.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.863+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=DW4LAKH2A425 type=write size=578355 2024-08-27T02:37:51.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.867+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=7KEPD0XNK17C type=del 2024-08-27T02:37:51.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~759QCX77AZX0.0 size=1037218 2024-08-27T02:37:51.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.875+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=759QCX77AZX0 tag=3VG7ER4F2PYE type=write size=2085794 2024-08-27T02:37:51.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.879+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=QSX1C3ERES9V type=del 2024-08-27T02:37:51.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.879+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=9BWBSO1OV77W type=del size=2312786 2024-08-27T02:37:51.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.883+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=VCCAZ35ZE5CE type=del 2024-08-27T02:37:51.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.887+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=KONB0NQCVHSB type=del size=2693528 2024-08-27T02:37:51.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.895+0000 7f3e0cc408c0 1 < suggested update operation key=QVG1NTF6O8L2 tag=3XQIM9GBAB8Z type=del size=275056 2024-08-27T02:37:51.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.899+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=3G4RF5PVVWFU type=del size=2548720 2024-08-27T02:37:51.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.899+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JDV1RIGAO7J1.2~80N8467JG1E7.0 size=185105 2024-08-27T02:37:51.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.903+0000 7f3e0cc408c0 1 < canceled multipart upload key=JDV1RIGAO7J1 upload=80N8467JG1E7 tag=8KY6F3AZ0DH7 type=write size=1233681 2024-08-27T02:37:51.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.907+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=U3X5XGC0U6J3 type=write size=682553 2024-08-27T02:37:51.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.911+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=TMEMGS42UR8H type=del 2024-08-27T02:37:51.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.911+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=W9YYE7H2PMS1 type=del size=685615 2024-08-27T02:37:51.918 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.915+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~MNBMVY7ZAY5H.0 size=1048576 2024-08-27T02:37:51.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.919+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~MNBMVY7ZAY5H.1 size=1048576 2024-08-27T02:37:51.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.923+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~MNBMVY7ZAY5H.2 size=672328 2024-08-27T02:37:51.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.931+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=MNBMVY7ZAY5H tag=E8B4HE0CC81U type=write size=3818056 2024-08-27T02:37:51.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~56436AE615MC.0 size=877132 2024-08-27T02:37:51.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.935+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=56436AE615MC tag=4Q9S27F9VIG9 type=write size=1925708 2024-08-27T02:37:51.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.939+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=JWWUKLKJP5WV type=write size=447185 2024-08-27T02:37:51.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.943+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=6UAC6ZMQ5KN0 type=del size=2469568 2024-08-27T02:37:51.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.947+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=PSPMN91QVZTV type=del 2024-08-27T02:37:51.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.955+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~YZL9FVRDYHOT.0 size=750534 2024-08-27T02:37:51.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.955+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=YZL9FVRDYHOT tag=H0XI7BNGZNVZ type=write size=1799110 2024-08-27T02:37:51.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.959+0000 7f3e0cc408c0 1 < suggested update operation key=A0RUXE4YL6NR tag=WWP7PYHJDLR3 type=write size=170991 2024-08-27T02:37:51.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.963+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~1CU45BOCTB89.0 size=1048576 2024-08-27T02:37:51.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~1CU45BOCTB89.1 size=113487 2024-08-27T02:37:51.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.967+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=1CU45BOCTB89 tag=N0D3AL3UAH4J type=write size=2210639 2024-08-27T02:37:51.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.971+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=HP74AZ7HHNY8 type=del 2024-08-27T02:37:51.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.975+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=D00A3NSSQ9MG type=del size=527663 2024-08-27T02:37:51.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.979+0000 7f3e0cc408c0 1 < suggested remove operation key=F4MCLPFLY531 tag=NRFIPBSF5ZK5 type=del 2024-08-27T02:37:51.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.983+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=2WZOA8BNDD67 type=write size=820323 2024-08-27T02:37:51.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.987+0000 7f3e0cc408c0 1 < completed write operation key=1ZIJ9JJTM4ZC tag=M5IRKJ3SAJU7 type=write size=503234 2024-08-27T02:37:51.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.991+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=A5N2AXH6QG42 type=del size=4114411 2024-08-27T02:37:51.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~C9R7MBJTIIFT.0 size=1048576 2024-08-27T02:37:51.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.995+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~C9R7MBJTIIFT.1 size=38124 2024-08-27T02:37:52.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:51.999+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=C9R7MBJTIIFT tag=GZ4KIO04EIN6 type=write size=2135276 2024-08-27T02:37:52.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~LA9U3MT9TZW3.0 size=1048576 2024-08-27T02:37:52.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~LA9U3MT9TZW3.1 size=818903 2024-08-27T02:37:52.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.007+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=LA9U3MT9TZW3 tag=H03N3GLQF779 type=write size=2916055 2024-08-27T02:37:52.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.015+0000 7f3e0cc408c0 1 < suggested update operation key=PLC076BXR38P tag=DGPW6B35HMH8 type=del size=3292018 2024-08-27T02:37:52.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.019+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=CZADIN12H5R8 type=del size=785009 2024-08-27T02:37:52.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.019+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=DW4LAKH2A425 type=write size=578355 2024-08-27T02:37:52.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.023+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=MP5YNTYFXHR9 type=del size=286172 2024-08-27T02:37:52.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.027+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~759QCX77AZX0.0 size=1037218 2024-08-27T02:37:52.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.031+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=759QCX77AZX0 tag=3VG7ER4F2PYE type=write size=2085794 2024-08-27T02:37:52.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.035+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=S8PH3J6UG296 type=del size=283934 2024-08-27T02:37:52.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.039+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=9BWBSO1OV77W type=del 2024-08-27T02:37:52.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.043+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=34AWPGVKTPEF type=write size=639530 2024-08-27T02:37:52.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.043+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=KONB0NQCVHSB type=del 2024-08-27T02:37:52.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.047+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=DFUC0UZNQMGI type=write size=880655 2024-08-27T02:37:52.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.051+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=3G4RF5PVVWFU type=del 2024-08-27T02:37:52.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.051+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=652CW06SG7LM type=write size=514089 2024-08-27T02:37:52.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.055+0000 7f3e0cc408c0 1 < completed write operation key=JDV1RIGAO7J1 tag=U3X5XGC0U6J3 type=write size=682553 2024-08-27T02:37:52.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.059+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=A3V79YAFJ6KX type=del size=505166 2024-08-27T02:37:52.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.067+0000 7f3e0cc408c0 1 < suggested remove operation key=VSDJU5KQLFKE tag=W9YYE7H2PMS1 type=del 2024-08-27T02:37:52.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.067+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=Q85VQXICBXXW type=del size=2722760 2024-08-27T02:37:52.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.067+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~56436AE615MC.0 size=877132 2024-08-27T02:37:52.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.075+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=56436AE615MC tag=4Q9S27F9VIG9 type=write size=1925708 2024-08-27T02:37:52.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.079+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~F5N037VSIUCE.0 size=1048576 2024-08-27T02:37:52.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.083+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~F5N037VSIUCE.1 size=70393 2024-08-27T02:37:52.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.083+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=F5N037VSIUCE tag=UYB77Z3MTQZX type=write size=2167545 2024-08-27T02:37:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.087+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=6UAC6ZMQ5KN0 type=del 2024-08-27T02:37:52.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.091+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~T34HTIUDFO67.0 size=1048576 2024-08-27T02:37:52.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~T34HTIUDFO67.1 size=1048576 2024-08-27T02:37:52.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~T34HTIUDFO67.2 size=136533 2024-08-27T02:37:52.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.095+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=T34HTIUDFO67 tag=4WADCTW3GXR5 type=write size=3282261 2024-08-27T02:37:52.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.099+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~YZL9FVRDYHOT.0 size=750534 2024-08-27T02:37:52.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.103+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=YZL9FVRDYHOT tag=H0XI7BNGZNVZ type=write size=1799110 2024-08-27T02:37:52.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.107+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=NI9CY84IK7DT type=write size=71838 2024-08-27T02:37:52.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.111+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~1CU45BOCTB89.0 size=1048576 2024-08-27T02:37:52.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.111+0000 7f3e0cc408c0 1 < canceled part key=_multipart_F4MCLPFLY531.2~1CU45BOCTB89.1 size=113487 2024-08-27T02:37:52.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.115+0000 7f3e0cc408c0 1 < canceled multipart upload key=F4MCLPFLY531 upload=1CU45BOCTB89 tag=N0D3AL3UAH4J type=write size=2210639 2024-08-27T02:37:52.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.119+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=ZFX4NGKQAZXT type=del size=2478609 2024-08-27T02:37:52.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.123+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=D00A3NSSQ9MG type=del 2024-08-27T02:37:52.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.127+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=EL44V3MO782A type=del size=3383714 2024-08-27T02:37:52.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.127+0000 7f3e0cc408c0 1 < completed write operation key=6QE1HU65GQZZ tag=2WZOA8BNDD67 type=write size=820323 2024-08-27T02:37:52.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~AOK7D4C35VCS.0 size=908373 2024-08-27T02:37:52.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.135+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=AOK7D4C35VCS tag=GENJVIROLUCM type=write size=1956949 2024-08-27T02:37:52.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.139+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=A5N2AXH6QG42 type=del 2024-08-27T02:37:52.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.143+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~OPEQXYGC8ZVP.0 size=1048576 2024-08-27T02:37:52.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~OPEQXYGC8ZVP.1 size=1048576 2024-08-27T02:37:52.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~OPEQXYGC8ZVP.2 size=617094 2024-08-27T02:37:52.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.147+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=OPEQXYGC8ZVP tag=DHEW55MNZ90H type=write size=3762822 2024-08-27T02:37:52.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.151+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~LA9U3MT9TZW3.0 size=1048576 2024-08-27T02:37:52.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.155+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~LA9U3MT9TZW3.1 size=818903 2024-08-27T02:37:52.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.159+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=LA9U3MT9TZW3 tag=H03N3GLQF779 type=write size=2916055 2024-08-27T02:37:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.167+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~67Q7GJV99NIF.0 size=448641 2024-08-27T02:37:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.167+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=67Q7GJV99NIF tag=CI3CW76I3DK6 type=write size=1497217 2024-08-27T02:37:52.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.167+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=CZADIN12H5R8 type=del 2024-08-27T02:37:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.171+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=U8EGOBFTDTE9 type=del size=3915260 2024-08-27T02:37:52.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.179+0000 7f3e0cc408c0 1 < suggested update operation key=HKDJMA7O2DFM tag=MP5YNTYFXHR9 type=del size=286172 2024-08-27T02:37:52.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.183+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=3N9ITL0B0O3S type=del size=4039631 2024-08-27T02:37:52.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.187+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=S8PH3J6UG296 type=del 2024-08-27T02:37:52.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.187+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=F2HFL630X5OG type=del size=30790 2024-08-27T02:37:52.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.191+0000 7f3e0cc408c0 -1 < no bi entry to suggest for operation key=VSDJU5KQLFKE tag=34AWPGVKTPEF type=write size=639530: (2) No such file or directory 2024-08-27T02:37:52.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.195+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~LAO35329MU7H.0 size=1048576 2024-08-27T02:37:52.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~LAO35329MU7H.1 size=1048576 2024-08-27T02:37:52.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~LAO35329MU7H.2 size=962370 2024-08-27T02:37:52.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.203+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=LAO35329MU7H tag=T4VYPSUBL2KJ type=write size=4108098 2024-08-27T02:37:52.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.203+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=DFUC0UZNQMGI type=write size=880655 2024-08-27T02:37:52.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.211+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~VDOBDO3E4DAG.0 size=1048576 2024-08-27T02:37:52.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.215+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~VDOBDO3E4DAG.1 size=233627 2024-08-27T02:37:52.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.215+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=VDOBDO3E4DAG tag=K8OFFD42C9UL type=write size=2330779 2024-08-27T02:37:52.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.219+0000 7f3e0cc408c0 1 < completed write operation key=UGSWC9ZK9S7S tag=652CW06SG7LM type=write size=514089 2024-08-27T02:37:52.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.223+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~M82IJKD7C82Z.0 size=1048576 2024-08-27T02:37:52.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.227+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~M82IJKD7C82Z.1 size=907497 2024-08-27T02:37:52.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.227+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=M82IJKD7C82Z tag=L2SH0QWW5CTN type=write size=3004649 2024-08-27T02:37:52.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.235+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=A3V79YAFJ6KX type=del 2024-08-27T02:37:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.239+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=LKOEBVMLGVHV type=del size=1466625 2024-08-27T02:37:52.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.239+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=Q85VQXICBXXW type=del 2024-08-27T02:37:52.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~GIEYNWT3VPU7.0 size=150134 2024-08-27T02:37:52.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.247+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=GIEYNWT3VPU7 tag=RJQN47EEDPMB type=write size=1198710 2024-08-27T02:37:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.251+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~F5N037VSIUCE.0 size=1048576 2024-08-27T02:37:52.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.255+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~F5N037VSIUCE.1 size=70393 2024-08-27T02:37:52.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.259+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=F5N037VSIUCE tag=UYB77Z3MTQZX type=write size=2167545 2024-08-27T02:37:52.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~W6NYQH1ZPR2A.0 size=1048576 2024-08-27T02:37:52.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~W6NYQH1ZPR2A.1 size=10224 2024-08-27T02:37:52.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.267+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=W6NYQH1ZPR2A tag=IPR6YP79U3XN type=write size=2107376 2024-08-27T02:37:52.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.271+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~T34HTIUDFO67.0 size=1048576 2024-08-27T02:37:52.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.275+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~T34HTIUDFO67.1 size=1048576 2024-08-27T02:37:52.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.275+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~T34HTIUDFO67.2 size=136533 2024-08-27T02:37:52.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.283+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=T34HTIUDFO67 tag=4WADCTW3GXR5 type=write size=3282261 2024-08-27T02:37:52.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.287+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=WGX8IMPOT3LG type=del size=4086923 2024-08-27T02:37:52.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.287+0000 7f3e0cc408c0 1 < completed write operation key=OY551242R8T6 tag=NI9CY84IK7DT type=write size=71838 2024-08-27T02:37:52.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~PQUCDHYWVI0H.0 size=1048576 2024-08-27T02:37:52.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~PQUCDHYWVI0H.1 size=1048576 2024-08-27T02:37:52.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~PQUCDHYWVI0H.2 size=386993 2024-08-27T02:37:52.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.299+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=PQUCDHYWVI0H tag=ZXOKB70CB8NP type=write size=3532721 2024-08-27T02:37:52.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.303+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=ZFX4NGKQAZXT type=del 2024-08-27T02:37:52.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.307+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=U4O7N68F0W4Y type=write size=352269 2024-08-27T02:37:52.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.311+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=EL44V3MO782A type=del 2024-08-27T02:37:52.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.315+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=JZU79P4S1SMD type=del size=1753582 2024-08-27T02:37:52.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.315+0000 7f3e0cc408c0 1 < canceled part key=_multipart_OY551242R8T6.2~AOK7D4C35VCS.0 size=908373 2024-08-27T02:37:52.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.323+0000 7f3e0cc408c0 1 < canceled multipart upload key=OY551242R8T6 upload=AOK7D4C35VCS tag=GENJVIROLUCM type=write size=1956949 2024-08-27T02:37:52.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.327+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=G1K815JB1H38 type=del size=998976 2024-08-27T02:37:52.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~OPEQXYGC8ZVP.0 size=1048576 2024-08-27T02:37:52.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~OPEQXYGC8ZVP.1 size=1048576 2024-08-27T02:37:52.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.335+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~OPEQXYGC8ZVP.2 size=617094 2024-08-27T02:37:52.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.343+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=OPEQXYGC8ZVP tag=DHEW55MNZ90H type=write size=3762822 2024-08-27T02:37:52.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.347+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=HL7OMML03EJT type=del size=507898 2024-08-27T02:37:52.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.351+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~67Q7GJV99NIF.0 size=448641 2024-08-27T02:37:52.354 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.355+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=67Q7GJV99NIF tag=CI3CW76I3DK6 type=write size=1497217 2024-08-27T02:37:52.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.363+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~Z6GPULXZAOWQ.0 size=997296 2024-08-27T02:37:52.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.363+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=Z6GPULXZAOWQ tag=86KL186EPIZH type=write size=2045872 2024-08-27T02:37:52.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.363+0000 7f3e0cc408c0 1 < canceled operation key=6YTZJKE4V5HQ tag=U8EGOBFTDTE9 type=del size=3915260 2024-08-27T02:37:52.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.367+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=U1BRXFGCF0R1 type=del size=1269461 2024-08-27T02:37:52.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.371+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=3N9ITL0B0O3S type=del 2024-08-27T02:37:52.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.375+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=XIMXSFT3DQE7 type=write size=929470 2024-08-27T02:37:52.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.383+0000 7f3e0cc408c0 1 < suggested remove operation key=UGSWC9ZK9S7S tag=F2HFL630X5OG type=del 2024-08-27T02:37:52.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.383+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=UNE1N10D374X type=write size=509942 2024-08-27T02:37:52.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~LAO35329MU7H.0 size=1048576 2024-08-27T02:37:52.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~LAO35329MU7H.1 size=1048576 2024-08-27T02:37:52.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.395+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~LAO35329MU7H.2 size=962370 2024-08-27T02:37:52.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.399+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=LAO35329MU7H tag=T4VYPSUBL2KJ type=write size=4108098 2024-08-27T02:37:52.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.403+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=LMCD52BY694P type=write size=102087 2024-08-27T02:37:52.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.407+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~VDOBDO3E4DAG.0 size=1048576 2024-08-27T02:37:52.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~VDOBDO3E4DAG.1 size=233627 2024-08-27T02:37:52.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.415+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=VDOBDO3E4DAG tag=K8OFFD42C9UL type=write size=2330779 2024-08-27T02:37:52.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.419+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~MYZFZ1RWNLP4.0 size=1048576 2024-08-27T02:37:52.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.419+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~MYZFZ1RWNLP4.1 size=1031645 2024-08-27T02:37:52.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.419+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=MYZFZ1RWNLP4 tag=UD815NR4J17J type=write size=3128797 2024-08-27T02:37:52.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.423+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~M82IJKD7C82Z.0 size=1048576 2024-08-27T02:37:52.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.427+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~M82IJKD7C82Z.1 size=907497 2024-08-27T02:37:52.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.431+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=M82IJKD7C82Z tag=L2SH0QWW5CTN type=write size=3004649 2024-08-27T02:37:52.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~UK9A1TAS6G6Y.0 size=1048576 2024-08-27T02:37:52.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~UK9A1TAS6G6Y.1 size=309831 2024-08-27T02:37:52.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.439+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=UK9A1TAS6G6Y tag=231MBF95OPMQ type=write size=2406983 2024-08-27T02:37:52.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.447+0000 7f3e0cc408c0 1 < suggested update operation key=ZMN8Y0VQVHLB tag=LKOEBVMLGVHV type=del size=1466625 2024-08-27T02:37:52.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.447+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=280JU6QV0U4R type=del size=2355350 2024-08-27T02:37:52.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~GIEYNWT3VPU7.0 size=150134 2024-08-27T02:37:52.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.455+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=GIEYNWT3VPU7 tag=RJQN47EEDPMB type=write size=1198710 2024-08-27T02:37:52.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~KE5NUZDDH4DC.0 size=1048576 2024-08-27T02:37:52.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~KE5NUZDDH4DC.1 size=1048576 2024-08-27T02:37:52.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.467+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~KE5NUZDDH4DC.2 size=564604 2024-08-27T02:37:52.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.467+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=KE5NUZDDH4DC tag=8KL2NBN8VDHC type=write size=3710332 2024-08-27T02:37:52.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.471+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~W6NYQH1ZPR2A.0 size=1048576 2024-08-27T02:37:52.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~W6NYQH1ZPR2A.1 size=10224 2024-08-27T02:37:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.479+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=W6NYQH1ZPR2A tag=IPR6YP79U3XN type=write size=2107376 2024-08-27T02:37:52.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.483+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=VLFM1SK0UMMS type=write size=371175 2024-08-27T02:37:52.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.487+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=WGX8IMPOT3LG type=del 2024-08-27T02:37:52.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.491+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=QBM8P4FVQ1ZV type=del size=140051 2024-08-27T02:37:52.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.491+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HTEOX3BV94K2.2~PQUCDHYWVI0H.0 size=1048576 2024-08-27T02:37:52.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.495+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~PQUCDHYWVI0H.1 size=1048576 2024-08-27T02:37:52.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.495+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HTEOX3BV94K2.2~PQUCDHYWVI0H.2 size=386993 2024-08-27T02:37:52.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.499+0000 7f3e0cc408c0 1 < canceled multipart upload key=HTEOX3BV94K2 upload=PQUCDHYWVI0H tag=ZXOKB70CB8NP type=write size=3532721 2024-08-27T02:37:52.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.503+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=1V1TGP6FZ5PC type=del size=933131 2024-08-27T02:37:52.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.507+0000 7f3e0cc408c0 1 < completed write operation key=4BV3C9MTIFT5 tag=U4O7N68F0W4Y type=write size=352269 2024-08-27T02:37:52.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.515+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~2ASIWPJ4AEK0.0 size=835577 2024-08-27T02:37:52.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.515+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=2ASIWPJ4AEK0 tag=63IMKF2F212F type=write size=1884153 2024-08-27T02:37:52.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.519+0000 7f3e0cc408c0 1 < suggested remove operation key=VSDJU5KQLFKE tag=JZU79P4S1SMD type=del 2024-08-27T02:37:52.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.523+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=BI1KKKEQZAZ8 type=del size=1075016 2024-08-27T02:37:52.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.527+0000 7f3e0cc408c0 1 < suggested remove operation key=0U59R3BXL181 tag=G1K815JB1H38 type=del 2024-08-27T02:37:52.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.531+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=SZ9DPANCT61J type=del size=324573 2024-08-27T02:37:52.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.535+0000 7f3e0cc408c0 1 < canceled operation key=JLAGXRZVF50G tag=HL7OMML03EJT type=del size=507898 2024-08-27T02:37:52.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.535+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=IR0VEIKHA2CK type=del size=900199 2024-08-27T02:37:52.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.543+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~Z6GPULXZAOWQ.0 size=997296 2024-08-27T02:37:52.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.547+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=Z6GPULXZAOWQ tag=86KL186EPIZH type=write size=2045872 2024-08-27T02:37:52.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.547+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=DDX7AHFYW0V2 type=del size=1223645 2024-08-27T02:37:52.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.551+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=U1BRXFGCF0R1 type=del 2024-08-27T02:37:52.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.555+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=9DIAKX8R053P type=del size=99406 2024-08-27T02:37:52.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.559+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=XIMXSFT3DQE7 type=write size=929470 2024-08-27T02:37:52.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.559+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=YTNM97XA4I5I type=del size=425226 2024-08-27T02:37:52.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.563+0000 7f3e0cc408c0 -1 < failed to complete operation key=0U59R3BXL181 tag=UNE1N10D374X type=write size=509942: (22) Invalid argument 2024-08-27T02:37:52.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.567+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=VIWIYIG6U21D type=write size=664179 2024-08-27T02:37:52.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.571+0000 7f3e0cc408c0 1 < suggested remove operation key=0OLVDEQWBCAQ tag=LMCD52BY694P type=write 2024-08-27T02:37:52.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.575+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=EQ74EZI0R077 type=del size=149458 2024-08-27T02:37:52.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~MYZFZ1RWNLP4.0 size=1048576 2024-08-27T02:37:52.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~MYZFZ1RWNLP4.1 size=1031645 2024-08-27T02:37:52.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.587+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=MYZFZ1RWNLP4 tag=UD815NR4J17J type=write size=3128797 2024-08-27T02:37:52.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.591+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=GRMU4NZ3PS8W type=write size=477354 2024-08-27T02:37:52.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.591+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~UK9A1TAS6G6Y.0 size=1048576 2024-08-27T02:37:52.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.591+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~UK9A1TAS6G6Y.1 size=309831 2024-08-27T02:37:52.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.599+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=UK9A1TAS6G6Y tag=231MBF95OPMQ type=write size=2406983 2024-08-27T02:37:52.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.603+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=PV06M9FD03X0 type=del size=2929419 2024-08-27T02:37:52.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.607+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=280JU6QV0U4R type=del 2024-08-27T02:37:52.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.611+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=8HCB6BBC1M5E type=write size=782790 2024-08-27T02:37:52.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.615+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~KE5NUZDDH4DC.0 size=1048576 2024-08-27T02:37:52.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.615+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~KE5NUZDDH4DC.1 size=1048576 2024-08-27T02:37:52.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~KE5NUZDDH4DC.2 size=564604 2024-08-27T02:37:52.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.627+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=KE5NUZDDH4DC tag=8KL2NBN8VDHC type=write size=3710332 2024-08-27T02:37:52.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.627+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=EDYA1K6ZJFYR type=del size=2621792 2024-08-27T02:37:52.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.635+0000 7f3e0cc408c0 1 < suggested remove operation key=ZMN8Y0VQVHLB tag=VLFM1SK0UMMS type=write 2024-08-27T02:37:52.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.643+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~MQFSFPM88E9G.0 size=1048576 2024-08-27T02:37:52.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.643+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~MQFSFPM88E9G.1 size=1048576 2024-08-27T02:37:52.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~MQFSFPM88E9G.2 size=8268 2024-08-27T02:37:52.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.647+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=MQFSFPM88E9G tag=UTDYDK0MDTAX type=write size=3153996 2024-08-27T02:37:52.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.651+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=QBM8P4FVQ1ZV type=del 2024-08-27T02:37:52.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.655+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=X99ITEOVJ6M7 type=write size=496649 2024-08-27T02:37:52.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.659+0000 7f3e0cc408c0 1 < suggested remove operation key=6QE1HU65GQZZ tag=1V1TGP6FZ5PC type=del 2024-08-27T02:37:52.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.663+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=Q3RLROU90990 type=del size=4176639 2024-08-27T02:37:52.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.667+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~2ASIWPJ4AEK0.0 size=835577 2024-08-27T02:37:52.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.671+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=2ASIWPJ4AEK0 tag=63IMKF2F212F type=write size=1884153 2024-08-27T02:37:52.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.675+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~CN7Z43RLYAAC.0 size=225273 2024-08-27T02:37:52.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.675+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=CN7Z43RLYAAC tag=NDMCQOO1G5WF type=write size=1273849 2024-08-27T02:37:52.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.679+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=BI1KKKEQZAZ8 type=del 2024-08-27T02:37:52.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.683+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=FEBTVPNAOSYI type=del size=3089594 2024-08-27T02:37:52.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.687+0000 7f3e0cc408c0 1 < suggested update operation key=IISECLYEAR19 tag=SZ9DPANCT61J type=del size=324573 2024-08-27T02:37:52.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.691+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=2OB1JAN6X2N1 type=del size=3161571 2024-08-27T02:37:52.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.695+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=IR0VEIKHA2CK type=del 2024-08-27T02:37:52.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.699+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=OZN1FXQPDPGN type=del size=2446314 2024-08-27T02:37:52.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.699+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=DDX7AHFYW0V2 type=del 2024-08-27T02:37:52.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.703+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=MGPYNR5PBJKE type=del size=1173644 2024-08-27T02:37:52.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.707+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=9DIAKX8R053P type=del 2024-08-27T02:37:52.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.711+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=6FEL7SNCDW99 type=write size=539309 2024-08-27T02:37:52.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.711+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=YTNM97XA4I5I type=del 2024-08-27T02:37:52.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.715+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=5H0R08C1UBLB type=del size=2315202 2024-08-27T02:37:52.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.719+0000 7f3e0cc408c0 1 < suggested update operation key=D7YWS7BWXT37 tag=VIWIYIG6U21D type=write size=664179 2024-08-27T02:37:52.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.723+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=K66S5QN9KRQ0 type=del size=522029 2024-08-27T02:37:52.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.727+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=EQ74EZI0R077 type=del 2024-08-27T02:37:52.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.731+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=BVJYFQTJDTXY type=write size=659516 2024-08-27T02:37:52.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.735+0000 7f3e0cc408c0 1 < completed write operation key=KTPZGZSQCERQ tag=GRMU4NZ3PS8W type=write size=477354 2024-08-27T02:37:52.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.735+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=URLBML248617 type=del size=2014442 2024-08-27T02:37:52.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.739+0000 7f3e0cc408c0 -1 < failed to complete operation key=6QE1HU65GQZZ tag=PV06M9FD03X0 type=del size=2929419: (22) Invalid argument 2024-08-27T02:37:52.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.743+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~XHU0MDJXE1XY.0 size=1048576 2024-08-27T02:37:52.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.747+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~XHU0MDJXE1XY.1 size=1048576 2024-08-27T02:37:52.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.751+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~XHU0MDJXE1XY.2 size=523293 2024-08-27T02:37:52.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.751+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=XHU0MDJXE1XY tag=YSUIMRDVNUE0 type=write size=3669021 2024-08-27T02:37:52.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.755+0000 7f3e0cc408c0 1 < completed write operation key=F4MCLPFLY531 tag=8HCB6BBC1M5E type=write size=782790 2024-08-27T02:37:52.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~HG2WSWFBVEZ0.0 size=1048576 2024-08-27T02:37:52.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~HG2WSWFBVEZ0.1 size=980791 2024-08-27T02:37:52.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.759+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=HG2WSWFBVEZ0 tag=3RUYNXOAXRMG type=write size=3077943 2024-08-27T02:37:52.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.763+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=EDYA1K6ZJFYR type=del 2024-08-27T02:37:52.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.767+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=FT0N3P3MT33B type=del size=1375705 2024-08-27T02:37:52.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~MQFSFPM88E9G.0 size=1048576 2024-08-27T02:37:52.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~MQFSFPM88E9G.1 size=1048576 2024-08-27T02:37:52.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.775+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~MQFSFPM88E9G.2 size=8268 2024-08-27T02:37:52.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.779+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=MQFSFPM88E9G tag=UTDYDK0MDTAX type=write size=3153996 2024-08-27T02:37:52.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.779+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=Z0G2UCT6A4WG type=del size=2732902 2024-08-27T02:37:52.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.783+0000 7f3e0cc408c0 1 < completed write operation key=JDV1RIGAO7J1 tag=X99ITEOVJ6M7 type=write size=496649 2024-08-27T02:37:52.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.787+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=IKAZN8YGMJNL type=del size=3241165 2024-08-27T02:37:52.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.787+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=Q3RLROU90990 type=del 2024-08-27T02:37:52.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.791+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=OWB04LV185Y6 type=write size=533388 2024-08-27T02:37:52.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.795+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~CN7Z43RLYAAC.0 size=225273 2024-08-27T02:37:52.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.799+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=CN7Z43RLYAAC tag=NDMCQOO1G5WF type=write size=1273849 2024-08-27T02:37:52.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.799+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=U79UXXVW07P6 type=write size=434480 2024-08-27T02:37:52.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.803+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=FEBTVPNAOSYI type=del 2024-08-27T02:37:52.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.807+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~JIDLJK5KNIBY.0 size=1048576 2024-08-27T02:37:52.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~JIDLJK5KNIBY.1 size=1048576 2024-08-27T02:37:52.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~JIDLJK5KNIBY.2 size=838125 2024-08-27T02:37:52.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.811+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=JIDLJK5KNIBY tag=9WYQAWUWTTNG type=write size=3983853 2024-08-27T02:37:52.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.815+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=2OB1JAN6X2N1 type=del 2024-08-27T02:37:52.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.819+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~L6EPNICL000F.0 size=1048576 2024-08-27T02:37:52.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.819+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~L6EPNICL000F.1 size=231953 2024-08-27T02:37:52.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.819+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=L6EPNICL000F tag=8SL6AWI7OVGR type=write size=2329105 2024-08-27T02:37:52.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.827+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=OZN1FXQPDPGN type=del 2024-08-27T02:37:52.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.831+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=IHV3QDRZBR83 type=write size=164835 2024-08-27T02:37:52.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.835+0000 7f3e0cc408c0 1 < suggested remove operation key=JLAGXRZVF50G tag=MGPYNR5PBJKE type=del 2024-08-27T02:37:52.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.835+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=PSLPU9GDLRY3 type=del size=1253146 2024-08-27T02:37:52.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.839+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=6FEL7SNCDW99 type=write size=539309 2024-08-27T02:37:52.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.843+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=I80CONNLIN1P type=del size=1152632 2024-08-27T02:37:52.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.843+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=5H0R08C1UBLB type=del 2024-08-27T02:37:52.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~ZXFYK9AC4Z8W.0 size=784184 2024-08-27T02:37:52.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.851+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=ZXFYK9AC4Z8W tag=YZEOW2CPMOQB type=write size=1832760 2024-08-27T02:37:52.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.851+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=K66S5QN9KRQ0 type=del 2024-08-27T02:37:52.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.855+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=0NH7UZ15ACCC type=del size=3144885 2024-08-27T02:37:52.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.863+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=BVJYFQTJDTXY type=write 2024-08-27T02:37:52.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.867+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=0U758X7LFL3U type=del size=4074017 2024-08-27T02:37:52.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.871+0000 7f3e0cc408c0 1 < suggested update operation key=IISECLYEAR19 tag=URLBML248617 type=del size=2014442 2024-08-27T02:37:52.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.875+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=GULYDKPXSYJV type=del size=199970 2024-08-27T02:37:52.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.875+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~XHU0MDJXE1XY.0 size=1048576 2024-08-27T02:37:52.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~XHU0MDJXE1XY.1 size=1048576 2024-08-27T02:37:52.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~XHU0MDJXE1XY.2 size=523293 2024-08-27T02:37:52.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.887+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=XHU0MDJXE1XY tag=YSUIMRDVNUE0 type=write size=3669021 2024-08-27T02:37:52.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.887+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=41KDT3NXL6V3 type=write size=294759 2024-08-27T02:37:52.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.891+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~HG2WSWFBVEZ0.0 size=1048576 2024-08-27T02:37:52.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.891+0000 7f3e0cc408c0 1 < canceled part key=_multipart_F4MCLPFLY531.2~HG2WSWFBVEZ0.1 size=980791 2024-08-27T02:37:52.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.895+0000 7f3e0cc408c0 1 < canceled multipart upload key=F4MCLPFLY531 upload=HG2WSWFBVEZ0 tag=3RUYNXOAXRMG type=write size=3077943 2024-08-27T02:37:52.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.899+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=UE7QKGYEVBYZ type=del size=4012445 2024-08-27T02:37:52.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.899+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=FT0N3P3MT33B type=del 2024-08-27T02:37:52.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.903+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~BI4FHLSHP42O.0 size=1048576 2024-08-27T02:37:52.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~BI4FHLSHP42O.1 size=901406 2024-08-27T02:37:52.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.907+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=BI4FHLSHP42O tag=UP71IH2YHVGO type=write size=2998558 2024-08-27T02:37:52.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.911+0000 7f3e0cc408c0 1 < canceled operation key=ZMN8Y0VQVHLB tag=Z0G2UCT6A4WG type=del size=2732902 2024-08-27T02:37:52.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.915+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~LPHT956OJN4O.0 size=975530 2024-08-27T02:37:52.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.915+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=LPHT956OJN4O tag=XLEVTS4RBGOO type=write size=2024106 2024-08-27T02:37:52.918 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.919+0000 7f3e0cc408c0 -1 < failed to complete operation key=JDV1RIGAO7J1 tag=IKAZN8YGMJNL type=del size=3241165: (22) Invalid argument 2024-08-27T02:37:52.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.923+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=6LO7YONYGE1S type=del size=2970701 2024-08-27T02:37:52.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.927+0000 7f3e0cc408c0 1 < completed write operation key=HKDJMA7O2DFM tag=OWB04LV185Y6 type=write size=533388 2024-08-27T02:37:52.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.931+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~I6B2UR0HI9UH.0 size=1048576 2024-08-27T02:37:52.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~I6B2UR0HI9UH.1 size=1048576 2024-08-27T02:37:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~I6B2UR0HI9UH.2 size=382030 2024-08-27T02:37:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.935+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=I6B2UR0HI9UH tag=AJEGZTZ2056V type=write size=3527758 2024-08-27T02:37:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.939+0000 7f3e0cc408c0 1 < completed write operation key=A0RUXE4YL6NR tag=U79UXXVW07P6 type=write size=434480 2024-08-27T02:37:52.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.943+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=3EA9F5N0WZMQ type=del size=1911196 2024-08-27T02:37:52.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.947+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~JIDLJK5KNIBY.0 size=1048576 2024-08-27T02:37:52.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.947+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~JIDLJK5KNIBY.1 size=1048576 2024-08-27T02:37:52.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.951+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~JIDLJK5KNIBY.2 size=838125 2024-08-27T02:37:52.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.955+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=JIDLJK5KNIBY tag=9WYQAWUWTTNG type=write size=3983853 2024-08-27T02:37:52.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.959+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=Q17MSO6AXHPD type=del size=3796960 2024-08-27T02:37:52.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.959+0000 7f3e0cc408c0 1 < canceled part key=_multipart_KTPZGZSQCERQ.2~L6EPNICL000F.0 size=1048576 2024-08-27T02:37:52.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~L6EPNICL000F.1 size=231953 2024-08-27T02:37:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.963+0000 7f3e0cc408c0 1 < canceled multipart upload key=KTPZGZSQCERQ upload=L6EPNICL000F tag=8SL6AWI7OVGR type=write size=2329105 2024-08-27T02:37:52.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~9EWJ2V8GEQQC.0 size=1048576 2024-08-27T02:37:52.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.971+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~9EWJ2V8GEQQC.1 size=568916 2024-08-27T02:37:52.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.971+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=9EWJ2V8GEQQC tag=I0RRYNLO68DU type=write size=2666068 2024-08-27T02:37:52.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.975+0000 7f3e0cc408c0 -1 < failed to complete operation key=IISECLYEAR19 tag=IHV3QDRZBR83 type=write size=164835: (22) Invalid argument 2024-08-27T02:37:52.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~XLH9P9ONAGNU.0 size=1048576 2024-08-27T02:37:52.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~XLH9P9ONAGNU.1 size=1048576 2024-08-27T02:37:52.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.983+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~XLH9P9ONAGNU.2 size=929014 2024-08-27T02:37:52.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.983+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=XLH9P9ONAGNU tag=44GSVTMYMNPX type=write size=4074742 2024-08-27T02:37:52.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.987+0000 7f3e0cc408c0 1 < canceled operation key=XBURHQSU6IML tag=PSLPU9GDLRY3 type=del size=1253146 2024-08-27T02:37:52.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.987+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=1ZZVDZ03G0TS type=del size=1944969 2024-08-27T02:37:52.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.991+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=I80CONNLIN1P type=del 2024-08-27T02:37:52.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.995+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=OYEASNT8DGI0 type=del size=1670572 2024-08-27T02:37:52.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.995+0000 7f3e0cc408c0 1 < canceled part key=_multipart_XBURHQSU6IML.2~ZXFYK9AC4Z8W.0 size=784184 2024-08-27T02:37:52.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.999+0000 7f3e0cc408c0 1 < canceled multipart upload key=XBURHQSU6IML upload=ZXFYK9AC4Z8W tag=YZEOW2CPMOQB type=write size=1832760 2024-08-27T02:37:53.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:52.999+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=DKTRQIRXAHHH type=del size=1267432 2024-08-27T02:37:53.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.003+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=0NH7UZ15ACCC type=del 2024-08-27T02:37:53.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~4S7QWINLIRHX.0 size=46558 2024-08-27T02:37:53.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.007+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=4S7QWINLIRHX tag=4AB32UGTGHTJ type=write size=1095134 2024-08-27T02:37:53.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.011+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=0U758X7LFL3U type=del 2024-08-27T02:37:53.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.015+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=345P3UX57XGV type=del size=153461 2024-08-27T02:37:53.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.015+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=GULYDKPXSYJV type=del 2024-08-27T02:37:53.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.019+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=2TT5XP9O058G type=del size=3129976 2024-08-27T02:37:53.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.019+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=41KDT3NXL6V3 type=write size=294759 2024-08-27T02:37:53.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.023+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=M0OFDLJ6N601 type=del size=4073539 2024-08-27T02:37:53.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.027+0000 7f3e0cc408c0 1 < suggested update operation key=4BV3C9MTIFT5 tag=UE7QKGYEVBYZ type=del size=4012445 2024-08-27T02:37:53.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.031+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=K50110Z5T4FH type=del size=353548 2024-08-27T02:37:53.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~BI4FHLSHP42O.0 size=1048576 2024-08-27T02:37:53.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~BI4FHLSHP42O.1 size=901406 2024-08-27T02:37:53.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.039+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=BI4FHLSHP42O tag=UP71IH2YHVGO type=write size=2998558 2024-08-27T02:37:53.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.043+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=F2QML1UC7XS8 type=del size=840945 2024-08-27T02:37:53.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~LPHT956OJN4O.0 size=975530 2024-08-27T02:37:53.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.051+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=LPHT956OJN4O tag=XLEVTS4RBGOO type=write size=2024106 2024-08-27T02:37:53.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.055+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=O91YX68YJ0UK type=del size=2368426 2024-08-27T02:37:53.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.059+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=6LO7YONYGE1S type=del 2024-08-27T02:37:53.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.059+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=HBMQK3093527 type=del size=929839 2024-08-27T02:37:53.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~I6B2UR0HI9UH.0 size=1048576 2024-08-27T02:37:53.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~I6B2UR0HI9UH.1 size=1048576 2024-08-27T02:37:53.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~I6B2UR0HI9UH.2 size=382030 2024-08-27T02:37:53.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.071+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=I6B2UR0HI9UH tag=AJEGZTZ2056V type=write size=3527758 2024-08-27T02:37:53.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.075+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=FLBWMYLV3JZE type=del size=2347962 2024-08-27T02:37:53.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.083+0000 7f3e0cc408c0 1 < suggested update operation key=1ZIJ9JJTM4ZC tag=3EA9F5N0WZMQ type=del size=1911196 2024-08-27T02:37:53.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.087+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~767PTHZHHN45.0 size=1048576 2024-08-27T02:37:53.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.091+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~767PTHZHHN45.1 size=1048576 2024-08-27T02:37:53.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~767PTHZHHN45.2 size=123536 2024-08-27T02:37:53.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.095+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=767PTHZHHN45 tag=2Q9FQU4W0Y3Y type=write size=3269264 2024-08-27T02:37:53.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.095+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=Q17MSO6AXHPD type=del 2024-08-27T02:37:53.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~FXXS3GMUSPOF.0 size=1048576 2024-08-27T02:37:53.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~FXXS3GMUSPOF.1 size=1048576 2024-08-27T02:37:53.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~FXXS3GMUSPOF.2 size=76326 2024-08-27T02:37:53.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.107+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=FXXS3GMUSPOF tag=3XK3M2PPBS4O type=write size=3222054 2024-08-27T02:37:53.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~9EWJ2V8GEQQC.0 size=1048576 2024-08-27T02:37:53.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.107+0000 7f3e0cc408c0 1 < canceled part key=_multipart_XBURHQSU6IML.2~9EWJ2V8GEQQC.1 size=568916 2024-08-27T02:37:53.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.111+0000 7f3e0cc408c0 1 < canceled multipart upload key=XBURHQSU6IML upload=9EWJ2V8GEQQC tag=I0RRYNLO68DU type=write size=2666068 2024-08-27T02:37:53.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.115+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=BJ5ZAPTWPZBS type=write size=911004 2024-08-27T02:37:53.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~XLH9P9ONAGNU.0 size=1048576 2024-08-27T02:37:53.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.123+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~XLH9P9ONAGNU.1 size=1048576 2024-08-27T02:37:53.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.123+0000 7f3e0cc408c0 1 < canceled part key=_multipart_MNE5WNFBH9HG.2~XLH9P9ONAGNU.2 size=929014 2024-08-27T02:37:53.126 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.127+0000 7f3e0cc408c0 1 < canceled multipart upload key=MNE5WNFBH9HG upload=XLH9P9ONAGNU tag=44GSVTMYMNPX type=write size=4074742 2024-08-27T02:37:53.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.131+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=WLZJ7SU2OECK type=del size=4182061 2024-08-27T02:37:53.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.135+0000 7f3e0cc408c0 1 < suggested remove operation key=S5ANS33DXN7X tag=1ZZVDZ03G0TS type=del 2024-08-27T02:37:53.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.139+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=YWEGDC3GA7A3 type=write size=812025 2024-08-27T02:37:53.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.143+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=OYEASNT8DGI0 type=del 2024-08-27T02:37:53.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.147+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=AA2SO9NTS7OF type=del size=147895 2024-08-27T02:37:53.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.147+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=DKTRQIRXAHHH type=del 2024-08-27T02:37:53.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~1280XKYJ0ACH.0 size=1048576 2024-08-27T02:37:53.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~1280XKYJ0ACH.1 size=1048576 2024-08-27T02:37:53.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~1280XKYJ0ACH.2 size=344130 2024-08-27T02:37:53.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.159+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=1280XKYJ0ACH tag=V36TKJTVR9JX type=write size=3489858 2024-08-27T02:37:53.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.163+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~4S7QWINLIRHX.0 size=46558 2024-08-27T02:37:53.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.167+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=4S7QWINLIRHX tag=4AB32UGTGHTJ type=write size=1095134 2024-08-27T02:37:53.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.167+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=63F9UAECT4Z3 type=del size=237705 2024-08-27T02:37:53.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.171+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=345P3UX57XGV type=del 2024-08-27T02:37:53.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.175+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=E2J58UUS68AD type=del size=2731254 2024-08-27T02:37:53.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.179+0000 7f3e0cc408c0 1 < canceled operation key=JLAGXRZVF50G tag=2TT5XP9O058G type=del size=3129976 2024-08-27T02:37:53.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.179+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=1JLD0VUUQZUE type=write size=850458 2024-08-27T02:37:53.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.187+0000 7f3e0cc408c0 1 < suggested remove operation key=XBURHQSU6IML tag=M0OFDLJ6N601 type=del 2024-08-27T02:37:53.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.191+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=UAFTGMA1UDJN type=del size=182936 2024-08-27T02:37:53.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.191+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=K50110Z5T4FH type=del 2024-08-27T02:37:53.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.195+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=4ZDOOAYLK655 type=write size=259560 2024-08-27T02:37:53.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.199+0000 7f3e0cc408c0 1 < canceled operation key=JDV1RIGAO7J1 tag=F2QML1UC7XS8 type=del size=840945 2024-08-27T02:37:53.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.203+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=3WC40E7FQXEU type=del size=911048 2024-08-27T02:37:53.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.203+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=O91YX68YJ0UK type=del 2024-08-27T02:37:53.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.207+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=QPMT69LNQ0ZS type=del size=1100257 2024-08-27T02:37:53.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.215+0000 7f3e0cc408c0 1 < suggested remove operation key=O66XJ7GJMPCU tag=HBMQK3093527 type=del 2024-08-27T02:37:53.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~9RA3UXE08T82.0 size=1048576 2024-08-27T02:37:53.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.223+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~9RA3UXE08T82.1 size=268375 2024-08-27T02:37:53.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.223+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=9RA3UXE08T82 tag=61B4WMQVP3VO type=write size=2365527 2024-08-27T02:37:53.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.223+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=FLBWMYLV3JZE type=del 2024-08-27T02:37:53.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.227+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=Q4O70L5469J4 type=del size=3537108 2024-08-27T02:37:53.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~767PTHZHHN45.0 size=1048576 2024-08-27T02:37:53.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.235+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~767PTHZHHN45.1 size=1048576 2024-08-27T02:37:53.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.235+0000 7f3e0cc408c0 1 < canceled part key=_multipart_B9DPI871LQ7E.2~767PTHZHHN45.2 size=123536 2024-08-27T02:37:53.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.239+0000 7f3e0cc408c0 1 < canceled multipart upload key=B9DPI871LQ7E upload=767PTHZHHN45 tag=2Q9FQU4W0Y3Y type=write size=3269264 2024-08-27T02:37:53.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.243+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=M40LO3O98JAE type=del size=1819618 2024-08-27T02:37:53.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.243+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~FXXS3GMUSPOF.0 size=1048576 2024-08-27T02:37:53.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~FXXS3GMUSPOF.1 size=1048576 2024-08-27T02:37:53.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~FXXS3GMUSPOF.2 size=76326 2024-08-27T02:37:53.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.255+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=FXXS3GMUSPOF tag=3XK3M2PPBS4O type=write size=3222054 2024-08-27T02:37:53.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~70JDVJBWIAJA.0 size=1048576 2024-08-27T02:37:53.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.263+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~70JDVJBWIAJA.1 size=1048576 2024-08-27T02:37:53.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~70JDVJBWIAJA.2 size=288003 2024-08-27T02:37:53.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.267+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=70JDVJBWIAJA tag=WNBC3L6JQ0BF type=write size=3433731 2024-08-27T02:37:53.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.267+0000 7f3e0cc408c0 1 < completed write operation key=HKDJMA7O2DFM tag=BJ5ZAPTWPZBS type=write size=911004 2024-08-27T02:37:53.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.271+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=BB2NANZOIYZ8 type=del size=1892522 2024-08-27T02:37:53.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.275+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=WLZJ7SU2OECK type=del 2024-08-27T02:37:53.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.283+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~J2PDRW41H51K.0 size=704387 2024-08-27T02:37:53.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.283+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=J2PDRW41H51K tag=7WO6JU0GZCS3 type=write size=1752963 2024-08-27T02:37:53.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.283+0000 7f3e0cc408c0 -1 < failed to complete operation key=XBURHQSU6IML tag=YWEGDC3GA7A3 type=write size=812025: (22) Invalid argument 2024-08-27T02:37:53.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.287+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=23F2FXC2BAQK type=del size=3904713 2024-08-27T02:37:53.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.291+0000 7f3e0cc408c0 1 < canceled operation key=JLAGXRZVF50G tag=AA2SO9NTS7OF type=del size=147895 2024-08-27T02:37:53.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.295+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=3VTPOG7R3HLZ type=del size=2750990 2024-08-27T02:37:53.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.299+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~1280XKYJ0ACH.0 size=1048576 2024-08-27T02:37:53.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~1280XKYJ0ACH.1 size=1048576 2024-08-27T02:37:53.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~1280XKYJ0ACH.2 size=344130 2024-08-27T02:37:53.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.307+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=1280XKYJ0ACH tag=V36TKJTVR9JX type=write size=3489858 2024-08-27T02:37:53.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.311+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=C0HQR9EUNSWX type=del size=3573483 2024-08-27T02:37:53.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.315+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=63F9UAECT4Z3 type=del 2024-08-27T02:37:53.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.315+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=1ND2GW25MLNM type=del size=3403932 2024-08-27T02:37:53.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.323+0000 7f3e0cc408c0 1 < suggested remove operation key=OY551242R8T6 tag=E2J58UUS68AD type=del 2024-08-27T02:37:53.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.323+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=1FUKPPYBCMFA type=del size=15592 2024-08-27T02:37:53.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.327+0000 7f3e0cc408c0 1 < completed write operation key=UGSWC9ZK9S7S tag=1JLD0VUUQZUE type=write size=850458 2024-08-27T02:37:53.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.331+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=XH9K1PYXA8SP type=del size=2557806 2024-08-27T02:37:53.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.335+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=UAFTGMA1UDJN type=del 2024-08-27T02:37:53.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.335+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=YLX09A54WTN8 type=del size=2067818 2024-08-27T02:37:53.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.339+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=4ZDOOAYLK655 type=write size=259560 2024-08-27T02:37:53.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.343+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~NFTKW2X1W1EG.0 size=1048576 2024-08-27T02:37:53.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.347+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~NFTKW2X1W1EG.1 size=854098 2024-08-27T02:37:53.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.347+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=NFTKW2X1W1EG tag=CI4QPG47R67K type=write size=2951250 2024-08-27T02:37:53.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.347+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=3WC40E7FQXEU type=del 2024-08-27T02:37:53.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.351+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=L35YKM1QRGVN type=write size=643430 2024-08-27T02:37:53.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.355+0000 7f3e0cc408c0 1 < suggested remove operation key=8VSA6T2H8FDI tag=QPMT69LNQ0ZS type=del 2024-08-27T02:37:53.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.359+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=5NPZX733FD8W type=del size=2985986 2024-08-27T02:37:53.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.363+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~9RA3UXE08T82.0 size=1048576 2024-08-27T02:37:53.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.363+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~9RA3UXE08T82.1 size=268375 2024-08-27T02:37:53.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.371+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=9RA3UXE08T82 tag=61B4WMQVP3VO type=write size=2365527 2024-08-27T02:37:53.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.375+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=P06RIXFFYUGI type=del size=3886009 2024-08-27T02:37:53.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.379+0000 7f3e0cc408c0 1 < suggested remove operation key=JLAGXRZVF50G tag=Q4O70L5469J4 type=del 2024-08-27T02:37:53.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~8DPS6LYQ5Z29.0 size=1048576 2024-08-27T02:37:53.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~8DPS6LYQ5Z29.1 size=1048576 2024-08-27T02:37:53.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.391+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~8DPS6LYQ5Z29.2 size=468501 2024-08-27T02:37:53.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.391+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=8DPS6LYQ5Z29 tag=6NKBWFEEQ5FU type=write size=3614229 2024-08-27T02:37:53.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.395+0000 7f3e0cc408c0 1 < suggested remove operation key=0OLVDEQWBCAQ tag=M40LO3O98JAE type=del 2024-08-27T02:37:53.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.399+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~V5JDRIM16K5R.0 size=209633 2024-08-27T02:37:53.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.399+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=V5JDRIM16K5R tag=3EAKRY6U9KKE type=write size=1258209 2024-08-27T02:37:53.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.403+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~70JDVJBWIAJA.0 size=1048576 2024-08-27T02:37:53.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.403+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HTEOX3BV94K2.2~70JDVJBWIAJA.1 size=1048576 2024-08-27T02:37:53.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.403+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~70JDVJBWIAJA.2 size=288003 2024-08-27T02:37:53.408 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.407+0000 7f3e0cc408c0 1 < canceled multipart upload key=HTEOX3BV94K2 upload=70JDVJBWIAJA tag=WNBC3L6JQ0BF type=write size=3433731 2024-08-27T02:37:53.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.415+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~6C313X9V68K3.0 size=1048576 2024-08-27T02:37:53.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.415+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~6C313X9V68K3.1 size=573322 2024-08-27T02:37:53.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.415+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=6C313X9V68K3 tag=UJ1CIRRVPY3A type=write size=2670474 2024-08-27T02:37:53.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.419+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=BB2NANZOIYZ8 type=del 2024-08-27T02:37:53.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.419+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=EERXU9ZLNZUF type=del size=3180582 2024-08-27T02:37:53.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.419+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~J2PDRW41H51K.0 size=704387 2024-08-27T02:37:53.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.423+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=J2PDRW41H51K tag=7WO6JU0GZCS3 type=write size=1752963 2024-08-27T02:37:53.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~ONKL5KDFQAW1.0 size=1048576 2024-08-27T02:37:53.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.431+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~ONKL5KDFQAW1.1 size=1048576 2024-08-27T02:37:53.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.431+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~ONKL5KDFQAW1.2 size=881734 2024-08-27T02:37:53.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.431+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=ONKL5KDFQAW1 tag=GA3FSX3ZFJJM type=write size=4027462 2024-08-27T02:37:53.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.435+0000 7f3e0cc408c0 -1 < failed to complete operation key=OY551242R8T6 tag=23F2FXC2BAQK type=del size=3904713: (22) Invalid argument 2024-08-27T02:37:53.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~5BQPXIRRUJ57.0 size=175256 2024-08-27T02:37:53.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.439+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=5BQPXIRRUJ57 tag=J2HY5GP0U62B type=write size=1223832 2024-08-27T02:37:53.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.443+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=3VTPOG7R3HLZ type=del 2024-08-27T02:37:53.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.447+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~UESAQNHFY418.0 size=1048576 2024-08-27T02:37:53.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.447+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~UESAQNHFY418.1 size=897107 2024-08-27T02:37:53.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.447+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=UESAQNHFY418 tag=EDXVK878TD6U type=write size=2994259 2024-08-27T02:37:53.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.451+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=C0HQR9EUNSWX type=del 2024-08-27T02:37:53.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.455+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~OCLNX9HLMUPK.0 size=1048576 2024-08-27T02:37:53.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.459+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~OCLNX9HLMUPK.1 size=1048576 2024-08-27T02:37:53.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.459+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~OCLNX9HLMUPK.2 size=76720 2024-08-27T02:37:53.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.459+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=OCLNX9HLMUPK tag=VT40BWBKYCKB type=write size=3222448 2024-08-27T02:37:53.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.463+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=1ND2GW25MLNM type=del 2024-08-27T02:37:53.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.467+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~PW12YN394JYG.0 size=907054 2024-08-27T02:37:53.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.467+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=PW12YN394JYG tag=M3JJJEG547J0 type=write size=1955630 2024-08-27T02:37:53.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.471+0000 7f3e0cc408c0 1 < canceled operation key=PLC076BXR38P tag=1FUKPPYBCMFA type=del size=15592 2024-08-27T02:37:53.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.475+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~RP0692K9R4GF.0 size=1048576 2024-08-27T02:37:53.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.475+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~RP0692K9R4GF.1 size=745902 2024-08-27T02:37:53.476 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.475+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=RP0692K9R4GF tag=LNURMI8X1LOS type=write size=2843054 2024-08-27T02:37:53.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.479+0000 7f3e0cc408c0 1 < suggested update operation key=6YTZJKE4V5HQ tag=XH9K1PYXA8SP type=del size=2557806 2024-08-27T02:37:53.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.483+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=XGSQR1ATIJN3 type=del size=1854015 2024-08-27T02:37:53.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.487+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=YLX09A54WTN8 type=del 2024-08-27T02:37:53.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.487+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=KQ2BJ7DEICFI type=write size=838411 2024-08-27T02:37:53.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.491+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HTEOX3BV94K2.2~NFTKW2X1W1EG.0 size=1048576 2024-08-27T02:37:53.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.491+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~NFTKW2X1W1EG.1 size=854098 2024-08-27T02:37:53.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.495+0000 7f3e0cc408c0 1 < canceled multipart upload key=HTEOX3BV94K2 upload=NFTKW2X1W1EG tag=CI4QPG47R67K type=write size=2951250 2024-08-27T02:37:53.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.499+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=MVCGY7IDVUXN type=write size=457658 2024-08-27T02:37:53.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.503+0000 7f3e0cc408c0 1 < suggested remove operation key=D7YWS7BWXT37 tag=L35YKM1QRGVN type=write 2024-08-27T02:37:53.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.507+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~TL6XXZ24CEYO.0 size=1048576 2024-08-27T02:37:53.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.511+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~TL6XXZ24CEYO.1 size=1048576 2024-08-27T02:37:53.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.511+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~TL6XXZ24CEYO.2 size=668148 2024-08-27T02:37:53.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.511+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=TL6XXZ24CEYO tag=6WVG1WVT53IT type=write size=3813876 2024-08-27T02:37:53.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.515+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=5NPZX733FD8W type=del 2024-08-27T02:37:53.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.519+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~FDU4ZV2HC7FO.0 size=1048576 2024-08-27T02:37:53.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.523+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~FDU4ZV2HC7FO.1 size=1048576 2024-08-27T02:37:53.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.523+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~FDU4ZV2HC7FO.2 size=222610 2024-08-27T02:37:53.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.523+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=FDU4ZV2HC7FO tag=XJ3EQVN0DLJC type=write size=3368338 2024-08-27T02:37:53.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.527+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=P06RIXFFYUGI type=del 2024-08-27T02:37:53.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~JT8GK6VHF3H8.0 size=548690 2024-08-27T02:37:53.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.531+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=JT8GK6VHF3H8 tag=C0GROG4Z8MNV type=write size=1597266 2024-08-27T02:37:53.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.535+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~8DPS6LYQ5Z29.0 size=1048576 2024-08-27T02:37:53.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.539+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~8DPS6LYQ5Z29.1 size=1048576 2024-08-27T02:37:53.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.539+0000 7f3e0cc408c0 1 < canceled part key=_multipart_A0RUXE4YL6NR.2~8DPS6LYQ5Z29.2 size=468501 2024-08-27T02:37:53.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.543+0000 7f3e0cc408c0 1 < canceled multipart upload key=A0RUXE4YL6NR upload=8DPS6LYQ5Z29 tag=6NKBWFEEQ5FU type=write size=3614229 2024-08-27T02:37:53.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.547+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~3HP0K212CPLS.0 size=887819 2024-08-27T02:37:53.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.547+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=3HP0K212CPLS tag=W7EHJFV10H06 type=write size=1936395 2024-08-27T02:37:53.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.551+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~V5JDRIM16K5R.0 size=209633 2024-08-27T02:37:53.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.555+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=V5JDRIM16K5R tag=3EAKRY6U9KKE type=write size=1258209 2024-08-27T02:37:53.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.559+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=I8DWKZETCERC type=del size=3802654 2024-08-27T02:37:53.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.559+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~6C313X9V68K3.0 size=1048576 2024-08-27T02:37:53.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.559+0000 7f3e0cc408c0 1 < canceled part key=_multipart_O66XJ7GJMPCU.2~6C313X9V68K3.1 size=573322 2024-08-27T02:37:53.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.563+0000 7f3e0cc408c0 1 < canceled multipart upload key=O66XJ7GJMPCU upload=6C313X9V68K3 tag=UJ1CIRRVPY3A type=write size=2670474 2024-08-27T02:37:53.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.567+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=D250WFF32QTT type=del size=2877786 2024-08-27T02:37:53.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.571+0000 7f3e0cc408c0 1 < canceled operation key=HTEOX3BV94K2 tag=EERXU9ZLNZUF type=del size=3180582 2024-08-27T02:37:53.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.571+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=KMZI59WA1FYD type=write size=433956 2024-08-27T02:37:53.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.575+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~ONKL5KDFQAW1.0 size=1048576 2024-08-27T02:37:53.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~ONKL5KDFQAW1.1 size=1048576 2024-08-27T02:37:53.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~ONKL5KDFQAW1.2 size=881734 2024-08-27T02:37:53.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.583+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=ONKL5KDFQAW1 tag=GA3FSX3ZFJJM type=write size=4027462 2024-08-27T02:37:53.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.587+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=OOHUWR7R27Z5 type=del size=2885380 2024-08-27T02:37:53.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.591+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~5BQPXIRRUJ57.0 size=175256 2024-08-27T02:37:53.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.595+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=5BQPXIRRUJ57 tag=J2HY5GP0U62B type=write size=1223832 2024-08-27T02:37:53.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.599+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=Z5619QOGNHBE type=write size=823241 2024-08-27T02:37:53.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~UESAQNHFY418.0 size=1048576 2024-08-27T02:37:53.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~UESAQNHFY418.1 size=897107 2024-08-27T02:37:53.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.607+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=UESAQNHFY418 tag=EDXVK878TD6U type=write size=2994259 2024-08-27T02:37:53.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.615+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~LXOITYDC121D.0 size=1048576 2024-08-27T02:37:53.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.619+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~LXOITYDC121D.1 size=979230 2024-08-27T02:37:53.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.619+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=LXOITYDC121D tag=TVDESAP2AE3P type=write size=3076382 2024-08-27T02:37:53.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~OCLNX9HLMUPK.0 size=1048576 2024-08-27T02:37:53.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~OCLNX9HLMUPK.1 size=1048576 2024-08-27T02:37:53.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.623+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0U59R3BXL181.2~OCLNX9HLMUPK.2 size=76720 2024-08-27T02:37:53.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.627+0000 7f3e0cc408c0 1 < canceled multipart upload key=0U59R3BXL181 upload=OCLNX9HLMUPK tag=VT40BWBKYCKB type=write size=3222448 2024-08-27T02:37:53.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.627+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=MBU2FXCOAMVQ type=del size=842660 2024-08-27T02:37:53.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.631+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~PW12YN394JYG.0 size=907054 2024-08-27T02:37:53.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.635+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=PW12YN394JYG tag=M3JJJEG547J0 type=write size=1955630 2024-08-27T02:37:53.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.635+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=LP9L837FQQA4 type=write size=278501 2024-08-27T02:37:53.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.639+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~RP0692K9R4GF.0 size=1048576 2024-08-27T02:37:53.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.639+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~RP0692K9R4GF.1 size=745902 2024-08-27T02:37:53.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.643+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=RP0692K9R4GF tag=LNURMI8X1LOS type=write size=2843054 2024-08-27T02:37:53.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.647+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=BPM691ASDIA9 type=del size=1927863 2024-08-27T02:37:53.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.651+0000 7f3e0cc408c0 1 < canceled operation key=HKDJMA7O2DFM tag=XGSQR1ATIJN3 type=del size=1854015 2024-08-27T02:37:53.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~CVYO1MF1QIXK.0 size=244924 2024-08-27T02:37:53.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.655+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=CVYO1MF1QIXK tag=EMN1Z65M6J2G type=write size=1293500 2024-08-27T02:37:53.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.659+0000 7f3e0cc408c0 1 < canceled operation key=1ZIJ9JJTM4ZC tag=KQ2BJ7DEICFI type=write size=838411 2024-08-27T02:37:53.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.659+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=KO2QRNMRMZY6 type=write size=554136 2024-08-27T02:37:53.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.663+0000 7f3e0cc408c0 1 < suggested update operation key=6QE1HU65GQZZ tag=MVCGY7IDVUXN type=write size=457658 2024-08-27T02:37:53.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.671+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~KFS56OQPF4Z7.0 size=869873 2024-08-27T02:37:53.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.671+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=KFS56OQPF4Z7 tag=XTBNCGESMNLD type=write size=1918449 2024-08-27T02:37:53.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.671+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~TL6XXZ24CEYO.0 size=1048576 2024-08-27T02:37:53.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~TL6XXZ24CEYO.1 size=1048576 2024-08-27T02:37:53.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~TL6XXZ24CEYO.2 size=668148 2024-08-27T02:37:53.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.679+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=TL6XXZ24CEYO tag=6WVG1WVT53IT type=write size=3813876 2024-08-27T02:37:53.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.683+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=TK3GCJUAGCBG type=write size=854863 2024-08-27T02:37:53.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.683+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~FDU4ZV2HC7FO.0 size=1048576 2024-08-27T02:37:53.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~FDU4ZV2HC7FO.1 size=1048576 2024-08-27T02:37:53.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.691+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~FDU4ZV2HC7FO.2 size=222610 2024-08-27T02:37:53.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.695+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=FDU4ZV2HC7FO tag=XJ3EQVN0DLJC type=write size=3368338 2024-08-27T02:37:53.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.699+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~MS75F9TDVAUF.0 size=1048576 2024-08-27T02:37:53.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.703+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~MS75F9TDVAUF.1 size=1048576 2024-08-27T02:37:53.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.703+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~MS75F9TDVAUF.2 size=10696 2024-08-27T02:37:53.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.703+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=MS75F9TDVAUF tag=4J4Q2VQD5FSW type=write size=3156424 2024-08-27T02:37:53.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.707+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~JT8GK6VHF3H8.0 size=548690 2024-08-27T02:37:53.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.711+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=JT8GK6VHF3H8 tag=C0GROG4Z8MNV type=write size=1597266 2024-08-27T02:37:53.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.715+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=01EFCNEYFT4R type=del size=3852399 2024-08-27T02:37:53.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.715+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~3HP0K212CPLS.0 size=887819 2024-08-27T02:37:53.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.723+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=3HP0K212CPLS tag=W7EHJFV10H06 type=write size=1936395 2024-08-27T02:37:53.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.723+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=XNNRWATTL3NH type=del size=2193587 2024-08-27T02:37:53.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.727+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=I8DWKZETCERC type=del 2024-08-27T02:37:53.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.731+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=3DGHO555N5Q9 type=del size=373463 2024-08-27T02:37:53.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.731+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=D250WFF32QTT type=del 2024-08-27T02:37:53.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.735+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=TW37QQCXPU0A type=write size=1048517 2024-08-27T02:37:53.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.739+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=KMZI59WA1FYD type=write size=433956 2024-08-27T02:37:53.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.743+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~LYYV1M3O3WE6.0 size=1048576 2024-08-27T02:37:53.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.747+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~LYYV1M3O3WE6.1 size=1048576 2024-08-27T02:37:53.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.747+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~LYYV1M3O3WE6.2 size=50863 2024-08-27T02:37:53.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.747+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=LYYV1M3O3WE6 tag=MHVHM5F0HR73 type=write size=3196591 2024-08-27T02:37:53.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.751+0000 7f3e0cc408c0 -1 < failed to complete operation key=6QE1HU65GQZZ tag=OOHUWR7R27Z5 type=del size=2885380: (22) Invalid argument 2024-08-27T02:37:53.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~1QU6U91V6GQL.0 size=1048576 2024-08-27T02:37:53.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~1QU6U91V6GQL.1 size=471058 2024-08-27T02:37:53.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.759+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=1QU6U91V6GQL tag=MQX092YD1VUF type=write size=2568210 2024-08-27T02:37:53.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.763+0000 7f3e0cc408c0 1 < completed write operation key=2CXWPDABA9XJ tag=Z5619QOGNHBE type=write size=823241 2024-08-27T02:37:53.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.767+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=SOYNOI5NJ177 type=del size=1358986 2024-08-27T02:37:53.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~LXOITYDC121D.0 size=1048576 2024-08-27T02:37:53.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~LXOITYDC121D.1 size=979230 2024-08-27T02:37:53.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.775+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=LXOITYDC121D tag=TVDESAP2AE3P type=write size=3076382 2024-08-27T02:37:53.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~GJX8A83J2R0I.0 size=667538 2024-08-27T02:37:53.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.779+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=GJX8A83J2R0I tag=M33DO421T4EE type=write size=1716114 2024-08-27T02:37:53.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.787+0000 7f3e0cc408c0 1 < suggested remove operation key=13M7JVZT12I2 tag=MBU2FXCOAMVQ type=del 2024-08-27T02:37:53.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.787+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=2GME2I453MUF type=write size=939393 2024-08-27T02:37:53.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.791+0000 7f3e0cc408c0 1 < completed write operation key=O66XJ7GJMPCU tag=LP9L837FQQA4 type=write size=278501 2024-08-27T02:37:53.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.795+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=2QMBEFR5GTXD type=del size=562297 2024-08-27T02:37:53.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.799+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=BPM691ASDIA9 type=del 2024-08-27T02:37:53.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.803+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=P4U05JQ4CMM3 type=del size=3622985 2024-08-27T02:37:53.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.807+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~CVYO1MF1QIXK.0 size=244924 2024-08-27T02:37:53.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.811+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=CVYO1MF1QIXK tag=EMN1Z65M6J2G type=write size=1293500 2024-08-27T02:37:53.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.815+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=KEDCKEA0XMG0 type=del size=1190732 2024-08-27T02:37:53.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.819+0000 7f3e0cc408c0 1 < canceled operation key=HKDJMA7O2DFM tag=KO2QRNMRMZY6 type=write size=554136 2024-08-27T02:37:53.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.823+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=O82JF11D84ON type=write size=337401 2024-08-27T02:37:53.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.823+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~KFS56OQPF4Z7.0 size=869873 2024-08-27T02:37:53.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.827+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=KFS56OQPF4Z7 tag=XTBNCGESMNLD type=write size=1918449 2024-08-27T02:37:53.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~O7DZ535HJ2GL.0 size=38207 2024-08-27T02:37:53.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.835+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=O7DZ535HJ2GL tag=6G1O2SB50FAO type=write size=1086783 2024-08-27T02:37:53.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.835+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=TK3GCJUAGCBG type=write size=854863 2024-08-27T02:37:53.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.839+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=O45W0W3SNYTM type=del size=3719709 2024-08-27T02:37:53.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.843+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~MS75F9TDVAUF.0 size=1048576 2024-08-27T02:37:53.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.847+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~MS75F9TDVAUF.1 size=1048576 2024-08-27T02:37:53.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.847+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~MS75F9TDVAUF.2 size=10696 2024-08-27T02:37:53.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.851+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=MS75F9TDVAUF tag=4J4Q2VQD5FSW type=write size=3156424 2024-08-27T02:37:53.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.855+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=EIOIQ2SLKVO3 type=write size=760442 2024-08-27T02:37:53.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.859+0000 7f3e0cc408c0 1 < suggested remove operation key=B9DPI871LQ7E tag=01EFCNEYFT4R type=del 2024-08-27T02:37:53.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.863+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=FCEXWE36TVNL type=del size=3276213 2024-08-27T02:37:53.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.863+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=XNNRWATTL3NH type=del 2024-08-27T02:37:53.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.867+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=R356W5FKMTQ9 type=del size=1053309 2024-08-27T02:37:53.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.875+0000 7f3e0cc408c0 -1 < failed to complete operation key=B9DPI871LQ7E tag=3DGHO555N5Q9 type=del size=373463: (22) Invalid argument 2024-08-27T02:37:53.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.879+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=ILL7RMRMBS2X type=del size=1049698 2024-08-27T02:37:53.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.883+0000 7f3e0cc408c0 1 < canceled operation key=MNE5WNFBH9HG tag=TW37QQCXPU0A type=write size=1048517 2024-08-27T02:37:53.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.887+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~TCXCHACRY5YH.0 size=1048576 2024-08-27T02:37:53.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.891+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~TCXCHACRY5YH.1 size=320581 2024-08-27T02:37:53.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.891+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=TCXCHACRY5YH tag=4K8KUC1E3OZV type=write size=2417733 2024-08-27T02:37:53.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.891+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~LYYV1M3O3WE6.0 size=1048576 2024-08-27T02:37:53.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.895+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~LYYV1M3O3WE6.1 size=1048576 2024-08-27T02:37:53.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.899+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~LYYV1M3O3WE6.2 size=50863 2024-08-27T02:37:53.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.903+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=LYYV1M3O3WE6 tag=MHVHM5F0HR73 type=write size=3196591 2024-08-27T02:37:53.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~DMU0ZO4RUK83.0 size=303296 2024-08-27T02:37:53.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.907+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=DMU0ZO4RUK83 tag=7CQW9D2OF84V type=write size=1351872 2024-08-27T02:37:53.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.911+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~1QU6U91V6GQL.0 size=1048576 2024-08-27T02:37:53.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.915+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~1QU6U91V6GQL.1 size=471058 2024-08-27T02:37:53.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.919+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=1QU6U91V6GQL tag=MQX092YD1VUF type=write size=2568210 2024-08-27T02:37:53.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.923+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=XJPVUVEEY01H type=del size=1368063 2024-08-27T02:37:53.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.927+0000 7f3e0cc408c0 1 < suggested remove operation key=6QE1HU65GQZZ tag=SOYNOI5NJ177 type=del 2024-08-27T02:37:53.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~MVV55EEUO8EB.0 size=1048576 2024-08-27T02:37:53.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~MVV55EEUO8EB.1 size=362669 2024-08-27T02:37:53.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.935+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=MVV55EEUO8EB tag=PI15M7OAGP8R type=write size=2459821 2024-08-27T02:37:53.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.939+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~GJX8A83J2R0I.0 size=667538 2024-08-27T02:37:53.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.943+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=GJX8A83J2R0I tag=M33DO421T4EE type=write size=1716114 2024-08-27T02:37:53.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.947+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=9DWLCST5BOEU type=del size=1808698 2024-08-27T02:37:53.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.951+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=2GME2I453MUF type=write size=939393 2024-08-27T02:37:53.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.955+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~N0N822DVVGUW.0 size=1048576 2024-08-27T02:37:53.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.959+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~N0N822DVVGUW.1 size=1048576 2024-08-27T02:37:53.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.963+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~N0N822DVVGUW.2 size=759043 2024-08-27T02:37:53.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.963+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=N0N822DVVGUW tag=M7C7DKNB4GFM type=write size=3904771 2024-08-27T02:37:53.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.967+0000 7f3e0cc408c0 1 < suggested remove operation key=VSDJU5KQLFKE tag=2QMBEFR5GTXD type=del 2024-08-27T02:37:53.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.971+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~IAURZNKH1BTF.0 size=1048576 2024-08-27T02:37:53.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~IAURZNKH1BTF.1 size=1048576 2024-08-27T02:37:53.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~IAURZNKH1BTF.2 size=510925 2024-08-27T02:37:53.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.979+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=IAURZNKH1BTF tag=FFSOBQU2ETWA type=write size=3656653 2024-08-27T02:37:53.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.979+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=P4U05JQ4CMM3 type=del 2024-08-27T02:37:53.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.983+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=73IO7PGXOY10 type=del size=2128814 2024-08-27T02:37:53.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.987+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=KEDCKEA0XMG0 type=del 2024-08-27T02:37:53.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.991+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=ROOVVUHVR5SL type=del size=490139 2024-08-27T02:37:53.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:53.995+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=O82JF11D84ON type=write size=337401 2024-08-27T02:37:54.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~3H6LOIXWI8HP.0 size=1048576 2024-08-27T02:37:54.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~3H6LOIXWI8HP.1 size=1048576 2024-08-27T02:37:54.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~3H6LOIXWI8HP.2 size=74691 2024-08-27T02:37:54.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.007+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=3H6LOIXWI8HP tag=GEIRMZWABJYI type=write size=3220419 2024-08-27T02:37:54.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.011+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~O7DZ535HJ2GL.0 size=38207 2024-08-27T02:37:54.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.015+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=O7DZ535HJ2GL tag=6G1O2SB50FAO type=write size=1086783 2024-08-27T02:37:54.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.019+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~PP9R2TJ036OY.0 size=1048576 2024-08-27T02:37:54.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.023+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~PP9R2TJ036OY.1 size=1048576 2024-08-27T02:37:54.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~PP9R2TJ036OY.2 size=687241 2024-08-27T02:37:54.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.027+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=PP9R2TJ036OY tag=2FKEZG92NDSO type=write size=3832969 2024-08-27T02:37:54.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.027+0000 7f3e0cc408c0 -1 < failed to complete operation key=B9DPI871LQ7E tag=O45W0W3SNYTM type=del size=3719709: (22) Invalid argument 2024-08-27T02:37:54.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.031+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=HJM1DX5DAWD2 type=del size=1585645 2024-08-27T02:37:54.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.035+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=EIOIQ2SLKVO3 type=write size=760442 2024-08-27T02:37:54.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.043+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~CAK9OZFXUSQA.0 size=1048576 2024-08-27T02:37:54.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.043+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~CAK9OZFXUSQA.1 size=1048576 2024-08-27T02:37:54.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.047+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~CAK9OZFXUSQA.2 size=639002 2024-08-27T02:37:54.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.047+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=CAK9OZFXUSQA tag=CAUXQF39RVOD type=write size=3784730 2024-08-27T02:37:54.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.055+0000 7f3e0cc408c0 1 < suggested update operation key=ZMN8Y0VQVHLB tag=FCEXWE36TVNL type=del size=3276213 2024-08-27T02:37:54.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.055+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=GKLSIW5C4SXR type=write size=97585 2024-08-27T02:37:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.063+0000 7f3e0cc408c0 1 < suggested remove operation key=1ZIJ9JJTM4ZC tag=R356W5FKMTQ9 type=del 2024-08-27T02:37:54.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.067+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~WLXU0LCTXG3V.0 size=1048576 2024-08-27T02:37:54.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.071+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~WLXU0LCTXG3V.1 size=1048576 2024-08-27T02:37:54.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.075+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~WLXU0LCTXG3V.2 size=916515 2024-08-27T02:37:54.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.075+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=WLXU0LCTXG3V tag=8NDEAAU2DZV7 type=write size=4062243 2024-08-27T02:37:54.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.075+0000 7f3e0cc408c0 1 < canceled operation key=13M7JVZT12I2 tag=ILL7RMRMBS2X type=del size=1049698 2024-08-27T02:37:54.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.079+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=3RXGQLOEU2XA type=del size=1022129 2024-08-27T02:37:54.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.083+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~TCXCHACRY5YH.0 size=1048576 2024-08-27T02:37:54.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.083+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~TCXCHACRY5YH.1 size=320581 2024-08-27T02:37:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.091+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=TCXCHACRY5YH tag=4K8KUC1E3OZV type=write size=2417733 2024-08-27T02:37:54.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~N9AHVY4MASD4.0 size=1048576 2024-08-27T02:37:54.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~N9AHVY4MASD4.1 size=71747 2024-08-27T02:37:54.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.099+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=N9AHVY4MASD4 tag=M0F710LQ92ZP type=write size=2168899 2024-08-27T02:37:54.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.099+0000 7f3e0cc408c0 1 < canceled part key=_multipart_S5ANS33DXN7X.2~DMU0ZO4RUK83.0 size=303296 2024-08-27T02:37:54.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.103+0000 7f3e0cc408c0 1 < canceled multipart upload key=S5ANS33DXN7X upload=DMU0ZO4RUK83 tag=7CQW9D2OF84V type=write size=1351872 2024-08-27T02:37:54.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.111+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~RECGY0CMIZ38.0 size=1048576 2024-08-27T02:37:54.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.111+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~RECGY0CMIZ38.1 size=1048576 2024-08-27T02:37:54.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.115+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~RECGY0CMIZ38.2 size=57216 2024-08-27T02:37:54.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.115+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=RECGY0CMIZ38 tag=3F6KR0Y123JP type=write size=3202944 2024-08-27T02:37:54.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.119+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=XJPVUVEEY01H type=del 2024-08-27T02:37:54.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.119+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=ME85CSA6DY0C type=del size=198289 2024-08-27T02:37:54.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.123+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HKDJMA7O2DFM.2~MVV55EEUO8EB.0 size=1048576 2024-08-27T02:37:54.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.123+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~MVV55EEUO8EB.1 size=362669 2024-08-27T02:37:54.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.127+0000 7f3e0cc408c0 1 < canceled multipart upload key=HKDJMA7O2DFM upload=MVV55EEUO8EB tag=PI15M7OAGP8R type=write size=2459821 2024-08-27T02:37:54.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~MWK7HTG88P7A.0 size=515383 2024-08-27T02:37:54.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.135+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=MWK7HTG88P7A tag=EEPYTD8K4ORY type=write size=1563959 2024-08-27T02:37:54.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.135+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=9DWLCST5BOEU type=del 2024-08-27T02:37:54.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.139+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=TPROTR9QK22G type=del size=2863442 2024-08-27T02:37:54.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.143+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~N0N822DVVGUW.0 size=1048576 2024-08-27T02:37:54.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.143+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~N0N822DVVGUW.1 size=1048576 2024-08-27T02:37:54.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.147+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~N0N822DVVGUW.2 size=759043 2024-08-27T02:37:54.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.151+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=N0N822DVVGUW tag=M7C7DKNB4GFM type=write size=3904771 2024-08-27T02:37:54.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.155+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=HHFGMUQTYM48 type=del size=1885320 2024-08-27T02:37:54.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~IAURZNKH1BTF.0 size=1048576 2024-08-27T02:37:54.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.163+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~IAURZNKH1BTF.1 size=1048576 2024-08-27T02:37:54.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.163+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~IAURZNKH1BTF.2 size=510925 2024-08-27T02:37:54.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.167+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=IAURZNKH1BTF tag=FFSOBQU2ETWA type=write size=3656653 2024-08-27T02:37:54.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~ZWM4PLD8M9MT.0 size=1048576 2024-08-27T02:37:54.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~ZWM4PLD8M9MT.1 size=93850 2024-08-27T02:37:54.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.175+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=ZWM4PLD8M9MT tag=HNDCRW5EJ3E5 type=write size=2191002 2024-08-27T02:37:54.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.179+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=73IO7PGXOY10 type=del 2024-08-27T02:37:54.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.183+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~4MV320FABMBL.0 size=1048576 2024-08-27T02:37:54.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~4MV320FABMBL.1 size=1048576 2024-08-27T02:37:54.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~4MV320FABMBL.2 size=868527 2024-08-27T02:37:54.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.187+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=4MV320FABMBL tag=R9BRKKYQH0J0 type=write size=4014255 2024-08-27T02:37:54.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.195+0000 7f3e0cc408c0 1 < suggested update operation key=HKDJMA7O2DFM tag=ROOVVUHVR5SL type=del size=490139 2024-08-27T02:37:54.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~20YDNNPW83WK.0 size=635244 2024-08-27T02:37:54.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.199+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=20YDNNPW83WK tag=254AV42NF75J type=write size=1683820 2024-08-27T02:37:54.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.199+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JDV1RIGAO7J1.2~3H6LOIXWI8HP.0 size=1048576 2024-08-27T02:37:54.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.203+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~3H6LOIXWI8HP.1 size=1048576 2024-08-27T02:37:54.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.203+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~3H6LOIXWI8HP.2 size=74691 2024-08-27T02:37:54.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.207+0000 7f3e0cc408c0 1 < canceled multipart upload key=JDV1RIGAO7J1 upload=3H6LOIXWI8HP tag=GEIRMZWABJYI type=write size=3220419 2024-08-27T02:37:54.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.211+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=MX75CII5X5UK type=del size=3850349 2024-08-27T02:37:54.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.215+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~PP9R2TJ036OY.0 size=1048576 2024-08-27T02:37:54.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.215+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~PP9R2TJ036OY.1 size=1048576 2024-08-27T02:37:54.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.219+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~PP9R2TJ036OY.2 size=687241 2024-08-27T02:37:54.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.223+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=PP9R2TJ036OY tag=2FKEZG92NDSO type=write size=3832969 2024-08-27T02:37:54.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.227+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~6HBVZ3G2QBX5.0 size=653184 2024-08-27T02:37:54.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.227+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=6HBVZ3G2QBX5 tag=X7M5Q65PF4P5 type=write size=1701760 2024-08-27T02:37:54.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.231+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=HJM1DX5DAWD2 type=del 2024-08-27T02:37:54.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.235+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=HB2FYGI8TUYS type=del size=3745684 2024-08-27T02:37:54.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.235+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~CAK9OZFXUSQA.0 size=1048576 2024-08-27T02:37:54.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.235+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~CAK9OZFXUSQA.1 size=1048576 2024-08-27T02:37:54.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.239+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~CAK9OZFXUSQA.2 size=639002 2024-08-27T02:37:54.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.243+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=CAK9OZFXUSQA tag=CAUXQF39RVOD type=write size=3784730 2024-08-27T02:37:54.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~VIAHB9WRJNHO.0 size=772061 2024-08-27T02:37:54.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.251+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=VIAHB9WRJNHO tag=72DEV7537LDM type=write size=1820637 2024-08-27T02:37:54.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.255+0000 7f3e0cc408c0 1 < suggested remove operation key=KTPZGZSQCERQ tag=GKLSIW5C4SXR type=write 2024-08-27T02:37:54.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.259+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=2QZYSSP1DTZG type=write size=65850 2024-08-27T02:37:54.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.263+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~WLXU0LCTXG3V.0 size=1048576 2024-08-27T02:37:54.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.263+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~WLXU0LCTXG3V.1 size=1048576 2024-08-27T02:37:54.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.267+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~WLXU0LCTXG3V.2 size=916515 2024-08-27T02:37:54.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.271+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=WLXU0LCTXG3V tag=8NDEAAU2DZV7 type=write size=4062243 2024-08-27T02:37:54.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.275+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=VVUOIK0F9TPY type=del size=2659760 2024-08-27T02:37:54.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.283+0000 7f3e0cc408c0 1 < suggested update operation key=4SSZQK6YIL1O tag=3RXGQLOEU2XA type=del size=1022129 2024-08-27T02:37:54.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.287+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=2H0MFNLGX0IA type=del size=2873574 2024-08-27T02:37:54.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.287+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~N9AHVY4MASD4.0 size=1048576 2024-08-27T02:37:54.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.291+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~N9AHVY4MASD4.1 size=71747 2024-08-27T02:37:54.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.299+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=N9AHVY4MASD4 tag=M0F710LQ92ZP type=write size=2168899 2024-08-27T02:37:54.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.299+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=XJWJRBY936QB type=del size=1672719 2024-08-27T02:37:54.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~RECGY0CMIZ38.0 size=1048576 2024-08-27T02:37:54.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.303+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~RECGY0CMIZ38.1 size=1048576 2024-08-27T02:37:54.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.307+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~RECGY0CMIZ38.2 size=57216 2024-08-27T02:37:54.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.311+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=RECGY0CMIZ38 tag=3F6KR0Y123JP type=write size=3202944 2024-08-27T02:37:54.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.315+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=FJYQS3MK1NUZ type=del size=263131 2024-08-27T02:37:54.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.319+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=ME85CSA6DY0C type=del 2024-08-27T02:37:54.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.323+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=ZWAPSYTTLWOT type=del size=1014039 2024-08-27T02:37:54.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.327+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~MWK7HTG88P7A.0 size=515383 2024-08-27T02:37:54.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.335+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=MWK7HTG88P7A tag=EEPYTD8K4ORY type=write size=1563959 2024-08-27T02:37:54.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.339+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~B6BX13FO5SFU.0 size=626025 2024-08-27T02:37:54.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.339+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=B6BX13FO5SFU tag=CBCIJPUA9RR9 type=write size=1674601 2024-08-27T02:37:54.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.347+0000 7f3e0cc408c0 1 < suggested update operation key=2CXWPDABA9XJ tag=TPROTR9QK22G type=del size=2863442 2024-08-27T02:37:54.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.351+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=EV1700WTIGBD type=del size=1918442 2024-08-27T02:37:54.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.351+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=HHFGMUQTYM48 type=del 2024-08-27T02:37:54.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.355+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=K2H9N82J9GKC type=del size=1899523 2024-08-27T02:37:54.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.359+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~ZWM4PLD8M9MT.0 size=1048576 2024-08-27T02:37:54.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.363+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~ZWM4PLD8M9MT.1 size=93850 2024-08-27T02:37:54.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.367+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=ZWM4PLD8M9MT tag=HNDCRW5EJ3E5 type=write size=2191002 2024-08-27T02:37:54.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.371+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=RG4OBJRJ59G0 type=write size=353681 2024-08-27T02:37:54.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.375+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~4MV320FABMBL.0 size=1048576 2024-08-27T02:37:54.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.375+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~4MV320FABMBL.1 size=1048576 2024-08-27T02:37:54.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.379+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~4MV320FABMBL.2 size=868527 2024-08-27T02:37:54.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.383+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=4MV320FABMBL tag=R9BRKKYQH0J0 type=write size=4014255 2024-08-27T02:37:54.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.387+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=7NYXUXCY5LPY type=del size=3581294 2024-08-27T02:37:54.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~20YDNNPW83WK.0 size=635244 2024-08-27T02:37:54.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.395+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=20YDNNPW83WK tag=254AV42NF75J type=write size=1683820 2024-08-27T02:37:54.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.403+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~CAV85F3SUKZ2.0 size=1048576 2024-08-27T02:37:54.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.403+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~CAV85F3SUKZ2.1 size=618295 2024-08-27T02:37:54.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.403+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=CAV85F3SUKZ2 tag=8MNG7JPVEUZ8 type=write size=2715447 2024-08-27T02:37:54.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.407+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=MX75CII5X5UK type=del 2024-08-27T02:37:54.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.411+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=0ERG8GI0TOPF type=write size=994099 2024-08-27T02:37:54.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.415+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~6HBVZ3G2QBX5.0 size=653184 2024-08-27T02:37:54.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.419+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=6HBVZ3G2QBX5 tag=X7M5Q65PF4P5 type=write size=1701760 2024-08-27T02:37:54.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.423+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=VCKYUFKJZHP2 type=del size=569071 2024-08-27T02:37:54.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.427+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=HB2FYGI8TUYS type=del 2024-08-27T02:37:54.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.431+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=32X82V506T0M type=del size=3919016 2024-08-27T02:37:54.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.435+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~VIAHB9WRJNHO.0 size=772061 2024-08-27T02:37:54.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.439+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=VIAHB9WRJNHO tag=72DEV7537LDM type=write size=1820637 2024-08-27T02:37:54.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.447+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~RKASPL2G4MGM.0 size=1048576 2024-08-27T02:37:54.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~RKASPL2G4MGM.1 size=1048576 2024-08-27T02:37:54.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~RKASPL2G4MGM.2 size=51050 2024-08-27T02:37:54.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.451+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=RKASPL2G4MGM tag=0PQAPNKL2TAG type=write size=3196778 2024-08-27T02:37:54.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.455+0000 7f3e0cc408c0 1 < completed write operation key=B9DPI871LQ7E tag=2QZYSSP1DTZG type=write size=65850 2024-08-27T02:37:54.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.459+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=KL8EWZ341JV8 type=del size=603305 2024-08-27T02:37:54.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.463+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=VVUOIK0F9TPY type=del 2024-08-27T02:37:54.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.467+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=P55EQFI3UEFZ type=del size=3631878 2024-08-27T02:37:54.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.471+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=2H0MFNLGX0IA type=del 2024-08-27T02:37:54.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.475+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~YK77DR2THFGX.0 size=666760 2024-08-27T02:37:54.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.475+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=YK77DR2THFGX tag=I2RI0J4FD7XP type=write size=1715336 2024-08-27T02:37:54.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.479+0000 7f3e0cc408c0 1 < canceled operation key=0U59R3BXL181 tag=XJWJRBY936QB type=del size=1672719 2024-08-27T02:37:54.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.483+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~SM391VJJP365.0 size=183707 2024-08-27T02:37:54.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.483+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=SM391VJJP365 tag=DEN078BEBQ66 type=write size=1232283 2024-08-27T02:37:54.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.491+0000 7f3e0cc408c0 1 < suggested remove operation key=S5ANS33DXN7X tag=FJYQS3MK1NUZ type=del 2024-08-27T02:37:54.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.495+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=L10G9RNT2O3P type=del size=3532141 2024-08-27T02:37:54.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.499+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=ZWAPSYTTLWOT type=del 2024-08-27T02:37:54.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.499+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=KPJUZKAAX0G5 type=del size=3303012 2024-08-27T02:37:54.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.503+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~B6BX13FO5SFU.0 size=626025 2024-08-27T02:37:54.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.511+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=B6BX13FO5SFU tag=CBCIJPUA9RR9 type=write size=1674601 2024-08-27T02:37:54.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.511+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=YLNTUK1XE1AM type=write size=1414 2024-08-27T02:37:54.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.515+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=EV1700WTIGBD type=del 2024-08-27T02:37:54.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.519+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=I3YTFZ74KVV2 type=del size=1129636 2024-08-27T02:37:54.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.523+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=K2H9N82J9GKC type=del 2024-08-27T02:37:54.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.527+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=YQ2M4A74VH5C type=del size=348046 2024-08-27T02:37:54.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.531+0000 7f3e0cc408c0 -1 < failed to complete operation key=S5ANS33DXN7X tag=RG4OBJRJ59G0 type=write size=353681: (22) Invalid argument 2024-08-27T02:37:54.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.535+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=1QB0OCZU5ANR type=write size=811162 2024-08-27T02:37:54.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.539+0000 7f3e0cc408c0 1 < canceled operation key=F4MCLPFLY531 tag=7NYXUXCY5LPY type=del size=3581294 2024-08-27T02:37:54.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.543+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=VHNQ2ZO64LRK type=write size=515495 2024-08-27T02:37:54.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~CAV85F3SUKZ2.0 size=1048576 2024-08-27T02:37:54.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.547+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~CAV85F3SUKZ2.1 size=618295 2024-08-27T02:37:54.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.551+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=CAV85F3SUKZ2 tag=8MNG7JPVEUZ8 type=write size=2715447 2024-08-27T02:37:54.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~K4LP0VQARW0T.0 size=1048576 2024-08-27T02:37:54.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~K4LP0VQARW0T.1 size=815562 2024-08-27T02:37:54.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.567+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=K4LP0VQARW0T tag=ZG7SVR2PO033 type=write size=2912714 2024-08-27T02:37:54.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.571+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=0ERG8GI0TOPF type=write size=994099 2024-08-27T02:37:54.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~ZELRHGJ58KNY.0 size=1048576 2024-08-27T02:37:54.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.583+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~ZELRHGJ58KNY.1 size=4249 2024-08-27T02:37:54.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.583+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=ZELRHGJ58KNY tag=O5YXXVC2RITM type=write size=2101401 2024-08-27T02:37:54.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.583+0000 7f3e0cc408c0 1 < canceled operation key=B9DPI871LQ7E tag=VCKYUFKJZHP2 type=del size=569071 2024-08-27T02:37:54.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.587+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=ZF5CTM3MLM1A type=del size=3258610 2024-08-27T02:37:54.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.591+0000 7f3e0cc408c0 1 < canceled operation key=4SSZQK6YIL1O tag=32X82V506T0M type=del size=3919016 2024-08-27T02:37:54.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.599+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~B4PYPQFXYEK3.0 size=708466 2024-08-27T02:37:54.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.599+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=B4PYPQFXYEK3 tag=GTZ3MD9ON6QE type=write size=1757042 2024-08-27T02:37:54.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.599+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~RKASPL2G4MGM.0 size=1048576 2024-08-27T02:37:54.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~RKASPL2G4MGM.1 size=1048576 2024-08-27T02:37:54.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~RKASPL2G4MGM.2 size=51050 2024-08-27T02:37:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.611+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=RKASPL2G4MGM tag=0PQAPNKL2TAG type=write size=3196778 2024-08-27T02:37:54.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.619+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~Z3SZJW8YG96T.0 size=1039804 2024-08-27T02:37:54.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.619+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=Z3SZJW8YG96T tag=YHULRIND8H3I type=write size=2088380 2024-08-27T02:37:54.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.623+0000 7f3e0cc408c0 1 < canceled operation key=0OLVDEQWBCAQ tag=KL8EWZ341JV8 type=del size=603305 2024-08-27T02:37:54.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.627+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=KTFMH9Q46XPX type=del size=2718674 2024-08-27T02:37:54.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.631+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=P55EQFI3UEFZ type=del 2024-08-27T02:37:54.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.635+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=MY8VPAE7NPFL type=del size=2538356 2024-08-27T02:37:54.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.639+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~YK77DR2THFGX.0 size=666760 2024-08-27T02:37:54.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.643+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=YK77DR2THFGX tag=I2RI0J4FD7XP type=write size=1715336 2024-08-27T02:37:54.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.647+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=NO23UO1ZT1K3 type=write size=683287 2024-08-27T02:37:54.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.651+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~SM391VJJP365.0 size=183707 2024-08-27T02:37:54.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.655+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=SM391VJJP365 tag=DEN078BEBQ66 type=write size=1232283 2024-08-27T02:37:54.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.659+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=74ZKNIKHJ64U type=del size=1800361 2024-08-27T02:37:54.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.667+0000 7f3e0cc408c0 1 < suggested update operation key=SG9T1RD5EATR tag=L10G9RNT2O3P type=del size=3532141 2024-08-27T02:37:54.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.667+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=TP0BLPJP3VFG type=del size=3532407 2024-08-27T02:37:54.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.671+0000 7f3e0cc408c0 1 < canceled operation key=MKB40KOOCCNT tag=KPJUZKAAX0G5 type=del size=3303012 2024-08-27T02:37:54.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.675+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=4H9SRUSWXEBF type=write size=637168 2024-08-27T02:37:54.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.683+0000 7f3e0cc408c0 1 < suggested remove operation key=A0RUXE4YL6NR tag=YLNTUK1XE1AM type=write 2024-08-27T02:37:54.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.687+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=VT8XMMB22543 type=del size=548734 2024-08-27T02:37:54.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.691+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=I3YTFZ74KVV2 type=del 2024-08-27T02:37:54.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.695+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=UA83US63CP57 type=del size=3354470 2024-08-27T02:37:54.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.699+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=YQ2M4A74VH5C type=del 2024-08-27T02:37:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.699+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=GW6Q4QC5UWO0 type=del size=923423 2024-08-27T02:37:54.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.703+0000 7f3e0cc408c0 1 < canceled operation key=4SSZQK6YIL1O tag=1QB0OCZU5ANR type=write size=811162 2024-08-27T02:37:54.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.711+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~UHQ81Z9FOCHD.0 size=161159 2024-08-27T02:37:54.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.711+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=UHQ81Z9FOCHD tag=A9SNYY8L8W03 type=write size=1209735 2024-08-27T02:37:54.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.715+0000 7f3e0cc408c0 1 < canceled operation key=8VSA6T2H8FDI tag=VHNQ2ZO64LRK type=write size=515495 2024-08-27T02:37:54.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.715+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=1T3SY8H86BM4 type=del size=2810316 2024-08-27T02:37:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.719+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~K4LP0VQARW0T.0 size=1048576 2024-08-27T02:37:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.719+0000 7f3e0cc408c0 1 < canceled part key=_multipart_O66XJ7GJMPCU.2~K4LP0VQARW0T.1 size=815562 2024-08-27T02:37:54.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.723+0000 7f3e0cc408c0 1 < canceled multipart upload key=O66XJ7GJMPCU upload=K4LP0VQARW0T tag=ZG7SVR2PO033 type=write size=2912714 2024-08-27T02:37:54.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.731+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~UUQQS5DN0XNY.0 size=521303 2024-08-27T02:37:54.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.731+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=UUQQS5DN0XNY tag=ICVYKP73GFSS type=write size=1569879 2024-08-27T02:37:54.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.735+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~ZELRHGJ58KNY.0 size=1048576 2024-08-27T02:37:54.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.735+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~ZELRHGJ58KNY.1 size=4249 2024-08-27T02:37:54.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.743+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=ZELRHGJ58KNY tag=O5YXXVC2RITM type=write size=2101401 2024-08-27T02:37:54.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.747+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=81NOIFA390HY type=del size=3803388 2024-08-27T02:37:54.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.747+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=ZF5CTM3MLM1A type=del 2024-08-27T02:37:54.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.751+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=671T2OMOMZQU type=del size=116989 2024-08-27T02:37:54.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.755+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~B4PYPQFXYEK3.0 size=708466 2024-08-27T02:37:54.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.759+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=B4PYPQFXYEK3 tag=GTZ3MD9ON6QE type=write size=1757042 2024-08-27T02:37:54.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.763+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=522JE5BKX0DJ type=del size=79472 2024-08-27T02:37:54.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~Z3SZJW8YG96T.0 size=1039804 2024-08-27T02:37:54.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.775+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=Z3SZJW8YG96T tag=YHULRIND8H3I type=write size=2088380 2024-08-27T02:37:54.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~6YPSCR5LLQ3A.0 size=1048576 2024-08-27T02:37:54.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.783+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~6YPSCR5LLQ3A.1 size=1048576 2024-08-27T02:37:54.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.783+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~6YPSCR5LLQ3A.2 size=108042 2024-08-27T02:37:54.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.783+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=6YPSCR5LLQ3A tag=V532TSYEV9R5 type=write size=3253770 2024-08-27T02:37:54.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.787+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=KTFMH9Q46XPX type=del 2024-08-27T02:37:54.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.791+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=QIZ8JJFR2L3T type=del size=927682 2024-08-27T02:37:54.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.795+0000 7f3e0cc408c0 1 < canceled operation key=HKDJMA7O2DFM tag=MY8VPAE7NPFL type=del size=2538356 2024-08-27T02:37:54.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.799+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~XULQS5CR79XC.0 size=1048576 2024-08-27T02:37:54.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~XULQS5CR79XC.1 size=1048576 2024-08-27T02:37:54.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~XULQS5CR79XC.2 size=326114 2024-08-27T02:37:54.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.803+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=XULQS5CR79XC tag=340MPKAT7SZ0 type=write size=3471842 2024-08-27T02:37:54.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.807+0000 7f3e0cc408c0 1 < completed write operation key=JLAGXRZVF50G tag=NO23UO1ZT1K3 type=write size=683287 2024-08-27T02:37:54.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.811+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=9B2775XH6Q89 type=del size=1935743 2024-08-27T02:37:54.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.811+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=74ZKNIKHJ64U type=del 2024-08-27T02:37:54.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.819+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~AW0VROHKMYVS.0 size=1048576 2024-08-27T02:37:54.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.819+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~AW0VROHKMYVS.1 size=43170 2024-08-27T02:37:54.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.819+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=AW0VROHKMYVS tag=RQS63QNYLQCA type=write size=2140322 2024-08-27T02:37:54.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.823+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=TP0BLPJP3VFG type=del 2024-08-27T02:37:54.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.827+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=RHWFT6T212OR type=write size=688019 2024-08-27T02:37:54.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.831+0000 7f3e0cc408c0 1 < completed write operation key=1ZIJ9JJTM4ZC tag=4H9SRUSWXEBF type=write size=637168 2024-08-27T02:37:54.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~RUEASCORG88V.0 size=613822 2024-08-27T02:37:54.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.835+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=RUEASCORG88V tag=2J3NO420ET93 type=write size=1662398 2024-08-27T02:37:54.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.835+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=VT8XMMB22543 type=del 2024-08-27T02:37:54.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.839+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=UPAILFV49M72 type=del size=2284838 2024-08-27T02:37:54.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.843+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=UA83US63CP57 type=del 2024-08-27T02:37:54.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.843+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=AGIGK8TZ4WSO type=del size=3885047 2024-08-27T02:37:54.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.847+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=GW6Q4QC5UWO0 type=del 2024-08-27T02:37:54.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.855+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~8B57XGB2AFWE.0 size=1048576 2024-08-27T02:37:54.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.855+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~8B57XGB2AFWE.1 size=251220 2024-08-27T02:37:54.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.855+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=8B57XGB2AFWE tag=QR69GYTC4LLI type=write size=2348372 2024-08-27T02:37:54.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.859+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~UHQ81Z9FOCHD.0 size=161159 2024-08-27T02:37:54.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.863+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=UHQ81Z9FOCHD tag=A9SNYY8L8W03 type=write size=1209735 2024-08-27T02:37:54.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.867+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~494658KHT0R5.0 size=1048576 2024-08-27T02:37:54.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.871+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~494658KHT0R5.1 size=1048576 2024-08-27T02:37:54.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.871+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~494658KHT0R5.2 size=86352 2024-08-27T02:37:54.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.871+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=494658KHT0R5 tag=UKDO6O44LP77 type=write size=3232080 2024-08-27T02:37:54.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.875+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=1T3SY8H86BM4 type=del 2024-08-27T02:37:54.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.879+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~CIVY2RM6355B.0 size=1048576 2024-08-27T02:37:54.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.883+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~CIVY2RM6355B.1 size=402558 2024-08-27T02:37:54.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.883+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=CIVY2RM6355B tag=GXNP0XB4TPNI type=write size=2499710 2024-08-27T02:37:54.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.883+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~UUQQS5DN0XNY.0 size=521303 2024-08-27T02:37:54.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.887+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=UUQQS5DN0XNY tag=ICVYKP73GFSS type=write size=1569879 2024-08-27T02:37:54.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.891+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=6S4I2O67GP4E type=del size=1655702 2024-08-27T02:37:54.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.895+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=81NOIFA390HY type=del 2024-08-27T02:37:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.895+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=LYND3UV79111 type=del size=2506503 2024-08-27T02:37:54.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.903+0000 7f3e0cc408c0 1 < suggested update operation key=8VSA6T2H8FDI tag=671T2OMOMZQU type=del size=116989 2024-08-27T02:37:54.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.907+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=4YY3WW8GIZQH type=del size=1713704 2024-08-27T02:37:54.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.907+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=522JE5BKX0DJ type=del 2024-08-27T02:37:54.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.915+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~BG9P53C2WK9F.0 size=1048576 2024-08-27T02:37:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.919+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~BG9P53C2WK9F.1 size=1048576 2024-08-27T02:37:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.919+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~BG9P53C2WK9F.2 size=835224 2024-08-27T02:37:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.919+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=BG9P53C2WK9F tag=FF464T7AC3KX type=write size=3980952 2024-08-27T02:37:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.923+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~6YPSCR5LLQ3A.0 size=1048576 2024-08-27T02:37:54.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.927+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~6YPSCR5LLQ3A.1 size=1048576 2024-08-27T02:37:54.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.931+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~6YPSCR5LLQ3A.2 size=108042 2024-08-27T02:37:54.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.935+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=6YPSCR5LLQ3A tag=V532TSYEV9R5 type=write size=3253770 2024-08-27T02:37:54.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.943+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~W4U8JU9ZGH6M.0 size=141772 2024-08-27T02:37:54.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.943+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=W4U8JU9ZGH6M tag=I4OPS6X2J151 type=write size=1190348 2024-08-27T02:37:54.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.947+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=QIZ8JJFR2L3T type=del 2024-08-27T02:37:54.950 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.951+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=LPDE0FG2G2NC type=del size=2558530 2024-08-27T02:37:54.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~XULQS5CR79XC.0 size=1048576 2024-08-27T02:37:54.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~XULQS5CR79XC.1 size=1048576 2024-08-27T02:37:54.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~XULQS5CR79XC.2 size=326114 2024-08-27T02:37:54.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.967+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=XULQS5CR79XC tag=340MPKAT7SZ0 type=write size=3471842 2024-08-27T02:37:54.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.971+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~APU5Y06LKJRQ.0 size=1048576 2024-08-27T02:37:54.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~APU5Y06LKJRQ.1 size=1041697 2024-08-27T02:37:54.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.975+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=APU5Y06LKJRQ tag=1FNV021CL9ZW type=write size=3138849 2024-08-27T02:37:54.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.983+0000 7f3e0cc408c0 1 < suggested update operation key=ZMN8Y0VQVHLB tag=9B2775XH6Q89 type=del size=1935743 2024-08-27T02:37:54.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.987+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~LX2KKS6QRJGQ.0 size=1048576 2024-08-27T02:37:54.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.987+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~LX2KKS6QRJGQ.1 size=398121 2024-08-27T02:37:54.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.987+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=LX2KKS6QRJGQ tag=5R4A1QPBU6L2 type=write size=2495273 2024-08-27T02:37:54.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~AW0VROHKMYVS.0 size=1048576 2024-08-27T02:37:54.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.995+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~AW0VROHKMYVS.1 size=43170 2024-08-27T02:37:54.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:54.999+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=AW0VROHKMYVS tag=RQS63QNYLQCA type=write size=2140322 2024-08-27T02:37:55.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~V4B5JHJ6MNP8.0 size=1048576 2024-08-27T02:37:55.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~V4B5JHJ6MNP8.1 size=159056 2024-08-27T02:37:55.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.007+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=V4B5JHJ6MNP8 tag=G7TQKF4C0LJE type=write size=2256208 2024-08-27T02:37:55.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.015+0000 7f3e0cc408c0 1 < suggested update operation key=ZMN8Y0VQVHLB tag=RHWFT6T212OR type=write size=688019 2024-08-27T02:37:55.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.015+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=OUBFLLHY440W type=write size=1007135 2024-08-27T02:37:55.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~RUEASCORG88V.0 size=613822 2024-08-27T02:37:55.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.023+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=RUEASCORG88V tag=2J3NO420ET93 type=write size=1662398 2024-08-27T02:37:55.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.027+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=C3S45EPD3YHC type=write size=460041 2024-08-27T02:37:55.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.031+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=UPAILFV49M72 type=del 2024-08-27T02:37:55.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.035+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=UB6G3I7GPALP type=del size=256306 2024-08-27T02:37:55.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.039+0000 7f3e0cc408c0 1 < canceled operation key=0U59R3BXL181 tag=AGIGK8TZ4WSO type=del size=3885047 2024-08-27T02:37:55.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.039+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=GL99976TFPKD type=del size=554596 2024-08-27T02:37:55.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~8B57XGB2AFWE.0 size=1048576 2024-08-27T02:37:55.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~8B57XGB2AFWE.1 size=251220 2024-08-27T02:37:55.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.051+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=8B57XGB2AFWE tag=QR69GYTC4LLI type=write size=2348372 2024-08-27T02:37:55.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.059+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~ZC8T9C8C4KGA.0 size=352756 2024-08-27T02:37:55.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.059+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=ZC8T9C8C4KGA tag=DDWQGJ4U70T4 type=write size=1401332 2024-08-27T02:37:55.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~494658KHT0R5.0 size=1048576 2024-08-27T02:37:55.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~494658KHT0R5.1 size=1048576 2024-08-27T02:37:55.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~494658KHT0R5.2 size=86352 2024-08-27T02:37:55.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.071+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=494658KHT0R5 tag=UKDO6O44LP77 type=write size=3232080 2024-08-27T02:37:55.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.075+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=UVZXS6WQM2VP type=del size=1500313 2024-08-27T02:37:55.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.075+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~CIVY2RM6355B.0 size=1048576 2024-08-27T02:37:55.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.079+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~CIVY2RM6355B.1 size=402558 2024-08-27T02:37:55.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.083+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=CIVY2RM6355B tag=GXNP0XB4TPNI type=write size=2499710 2024-08-27T02:37:55.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.091+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~2WUI9Q06HOVT.0 size=1048576 2024-08-27T02:37:55.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.091+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~2WUI9Q06HOVT.1 size=642023 2024-08-27T02:37:55.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.091+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=2WUI9Q06HOVT tag=91FI5S33M16B type=write size=2739175 2024-08-27T02:37:55.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.095+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=6S4I2O67GP4E type=del 2024-08-27T02:37:55.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~LD5GI77KTXBU.0 size=1048576 2024-08-27T02:37:55.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~LD5GI77KTXBU.1 size=629763 2024-08-27T02:37:55.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.103+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=LD5GI77KTXBU tag=V5ZBYUU9F3TD type=write size=2726915 2024-08-27T02:37:55.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.107+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=LYND3UV79111 type=del 2024-08-27T02:37:55.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.111+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=RBDUQSMTAMXH type=write size=671618 2024-08-27T02:37:55.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.111+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=4YY3WW8GIZQH type=del 2024-08-27T02:37:55.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.115+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=OJGGDIMFPTJZ type=del size=316429 2024-08-27T02:37:55.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~BG9P53C2WK9F.0 size=1048576 2024-08-27T02:37:55.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.123+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~BG9P53C2WK9F.1 size=1048576 2024-08-27T02:37:55.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.123+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~BG9P53C2WK9F.2 size=835224 2024-08-27T02:37:55.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.131+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=BG9P53C2WK9F tag=FF464T7AC3KX type=write size=3980952 2024-08-27T02:37:55.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.135+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=3T6GAHW9X5Z6 type=del size=3553585 2024-08-27T02:37:55.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.139+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~W4U8JU9ZGH6M.0 size=141772 2024-08-27T02:37:55.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.143+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=W4U8JU9ZGH6M tag=I4OPS6X2J151 type=write size=1190348 2024-08-27T02:37:55.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~10ZJRI2S8I5C.0 size=1048576 2024-08-27T02:37:55.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.151+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~10ZJRI2S8I5C.1 size=1048576 2024-08-27T02:37:55.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~10ZJRI2S8I5C.2 size=357791 2024-08-27T02:37:55.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.155+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=10ZJRI2S8I5C tag=76M9XTPN2K54 type=write size=3503519 2024-08-27T02:37:55.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.155+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=LPDE0FG2G2NC type=del 2024-08-27T02:37:55.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.159+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=1O9MRTRR88M5 type=del size=1428865 2024-08-27T02:37:55.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.163+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~APU5Y06LKJRQ.0 size=1048576 2024-08-27T02:37:55.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.167+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~APU5Y06LKJRQ.1 size=1041697 2024-08-27T02:37:55.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.171+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=APU5Y06LKJRQ tag=1FNV021CL9ZW type=write size=3138849 2024-08-27T02:37:55.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.175+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=V6O5LFQXJ030 type=del size=3206213 2024-08-27T02:37:55.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.179+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~LX2KKS6QRJGQ.0 size=1048576 2024-08-27T02:37:55.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.183+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~LX2KKS6QRJGQ.1 size=398121 2024-08-27T02:37:55.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.187+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=LX2KKS6QRJGQ tag=5R4A1QPBU6L2 type=write size=2495273 2024-08-27T02:37:55.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.191+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=MM73Q02VJ472 type=write size=720664 2024-08-27T02:37:55.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.195+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~V4B5JHJ6MNP8.0 size=1048576 2024-08-27T02:37:55.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.195+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~V4B5JHJ6MNP8.1 size=159056 2024-08-27T02:37:55.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.199+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=V4B5JHJ6MNP8 tag=G7TQKF4C0LJE type=write size=2256208 2024-08-27T02:37:55.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.203+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=1HG3OPKJSK55 type=write size=462442 2024-08-27T02:37:55.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.207+0000 7f3e0cc408c0 1 < completed write operation key=2CXWPDABA9XJ tag=OUBFLLHY440W type=write size=1007135 2024-08-27T02:37:55.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.211+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~RWO147DQIM85.0 size=1048576 2024-08-27T02:37:55.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.215+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~RWO147DQIM85.1 size=737381 2024-08-27T02:37:55.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.215+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=RWO147DQIM85 tag=YLPWAW8T8HC2 type=write size=2834533 2024-08-27T02:37:55.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.219+0000 7f3e0cc408c0 1 < canceled operation key=B9DPI871LQ7E tag=C3S45EPD3YHC type=write size=460041 2024-08-27T02:37:55.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.223+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~4A7KMNBTGN1I.0 size=1048576 2024-08-27T02:37:55.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.227+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~4A7KMNBTGN1I.1 size=520092 2024-08-27T02:37:55.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.227+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=4A7KMNBTGN1I tag=LPR66NOD7NLG type=write size=2617244 2024-08-27T02:37:55.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.227+0000 7f3e0cc408c0 1 < canceled operation key=B9DPI871LQ7E tag=UB6G3I7GPALP type=del size=256306 2024-08-27T02:37:55.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.235+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~VE1JHKAXYFTH.0 size=1048576 2024-08-27T02:37:55.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.235+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~VE1JHKAXYFTH.1 size=1048576 2024-08-27T02:37:55.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.239+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~VE1JHKAXYFTH.2 size=842263 2024-08-27T02:37:55.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.239+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=VE1JHKAXYFTH tag=0V9GI4UHDRJY type=write size=3987991 2024-08-27T02:37:55.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.243+0000 7f3e0cc408c0 1 < canceled operation key=4SSZQK6YIL1O tag=GL99976TFPKD type=del size=554596 2024-08-27T02:37:55.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~F4Z0HISWFMTI.0 size=1048576 2024-08-27T02:37:55.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.251+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~F4Z0HISWFMTI.1 size=1045066 2024-08-27T02:37:55.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.251+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=F4Z0HISWFMTI tag=E5HDACBQ3JBS type=write size=3142218 2024-08-27T02:37:55.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.255+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~ZC8T9C8C4KGA.0 size=352756 2024-08-27T02:37:55.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.259+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=ZC8T9C8C4KGA tag=DDWQGJ4U70T4 type=write size=1401332 2024-08-27T02:37:55.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.263+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=TDILB521A8P4 type=del size=2613651 2024-08-27T02:37:55.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.267+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=UVZXS6WQM2VP type=del 2024-08-27T02:37:55.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.267+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=LUGVT8DBKXE6 type=del size=2869026 2024-08-27T02:37:55.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.267+0000 7f3e0cc408c0 1 < canceled part key=_multipart_F4MCLPFLY531.2~2WUI9Q06HOVT.0 size=1048576 2024-08-27T02:37:55.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.271+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~2WUI9Q06HOVT.1 size=642023 2024-08-27T02:37:55.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.275+0000 7f3e0cc408c0 1 < canceled multipart upload key=F4MCLPFLY531 upload=2WUI9Q06HOVT tag=91FI5S33M16B type=write size=2739175 2024-08-27T02:37:55.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.283+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~ULCL495VWEK5.0 size=745452 2024-08-27T02:37:55.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.283+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=ULCL495VWEK5 tag=ALN2N4EXTZZ2 type=write size=1794028 2024-08-27T02:37:55.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.283+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~LD5GI77KTXBU.0 size=1048576 2024-08-27T02:37:55.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.283+0000 7f3e0cc408c0 1 < canceled part key=_multipart_PLC076BXR38P.2~LD5GI77KTXBU.1 size=629763 2024-08-27T02:37:55.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.287+0000 7f3e0cc408c0 1 < canceled multipart upload key=PLC076BXR38P upload=LD5GI77KTXBU tag=V5ZBYUU9F3TD type=write size=2726915 2024-08-27T02:37:55.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.291+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=9MGB0U62AL1K type=del size=235926 2024-08-27T02:37:55.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.295+0000 7f3e0cc408c0 1 < completed write operation key=2CXWPDABA9XJ tag=RBDUQSMTAMXH type=write size=671618 2024-08-27T02:37:55.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.299+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=8NRRDULWKAOB type=del size=3550801 2024-08-27T02:37:55.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.303+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=OJGGDIMFPTJZ type=del 2024-08-27T02:37:55.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.303+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=VW3E1L25FP35 type=write size=715559 2024-08-27T02:37:55.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.307+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=3T6GAHW9X5Z6 type=del 2024-08-27T02:37:55.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.311+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=82CJ71UDVNES type=del size=1686373 2024-08-27T02:37:55.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.315+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~10ZJRI2S8I5C.0 size=1048576 2024-08-27T02:37:55.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.315+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~10ZJRI2S8I5C.1 size=1048576 2024-08-27T02:37:55.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~10ZJRI2S8I5C.2 size=357791 2024-08-27T02:37:55.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.323+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=10ZJRI2S8I5C tag=76M9XTPN2K54 type=write size=3503519 2024-08-27T02:37:55.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.331+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~PQQNRQWJG1I9.0 size=1048576 2024-08-27T02:37:55.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.331+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~PQQNRQWJG1I9.1 size=854264 2024-08-27T02:37:55.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.331+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=PQQNRQWJG1I9 tag=LJKCYW35HR59 type=write size=2951416 2024-08-27T02:37:55.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.335+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=1O9MRTRR88M5 type=del 2024-08-27T02:37:55.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.339+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=XNX8FZ1O4BSC type=del size=225151 2024-08-27T02:37:55.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.343+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=V6O5LFQXJ030 type=del 2024-08-27T02:37:55.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.347+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=SARYL0F198NP type=del size=3195465 2024-08-27T02:37:55.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.351+0000 7f3e0cc408c0 1 < completed write operation key=VSDJU5KQLFKE tag=MM73Q02VJ472 type=write size=720664 2024-08-27T02:37:55.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.351+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=0KSH3228SCYF type=del size=2728838 2024-08-27T02:37:55.355 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.355+0000 7f3e0cc408c0 1 < completed write operation key=F4MCLPFLY531 tag=1HG3OPKJSK55 type=write size=462442 2024-08-27T02:37:55.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.359+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~17A4WOGHK1Q9.0 size=714934 2024-08-27T02:37:55.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.359+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=17A4WOGHK1Q9 tag=13WMUTLZG53G type=write size=1763510 2024-08-27T02:37:55.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.363+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~RWO147DQIM85.0 size=1048576 2024-08-27T02:37:55.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~RWO147DQIM85.1 size=737381 2024-08-27T02:37:55.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.371+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=RWO147DQIM85 tag=YLPWAW8T8HC2 type=write size=2834533 2024-08-27T02:37:55.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.371+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=BWRH2PFR5EPP type=del size=1656177 2024-08-27T02:37:55.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.375+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~4A7KMNBTGN1I.0 size=1048576 2024-08-27T02:37:55.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.379+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~4A7KMNBTGN1I.1 size=520092 2024-08-27T02:37:55.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.383+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=4A7KMNBTGN1I tag=LPR66NOD7NLG type=write size=2617244 2024-08-27T02:37:55.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.387+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=KK0SGQZU2WSY type=del size=644315 2024-08-27T02:37:55.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~VE1JHKAXYFTH.0 size=1048576 2024-08-27T02:37:55.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~VE1JHKAXYFTH.1 size=1048576 2024-08-27T02:37:55.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~VE1JHKAXYFTH.2 size=842263 2024-08-27T02:37:55.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.399+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=VE1JHKAXYFTH tag=0V9GI4UHDRJY type=write size=3987991 2024-08-27T02:37:55.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.399+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=9ZGNWBZ708MT type=del size=630974 2024-08-27T02:37:55.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.403+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~F4Z0HISWFMTI.0 size=1048576 2024-08-27T02:37:55.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.407+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~F4Z0HISWFMTI.1 size=1045066 2024-08-27T02:37:55.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.411+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=F4Z0HISWFMTI tag=E5HDACBQ3JBS type=write size=3142218 2024-08-27T02:37:55.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.411+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=D5O93W5U1EYL type=del size=2509974 2024-08-27T02:37:55.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.415+0000 7f3e0cc408c0 1 < canceled operation key=F4MCLPFLY531 tag=TDILB521A8P4 type=del size=2613651 2024-08-27T02:37:55.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.419+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=HJ6VGVU9WIMZ type=del size=175378 2024-08-27T02:37:55.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.423+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=LUGVT8DBKXE6 type=del 2024-08-27T02:37:55.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.423+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=7ECG96ZGKIP1 type=write size=269237 2024-08-27T02:37:55.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.427+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~ULCL495VWEK5.0 size=745452 2024-08-27T02:37:55.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.431+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=ULCL495VWEK5 tag=ALN2N4EXTZZ2 type=write size=1794028 2024-08-27T02:37:55.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~DUBDOHA5OA28.0 size=1048576 2024-08-27T02:37:55.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~DUBDOHA5OA28.1 size=77398 2024-08-27T02:37:55.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.439+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=DUBDOHA5OA28 tag=EDUY3ACSV0R3 type=write size=2174550 2024-08-27T02:37:55.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.443+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=9MGB0U62AL1K type=del 2024-08-27T02:37:55.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.447+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=MGKKZD7EC1WQ type=del size=3835085 2024-08-27T02:37:55.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.451+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=8NRRDULWKAOB type=del 2024-08-27T02:37:55.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.455+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=ZD333XX9MAFV type=del size=1666760 2024-08-27T02:37:55.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.455+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=VW3E1L25FP35 type=write size=715559 2024-08-27T02:37:55.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~U88DSOY1YYCJ.0 size=1048576 2024-08-27T02:37:55.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.467+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~U88DSOY1YYCJ.1 size=319697 2024-08-27T02:37:55.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.467+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=U88DSOY1YYCJ tag=FKVRWJW388Y0 type=write size=2416849 2024-08-27T02:37:55.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.471+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=82CJ71UDVNES type=del 2024-08-27T02:37:55.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.475+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~RSHWR5PUFD30.0 size=1048576 2024-08-27T02:37:55.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.479+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~RSHWR5PUFD30.1 size=1048576 2024-08-27T02:37:55.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.479+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~RSHWR5PUFD30.2 size=443560 2024-08-27T02:37:55.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.479+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=RSHWR5PUFD30 tag=NWMPY0EFACT0 type=write size=3589288 2024-08-27T02:37:55.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.483+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~PQQNRQWJG1I9.0 size=1048576 2024-08-27T02:37:55.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.487+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~PQQNRQWJG1I9.1 size=854264 2024-08-27T02:37:55.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.491+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=PQQNRQWJG1I9 tag=LJKCYW35HR59 type=write size=2951416 2024-08-27T02:37:55.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.495+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=IX2M4TLFVDX7 type=del size=3976720 2024-08-27T02:37:55.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.499+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=XNX8FZ1O4BSC type=del 2024-08-27T02:37:55.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.503+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=NY0EDXTT7FZX type=write size=520030 2024-08-27T02:37:55.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.507+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=SARYL0F198NP type=del 2024-08-27T02:37:55.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.507+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=PTMXSH2GPCRG type=del size=2287459 2024-08-27T02:37:55.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.515+0000 7f3e0cc408c0 1 < suggested update operation key=O66XJ7GJMPCU tag=0KSH3228SCYF type=del size=2728838 2024-08-27T02:37:55.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.519+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=IBL84Y35WI6M type=del size=2532852 2024-08-27T02:37:55.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.523+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~17A4WOGHK1Q9.0 size=714934 2024-08-27T02:37:55.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.527+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=17A4WOGHK1Q9 tag=13WMUTLZG53G type=write size=1763510 2024-08-27T02:37:55.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~98UYXEPHY5CJ.0 size=1048576 2024-08-27T02:37:55.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~98UYXEPHY5CJ.1 size=1048576 2024-08-27T02:37:55.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~98UYXEPHY5CJ.2 size=975866 2024-08-27T02:37:55.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.535+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=98UYXEPHY5CJ tag=19AW1XUVGNTE type=write size=4121594 2024-08-27T02:37:55.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.539+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=BWRH2PFR5EPP type=del 2024-08-27T02:37:55.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.543+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=FFMI9MJTOW6I type=del size=2222132 2024-08-27T02:37:55.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.543+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=KK0SGQZU2WSY type=del 2024-08-27T02:37:55.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.547+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=S7CD92KVF7MR type=del size=4032967 2024-08-27T02:37:55.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.551+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=9ZGNWBZ708MT type=del 2024-08-27T02:37:55.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.555+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~1POXEEEOW6LW.0 size=398235 2024-08-27T02:37:55.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.555+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=1POXEEEOW6LW tag=ON6AMA14G708 type=write size=1446811 2024-08-27T02:37:55.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.563+0000 7f3e0cc408c0 1 < suggested update operation key=JDV1RIGAO7J1 tag=D5O93W5U1EYL type=del size=2509974 2024-08-27T02:37:55.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.563+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=JDW4TZJZZOYI type=del size=3884524 2024-08-27T02:37:55.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.571+0000 7f3e0cc408c0 1 < suggested remove operation key=MNE5WNFBH9HG tag=HJ6VGVU9WIMZ type=del 2024-08-27T02:37:55.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.571+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=FYUHNU4I5YN6 type=del size=3396382 2024-08-27T02:37:55.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.575+0000 7f3e0cc408c0 1 < canceled operation key=1ZIJ9JJTM4ZC tag=7ECG96ZGKIP1 type=write size=269237 2024-08-27T02:37:55.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~BD18P8FMPLH6.0 size=1048576 2024-08-27T02:37:55.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.583+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~BD18P8FMPLH6.1 size=445947 2024-08-27T02:37:55.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.583+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=BD18P8FMPLH6 tag=0XYBGPI3AFHK type=write size=2543099 2024-08-27T02:37:55.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.587+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~DUBDOHA5OA28.0 size=1048576 2024-08-27T02:37:55.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.587+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~DUBDOHA5OA28.1 size=77398 2024-08-27T02:37:55.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.591+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=DUBDOHA5OA28 tag=EDUY3ACSV0R3 type=write size=2174550 2024-08-27T02:37:55.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.595+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=QEW109A0ZWM5 type=del size=2528809 2024-08-27T02:37:55.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.599+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=MGKKZD7EC1WQ type=del 2024-08-27T02:37:55.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.603+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=2PY9GHOAW5EJ type=del size=1690654 2024-08-27T02:37:55.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.603+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=ZD333XX9MAFV type=del 2024-08-27T02:37:55.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.607+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=GK1TGUYFXA8M type=del size=441740 2024-08-27T02:37:55.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.611+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~U88DSOY1YYCJ.0 size=1048576 2024-08-27T02:37:55.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.611+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~U88DSOY1YYCJ.1 size=319697 2024-08-27T02:37:55.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.619+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=U88DSOY1YYCJ tag=FKVRWJW388Y0 type=write size=2416849 2024-08-27T02:37:55.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.623+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~XF1BLCU6F8T6.0 size=1048576 2024-08-27T02:37:55.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~XF1BLCU6F8T6.1 size=1048576 2024-08-27T02:37:55.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.631+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~XF1BLCU6F8T6.2 size=162310 2024-08-27T02:37:55.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.631+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=XF1BLCU6F8T6 tag=O23ANYJEH066 type=write size=3308038 2024-08-27T02:37:55.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.631+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~RSHWR5PUFD30.0 size=1048576 2024-08-27T02:37:55.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.635+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~RSHWR5PUFD30.1 size=1048576 2024-08-27T02:37:55.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.639+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~RSHWR5PUFD30.2 size=443560 2024-08-27T02:37:55.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.643+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=RSHWR5PUFD30 tag=NWMPY0EFACT0 type=write size=3589288 2024-08-27T02:37:55.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.647+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=FOKFACYOO9T9 type=del size=618896 2024-08-27T02:37:55.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.651+0000 7f3e0cc408c0 1 < suggested update operation key=A0RUXE4YL6NR tag=IX2M4TLFVDX7 type=del size=3976720 2024-08-27T02:37:55.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.655+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=1ACC6S9P4IW6 type=del size=349225 2024-08-27T02:37:55.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.659+0000 7f3e0cc408c0 1 < completed write operation key=QVG1NTF6O8L2 tag=NY0EDXTT7FZX type=write size=520030 2024-08-27T02:37:55.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.663+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=NLT7EO8QYEQP type=write size=609927 2024-08-27T02:37:55.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.667+0000 7f3e0cc408c0 1 < suggested remove operation key=IISECLYEAR19 tag=PTMXSH2GPCRG type=del 2024-08-27T02:37:55.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.671+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=5E7KYFXY3V0G type=del size=3161890 2024-08-27T02:37:55.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.679+0000 7f3e0cc408c0 1 < suggested remove operation key=VSDJU5KQLFKE tag=IBL84Y35WI6M type=del 2024-08-27T02:37:55.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.683+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~1WL8GAIYJY6Z.0 size=335128 2024-08-27T02:37:55.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.683+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=1WL8GAIYJY6Z tag=UY78ITKX1C6P type=write size=1383704 2024-08-27T02:37:55.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~98UYXEPHY5CJ.0 size=1048576 2024-08-27T02:37:55.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.691+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~98UYXEPHY5CJ.1 size=1048576 2024-08-27T02:37:55.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.691+0000 7f3e0cc408c0 1 < canceled part key=_multipart_MNE5WNFBH9HG.2~98UYXEPHY5CJ.2 size=975866 2024-08-27T02:37:55.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.699+0000 7f3e0cc408c0 1 < canceled multipart upload key=MNE5WNFBH9HG upload=98UYXEPHY5CJ tag=19AW1XUVGNTE type=write size=4121594 2024-08-27T02:37:55.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.703+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=JJ5MZU3DZEDI type=del size=700916 2024-08-27T02:37:55.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.711+0000 7f3e0cc408c0 1 < suggested update operation key=8VSA6T2H8FDI tag=FFMI9MJTOW6I type=del size=2222132 2024-08-27T02:37:55.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.715+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=U3QI9AO31713 type=write size=719937 2024-08-27T02:37:55.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.719+0000 7f3e0cc408c0 1 < suggested remove operation key=XBURHQSU6IML tag=S7CD92KVF7MR type=del 2024-08-27T02:37:55.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.723+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=6OHH6GA3GJOC type=write size=989494 2024-08-27T02:37:55.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.727+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~1POXEEEOW6LW.0 size=398235 2024-08-27T02:37:55.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.731+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=1POXEEEOW6LW tag=ON6AMA14G708 type=write size=1446811 2024-08-27T02:37:55.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.735+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=RCV4AF3FLACV type=del size=1002748 2024-08-27T02:37:55.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.743+0000 7f3e0cc408c0 1 < suggested remove operation key=HTEOX3BV94K2 tag=JDW4TZJZZOYI type=del 2024-08-27T02:37:55.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.747+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=3LN2Z8R2C3CR type=del size=1148125 2024-08-27T02:37:55.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.751+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=FYUHNU4I5YN6 type=del 2024-08-27T02:37:55.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.755+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~UA6WBNJHM52G.0 size=1048576 2024-08-27T02:37:55.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~UA6WBNJHM52G.1 size=977875 2024-08-27T02:37:55.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.759+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=UA6WBNJHM52G tag=YIQELLFL8QP5 type=write size=3075027 2024-08-27T02:37:55.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.763+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~BD18P8FMPLH6.0 size=1048576 2024-08-27T02:37:55.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~BD18P8FMPLH6.1 size=445947 2024-08-27T02:37:55.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.771+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=BD18P8FMPLH6 tag=0XYBGPI3AFHK type=write size=2543099 2024-08-27T02:37:55.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.775+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ICBIXVYJWQI7.0 size=1048576 2024-08-27T02:37:55.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ICBIXVYJWQI7.1 size=442265 2024-08-27T02:37:55.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.779+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=ICBIXVYJWQI7 tag=OVGXAGD3D3VZ type=write size=2539417 2024-08-27T02:37:55.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.783+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=QEW109A0ZWM5 type=del 2024-08-27T02:37:55.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~Q1ZONO4FYZL9.0 size=1048576 2024-08-27T02:37:55.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~Q1ZONO4FYZL9.1 size=209319 2024-08-27T02:37:55.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.791+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=Q1ZONO4FYZL9 tag=PH5HK1FAM8PM type=write size=2306471 2024-08-27T02:37:55.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.799+0000 7f3e0cc408c0 1 < suggested remove operation key=A0RUXE4YL6NR tag=2PY9GHOAW5EJ type=del 2024-08-27T02:37:55.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~3QMBTSAPFII8.0 size=638492 2024-08-27T02:37:55.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.803+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=3QMBTSAPFII8 tag=NHDBX920R26A type=write size=1687068 2024-08-27T02:37:55.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.807+0000 7f3e0cc408c0 1 < canceled operation key=6QE1HU65GQZZ tag=GK1TGUYFXA8M type=del size=441740 2024-08-27T02:37:55.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.815+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~S6MER6RNUOS2.0 size=480364 2024-08-27T02:37:55.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.815+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=S6MER6RNUOS2 tag=STGL79XY66TW type=write size=1528940 2024-08-27T02:37:55.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~XF1BLCU6F8T6.0 size=1048576 2024-08-27T02:37:55.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~XF1BLCU6F8T6.1 size=1048576 2024-08-27T02:37:55.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.823+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~XF1BLCU6F8T6.2 size=162310 2024-08-27T02:37:55.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.827+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=XF1BLCU6F8T6 tag=O23ANYJEH066 type=write size=3308038 2024-08-27T02:37:55.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.831+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=HXR2ZFQMRG7T type=write size=663498 2024-08-27T02:37:55.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.835+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=FOKFACYOO9T9 type=del 2024-08-27T02:37:55.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.843+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~1PA347YJYD2G.0 size=1048576 2024-08-27T02:37:55.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.843+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~1PA347YJYD2G.1 size=1048576 2024-08-27T02:37:55.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.847+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~1PA347YJYD2G.2 size=430389 2024-08-27T02:37:55.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.847+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=1PA347YJYD2G tag=Y2YAWA3WFVT1 type=write size=3576117 2024-08-27T02:37:55.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.851+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=1ACC6S9P4IW6 type=del 2024-08-27T02:37:55.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.855+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=0VERN6NKBMVX type=del size=3068741 2024-08-27T02:37:55.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.859+0000 7f3e0cc408c0 1 < completed write operation key=JDV1RIGAO7J1 tag=NLT7EO8QYEQP type=write size=609927 2024-08-27T02:37:55.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.863+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=5O6Z09VN2VNC type=write size=881831 2024-08-27T02:37:55.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.867+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=5E7KYFXY3V0G type=del 2024-08-27T02:37:55.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.871+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~QI33UJS8CHET.0 size=1048576 2024-08-27T02:37:55.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~QI33UJS8CHET.1 size=724737 2024-08-27T02:37:55.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.875+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=QI33UJS8CHET tag=GDA538V3QHQB type=write size=2821889 2024-08-27T02:37:55.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~1WL8GAIYJY6Z.0 size=335128 2024-08-27T02:37:55.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.883+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=1WL8GAIYJY6Z tag=UY78ITKX1C6P type=write size=1383704 2024-08-27T02:37:55.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.887+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=MZLWGTNJZ9W9 type=del size=983402 2024-08-27T02:37:55.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.891+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=JJ5MZU3DZEDI type=del 2024-08-27T02:37:55.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.895+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=BXJ2SQKSO3BI type=write size=485637 2024-08-27T02:37:55.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.903+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=U3QI9AO31713 type=write size=719937 2024-08-27T02:37:55.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.903+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=H2DTRJYO5RGQ type=del size=1997392 2024-08-27T02:37:55.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.911+0000 7f3e0cc408c0 1 < suggested update operation key=ZMN8Y0VQVHLB tag=6OHH6GA3GJOC type=write size=989494 2024-08-27T02:37:55.918 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.919+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~LGEQCWVRX4GD.0 size=1048576 2024-08-27T02:37:55.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.923+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~LGEQCWVRX4GD.1 size=1048576 2024-08-27T02:37:55.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.923+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~LGEQCWVRX4GD.2 size=698442 2024-08-27T02:37:55.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.923+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=LGEQCWVRX4GD tag=MCY1XAC14JX1 type=write size=3844170 2024-08-27T02:37:55.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.927+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=RCV4AF3FLACV type=del 2024-08-27T02:37:55.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.931+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=MQM45DLJJ62V type=write size=669349 2024-08-27T02:37:55.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.935+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=3LN2Z8R2C3CR type=del 2024-08-27T02:37:55.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.939+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=C8TZZG350TST type=write size=759695 2024-08-27T02:37:55.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.943+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~UA6WBNJHM52G.0 size=1048576 2024-08-27T02:37:55.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.947+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~UA6WBNJHM52G.1 size=977875 2024-08-27T02:37:55.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.951+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=UA6WBNJHM52G tag=YIQELLFL8QP5 type=write size=3075027 2024-08-27T02:37:55.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.955+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=297YJDC8KTFU type=del size=1734264 2024-08-27T02:37:55.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~ICBIXVYJWQI7.0 size=1048576 2024-08-27T02:37:55.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.963+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~ICBIXVYJWQI7.1 size=442265 2024-08-27T02:37:55.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.967+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=ICBIXVYJWQI7 tag=OVGXAGD3D3VZ type=write size=2539417 2024-08-27T02:37:55.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.971+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=NCGMDGEJ856K type=del size=1665467 2024-08-27T02:37:55.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.971+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~Q1ZONO4FYZL9.0 size=1048576 2024-08-27T02:37:55.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.975+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~Q1ZONO4FYZL9.1 size=209319 2024-08-27T02:37:55.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.979+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=Q1ZONO4FYZL9 tag=PH5HK1FAM8PM type=write size=2306471 2024-08-27T02:37:55.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.983+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=GAW7QNB9BU34 type=del size=561074 2024-08-27T02:37:55.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.987+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~3QMBTSAPFII8.0 size=638492 2024-08-27T02:37:55.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.991+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=3QMBTSAPFII8 tag=NHDBX920R26A type=write size=1687068 2024-08-27T02:37:55.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.995+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~3KR13J3M2UXK.0 size=893633 2024-08-27T02:37:55.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.995+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=3KR13J3M2UXK tag=QVBFTL6H19IH type=write size=1942209 2024-08-27T02:37:55.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:55.999+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~S6MER6RNUOS2.0 size=480364 2024-08-27T02:37:56.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.003+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=S6MER6RNUOS2 tag=STGL79XY66TW type=write size=1528940 2024-08-27T02:37:56.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~8YJQ6BGMSN6N.0 size=1048576 2024-08-27T02:37:56.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~8YJQ6BGMSN6N.1 size=1048576 2024-08-27T02:37:56.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.015+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~8YJQ6BGMSN6N.2 size=126059 2024-08-27T02:37:56.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.015+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=8YJQ6BGMSN6N tag=LI8E4G0SPRB7 type=write size=3271787 2024-08-27T02:37:56.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.015+0000 7f3e0cc408c0 1 < completed write operation key=O66XJ7GJMPCU tag=HXR2ZFQMRG7T type=write size=663498 2024-08-27T02:37:56.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.023+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~OOSDVTOV1IJX.0 size=1048576 2024-08-27T02:37:56.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~OOSDVTOV1IJX.1 size=1048576 2024-08-27T02:37:56.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~OOSDVTOV1IJX.2 size=294288 2024-08-27T02:37:56.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.027+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=OOSDVTOV1IJX tag=T4D4D22WH1ZV type=write size=3440016 2024-08-27T02:37:56.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~1PA347YJYD2G.0 size=1048576 2024-08-27T02:37:56.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~1PA347YJYD2G.1 size=1048576 2024-08-27T02:37:56.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~1PA347YJYD2G.2 size=430389 2024-08-27T02:37:56.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.043+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=1PA347YJYD2G tag=Y2YAWA3WFVT1 type=write size=3576117 2024-08-27T02:37:56.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.043+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=2DNGNYIRHBKS type=del size=709414 2024-08-27T02:37:56.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.051+0000 7f3e0cc408c0 1 < suggested update operation key=6QE1HU65GQZZ tag=0VERN6NKBMVX type=del size=3068741 2024-08-27T02:37:56.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.055+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=BJ08STT5RNGZ type=write size=416953 2024-08-27T02:37:56.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.059+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=5O6Z09VN2VNC type=write size=881831 2024-08-27T02:37:56.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.059+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=HDR28N3MKL9D type=write size=173971 2024-08-27T02:37:56.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~QI33UJS8CHET.0 size=1048576 2024-08-27T02:37:56.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~QI33UJS8CHET.1 size=724737 2024-08-27T02:37:56.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.071+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=QI33UJS8CHET tag=GDA538V3QHQB type=write size=2821889 2024-08-27T02:37:56.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.071+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=QEGJLCMCXE8T type=del size=1980530 2024-08-27T02:37:56.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.075+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=MZLWGTNJZ9W9 type=del 2024-08-27T02:37:56.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.079+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=AVMFFVNIC6L7 type=write size=408607 2024-08-27T02:37:56.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.083+0000 7f3e0cc408c0 1 < suggested update operation key=HTEOX3BV94K2 tag=BXJ2SQKSO3BI type=write size=485637 2024-08-27T02:37:56.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.087+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=JETNXTXKSDQV type=del size=907217 2024-08-27T02:37:56.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.095+0000 7f3e0cc408c0 1 < suggested remove operation key=A0RUXE4YL6NR tag=H2DTRJYO5RGQ type=del 2024-08-27T02:37:56.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.099+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=NLVAUFQIXWIU type=del size=2352034 2024-08-27T02:37:56.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.103+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~LGEQCWVRX4GD.0 size=1048576 2024-08-27T02:37:56.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~LGEQCWVRX4GD.1 size=1048576 2024-08-27T02:37:56.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~LGEQCWVRX4GD.2 size=698442 2024-08-27T02:37:56.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.111+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=LGEQCWVRX4GD tag=MCY1XAC14JX1 type=write size=3844170 2024-08-27T02:37:56.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.115+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=NM1N1WJ0K259 type=del size=1727954 2024-08-27T02:37:56.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.119+0000 7f3e0cc408c0 1 < completed write operation key=13M7JVZT12I2 tag=MQM45DLJJ62V type=write size=669349 2024-08-27T02:37:56.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.123+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=Y9ISDHVMAPDS type=write size=811954 2024-08-27T02:37:56.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.127+0000 7f3e0cc408c0 1 < suggested remove operation key=13M7JVZT12I2 tag=C8TZZG350TST type=write 2024-08-27T02:37:56.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~PH1CLYZS7A0T.0 size=1048576 2024-08-27T02:37:56.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~PH1CLYZS7A0T.1 size=200815 2024-08-27T02:37:56.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.135+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=PH1CLYZS7A0T tag=M2LJ3ZPEQPID type=write size=2297967 2024-08-27T02:37:56.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.139+0000 7f3e0cc408c0 1 < suggested remove operation key=4SSZQK6YIL1O tag=297YJDC8KTFU type=del 2024-08-27T02:37:56.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~S206GYD8IR8X.0 size=970014 2024-08-27T02:37:56.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.147+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=S206GYD8IR8X tag=90WXH4G4JD3R type=write size=2018590 2024-08-27T02:37:56.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.151+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=NCGMDGEJ856K type=del 2024-08-27T02:37:56.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~U6ETU5KUJAJY.0 size=1048576 2024-08-27T02:37:56.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~U6ETU5KUJAJY.1 size=1048576 2024-08-27T02:37:56.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~U6ETU5KUJAJY.2 size=809870 2024-08-27T02:37:56.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.159+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=U6ETU5KUJAJY tag=ZGHEW213FQTW type=write size=3955598 2024-08-27T02:37:56.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.163+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=GAW7QNB9BU34 type=del 2024-08-27T02:37:56.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.167+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=RVS2V5VUQFPA type=del size=2530327 2024-08-27T02:37:56.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.171+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~3KR13J3M2UXK.0 size=893633 2024-08-27T02:37:56.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.175+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=3KR13J3M2UXK tag=QVBFTL6H19IH type=write size=1942209 2024-08-27T02:37:56.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.179+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=OTV4SXQK5VIC type=write size=989555 2024-08-27T02:37:56.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.183+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~8YJQ6BGMSN6N.0 size=1048576 2024-08-27T02:37:56.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.183+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~8YJQ6BGMSN6N.1 size=1048576 2024-08-27T02:37:56.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.187+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~8YJQ6BGMSN6N.2 size=126059 2024-08-27T02:37:56.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.191+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=8YJQ6BGMSN6N tag=LI8E4G0SPRB7 type=write size=3271787 2024-08-27T02:37:56.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~76OQNVJLQGVB.0 size=1048576 2024-08-27T02:37:56.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~76OQNVJLQGVB.1 size=859167 2024-08-27T02:37:56.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.199+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=76OQNVJLQGVB tag=5WCDDSIB0SI5 type=write size=2956319 2024-08-27T02:37:56.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.203+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~OOSDVTOV1IJX.0 size=1048576 2024-08-27T02:37:56.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.207+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~OOSDVTOV1IJX.1 size=1048576 2024-08-27T02:37:56.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.207+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~OOSDVTOV1IJX.2 size=294288 2024-08-27T02:37:56.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.215+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=OOSDVTOV1IJX tag=T4D4D22WH1ZV type=write size=3440016 2024-08-27T02:37:56.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~T017UWU3KN3P.0 size=1048576 2024-08-27T02:37:56.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.223+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~T017UWU3KN3P.1 size=1048576 2024-08-27T02:37:56.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.227+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~T017UWU3KN3P.2 size=498167 2024-08-27T02:37:56.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.227+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=T017UWU3KN3P tag=3R7TQQ5ML0QP type=write size=3643895 2024-08-27T02:37:56.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.231+0000 7f3e0cc408c0 -1 < failed to complete operation key=13M7JVZT12I2 tag=2DNGNYIRHBKS type=del size=709414: (22) Invalid argument 2024-08-27T02:37:56.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.235+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=YRENI3LACJSJ type=del size=738941 2024-08-27T02:37:56.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.239+0000 7f3e0cc408c0 1 < suggested remove operation key=D7YWS7BWXT37 tag=BJ08STT5RNGZ type=write 2024-08-27T02:37:56.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~PMDBOVI6C0RD.0 size=1048576 2024-08-27T02:37:56.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~PMDBOVI6C0RD.1 size=1048576 2024-08-27T02:37:56.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.251+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~PMDBOVI6C0RD.2 size=726168 2024-08-27T02:37:56.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.251+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=PMDBOVI6C0RD tag=KW8GB92XGK4E type=write size=3871896 2024-08-27T02:37:56.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.255+0000 7f3e0cc408c0 1 < completed write operation key=JLAGXRZVF50G tag=HDR28N3MKL9D type=write size=173971 2024-08-27T02:37:56.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.255+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=4P1T23E0K0D4 type=write size=612160 2024-08-27T02:37:56.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.263+0000 7f3e0cc408c0 1 < suggested update operation key=JDV1RIGAO7J1 tag=QEGJLCMCXE8T type=del size=1980530 2024-08-27T02:37:56.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.271+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~J1N9PRBWBWQO.0 size=1048576 2024-08-27T02:37:56.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.271+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~J1N9PRBWBWQO.1 size=1048576 2024-08-27T02:37:56.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.275+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~J1N9PRBWBWQO.2 size=414184 2024-08-27T02:37:56.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.275+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=J1N9PRBWBWQO tag=XHJIU6MKHQP3 type=write size=3559912 2024-08-27T02:37:56.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.275+0000 7f3e0cc408c0 1 < canceled operation key=6YTZJKE4V5HQ tag=AVMFFVNIC6L7 type=write size=408607 2024-08-27T02:37:56.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.279+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=JPOZQW17ND3P type=del size=3965244 2024-08-27T02:37:56.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.279+0000 7f3e0cc408c0 1 < canceled operation key=2CXWPDABA9XJ tag=JETNXTXKSDQV type=del size=907217 2024-08-27T02:37:56.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.283+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=CCUIX0M17X86 type=del size=2521299 2024-08-27T02:37:56.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.287+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=NLVAUFQIXWIU type=del 2024-08-27T02:37:56.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.291+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=GI8L18XUL9NO type=write size=611705 2024-08-27T02:37:56.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.295+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=NM1N1WJ0K259 type=del 2024-08-27T02:37:56.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.295+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=ZK0UZ12C2L7H type=write size=27502 2024-08-27T02:37:56.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.299+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=Y9ISDHVMAPDS type=write size=811954 2024-08-27T02:37:56.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.303+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~3SPY5TO30RRH.0 size=1048576 2024-08-27T02:37:56.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~3SPY5TO30RRH.1 size=388373 2024-08-27T02:37:56.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.307+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=3SPY5TO30RRH tag=DB8WWQRNG0PU type=write size=2485525 2024-08-27T02:37:56.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~PH1CLYZS7A0T.0 size=1048576 2024-08-27T02:37:56.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~PH1CLYZS7A0T.1 size=200815 2024-08-27T02:37:56.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.319+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=PH1CLYZS7A0T tag=M2LJ3ZPEQPID type=write size=2297967 2024-08-27T02:37:56.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~IBOTW4MA8145.0 size=1048576 2024-08-27T02:37:56.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~IBOTW4MA8145.1 size=1048576 2024-08-27T02:37:56.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~IBOTW4MA8145.2 size=511627 2024-08-27T02:37:56.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.327+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=IBOTW4MA8145 tag=73DBG6VXABJ0 type=write size=3657355 2024-08-27T02:37:56.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~S206GYD8IR8X.0 size=970014 2024-08-27T02:37:56.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.335+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=S206GYD8IR8X tag=90WXH4G4JD3R type=write size=2018590 2024-08-27T02:37:56.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.339+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=I0VIN08E3BN2 type=del size=1236126 2024-08-27T02:37:56.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~U6ETU5KUJAJY.0 size=1048576 2024-08-27T02:37:56.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~U6ETU5KUJAJY.1 size=1048576 2024-08-27T02:37:56.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.347+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~U6ETU5KUJAJY.2 size=809870 2024-08-27T02:37:56.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.351+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=U6ETU5KUJAJY tag=ZGHEW213FQTW type=write size=3955598 2024-08-27T02:37:56.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.355+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=O04C7MEY35LV type=del size=3497698 2024-08-27T02:37:56.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.359+0000 7f3e0cc408c0 1 < suggested remove operation key=0OLVDEQWBCAQ tag=RVS2V5VUQFPA type=del 2024-08-27T02:37:56.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.363+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~POT03HLOMZLO.0 size=1048576 2024-08-27T02:37:56.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~POT03HLOMZLO.1 size=1048576 2024-08-27T02:37:56.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.371+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~POT03HLOMZLO.2 size=666307 2024-08-27T02:37:56.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.371+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=POT03HLOMZLO tag=3M6Z9XK12EVK type=write size=3812035 2024-08-27T02:37:56.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.371+0000 7f3e0cc408c0 1 < completed write operation key=HTEOX3BV94K2 tag=OTV4SXQK5VIC type=write size=989555 2024-08-27T02:37:56.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.379+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~ATG45DF79GRB.0 size=1048576 2024-08-27T02:37:56.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.379+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~ATG45DF79GRB.1 size=1048576 2024-08-27T02:37:56.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~ATG45DF79GRB.2 size=165032 2024-08-27T02:37:56.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.383+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=ATG45DF79GRB tag=M3HOZ6EUB8PL type=write size=3310760 2024-08-27T02:37:56.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~76OQNVJLQGVB.0 size=1048576 2024-08-27T02:37:56.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~76OQNVJLQGVB.1 size=859167 2024-08-27T02:37:56.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.391+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=76OQNVJLQGVB tag=5WCDDSIB0SI5 type=write size=2956319 2024-08-27T02:37:56.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.395+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=6D00Y9OD2QXH type=del size=249185 2024-08-27T02:37:56.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.399+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~T017UWU3KN3P.0 size=1048576 2024-08-27T02:37:56.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.399+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~T017UWU3KN3P.1 size=1048576 2024-08-27T02:37:56.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.403+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~T017UWU3KN3P.2 size=498167 2024-08-27T02:37:56.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.407+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=T017UWU3KN3P tag=3R7TQQ5ML0QP type=write size=3643895 2024-08-27T02:37:56.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~U9RWM2W7M071.0 size=1048576 2024-08-27T02:37:56.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~U9RWM2W7M071.1 size=414499 2024-08-27T02:37:56.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.411+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=U9RWM2W7M071 tag=MM5Q0MQMTYPP type=write size=2511651 2024-08-27T02:37:56.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.415+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=YRENI3LACJSJ type=del 2024-08-27T02:37:56.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.415+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=WJSG4I414X1F type=write size=926503 2024-08-27T02:37:56.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.419+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~PMDBOVI6C0RD.0 size=1048576 2024-08-27T02:37:56.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.419+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HTEOX3BV94K2.2~PMDBOVI6C0RD.1 size=1048576 2024-08-27T02:37:56.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.419+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~PMDBOVI6C0RD.2 size=726168 2024-08-27T02:37:56.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.423+0000 7f3e0cc408c0 1 < canceled multipart upload key=HTEOX3BV94K2 upload=PMDBOVI6C0RD tag=KW8GB92XGK4E type=write size=3871896 2024-08-27T02:37:56.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.427+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=71SIO620C35H type=del size=557367 2024-08-27T02:37:56.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.431+0000 7f3e0cc408c0 1 < canceled operation key=SG9T1RD5EATR tag=4P1T23E0K0D4 type=write size=612160 2024-08-27T02:37:56.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.435+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~ZLG7CG4H746Q.0 size=1048576 2024-08-27T02:37:56.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~ZLG7CG4H746Q.1 size=298307 2024-08-27T02:37:56.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.439+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=ZLG7CG4H746Q tag=J9BQYKXJXEMJ type=write size=2395459 2024-08-27T02:37:56.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.439+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~J1N9PRBWBWQO.0 size=1048576 2024-08-27T02:37:56.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.439+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~J1N9PRBWBWQO.1 size=1048576 2024-08-27T02:37:56.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.439+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~J1N9PRBWBWQO.2 size=414184 2024-08-27T02:37:56.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.443+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=J1N9PRBWBWQO tag=XHJIU6MKHQP3 type=write size=3559912 2024-08-27T02:37:56.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~99JN11X18NIK.0 size=181117 2024-08-27T02:37:56.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.451+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=99JN11X18NIK tag=5TAM8RTPLX4V type=write size=1229693 2024-08-27T02:37:56.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.451+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=JPOZQW17ND3P type=del 2024-08-27T02:37:56.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.455+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=R3G1675G75L1 type=del size=252502 2024-08-27T02:37:56.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.459+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=CCUIX0M17X86 type=del 2024-08-27T02:37:56.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.463+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=HGTDSF7N03RB type=del size=3211156 2024-08-27T02:37:56.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.467+0000 7f3e0cc408c0 1 < suggested remove operation key=MKB40KOOCCNT tag=GI8L18XUL9NO type=write 2024-08-27T02:37:56.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.471+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~W1PXIMTLK6DE.0 size=1048576 2024-08-27T02:37:56.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.475+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~W1PXIMTLK6DE.1 size=370712 2024-08-27T02:37:56.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.475+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=W1PXIMTLK6DE tag=PYVBC5LX1O49 type=write size=2467864 2024-08-27T02:37:56.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.479+0000 7f3e0cc408c0 1 < completed write operation key=ZMN8Y0VQVHLB tag=ZK0UZ12C2L7H type=write size=27502 2024-08-27T02:37:56.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.479+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=7WTZ3MGQU48P type=del size=1262951 2024-08-27T02:37:56.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.483+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~3SPY5TO30RRH.0 size=1048576 2024-08-27T02:37:56.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.483+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~3SPY5TO30RRH.1 size=388373 2024-08-27T02:37:56.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.491+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=3SPY5TO30RRH tag=DB8WWQRNG0PU type=write size=2485525 2024-08-27T02:37:56.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.495+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=TD3WDV30SNGK type=del size=2451348 2024-08-27T02:37:56.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.495+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~IBOTW4MA8145.0 size=1048576 2024-08-27T02:37:56.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~IBOTW4MA8145.1 size=1048576 2024-08-27T02:37:56.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~IBOTW4MA8145.2 size=511627 2024-08-27T02:37:56.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.507+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=IBOTW4MA8145 tag=73DBG6VXABJ0 type=write size=3657355 2024-08-27T02:37:56.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.507+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=FJO0BOP1SO0N type=del size=1484922 2024-08-27T02:37:56.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.511+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=I0VIN08E3BN2 type=del 2024-08-27T02:37:56.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.515+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=4YBWATUMOFMG type=del size=1241265 2024-08-27T02:37:56.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.523+0000 7f3e0cc408c0 1 < suggested update operation key=IISECLYEAR19 tag=O04C7MEY35LV type=del size=3497698 2024-08-27T02:37:56.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.523+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=27LLNOG8AVE3 type=del size=1476930 2024-08-27T02:37:56.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.527+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~POT03HLOMZLO.0 size=1048576 2024-08-27T02:37:56.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.531+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~POT03HLOMZLO.1 size=1048576 2024-08-27T02:37:56.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.535+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~POT03HLOMZLO.2 size=666307 2024-08-27T02:37:56.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.539+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=POT03HLOMZLO tag=3M6Z9XK12EVK type=write size=3812035 2024-08-27T02:37:56.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.543+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=DLX498DV00P9 type=del size=3305757 2024-08-27T02:37:56.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.543+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~ATG45DF79GRB.0 size=1048576 2024-08-27T02:37:56.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~ATG45DF79GRB.1 size=1048576 2024-08-27T02:37:56.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.551+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~ATG45DF79GRB.2 size=165032 2024-08-27T02:37:56.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.555+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=ATG45DF79GRB tag=M3HOZ6EUB8PL type=write size=3310760 2024-08-27T02:37:56.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.559+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=HIOMXNU25IZX type=del size=2926110 2024-08-27T02:37:56.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.563+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=6D00Y9OD2QXH type=del 2024-08-27T02:37:56.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.571+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~UXPP3G8GKUCU.0 size=1048576 2024-08-27T02:37:56.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.571+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~UXPP3G8GKUCU.1 size=1048576 2024-08-27T02:37:56.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.575+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~UXPP3G8GKUCU.2 size=175833 2024-08-27T02:37:56.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.575+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=UXPP3G8GKUCU tag=TM475GORULI0 type=write size=3321561 2024-08-27T02:37:56.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~U9RWM2W7M071.0 size=1048576 2024-08-27T02:37:56.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~U9RWM2W7M071.1 size=414499 2024-08-27T02:37:56.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.583+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=U9RWM2W7M071 tag=MM5Q0MQMTYPP type=write size=2511651 2024-08-27T02:37:56.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.591+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~H0GAF2TRM1UQ.0 size=1048576 2024-08-27T02:37:56.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.591+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~H0GAF2TRM1UQ.1 size=1048576 2024-08-27T02:37:56.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.595+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~H0GAF2TRM1UQ.2 size=106772 2024-08-27T02:37:56.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.595+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=H0GAF2TRM1UQ tag=JFEEEISJBRLE type=write size=3252500 2024-08-27T02:37:56.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.595+0000 7f3e0cc408c0 1 < completed write operation key=SG9T1RD5EATR tag=WJSG4I414X1F type=write size=926503 2024-08-27T02:37:56.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.599+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=636FV3UW8IBD type=del size=754843 2024-08-27T02:37:56.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.603+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=71SIO620C35H type=del 2024-08-27T02:37:56.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.603+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=98B4PTV24S3W type=del size=438563 2024-08-27T02:37:56.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~ZLG7CG4H746Q.0 size=1048576 2024-08-27T02:37:56.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~ZLG7CG4H746Q.1 size=298307 2024-08-27T02:37:56.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.615+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=ZLG7CG4H746Q tag=J9BQYKXJXEMJ type=write size=2395459 2024-08-27T02:37:56.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.615+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=D01W4CYZYZG8 type=del size=3738582 2024-08-27T02:37:56.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~99JN11X18NIK.0 size=181117 2024-08-27T02:37:56.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.623+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=99JN11X18NIK tag=5TAM8RTPLX4V type=write size=1229693 2024-08-27T02:37:56.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~M4IN2KNKWBZS.0 size=1048576 2024-08-27T02:37:56.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.631+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~M4IN2KNKWBZS.1 size=1048576 2024-08-27T02:37:56.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.631+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~M4IN2KNKWBZS.2 size=221938 2024-08-27T02:37:56.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.631+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=M4IN2KNKWBZS tag=KVQPZQKC1HWP type=write size=3367666 2024-08-27T02:37:56.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.639+0000 7f3e0cc408c0 1 < suggested remove operation key=OY551242R8T6 tag=R3G1675G75L1 type=del 2024-08-27T02:37:56.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.639+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=M65K0BEL5W3L type=del size=4010244 2024-08-27T02:37:56.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.643+0000 7f3e0cc408c0 -1 < failed to complete operation key=OY551242R8T6 tag=HGTDSF7N03RB type=del size=3211156: (22) Invalid argument 2024-08-27T02:37:56.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.647+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=AH0YL710EG58 type=del size=3539273 2024-08-27T02:37:56.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.647+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~W1PXIMTLK6DE.0 size=1048576 2024-08-27T02:37:56.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.647+0000 7f3e0cc408c0 1 < canceled part key=_multipart_UGSWC9ZK9S7S.2~W1PXIMTLK6DE.1 size=370712 2024-08-27T02:37:56.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.655+0000 7f3e0cc408c0 1 < canceled multipart upload key=UGSWC9ZK9S7S upload=W1PXIMTLK6DE tag=PYVBC5LX1O49 type=write size=2467864 2024-08-27T02:37:56.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.655+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=JF2C76U9324D type=del size=3801931 2024-08-27T02:37:56.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.659+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=7WTZ3MGQU48P type=del 2024-08-27T02:37:56.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.663+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~TL53HBNMJEHU.0 size=1048576 2024-08-27T02:37:56.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~TL53HBNMJEHU.1 size=1048576 2024-08-27T02:37:56.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~TL53HBNMJEHU.2 size=858432 2024-08-27T02:37:56.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.667+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=TL53HBNMJEHU tag=SOVQ1OXVZUFJ type=write size=4004160 2024-08-27T02:37:56.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.671+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=TD3WDV30SNGK type=del 2024-08-27T02:37:56.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.675+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=3JUT5D2QQSVQ type=write size=230935 2024-08-27T02:37:56.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.679+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=FJO0BOP1SO0N type=del 2024-08-27T02:37:56.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.683+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~9FWIC1NHFFDC.0 size=87873 2024-08-27T02:37:56.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.683+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=9FWIC1NHFFDC tag=WPOZJ22HB7T9 type=write size=1136449 2024-08-27T02:37:56.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.687+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=4YBWATUMOFMG type=del 2024-08-27T02:37:56.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.687+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=K415ZV252F83 type=del size=3309694 2024-08-27T02:37:56.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.691+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=27LLNOG8AVE3 type=del 2024-08-27T02:37:56.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.695+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=VPE762V5T4PK type=del size=928164 2024-08-27T02:37:56.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.699+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=DLX498DV00P9 type=del 2024-08-27T02:37:56.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.699+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=KZ47VU21WXAR type=del size=1769767 2024-08-27T02:37:56.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.703+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=HIOMXNU25IZX type=del 2024-08-27T02:37:56.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.707+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=4QRFCOZ3VC63 type=del size=3770261 2024-08-27T02:37:56.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~UXPP3G8GKUCU.0 size=1048576 2024-08-27T02:37:56.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~UXPP3G8GKUCU.1 size=1048576 2024-08-27T02:37:56.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.715+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~UXPP3G8GKUCU.2 size=175833 2024-08-27T02:37:56.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.719+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=UXPP3G8GKUCU tag=TM475GORULI0 type=write size=3321561 2024-08-27T02:37:56.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.723+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=XRA0PISUGKA5 type=del size=1109261 2024-08-27T02:37:56.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.727+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~H0GAF2TRM1UQ.0 size=1048576 2024-08-27T02:37:56.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.727+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~H0GAF2TRM1UQ.1 size=1048576 2024-08-27T02:37:56.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.731+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~H0GAF2TRM1UQ.2 size=106772 2024-08-27T02:37:56.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.735+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=H0GAF2TRM1UQ tag=JFEEEISJBRLE type=write size=3252500 2024-08-27T02:37:56.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.743+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~11WY8DSEWR9Q.0 size=197727 2024-08-27T02:37:56.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.743+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=11WY8DSEWR9Q tag=LB7C71IJ42U0 type=write size=1246303 2024-08-27T02:37:56.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.743+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=636FV3UW8IBD type=del 2024-08-27T02:37:56.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.751+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~LPYPBHJQK620.0 size=1048576 2024-08-27T02:37:56.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.751+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~LPYPBHJQK620.1 size=132325 2024-08-27T02:37:56.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.751+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=LPYPBHJQK620 tag=4T9ULFUUPCKF type=write size=2229477 2024-08-27T02:37:56.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.759+0000 7f3e0cc408c0 1 < suggested remove operation key=XBURHQSU6IML tag=98B4PTV24S3W type=del 2024-08-27T02:37:56.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~IZZ7C0CPWS2W.0 size=922084 2024-08-27T02:37:56.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.767+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=IZZ7C0CPWS2W tag=S5FMEMI42TBS type=write size=1970660 2024-08-27T02:37:56.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.771+0000 7f3e0cc408c0 1 < suggested remove operation key=6QE1HU65GQZZ tag=D01W4CYZYZG8 type=del 2024-08-27T02:37:56.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.775+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=J60JL8KEN1RL type=del size=3471588 2024-08-27T02:37:56.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.779+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~M4IN2KNKWBZS.0 size=1048576 2024-08-27T02:37:56.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.779+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~M4IN2KNKWBZS.1 size=1048576 2024-08-27T02:37:56.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.783+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~M4IN2KNKWBZS.2 size=221938 2024-08-27T02:37:56.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.787+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=M4IN2KNKWBZS tag=KVQPZQKC1HWP type=write size=3367666 2024-08-27T02:37:56.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.795+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~WRDEOAMZDQR3.0 size=72906 2024-08-27T02:37:56.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.795+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=WRDEOAMZDQR3 tag=659TRO3E7UM8 type=write size=1121482 2024-08-27T02:37:56.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.799+0000 7f3e0cc408c0 1 < suggested update operation key=6YTZJKE4V5HQ tag=M65K0BEL5W3L type=del size=4010244 2024-08-27T02:37:56.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.803+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=DROQNSU9FU5X type=write size=90678 2024-08-27T02:37:56.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.803+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=AH0YL710EG58 type=del 2024-08-27T02:37:56.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~WR9JBITWLP4L.0 size=1048576 2024-08-27T02:37:56.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~WR9JBITWLP4L.1 size=721058 2024-08-27T02:37:56.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.811+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=WR9JBITWLP4L tag=OUYGUZ95TJ1N type=write size=2818210 2024-08-27T02:37:56.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.815+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=JF2C76U9324D type=del 2024-08-27T02:37:56.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~RZN5I9T0P3RN.0 size=1048576 2024-08-27T02:37:56.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~RZN5I9T0P3RN.1 size=57049 2024-08-27T02:37:56.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.823+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=RZN5I9T0P3RN tag=0UQIVV8B466S type=write size=2154201 2024-08-27T02:37:56.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.827+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~TL53HBNMJEHU.0 size=1048576 2024-08-27T02:37:56.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.831+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~TL53HBNMJEHU.1 size=1048576 2024-08-27T02:37:56.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.831+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~TL53HBNMJEHU.2 size=858432 2024-08-27T02:37:56.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.839+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=TL53HBNMJEHU tag=SOVQ1OXVZUFJ type=write size=4004160 2024-08-27T02:37:56.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.843+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~4XPA5O2ZTR5R.0 size=402894 2024-08-27T02:37:56.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.843+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=4XPA5O2ZTR5R tag=AO173NX0E0YN type=write size=1451470 2024-08-27T02:37:56.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.847+0000 7f3e0cc408c0 1 < completed write operation key=OY551242R8T6 tag=3JUT5D2QQSVQ type=write size=230935 2024-08-27T02:37:56.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~J1T8MLWUFKXR.0 size=1048576 2024-08-27T02:37:56.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.855+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~J1T8MLWUFKXR.1 size=1048576 2024-08-27T02:37:56.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.855+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~J1T8MLWUFKXR.2 size=807704 2024-08-27T02:37:56.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.855+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=J1T8MLWUFKXR tag=0YDJNKLA9IK6 type=write size=3953432 2024-08-27T02:37:56.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.859+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~9FWIC1NHFFDC.0 size=87873 2024-08-27T02:37:56.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.863+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=9FWIC1NHFFDC tag=WPOZJ22HB7T9 type=write size=1136449 2024-08-27T02:37:56.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.867+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=C7MNYW34MU40 type=write size=715688 2024-08-27T02:37:56.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.871+0000 7f3e0cc408c0 1 < suggested remove operation key=UGSWC9ZK9S7S tag=K415ZV252F83 type=del 2024-08-27T02:37:56.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.875+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=2NSHCFMA7M7M type=write size=353965 2024-08-27T02:37:56.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.879+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=VPE762V5T4PK type=del 2024-08-27T02:37:56.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.883+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=PAJ64LSFXVFS type=del size=3155451 2024-08-27T02:37:56.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.883+0000 7f3e0cc408c0 -1 < failed to complete operation key=XBURHQSU6IML tag=KZ47VU21WXAR type=del size=1769767: (22) Invalid argument 2024-08-27T02:37:56.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.887+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=0MEYHBHQN0UP type=del size=1589187 2024-08-27T02:37:56.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.891+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=4QRFCOZ3VC63 type=del 2024-08-27T02:37:56.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.895+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=6RL79NEL3OYM type=del size=409962 2024-08-27T02:37:56.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.895+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=XRA0PISUGKA5 type=del 2024-08-27T02:37:56.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.899+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=OA2G7AEBGTK4 type=del size=2313944 2024-08-27T02:37:56.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.899+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~11WY8DSEWR9Q.0 size=197727 2024-08-27T02:37:56.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.903+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=11WY8DSEWR9Q tag=LB7C71IJ42U0 type=write size=1246303 2024-08-27T02:37:56.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.907+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=V1DBK1RPK2VQ type=write size=155932 2024-08-27T02:37:56.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.911+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~LPYPBHJQK620.0 size=1048576 2024-08-27T02:37:56.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.911+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~LPYPBHJQK620.1 size=132325 2024-08-27T02:37:56.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.919+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=LPYPBHJQK620 tag=4T9ULFUUPCKF type=write size=2229477 2024-08-27T02:37:56.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.919+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=MN3HFB9RE7NU type=del size=2377853 2024-08-27T02:37:56.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.923+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~IZZ7C0CPWS2W.0 size=922084 2024-08-27T02:37:56.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.931+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=IZZ7C0CPWS2W tag=S5FMEMI42TBS type=write size=1970660 2024-08-27T02:37:56.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.935+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=KF598W82L9OW type=del size=91261 2024-08-27T02:37:56.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.939+0000 7f3e0cc408c0 -1 < failed to complete operation key=UGSWC9ZK9S7S tag=J60JL8KEN1RL type=del size=3471588: (22) Invalid argument 2024-08-27T02:37:56.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.943+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=GBKS1BUK3BUJ type=del size=588103 2024-08-27T02:37:56.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.943+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~WRDEOAMZDQR3.0 size=72906 2024-08-27T02:37:56.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.951+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=WRDEOAMZDQR3 tag=659TRO3E7UM8 type=write size=1121482 2024-08-27T02:37:56.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.951+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=8RO81TOBJWPH type=del size=4081348 2024-08-27T02:37:56.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.955+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=DROQNSU9FU5X type=write size=90678 2024-08-27T02:37:56.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.959+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=BPYZBHE0VP7K type=del size=1826551 2024-08-27T02:37:56.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.963+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~WR9JBITWLP4L.0 size=1048576 2024-08-27T02:37:56.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.967+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~WR9JBITWLP4L.1 size=721058 2024-08-27T02:37:56.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.971+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=WR9JBITWLP4L tag=OUYGUZ95TJ1N type=write size=2818210 2024-08-27T02:37:56.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.975+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=IAJBAWJRLS1R type=del size=3424006 2024-08-27T02:37:56.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.979+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~RZN5I9T0P3RN.0 size=1048576 2024-08-27T02:37:56.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.979+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~RZN5I9T0P3RN.1 size=57049 2024-08-27T02:37:56.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.987+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=RZN5I9T0P3RN tag=0UQIVV8B466S type=write size=2154201 2024-08-27T02:37:56.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.991+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=RMNF8FT9M92V type=del size=3333122 2024-08-27T02:37:56.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.991+0000 7f3e0cc408c0 1 < canceled part key=_multipart_A0RUXE4YL6NR.2~4XPA5O2ZTR5R.0 size=402894 2024-08-27T02:37:56.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.999+0000 7f3e0cc408c0 1 < canceled multipart upload key=A0RUXE4YL6NR upload=4XPA5O2ZTR5R tag=AO173NX0E0YN type=write size=1451470 2024-08-27T02:37:57.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:56.999+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=GMZRHF864A5A type=write size=1032571 2024-08-27T02:37:57.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.003+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~J1T8MLWUFKXR.0 size=1048576 2024-08-27T02:37:57.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.007+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~J1T8MLWUFKXR.1 size=1048576 2024-08-27T02:37:57.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.011+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~J1T8MLWUFKXR.2 size=807704 2024-08-27T02:37:57.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.015+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=J1T8MLWUFKXR tag=0YDJNKLA9IK6 type=write size=3953432 2024-08-27T02:37:57.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.023+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~8DUJ0XW7AUMQ.0 size=971803 2024-08-27T02:37:57.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.023+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=8DUJ0XW7AUMQ tag=N9907NW4DFGF type=write size=2020379 2024-08-27T02:37:57.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.027+0000 7f3e0cc408c0 1 < canceled operation key=JDV1RIGAO7J1 tag=C7MNYW34MU40 type=write size=715688 2024-08-27T02:37:57.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.031+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~TZ4DG7HDX3B9.0 size=454394 2024-08-27T02:37:57.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.031+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=TZ4DG7HDX3B9 tag=LEBMZY443MH5 type=write size=1502970 2024-08-27T02:37:57.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.035+0000 7f3e0cc408c0 1 < completed write operation key=1ZIJ9JJTM4ZC tag=2NSHCFMA7M7M type=write size=353965 2024-08-27T02:37:57.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.039+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=UIW2XN0UNHY0 type=del size=1718283 2024-08-27T02:37:57.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.043+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=PAJ64LSFXVFS type=del 2024-08-27T02:37:57.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.047+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~T6GKF8CDNA2B.0 size=1048576 2024-08-27T02:37:57.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~T6GKF8CDNA2B.1 size=364864 2024-08-27T02:37:57.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.051+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=T6GKF8CDNA2B tag=4CTB7S5YJQG6 type=write size=2462016 2024-08-27T02:37:57.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.059+0000 7f3e0cc408c0 1 < suggested remove operation key=S5ANS33DXN7X tag=0MEYHBHQN0UP type=del 2024-08-27T02:37:57.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.067+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~QJT5PGZMNVA4.0 size=647606 2024-08-27T02:37:57.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.067+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=QJT5PGZMNVA4 tag=WJC4QM93OEZI type=write size=1696182 2024-08-27T02:37:57.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.071+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=6RL79NEL3OYM type=del 2024-08-27T02:37:57.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.079+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~CCODPLOMAXET.0 size=208362 2024-08-27T02:37:57.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.079+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=CCODPLOMAXET tag=0GT6UI1YF4A7 type=write size=1256938 2024-08-27T02:37:57.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.079+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=OA2G7AEBGTK4 type=del 2024-08-27T02:37:57.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.083+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=AVKWP3SOG9BR type=del size=1779403 2024-08-27T02:37:57.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.087+0000 7f3e0cc408c0 1 < completed write operation key=ZMN8Y0VQVHLB tag=V1DBK1RPK2VQ type=write size=155932 2024-08-27T02:37:57.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.091+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=GS14BT2LLXI5 type=del size=1125932 2024-08-27T02:37:57.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.095+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=MN3HFB9RE7NU type=del 2024-08-27T02:37:57.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.099+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=GORYR6TD3LEB type=write size=217779 2024-08-27T02:37:57.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.103+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=KF598W82L9OW type=del 2024-08-27T02:37:57.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.107+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=A3USQCLBHE95 type=del size=1789837 2024-08-27T02:37:57.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.107+0000 7f3e0cc408c0 1 < canceled operation key=D7YWS7BWXT37 tag=GBKS1BUK3BUJ type=del size=588103 2024-08-27T02:37:57.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.111+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=PB1U87MRZ7CG type=del size=13836 2024-08-27T02:37:57.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.115+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=8RO81TOBJWPH type=del 2024-08-27T02:37:57.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.123+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~1Y62MPM0C5RC.0 size=991548 2024-08-27T02:37:57.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.123+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=1Y62MPM0C5RC tag=32E4X5PDTPA0 type=write size=2040124 2024-08-27T02:37:57.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.127+0000 7f3e0cc408c0 1 < canceled operation key=QVG1NTF6O8L2 tag=BPYZBHE0VP7K type=del size=1826551 2024-08-27T02:37:57.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~NSFKCE6JTOPO.0 size=248001 2024-08-27T02:37:57.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.135+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=NSFKCE6JTOPO tag=ZSJF0UFN2R4F type=write size=1296577 2024-08-27T02:37:57.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.139+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=IAJBAWJRLS1R type=del 2024-08-27T02:37:57.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~1DGVWGX7B49R.0 size=1048576 2024-08-27T02:37:57.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~1DGVWGX7B49R.1 size=1048576 2024-08-27T02:37:57.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.151+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~1DGVWGX7B49R.2 size=763001 2024-08-27T02:37:57.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.151+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=1DGVWGX7B49R tag=O3N0QHXIJNRR type=write size=3908729 2024-08-27T02:37:57.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.155+0000 7f3e0cc408c0 1 < canceled operation key=PLC076BXR38P tag=RMNF8FT9M92V type=del size=3333122 2024-08-27T02:37:57.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.159+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=PO3W209Y95MN type=del size=3809100 2024-08-27T02:37:57.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.163+0000 7f3e0cc408c0 1 < completed write operation key=HKDJMA7O2DFM tag=GMZRHF864A5A type=write size=1032571 2024-08-27T02:37:57.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.171+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~193M53MG4DR6.0 size=1048576 2024-08-27T02:37:57.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~193M53MG4DR6.1 size=1048576 2024-08-27T02:37:57.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~193M53MG4DR6.2 size=883366 2024-08-27T02:37:57.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.175+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=193M53MG4DR6 tag=W5G0YXE3SSNY type=write size=4029094 2024-08-27T02:37:57.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.179+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~8DUJ0XW7AUMQ.0 size=971803 2024-08-27T02:37:57.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.187+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=8DUJ0XW7AUMQ tag=N9907NW4DFGF type=write size=2020379 2024-08-27T02:37:57.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.191+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~OO55R6734M3Z.0 size=1048576 2024-08-27T02:37:57.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.195+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~OO55R6734M3Z.1 size=352926 2024-08-27T02:37:57.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.195+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=OO55R6734M3Z tag=W0PG5TM2RIZX type=write size=2450078 2024-08-27T02:37:57.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.199+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~TZ4DG7HDX3B9.0 size=454394 2024-08-27T02:37:57.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.207+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=TZ4DG7HDX3B9 tag=LEBMZY443MH5 type=write size=1502970 2024-08-27T02:37:57.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.211+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=BDQ1GV095E61 type=del size=3994978 2024-08-27T02:37:57.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.215+0000 7f3e0cc408c0 1 < canceled operation key=6YTZJKE4V5HQ tag=UIW2XN0UNHY0 type=del size=1718283 2024-08-27T02:37:57.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~5HXKNZXETU3T.0 size=1048576 2024-08-27T02:37:57.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.223+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~5HXKNZXETU3T.1 size=1048576 2024-08-27T02:37:57.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.223+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~5HXKNZXETU3T.2 size=289858 2024-08-27T02:37:57.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.223+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=5HXKNZXETU3T tag=GLD21CP9T5ZA type=write size=3435586 2024-08-27T02:37:57.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.227+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~T6GKF8CDNA2B.0 size=1048576 2024-08-27T02:37:57.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~T6GKF8CDNA2B.1 size=364864 2024-08-27T02:37:57.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.239+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=T6GKF8CDNA2B tag=4CTB7S5YJQG6 type=write size=2462016 2024-08-27T02:37:57.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.243+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~ADO3UOBE018G.0 size=1048576 2024-08-27T02:37:57.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~ADO3UOBE018G.1 size=1048576 2024-08-27T02:37:57.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~ADO3UOBE018G.2 size=289048 2024-08-27T02:37:57.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.247+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=ADO3UOBE018G tag=2GSWAE7GBLRA type=write size=3434776 2024-08-27T02:37:57.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.251+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~QJT5PGZMNVA4.0 size=647606 2024-08-27T02:37:57.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.255+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=QJT5PGZMNVA4 tag=WJC4QM93OEZI type=write size=1696182 2024-08-27T02:37:57.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.263+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~HSPPSXAB3YTY.0 size=1048576 2024-08-27T02:37:57.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~HSPPSXAB3YTY.1 size=288009 2024-08-27T02:37:57.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.267+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=HSPPSXAB3YTY tag=87962J1GYZQG type=write size=2385161 2024-08-27T02:37:57.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.271+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~CCODPLOMAXET.0 size=208362 2024-08-27T02:37:57.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.275+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=CCODPLOMAXET tag=0GT6UI1YF4A7 type=write size=1256938 2024-08-27T02:37:57.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.275+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=04B2GF1O9O8Z type=write size=532281 2024-08-27T02:37:57.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.279+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=AVKWP3SOG9BR type=del 2024-08-27T02:37:57.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.283+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=Y06IS9W5HPYQ type=write size=41486 2024-08-27T02:37:57.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.283+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=GS14BT2LLXI5 type=del 2024-08-27T02:37:57.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.291+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~EEIRFE5KCZLE.0 size=1048576 2024-08-27T02:37:57.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~EEIRFE5KCZLE.1 size=290777 2024-08-27T02:37:57.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.295+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=EEIRFE5KCZLE tag=3BTYJLE7UFRG type=write size=2387929 2024-08-27T02:37:57.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.299+0000 7f3e0cc408c0 1 < completed write operation key=2CXWPDABA9XJ tag=GORYR6TD3LEB type=write size=217779 2024-08-27T02:37:57.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.299+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=P1WO223SOKPW type=del size=3891547 2024-08-27T02:37:57.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.303+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=A3USQCLBHE95 type=del 2024-08-27T02:37:57.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.307+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=991YA4LISBD2 type=del size=107901 2024-08-27T02:37:57.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.307+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=PB1U87MRZ7CG type=del 2024-08-27T02:37:57.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~TLR7EXPQADT4.0 size=62739 2024-08-27T02:37:57.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.315+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=TLR7EXPQADT4 tag=H2ZILZP6XWYI type=write size=1111315 2024-08-27T02:37:57.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~1Y62MPM0C5RC.0 size=991548 2024-08-27T02:37:57.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.323+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=1Y62MPM0C5RC tag=32E4X5PDTPA0 type=write size=2040124 2024-08-27T02:37:57.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.327+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=RGIPTTO712VO type=del size=1760706 2024-08-27T02:37:57.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.327+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~NSFKCE6JTOPO.0 size=248001 2024-08-27T02:37:57.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.335+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=NSFKCE6JTOPO tag=ZSJF0UFN2R4F type=write size=1296577 2024-08-27T02:37:57.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.335+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=EABIHUN4VKL5 type=write size=108845 2024-08-27T02:37:57.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.339+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~1DGVWGX7B49R.0 size=1048576 2024-08-27T02:37:57.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~1DGVWGX7B49R.1 size=1048576 2024-08-27T02:37:57.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~1DGVWGX7B49R.2 size=763001 2024-08-27T02:37:57.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.351+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=1DGVWGX7B49R tag=O3N0QHXIJNRR type=write size=3908729 2024-08-27T02:37:57.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.351+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=NA2Q00IHB464 type=del size=2045147 2024-08-27T02:37:57.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.359+0000 7f3e0cc408c0 1 < suggested update operation key=JDV1RIGAO7J1 tag=PO3W209Y95MN type=del size=3809100 2024-08-27T02:37:57.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.363+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=5BDTOCIY8EAO type=del size=854674 2024-08-27T02:37:57.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.363+0000 7f3e0cc408c0 1 < canceled part key=_multipart_2CXWPDABA9XJ.2~193M53MG4DR6.0 size=1048576 2024-08-27T02:37:57.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~193M53MG4DR6.1 size=1048576 2024-08-27T02:37:57.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~193M53MG4DR6.2 size=883366 2024-08-27T02:37:57.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.375+0000 7f3e0cc408c0 1 < canceled multipart upload key=2CXWPDABA9XJ upload=193M53MG4DR6 tag=W5G0YXE3SSNY type=write size=4029094 2024-08-27T02:37:57.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.379+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=E09JOU90LH1D type=write size=779554 2024-08-27T02:37:57.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~OO55R6734M3Z.0 size=1048576 2024-08-27T02:37:57.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~OO55R6734M3Z.1 size=352926 2024-08-27T02:37:57.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.391+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=OO55R6734M3Z tag=W0PG5TM2RIZX type=write size=2450078 2024-08-27T02:37:57.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.395+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=6FAH8ZL0XFJQ type=write size=165710 2024-08-27T02:37:57.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.395+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=BDQ1GV095E61 type=del 2024-08-27T02:37:57.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.403+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~PQFA180NPFIA.0 size=1048576 2024-08-27T02:37:57.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.403+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~PQFA180NPFIA.1 size=734497 2024-08-27T02:37:57.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.403+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=PQFA180NPFIA tag=N100RERR9H9V type=write size=2831649 2024-08-27T02:37:57.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.407+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~5HXKNZXETU3T.0 size=1048576 2024-08-27T02:37:57.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~5HXKNZXETU3T.1 size=1048576 2024-08-27T02:37:57.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~5HXKNZXETU3T.2 size=289858 2024-08-27T02:37:57.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.415+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=5HXKNZXETU3T tag=GLD21CP9T5ZA type=write size=3435586 2024-08-27T02:37:57.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.419+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=AK72P6LHQNMN type=del size=454988 2024-08-27T02:37:57.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.423+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~ADO3UOBE018G.0 size=1048576 2024-08-27T02:37:57.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.423+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~ADO3UOBE018G.1 size=1048576 2024-08-27T02:37:57.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.427+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~ADO3UOBE018G.2 size=289048 2024-08-27T02:37:57.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.431+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=ADO3UOBE018G tag=2GSWAE7GBLRA type=write size=3434776 2024-08-27T02:37:57.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~G2UL3FGPLP0Y.0 size=1048576 2024-08-27T02:37:57.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~G2UL3FGPLP0Y.1 size=1048576 2024-08-27T02:37:57.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~G2UL3FGPLP0Y.2 size=587952 2024-08-27T02:37:57.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.443+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=G2UL3FGPLP0Y tag=PHVXF75YAPSJ type=write size=3733680 2024-08-27T02:37:57.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.443+0000 7f3e0cc408c0 1 < canceled part key=_multipart_S5ANS33DXN7X.2~HSPPSXAB3YTY.0 size=1048576 2024-08-27T02:37:57.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~HSPPSXAB3YTY.1 size=288009 2024-08-27T02:37:57.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.451+0000 7f3e0cc408c0 1 < canceled multipart upload key=S5ANS33DXN7X upload=HSPPSXAB3YTY tag=87962J1GYZQG type=write size=2385161 2024-08-27T02:37:57.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.459+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~ATZQXLE2GQY0.0 size=462331 2024-08-27T02:37:57.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.459+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=ATZQXLE2GQY0 tag=F5WRJ9YZFF7K type=write size=1510907 2024-08-27T02:37:57.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.459+0000 7f3e0cc408c0 1 < completed write operation key=MKB40KOOCCNT tag=04B2GF1O9O8Z type=write size=532281 2024-08-27T02:37:57.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.463+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=569UB7HU2VO8 type=del size=2044698 2024-08-27T02:37:57.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.467+0000 7f3e0cc408c0 1 < completed write operation key=OY551242R8T6 tag=Y06IS9W5HPYQ type=write size=41486 2024-08-27T02:37:57.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.471+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=ML6H2FPIX95D type=del size=1192435 2024-08-27T02:37:57.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~EEIRFE5KCZLE.0 size=1048576 2024-08-27T02:37:57.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~EEIRFE5KCZLE.1 size=290777 2024-08-27T02:37:57.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.479+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=EEIRFE5KCZLE tag=3BTYJLE7UFRG type=write size=2387929 2024-08-27T02:37:57.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.483+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=6NI55YEXFXU3 type=del size=3305952 2024-08-27T02:37:57.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.487+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=P1WO223SOKPW type=del 2024-08-27T02:37:57.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.491+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~PB36ZRWLYSR3.0 size=1048576 2024-08-27T02:37:57.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.495+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~PB36ZRWLYSR3.1 size=978439 2024-08-27T02:37:57.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.495+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=PB36ZRWLYSR3 tag=HW3LMJZR8DSY type=write size=3075591 2024-08-27T02:37:57.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.503+0000 7f3e0cc408c0 1 < suggested update operation key=13M7JVZT12I2 tag=991YA4LISBD2 type=del size=107901 2024-08-27T02:37:57.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.507+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~850CF3SFZBNW.0 size=1048576 2024-08-27T02:37:57.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.511+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~850CF3SFZBNW.1 size=860783 2024-08-27T02:37:57.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.511+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=850CF3SFZBNW tag=6DVUFZXAX3NH type=write size=2957935 2024-08-27T02:37:57.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.515+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~TLR7EXPQADT4.0 size=62739 2024-08-27T02:37:57.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.519+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=TLR7EXPQADT4 tag=H2ZILZP6XWYI type=write size=1111315 2024-08-27T02:37:57.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.523+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=G8X2CQ7PI3KE type=del size=2133019 2024-08-27T02:37:57.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.527+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=RGIPTTO712VO type=del 2024-08-27T02:37:57.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.527+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=XVH1YL1216EV type=del size=3066670 2024-08-27T02:37:57.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.531+0000 7f3e0cc408c0 1 < completed write operation key=0U59R3BXL181 tag=EABIHUN4VKL5 type=write size=108845 2024-08-27T02:37:57.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.535+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=JZ3W3QEEUMV6 type=del size=1865718 2024-08-27T02:37:57.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.539+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=NA2Q00IHB464 type=del 2024-08-27T02:37:57.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.547+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~QPO0MORFHQBD.0 size=142943 2024-08-27T02:37:57.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.547+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=QPO0MORFHQBD tag=3CM2B20NQSH1 type=write size=1191519 2024-08-27T02:37:57.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.551+0000 7f3e0cc408c0 1 < suggested remove operation key=6QE1HU65GQZZ tag=5BDTOCIY8EAO type=del 2024-08-27T02:37:57.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.559+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~0R5HLTBACD1K.0 size=1048576 2024-08-27T02:37:57.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~0R5HLTBACD1K.1 size=1048576 2024-08-27T02:37:57.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~0R5HLTBACD1K.2 size=890354 2024-08-27T02:37:57.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.563+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=0R5HLTBACD1K tag=U3GS56AIX1FH type=write size=4036082 2024-08-27T02:37:57.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.567+0000 7f3e0cc408c0 1 < completed write operation key=MNE5WNFBH9HG tag=E09JOU90LH1D type=write size=779554 2024-08-27T02:37:57.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.571+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=06ZHEILFO8EX type=write size=791871 2024-08-27T02:37:57.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.575+0000 7f3e0cc408c0 1 < completed write operation key=MNE5WNFBH9HG tag=6FAH8ZL0XFJQ type=write size=165710 2024-08-27T02:37:57.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.579+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=F06LZSEH99KF type=del size=4118629 2024-08-27T02:37:57.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~PQFA180NPFIA.0 size=1048576 2024-08-27T02:37:57.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.583+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~PQFA180NPFIA.1 size=734497 2024-08-27T02:37:57.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.587+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=PQFA180NPFIA tag=N100RERR9H9V type=write size=2831649 2024-08-27T02:37:57.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.591+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=GX0TKT8H012B type=del size=2930412 2024-08-27T02:37:57.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.595+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=AK72P6LHQNMN type=del 2024-08-27T02:37:57.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.599+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=BJWF17FXCJHF type=del size=3319212 2024-08-27T02:37:57.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~G2UL3FGPLP0Y.0 size=1048576 2024-08-27T02:37:57.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~G2UL3FGPLP0Y.1 size=1048576 2024-08-27T02:37:57.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~G2UL3FGPLP0Y.2 size=587952 2024-08-27T02:37:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.615+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=G2UL3FGPLP0Y tag=PHVXF75YAPSJ type=write size=3733680 2024-08-27T02:37:57.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.615+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=2K9650Q6WX2Y type=del size=1317348 2024-08-27T02:37:57.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~ATZQXLE2GQY0.0 size=462331 2024-08-27T02:37:57.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.627+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=ATZQXLE2GQY0 tag=F5WRJ9YZFF7K type=write size=1510907 2024-08-27T02:37:57.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.631+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~SXLO9YV6C51P.0 size=1048576 2024-08-27T02:37:57.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~SXLO9YV6C51P.1 size=186667 2024-08-27T02:37:57.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.635+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=SXLO9YV6C51P tag=90FA8QQ3SY6B type=write size=2283819 2024-08-27T02:37:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.639+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=569UB7HU2VO8 type=del 2024-08-27T02:37:57.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.643+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=QBBX4DI57HID type=del size=3465014 2024-08-27T02:37:57.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.643+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=ML6H2FPIX95D type=del 2024-08-27T02:37:57.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.647+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=EXPWMLVBSEMU type=write size=659807 2024-08-27T02:37:57.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.651+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=6NI55YEXFXU3 type=del 2024-08-27T02:37:57.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.655+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=W2WBY23NT1RH type=write size=953469 2024-08-27T02:37:57.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.659+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~PB36ZRWLYSR3.0 size=1048576 2024-08-27T02:37:57.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.663+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~PB36ZRWLYSR3.1 size=978439 2024-08-27T02:37:57.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.667+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=PB36ZRWLYSR3 tag=HW3LMJZR8DSY type=write size=3075591 2024-08-27T02:37:57.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.675+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=MSZNOR1BA1G5 type=del size=1636840 2024-08-27T02:37:57.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.679+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~850CF3SFZBNW.0 size=1048576 2024-08-27T02:37:57.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.683+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~850CF3SFZBNW.1 size=860783 2024-08-27T02:37:57.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.687+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=850CF3SFZBNW tag=6DVUFZXAX3NH type=write size=2957935 2024-08-27T02:37:57.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.691+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=8JRF570AMQZH type=del size=1469938 2024-08-27T02:37:57.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.695+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=G8X2CQ7PI3KE type=del 2024-08-27T02:37:57.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.703+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~0Z0R86RFSBNO.0 size=1016516 2024-08-27T02:37:57.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.703+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=0Z0R86RFSBNO tag=FU2VCKJR89AL type=write size=2065092 2024-08-27T02:37:57.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.707+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=XVH1YL1216EV type=del 2024-08-27T02:37:57.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.711+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~S2JKT3O3KVW4.0 size=1048576 2024-08-27T02:37:57.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.715+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~S2JKT3O3KVW4.1 size=941060 2024-08-27T02:37:57.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.715+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=S2JKT3O3KVW4 tag=30S97Q11YOD2 type=write size=3038212 2024-08-27T02:37:57.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.719+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=JZ3W3QEEUMV6 type=del 2024-08-27T02:37:57.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.723+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~Q68H3X3OXT22.0 size=1048576 2024-08-27T02:37:57.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.727+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~Q68H3X3OXT22.1 size=999793 2024-08-27T02:37:57.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.727+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=Q68H3X3OXT22 tag=MI08Y2RWIQNP type=write size=3096945 2024-08-27T02:37:57.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.731+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~QPO0MORFHQBD.0 size=142943 2024-08-27T02:37:57.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.735+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=QPO0MORFHQBD tag=3CM2B20NQSH1 type=write size=1191519 2024-08-27T02:37:57.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.739+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=15OFT6LWL9JJ type=del size=41841 2024-08-27T02:37:57.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.743+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~0R5HLTBACD1K.0 size=1048576 2024-08-27T02:37:57.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.747+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~0R5HLTBACD1K.1 size=1048576 2024-08-27T02:37:57.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.751+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~0R5HLTBACD1K.2 size=890354 2024-08-27T02:37:57.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.755+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=0R5HLTBACD1K tag=U3GS56AIX1FH type=write size=4036082 2024-08-27T02:37:57.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.763+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~PQK4B3AP8RWJ.0 size=463736 2024-08-27T02:37:57.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.763+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=PQK4B3AP8RWJ tag=P7O9SP00111E type=write size=1512312 2024-08-27T02:37:57.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.767+0000 7f3e0cc408c0 1 < suggested update operation key=HTEOX3BV94K2 tag=06ZHEILFO8EX type=write size=791871 2024-08-27T02:37:57.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.771+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=KDHM004KFK1Q type=del size=3261396 2024-08-27T02:37:57.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.779+0000 7f3e0cc408c0 1 < suggested remove operation key=HKDJMA7O2DFM tag=F06LZSEH99KF type=del 2024-08-27T02:37:57.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.783+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=I9X3RTN2NCAB type=del size=575980 2024-08-27T02:37:57.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.787+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=GX0TKT8H012B type=del 2024-08-27T02:37:57.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.791+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=0D22LSDHRUW7 type=write size=874504 2024-08-27T02:37:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.791+0000 7f3e0cc408c0 -1 < failed to complete operation key=HKDJMA7O2DFM tag=BJWF17FXCJHF type=del size=3319212: (22) Invalid argument 2024-08-27T02:37:57.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.795+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=XYCGZ746XAFO type=write size=244082 2024-08-27T02:37:57.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.803+0000 7f3e0cc408c0 1 < suggested update operation key=VSDJU5KQLFKE tag=2K9650Q6WX2Y type=del size=1317348 2024-08-27T02:37:57.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.807+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~ATCQ61SLQDGB.0 size=1048576 2024-08-27T02:37:57.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~ATCQ61SLQDGB.1 size=899904 2024-08-27T02:37:57.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.811+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=ATCQ61SLQDGB tag=FKXBTRIF8GKI type=write size=2997056 2024-08-27T02:37:57.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.811+0000 7f3e0cc408c0 1 < canceled part key=_multipart_UGSWC9ZK9S7S.2~SXLO9YV6C51P.0 size=1048576 2024-08-27T02:37:57.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.815+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~SXLO9YV6C51P.1 size=186667 2024-08-27T02:37:57.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.819+0000 7f3e0cc408c0 1 < canceled multipart upload key=UGSWC9ZK9S7S upload=SXLO9YV6C51P tag=90FA8QQ3SY6B type=write size=2283819 2024-08-27T02:37:57.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.819+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=VV2FXOYRVCLO type=del size=2354883 2024-08-27T02:37:57.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.823+0000 7f3e0cc408c0 -1 < failed to complete operation key=VSDJU5KQLFKE tag=QBBX4DI57HID type=del size=3465014: (22) Invalid argument 2024-08-27T02:37:57.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.827+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=6559MOTMT25D type=del size=1228001 2024-08-27T02:37:57.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.831+0000 7f3e0cc408c0 1 < suggested update operation key=6YTZJKE4V5HQ tag=EXPWMLVBSEMU type=write size=659807 2024-08-27T02:37:57.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.835+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=RSWM1O92YWSN type=del size=3468012 2024-08-27T02:37:57.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.839+0000 7f3e0cc408c0 -1 < failed to complete operation key=HTEOX3BV94K2 tag=W2WBY23NT1RH type=write size=953469: (22) Invalid argument 2024-08-27T02:37:57.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.847+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~ES7Y0J9SCLRI.0 size=1048576 2024-08-27T02:37:57.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~ES7Y0J9SCLRI.1 size=1048576 2024-08-27T02:37:57.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~ES7Y0J9SCLRI.2 size=51616 2024-08-27T02:37:57.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.851+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=ES7Y0J9SCLRI tag=QHA86ALJ7KWB type=write size=3197344 2024-08-27T02:37:57.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.855+0000 7f3e0cc408c0 1 < canceled operation key=SG9T1RD5EATR tag=MSZNOR1BA1G5 type=del size=1636840 2024-08-27T02:37:57.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~I85518WXTRGY.0 size=410858 2024-08-27T02:37:57.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.863+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=I85518WXTRGY tag=EEM2RXCJQAGC type=write size=1459434 2024-08-27T02:37:57.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.867+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=8JRF570AMQZH type=del 2024-08-27T02:37:57.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.871+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~PFG5HJ3GL9GF.0 size=1048576 2024-08-27T02:37:57.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~PFG5HJ3GL9GF.1 size=1048576 2024-08-27T02:37:57.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~PFG5HJ3GL9GF.2 size=10219 2024-08-27T02:37:57.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.875+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=PFG5HJ3GL9GF tag=8KR3ZM8JKK94 type=write size=3155947 2024-08-27T02:37:57.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~0Z0R86RFSBNO.0 size=1016516 2024-08-27T02:37:57.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.883+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=0Z0R86RFSBNO tag=FU2VCKJR89AL type=write size=2065092 2024-08-27T02:37:57.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.887+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=30U742U4S69B type=del size=2741635 2024-08-27T02:37:57.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.891+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~S2JKT3O3KVW4.0 size=1048576 2024-08-27T02:37:57.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.891+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~S2JKT3O3KVW4.1 size=941060 2024-08-27T02:37:57.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.899+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=S2JKT3O3KVW4 tag=30S97Q11YOD2 type=write size=3038212 2024-08-27T02:37:57.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.899+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=AE4E9BEYEPS0 type=del size=3454157 2024-08-27T02:37:57.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.903+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~Q68H3X3OXT22.0 size=1048576 2024-08-27T02:37:57.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.907+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~Q68H3X3OXT22.1 size=999793 2024-08-27T02:37:57.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.911+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=Q68H3X3OXT22 tag=MI08Y2RWIQNP type=write size=3096945 2024-08-27T02:37:57.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.911+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=Z0SFN0EN8S3H type=write size=723179 2024-08-27T02:37:57.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.919+0000 7f3e0cc408c0 1 < suggested update operation key=1ZIJ9JJTM4ZC tag=15OFT6LWL9JJ type=del size=41841 2024-08-27T02:37:57.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.923+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~LNJ036V159OY.0 size=618437 2024-08-27T02:37:57.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.923+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=LNJ036V159OY tag=D05X30DNV3UU type=write size=1667013 2024-08-27T02:37:57.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.927+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~PQK4B3AP8RWJ.0 size=463736 2024-08-27T02:37:57.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.931+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=PQK4B3AP8RWJ tag=P7O9SP00111E type=write size=1512312 2024-08-27T02:37:57.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~C112K5HP1ZQL.0 size=623595 2024-08-27T02:37:57.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.939+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=C112K5HP1ZQL tag=TSXDC77OBY62 type=write size=1672171 2024-08-27T02:37:57.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.939+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=KDHM004KFK1Q type=del 2024-08-27T02:37:57.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.943+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=FB3UYASOQPNJ type=del size=2156143 2024-08-27T02:37:57.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.947+0000 7f3e0cc408c0 1 < canceled operation key=OY551242R8T6 tag=I9X3RTN2NCAB type=del size=575980 2024-08-27T02:37:57.950 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.951+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=QJ1MQZWFD2RP type=write size=304899 2024-08-27T02:37:57.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.955+0000 7f3e0cc408c0 1 < completed write operation key=0U59R3BXL181 tag=0D22LSDHRUW7 type=write size=874504 2024-08-27T02:37:57.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.959+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~U7B3RGURPFCM.0 size=1048576 2024-08-27T02:37:57.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.959+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~U7B3RGURPFCM.1 size=242907 2024-08-27T02:37:57.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.959+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=U7B3RGURPFCM tag=LJ1JYU9ZL81K type=write size=2340059 2024-08-27T02:37:57.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.963+0000 7f3e0cc408c0 1 < completed write operation key=4BV3C9MTIFT5 tag=XYCGZ746XAFO type=write size=244082 2024-08-27T02:37:57.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.967+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=OOFVFIPITSKX type=del size=1019109 2024-08-27T02:37:57.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.971+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~ATCQ61SLQDGB.0 size=1048576 2024-08-27T02:37:57.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.971+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~ATCQ61SLQDGB.1 size=899904 2024-08-27T02:37:57.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.983+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=ATCQ61SLQDGB tag=FKXBTRIF8GKI type=write size=2997056 2024-08-27T02:37:57.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.987+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~0CF6K5J3CEFN.0 size=1048576 2024-08-27T02:37:57.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.987+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~0CF6K5J3CEFN.1 size=1048576 2024-08-27T02:37:57.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.991+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~0CF6K5J3CEFN.2 size=653898 2024-08-27T02:37:57.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.991+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=0CF6K5J3CEFN tag=M7UNBCGD50B1 type=write size=3799626 2024-08-27T02:37:57.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.995+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=VV2FXOYRVCLO type=del 2024-08-27T02:37:57.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.995+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=8V7ZT0U0FTU4 type=del size=4108439 2024-08-27T02:37:57.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:57.999+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=6559MOTMT25D type=del 2024-08-27T02:37:58.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~XRQRQF8YN4H3.0 size=1048576 2024-08-27T02:37:58.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~XRQRQF8YN4H3.1 size=1048576 2024-08-27T02:37:58.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~XRQRQF8YN4H3.2 size=596436 2024-08-27T02:37:58.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.011+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=XRQRQF8YN4H3 tag=TRDOW5Y2MBRU type=write size=3742164 2024-08-27T02:37:58.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.015+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=RSWM1O92YWSN type=del 2024-08-27T02:37:58.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.015+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=NQP9N27M9N64 type=del size=2764196 2024-08-27T02:37:58.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~ES7Y0J9SCLRI.0 size=1048576 2024-08-27T02:37:58.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.019+0000 7f3e0cc408c0 1 < canceled part key=_multipart_XBURHQSU6IML.2~ES7Y0J9SCLRI.1 size=1048576 2024-08-27T02:37:58.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~ES7Y0J9SCLRI.2 size=51616 2024-08-27T02:37:58.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.027+0000 7f3e0cc408c0 1 < canceled multipart upload key=XBURHQSU6IML upload=ES7Y0J9SCLRI tag=QHA86ALJ7KWB type=write size=3197344 2024-08-27T02:37:58.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.031+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=0QTX18Z0IO34 type=del size=899377 2024-08-27T02:37:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~I85518WXTRGY.0 size=410858 2024-08-27T02:37:58.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.035+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=I85518WXTRGY tag=EEM2RXCJQAGC type=write size=1459434 2024-08-27T02:37:58.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.043+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~004XKPIQGL3O.0 size=1048576 2024-08-27T02:37:58.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.043+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~004XKPIQGL3O.1 size=537482 2024-08-27T02:37:58.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.043+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=004XKPIQGL3O tag=RN76492JQIPI type=write size=2634634 2024-08-27T02:37:58.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~PFG5HJ3GL9GF.0 size=1048576 2024-08-27T02:37:58.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.051+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~PFG5HJ3GL9GF.1 size=1048576 2024-08-27T02:37:58.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.055+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~PFG5HJ3GL9GF.2 size=10219 2024-08-27T02:37:58.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.059+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=PFG5HJ3GL9GF tag=8KR3ZM8JKK94 type=write size=3155947 2024-08-27T02:37:58.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.063+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=83N67CGZSX8Q type=del size=586515 2024-08-27T02:37:58.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.063+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=30U742U4S69B type=del 2024-08-27T02:37:58.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.067+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=258CG55BNXSW type=del size=1283775 2024-08-27T02:37:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.071+0000 7f3e0cc408c0 1 < suggested update operation key=6YTZJKE4V5HQ tag=AE4E9BEYEPS0 type=del size=3454157 2024-08-27T02:37:58.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.075+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=0BG8JGGZTVAV type=del size=2087006 2024-08-27T02:37:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.079+0000 7f3e0cc408c0 1 < completed write operation key=HKDJMA7O2DFM tag=Z0SFN0EN8S3H type=write size=723179 2024-08-27T02:37:58.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.083+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=FLCYJQ4M7WFP type=del size=1733830 2024-08-27T02:37:58.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.083+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~LNJ036V159OY.0 size=618437 2024-08-27T02:37:58.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.087+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=LNJ036V159OY tag=D05X30DNV3UU type=write size=1667013 2024-08-27T02:37:58.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.091+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~SOCCGQDCI992.0 size=1048576 2024-08-27T02:37:58.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~SOCCGQDCI992.1 size=1048576 2024-08-27T02:37:58.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~SOCCGQDCI992.2 size=441381 2024-08-27T02:37:58.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.095+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=SOCCGQDCI992 tag=Q7I37BQZZ2QX type=write size=3587109 2024-08-27T02:37:58.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.099+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~C112K5HP1ZQL.0 size=623595 2024-08-27T02:37:58.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.107+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=C112K5HP1ZQL tag=TSXDC77OBY62 type=write size=1672171 2024-08-27T02:37:58.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.111+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~0JNA60VY255Z.0 size=666543 2024-08-27T02:37:58.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.111+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=0JNA60VY255Z tag=LFWZSWGLZTEK type=write size=1715119 2024-08-27T02:37:58.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.119+0000 7f3e0cc408c0 1 < suggested remove operation key=D7YWS7BWXT37 tag=FB3UYASOQPNJ type=del 2024-08-27T02:37:58.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.123+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~0KC3QQMGLTF0.0 size=1048576 2024-08-27T02:37:58.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~0KC3QQMGLTF0.1 size=51173 2024-08-27T02:37:58.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.127+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=0KC3QQMGLTF0 tag=UP105MVKEJ1K type=write size=2148325 2024-08-27T02:37:58.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.127+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=QJ1MQZWFD2RP type=write size=304899 2024-08-27T02:37:58.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~YLA5PUB9VZY0.0 size=1048576 2024-08-27T02:37:58.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~YLA5PUB9VZY0.1 size=458999 2024-08-27T02:37:58.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.135+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=YLA5PUB9VZY0 tag=CIUDKGRMAE0W type=write size=2556151 2024-08-27T02:37:58.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.139+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~U7B3RGURPFCM.0 size=1048576 2024-08-27T02:37:58.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.139+0000 7f3e0cc408c0 1 < canceled part key=_multipart_IISECLYEAR19.2~U7B3RGURPFCM.1 size=242907 2024-08-27T02:37:58.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.147+0000 7f3e0cc408c0 1 < canceled multipart upload key=IISECLYEAR19 upload=U7B3RGURPFCM tag=LJ1JYU9ZL81K type=write size=2340059 2024-08-27T02:37:58.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.151+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ZGAHRGVKA309.0 size=1048576 2024-08-27T02:37:58.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ZGAHRGVKA309.1 size=1048576 2024-08-27T02:37:58.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~ZGAHRGVKA309.2 size=622886 2024-08-27T02:37:58.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.159+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=ZGAHRGVKA309 tag=T0F7TXSWWL9J type=write size=3768614 2024-08-27T02:37:58.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.163+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=OOFVFIPITSKX type=del 2024-08-27T02:37:58.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.163+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=01CGOMUNVEXE type=del size=2804570 2024-08-27T02:37:58.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.167+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~0CF6K5J3CEFN.0 size=1048576 2024-08-27T02:37:58.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.171+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~0CF6K5J3CEFN.1 size=1048576 2024-08-27T02:37:58.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.171+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~0CF6K5J3CEFN.2 size=653898 2024-08-27T02:37:58.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.179+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=0CF6K5J3CEFN tag=M7UNBCGD50B1 type=write size=3799626 2024-08-27T02:37:58.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.183+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~Z8EMT1JI6TBZ.0 size=580034 2024-08-27T02:37:58.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.183+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=Z8EMT1JI6TBZ tag=SFNLVJXVDFVY type=write size=1628610 2024-08-27T02:37:58.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.191+0000 7f3e0cc408c0 1 < suggested remove operation key=4BV3C9MTIFT5 tag=8V7ZT0U0FTU4 type=del 2024-08-27T02:37:58.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.195+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=1Z5RU497TSMF type=del size=4132225 2024-08-27T02:37:58.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.199+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~XRQRQF8YN4H3.0 size=1048576 2024-08-27T02:37:58.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.203+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~XRQRQF8YN4H3.1 size=1048576 2024-08-27T02:37:58.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.207+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~XRQRQF8YN4H3.2 size=596436 2024-08-27T02:37:58.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.211+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=XRQRQF8YN4H3 tag=TRDOW5Y2MBRU type=write size=3742164 2024-08-27T02:37:58.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.215+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=MWRB4DJSYFTB type=del size=2500501 2024-08-27T02:37:58.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.223+0000 7f3e0cc408c0 1 < suggested update operation key=HKDJMA7O2DFM tag=NQP9N27M9N64 type=del size=2764196 2024-08-27T02:37:58.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.223+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=NVQ54227B217 type=del size=2569565 2024-08-27T02:37:58.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.227+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=0QTX18Z0IO34 type=del 2024-08-27T02:37:58.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.231+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=D0FP4MTW9N1E type=write size=594400 2024-08-27T02:37:58.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.235+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~004XKPIQGL3O.0 size=1048576 2024-08-27T02:37:58.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.239+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~004XKPIQGL3O.1 size=537482 2024-08-27T02:37:58.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.243+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=004XKPIQGL3O tag=RN76492JQIPI type=write size=2634634 2024-08-27T02:37:58.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.247+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=HJ18M36Z6Q38 type=del size=2389496 2024-08-27T02:37:58.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.255+0000 7f3e0cc408c0 1 < suggested remove operation key=2CXWPDABA9XJ tag=83N67CGZSX8Q type=del 2024-08-27T02:37:58.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~1UFXG2TA21Q7.0 size=1048576 2024-08-27T02:37:58.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.263+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~1UFXG2TA21Q7.1 size=1048576 2024-08-27T02:37:58.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~1UFXG2TA21Q7.2 size=727745 2024-08-27T02:37:58.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.267+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=1UFXG2TA21Q7 tag=6TJ38YCUPIPY type=write size=3873473 2024-08-27T02:37:58.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.271+0000 7f3e0cc408c0 -1 < failed to complete operation key=6YTZJKE4V5HQ tag=258CG55BNXSW type=del size=1283775: (22) Invalid argument 2024-08-27T02:37:58.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.275+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=VP1VJYYQU0FF type=del size=37562 2024-08-27T02:37:58.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.283+0000 7f3e0cc408c0 1 < suggested remove operation key=MNE5WNFBH9HG tag=0BG8JGGZTVAV type=del 2024-08-27T02:37:58.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.283+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=988W1KUUWYWQ type=del size=477399 2024-08-27T02:37:58.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.291+0000 7f3e0cc408c0 1 < suggested remove operation key=6YTZJKE4V5HQ tag=FLCYJQ4M7WFP type=del 2024-08-27T02:37:58.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.295+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=R69DKPJO1Q34 type=del size=3919662 2024-08-27T02:37:58.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.299+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~SOCCGQDCI992.0 size=1048576 2024-08-27T02:37:58.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.299+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~SOCCGQDCI992.1 size=1048576 2024-08-27T02:37:58.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~SOCCGQDCI992.2 size=441381 2024-08-27T02:37:58.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.307+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=SOCCGQDCI992 tag=Q7I37BQZZ2QX type=write size=3587109 2024-08-27T02:37:58.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.311+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=C9GXL6NRLFEI type=del size=2577099 2024-08-27T02:37:58.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.315+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~0JNA60VY255Z.0 size=666543 2024-08-27T02:37:58.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.319+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=0JNA60VY255Z tag=LFWZSWGLZTEK type=write size=1715119 2024-08-27T02:37:58.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~BHU1ZH17L742.0 size=1048576 2024-08-27T02:37:58.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~BHU1ZH17L742.1 size=206264 2024-08-27T02:37:58.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.323+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=BHU1ZH17L742 tag=U7YDS9EJI2BV type=write size=2303416 2024-08-27T02:37:58.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.327+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~0KC3QQMGLTF0.0 size=1048576 2024-08-27T02:37:58.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~0KC3QQMGLTF0.1 size=51173 2024-08-27T02:37:58.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.335+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=0KC3QQMGLTF0 tag=UP105MVKEJ1K type=write size=2148325 2024-08-27T02:37:58.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.339+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=SQE99LH4F9HU type=del size=2850518 2024-08-27T02:37:58.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.339+0000 7f3e0cc408c0 1 < canceled part key=_multipart_4BV3C9MTIFT5.2~YLA5PUB9VZY0.0 size=1048576 2024-08-27T02:37:58.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.339+0000 7f3e0cc408c0 1 < canceled part key=_multipart_4BV3C9MTIFT5.2~YLA5PUB9VZY0.1 size=458999 2024-08-27T02:37:58.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.347+0000 7f3e0cc408c0 1 < canceled multipart upload key=4BV3C9MTIFT5 upload=YLA5PUB9VZY0 tag=CIUDKGRMAE0W type=write size=2556151 2024-08-27T02:37:58.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.347+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=EWMALJ6DDTN5 type=del size=1254234 2024-08-27T02:37:58.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.351+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~ZGAHRGVKA309.0 size=1048576 2024-08-27T02:37:58.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.351+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~ZGAHRGVKA309.1 size=1048576 2024-08-27T02:37:58.354 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.355+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~ZGAHRGVKA309.2 size=622886 2024-08-27T02:37:58.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.359+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=ZGAHRGVKA309 tag=T0F7TXSWWL9J type=write size=3768614 2024-08-27T02:37:58.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.363+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=AE5YIDB0SYPU type=del size=1433117 2024-08-27T02:37:58.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.367+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=01CGOMUNVEXE type=del 2024-08-27T02:37:58.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.371+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=1P5T3ZT72A4E type=del size=358546 2024-08-27T02:37:58.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~Z8EMT1JI6TBZ.0 size=580034 2024-08-27T02:37:58.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.379+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=Z8EMT1JI6TBZ tag=SFNLVJXVDFVY type=write size=1628610 2024-08-27T02:37:58.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~ZKJQHDKJZ9QW.0 size=1048576 2024-08-27T02:37:58.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~ZKJQHDKJZ9QW.1 size=1048576 2024-08-27T02:37:58.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~ZKJQHDKJZ9QW.2 size=719595 2024-08-27T02:37:58.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.387+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=ZKJQHDKJZ9QW tag=N1FHAYYAH8Z6 type=write size=3865323 2024-08-27T02:37:58.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.391+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=1Z5RU497TSMF type=del 2024-08-27T02:37:58.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.395+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=JUJPXDC1CQHN type=write size=602582 2024-08-27T02:37:58.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.399+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=MWRB4DJSYFTB type=del 2024-08-27T02:37:58.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.407+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~3OYEVL3H1Y68.0 size=540393 2024-08-27T02:37:58.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.407+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=3OYEVL3H1Y68 tag=TCVT8XKB8DVH type=write size=1588969 2024-08-27T02:37:58.408 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.407+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=NVQ54227B217 type=del 2024-08-27T02:37:58.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.411+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=6HMLUIVAPFJG type=del size=4038543 2024-08-27T02:37:58.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.419+0000 7f3e0cc408c0 1 < suggested remove operation key=D7YWS7BWXT37 tag=D0FP4MTW9N1E type=write 2024-08-27T02:37:58.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~P7RUEIIP0VHP.0 size=182817 2024-08-27T02:37:58.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.427+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=P7RUEIIP0VHP tag=9AIJPP6D6BSB type=write size=1231393 2024-08-27T02:37:58.429 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.431+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=HJ18M36Z6Q38 type=del 2024-08-27T02:37:58.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.435+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~8P91DZCATZC2.0 size=94042 2024-08-27T02:37:58.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.435+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=8P91DZCATZC2 tag=SKYLODIDH17B type=write size=1142618 2024-08-27T02:37:58.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.439+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~1UFXG2TA21Q7.0 size=1048576 2024-08-27T02:37:58.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.443+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~1UFXG2TA21Q7.1 size=1048576 2024-08-27T02:37:58.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.443+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~1UFXG2TA21Q7.2 size=727745 2024-08-27T02:37:58.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.451+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=1UFXG2TA21Q7 tag=6TJ38YCUPIPY type=write size=3873473 2024-08-27T02:37:58.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.455+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~BS552G80SVSH.0 size=1048576 2024-08-27T02:37:58.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.459+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~BS552G80SVSH.1 size=1048576 2024-08-27T02:37:58.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.459+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~BS552G80SVSH.2 size=249188 2024-08-27T02:37:58.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.459+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=BS552G80SVSH tag=X8B647HS5O10 type=write size=3394916 2024-08-27T02:37:58.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.467+0000 7f3e0cc408c0 1 < suggested remove operation key=HTEOX3BV94K2 tag=VP1VJYYQU0FF type=del 2024-08-27T02:37:58.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.467+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=D0ZKM3NC5MF1 type=del size=1813405 2024-08-27T02:37:58.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.471+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=988W1KUUWYWQ type=del 2024-08-27T02:37:58.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.475+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=8NQRBTVCPLHQ type=write size=288534 2024-08-27T02:37:58.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.479+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=R69DKPJO1Q34 type=del 2024-08-27T02:37:58.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.483+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~TQLRIJTTR59G.0 size=192572 2024-08-27T02:37:58.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.483+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=TQLRIJTTR59G tag=6M8EDFMBXHLN type=write size=1241148 2024-08-27T02:37:58.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.487+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=C9GXL6NRLFEI type=del 2024-08-27T02:37:58.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.491+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=FBCVEX0OM6YY type=del size=1295693 2024-08-27T02:37:58.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.495+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~BHU1ZH17L742.0 size=1048576 2024-08-27T02:37:58.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~BHU1ZH17L742.1 size=206264 2024-08-27T02:37:58.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.503+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=BHU1ZH17L742 tag=U7YDS9EJI2BV type=write size=2303416 2024-08-27T02:37:58.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.507+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=7NSQHDYCFE18 type=del size=2058357 2024-08-27T02:37:58.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.511+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=SQE99LH4F9HU type=del 2024-08-27T02:37:58.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.515+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=N2OTYGNYO92V type=del size=1239203 2024-08-27T02:37:58.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.519+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=EWMALJ6DDTN5 type=del 2024-08-27T02:37:58.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.523+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=1JJ5GMK812E9 type=del size=1646710 2024-08-27T02:37:58.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.527+0000 7f3e0cc408c0 -1 < failed to complete operation key=D7YWS7BWXT37 tag=AE5YIDB0SYPU type=del size=1433117: (22) Invalid argument 2024-08-27T02:37:58.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.531+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=UDLKBOBQKYZH type=del size=3068839 2024-08-27T02:37:58.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.535+0000 7f3e0cc408c0 1 < suggested update operation key=6YTZJKE4V5HQ tag=1P5T3ZT72A4E type=del size=358546 2024-08-27T02:37:58.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.539+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=861VSP8U8UT5 type=del size=1940145 2024-08-27T02:37:58.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.543+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~ZKJQHDKJZ9QW.0 size=1048576 2024-08-27T02:37:58.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.543+0000 7f3e0cc408c0 1 < canceled part key=_multipart_13M7JVZT12I2.2~ZKJQHDKJZ9QW.1 size=1048576 2024-08-27T02:37:58.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~ZKJQHDKJZ9QW.2 size=719595 2024-08-27T02:37:58.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.551+0000 7f3e0cc408c0 1 < canceled multipart upload key=13M7JVZT12I2 upload=ZKJQHDKJZ9QW tag=N1FHAYYAH8Z6 type=write size=3865323 2024-08-27T02:37:58.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.555+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=1GYQLMQ2O2GK type=del size=706070 2024-08-27T02:37:58.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.559+0000 7f3e0cc408c0 1 < completed write operation key=ZMN8Y0VQVHLB tag=JUJPXDC1CQHN type=write size=602582 2024-08-27T02:37:58.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~S1YXUP6WS6G2.0 size=1048576 2024-08-27T02:37:58.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~S1YXUP6WS6G2.1 size=1048576 2024-08-27T02:37:58.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.571+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~S1YXUP6WS6G2.2 size=687165 2024-08-27T02:37:58.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.571+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=S1YXUP6WS6G2 tag=SW9JK26MGVXX type=write size=3832893 2024-08-27T02:37:58.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.575+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~3OYEVL3H1Y68.0 size=540393 2024-08-27T02:37:58.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.583+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=3OYEVL3H1Y68 tag=TCVT8XKB8DVH type=write size=1588969 2024-08-27T02:37:58.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.591+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~W32KGD3VECC6.0 size=186995 2024-08-27T02:37:58.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.591+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=W32KGD3VECC6 tag=CAXQNYD7AN2R type=write size=1235571 2024-08-27T02:37:58.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.595+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=6HMLUIVAPFJG type=del 2024-08-27T02:37:58.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.595+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=CS86FLRPJDTM type=del size=2352212 2024-08-27T02:37:58.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.599+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~P7RUEIIP0VHP.0 size=182817 2024-08-27T02:37:58.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.607+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=P7RUEIIP0VHP tag=9AIJPP6D6BSB type=write size=1231393 2024-08-27T02:37:58.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.611+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=99AGRAF7MBB8 type=write size=970552 2024-08-27T02:37:58.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.615+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~8P91DZCATZC2.0 size=94042 2024-08-27T02:37:58.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.619+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=8P91DZCATZC2 tag=SKYLODIDH17B type=write size=1142618 2024-08-27T02:37:58.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.623+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~CO8W1UN0RR2S.0 size=1048576 2024-08-27T02:37:58.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~CO8W1UN0RR2S.1 size=86249 2024-08-27T02:37:58.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.627+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=CO8W1UN0RR2S tag=5N755YTH64ND type=write size=2183401 2024-08-27T02:37:58.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.627+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~BS552G80SVSH.0 size=1048576 2024-08-27T02:37:58.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.631+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~BS552G80SVSH.1 size=1048576 2024-08-27T02:37:58.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.635+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~BS552G80SVSH.2 size=249188 2024-08-27T02:37:58.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.639+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=BS552G80SVSH tag=X8B647HS5O10 type=write size=3394916 2024-08-27T02:37:58.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.643+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~1LP62KRK4UGG.0 size=1048576 2024-08-27T02:37:58.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~1LP62KRK4UGG.1 size=1048576 2024-08-27T02:37:58.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.651+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~1LP62KRK4UGG.2 size=462736 2024-08-27T02:37:58.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.651+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=1LP62KRK4UGG tag=X850PQ1D5F2P type=write size=3608464 2024-08-27T02:37:58.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.655+0000 7f3e0cc408c0 1 < suggested remove operation key=B9DPI871LQ7E tag=D0ZKM3NC5MF1 type=del 2024-08-27T02:37:58.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.659+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=TU0ZX73PJ4T0 type=del size=3105253 2024-08-27T02:37:58.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.663+0000 7f3e0cc408c0 -1 < failed to complete operation key=6YTZJKE4V5HQ tag=8NQRBTVCPLHQ type=write size=288534: (22) Invalid argument 2024-08-27T02:37:58.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.667+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=BW0714H0MJN1 type=del size=3423811 2024-08-27T02:37:58.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.671+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~TQLRIJTTR59G.0 size=192572 2024-08-27T02:37:58.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.675+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=TQLRIJTTR59G tag=6M8EDFMBXHLN type=write size=1241148 2024-08-27T02:37:58.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.679+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=DZD7NHQVPEKG type=del size=2740728 2024-08-27T02:37:58.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.683+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=FBCVEX0OM6YY type=del 2024-08-27T02:37:58.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.687+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~LCETMWMAPNWU.0 size=1016866 2024-08-27T02:37:58.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.687+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=LCETMWMAPNWU tag=XMET37PL5VS6 type=write size=2065442 2024-08-27T02:37:58.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.695+0000 7f3e0cc408c0 1 < suggested remove operation key=MNE5WNFBH9HG tag=7NSQHDYCFE18 type=del 2024-08-27T02:37:58.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.699+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~Z6DBMAHBR97W.0 size=745464 2024-08-27T02:37:58.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.699+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=Z6DBMAHBR97W tag=OY5JOBQX8BZN type=write size=1794040 2024-08-27T02:37:58.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.703+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=N2OTYGNYO92V type=del 2024-08-27T02:37:58.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.707+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=G639M8ZLFW30 type=del size=3367563 2024-08-27T02:37:58.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.711+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=1JJ5GMK812E9 type=del 2024-08-27T02:37:58.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.715+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=4R2LWI23H4G0 type=del size=1272722 2024-08-27T02:37:58.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.715+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=UDLKBOBQKYZH type=del 2024-08-27T02:37:58.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.723+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~C3Q5H4I0FTSI.0 size=731837 2024-08-27T02:37:58.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.723+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=C3Q5H4I0FTSI tag=0GD16526IYRT type=write size=1780413 2024-08-27T02:37:58.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.727+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=861VSP8U8UT5 type=del 2024-08-27T02:37:58.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.731+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~XJ2ZSJJN78YL.0 size=556427 2024-08-27T02:37:58.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.731+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=XJ2ZSJJN78YL tag=V5EWD4SCRG0E type=write size=1605003 2024-08-27T02:37:58.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.735+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=1GYQLMQ2O2GK type=del 2024-08-27T02:37:58.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.739+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=O89JDGF10MLH type=del size=2140658 2024-08-27T02:37:58.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.739+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~S1YXUP6WS6G2.0 size=1048576 2024-08-27T02:37:58.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.739+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~S1YXUP6WS6G2.1 size=1048576 2024-08-27T02:37:58.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.743+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~S1YXUP6WS6G2.2 size=687165 2024-08-27T02:37:58.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.747+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=S1YXUP6WS6G2 tag=SW9JK26MGVXX type=write size=3832893 2024-08-27T02:37:58.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.751+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~DU6Q5PIZ7QXE.0 size=870385 2024-08-27T02:37:58.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.751+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=DU6Q5PIZ7QXE tag=U7JG8UDM66KB type=write size=1918961 2024-08-27T02:37:58.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.755+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~W32KGD3VECC6.0 size=186995 2024-08-27T02:37:58.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.759+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=W32KGD3VECC6 tag=CAXQNYD7AN2R type=write size=1235571 2024-08-27T02:37:58.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~6IA9H45LQWWC.0 size=1048576 2024-08-27T02:37:58.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~6IA9H45LQWWC.1 size=60994 2024-08-27T02:37:58.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.767+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=6IA9H45LQWWC tag=6HROXK73UU9K type=write size=2158146 2024-08-27T02:37:58.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.771+0000 7f3e0cc408c0 1 < canceled operation key=F4MCLPFLY531 tag=CS86FLRPJDTM type=del size=2352212 2024-08-27T02:37:58.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.775+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=V037K9VVHJX1 type=del size=2253660 2024-08-27T02:37:58.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.779+0000 7f3e0cc408c0 1 < canceled operation key=A0RUXE4YL6NR tag=99AGRAF7MBB8 type=write size=970552 2024-08-27T02:37:58.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.783+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=WWZM988QC2FX type=del size=3920181 2024-08-27T02:37:58.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.783+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~CO8W1UN0RR2S.0 size=1048576 2024-08-27T02:37:58.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.787+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~CO8W1UN0RR2S.1 size=86249 2024-08-27T02:37:58.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.791+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=CO8W1UN0RR2S tag=5N755YTH64ND type=write size=2183401 2024-08-27T02:37:58.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.799+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~DPQOMISH2L3P.0 size=1048576 2024-08-27T02:37:58.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~DPQOMISH2L3P.1 size=1048576 2024-08-27T02:37:58.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~DPQOMISH2L3P.2 size=410653 2024-08-27T02:37:58.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.803+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=DPQOMISH2L3P tag=X9CAO8XEQBGC type=write size=3556381 2024-08-27T02:37:58.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.807+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~1LP62KRK4UGG.0 size=1048576 2024-08-27T02:37:58.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.811+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~1LP62KRK4UGG.1 size=1048576 2024-08-27T02:37:58.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.811+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~1LP62KRK4UGG.2 size=462736 2024-08-27T02:37:58.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.819+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=1LP62KRK4UGG tag=X850PQ1D5F2P type=write size=3608464 2024-08-27T02:37:58.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~IVAQSPVE9207.0 size=307398 2024-08-27T02:37:58.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.823+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=IVAQSPVE9207 tag=6VP5XYDC3205 type=write size=1355974 2024-08-27T02:37:58.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.827+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=TU0ZX73PJ4T0 type=del 2024-08-27T02:37:58.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.831+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~LTGPCJ2E8VQ7.0 size=1048576 2024-08-27T02:37:58.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~LTGPCJ2E8VQ7.1 size=1048576 2024-08-27T02:37:58.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.839+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~LTGPCJ2E8VQ7.2 size=762803 2024-08-27T02:37:58.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.839+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=LTGPCJ2E8VQ7 tag=GVJJ1S90O3KM type=write size=3908531 2024-08-27T02:37:58.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.843+0000 7f3e0cc408c0 1 < suggested remove operation key=OY551242R8T6 tag=BW0714H0MJN1 type=del 2024-08-27T02:37:58.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.847+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=I59P02AW3H3R type=write size=1043600 2024-08-27T02:37:58.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.851+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=DZD7NHQVPEKG type=del 2024-08-27T02:37:58.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.855+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~ISMP81UBB711.0 size=926804 2024-08-27T02:37:58.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.855+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=ISMP81UBB711 tag=3RN3UQDGRELH type=write size=1975380 2024-08-27T02:37:58.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.855+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~LCETMWMAPNWU.0 size=1016866 2024-08-27T02:37:58.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.859+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=LCETMWMAPNWU tag=XMET37PL5VS6 type=write size=2065442 2024-08-27T02:37:58.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.863+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=4WGA4G23GTTT type=del size=2452291 2024-08-27T02:37:58.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~Z6DBMAHBR97W.0 size=745464 2024-08-27T02:37:58.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.871+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=Z6DBMAHBR97W tag=OY5JOBQX8BZN type=write size=1794040 2024-08-27T02:37:58.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.879+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~E4KMZZ99V8OX.0 size=1048576 2024-08-27T02:37:58.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.883+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~E4KMZZ99V8OX.1 size=816306 2024-08-27T02:37:58.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.883+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=E4KMZZ99V8OX tag=4KJGPZGVA3D7 type=write size=2913458 2024-08-27T02:37:58.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.887+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=G639M8ZLFW30 type=del 2024-08-27T02:37:58.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.891+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~FTQ5OB9ZJEPF.0 size=1048576 2024-08-27T02:37:58.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.895+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~FTQ5OB9ZJEPF.1 size=1048576 2024-08-27T02:37:58.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.895+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~FTQ5OB9ZJEPF.2 size=660252 2024-08-27T02:37:58.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.895+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=FTQ5OB9ZJEPF tag=1R1K4P67H7HG type=write size=3805980 2024-08-27T02:37:58.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.899+0000 7f3e0cc408c0 -1 < no bi entry to suggest for operation key=OY551242R8T6 tag=4R2LWI23H4G0 type=del size=1272722: (2) No such file or directory 2024-08-27T02:37:58.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.899+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=RTKLS87L0L3K type=del size=4081383 2024-08-27T02:37:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.903+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~C3Q5H4I0FTSI.0 size=731837 2024-08-27T02:37:58.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.911+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=C3Q5H4I0FTSI tag=0GD16526IYRT type=write size=1780413 2024-08-27T02:37:58.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.911+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=R3GXENZ5EROL type=del size=889406 2024-08-27T02:37:58.916 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.915+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~XJ2ZSJJN78YL.0 size=556427 2024-08-27T02:37:58.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.923+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=XJ2ZSJJN78YL tag=V5EWD4SCRG0E type=write size=1605003 2024-08-27T02:37:58.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.927+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~YE0CC90EJPGA.0 size=1048576 2024-08-27T02:37:58.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.931+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~YE0CC90EJPGA.1 size=213553 2024-08-27T02:37:58.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.931+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=YE0CC90EJPGA tag=E6S9ODSL80U1 type=write size=2310705 2024-08-27T02:37:58.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.935+0000 7f3e0cc408c0 1 < suggested update operation key=QVG1NTF6O8L2 tag=O89JDGF10MLH type=del size=2140658 2024-08-27T02:37:58.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~36LGZQ0OI66L.0 size=249158 2024-08-27T02:37:58.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.939+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=36LGZQ0OI66L tag=EP6PHAR2D9CN type=write size=1297734 2024-08-27T02:37:58.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.943+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~DU6Q5PIZ7QXE.0 size=870385 2024-08-27T02:37:58.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.951+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=DU6Q5PIZ7QXE tag=U7JG8UDM66KB type=write size=1918961 2024-08-27T02:37:58.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.951+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=KW5H6XQL42LM type=del size=3830017 2024-08-27T02:37:58.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~6IA9H45LQWWC.0 size=1048576 2024-08-27T02:37:58.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~6IA9H45LQWWC.1 size=60994 2024-08-27T02:37:58.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.963+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=6IA9H45LQWWC tag=6HROXK73UU9K type=write size=2158146 2024-08-27T02:37:58.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.967+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=Q4GRCUEKMSC0 type=del size=3893831 2024-08-27T02:37:58.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.967+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=V037K9VVHJX1 type=del 2024-08-27T02:37:58.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~3KF1FP6P1QAA.0 size=1048576 2024-08-27T02:37:58.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~3KF1FP6P1QAA.1 size=54297 2024-08-27T02:37:58.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.975+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=3KF1FP6P1QAA tag=U9QIK50OLP4O type=write size=2151449 2024-08-27T02:37:58.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.983+0000 7f3e0cc408c0 1 < suggested remove operation key=XBURHQSU6IML tag=WWZM988QC2FX type=del 2024-08-27T02:37:58.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.987+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=L6GTDX4K1WU4 type=del size=2661145 2024-08-27T02:37:58.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~DPQOMISH2L3P.0 size=1048576 2024-08-27T02:37:58.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~DPQOMISH2L3P.1 size=1048576 2024-08-27T02:37:58.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.995+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~DPQOMISH2L3P.2 size=410653 2024-08-27T02:37:58.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:58.999+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=DPQOMISH2L3P tag=X9CAO8XEQBGC type=write size=3556381 2024-08-27T02:37:59.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.003+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=6E79EGCBPCQ3 type=del size=3632062 2024-08-27T02:37:59.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.007+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~IVAQSPVE9207.0 size=307398 2024-08-27T02:37:59.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.011+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=IVAQSPVE9207 tag=6VP5XYDC3205 type=write size=1355974 2024-08-27T02:37:59.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.015+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=YODGNEGT6LFT type=write size=769493 2024-08-27T02:37:59.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.015+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~LTGPCJ2E8VQ7.0 size=1048576 2024-08-27T02:37:59.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~LTGPCJ2E8VQ7.1 size=1048576 2024-08-27T02:37:59.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~LTGPCJ2E8VQ7.2 size=762803 2024-08-27T02:37:59.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.027+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=LTGPCJ2E8VQ7 tag=GVJJ1S90O3KM type=write size=3908531 2024-08-27T02:37:59.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.031+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=ZC5T6PPW8Y7C type=del size=2438609 2024-08-27T02:37:59.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.031+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=I59P02AW3H3R type=write size=1043600 2024-08-27T02:37:59.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.039+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~Y06MFHH0MS5L.0 size=1048576 2024-08-27T02:37:59.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.039+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~Y06MFHH0MS5L.1 size=1008082 2024-08-27T02:37:59.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.039+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=Y06MFHH0MS5L tag=XEPW0U36AW7B type=write size=3105234 2024-08-27T02:37:59.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~ISMP81UBB711.0 size=926804 2024-08-27T02:37:59.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.051+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=ISMP81UBB711 tag=3RN3UQDGRELH type=write size=1975380 2024-08-27T02:37:59.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.055+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=5OLS84H7H5GE type=write size=176549 2024-08-27T02:37:59.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.059+0000 7f3e0cc408c0 1 < canceled operation key=4BV3C9MTIFT5 tag=4WGA4G23GTTT type=del size=2452291 2024-08-27T02:37:59.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.059+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=BGF09GRKHZEX type=del size=3828139 2024-08-27T02:37:59.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~E4KMZZ99V8OX.0 size=1048576 2024-08-27T02:37:59.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~E4KMZZ99V8OX.1 size=816306 2024-08-27T02:37:59.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.075+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=E4KMZZ99V8OX tag=4KJGPZGVA3D7 type=write size=2913458 2024-08-27T02:37:59.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.075+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=A1Q0GSWXMYZA type=del size=1055928 2024-08-27T02:37:59.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.079+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~FTQ5OB9ZJEPF.0 size=1048576 2024-08-27T02:37:59.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.083+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~FTQ5OB9ZJEPF.1 size=1048576 2024-08-27T02:37:59.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.083+0000 7f3e0cc408c0 1 < canceled part key=_multipart_OY551242R8T6.2~FTQ5OB9ZJEPF.2 size=660252 2024-08-27T02:37:59.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.087+0000 7f3e0cc408c0 1 < canceled multipart upload key=OY551242R8T6 upload=FTQ5OB9ZJEPF tag=1R1K4P67H7HG type=write size=3805980 2024-08-27T02:37:59.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~F8CO0K7PR9EI.0 size=6385 2024-08-27T02:37:59.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.095+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=F8CO0K7PR9EI tag=2LQ53S2OVBR2 type=write size=1054961 2024-08-27T02:37:59.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.099+0000 7f3e0cc408c0 1 < canceled operation key=HKDJMA7O2DFM tag=RTKLS87L0L3K type=del size=4081383 2024-08-27T02:37:59.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~BWW12VPWIG58.0 size=1048576 2024-08-27T02:37:59.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~BWW12VPWIG58.1 size=1048576 2024-08-27T02:37:59.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.111+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~BWW12VPWIG58.2 size=168319 2024-08-27T02:37:59.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.111+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=BWW12VPWIG58 tag=0XDQ2SD20MP6 type=write size=3314047 2024-08-27T02:37:59.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.115+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=R3GXENZ5EROL type=del 2024-08-27T02:37:59.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.115+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=29C8WRWNDCI4 type=write size=454109 2024-08-27T02:37:59.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~YE0CC90EJPGA.0 size=1048576 2024-08-27T02:37:59.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.123+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~YE0CC90EJPGA.1 size=213553 2024-08-27T02:37:59.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.131+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=YE0CC90EJPGA tag=E6S9ODSL80U1 type=write size=2310705 2024-08-27T02:37:59.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~U3RIRK3F1CKV.0 size=1048576 2024-08-27T02:37:59.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.139+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~U3RIRK3F1CKV.1 size=945923 2024-08-27T02:37:59.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.139+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=U3RIRK3F1CKV tag=OIVEURYHMKYS type=write size=3043075 2024-08-27T02:37:59.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.139+0000 7f3e0cc408c0 1 < canceled part key=_multipart_PLC076BXR38P.2~36LGZQ0OI66L.0 size=249158 2024-08-27T02:37:59.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.143+0000 7f3e0cc408c0 1 < canceled multipart upload key=PLC076BXR38P upload=36LGZQ0OI66L tag=EP6PHAR2D9CN type=write size=1297734 2024-08-27T02:37:59.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.147+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=HIXQPEFMGVCS type=del size=3565846 2024-08-27T02:37:59.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.151+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=KW5H6XQL42LM type=del 2024-08-27T02:37:59.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.155+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=MCVDJGYBJJW7 type=del size=3613135 2024-08-27T02:37:59.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.159+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=Q4GRCUEKMSC0 type=del 2024-08-27T02:37:59.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.163+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~WXOP0IEIBZXH.0 size=951627 2024-08-27T02:37:59.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.163+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=WXOP0IEIBZXH tag=HPA7UQTLMFOR type=write size=2000203 2024-08-27T02:37:59.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.167+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~3KF1FP6P1QAA.0 size=1048576 2024-08-27T02:37:59.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.171+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~3KF1FP6P1QAA.1 size=54297 2024-08-27T02:37:59.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.179+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=3KF1FP6P1QAA tag=U9QIK50OLP4O type=write size=2151449 2024-08-27T02:37:59.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.183+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=BCA8DU4LUANT type=del size=691270 2024-08-27T02:37:59.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.187+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=L6GTDX4K1WU4 type=del 2024-08-27T02:37:59.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.191+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=R6YSTQ1CDC2M type=del size=3041842 2024-08-27T02:37:59.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.199+0000 7f3e0cc408c0 1 < suggested update operation key=6QE1HU65GQZZ tag=6E79EGCBPCQ3 type=del size=3632062 2024-08-27T02:37:59.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~1ATP0GM6QJQA.0 size=1048576 2024-08-27T02:37:59.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.207+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~1ATP0GM6QJQA.1 size=1048576 2024-08-27T02:37:59.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.207+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~1ATP0GM6QJQA.2 size=242649 2024-08-27T02:37:59.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.207+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=1ATP0GM6QJQA tag=Q9L6EUDPSLLU type=write size=3388377 2024-08-27T02:37:59.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.211+0000 7f3e0cc408c0 1 < canceled operation key=F4MCLPFLY531 tag=YODGNEGT6LFT type=write size=769493 2024-08-27T02:37:59.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.215+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=K7EJSWO730TR type=write size=505381 2024-08-27T02:37:59.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.223+0000 7f3e0cc408c0 1 < suggested update operation key=6QE1HU65GQZZ tag=ZC5T6PPW8Y7C type=del size=2438609 2024-08-27T02:37:59.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.227+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~APJHYI8J8E32.0 size=1048576 2024-08-27T02:37:59.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.231+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~APJHYI8J8E32.1 size=255236 2024-08-27T02:37:59.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.231+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=APJHYI8J8E32 tag=DOD6D58MD5ID type=write size=2352388 2024-08-27T02:37:59.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.235+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~Y06MFHH0MS5L.0 size=1048576 2024-08-27T02:37:59.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.239+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~Y06MFHH0MS5L.1 size=1008082 2024-08-27T02:37:59.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.243+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=Y06MFHH0MS5L tag=XEPW0U36AW7B type=write size=3105234 2024-08-27T02:37:59.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.247+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=C1UZCQQ0MIDI type=del size=498013 2024-08-27T02:37:59.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.251+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=5OLS84H7H5GE type=write size=176549 2024-08-27T02:37:59.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~25IGA501ZBU8.0 size=1048576 2024-08-27T02:37:59.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~25IGA501ZBU8.1 size=494899 2024-08-27T02:37:59.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.259+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=25IGA501ZBU8 tag=8ZQPJHVI3S90 type=write size=2592051 2024-08-27T02:37:59.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.263+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=BGF09GRKHZEX type=del 2024-08-27T02:37:59.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.271+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~H44GZS3QYFZE.0 size=123464 2024-08-27T02:37:59.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.271+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=H44GZS3QYFZE tag=ACZUEMYF6YG9 type=write size=1172040 2024-08-27T02:37:59.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.275+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=A1Q0GSWXMYZA type=del 2024-08-27T02:37:59.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.275+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=TYLRX3FUP0GE type=del size=3284376 2024-08-27T02:37:59.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.279+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~F8CO0K7PR9EI.0 size=6385 2024-08-27T02:37:59.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.283+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=F8CO0K7PR9EI tag=2LQ53S2OVBR2 type=write size=1054961 2024-08-27T02:37:59.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.287+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=NCK8IZYWT5HB type=write size=21214 2024-08-27T02:37:59.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.291+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~BWW12VPWIG58.0 size=1048576 2024-08-27T02:37:59.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.295+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~BWW12VPWIG58.1 size=1048576 2024-08-27T02:37:59.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.295+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~BWW12VPWIG58.2 size=168319 2024-08-27T02:37:59.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.303+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=BWW12VPWIG58 tag=0XDQ2SD20MP6 type=write size=3314047 2024-08-27T02:37:59.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~C3URLTT0C6YN.0 size=361672 2024-08-27T02:37:59.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.307+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=C3URLTT0C6YN tag=L7515TLY05RF type=write size=1410248 2024-08-27T02:37:59.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.311+0000 7f3e0cc408c0 1 < completed write operation key=ZMN8Y0VQVHLB tag=29C8WRWNDCI4 type=write size=454109 2024-08-27T02:37:59.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~HWRDG6KIRYHL.0 size=769604 2024-08-27T02:37:59.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.315+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=HWRDG6KIRYHL tag=63MN9912WF21 type=write size=1818180 2024-08-27T02:37:59.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~U3RIRK3F1CKV.0 size=1048576 2024-08-27T02:37:59.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.323+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~U3RIRK3F1CKV.1 size=945923 2024-08-27T02:37:59.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.327+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=U3RIRK3F1CKV tag=OIVEURYHMKYS type=write size=3043075 2024-08-27T02:37:59.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.331+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=2AU3MWH932OD type=del size=2465161 2024-08-27T02:37:59.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.335+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=HIXQPEFMGVCS type=del 2024-08-27T02:37:59.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.335+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=SO7QZ6OM06ZT type=del size=2180067 2024-08-27T02:37:59.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.339+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=MCVDJGYBJJW7 type=del 2024-08-27T02:37:59.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.343+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=R1QHC630AF6D type=del size=241367 2024-08-27T02:37:59.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.347+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~WXOP0IEIBZXH.0 size=951627 2024-08-27T02:37:59.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.351+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=WXOP0IEIBZXH tag=HPA7UQTLMFOR type=write size=2000203 2024-08-27T02:37:59.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.359+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~81UG7IIRF68X.0 size=1048576 2024-08-27T02:37:59.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.359+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~81UG7IIRF68X.1 size=817701 2024-08-27T02:37:59.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.359+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=81UG7IIRF68X tag=M9RUEVEH6HVX type=write size=2914853 2024-08-27T02:37:59.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.367+0000 7f3e0cc408c0 1 < suggested remove operation key=4BV3C9MTIFT5 tag=BCA8DU4LUANT type=del 2024-08-27T02:37:59.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.375+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~GTBE30O9VYT0.0 size=1048576 2024-08-27T02:37:59.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.375+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~GTBE30O9VYT0.1 size=1048576 2024-08-27T02:37:59.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.379+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~GTBE30O9VYT0.2 size=759645 2024-08-27T02:37:59.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.379+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=GTBE30O9VYT0 tag=Q2OT4P4RZXK1 type=write size=3905373 2024-08-27T02:37:59.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.383+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=R6YSTQ1CDC2M type=del 2024-08-27T02:37:59.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.387+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=F7EPPBB31C57 type=del size=3846975 2024-08-27T02:37:59.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~1ATP0GM6QJQA.0 size=1048576 2024-08-27T02:37:59.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.391+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HTEOX3BV94K2.2~1ATP0GM6QJQA.1 size=1048576 2024-08-27T02:37:59.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~1ATP0GM6QJQA.2 size=242649 2024-08-27T02:37:59.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.399+0000 7f3e0cc408c0 1 < canceled multipart upload key=HTEOX3BV94K2 upload=1ATP0GM6QJQA tag=Q9L6EUDPSLLU type=write size=3388377 2024-08-27T02:37:59.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.403+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=7AXDAH1YB6F7 type=del size=1032941 2024-08-27T02:37:59.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.403+0000 7f3e0cc408c0 1 < canceled operation key=D7YWS7BWXT37 tag=K7EJSWO730TR type=write size=505381 2024-08-27T02:37:59.408 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.407+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=R5NHP28MGSZE type=del size=2811970 2024-08-27T02:37:59.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~APJHYI8J8E32.0 size=1048576 2024-08-27T02:37:59.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.415+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~APJHYI8J8E32.1 size=255236 2024-08-27T02:37:59.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.419+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=APJHYI8J8E32 tag=DOD6D58MD5ID type=write size=2352388 2024-08-27T02:37:59.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~18CBWRF8DBK7.0 size=1048576 2024-08-27T02:37:59.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~18CBWRF8DBK7.1 size=1048576 2024-08-27T02:37:59.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.431+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~18CBWRF8DBK7.2 size=561210 2024-08-27T02:37:59.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.431+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=18CBWRF8DBK7 tag=VURIYISC7IP0 type=write size=3706938 2024-08-27T02:37:59.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.435+0000 7f3e0cc408c0 -1 < failed to complete operation key=4BV3C9MTIFT5 tag=C1UZCQQ0MIDI type=del size=498013: (22) Invalid argument 2024-08-27T02:37:59.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.435+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=NG5VRLT3M1LQ type=del size=3393107 2024-08-27T02:37:59.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.439+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~25IGA501ZBU8.0 size=1048576 2024-08-27T02:37:59.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.443+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~25IGA501ZBU8.1 size=494899 2024-08-27T02:37:59.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.447+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=25IGA501ZBU8 tag=8ZQPJHVI3S90 type=write size=2592051 2024-08-27T02:37:59.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~FCN3XQ1TC2ZW.0 size=1048576 2024-08-27T02:37:59.454 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.455+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~FCN3XQ1TC2ZW.1 size=1048576 2024-08-27T02:37:59.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.455+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~FCN3XQ1TC2ZW.2 size=13103 2024-08-27T02:37:59.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.455+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=FCN3XQ1TC2ZW tag=PLDH3X7ZZ1JD type=write size=3158831 2024-08-27T02:37:59.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.459+0000 7f3e0cc408c0 1 < canceled part key=_multipart_HKDJMA7O2DFM.2~H44GZS3QYFZE.0 size=123464 2024-08-27T02:37:59.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.463+0000 7f3e0cc408c0 1 < canceled multipart upload key=HKDJMA7O2DFM upload=H44GZS3QYFZE tag=ACZUEMYF6YG9 type=write size=1172040 2024-08-27T02:37:59.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.467+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~OZICE0ZSJ156.0 size=84268 2024-08-27T02:37:59.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.467+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=OZICE0ZSJ156 tag=7JU7E78H86VG type=write size=1132844 2024-08-27T02:37:59.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.471+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=TYLRX3FUP0GE type=del 2024-08-27T02:37:59.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.475+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=AJINJCF6XQRM type=del size=2378092 2024-08-27T02:37:59.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.479+0000 7f3e0cc408c0 1 < completed write operation key=8VSA6T2H8FDI tag=NCK8IZYWT5HB type=write size=21214 2024-08-27T02:37:59.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.487+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~PXI648VF02Q0.0 size=1048576 2024-08-27T02:37:59.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.487+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~PXI648VF02Q0.1 size=141474 2024-08-27T02:37:59.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.487+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=PXI648VF02Q0 tag=3AJ1U9KZIZK9 type=write size=2238626 2024-08-27T02:37:59.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.491+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~C3URLTT0C6YN.0 size=361672 2024-08-27T02:37:59.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.495+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=C3URLTT0C6YN tag=L7515TLY05RF type=write size=1410248 2024-08-27T02:37:59.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.499+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=B3GUXBGI3NJ0 type=del size=2155629 2024-08-27T02:37:59.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.503+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~HWRDG6KIRYHL.0 size=769604 2024-08-27T02:37:59.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.507+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=HWRDG6KIRYHL tag=63MN9912WF21 type=write size=1818180 2024-08-27T02:37:59.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.511+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~XVMOUPGQPDOC.0 size=590875 2024-08-27T02:37:59.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.511+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=XVMOUPGQPDOC tag=BNH1WRAQZ74A type=write size=1639451 2024-08-27T02:37:59.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.515+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=2AU3MWH932OD type=del 2024-08-27T02:37:59.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.519+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=IUQK7LRQ0KE0 type=del size=2901357 2024-08-27T02:37:59.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.523+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=SO7QZ6OM06ZT type=del 2024-08-27T02:37:59.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.527+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=UB7PKE04I29I type=write size=196901 2024-08-27T02:37:59.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.531+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=R1QHC630AF6D type=del 2024-08-27T02:37:59.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~DION6YZ6GQEK.0 size=1048576 2024-08-27T02:37:59.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~DION6YZ6GQEK.1 size=1048576 2024-08-27T02:37:59.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~DION6YZ6GQEK.2 size=38567 2024-08-27T02:37:59.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.539+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=DION6YZ6GQEK tag=WJ8XH41PSGHL type=write size=3184295 2024-08-27T02:37:59.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.543+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~81UG7IIRF68X.0 size=1048576 2024-08-27T02:37:59.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.543+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~81UG7IIRF68X.1 size=817701 2024-08-27T02:37:59.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.551+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=81UG7IIRF68X tag=M9RUEVEH6HVX type=write size=2914853 2024-08-27T02:37:59.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.555+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=XP1XFPWYKWKB type=del size=3573521 2024-08-27T02:37:59.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.555+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~GTBE30O9VYT0.0 size=1048576 2024-08-27T02:37:59.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.559+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~GTBE30O9VYT0.1 size=1048576 2024-08-27T02:37:59.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.563+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~GTBE30O9VYT0.2 size=759645 2024-08-27T02:37:59.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.567+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=GTBE30O9VYT0 tag=Q2OT4P4RZXK1 type=write size=3905373 2024-08-27T02:37:59.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.571+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=ZEZ7SNS66KZS type=write size=403059 2024-08-27T02:37:59.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.571+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=F7EPPBB31C57 type=del 2024-08-27T02:37:59.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.575+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=MRDV8RG57LMJ type=del size=1396780 2024-08-27T02:37:59.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.579+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=7AXDAH1YB6F7 type=del size=1032941 2024-08-27T02:37:59.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.583+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=8MMNL0TFVGZO type=del size=3031734 2024-08-27T02:37:59.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.587+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=R5NHP28MGSZE type=del 2024-08-27T02:37:59.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.591+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~0I8GCO1K6OTT.0 size=1048576 2024-08-27T02:37:59.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.595+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~0I8GCO1K6OTT.1 size=1048576 2024-08-27T02:37:59.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.595+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~0I8GCO1K6OTT.2 size=882482 2024-08-27T02:37:59.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.595+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=0I8GCO1K6OTT tag=ZW568A63M98A type=write size=4028210 2024-08-27T02:37:59.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.599+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~18CBWRF8DBK7.0 size=1048576 2024-08-27T02:37:59.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~18CBWRF8DBK7.1 size=1048576 2024-08-27T02:37:59.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~18CBWRF8DBK7.2 size=561210 2024-08-27T02:37:59.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.607+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=18CBWRF8DBK7 tag=VURIYISC7IP0 type=write size=3706938 2024-08-27T02:37:59.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.611+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=KB3DNPV7ZTN2 type=del size=2539800 2024-08-27T02:37:59.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.615+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=NG5VRLT3M1LQ type=del 2024-08-27T02:37:59.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.619+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~3EXJPJVVTOC6.0 size=229344 2024-08-27T02:37:59.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.619+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=3EXJPJVVTOC6 tag=6T674DWX1QNJ type=write size=1277920 2024-08-27T02:37:59.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~FCN3XQ1TC2ZW.0 size=1048576 2024-08-27T02:37:59.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.623+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~FCN3XQ1TC2ZW.1 size=1048576 2024-08-27T02:37:59.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.627+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~FCN3XQ1TC2ZW.2 size=13103 2024-08-27T02:37:59.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.631+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=FCN3XQ1TC2ZW tag=PLDH3X7ZZ1JD type=write size=3158831 2024-08-27T02:37:59.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.635+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=C6TB7775K20N type=del size=3280539 2024-08-27T02:37:59.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.635+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~OZICE0ZSJ156.0 size=84268 2024-08-27T02:37:59.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.643+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=OZICE0ZSJ156 tag=7JU7E78H86VG type=write size=1132844 2024-08-27T02:37:59.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.643+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=5T1XZ8B61F2Z type=del size=2334343 2024-08-27T02:37:59.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.647+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=AJINJCF6XQRM type=del 2024-08-27T02:37:59.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~7OJA8PC4GW8W.0 size=1048576 2024-08-27T02:37:59.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~7OJA8PC4GW8W.1 size=1048576 2024-08-27T02:37:59.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.659+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~7OJA8PC4GW8W.2 size=507167 2024-08-27T02:37:59.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.659+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=7OJA8PC4GW8W tag=JH3XM7CDMS7H type=write size=3652895 2024-08-27T02:37:59.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.663+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~PXI648VF02Q0.0 size=1048576 2024-08-27T02:37:59.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.663+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~PXI648VF02Q0.1 size=141474 2024-08-27T02:37:59.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.667+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=PXI648VF02Q0 tag=3AJ1U9KZIZK9 type=write size=2238626 2024-08-27T02:37:59.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.671+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=Q12ZMIZNOX0C type=del size=2438982 2024-08-27T02:37:59.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.679+0000 7f3e0cc408c0 1 < suggested update operation key=SG9T1RD5EATR tag=B3GUXBGI3NJ0 type=del size=2155629 2024-08-27T02:37:59.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.683+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~FITRZ3CWCB5H.0 size=735669 2024-08-27T02:37:59.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.683+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=FITRZ3CWCB5H tag=VG81AJTVWUO5 type=write size=1784245 2024-08-27T02:37:59.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~XVMOUPGQPDOC.0 size=590875 2024-08-27T02:37:59.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.691+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=XVMOUPGQPDOC tag=BNH1WRAQZ74A type=write size=1639451 2024-08-27T02:37:59.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.695+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=5AYHAL9DE13B type=write size=269159 2024-08-27T02:37:59.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.699+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=IUQK7LRQ0KE0 type=del 2024-08-27T02:37:59.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.703+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~YK4S2U2S2MMN.0 size=1048576 2024-08-27T02:37:59.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.707+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~YK4S2U2S2MMN.1 size=1048576 2024-08-27T02:37:59.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.707+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~YK4S2U2S2MMN.2 size=940022 2024-08-27T02:37:59.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.707+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=YK4S2U2S2MMN tag=D5RHTA6BPDZ6 type=write size=4085750 2024-08-27T02:37:59.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.711+0000 7f3e0cc408c0 1 < canceled operation key=OY551242R8T6 tag=UB7PKE04I29I type=write size=196901 2024-08-27T02:37:59.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.715+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=3KAMNAO523AK type=del size=3655268 2024-08-27T02:37:59.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.719+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~DION6YZ6GQEK.0 size=1048576 2024-08-27T02:37:59.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.719+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~DION6YZ6GQEK.1 size=1048576 2024-08-27T02:37:59.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.719+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~DION6YZ6GQEK.2 size=38567 2024-08-27T02:37:59.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.727+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=DION6YZ6GQEK tag=WJ8XH41PSGHL type=write size=3184295 2024-08-27T02:37:59.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.727+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=F9F2354WKVRT type=del size=4154585 2024-08-27T02:37:59.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.731+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=XP1XFPWYKWKB type=del 2024-08-27T02:37:59.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.735+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~OLJAM7YJE1T0.0 size=638213 2024-08-27T02:37:59.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.735+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=OLJAM7YJE1T0 tag=O84LKRVP3MCO type=write size=1686789 2024-08-27T02:37:59.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.739+0000 7f3e0cc408c0 1 < completed write operation key=F4MCLPFLY531 tag=ZEZ7SNS66KZS type=write size=403059 2024-08-27T02:37:59.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.747+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~LZ6ZAFMTEGED.0 size=898781 2024-08-27T02:37:59.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.747+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=LZ6ZAFMTEGED tag=0ZLN857WFU98 type=write size=1947357 2024-08-27T02:37:59.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.751+0000 7f3e0cc408c0 1 < canceled operation key=0OLVDEQWBCAQ tag=MRDV8RG57LMJ type=del size=1396780 2024-08-27T02:37:59.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.751+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=HX2IOBVGVGCX type=del size=2572584 2024-08-27T02:37:59.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.755+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=8MMNL0TFVGZO type=del 2024-08-27T02:37:59.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.759+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=O7S8NRLOUHLM type=del size=2498176 2024-08-27T02:37:59.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~0I8GCO1K6OTT.0 size=1048576 2024-08-27T02:37:59.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~0I8GCO1K6OTT.1 size=1048576 2024-08-27T02:37:59.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~0I8GCO1K6OTT.2 size=882482 2024-08-27T02:37:59.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.775+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=0I8GCO1K6OTT tag=ZW568A63M98A type=write size=4028210 2024-08-27T02:37:59.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.779+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=H1XTP92Y90BJ type=del size=2321450 2024-08-27T02:37:59.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.787+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=KB3DNPV7ZTN2 type=del size=2539800 2024-08-27T02:37:59.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.787+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=KYGB837FRJ7G type=del size=230603 2024-08-27T02:37:59.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.791+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~3EXJPJVVTOC6.0 size=229344 2024-08-27T02:37:59.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.799+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=3EXJPJVVTOC6 tag=6T674DWX1QNJ type=write size=1277920 2024-08-27T02:37:59.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~27IZHZPKLFRT.0 size=1048576 2024-08-27T02:37:59.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.807+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~27IZHZPKLFRT.1 size=730710 2024-08-27T02:37:59.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.807+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=27IZHZPKLFRT tag=MEN2S0X44WPO type=write size=2827862 2024-08-27T02:37:59.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.811+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=C6TB7775K20N type=del 2024-08-27T02:37:59.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.815+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=NJD0PNI68U3G type=del size=1832994 2024-08-27T02:37:59.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.815+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=5T1XZ8B61F2Z type=del 2024-08-27T02:37:59.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~WQNNHNGXXJML.0 size=1048576 2024-08-27T02:37:59.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~WQNNHNGXXJML.1 size=1048576 2024-08-27T02:37:59.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.827+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~WQNNHNGXXJML.2 size=814860 2024-08-27T02:37:59.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.827+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=WQNNHNGXXJML tag=TFOL5F2IVAMA type=write size=3960588 2024-08-27T02:37:59.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.831+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~7OJA8PC4GW8W.0 size=1048576 2024-08-27T02:37:59.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.835+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~7OJA8PC4GW8W.1 size=1048576 2024-08-27T02:37:59.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.835+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~7OJA8PC4GW8W.2 size=507167 2024-08-27T02:37:59.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.843+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=7OJA8PC4GW8W tag=JH3XM7CDMS7H type=write size=3652895 2024-08-27T02:37:59.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.847+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=NRZ8U5INV6AZ type=del size=368577 2024-08-27T02:37:59.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.851+0000 7f3e0cc408c0 1 < canceled operation key=4SSZQK6YIL1O tag=Q12ZMIZNOX0C type=del size=2438982 2024-08-27T02:37:59.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.855+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=0F50I1J45JS5 type=del size=4009983 2024-08-27T02:37:59.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.855+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~FITRZ3CWCB5H.0 size=735669 2024-08-27T02:37:59.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.863+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=FITRZ3CWCB5H tag=VG81AJTVWUO5 type=write size=1784245 2024-08-27T02:37:59.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.867+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=5C01TPCP478G type=del size=302205 2024-08-27T02:37:59.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.871+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=5AYHAL9DE13B type=write size=269159 2024-08-27T02:37:59.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.871+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=IEYO9XR3CSTJ type=write size=581455 2024-08-27T02:37:59.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.875+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~YK4S2U2S2MMN.0 size=1048576 2024-08-27T02:37:59.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~YK4S2U2S2MMN.1 size=1048576 2024-08-27T02:37:59.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.883+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~YK4S2U2S2MMN.2 size=940022 2024-08-27T02:37:59.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.887+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=YK4S2U2S2MMN tag=D5RHTA6BPDZ6 type=write size=4085750 2024-08-27T02:37:59.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.891+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=0TYOK72KLNH1 type=write size=1034483 2024-08-27T02:37:59.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.899+0000 7f3e0cc408c0 1 < suggested update operation key=XBURHQSU6IML tag=3KAMNAO523AK type=del size=3655268 2024-08-27T02:37:59.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.903+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=EJ1CQ2WRY5V1 type=del size=1654556 2024-08-27T02:37:59.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.907+0000 7f3e0cc408c0 1 < canceled operation key=HKDJMA7O2DFM tag=F9F2354WKVRT type=del size=4154585 2024-08-27T02:37:59.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.915+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~GZJHFV3GL8IB.0 size=1048576 2024-08-27T02:37:59.916 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.915+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~GZJHFV3GL8IB.1 size=1048576 2024-08-27T02:37:59.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.919+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~GZJHFV3GL8IB.2 size=726378 2024-08-27T02:37:59.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.919+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=GZJHFV3GL8IB tag=BIIUFTWRTRO6 type=write size=3872106 2024-08-27T02:37:59.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.923+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~OLJAM7YJE1T0.0 size=638213 2024-08-27T02:37:59.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.927+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=OLJAM7YJE1T0 tag=O84LKRVP3MCO type=write size=1686789 2024-08-27T02:37:59.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.931+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=TCHEKT9LS8ZB type=del size=999336 2024-08-27T02:37:59.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.935+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~LZ6ZAFMTEGED.0 size=898781 2024-08-27T02:37:59.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.943+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=LZ6ZAFMTEGED tag=0ZLN857WFU98 type=write size=1947357 2024-08-27T02:37:59.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.943+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=2S4Q3BNTTVQY type=del size=1107171 2024-08-27T02:37:59.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.947+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=HX2IOBVGVGCX type=del 2024-08-27T02:37:59.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.951+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=8F6Z3FRUP4HD type=del size=1569472 2024-08-27T02:37:59.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.955+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=O7S8NRLOUHLM type=del 2024-08-27T02:37:59.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.959+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~UOH2ZOGTJ1H0.0 size=488832 2024-08-27T02:37:59.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.959+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=UOH2ZOGTJ1H0 tag=J24CKZMRCVAN type=write size=1537408 2024-08-27T02:37:59.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.963+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=H1XTP92Y90BJ type=del 2024-08-27T02:37:59.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~NXTVYMTW7FIG.0 size=1048576 2024-08-27T02:37:59.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.971+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~NXTVYMTW7FIG.1 size=213272 2024-08-27T02:37:59.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.971+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=NXTVYMTW7FIG tag=PE81K728DIZ2 type=write size=2310424 2024-08-27T02:37:59.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.975+0000 7f3e0cc408c0 1 < canceled operation key=6YTZJKE4V5HQ tag=KYGB837FRJ7G type=del size=230603 2024-08-27T02:37:59.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.979+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=7B1OXKGWN75O type=write size=471972 2024-08-27T02:37:59.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.979+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~27IZHZPKLFRT.0 size=1048576 2024-08-27T02:37:59.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.983+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~27IZHZPKLFRT.1 size=730710 2024-08-27T02:37:59.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.987+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=27IZHZPKLFRT tag=MEN2S0X44WPO type=write size=2827862 2024-08-27T02:37:59.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.991+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=TCZEOY1AR0HK type=del size=654829 2024-08-27T02:37:59.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.995+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=NJD0PNI68U3G type=del 2024-08-27T02:37:59.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.999+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=1GW3G744JKGQ type=write size=442929 2024-08-27T02:38:00.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:37:59.999+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~WQNNHNGXXJML.0 size=1048576 2024-08-27T02:38:00.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.003+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~WQNNHNGXXJML.1 size=1048576 2024-08-27T02:38:00.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.007+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~WQNNHNGXXJML.2 size=814860 2024-08-27T02:38:00.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.011+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=WQNNHNGXXJML tag=TFOL5F2IVAMA type=write size=3960588 2024-08-27T02:38:00.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.015+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=WGFKQTDD172R type=del size=1909659 2024-08-27T02:38:00.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.023+0000 7f3e0cc408c0 1 < suggested remove operation key=F4MCLPFLY531 tag=NRZ8U5INV6AZ type=del 2024-08-27T02:38:00.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~00F59ZNR1XCI.0 size=1048576 2024-08-27T02:38:00.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.031+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~00F59ZNR1XCI.1 size=172810 2024-08-27T02:38:00.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.031+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=00F59ZNR1XCI tag=WENGMA2DRJPL type=write size=2269962 2024-08-27T02:38:00.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.039+0000 7f3e0cc408c0 1 < suggested update operation key=2CXWPDABA9XJ tag=0F50I1J45JS5 type=del size=4009983 2024-08-27T02:38:00.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.043+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=T2C941679Z7T type=del size=3788525 2024-08-27T02:38:00.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.043+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=5C01TPCP478G type=del 2024-08-27T02:38:00.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~B70WQ005UL0Q.0 size=1048576 2024-08-27T02:38:00.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~B70WQ005UL0Q.1 size=1048576 2024-08-27T02:38:00.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.055+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~B70WQ005UL0Q.2 size=829914 2024-08-27T02:38:00.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.055+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=B70WQ005UL0Q tag=5LBVS5BRZ1CW type=write size=3975642 2024-08-27T02:38:00.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.059+0000 7f3e0cc408c0 1 < completed write operation key=IISECLYEAR19 tag=IEYO9XR3CSTJ type=write size=581455 2024-08-27T02:38:00.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.059+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=K4FTG0WR5O4F type=del size=2114822 2024-08-27T02:38:00.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.063+0000 7f3e0cc408c0 -1 < failed to complete operation key=XBURHQSU6IML tag=0TYOK72KLNH1 type=write size=1034483: (22) Invalid argument 2024-08-27T02:38:00.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.067+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=7QZA0MLF953Z type=del size=3145471 2024-08-27T02:38:00.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.071+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=EJ1CQ2WRY5V1 type=del 2024-08-27T02:38:00.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.079+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~7JI88T9QCVOD.0 size=591316 2024-08-27T02:38:00.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.079+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=7JI88T9QCVOD tag=S94AM08B5QF4 type=write size=1639892 2024-08-27T02:38:00.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.079+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~GZJHFV3GL8IB.0 size=1048576 2024-08-27T02:38:00.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.083+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~GZJHFV3GL8IB.1 size=1048576 2024-08-27T02:38:00.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.087+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~GZJHFV3GL8IB.2 size=726378 2024-08-27T02:38:00.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.091+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=GZJHFV3GL8IB tag=BIIUFTWRTRO6 type=write size=3872106 2024-08-27T02:38:00.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~9YDXEFJ4AZNL.0 size=232850 2024-08-27T02:38:00.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.095+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=9YDXEFJ4AZNL tag=OP1JB33VU0UI type=write size=1281426 2024-08-27T02:38:00.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.099+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=TCHEKT9LS8ZB type=del 2024-08-27T02:38:00.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.099+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=D8DS5WEYZMG9 type=del size=2716044 2024-08-27T02:38:00.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.103+0000 7f3e0cc408c0 1 < suggested remove operation key=0U59R3BXL181 tag=2S4Q3BNTTVQY type=del 2024-08-27T02:38:00.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.107+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=HLWWMBAHISWS type=del size=1862346 2024-08-27T02:38:00.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.111+0000 7f3e0cc408c0 1 < canceled operation key=S5ANS33DXN7X tag=8F6Z3FRUP4HD type=del size=1569472 2024-08-27T02:38:00.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.115+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~T28TJ0ZM1EOS.0 size=1048576 2024-08-27T02:38:00.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.115+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~T28TJ0ZM1EOS.1 size=650332 2024-08-27T02:38:00.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.115+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=T28TJ0ZM1EOS tag=NN98AOGV3L1T type=write size=2747484 2024-08-27T02:38:00.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~UOH2ZOGTJ1H0.0 size=488832 2024-08-27T02:38:00.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.123+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=UOH2ZOGTJ1H0 tag=J24CKZMRCVAN type=write size=1537408 2024-08-27T02:38:00.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.123+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=8HUOVPS69921 type=del size=3362429 2024-08-27T02:38:00.126 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.127+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~NXTVYMTW7FIG.0 size=1048576 2024-08-27T02:38:00.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.127+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~NXTVYMTW7FIG.1 size=213272 2024-08-27T02:38:00.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.131+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=NXTVYMTW7FIG tag=PE81K728DIZ2 type=write size=2310424 2024-08-27T02:38:00.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.135+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=0IWP0PC0FE70 type=write size=720075 2024-08-27T02:38:00.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.139+0000 7f3e0cc408c0 1 < completed write operation key=QVG1NTF6O8L2 tag=7B1OXKGWN75O type=write size=471972 2024-08-27T02:38:00.141 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.143+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~S0FXW7S64VLU.0 size=1048576 2024-08-27T02:38:00.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.143+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~S0FXW7S64VLU.1 size=1048576 2024-08-27T02:38:00.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.143+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~S0FXW7S64VLU.2 size=151452 2024-08-27T02:38:00.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.143+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=S0FXW7S64VLU tag=WJMM9AS19RCA type=write size=3297180 2024-08-27T02:38:00.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.147+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=TCZEOY1AR0HK type=del 2024-08-27T02:38:00.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.151+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~TBM6AQ0MURRZ.0 size=584449 2024-08-27T02:38:00.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.151+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=TBM6AQ0MURRZ tag=JL0R978C4QCW type=write size=1633025 2024-08-27T02:38:00.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.151+0000 7f3e0cc408c0 1 < completed write operation key=B9DPI871LQ7E tag=1GW3G744JKGQ type=write size=442929 2024-08-27T02:38:00.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.155+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=02N0NNR5IIQM type=write size=330818 2024-08-27T02:38:00.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.155+0000 7f3e0cc408c0 -1 < failed to complete operation key=F4MCLPFLY531 tag=WGFKQTDD172R type=del size=1909659: (22) Invalid argument 2024-08-27T02:38:00.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.159+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=ELY75W0XXLBS type=write size=461314 2024-08-27T02:38:00.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~00F59ZNR1XCI.0 size=1048576 2024-08-27T02:38:00.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~00F59ZNR1XCI.1 size=172810 2024-08-27T02:38:00.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.163+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=00F59ZNR1XCI tag=WENGMA2DRJPL type=write size=2269962 2024-08-27T02:38:00.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.167+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=WCIF88QHUTEQ type=del size=3460050 2024-08-27T02:38:00.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.167+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=T2C941679Z7T type=del 2024-08-27T02:38:00.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.171+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~3TV3K96R2BHZ.0 size=1048576 2024-08-27T02:38:00.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.171+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~3TV3K96R2BHZ.1 size=1048576 2024-08-27T02:38:00.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~3TV3K96R2BHZ.2 size=770927 2024-08-27T02:38:00.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.175+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=3TV3K96R2BHZ tag=DDMYKHMTXOMD type=write size=3916655 2024-08-27T02:38:00.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.175+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~B70WQ005UL0Q.0 size=1048576 2024-08-27T02:38:00.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.179+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~B70WQ005UL0Q.1 size=1048576 2024-08-27T02:38:00.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.179+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~B70WQ005UL0Q.2 size=829914 2024-08-27T02:38:00.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.183+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=B70WQ005UL0Q tag=5LBVS5BRZ1CW type=write size=3975642 2024-08-27T02:38:00.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.187+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=HJS9TU5X4QCO type=del size=1598358 2024-08-27T02:38:00.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.191+0000 7f3e0cc408c0 1 < suggested remove operation key=MNE5WNFBH9HG tag=K4FTG0WR5O4F type=del 2024-08-27T02:38:00.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.195+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=UJ6Q6WBXXAIT type=write size=630205 2024-08-27T02:38:00.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.195+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=7QZA0MLF953Z type=del 2024-08-27T02:38:00.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~KY2PQFWPALV3.0 size=1048576 2024-08-27T02:38:00.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~KY2PQFWPALV3.1 size=1048576 2024-08-27T02:38:00.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~KY2PQFWPALV3.2 size=767837 2024-08-27T02:38:00.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.203+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=KY2PQFWPALV3 tag=LJSVANT2SXWW type=write size=3913565 2024-08-27T02:38:00.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.203+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~7JI88T9QCVOD.0 size=591316 2024-08-27T02:38:00.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.207+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=7JI88T9QCVOD tag=S94AM08B5QF4 type=write size=1639892 2024-08-27T02:38:00.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.211+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=SUK9ULD8APAG type=del size=1065686 2024-08-27T02:38:00.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.211+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~9YDXEFJ4AZNL.0 size=232850 2024-08-27T02:38:00.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.215+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=9YDXEFJ4AZNL tag=OP1JB33VU0UI type=write size=1281426 2024-08-27T02:38:00.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~2GD4MLF5P309.0 size=1048576 2024-08-27T02:38:00.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~2GD4MLF5P309.1 size=1048576 2024-08-27T02:38:00.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.223+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~2GD4MLF5P309.2 size=999290 2024-08-27T02:38:00.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.223+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=2GD4MLF5P309 tag=T661B152PKLR type=write size=4145018 2024-08-27T02:38:00.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.223+0000 7f3e0cc408c0 1 < canceled operation key=XBURHQSU6IML tag=D8DS5WEYZMG9 type=del size=2716044 2024-08-27T02:38:00.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.227+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=E6O9JGEDRXBG type=del size=2516803 2024-08-27T02:38:00.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.227+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=HLWWMBAHISWS type=del 2024-08-27T02:38:00.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.231+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=40M4IR7UMT1R type=del size=1936495 2024-08-27T02:38:00.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~T28TJ0ZM1EOS.0 size=1048576 2024-08-27T02:38:00.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.235+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~T28TJ0ZM1EOS.1 size=650332 2024-08-27T02:38:00.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.239+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=T28TJ0ZM1EOS tag=NN98AOGV3L1T type=write size=2747484 2024-08-27T02:38:00.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.239+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=MBCAY2E03WMK type=del size=3720496 2024-08-27T02:38:00.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.243+0000 7f3e0cc408c0 1 < suggested remove operation key=PLC076BXR38P tag=8HUOVPS69921 type=del 2024-08-27T02:38:00.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~GGFQU9X8FXG1.0 size=1048576 2024-08-27T02:38:00.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.251+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~GGFQU9X8FXG1.1 size=37164 2024-08-27T02:38:00.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.251+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=GGFQU9X8FXG1 tag=NOGUN4D007WL type=write size=2134316 2024-08-27T02:38:00.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.251+0000 7f3e0cc408c0 1 < completed write operation key=JDV1RIGAO7J1 tag=0IWP0PC0FE70 type=write size=720075 2024-08-27T02:38:00.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.255+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~RCGAL5ZTK83L.0 size=1048576 2024-08-27T02:38:00.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~RCGAL5ZTK83L.1 size=334050 2024-08-27T02:38:00.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.259+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=RCGAL5ZTK83L tag=F53RPVS4J1SF type=write size=2431202 2024-08-27T02:38:00.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.259+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~S0FXW7S64VLU.0 size=1048576 2024-08-27T02:38:00.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.259+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~S0FXW7S64VLU.1 size=1048576 2024-08-27T02:38:00.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.263+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~S0FXW7S64VLU.2 size=151452 2024-08-27T02:38:00.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.267+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=S0FXW7S64VLU tag=WJMM9AS19RCA type=write size=3297180 2024-08-27T02:38:00.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.271+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~5OWU37TW9WVP.0 size=962257 2024-08-27T02:38:00.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.271+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=5OWU37TW9WVP tag=JE1GXZ343MXK type=write size=2010833 2024-08-27T02:38:00.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.271+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~TBM6AQ0MURRZ.0 size=584449 2024-08-27T02:38:00.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.275+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=TBM6AQ0MURRZ tag=JL0R978C4QCW type=write size=1633025 2024-08-27T02:38:00.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.279+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~3GKV14H6U4QS.0 size=1048576 2024-08-27T02:38:00.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.283+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~3GKV14H6U4QS.1 size=1048576 2024-08-27T02:38:00.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.283+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~3GKV14H6U4QS.2 size=11517 2024-08-27T02:38:00.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.283+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=3GKV14H6U4QS tag=Q4VN28GFKXUZ type=write size=3157245 2024-08-27T02:38:00.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.283+0000 7f3e0cc408c0 1 < completed write operation key=6QE1HU65GQZZ tag=02N0NNR5IIQM type=write size=330818 2024-08-27T02:38:00.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.287+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=2YRIAOC1LZPP type=del size=406282 2024-08-27T02:38:00.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.287+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=ELY75W0XXLBS type=write size=461314 2024-08-27T02:38:00.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.291+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~HJ7166G2GSMF.0 size=1048576 2024-08-27T02:38:00.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~HJ7166G2GSMF.1 size=1048576 2024-08-27T02:38:00.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~HJ7166G2GSMF.2 size=173358 2024-08-27T02:38:00.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.295+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=HJ7166G2GSMF tag=U50AAMT02BAL type=write size=3319086 2024-08-27T02:38:00.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.295+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=WCIF88QHUTEQ type=del 2024-08-27T02:38:00.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.299+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=OT1STZUT7T5F type=write size=265768 2024-08-27T02:38:00.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.299+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~3TV3K96R2BHZ.0 size=1048576 2024-08-27T02:38:00.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~3TV3K96R2BHZ.1 size=1048576 2024-08-27T02:38:00.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~3TV3K96R2BHZ.2 size=770927 2024-08-27T02:38:00.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.307+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=3TV3K96R2BHZ tag=DDMYKHMTXOMD type=write size=3916655 2024-08-27T02:38:00.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.307+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=QOKNTO5T0K6G type=write size=336654 2024-08-27T02:38:00.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.311+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=HJS9TU5X4QCO type=del 2024-08-27T02:38:00.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.311+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=SACUVJQAPCIR type=write size=157436 2024-08-27T02:38:00.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.315+0000 7f3e0cc408c0 1 < completed write operation key=KTPZGZSQCERQ tag=UJ6Q6WBXXAIT type=write size=630205 2024-08-27T02:38:00.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.315+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=64K1F76YAL0X type=del size=2269678 2024-08-27T02:38:00.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.315+0000 7f3e0cc408c0 1 < canceled part key=_multipart_4SSZQK6YIL1O.2~KY2PQFWPALV3.0 size=1048576 2024-08-27T02:38:00.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~KY2PQFWPALV3.1 size=1048576 2024-08-27T02:38:00.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~KY2PQFWPALV3.2 size=767837 2024-08-27T02:38:00.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.323+0000 7f3e0cc408c0 1 < canceled multipart upload key=4SSZQK6YIL1O upload=KY2PQFWPALV3 tag=LJSVANT2SXWW type=write size=3913565 2024-08-27T02:38:00.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~BHAZEZ0KDQEA.0 size=1048576 2024-08-27T02:38:00.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~BHAZEZ0KDQEA.1 size=1013334 2024-08-27T02:38:00.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.327+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=BHAZEZ0KDQEA tag=ZUYCN0DM0DYT type=write size=3110486 2024-08-27T02:38:00.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.331+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=SUK9ULD8APAG type=del 2024-08-27T02:38:00.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.331+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=JO0B2M2EN3R9 type=del size=896445 2024-08-27T02:38:00.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.335+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~2GD4MLF5P309.0 size=1048576 2024-08-27T02:38:00.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.335+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~2GD4MLF5P309.1 size=1048576 2024-08-27T02:38:00.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.339+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~2GD4MLF5P309.2 size=999290 2024-08-27T02:38:00.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.343+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=2GD4MLF5P309 tag=T661B152PKLR type=write size=4145018 2024-08-27T02:38:00.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.343+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=M5UV6PGTFPK7 type=del size=4153355 2024-08-27T02:38:00.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.347+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=E6O9JGEDRXBG type=del 2024-08-27T02:38:00.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.351+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=PNWR2VINORUQ type=del size=1534863 2024-08-27T02:38:00.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.351+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=40M4IR7UMT1R type=del 2024-08-27T02:38:00.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.355+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~34J5PK0T5LJL.0 size=972730 2024-08-27T02:38:00.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.355+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=34J5PK0T5LJL tag=RTVCD96ZOX02 type=write size=2021306 2024-08-27T02:38:00.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.359+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=MBCAY2E03WMK type=del 2024-08-27T02:38:00.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.363+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~34YBOTXBGH0W.0 size=1048576 2024-08-27T02:38:00.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~34YBOTXBGH0W.1 size=1048576 2024-08-27T02:38:00.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~34YBOTXBGH0W.2 size=77029 2024-08-27T02:38:00.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.367+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=34YBOTXBGH0W tag=E4QOC4L614JQ type=write size=3222757 2024-08-27T02:38:00.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~GGFQU9X8FXG1.0 size=1048576 2024-08-27T02:38:00.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~GGFQU9X8FXG1.1 size=37164 2024-08-27T02:38:00.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.375+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=GGFQU9X8FXG1 tag=NOGUN4D007WL type=write size=2134316 2024-08-27T02:38:00.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.379+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~EQJEURDINDU2.0 size=57107 2024-08-27T02:38:00.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.379+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=EQJEURDINDU2 tag=XUQUA0BGM01L type=write size=1105683 2024-08-27T02:38:00.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~RCGAL5ZTK83L.0 size=1048576 2024-08-27T02:38:00.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.383+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JLAGXRZVF50G.2~RCGAL5ZTK83L.1 size=334050 2024-08-27T02:38:00.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.383+0000 7f3e0cc408c0 1 < canceled multipart upload key=JLAGXRZVF50G upload=RCGAL5ZTK83L tag=F53RPVS4J1SF type=write size=2431202 2024-08-27T02:38:00.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.387+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=R8ICOLUCGDZ7 type=write size=613924 2024-08-27T02:38:00.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~5OWU37TW9WVP.0 size=962257 2024-08-27T02:38:00.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.391+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=5OWU37TW9WVP tag=JE1GXZ343MXK type=write size=2010833 2024-08-27T02:38:00.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.395+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~BXEWDX5RWA4Z.0 size=533222 2024-08-27T02:38:00.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.395+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=BXEWDX5RWA4Z tag=798HJLKY3JCF type=write size=1581798 2024-08-27T02:38:00.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.395+0000 7f3e0cc408c0 1 < canceled part key=_multipart_UGSWC9ZK9S7S.2~3GKV14H6U4QS.0 size=1048576 2024-08-27T02:38:00.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.399+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~3GKV14H6U4QS.1 size=1048576 2024-08-27T02:38:00.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.399+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~3GKV14H6U4QS.2 size=11517 2024-08-27T02:38:00.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.403+0000 7f3e0cc408c0 1 < canceled multipart upload key=UGSWC9ZK9S7S upload=3GKV14H6U4QS tag=Q4VN28GFKXUZ type=write size=3157245 2024-08-27T02:38:00.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.407+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~YC8X1SNV0BVK.0 size=1032234 2024-08-27T02:38:00.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.407+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=YC8X1SNV0BVK tag=E4QU3FKGKH1S type=write size=2080810 2024-08-27T02:38:00.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.411+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=2YRIAOC1LZPP type=del 2024-08-27T02:38:00.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.411+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=3BET0XFN20LZ type=write size=79296 2024-08-27T02:38:00.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.415+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~HJ7166G2GSMF.0 size=1048576 2024-08-27T02:38:00.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.415+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~HJ7166G2GSMF.1 size=1048576 2024-08-27T02:38:00.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.419+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~HJ7166G2GSMF.2 size=173358 2024-08-27T02:38:00.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.423+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=HJ7166G2GSMF tag=U50AAMT02BAL type=write size=3319086 2024-08-27T02:38:00.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~FTS146LTQCM2.0 size=1048576 2024-08-27T02:38:00.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~FTS146LTQCM2.1 size=625449 2024-08-27T02:38:00.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.427+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=FTS146LTQCM2 tag=A1Z04U1SMXO5 type=write size=2722601 2024-08-27T02:38:00.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.431+0000 7f3e0cc408c0 1 < completed write operation key=1ZIJ9JJTM4ZC tag=OT1STZUT7T5F type=write size=265768 2024-08-27T02:38:00.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.431+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=VHVA0EOO77CP type=del size=1186748 2024-08-27T02:38:00.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.435+0000 7f3e0cc408c0 1 < suggested update operation key=JLAGXRZVF50G tag=QOKNTO5T0K6G type=write size=336654 2024-08-27T02:38:00.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.439+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=XA8AKCLTJM1P type=del size=2810617 2024-08-27T02:38:00.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.439+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=SACUVJQAPCIR type=write size=157436 2024-08-27T02:38:00.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.443+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=7H2DXDNZEZN0 type=del size=3284878 2024-08-27T02:38:00.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.447+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=64K1F76YAL0X type=del size=2269678 2024-08-27T02:38:00.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~0J1GEGZ0T0S7.0 size=1048576 2024-08-27T02:38:00.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.455+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~0J1GEGZ0T0S7.1 size=1047220 2024-08-27T02:38:00.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.455+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=0J1GEGZ0T0S7 tag=6LLBKV2AKX7T type=write size=3144372 2024-08-27T02:38:00.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.455+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~BHAZEZ0KDQEA.0 size=1048576 2024-08-27T02:38:00.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.459+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~BHAZEZ0KDQEA.1 size=1013334 2024-08-27T02:38:00.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.463+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=BHAZEZ0KDQEA tag=ZUYCN0DM0DYT type=write size=3110486 2024-08-27T02:38:00.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.467+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=KBYFC2U3A4QV type=del size=3062777 2024-08-27T02:38:00.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.467+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=JO0B2M2EN3R9 type=del 2024-08-27T02:38:00.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.471+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=HWUORAVU3PZC type=del size=2022598 2024-08-27T02:38:00.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.475+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=M5UV6PGTFPK7 type=del 2024-08-27T02:38:00.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.475+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=JXGFU2QHL4X1 type=del size=3243086 2024-08-27T02:38:00.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.479+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=PNWR2VINORUQ type=del 2024-08-27T02:38:00.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.483+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=O4KNRBAIX8B5 type=del size=2959936 2024-08-27T02:38:00.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.487+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~34J5PK0T5LJL.0 size=972730 2024-08-27T02:38:00.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.487+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=34J5PK0T5LJL tag=RTVCD96ZOX02 type=write size=2021306 2024-08-27T02:38:00.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.491+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~QCPDMK3SHZU9.0 size=1048576 2024-08-27T02:38:00.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.495+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~QCPDMK3SHZU9.1 size=43391 2024-08-27T02:38:00.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.495+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=QCPDMK3SHZU9 tag=2WZ01N596D96 type=write size=2140543 2024-08-27T02:38:00.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.495+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~34YBOTXBGH0W.0 size=1048576 2024-08-27T02:38:00.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~34YBOTXBGH0W.1 size=1048576 2024-08-27T02:38:00.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~34YBOTXBGH0W.2 size=77029 2024-08-27T02:38:00.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.503+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=34YBOTXBGH0W tag=E4QOC4L614JQ type=write size=3222757 2024-08-27T02:38:00.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.503+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=FQ1SC5T15Y5L type=del size=918451 2024-08-27T02:38:00.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.507+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~EQJEURDINDU2.0 size=57107 2024-08-27T02:38:00.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.511+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=EQJEURDINDU2 tag=XUQUA0BGM01L type=write size=1105683 2024-08-27T02:38:00.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.511+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~YH4NHRJY1IO0.0 size=1048576 2024-08-27T02:38:00.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.515+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~YH4NHRJY1IO0.1 size=852465 2024-08-27T02:38:00.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.515+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=YH4NHRJY1IO0 tag=GRTEAKEGSUJ9 type=write size=2949617 2024-08-27T02:38:00.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.515+0000 7f3e0cc408c0 1 < completed write operation key=OY551242R8T6 tag=R8ICOLUCGDZ7 type=write size=613924 2024-08-27T02:38:00.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.519+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~YM7HXUC9VUSO.0 size=1048576 2024-08-27T02:38:00.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.519+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~YM7HXUC9VUSO.1 size=537914 2024-08-27T02:38:00.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.519+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=YM7HXUC9VUSO tag=K3VWPXN4LOBV type=write size=2635066 2024-08-27T02:38:00.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.523+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~BXEWDX5RWA4Z.0 size=533222 2024-08-27T02:38:00.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.523+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=BXEWDX5RWA4Z tag=798HJLKY3JCF type=write size=1581798 2024-08-27T02:38:00.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.527+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=P9UI0T0RH8BW type=del size=1109769 2024-08-27T02:38:00.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.527+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~YC8X1SNV0BVK.0 size=1032234 2024-08-27T02:38:00.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.531+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=YC8X1SNV0BVK tag=E4QU3FKGKH1S type=write size=2080810 2024-08-27T02:38:00.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.531+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=M5VCVDOKPCD3 type=del size=2666945 2024-08-27T02:38:00.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.535+0000 7f3e0cc408c0 1 < completed write operation key=A0RUXE4YL6NR tag=3BET0XFN20LZ type=write size=79296 2024-08-27T02:38:00.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~UIDMJT6PKUTO.0 size=290066 2024-08-27T02:38:00.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.539+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=UIDMJT6PKUTO tag=V748YOUBGZC8 type=write size=1338642 2024-08-27T02:38:00.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.539+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~FTS146LTQCM2.0 size=1048576 2024-08-27T02:38:00.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.539+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~FTS146LTQCM2.1 size=625449 2024-08-27T02:38:00.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.543+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=FTS146LTQCM2 tag=A1Z04U1SMXO5 type=write size=2722601 2024-08-27T02:38:00.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.547+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=PDIPM8DRTCN2 type=del size=3573297 2024-08-27T02:38:00.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.547+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=VHVA0EOO77CP type=del 2024-08-27T02:38:00.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.551+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~L7HGPBY9NUDT.0 size=263243 2024-08-27T02:38:00.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.551+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=L7HGPBY9NUDT tag=3LRHRH6DCJ1O type=write size=1311819 2024-08-27T02:38:00.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.551+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=XA8AKCLTJM1P type=del 2024-08-27T02:38:00.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.555+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=QTB4H0NU4XQM type=write size=987371 2024-08-27T02:38:00.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.555+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=7H2DXDNZEZN0 type=del 2024-08-27T02:38:00.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.559+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=EMD5F5ICS359 type=write size=487118 2024-08-27T02:38:00.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.559+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~0J1GEGZ0T0S7.0 size=1048576 2024-08-27T02:38:00.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.563+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~0J1GEGZ0T0S7.1 size=1047220 2024-08-27T02:38:00.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.563+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=0J1GEGZ0T0S7 tag=6LLBKV2AKX7T type=write size=3144372 2024-08-27T02:38:00.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.567+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=LDJJ2U1GOYA0 type=del size=2327373 2024-08-27T02:38:00.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.567+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=KBYFC2U3A4QV type=del 2024-08-27T02:38:00.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.571+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~IJDZ6SEYS480.0 size=1048576 2024-08-27T02:38:00.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.571+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~IJDZ6SEYS480.1 size=1048576 2024-08-27T02:38:00.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.575+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~IJDZ6SEYS480.2 size=213705 2024-08-27T02:38:00.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.575+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=IJDZ6SEYS480 tag=JWRT5PNOW1GR type=write size=3359433 2024-08-27T02:38:00.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.579+0000 7f3e0cc408c0 1 < suggested remove operation key=D7YWS7BWXT37 tag=HWUORAVU3PZC type=del 2024-08-27T02:38:00.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~XL33LXZ4Z4Z5.0 size=1048576 2024-08-27T02:38:00.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.583+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~XL33LXZ4Z4Z5.1 size=237466 2024-08-27T02:38:00.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.583+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=XL33LXZ4Z4Z5 tag=V7NGS1KDH6AL type=write size=2334618 2024-08-27T02:38:00.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.583+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=JXGFU2QHL4X1 type=del 2024-08-27T02:38:00.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.587+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=QS6DDTBO2ZMX type=del size=1239675 2024-08-27T02:38:00.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.587+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=O4KNRBAIX8B5 type=del 2024-08-27T02:38:00.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.591+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~GV4CCF7IG1F2.0 size=1048576 2024-08-27T02:38:00.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.595+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~GV4CCF7IG1F2.1 size=559085 2024-08-27T02:38:00.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.595+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=GV4CCF7IG1F2 tag=3RDG52UB7JFX type=write size=2656237 2024-08-27T02:38:00.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.595+0000 7f3e0cc408c0 1 < canceled part key=_multipart_VSDJU5KQLFKE.2~QCPDMK3SHZU9.0 size=1048576 2024-08-27T02:38:00.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.595+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~QCPDMK3SHZU9.1 size=43391 2024-08-27T02:38:00.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.599+0000 7f3e0cc408c0 1 < canceled multipart upload key=VSDJU5KQLFKE upload=QCPDMK3SHZU9 tag=2WZ01N596D96 type=write size=2140543 2024-08-27T02:38:00.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~Y4CXZHQL64NY.0 size=1048576 2024-08-27T02:38:00.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~Y4CXZHQL64NY.1 size=1048576 2024-08-27T02:38:00.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~Y4CXZHQL64NY.2 size=533040 2024-08-27T02:38:00.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.603+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=Y4CXZHQL64NY tag=HJYG9XSRUVDG type=write size=3678768 2024-08-27T02:38:00.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.607+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=FQ1SC5T15Y5L type=del 2024-08-27T02:38:00.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.607+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=SYVTYR5DX9U0 type=del size=3981221 2024-08-27T02:38:00.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.611+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~YH4NHRJY1IO0.0 size=1048576 2024-08-27T02:38:00.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.611+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~YH4NHRJY1IO0.1 size=852465 2024-08-27T02:38:00.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.615+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=YH4NHRJY1IO0 tag=GRTEAKEGSUJ9 type=write size=2949617 2024-08-27T02:38:00.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.619+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~9M1VQHUU9XQ9.0 size=1048576 2024-08-27T02:38:00.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.619+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~9M1VQHUU9XQ9.1 size=1048576 2024-08-27T02:38:00.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.619+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~9M1VQHUU9XQ9.2 size=586683 2024-08-27T02:38:00.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.619+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=9M1VQHUU9XQ9 tag=8T6GQWI0G7XS type=write size=3732411 2024-08-27T02:38:00.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~YM7HXUC9VUSO.0 size=1048576 2024-08-27T02:38:00.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~YM7HXUC9VUSO.1 size=537914 2024-08-27T02:38:00.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.627+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=YM7HXUC9VUSO tag=K3VWPXN4LOBV type=write size=2635066 2024-08-27T02:38:00.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.627+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=BNCKEZTNSNFK type=del size=755990 2024-08-27T02:38:00.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.631+0000 7f3e0cc408c0 -1 < failed to complete operation key=D7YWS7BWXT37 tag=P9UI0T0RH8BW type=del size=1109769: (22) Invalid argument 2024-08-27T02:38:00.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.631+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=Q90INE1YNJ7Q type=write size=722695 2024-08-27T02:38:00.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.635+0000 7f3e0cc408c0 -1 < no bi entry to suggest for operation key=D7YWS7BWXT37 tag=M5VCVDOKPCD3 type=del size=2666945: (2) No such file or directory 2024-08-27T02:38:00.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~98BG61DNFAGK.0 size=1048576 2024-08-27T02:38:00.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.639+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~98BG61DNFAGK.1 size=151638 2024-08-27T02:38:00.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.639+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=98BG61DNFAGK tag=03ZYFMJSGJLL type=write size=2248790 2024-08-27T02:38:00.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.639+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~UIDMJT6PKUTO.0 size=290066 2024-08-27T02:38:00.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.643+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=UIDMJT6PKUTO tag=V748YOUBGZC8 type=write size=1338642 2024-08-27T02:38:00.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.647+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=HS6N884296GJ type=del size=1790269 2024-08-27T02:38:00.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.647+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=PDIPM8DRTCN2 type=del 2024-08-27T02:38:00.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~VRHX38U7CLLV.0 size=1048576 2024-08-27T02:38:00.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~VRHX38U7CLLV.1 size=1048576 2024-08-27T02:38:00.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~VRHX38U7CLLV.2 size=381477 2024-08-27T02:38:00.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.655+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=VRHX38U7CLLV tag=8TU390AZMAJ3 type=write size=3527205 2024-08-27T02:38:00.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.659+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~L7HGPBY9NUDT.0 size=263243 2024-08-27T02:38:00.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.663+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=L7HGPBY9NUDT tag=3LRHRH6DCJ1O type=write size=1311819 2024-08-27T02:38:00.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.663+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=C5KTW1H9E1Z0 type=write size=6954 2024-08-27T02:38:00.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.667+0000 7f3e0cc408c0 -1 < failed to complete operation key=D7YWS7BWXT37 tag=QTB4H0NU4XQM type=write size=987371: (22) Invalid argument 2024-08-27T02:38:00.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.671+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~255L7YJ19U27.0 size=1048576 2024-08-27T02:38:00.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.671+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~255L7YJ19U27.1 size=501420 2024-08-27T02:38:00.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.671+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=255L7YJ19U27 tag=4DXIXLOU9P9W type=write size=2598572 2024-08-27T02:38:00.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.671+0000 7f3e0cc408c0 1 < completed write operation key=MNE5WNFBH9HG tag=EMD5F5ICS359 type=write size=487118 2024-08-27T02:38:00.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.675+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~6TCTX5JH8EU7.0 size=1048576 2024-08-27T02:38:00.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.679+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~6TCTX5JH8EU7.1 size=1048576 2024-08-27T02:38:00.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.679+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~6TCTX5JH8EU7.2 size=808684 2024-08-27T02:38:00.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.679+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=6TCTX5JH8EU7 tag=N6YEGH6V3OQL type=write size=3954412 2024-08-27T02:38:00.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.683+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=LDJJ2U1GOYA0 type=del 2024-08-27T02:38:00.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.683+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=UVYNGZX14VIP type=del size=1635871 2024-08-27T02:38:00.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~IJDZ6SEYS480.0 size=1048576 2024-08-27T02:38:00.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~IJDZ6SEYS480.1 size=1048576 2024-08-27T02:38:00.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.691+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~IJDZ6SEYS480.2 size=213705 2024-08-27T02:38:00.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.695+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=IJDZ6SEYS480 tag=JWRT5PNOW1GR type=write size=3359433 2024-08-27T02:38:00.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.699+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=00BVX3R1CSH4 type=del size=1917269 2024-08-27T02:38:00.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.699+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~XL33LXZ4Z4Z5.0 size=1048576 2024-08-27T02:38:00.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.703+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~XL33LXZ4Z4Z5.1 size=237466 2024-08-27T02:38:00.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.707+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=XL33LXZ4Z4Z5 tag=V7NGS1KDH6AL type=write size=2334618 2024-08-27T02:38:00.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.707+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=QT42SVPKI2JU type=del size=1116361 2024-08-27T02:38:00.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.711+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=QS6DDTBO2ZMX type=del 2024-08-27T02:38:00.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.711+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=OWR7RZMTLL2H type=del size=3451146 2024-08-27T02:38:00.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.711+0000 7f3e0cc408c0 1 < canceled part key=_multipart_S5ANS33DXN7X.2~GV4CCF7IG1F2.0 size=1048576 2024-08-27T02:38:00.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.715+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~GV4CCF7IG1F2.1 size=559085 2024-08-27T02:38:00.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.719+0000 7f3e0cc408c0 1 < canceled multipart upload key=S5ANS33DXN7X upload=GV4CCF7IG1F2 tag=3RDG52UB7JFX type=write size=2656237 2024-08-27T02:38:00.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.719+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=6X1V9CBGFQWX type=del size=3797384 2024-08-27T02:38:00.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.723+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~Y4CXZHQL64NY.0 size=1048576 2024-08-27T02:38:00.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.723+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~Y4CXZHQL64NY.1 size=1048576 2024-08-27T02:38:00.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.727+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~Y4CXZHQL64NY.2 size=533040 2024-08-27T02:38:00.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.731+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=Y4CXZHQL64NY tag=HJYG9XSRUVDG type=write size=3678768 2024-08-27T02:38:00.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.731+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=JKIYD0EQKYWY type=del size=518069 2024-08-27T02:38:00.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.735+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=SYVTYR5DX9U0 type=del 2024-08-27T02:38:00.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.735+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=QZM0MA0V52CJ type=del size=1479909 2024-08-27T02:38:00.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~9M1VQHUU9XQ9.0 size=1048576 2024-08-27T02:38:00.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~9M1VQHUU9XQ9.1 size=1048576 2024-08-27T02:38:00.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.743+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~9M1VQHUU9XQ9.2 size=586683 2024-08-27T02:38:00.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.747+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=9M1VQHUU9XQ9 tag=8T6GQWI0G7XS type=write size=3732411 2024-08-27T02:38:00.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.747+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=K7O001C5I6ET type=del size=1838052 2024-08-27T02:38:00.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.751+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=BNCKEZTNSNFK type=del 2024-08-27T02:38:00.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.751+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=P08157QWL67I type=del size=2711315 2024-08-27T02:38:00.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.759+0000 7f3e0cc408c0 1 < suggested remove operation key=QVG1NTF6O8L2 tag=Q90INE1YNJ7Q type=write 2024-08-27T02:38:00.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.759+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=51G2J9OCG6AA type=del size=1680270 2024-08-27T02:38:00.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.763+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~98BG61DNFAGK.0 size=1048576 2024-08-27T02:38:00.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.763+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~98BG61DNFAGK.1 size=151638 2024-08-27T02:38:00.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.767+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=98BG61DNFAGK tag=03ZYFMJSGJLL type=write size=2248790 2024-08-27T02:38:00.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.771+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~8VUEXT1MY39V.0 size=1048576 2024-08-27T02:38:00.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.775+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~8VUEXT1MY39V.1 size=92324 2024-08-27T02:38:00.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.775+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=8VUEXT1MY39V tag=8YOPQQKQ1DAB type=write size=2189476 2024-08-27T02:38:00.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.775+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=HS6N884296GJ type=del 2024-08-27T02:38:00.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.779+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=E0YVHWH1NPDD type=write size=146161 2024-08-27T02:38:00.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.779+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~VRHX38U7CLLV.0 size=1048576 2024-08-27T02:38:00.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.783+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~VRHX38U7CLLV.1 size=1048576 2024-08-27T02:38:00.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.783+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~VRHX38U7CLLV.2 size=381477 2024-08-27T02:38:00.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.787+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=VRHX38U7CLLV tag=8TU390AZMAJ3 type=write size=3527205 2024-08-27T02:38:00.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~PQRO7FXIY0E6.0 size=553966 2024-08-27T02:38:00.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.791+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=PQRO7FXIY0E6 tag=CW9W2ENAJTYP type=write size=1602542 2024-08-27T02:38:00.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.795+0000 7f3e0cc408c0 1 < canceled operation key=1ZIJ9JJTM4ZC tag=C5KTW1H9E1Z0 type=write size=6954 2024-08-27T02:38:00.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.799+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~3PXB0QJR2H5G.0 size=1048576 2024-08-27T02:38:00.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.799+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~3PXB0QJR2H5G.1 size=355123 2024-08-27T02:38:00.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.799+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=3PXB0QJR2H5G tag=SMZC04PWA42B type=write size=2452275 2024-08-27T02:38:00.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.803+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~255L7YJ19U27.0 size=1048576 2024-08-27T02:38:00.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.803+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~255L7YJ19U27.1 size=501420 2024-08-27T02:38:00.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.807+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=255L7YJ19U27 tag=4DXIXLOU9P9W type=write size=2598572 2024-08-27T02:38:00.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~B2GXV8LK27QH.0 size=1048576 2024-08-27T02:38:00.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.815+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~B2GXV8LK27QH.1 size=1048576 2024-08-27T02:38:00.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.815+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~B2GXV8LK27QH.2 size=451165 2024-08-27T02:38:00.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.815+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=B2GXV8LK27QH tag=8M2G0RE63N2J type=write size=3596893 2024-08-27T02:38:00.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~6TCTX5JH8EU7.0 size=1048576 2024-08-27T02:38:00.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~6TCTX5JH8EU7.1 size=1048576 2024-08-27T02:38:00.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.823+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~6TCTX5JH8EU7.2 size=808684 2024-08-27T02:38:00.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.827+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=6TCTX5JH8EU7 tag=N6YEGH6V3OQL type=write size=3954412 2024-08-27T02:38:00.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.827+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=OT51RNGCHD94 type=write size=992997 2024-08-27T02:38:00.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.831+0000 7f3e0cc408c0 1 < suggested remove operation key=MNE5WNFBH9HG tag=UVYNGZX14VIP type=del 2024-08-27T02:38:00.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.835+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=2DV3VIWB03EZ type=del size=2045035 2024-08-27T02:38:00.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.835+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=00BVX3R1CSH4 type=del 2024-08-27T02:38:00.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.839+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=57Y301VFNBJ9 type=del size=3549153 2024-08-27T02:38:00.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.839+0000 7f3e0cc408c0 -1 < failed to complete operation key=MNE5WNFBH9HG tag=QT42SVPKI2JU type=del size=1116361: (22) Invalid argument 2024-08-27T02:38:00.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.843+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=4BTGCCR0BHJO type=del size=3442194 2024-08-27T02:38:00.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.847+0000 7f3e0cc408c0 1 < suggested remove operation key=JLAGXRZVF50G tag=OWR7RZMTLL2H type=del 2024-08-27T02:38:00.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.851+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=0XH7CQIW9TZT type=del size=309663 2024-08-27T02:38:00.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.851+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=6X1V9CBGFQWX type=del 2024-08-27T02:38:00.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.859+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~52105M1LHIPB.0 size=1048576 2024-08-27T02:38:00.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~52105M1LHIPB.1 size=1048576 2024-08-27T02:38:00.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~52105M1LHIPB.2 size=1035780 2024-08-27T02:38:00.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.863+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=52105M1LHIPB tag=G5MW30AMH02D type=write size=4181508 2024-08-27T02:38:00.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.867+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=JKIYD0EQKYWY type=del 2024-08-27T02:38:00.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.867+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=T0JNDT2YY6HU type=del size=2962322 2024-08-27T02:38:00.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.871+0000 7f3e0cc408c0 1 < suggested update operation key=6QE1HU65GQZZ tag=QZM0MA0V52CJ type=del size=1479909 2024-08-27T02:38:00.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~05UT16E4Y2ZE.0 size=1048576 2024-08-27T02:38:00.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.879+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~05UT16E4Y2ZE.1 size=1048576 2024-08-27T02:38:00.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.879+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~05UT16E4Y2ZE.2 size=670094 2024-08-27T02:38:00.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.879+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=05UT16E4Y2ZE tag=DFJBA8DO8KB5 type=write size=3815822 2024-08-27T02:38:00.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.883+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=K7O001C5I6ET type=del 2024-08-27T02:38:00.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.887+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=SO5OZRPQ95YH type=del size=1085909 2024-08-27T02:38:00.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.887+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=P08157QWL67I type=del 2024-08-27T02:38:00.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.891+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=J39RQ9G0ONLB type=write size=1034662 2024-08-27T02:38:00.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.891+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=51G2J9OCG6AA type=del 2024-08-27T02:38:00.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~KBU35UX03FUI.0 size=1048576 2024-08-27T02:38:00.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~KBU35UX03FUI.1 size=1048576 2024-08-27T02:38:00.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.903+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~KBU35UX03FUI.2 size=362070 2024-08-27T02:38:00.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.903+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=KBU35UX03FUI tag=551YP0R47O1T type=write size=3507798 2024-08-27T02:38:00.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.903+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~8VUEXT1MY39V.0 size=1048576 2024-08-27T02:38:00.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.903+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JLAGXRZVF50G.2~8VUEXT1MY39V.1 size=92324 2024-08-27T02:38:00.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.907+0000 7f3e0cc408c0 1 < canceled multipart upload key=JLAGXRZVF50G upload=8VUEXT1MY39V tag=8YOPQQKQ1DAB type=write size=2189476 2024-08-27T02:38:00.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.911+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=ATULBQ696RD9 type=del size=292635 2024-08-27T02:38:00.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.915+0000 7f3e0cc408c0 1 < completed write operation key=JDV1RIGAO7J1 tag=E0YVHWH1NPDD type=write size=146161 2024-08-27T02:38:00.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.919+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=9Z435TRSXZFQ type=del size=3223447 2024-08-27T02:38:00.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.919+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~PQRO7FXIY0E6.0 size=553966 2024-08-27T02:38:00.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.927+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=PQRO7FXIY0E6 tag=CW9W2ENAJTYP type=write size=1602542 2024-08-27T02:38:00.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.927+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=3JMEI16HTKMN type=write size=586421 2024-08-27T02:38:00.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.931+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~3PXB0QJR2H5G.0 size=1048576 2024-08-27T02:38:00.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.935+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~3PXB0QJR2H5G.1 size=355123 2024-08-27T02:38:00.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.939+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=3PXB0QJR2H5G tag=SMZC04PWA42B type=write size=2452275 2024-08-27T02:38:00.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.943+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~WCO9FZXUC2AI.0 size=1048576 2024-08-27T02:38:00.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~WCO9FZXUC2AI.1 size=1048576 2024-08-27T02:38:00.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~WCO9FZXUC2AI.2 size=670533 2024-08-27T02:38:00.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.947+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=WCO9FZXUC2AI tag=5SBHC8DP8Y5Q type=write size=3816261 2024-08-27T02:38:00.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.951+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~B2GXV8LK27QH.0 size=1048576 2024-08-27T02:38:00.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~B2GXV8LK27QH.1 size=1048576 2024-08-27T02:38:00.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~B2GXV8LK27QH.2 size=451165 2024-08-27T02:38:00.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.959+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=B2GXV8LK27QH tag=8M2G0RE63N2J type=write size=3596893 2024-08-27T02:38:00.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~63ZMDUTGF6MZ.0 size=1048576 2024-08-27T02:38:00.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~63ZMDUTGF6MZ.1 size=960150 2024-08-27T02:38:00.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.967+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=63ZMDUTGF6MZ tag=XHYH5XT62ION type=write size=3057302 2024-08-27T02:38:00.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.971+0000 7f3e0cc408c0 -1 < failed to complete operation key=6QE1HU65GQZZ tag=OT51RNGCHD94 type=write size=992997: (22) Invalid argument 2024-08-27T02:38:00.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~VY2IB6B7IRJ2.0 size=184087 2024-08-27T02:38:00.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.975+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=VY2IB6B7IRJ2 tag=DVQML6C1JPNP type=write size=1232663 2024-08-27T02:38:00.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.979+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=2DV3VIWB03EZ type=del 2024-08-27T02:38:00.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.983+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~VK6SC1QUPI6L.0 size=396655 2024-08-27T02:38:00.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.983+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=VK6SC1QUPI6L tag=MF2Y81UH25KD type=write size=1445231 2024-08-27T02:38:00.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.987+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=57Y301VFNBJ9 type=del 2024-08-27T02:38:00.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.987+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=72MM65QTWUFF type=del size=3083204 2024-08-27T02:38:00.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.991+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=4BTGCCR0BHJO type=del 2024-08-27T02:38:00.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.995+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=XFY7NBCJJRLY type=del size=2791631 2024-08-27T02:38:00.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.995+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=0XH7CQIW9TZT type=del 2024-08-27T02:38:00.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.999+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=9RYJTB1FRD7N type=del size=2084071 2024-08-27T02:38:01.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:00.999+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~52105M1LHIPB.0 size=1048576 2024-08-27T02:38:01.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.003+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~52105M1LHIPB.1 size=1048576 2024-08-27T02:38:01.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.003+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~52105M1LHIPB.2 size=1035780 2024-08-27T02:38:01.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.007+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=52105M1LHIPB tag=G5MW30AMH02D type=write size=4181508 2024-08-27T02:38:01.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.011+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=1W4F8P1UYPBG type=del size=549259 2024-08-27T02:38:01.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.015+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=T0JNDT2YY6HU type=del 2024-08-27T02:38:01.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.019+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~JZETRQGOLTT6.0 size=1048576 2024-08-27T02:38:01.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.019+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~JZETRQGOLTT6.1 size=578469 2024-08-27T02:38:01.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.019+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=JZETRQGOLTT6 tag=S4B8HLQNLQ0M type=write size=2675621 2024-08-27T02:38:01.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~05UT16E4Y2ZE.0 size=1048576 2024-08-27T02:38:01.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~05UT16E4Y2ZE.1 size=1048576 2024-08-27T02:38:01.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.023+0000 7f3e0cc408c0 1 < canceled part key=_multipart_IISECLYEAR19.2~05UT16E4Y2ZE.2 size=670094 2024-08-27T02:38:01.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.027+0000 7f3e0cc408c0 1 < canceled multipart upload key=IISECLYEAR19 upload=05UT16E4Y2ZE tag=DFJBA8DO8KB5 type=write size=3815822 2024-08-27T02:38:01.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.031+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=W743YR32C5X1 type=del size=1511271 2024-08-27T02:38:01.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.035+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=SO5OZRPQ95YH type=del 2024-08-27T02:38:01.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.035+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=OJBQ21PLAVFO type=del size=271511 2024-08-27T02:38:01.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.039+0000 7f3e0cc408c0 1 < completed write operation key=O66XJ7GJMPCU tag=J39RQ9G0ONLB type=write size=1034662 2024-08-27T02:38:01.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.043+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=2DNGYU8G5EU8 type=del size=2847138 2024-08-27T02:38:01.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~KBU35UX03FUI.0 size=1048576 2024-08-27T02:38:01.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~KBU35UX03FUI.1 size=1048576 2024-08-27T02:38:01.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.051+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~KBU35UX03FUI.2 size=362070 2024-08-27T02:38:01.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.059+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=KBU35UX03FUI tag=551YP0R47O1T type=write size=3507798 2024-08-27T02:38:01.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.059+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=N2YWU6I44BCK type=del size=3522952 2024-08-27T02:38:01.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.067+0000 7f3e0cc408c0 1 < suggested remove operation key=4BV3C9MTIFT5 tag=ATULBQ696RD9 type=del 2024-08-27T02:38:01.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.071+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~EWUTJY7DYG3R.0 size=1048576 2024-08-27T02:38:01.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.075+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~EWUTJY7DYG3R.1 size=692244 2024-08-27T02:38:01.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.075+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=EWUTJY7DYG3R tag=FHDCBY230S3L type=write size=2789396 2024-08-27T02:38:01.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.075+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=9Z435TRSXZFQ type=del 2024-08-27T02:38:01.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.079+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=OXO9DUAUML2G type=del size=2115699 2024-08-27T02:38:01.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.087+0000 7f3e0cc408c0 1 < suggested remove operation key=0OLVDEQWBCAQ tag=3JMEI16HTKMN type=write 2024-08-27T02:38:01.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.087+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=9MFYTTA3A0QP type=write size=507193 2024-08-27T02:38:01.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.091+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~WCO9FZXUC2AI.0 size=1048576 2024-08-27T02:38:01.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.095+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~WCO9FZXUC2AI.1 size=1048576 2024-08-27T02:38:01.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.099+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~WCO9FZXUC2AI.2 size=670533 2024-08-27T02:38:01.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.103+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=WCO9FZXUC2AI tag=5SBHC8DP8Y5Q type=write size=3816261 2024-08-27T02:38:01.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.111+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~M505Z23MHGXR.0 size=1048576 2024-08-27T02:38:01.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.115+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~M505Z23MHGXR.1 size=940973 2024-08-27T02:38:01.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.115+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=M505Z23MHGXR tag=AWFVMQLW94HX type=write size=3038125 2024-08-27T02:38:01.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~63ZMDUTGF6MZ.0 size=1048576 2024-08-27T02:38:01.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~63ZMDUTGF6MZ.1 size=960150 2024-08-27T02:38:01.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.127+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=63ZMDUTGF6MZ tag=XHYH5XT62ION type=write size=3057302 2024-08-27T02:38:01.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.127+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=XZ9SQJ99HOLR type=del size=2566391 2024-08-27T02:38:01.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.131+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~VY2IB6B7IRJ2.0 size=184087 2024-08-27T02:38:01.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.135+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=VY2IB6B7IRJ2 tag=DVQML6C1JPNP type=write size=1232663 2024-08-27T02:38:01.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.143+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~1DG9407Z8ESD.0 size=865214 2024-08-27T02:38:01.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.143+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=1DG9407Z8ESD tag=H7WSSR5CNMIF type=write size=1913790 2024-08-27T02:38:01.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.147+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~VK6SC1QUPI6L.0 size=396655 2024-08-27T02:38:01.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.151+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=VK6SC1QUPI6L tag=MF2Y81UH25KD type=write size=1445231 2024-08-27T02:38:01.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~RCXSQ00GW6RX.0 size=1048576 2024-08-27T02:38:01.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~RCXSQ00GW6RX.1 size=1048576 2024-08-27T02:38:01.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~RCXSQ00GW6RX.2 size=765208 2024-08-27T02:38:01.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.159+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=RCXSQ00GW6RX tag=27X8J8SAX6UJ type=write size=3910936 2024-08-27T02:38:01.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.163+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=72MM65QTWUFF type=del 2024-08-27T02:38:01.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.167+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~HPW7SM224QN0.0 size=1048576 2024-08-27T02:38:01.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.171+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~HPW7SM224QN0.1 size=1048576 2024-08-27T02:38:01.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~HPW7SM224QN0.2 size=447561 2024-08-27T02:38:01.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.175+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=HPW7SM224QN0 tag=Z0NQVIVOPLHM type=write size=3593289 2024-08-27T02:38:01.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.179+0000 7f3e0cc408c0 -1 < failed to complete operation key=4BV3C9MTIFT5 tag=XFY7NBCJJRLY type=del size=2791631: (22) Invalid argument 2024-08-27T02:38:01.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.183+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~LC9YV17YNGK4.0 size=1048576 2024-08-27T02:38:01.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~LC9YV17YNGK4.1 size=329741 2024-08-27T02:38:01.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.187+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=LC9YV17YNGK4 tag=H0RMQP8F33WM type=write size=2426893 2024-08-27T02:38:01.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.187+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=9RYJTB1FRD7N type=del 2024-08-27T02:38:01.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.191+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=2O7PEA93I3HC type=write size=198928 2024-08-27T02:38:01.194 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.195+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=1W4F8P1UYPBG type=del 2024-08-27T02:38:01.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~ATHGCUR5RFC4.0 size=1048576 2024-08-27T02:38:01.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~ATHGCUR5RFC4.1 size=805973 2024-08-27T02:38:01.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.203+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=ATHGCUR5RFC4 tag=EYS7SJXGH49W type=write size=2903125 2024-08-27T02:38:01.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.207+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~JZETRQGOLTT6.0 size=1048576 2024-08-27T02:38:01.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.207+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~JZETRQGOLTT6.1 size=578469 2024-08-27T02:38:01.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.215+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=JZETRQGOLTT6 tag=S4B8HLQNLQ0M type=write size=2675621 2024-08-27T02:38:01.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.215+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=MH54N6N7B4Q1 type=write size=596324 2024-08-27T02:38:01.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.219+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=W743YR32C5X1 type=del 2024-08-27T02:38:01.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.223+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=MT7WFVEGNGD0 type=del size=4146629 2024-08-27T02:38:01.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.227+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=OJBQ21PLAVFO type=del 2024-08-27T02:38:01.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.231+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=3IF9Q07HVX0H type=del size=2766887 2024-08-27T02:38:01.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.231+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=2DNGYU8G5EU8 type=del 2024-08-27T02:38:01.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.239+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~J5RIQ6JYW45N.0 size=1048576 2024-08-27T02:38:01.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.239+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~J5RIQ6JYW45N.1 size=847935 2024-08-27T02:38:01.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.239+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=J5RIQ6JYW45N tag=YT510WSFB1BO type=write size=2945087 2024-08-27T02:38:01.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.247+0000 7f3e0cc408c0 1 < suggested remove operation key=MKB40KOOCCNT tag=N2YWU6I44BCK type=del 2024-08-27T02:38:01.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.251+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=GKJBQ1MJAKXX type=del size=1864939 2024-08-27T02:38:01.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.255+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~EWUTJY7DYG3R.0 size=1048576 2024-08-27T02:38:01.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.255+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~EWUTJY7DYG3R.1 size=692244 2024-08-27T02:38:01.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.263+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=EWUTJY7DYG3R tag=FHDCBY230S3L type=write size=2789396 2024-08-27T02:38:01.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~H0JN4FJL0N81.0 size=1048576 2024-08-27T02:38:01.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.271+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~H0JN4FJL0N81.1 size=1048576 2024-08-27T02:38:01.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.275+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~H0JN4FJL0N81.2 size=958859 2024-08-27T02:38:01.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.275+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=H0JN4FJL0N81 tag=ZTT4MREKY9J9 type=write size=4104587 2024-08-27T02:38:01.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.279+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=OXO9DUAUML2G type=del 2024-08-27T02:38:01.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.283+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~T3PN7M5DM5KX.0 size=1048576 2024-08-27T02:38:01.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.287+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~T3PN7M5DM5KX.1 size=368713 2024-08-27T02:38:01.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.287+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=T3PN7M5DM5KX tag=2TEVTJGCAWCH type=write size=2465865 2024-08-27T02:38:01.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.291+0000 7f3e0cc408c0 1 < completed write operation key=KTPZGZSQCERQ tag=9MFYTTA3A0QP type=write size=507193 2024-08-27T02:38:01.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.295+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=CAP2RHL1E100 type=del size=3070818 2024-08-27T02:38:01.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.295+0000 7f3e0cc408c0 1 < canceled part key=_multipart_IISECLYEAR19.2~M505Z23MHGXR.0 size=1048576 2024-08-27T02:38:01.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.295+0000 7f3e0cc408c0 1 < canceled part key=_multipart_IISECLYEAR19.2~M505Z23MHGXR.1 size=940973 2024-08-27T02:38:01.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.299+0000 7f3e0cc408c0 1 < canceled multipart upload key=IISECLYEAR19 upload=M505Z23MHGXR tag=AWFVMQLW94HX type=write size=3038125 2024-08-27T02:38:01.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~TG9LVWSPYJ53.0 size=1048576 2024-08-27T02:38:01.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~TG9LVWSPYJ53.1 size=366280 2024-08-27T02:38:01.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.307+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=TG9LVWSPYJ53 tag=AHG43H9ENXDA type=write size=2463432 2024-08-27T02:38:01.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.311+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=XZ9SQJ99HOLR type=del 2024-08-27T02:38:01.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~NQ9TRLWX635N.0 size=880096 2024-08-27T02:38:01.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.315+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=NQ9TRLWX635N tag=2WMO9L4H1Y8L type=write size=1928672 2024-08-27T02:38:01.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~1DG9407Z8ESD.0 size=865214 2024-08-27T02:38:01.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.327+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=1DG9407Z8ESD tag=H7WSSR5CNMIF type=write size=1913790 2024-08-27T02:38:01.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.327+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=85IX9NXZBNXO type=del size=954717 2024-08-27T02:38:01.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~RCXSQ00GW6RX.0 size=1048576 2024-08-27T02:38:01.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.335+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~RCXSQ00GW6RX.1 size=1048576 2024-08-27T02:38:01.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.335+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~RCXSQ00GW6RX.2 size=765208 2024-08-27T02:38:01.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.339+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=RCXSQ00GW6RX tag=27X8J8SAX6UJ type=write size=3910936 2024-08-27T02:38:01.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.339+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=KHPK3QL61E0M type=del size=504740 2024-08-27T02:38:01.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~HPW7SM224QN0.0 size=1048576 2024-08-27T02:38:01.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.347+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~HPW7SM224QN0.1 size=1048576 2024-08-27T02:38:01.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.347+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~HPW7SM224QN0.2 size=447561 2024-08-27T02:38:01.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.351+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=HPW7SM224QN0 tag=Z0NQVIVOPLHM type=write size=3593289 2024-08-27T02:38:01.355 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.355+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=25MIYNW33I5Q type=del size=184274 2024-08-27T02:38:01.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.359+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~LC9YV17YNGK4.0 size=1048576 2024-08-27T02:38:01.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.359+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~LC9YV17YNGK4.1 size=329741 2024-08-27T02:38:01.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.363+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=LC9YV17YNGK4 tag=H0RMQP8F33WM type=write size=2426893 2024-08-27T02:38:01.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.371+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~NTE8AE1UKY8M.0 size=1048576 2024-08-27T02:38:01.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.371+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~NTE8AE1UKY8M.1 size=924051 2024-08-27T02:38:01.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.371+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=NTE8AE1UKY8M tag=HV111UGO7O1E type=write size=3021203 2024-08-27T02:38:01.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.375+0000 7f3e0cc408c0 1 < completed write operation key=O66XJ7GJMPCU tag=2O7PEA93I3HC type=write size=198928 2024-08-27T02:38:01.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.379+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=UDTYF4ECSK3H type=del size=2064546 2024-08-27T02:38:01.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.379+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~ATHGCUR5RFC4.0 size=1048576 2024-08-27T02:38:01.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~ATHGCUR5RFC4.1 size=805973 2024-08-27T02:38:01.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.387+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=ATHGCUR5RFC4 tag=EYS7SJXGH49W type=write size=2903125 2024-08-27T02:38:01.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.395+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~4JNZELT0PTLC.0 size=1048576 2024-08-27T02:38:01.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.399+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~4JNZELT0PTLC.1 size=665461 2024-08-27T02:38:01.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.399+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=4JNZELT0PTLC tag=O21NRPC5JJPJ type=write size=2762613 2024-08-27T02:38:01.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.399+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=MH54N6N7B4Q1 type=write size=596324 2024-08-27T02:38:01.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.403+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=TFJTC0RIE572 type=del size=1835325 2024-08-27T02:38:01.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.407+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=MT7WFVEGNGD0 type=del 2024-08-27T02:38:01.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~0NCTB4SZ26H7.0 size=1048576 2024-08-27T02:38:01.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~0NCTB4SZ26H7.1 size=1048576 2024-08-27T02:38:01.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.415+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~0NCTB4SZ26H7.2 size=491685 2024-08-27T02:38:01.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.415+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=0NCTB4SZ26H7 tag=P6WB6V16TMKO type=write size=3637413 2024-08-27T02:38:01.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.419+0000 7f3e0cc408c0 1 < canceled operation key=4SSZQK6YIL1O tag=3IF9Q07HVX0H type=del size=2766887 2024-08-27T02:38:01.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.423+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~CTBA7WZ0GBAI.0 size=716036 2024-08-27T02:38:01.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.423+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=CTBA7WZ0GBAI tag=2T34BKU5CIXG type=write size=1764612 2024-08-27T02:38:01.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.423+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~J5RIQ6JYW45N.0 size=1048576 2024-08-27T02:38:01.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.427+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~J5RIQ6JYW45N.1 size=847935 2024-08-27T02:38:01.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.431+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=J5RIQ6JYW45N tag=YT510WSFB1BO type=write size=2945087 2024-08-27T02:38:01.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.435+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~Y57BVT125P8T.0 size=289869 2024-08-27T02:38:01.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.435+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=Y57BVT125P8T tag=DP7TD73QU5BY type=write size=1338445 2024-08-27T02:38:01.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.439+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=GKJBQ1MJAKXX type=del 2024-08-27T02:38:01.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.443+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=D23FYHJQ3AU5 type=del size=462429 2024-08-27T02:38:01.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.443+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~H0JN4FJL0N81.0 size=1048576 2024-08-27T02:38:01.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~H0JN4FJL0N81.1 size=1048576 2024-08-27T02:38:01.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.447+0000 7f3e0cc408c0 1 < canceled part key=_multipart_B9DPI871LQ7E.2~H0JN4FJL0N81.2 size=958859 2024-08-27T02:38:01.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.451+0000 7f3e0cc408c0 1 < canceled multipart upload key=B9DPI871LQ7E upload=H0JN4FJL0N81 tag=ZTT4MREKY9J9 type=write size=4104587 2024-08-27T02:38:01.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.455+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=S1MXQRO9O6PX type=del size=1440622 2024-08-27T02:38:01.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.459+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~T3PN7M5DM5KX.0 size=1048576 2024-08-27T02:38:01.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.463+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~T3PN7M5DM5KX.1 size=368713 2024-08-27T02:38:01.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.467+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=T3PN7M5DM5KX tag=2TEVTJGCAWCH type=write size=2465865 2024-08-27T02:38:01.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.471+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=8SDLJWTNZC8R type=del size=433793 2024-08-27T02:38:01.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.471+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=CAP2RHL1E100 type=del 2024-08-27T02:38:01.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.479+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~7W49N4FSZ4B4.0 size=242794 2024-08-27T02:38:01.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.479+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=7W49N4FSZ4B4 tag=2BJSNXMC62MA type=write size=1291370 2024-08-27T02:38:01.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.479+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~TG9LVWSPYJ53.0 size=1048576 2024-08-27T02:38:01.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.483+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~TG9LVWSPYJ53.1 size=366280 2024-08-27T02:38:01.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.487+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=TG9LVWSPYJ53 tag=AHG43H9ENXDA type=write size=2463432 2024-08-27T02:38:01.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.491+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~T78FTX3C5RS8.0 size=1048576 2024-08-27T02:38:01.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.495+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~T78FTX3C5RS8.1 size=1048576 2024-08-27T02:38:01.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.495+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~T78FTX3C5RS8.2 size=744903 2024-08-27T02:38:01.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.495+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=T78FTX3C5RS8 tag=SIW6VU59VI2D type=write size=3890631 2024-08-27T02:38:01.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~NQ9TRLWX635N.0 size=880096 2024-08-27T02:38:01.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.503+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=NQ9TRLWX635N tag=2WMO9L4H1Y8L type=write size=1928672 2024-08-27T02:38:01.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.511+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~ORIGUIEJAG1Y.0 size=639945 2024-08-27T02:38:01.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.511+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=ORIGUIEJAG1Y tag=J0V2FU9BE100 type=write size=1688521 2024-08-27T02:38:01.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.511+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=85IX9NXZBNXO type=del 2024-08-27T02:38:01.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.515+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=IZ956RNA9AA4 type=del size=1087764 2024-08-27T02:38:01.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.519+0000 7f3e0cc408c0 1 < suggested remove operation key=MKB40KOOCCNT tag=KHPK3QL61E0M type=del 2024-08-27T02:38:01.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~MKUCZBYULVXL.0 size=1048576 2024-08-27T02:38:01.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~MKUCZBYULVXL.1 size=775019 2024-08-27T02:38:01.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.527+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=MKUCZBYULVXL tag=S7GO4FFEMCZ5 type=write size=2872171 2024-08-27T02:38:01.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.531+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=25MIYNW33I5Q type=del 2024-08-27T02:38:01.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~8OIE0RHLXWA8.0 size=1048576 2024-08-27T02:38:01.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~8OIE0RHLXWA8.1 size=1048576 2024-08-27T02:38:01.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.543+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~8OIE0RHLXWA8.2 size=306848 2024-08-27T02:38:01.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.543+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=8OIE0RHLXWA8 tag=NH3NBMXV0XP4 type=write size=3452576 2024-08-27T02:38:01.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~NTE8AE1UKY8M.0 size=1048576 2024-08-27T02:38:01.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~NTE8AE1UKY8M.1 size=924051 2024-08-27T02:38:01.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.555+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=NTE8AE1UKY8M tag=HV111UGO7O1E type=write size=3021203 2024-08-27T02:38:01.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.559+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~L2T3DKMO5BKI.0 size=177332 2024-08-27T02:38:01.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.559+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=L2T3DKMO5BKI tag=6OO17XY076D9 type=write size=1225908 2024-08-27T02:38:01.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.563+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=UDTYF4ECSK3H type=del 2024-08-27T02:38:01.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.567+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=SYJM2NH9DP4F type=del size=3973222 2024-08-27T02:38:01.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.567+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~4JNZELT0PTLC.0 size=1048576 2024-08-27T02:38:01.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.567+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~4JNZELT0PTLC.1 size=665461 2024-08-27T02:38:01.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.575+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=4JNZELT0PTLC tag=O21NRPC5JJPJ type=write size=2762613 2024-08-27T02:38:01.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~KL6F5RT15YBD.0 size=1048576 2024-08-27T02:38:01.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~KL6F5RT15YBD.1 size=694809 2024-08-27T02:38:01.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.579+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=KL6F5RT15YBD tag=HPMDWNII98XY type=write size=2791961 2024-08-27T02:38:01.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.583+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=TFJTC0RIE572 type=del 2024-08-27T02:38:01.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.587+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=0P1VVXXHWUYV type=del size=3183371 2024-08-27T02:38:01.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.591+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~0NCTB4SZ26H7.0 size=1048576 2024-08-27T02:38:01.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.591+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~0NCTB4SZ26H7.1 size=1048576 2024-08-27T02:38:01.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.595+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~0NCTB4SZ26H7.2 size=491685 2024-08-27T02:38:01.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.599+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=0NCTB4SZ26H7 tag=P6WB6V16TMKO type=write size=3637413 2024-08-27T02:38:01.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.603+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=SF464ZYIIARQ type=del size=2701496 2024-08-27T02:38:01.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.603+0000 7f3e0cc408c0 1 < canceled part key=_multipart_XBURHQSU6IML.2~CTBA7WZ0GBAI.0 size=716036 2024-08-27T02:38:01.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.611+0000 7f3e0cc408c0 1 < canceled multipart upload key=XBURHQSU6IML upload=CTBA7WZ0GBAI tag=2T34BKU5CIXG type=write size=1764612 2024-08-27T02:38:01.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.611+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=3DTB0U4QKJSF type=del size=2917240 2024-08-27T02:38:01.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.615+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~Y57BVT125P8T.0 size=289869 2024-08-27T02:38:01.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.619+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=Y57BVT125P8T tag=DP7TD73QU5BY type=write size=1338445 2024-08-27T02:38:01.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~J67R2HZYC75C.0 size=1034481 2024-08-27T02:38:01.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.627+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=J67R2HZYC75C tag=1Q8E4AY66F8I type=write size=2083057 2024-08-27T02:38:01.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.627+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=D23FYHJQ3AU5 type=del 2024-08-27T02:38:01.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~RZEQI4O6S8UD.0 size=1048576 2024-08-27T02:38:01.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~RZEQI4O6S8UD.1 size=2300 2024-08-27T02:38:01.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.635+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=RZEQI4O6S8UD tag=29LO3J63QIU0 type=write size=2099452 2024-08-27T02:38:01.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.643+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=S1MXQRO9O6PX type=del 2024-08-27T02:38:01.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~KGQMWFEKNXM2.0 size=1048576 2024-08-27T02:38:01.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~KGQMWFEKNXM2.1 size=1048576 2024-08-27T02:38:01.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.651+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~KGQMWFEKNXM2.2 size=654163 2024-08-27T02:38:01.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.651+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=KGQMWFEKNXM2 tag=M05LWY6C4NVB type=write size=3799891 2024-08-27T02:38:01.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.655+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=8SDLJWTNZC8R type=del 2024-08-27T02:38:01.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.663+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~RQE3C608KRHY.0 size=763694 2024-08-27T02:38:01.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.663+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=RQE3C608KRHY tag=PJA8YQ4BDK5D type=write size=1812270 2024-08-27T02:38:01.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.667+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~7W49N4FSZ4B4.0 size=242794 2024-08-27T02:38:01.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.671+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=7W49N4FSZ4B4 tag=2BJSNXMC62MA type=write size=1291370 2024-08-27T02:38:01.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.671+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=O4792SUVZAPI type=del size=2146149 2024-08-27T02:38:01.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.675+0000 7f3e0cc408c0 1 < canceled part key=_multipart_F4MCLPFLY531.2~T78FTX3C5RS8.0 size=1048576 2024-08-27T02:38:01.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~T78FTX3C5RS8.1 size=1048576 2024-08-27T02:38:01.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.675+0000 7f3e0cc408c0 1 < canceled part key=_multipart_F4MCLPFLY531.2~T78FTX3C5RS8.2 size=744903 2024-08-27T02:38:01.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.679+0000 7f3e0cc408c0 1 < canceled multipart upload key=F4MCLPFLY531 upload=T78FTX3C5RS8 tag=SIW6VU59VI2D type=write size=3890631 2024-08-27T02:38:01.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.683+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=DJM00UXD5J21 type=write size=246699 2024-08-27T02:38:01.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~ORIGUIEJAG1Y.0 size=639945 2024-08-27T02:38:01.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.691+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=ORIGUIEJAG1Y tag=J0V2FU9BE100 type=write size=1688521 2024-08-27T02:38:01.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.695+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~78K3XLBXVUZ5.0 size=1048576 2024-08-27T02:38:01.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.699+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~78K3XLBXVUZ5.1 size=1048576 2024-08-27T02:38:01.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.703+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~78K3XLBXVUZ5.2 size=938368 2024-08-27T02:38:01.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.703+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=78K3XLBXVUZ5 tag=4U23386JSYOK type=write size=4084096 2024-08-27T02:38:01.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.703+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=IZ956RNA9AA4 type=del 2024-08-27T02:38:01.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.707+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=0TH3AVDWSC6L type=del size=1784687 2024-08-27T02:38:01.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~MKUCZBYULVXL.0 size=1048576 2024-08-27T02:38:01.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~MKUCZBYULVXL.1 size=775019 2024-08-27T02:38:01.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.719+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=MKUCZBYULVXL tag=S7GO4FFEMCZ5 type=write size=2872171 2024-08-27T02:38:01.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.723+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=6PC3X8C3R25S type=del size=3388048 2024-08-27T02:38:01.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.723+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~8OIE0RHLXWA8.0 size=1048576 2024-08-27T02:38:01.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.727+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~8OIE0RHLXWA8.1 size=1048576 2024-08-27T02:38:01.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.727+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~8OIE0RHLXWA8.2 size=306848 2024-08-27T02:38:01.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.731+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=8OIE0RHLXWA8 tag=NH3NBMXV0XP4 type=write size=3452576 2024-08-27T02:38:01.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.735+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=1DK2I4ETF9C8 type=del size=3090160 2024-08-27T02:38:01.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~L2T3DKMO5BKI.0 size=177332 2024-08-27T02:38:01.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.743+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=L2T3DKMO5BKI tag=6OO17XY076D9 type=write size=1225908 2024-08-27T02:38:01.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.747+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~M4TFV2MTL4M1.0 size=1048576 2024-08-27T02:38:01.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.751+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~M4TFV2MTL4M1.1 size=282602 2024-08-27T02:38:01.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.751+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=M4TFV2MTL4M1 tag=KZ2GO9G8G99M type=write size=2379754 2024-08-27T02:38:01.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.755+0000 7f3e0cc408c0 1 < suggested remove operation key=8VSA6T2H8FDI tag=SYJM2NH9DP4F type=del 2024-08-27T02:38:01.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~JQ0EYBLGNAXB.0 size=1048576 2024-08-27T02:38:01.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.763+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~JQ0EYBLGNAXB.1 size=902516 2024-08-27T02:38:01.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.763+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=JQ0EYBLGNAXB tag=H1SK522GFTQ6 type=write size=2999668 2024-08-27T02:38:01.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~KL6F5RT15YBD.0 size=1048576 2024-08-27T02:38:01.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~KL6F5RT15YBD.1 size=694809 2024-08-27T02:38:01.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.775+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=KL6F5RT15YBD tag=HPMDWNII98XY type=write size=2791961 2024-08-27T02:38:01.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~ADOLTLZV5AZW.0 size=417972 2024-08-27T02:38:01.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.779+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=ADOLTLZV5AZW tag=DEIO9ECVFL6T type=write size=1466548 2024-08-27T02:38:01.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.787+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=0P1VVXXHWUYV type=del size=3183371 2024-08-27T02:38:01.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~ZXG0O9H0KOKM.0 size=1048576 2024-08-27T02:38:01.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~ZXG0O9H0KOKM.1 size=1048576 2024-08-27T02:38:01.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.795+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~ZXG0O9H0KOKM.2 size=1008788 2024-08-27T02:38:01.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.795+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=ZXG0O9H0KOKM tag=EB46H4I5IOS2 type=write size=4154516 2024-08-27T02:38:01.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.799+0000 7f3e0cc408c0 1 < canceled operation key=D7YWS7BWXT37 tag=SF464ZYIIARQ type=del size=2701496 2024-08-27T02:38:01.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~CW24ZNX4SN5U.0 size=968449 2024-08-27T02:38:01.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.803+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=CW24ZNX4SN5U tag=EEUTJLU9KKGA type=write size=2017025 2024-08-27T02:38:01.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.807+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=3DTB0U4QKJSF type=del 2024-08-27T02:38:01.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.807+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=SWLLSEZS1VWZ type=del size=196365 2024-08-27T02:38:01.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.811+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~J67R2HZYC75C.0 size=1034481 2024-08-27T02:38:01.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.819+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=J67R2HZYC75C tag=1Q8E4AY66F8I type=write size=2083057 2024-08-27T02:38:01.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.819+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=O6OSLXZUN3IY type=del size=3654775 2024-08-27T02:38:01.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.823+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~RZEQI4O6S8UD.0 size=1048576 2024-08-27T02:38:01.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.827+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~RZEQI4O6S8UD.1 size=2300 2024-08-27T02:38:01.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.831+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=RZEQI4O6S8UD tag=29LO3J63QIU0 type=write size=2099452 2024-08-27T02:38:01.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.835+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=4SISNSKU11EQ type=del size=2350684 2024-08-27T02:38:01.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.835+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~KGQMWFEKNXM2.0 size=1048576 2024-08-27T02:38:01.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.839+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~KGQMWFEKNXM2.1 size=1048576 2024-08-27T02:38:01.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.839+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~KGQMWFEKNXM2.2 size=654163 2024-08-27T02:38:01.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.847+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=KGQMWFEKNXM2 tag=M05LWY6C4NVB type=write size=3799891 2024-08-27T02:38:01.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~CAVEM6S2N0LU.0 size=158121 2024-08-27T02:38:01.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.851+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=CAVEM6S2N0LU tag=7RTIJCLRX6PP type=write size=1206697 2024-08-27T02:38:01.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.855+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~RQE3C608KRHY.0 size=763694 2024-08-27T02:38:01.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.859+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=RQE3C608KRHY tag=PJA8YQ4BDK5D type=write size=1812270 2024-08-27T02:38:01.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.863+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=3UV3KOREY68O type=write size=603343 2024-08-27T02:38:01.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.867+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=O4792SUVZAPI type=del 2024-08-27T02:38:01.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.871+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~OP4KUFWXRYFH.0 size=1048576 2024-08-27T02:38:01.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~OP4KUFWXRYFH.1 size=371435 2024-08-27T02:38:01.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.875+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=OP4KUFWXRYFH tag=EZSIKJLFDRT4 type=write size=2468587 2024-08-27T02:38:01.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.879+0000 7f3e0cc408c0 1 < completed write operation key=KTPZGZSQCERQ tag=DJM00UXD5J21 type=write size=246699 2024-08-27T02:38:01.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.879+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=PD1F8UMIOVB8 type=write size=112070 2024-08-27T02:38:01.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.883+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~78K3XLBXVUZ5.0 size=1048576 2024-08-27T02:38:01.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.887+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~78K3XLBXVUZ5.1 size=1048576 2024-08-27T02:38:01.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.887+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~78K3XLBXVUZ5.2 size=938368 2024-08-27T02:38:01.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.895+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=78K3XLBXVUZ5 tag=4U23386JSYOK type=write size=4084096 2024-08-27T02:38:01.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.899+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=N28EC2DZ4DEF type=del size=3821642 2024-08-27T02:38:01.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.903+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=0TH3AVDWSC6L type=del 2024-08-27T02:38:01.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~KGIBM3H4VVDK.0 size=1048576 2024-08-27T02:38:01.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.911+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~KGIBM3H4VVDK.1 size=174945 2024-08-27T02:38:01.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.911+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=KGIBM3H4VVDK tag=OR8STKTAI5UD type=write size=2272097 2024-08-27T02:38:01.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.915+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=6PC3X8C3R25S type=del 2024-08-27T02:38:01.916 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.915+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=XLJPO7VT3051 type=del size=1895843 2024-08-27T02:38:01.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.919+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=1DK2I4ETF9C8 type=del 2024-08-27T02:38:01.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.923+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=K1RGIA54DIUF type=del size=2402508 2024-08-27T02:38:01.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.927+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~M4TFV2MTL4M1.0 size=1048576 2024-08-27T02:38:01.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.927+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~M4TFV2MTL4M1.1 size=282602 2024-08-27T02:38:01.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.935+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=M4TFV2MTL4M1 tag=KZ2GO9G8G99M type=write size=2379754 2024-08-27T02:38:01.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.943+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~4CGYVM1UYISV.0 size=1048576 2024-08-27T02:38:01.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~4CGYVM1UYISV.1 size=1048576 2024-08-27T02:38:01.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~4CGYVM1UYISV.2 size=647886 2024-08-27T02:38:01.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.947+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=4CGYVM1UYISV tag=M6WV381GQA0W type=write size=3793614 2024-08-27T02:38:01.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.951+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~JQ0EYBLGNAXB.0 size=1048576 2024-08-27T02:38:01.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~JQ0EYBLGNAXB.1 size=902516 2024-08-27T02:38:01.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.959+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=JQ0EYBLGNAXB tag=H1SK522GFTQ6 type=write size=2999668 2024-08-27T02:38:01.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.963+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=31IZ2GWALZYN type=del size=109923 2024-08-27T02:38:01.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.963+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~ADOLTLZV5AZW.0 size=417972 2024-08-27T02:38:01.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.967+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=ADOLTLZV5AZW tag=DEIO9ECVFL6T type=write size=1466548 2024-08-27T02:38:01.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~QEPP87GF3APO.0 size=1048576 2024-08-27T02:38:01.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~QEPP87GF3APO.1 size=1048576 2024-08-27T02:38:01.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~QEPP87GF3APO.2 size=365518 2024-08-27T02:38:01.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.979+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=QEPP87GF3APO tag=9FIJEIUFTD5C type=write size=3511246 2024-08-27T02:38:01.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.979+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~ZXG0O9H0KOKM.0 size=1048576 2024-08-27T02:38:01.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.983+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~ZXG0O9H0KOKM.1 size=1048576 2024-08-27T02:38:01.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.987+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~ZXG0O9H0KOKM.2 size=1008788 2024-08-27T02:38:01.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.991+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=ZXG0O9H0KOKM tag=EB46H4I5IOS2 type=write size=4154516 2024-08-27T02:38:01.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.999+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~7HA7LJN1YRKK.0 size=1048576 2024-08-27T02:38:01.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.999+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~7HA7LJN1YRKK.1 size=345209 2024-08-27T02:38:01.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:01.999+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=7HA7LJN1YRKK tag=5CJY8YEW3U1T type=write size=2442361 2024-08-27T02:38:02.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.003+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~CW24ZNX4SN5U.0 size=968449 2024-08-27T02:38:02.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.007+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=CW24ZNX4SN5U tag=EEUTJLU9KKGA type=write size=2017025 2024-08-27T02:38:02.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.011+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=LSF9DB3E76L7 type=del size=3972606 2024-08-27T02:38:02.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.015+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=SWLLSEZS1VWZ type=del 2024-08-27T02:38:02.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.019+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=7UXF15PGUMDE type=del size=1443529 2024-08-27T02:38:02.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.023+0000 7f3e0cc408c0 1 < canceled operation key=F4MCLPFLY531 tag=O6OSLXZUN3IY type=del size=3654775 2024-08-27T02:38:02.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.023+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=BKNRZPJRKTIB type=del size=1891763 2024-08-27T02:38:02.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.027+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=4SISNSKU11EQ type=del 2024-08-27T02:38:02.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.031+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=B97I3TIMZG85 type=del size=919051 2024-08-27T02:38:02.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~CAVEM6S2N0LU.0 size=158121 2024-08-27T02:38:02.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.039+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=CAVEM6S2N0LU tag=7RTIJCLRX6PP type=write size=1206697 2024-08-27T02:38:02.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.043+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=BHS4DPJFQQ52 type=write size=753335 2024-08-27T02:38:02.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.047+0000 7f3e0cc408c0 1 < completed write operation key=UGSWC9ZK9S7S tag=3UV3KOREY68O type=write size=603343 2024-08-27T02:38:02.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~DLCG5AKF8U9M.0 size=135763 2024-08-27T02:38:02.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.051+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=DLCG5AKF8U9M tag=1JZXJL69RU4Z type=write size=1184339 2024-08-27T02:38:02.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.055+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~OP4KUFWXRYFH.0 size=1048576 2024-08-27T02:38:02.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.059+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~OP4KUFWXRYFH.1 size=371435 2024-08-27T02:38:02.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.063+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=OP4KUFWXRYFH tag=EZSIKJLFDRT4 type=write size=2468587 2024-08-27T02:38:02.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.067+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~GJQQ9Y47RESY.0 size=1048576 2024-08-27T02:38:02.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.071+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~GJQQ9Y47RESY.1 size=89801 2024-08-27T02:38:02.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.071+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=GJQQ9Y47RESY tag=USH09E1I89YB type=write size=2186953 2024-08-27T02:38:02.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.075+0000 7f3e0cc408c0 1 < suggested remove operation key=4BV3C9MTIFT5 tag=PD1F8UMIOVB8 type=write 2024-08-27T02:38:02.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.079+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=7LBGJIJ4N3L1 type=del size=2582727 2024-08-27T02:38:02.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.079+0000 7f3e0cc408c0 1 < canceled operation key=6YTZJKE4V5HQ tag=N28EC2DZ4DEF type=del size=3821642 2024-08-27T02:38:02.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.083+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=3QTRDRCCGBQV type=del size=2293186 2024-08-27T02:38:02.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.083+0000 7f3e0cc408c0 1 < canceled part key=_multipart_QVG1NTF6O8L2.2~KGIBM3H4VVDK.0 size=1048576 2024-08-27T02:38:02.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.087+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~KGIBM3H4VVDK.1 size=174945 2024-08-27T02:38:02.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.091+0000 7f3e0cc408c0 1 < canceled multipart upload key=QVG1NTF6O8L2 upload=KGIBM3H4VVDK tag=OR8STKTAI5UD type=write size=2272097 2024-08-27T02:38:02.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.091+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=I077YIE3LPCS type=del size=839089 2024-08-27T02:38:02.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.095+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=XLJPO7VT3051 type=del 2024-08-27T02:38:02.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~H00TZP4R9K1K.0 size=1048576 2024-08-27T02:38:02.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~H00TZP4R9K1K.1 size=1048576 2024-08-27T02:38:02.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~H00TZP4R9K1K.2 size=728915 2024-08-27T02:38:02.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.103+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=H00TZP4R9K1K tag=HOA0FO7Y1DPC type=write size=3874643 2024-08-27T02:38:02.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.107+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=K1RGIA54DIUF type=del 2024-08-27T02:38:02.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.111+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=2X90CML2D0DX type=del size=3816202 2024-08-27T02:38:02.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.111+0000 7f3e0cc408c0 1 < canceled part key=_multipart_IISECLYEAR19.2~4CGYVM1UYISV.0 size=1048576 2024-08-27T02:38:02.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~4CGYVM1UYISV.1 size=1048576 2024-08-27T02:38:02.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~4CGYVM1UYISV.2 size=647886 2024-08-27T02:38:02.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.123+0000 7f3e0cc408c0 1 < canceled multipart upload key=IISECLYEAR19 upload=4CGYVM1UYISV tag=M6WV381GQA0W type=write size=3793614 2024-08-27T02:38:02.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~WG61W525WA6D.0 size=1048576 2024-08-27T02:38:02.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~WG61W525WA6D.1 size=1048576 2024-08-27T02:38:02.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~WG61W525WA6D.2 size=795309 2024-08-27T02:38:02.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.131+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=WG61W525WA6D tag=47ANU4DT321R type=write size=3941037 2024-08-27T02:38:02.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.135+0000 7f3e0cc408c0 1 < suggested remove operation key=KTPZGZSQCERQ tag=31IZ2GWALZYN type=del 2024-08-27T02:38:02.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.139+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=4SL378D4O8Z1 type=del size=1179996 2024-08-27T02:38:02.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.139+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~QEPP87GF3APO.0 size=1048576 2024-08-27T02:38:02.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.143+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~QEPP87GF3APO.1 size=1048576 2024-08-27T02:38:02.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.143+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~QEPP87GF3APO.2 size=365518 2024-08-27T02:38:02.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.147+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=QEPP87GF3APO tag=9FIJEIUFTD5C type=write size=3511246 2024-08-27T02:38:02.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~P2F96T1UA1LY.0 size=1048576 2024-08-27T02:38:02.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~P2F96T1UA1LY.1 size=1048576 2024-08-27T02:38:02.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.159+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~P2F96T1UA1LY.2 size=360814 2024-08-27T02:38:02.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.159+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=P2F96T1UA1LY tag=11EZ6YO8CZDC type=write size=3506542 2024-08-27T02:38:02.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.163+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~7HA7LJN1YRKK.0 size=1048576 2024-08-27T02:38:02.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.163+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~7HA7LJN1YRKK.1 size=345209 2024-08-27T02:38:02.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.171+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=7HA7LJN1YRKK tag=5CJY8YEW3U1T type=write size=2442361 2024-08-27T02:38:02.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.175+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=L21GC0KDRANM type=del size=1589559 2024-08-27T02:38:02.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.175+0000 7f3e0cc408c0 -1 < failed to complete operation key=KTPZGZSQCERQ tag=LSF9DB3E76L7 type=del size=3972606: (22) Invalid argument 2024-08-27T02:38:02.179 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.179+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=XZRUMML6M2BS type=del size=1857557 2024-08-27T02:38:02.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.183+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=7UXF15PGUMDE type=del 2024-08-27T02:38:02.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~NLGED8OLUS10.0 size=1048576 2024-08-27T02:38:02.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.191+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~NLGED8OLUS10.1 size=1048576 2024-08-27T02:38:02.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.195+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~NLGED8OLUS10.2 size=959148 2024-08-27T02:38:02.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.195+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=NLGED8OLUS10 tag=WUXZJ16H21J0 type=write size=4104876 2024-08-27T02:38:02.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.199+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=BKNRZPJRKTIB type=del 2024-08-27T02:38:02.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.203+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=SLNF3L6T53G8 type=del size=1233341 2024-08-27T02:38:02.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.203+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=B97I3TIMZG85 type=del 2024-08-27T02:38:02.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.211+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=8YTUER7D1RP5 type=del size=1692162 2024-08-27T02:38:02.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.215+0000 7f3e0cc408c0 1 < completed write operation key=MNE5WNFBH9HG tag=BHS4DPJFQQ52 type=write size=753335 2024-08-27T02:38:02.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.219+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=7D32LUMTNBYV type=del size=3105560 2024-08-27T02:38:02.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.223+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~DLCG5AKF8U9M.0 size=135763 2024-08-27T02:38:02.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.227+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=DLCG5AKF8U9M tag=1JZXJL69RU4Z type=write size=1184339 2024-08-27T02:38:02.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.231+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~SIDJLVK2CPG0.0 size=1048576 2024-08-27T02:38:02.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.235+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~SIDJLVK2CPG0.1 size=231675 2024-08-27T02:38:02.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.235+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=SIDJLVK2CPG0 tag=62EM1ZYAGOBK type=write size=2328827 2024-08-27T02:38:02.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.235+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~GJQQ9Y47RESY.0 size=1048576 2024-08-27T02:38:02.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.239+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~GJQQ9Y47RESY.1 size=89801 2024-08-27T02:38:02.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.243+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=GJQQ9Y47RESY tag=USH09E1I89YB type=write size=2186953 2024-08-27T02:38:02.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.247+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=OX1AGXPRJ8CH type=del size=2290363 2024-08-27T02:38:02.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.247+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=7LBGJIJ4N3L1 type=del 2024-08-27T02:38:02.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.251+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=D7OSHTINIU9J type=del size=4015490 2024-08-27T02:38:02.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.255+0000 7f3e0cc408c0 1 < canceled operation key=UGSWC9ZK9S7S tag=3QTRDRCCGBQV type=del size=2293186 2024-08-27T02:38:02.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~Z7C81J3R2MK2.0 size=700623 2024-08-27T02:38:02.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.259+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=Z7C81J3R2MK2 tag=RXDZ88YFHDG8 type=write size=1749199 2024-08-27T02:38:02.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.263+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=I077YIE3LPCS type=del 2024-08-27T02:38:02.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.267+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=UTIV6DDP7ILO type=del size=3865717 2024-08-27T02:38:02.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.267+0000 7f3e0cc408c0 1 < canceled part key=_multipart_UGSWC9ZK9S7S.2~H00TZP4R9K1K.0 size=1048576 2024-08-27T02:38:02.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.267+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~H00TZP4R9K1K.1 size=1048576 2024-08-27T02:38:02.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.271+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~H00TZP4R9K1K.2 size=728915 2024-08-27T02:38:02.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.275+0000 7f3e0cc408c0 1 < canceled multipart upload key=UGSWC9ZK9S7S upload=H00TZP4R9K1K tag=HOA0FO7Y1DPC type=write size=3874643 2024-08-27T02:38:02.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.279+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=P0LCUW6JL7QQ type=write size=211029 2024-08-27T02:38:02.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.279+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=2X90CML2D0DX type=del 2024-08-27T02:38:02.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.283+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=5NE6W3YISXJM type=del size=286352 2024-08-27T02:38:02.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.287+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~WG61W525WA6D.0 size=1048576 2024-08-27T02:38:02.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.287+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~WG61W525WA6D.1 size=1048576 2024-08-27T02:38:02.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.291+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~WG61W525WA6D.2 size=795309 2024-08-27T02:38:02.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.295+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=WG61W525WA6D tag=47ANU4DT321R type=write size=3941037 2024-08-27T02:38:02.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~9QCMNEW8YL69.0 size=17364 2024-08-27T02:38:02.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.299+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=9QCMNEW8YL69 tag=HFNXDP6BV1U0 type=write size=1065940 2024-08-27T02:38:02.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.303+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=4SL378D4O8Z1 type=del 2024-08-27T02:38:02.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~6XXGV83871MU.0 size=1048576 2024-08-27T02:38:02.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.311+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~6XXGV83871MU.1 size=809634 2024-08-27T02:38:02.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.311+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=6XXGV83871MU tag=I7DPGN21P3EW type=write size=2906786 2024-08-27T02:38:02.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.311+0000 7f3e0cc408c0 1 < canceled part key=_multipart_S5ANS33DXN7X.2~P2F96T1UA1LY.0 size=1048576 2024-08-27T02:38:02.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~P2F96T1UA1LY.1 size=1048576 2024-08-27T02:38:02.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.315+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~P2F96T1UA1LY.2 size=360814 2024-08-27T02:38:02.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.319+0000 7f3e0cc408c0 1 < canceled multipart upload key=S5ANS33DXN7X upload=P2F96T1UA1LY tag=11EZ6YO8CZDC type=write size=3506542 2024-08-27T02:38:02.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~HSZT1AOCXFXJ.0 size=1048576 2024-08-27T02:38:02.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~HSZT1AOCXFXJ.1 size=900978 2024-08-27T02:38:02.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.327+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=HSZT1AOCXFXJ tag=YKRO1ZCV862C type=write size=2998130 2024-08-27T02:38:02.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.331+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=L21GC0KDRANM type=del 2024-08-27T02:38:02.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.335+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=BNHYHWTFHAOJ type=del size=3659518 2024-08-27T02:38:02.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.339+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=XZRUMML6M2BS type=del 2024-08-27T02:38:02.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.339+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=QY9S6WFY9D52 type=del size=2397963 2024-08-27T02:38:02.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.343+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~NLGED8OLUS10.0 size=1048576 2024-08-27T02:38:02.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.347+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~NLGED8OLUS10.1 size=1048576 2024-08-27T02:38:02.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.347+0000 7f3e0cc408c0 1 < canceled part key=_multipart_S5ANS33DXN7X.2~NLGED8OLUS10.2 size=959148 2024-08-27T02:38:02.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.351+0000 7f3e0cc408c0 1 < canceled multipart upload key=S5ANS33DXN7X upload=NLGED8OLUS10 tag=WUXZJ16H21J0 type=write size=4104876 2024-08-27T02:38:02.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.355+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=L5HB7RWHXTTK type=del size=550554 2024-08-27T02:38:02.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.355+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=SLNF3L6T53G8 type=del 2024-08-27T02:38:02.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.363+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~H9RH27G0TE1Z.0 size=1048576 2024-08-27T02:38:02.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.363+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~H9RH27G0TE1Z.1 size=1048576 2024-08-27T02:38:02.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~H9RH27G0TE1Z.2 size=233011 2024-08-27T02:38:02.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.367+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=H9RH27G0TE1Z tag=9M40T1O0UPMQ type=write size=3378739 2024-08-27T02:38:02.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.371+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=8YTUER7D1RP5 type=del 2024-08-27T02:38:02.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.375+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~MKUSLST8JC95.0 size=828933 2024-08-27T02:38:02.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.375+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=MKUSLST8JC95 tag=GSZJJ5EM2FPZ type=write size=1877509 2024-08-27T02:38:02.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.379+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=7D32LUMTNBYV type=del 2024-08-27T02:38:02.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~P9I0I8S8QX8J.0 size=866710 2024-08-27T02:38:02.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.383+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=P9I0I8S8QX8J tag=VCVPBCLUA5C0 type=write size=1915286 2024-08-27T02:38:02.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~SIDJLVK2CPG0.0 size=1048576 2024-08-27T02:38:02.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~SIDJLVK2CPG0.1 size=231675 2024-08-27T02:38:02.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.395+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=SIDJLVK2CPG0 tag=62EM1ZYAGOBK type=write size=2328827 2024-08-27T02:38:02.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.395+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=J090Y5OEZQTE type=del size=43644 2024-08-27T02:38:02.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.399+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=OX1AGXPRJ8CH type=del 2024-08-27T02:38:02.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.403+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=WCVCMMCMY4E3 type=write size=320609 2024-08-27T02:38:02.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.407+0000 7f3e0cc408c0 1 < suggested remove operation key=F4MCLPFLY531 tag=D7OSHTINIU9J type=del 2024-08-27T02:38:02.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.411+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=01EMK47NCECS type=del size=1437465 2024-08-27T02:38:02.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~Z7C81J3R2MK2.0 size=700623 2024-08-27T02:38:02.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.419+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=Z7C81J3R2MK2 tag=RXDZ88YFHDG8 type=write size=1749199 2024-08-27T02:38:02.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.419+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=AOZM5NSI4XWO type=del size=3887944 2024-08-27T02:38:02.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.423+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=UTIV6DDP7ILO type=del 2024-08-27T02:38:02.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~DGUSKVKCMW2H.0 size=550211 2024-08-27T02:38:02.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.427+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=DGUSKVKCMW2H tag=1YRZDU0H76HW type=write size=1598787 2024-08-27T02:38:02.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.431+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=P0LCUW6JL7QQ type=write size=211029 2024-08-27T02:38:02.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.435+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~7QH6B01YWWDK.0 size=1048576 2024-08-27T02:38:02.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~7QH6B01YWWDK.1 size=1048576 2024-08-27T02:38:02.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~7QH6B01YWWDK.2 size=882340 2024-08-27T02:38:02.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.443+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=7QH6B01YWWDK tag=W731LY48IOGI type=write size=4028068 2024-08-27T02:38:02.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.443+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=5NE6W3YISXJM type=del 2024-08-27T02:38:02.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~ZOBYNYE1VQOF.0 size=1048576 2024-08-27T02:38:02.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~ZOBYNYE1VQOF.1 size=756825 2024-08-27T02:38:02.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.451+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=ZOBYNYE1VQOF tag=6SS32PV4Z9AH type=write size=2853977 2024-08-27T02:38:02.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.455+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~9QCMNEW8YL69.0 size=17364 2024-08-27T02:38:02.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.459+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=9QCMNEW8YL69 tag=HFNXDP6BV1U0 type=write size=1065940 2024-08-27T02:38:02.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.467+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~4WTHBTIGOT55.0 size=387183 2024-08-27T02:38:02.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.467+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=4WTHBTIGOT55 tag=4FCW33IEURI3 type=write size=1435759 2024-08-27T02:38:02.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.467+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~6XXGV83871MU.0 size=1048576 2024-08-27T02:38:02.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.471+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~6XXGV83871MU.1 size=809634 2024-08-27T02:38:02.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.479+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=6XXGV83871MU tag=I7DPGN21P3EW type=write size=2906786 2024-08-27T02:38:02.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.483+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~SFI90QPFRK0D.0 size=1048576 2024-08-27T02:38:02.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.483+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~SFI90QPFRK0D.1 size=1048576 2024-08-27T02:38:02.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.487+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~SFI90QPFRK0D.2 size=251004 2024-08-27T02:38:02.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.487+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=SFI90QPFRK0D tag=Q5GGS1WUAMK4 type=write size=3396732 2024-08-27T02:38:02.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.491+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~HSZT1AOCXFXJ.0 size=1048576 2024-08-27T02:38:02.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.491+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~HSZT1AOCXFXJ.1 size=900978 2024-08-27T02:38:02.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.495+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=HSZT1AOCXFXJ tag=YKRO1ZCV862C type=write size=2998130 2024-08-27T02:38:02.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.499+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=SOKIYDA38QVP type=del size=339294 2024-08-27T02:38:02.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.499+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=BNHYHWTFHAOJ type=del 2024-08-27T02:38:02.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.503+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~3EVH68HZT9YH.0 size=1048576 2024-08-27T02:38:02.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.507+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~3EVH68HZT9YH.1 size=988167 2024-08-27T02:38:02.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.507+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=3EVH68HZT9YH tag=JKAXXR1OGMNR type=write size=3085319 2024-08-27T02:38:02.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.507+0000 7f3e0cc408c0 1 < canceled operation key=O66XJ7GJMPCU tag=QY9S6WFY9D52 type=del size=2397963 2024-08-27T02:38:02.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.511+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=LBXW66TUDQVJ type=write size=777642 2024-08-27T02:38:02.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.515+0000 7f3e0cc408c0 1 < canceled operation key=0OLVDEQWBCAQ tag=L5HB7RWHXTTK type=del size=550554 2024-08-27T02:38:02.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.519+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~DNGFDTK6S9KY.0 size=1048576 2024-08-27T02:38:02.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.519+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~DNGFDTK6S9KY.1 size=1048576 2024-08-27T02:38:02.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.523+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~DNGFDTK6S9KY.2 size=517851 2024-08-27T02:38:02.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.523+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=DNGFDTK6S9KY tag=QLJOEF97M7I3 type=write size=3663579 2024-08-27T02:38:02.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.523+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~H9RH27G0TE1Z.0 size=1048576 2024-08-27T02:38:02.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.527+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~H9RH27G0TE1Z.1 size=1048576 2024-08-27T02:38:02.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.527+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~H9RH27G0TE1Z.2 size=233011 2024-08-27T02:38:02.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.531+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=H9RH27G0TE1Z tag=9M40T1O0UPMQ type=write size=3378739 2024-08-27T02:38:02.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.535+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=94O4IBD6X62P type=write size=438059 2024-08-27T02:38:02.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.535+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~MKUSLST8JC95.0 size=828933 2024-08-27T02:38:02.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.543+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=MKUSLST8JC95 tag=GSZJJ5EM2FPZ type=write size=1877509 2024-08-27T02:38:02.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.543+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=IE97BFIV393K type=del size=3446767 2024-08-27T02:38:02.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~P9I0I8S8QX8J.0 size=866710 2024-08-27T02:38:02.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.551+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=P9I0I8S8QX8J tag=VCVPBCLUA5C0 type=write size=1915286 2024-08-27T02:38:02.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.555+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=YLP6B8H9JLKN type=del size=2095157 2024-08-27T02:38:02.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.559+0000 7f3e0cc408c0 1 < suggested update operation key=1ZIJ9JJTM4ZC tag=J090Y5OEZQTE type=del size=43644 2024-08-27T02:38:02.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~8A313NFF7UQB.0 size=283926 2024-08-27T02:38:02.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.567+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=8A313NFF7UQB tag=2VJJ4BM15X25 type=write size=1332502 2024-08-27T02:38:02.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.567+0000 7f3e0cc408c0 1 < canceled operation key=4SSZQK6YIL1O tag=WCVCMMCMY4E3 type=write size=320609 2024-08-27T02:38:02.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.575+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~8I7SPCH6PWDO.0 size=1048576 2024-08-27T02:38:02.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.575+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~8I7SPCH6PWDO.1 size=553971 2024-08-27T02:38:02.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.575+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=8I7SPCH6PWDO tag=ORXTKVESLQXY type=write size=2651123 2024-08-27T02:38:02.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.579+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=01EMK47NCECS type=del 2024-08-27T02:38:02.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.583+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~CN2CTR54IC0H.0 size=1048576 2024-08-27T02:38:02.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.587+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~CN2CTR54IC0H.1 size=1048576 2024-08-27T02:38:02.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.587+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~CN2CTR54IC0H.2 size=529575 2024-08-27T02:38:02.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.587+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=CN2CTR54IC0H tag=AIS678IPLQB4 type=write size=3675303 2024-08-27T02:38:02.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.591+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=AOZM5NSI4XWO type=del 2024-08-27T02:38:02.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.595+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=55TBAY9QRPS8 type=del size=1871500 2024-08-27T02:38:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.595+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~DGUSKVKCMW2H.0 size=550211 2024-08-27T02:38:02.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.599+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=DGUSKVKCMW2H tag=1YRZDU0H76HW type=write size=1598787 2024-08-27T02:38:02.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.607+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~R6XVIM4G3DQ5.0 size=281298 2024-08-27T02:38:02.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.607+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=R6XVIM4G3DQ5 tag=8HGKDCXDKLM3 type=write size=1329874 2024-08-27T02:38:02.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~7QH6B01YWWDK.0 size=1048576 2024-08-27T02:38:02.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.607+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JLAGXRZVF50G.2~7QH6B01YWWDK.1 size=1048576 2024-08-27T02:38:02.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.611+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~7QH6B01YWWDK.2 size=882340 2024-08-27T02:38:02.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.615+0000 7f3e0cc408c0 1 < canceled multipart upload key=JLAGXRZVF50G upload=7QH6B01YWWDK tag=W731LY48IOGI type=write size=4028068 2024-08-27T02:38:02.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.615+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=T7CYAN2911BK type=del size=3711198 2024-08-27T02:38:02.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.615+0000 7f3e0cc408c0 1 < canceled part key=_multipart_VSDJU5KQLFKE.2~ZOBYNYE1VQOF.0 size=1048576 2024-08-27T02:38:02.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~ZOBYNYE1VQOF.1 size=756825 2024-08-27T02:38:02.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.623+0000 7f3e0cc408c0 1 < canceled multipart upload key=VSDJU5KQLFKE upload=ZOBYNYE1VQOF tag=6SS32PV4Z9AH type=write size=2853977 2024-08-27T02:38:02.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.627+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=L7X17QMPUNAI type=del size=3630564 2024-08-27T02:38:02.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.627+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~4WTHBTIGOT55.0 size=387183 2024-08-27T02:38:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.635+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=4WTHBTIGOT55 tag=4FCW33IEURI3 type=write size=1435759 2024-08-27T02:38:02.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.635+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=6M47LC30S80J type=del size=267582 2024-08-27T02:38:02.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.639+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~SFI90QPFRK0D.0 size=1048576 2024-08-27T02:38:02.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.643+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~SFI90QPFRK0D.1 size=1048576 2024-08-27T02:38:02.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.643+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~SFI90QPFRK0D.2 size=251004 2024-08-27T02:38:02.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.651+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=SFI90QPFRK0D tag=Q5GGS1WUAMK4 type=write size=3396732 2024-08-27T02:38:02.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.651+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=RXVPYZHH7IX3 type=write size=416038 2024-08-27T02:38:02.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.655+0000 7f3e0cc408c0 -1 < failed to complete operation key=1ZIJ9JJTM4ZC tag=SOKIYDA38QVP type=del size=339294: (22) Invalid argument 2024-08-27T02:38:02.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.659+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=YBPJYC6ZIKW6 type=del size=1736393 2024-08-27T02:38:02.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.659+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~3EVH68HZT9YH.0 size=1048576 2024-08-27T02:38:02.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.663+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~3EVH68HZT9YH.1 size=988167 2024-08-27T02:38:02.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.667+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=3EVH68HZT9YH tag=JKAXXR1OGMNR type=write size=3085319 2024-08-27T02:38:02.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.671+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~66PNGQC4TUBP.0 size=650305 2024-08-27T02:38:02.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.671+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=66PNGQC4TUBP tag=HO53MZBEBKFA type=write size=1698881 2024-08-27T02:38:02.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.679+0000 7f3e0cc408c0 1 < suggested remove operation key=O66XJ7GJMPCU tag=LBXW66TUDQVJ type=write 2024-08-27T02:38:02.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.679+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=5OR3C8MWNQ6T type=del size=3526265 2024-08-27T02:38:02.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.683+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~DNGFDTK6S9KY.0 size=1048576 2024-08-27T02:38:02.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~DNGFDTK6S9KY.1 size=1048576 2024-08-27T02:38:02.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~DNGFDTK6S9KY.2 size=517851 2024-08-27T02:38:02.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.695+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=DNGFDTK6S9KY tag=QLJOEF97M7I3 type=write size=3663579 2024-08-27T02:38:02.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.695+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=RTDDVM1TSUIF type=del size=3842340 2024-08-27T02:38:02.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.699+0000 7f3e0cc408c0 1 < completed write operation key=ZMN8Y0VQVHLB tag=94O4IBD6X62P type=write size=438059 2024-08-27T02:38:02.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.703+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=385139LSLE40 type=del size=3444681 2024-08-27T02:38:02.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.707+0000 7f3e0cc408c0 1 < suggested remove operation key=6YTZJKE4V5HQ tag=IE97BFIV393K type=del 2024-08-27T02:38:02.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.715+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~UPEPS2W44M2G.0 size=1048576 2024-08-27T02:38:02.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.715+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~UPEPS2W44M2G.1 size=839907 2024-08-27T02:38:02.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.715+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=UPEPS2W44M2G tag=3N1URE3UD13S type=write size=2937059 2024-08-27T02:38:02.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.723+0000 7f3e0cc408c0 1 < suggested update operation key=HKDJMA7O2DFM tag=YLP6B8H9JLKN type=del size=2095157 2024-08-27T02:38:02.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.727+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=KGGFRJ22HHVS type=del size=1899355 2024-08-27T02:38:02.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.727+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~8A313NFF7UQB.0 size=283926 2024-08-27T02:38:02.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.731+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=8A313NFF7UQB tag=2VJJ4BM15X25 type=write size=1332502 2024-08-27T02:38:02.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.739+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~GYVURUZ8X8HQ.0 size=120161 2024-08-27T02:38:02.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.739+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=GYVURUZ8X8HQ tag=ZQNKE89X3C6B type=write size=1168737 2024-08-27T02:38:02.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.739+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~8I7SPCH6PWDO.0 size=1048576 2024-08-27T02:38:02.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~8I7SPCH6PWDO.1 size=553971 2024-08-27T02:38:02.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.743+0000 7f3e0cc408c0 1 < canceled multipart upload key=1ZIJ9JJTM4ZC upload=8I7SPCH6PWDO tag=ORXTKVESLQXY type=write size=2651123 2024-08-27T02:38:02.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.751+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~NUP82OTJABXZ.0 size=753519 2024-08-27T02:38:02.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.751+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=NUP82OTJABXZ tag=Y3UBWE7FM7WO type=write size=1802095 2024-08-27T02:38:02.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.751+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6YTZJKE4V5HQ.2~CN2CTR54IC0H.0 size=1048576 2024-08-27T02:38:02.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.755+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~CN2CTR54IC0H.1 size=1048576 2024-08-27T02:38:02.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.755+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~CN2CTR54IC0H.2 size=529575 2024-08-27T02:38:02.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.759+0000 7f3e0cc408c0 1 < canceled multipart upload key=6YTZJKE4V5HQ upload=CN2CTR54IC0H tag=AIS678IPLQB4 type=write size=3675303 2024-08-27T02:38:02.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~DOSUN3V59UTB.0 size=1048576 2024-08-27T02:38:02.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~DOSUN3V59UTB.1 size=1048576 2024-08-27T02:38:02.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.771+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~DOSUN3V59UTB.2 size=1015489 2024-08-27T02:38:02.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.771+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=DOSUN3V59UTB tag=UCBMYERNULX7 type=write size=4161217 2024-08-27T02:38:02.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.775+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=55TBAY9QRPS8 type=del 2024-08-27T02:38:02.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.775+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=XL5V9EGVAXQZ type=write size=184922 2024-08-27T02:38:02.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.779+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~R6XVIM4G3DQ5.0 size=281298 2024-08-27T02:38:02.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.783+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=R6XVIM4G3DQ5 tag=8HGKDCXDKLM3 type=write size=1329874 2024-08-27T02:38:02.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.787+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=5NN0AAX1D1FB type=del size=3590741 2024-08-27T02:38:02.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.787+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=T7CYAN2911BK type=del 2024-08-27T02:38:02.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.791+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=O91L62DZNG4C type=del size=1644735 2024-08-27T02:38:02.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.791+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=L7X17QMPUNAI type=del 2024-08-27T02:38:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.799+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~QMYO1LSP07RC.0 size=159828 2024-08-27T02:38:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.799+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=QMYO1LSP07RC tag=C0C7T6PUSKH3 type=write size=1208404 2024-08-27T02:38:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.799+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=6M47LC30S80J type=del 2024-08-27T02:38:02.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~43FQY5N55GJI.0 size=1048576 2024-08-27T02:38:02.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.807+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~43FQY5N55GJI.1 size=867567 2024-08-27T02:38:02.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.807+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=43FQY5N55GJI tag=S85GMDAIX4NQ type=write size=2964719 2024-08-27T02:38:02.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.807+0000 7f3e0cc408c0 1 < completed write operation key=QVG1NTF6O8L2 tag=RXVPYZHH7IX3 type=write size=416038 2024-08-27T02:38:02.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~H77IZKYLDW1K.0 size=893750 2024-08-27T02:38:02.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.811+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=H77IZKYLDW1K tag=EF4WQCJ6RWF9 type=write size=1942326 2024-08-27T02:38:02.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.815+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=YBPJYC6ZIKW6 type=del 2024-08-27T02:38:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.815+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=W7708WLOQ7PG type=del size=3962298 2024-08-27T02:38:02.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~66PNGQC4TUBP.0 size=650305 2024-08-27T02:38:02.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.823+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=66PNGQC4TUBP tag=HO53MZBEBKFA type=write size=1698881 2024-08-27T02:38:02.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.827+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~WZYF6FKAYYZH.0 size=1048576 2024-08-27T02:38:02.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.827+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~WZYF6FKAYYZH.1 size=1048576 2024-08-27T02:38:02.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.831+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~WZYF6FKAYYZH.2 size=326975 2024-08-27T02:38:02.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.831+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=WZYF6FKAYYZH tag=21A4Z3IABVN1 type=write size=3472703 2024-08-27T02:38:02.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.835+0000 7f3e0cc408c0 1 < suggested remove operation key=D7YWS7BWXT37 tag=5OR3C8MWNQ6T type=del 2024-08-27T02:38:02.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.835+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=O4FULHMZ9GNV type=del size=1320899 2024-08-27T02:38:02.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.839+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=RTDDVM1TSUIF type=del 2024-08-27T02:38:02.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.843+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~2RLPJ4U8VQ42.0 size=1048576 2024-08-27T02:38:02.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.847+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~2RLPJ4U8VQ42.1 size=669765 2024-08-27T02:38:02.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.847+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=2RLPJ4U8VQ42 tag=4W06TD0QV28S type=write size=2766917 2024-08-27T02:38:02.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.847+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=385139LSLE40 type=del 2024-08-27T02:38:02.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.851+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=VJZAGXDZFZZK type=del size=3993950 2024-08-27T02:38:02.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~UPEPS2W44M2G.0 size=1048576 2024-08-27T02:38:02.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.855+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~UPEPS2W44M2G.1 size=839907 2024-08-27T02:38:02.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.859+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=UPEPS2W44M2G tag=3N1URE3UD13S type=write size=2937059 2024-08-27T02:38:02.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~WQRMA0DCNA40.0 size=1048576 2024-08-27T02:38:02.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~WQRMA0DCNA40.1 size=994771 2024-08-27T02:38:02.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.863+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=WQRMA0DCNA40 tag=V40F0IAW40DB type=write size=3091923 2024-08-27T02:38:02.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.867+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=KGGFRJ22HHVS type=del 2024-08-27T02:38:02.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.871+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=7TMIP36PX3GF type=del size=170114 2024-08-27T02:38:02.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.871+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~GYVURUZ8X8HQ.0 size=120161 2024-08-27T02:38:02.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.875+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=GYVURUZ8X8HQ tag=ZQNKE89X3C6B type=write size=1168737 2024-08-27T02:38:02.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.879+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=ZIP1F1OWN8VQ type=del size=2363209 2024-08-27T02:38:02.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.879+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~NUP82OTJABXZ.0 size=753519 2024-08-27T02:38:02.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.883+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=NUP82OTJABXZ tag=Y3UBWE7FM7WO type=write size=1802095 2024-08-27T02:38:02.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.887+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~UQ5IOLHT9F11.0 size=1048576 2024-08-27T02:38:02.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.891+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~UQ5IOLHT9F11.1 size=371400 2024-08-27T02:38:02.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.891+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=UQ5IOLHT9F11 tag=47GCUFJZWUP6 type=write size=2468552 2024-08-27T02:38:02.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.895+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~DOSUN3V59UTB.0 size=1048576 2024-08-27T02:38:02.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.895+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~DOSUN3V59UTB.1 size=1048576 2024-08-27T02:38:02.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.899+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~DOSUN3V59UTB.2 size=1015489 2024-08-27T02:38:02.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.903+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=DOSUN3V59UTB tag=UCBMYERNULX7 type=write size=4161217 2024-08-27T02:38:02.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.907+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=4ENF3NXOPFY2 type=write size=16321 2024-08-27T02:38:02.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.915+0000 7f3e0cc408c0 1 < suggested remove operation key=SG9T1RD5EATR tag=XL5V9EGVAXQZ type=write 2024-08-27T02:38:02.916 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.915+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=K1109IWTXGWA type=del size=1647762 2024-08-27T02:38:02.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.919+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=5NN0AAX1D1FB type=del 2024-08-27T02:38:02.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.923+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=VOV24M8K0BBF type=del size=1117799 2024-08-27T02:38:02.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.927+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=O91L62DZNG4C type=del 2024-08-27T02:38:02.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.931+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~JHNOJPA35Z7Z.0 size=1048576 2024-08-27T02:38:02.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.931+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~JHNOJPA35Z7Z.1 size=1048576 2024-08-27T02:38:02.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~JHNOJPA35Z7Z.2 size=607100 2024-08-27T02:38:02.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.935+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=JHNOJPA35Z7Z tag=D0ZSFF7PH0LJ type=write size=3752828 2024-08-27T02:38:02.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.939+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~QMYO1LSP07RC.0 size=159828 2024-08-27T02:38:02.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.943+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=QMYO1LSP07RC tag=C0C7T6PUSKH3 type=write size=1208404 2024-08-27T02:38:02.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.947+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=3UTUF26JKT8F type=del size=3826552 2024-08-27T02:38:02.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.947+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~43FQY5N55GJI.0 size=1048576 2024-08-27T02:38:02.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.951+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~43FQY5N55GJI.1 size=867567 2024-08-27T02:38:02.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.955+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=43FQY5N55GJI tag=S85GMDAIX4NQ type=write size=2964719 2024-08-27T02:38:02.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.959+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=MWE6UDL9VVBO type=del size=2258868 2024-08-27T02:38:02.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.963+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~H77IZKYLDW1K.0 size=893750 2024-08-27T02:38:02.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.971+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=H77IZKYLDW1K tag=EF4WQCJ6RWF9 type=write size=1942326 2024-08-27T02:38:02.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.975+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=0XCKDM31HAU8 type=del size=2004963 2024-08-27T02:38:02.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.979+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=W7708WLOQ7PG type=del 2024-08-27T02:38:02.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.979+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=26K2MMTXEL6N type=del size=3077881 2024-08-27T02:38:02.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.983+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~WZYF6FKAYYZH.0 size=1048576 2024-08-27T02:38:02.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.983+0000 7f3e0cc408c0 1 < canceled part key=_multipart_PLC076BXR38P.2~WZYF6FKAYYZH.1 size=1048576 2024-08-27T02:38:02.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.987+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~WZYF6FKAYYZH.2 size=326975 2024-08-27T02:38:02.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.991+0000 7f3e0cc408c0 1 < canceled multipart upload key=PLC076BXR38P upload=WZYF6FKAYYZH tag=21A4Z3IABVN1 type=write size=3472703 2024-08-27T02:38:02.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.995+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~NIXNGIO06COO.0 size=1048576 2024-08-27T02:38:02.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.999+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~NIXNGIO06COO.1 size=1048576 2024-08-27T02:38:02.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.999+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~NIXNGIO06COO.2 size=641490 2024-08-27T02:38:03.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:02.999+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=NIXNGIO06COO tag=B56RXWNVG68M type=write size=3787218 2024-08-27T02:38:03.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.007+0000 7f3e0cc408c0 1 < suggested update operation key=QVG1NTF6O8L2 tag=O4FULHMZ9GNV type=del size=1320899 2024-08-27T02:38:03.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~WL3ILDSE6GMK.0 size=324066 2024-08-27T02:38:03.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.011+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=WL3ILDSE6GMK tag=5R1M0G8QUWD3 type=write size=1372642 2024-08-27T02:38:03.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.015+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~2RLPJ4U8VQ42.0 size=1048576 2024-08-27T02:38:03.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~2RLPJ4U8VQ42.1 size=669765 2024-08-27T02:38:03.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.023+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=2RLPJ4U8VQ42 tag=4W06TD0QV28S type=write size=2766917 2024-08-27T02:38:03.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~R0R2HDLB2SNO.0 size=1048576 2024-08-27T02:38:03.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~R0R2HDLB2SNO.1 size=1048576 2024-08-27T02:38:03.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.031+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~R0R2HDLB2SNO.2 size=390968 2024-08-27T02:38:03.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.031+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=R0R2HDLB2SNO tag=ZSSBPASCTBTI type=write size=3536696 2024-08-27T02:38:03.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.035+0000 7f3e0cc408c0 1 < suggested remove operation key=6YTZJKE4V5HQ tag=VJZAGXDZFZZK type=del 2024-08-27T02:38:03.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.039+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=KABY26P4K6XM type=del size=3688588 2024-08-27T02:38:03.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.039+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~WQRMA0DCNA40.0 size=1048576 2024-08-27T02:38:03.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~WQRMA0DCNA40.1 size=994771 2024-08-27T02:38:03.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.047+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=WQRMA0DCNA40 tag=V40F0IAW40DB type=write size=3091923 2024-08-27T02:38:03.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.047+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=7F0N3Z6X0TZY type=del size=394006 2024-08-27T02:38:03.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.051+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=7TMIP36PX3GF type=del 2024-08-27T02:38:03.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.055+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~4E26YTL9BIM0.0 size=155331 2024-08-27T02:38:03.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.055+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=4E26YTL9BIM0 tag=ZO03VF6VNAEO type=write size=1203907 2024-08-27T02:38:03.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.059+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=ZIP1F1OWN8VQ type=del 2024-08-27T02:38:03.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.063+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=GLBZPNA9J5MX type=del size=1499312 2024-08-27T02:38:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~UQ5IOLHT9F11.0 size=1048576 2024-08-27T02:38:03.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~UQ5IOLHT9F11.1 size=371400 2024-08-27T02:38:03.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.071+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=UQ5IOLHT9F11 tag=47GCUFJZWUP6 type=write size=2468552 2024-08-27T02:38:03.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.079+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~5WCS8FHA7MLQ.0 size=1048576 2024-08-27T02:38:03.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.079+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~5WCS8FHA7MLQ.1 size=1048576 2024-08-27T02:38:03.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.083+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~5WCS8FHA7MLQ.2 size=745560 2024-08-27T02:38:03.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.083+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=5WCS8FHA7MLQ tag=PMSTV2XX08K4 type=write size=3891288 2024-08-27T02:38:03.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.087+0000 7f3e0cc408c0 1 < completed write operation key=JDV1RIGAO7J1 tag=4ENF3NXOPFY2 type=write size=16321 2024-08-27T02:38:03.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.091+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=BUNFVVX2VC68 type=write size=967149 2024-08-27T02:38:03.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.095+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=K1109IWTXGWA type=del 2024-08-27T02:38:03.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~034UP0HR0Z7Z.0 size=725132 2024-08-27T02:38:03.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.099+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=034UP0HR0Z7Z tag=58HA0ELJMLRP type=write size=1773708 2024-08-27T02:38:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.103+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=VOV24M8K0BBF type=del 2024-08-27T02:38:03.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~231M1T2VMM30.0 size=1048576 2024-08-27T02:38:03.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.111+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~231M1T2VMM30.1 size=807103 2024-08-27T02:38:03.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.111+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=231M1T2VMM30 tag=QNX53YPF12DS type=write size=2904255 2024-08-27T02:38:03.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~JHNOJPA35Z7Z.0 size=1048576 2024-08-27T02:38:03.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~JHNOJPA35Z7Z.1 size=1048576 2024-08-27T02:38:03.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~JHNOJPA35Z7Z.2 size=607100 2024-08-27T02:38:03.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.127+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=JHNOJPA35Z7Z tag=D0ZSFF7PH0LJ type=write size=3752828 2024-08-27T02:38:03.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~V6TXA9YC3FU2.0 size=1048576 2024-08-27T02:38:03.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~V6TXA9YC3FU2.1 size=1048576 2024-08-27T02:38:03.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.135+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~V6TXA9YC3FU2.2 size=891002 2024-08-27T02:38:03.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.135+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=V6TXA9YC3FU2 tag=Z7MQLRMX7BLM type=write size=4036730 2024-08-27T02:38:03.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.139+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=3UTUF26JKT8F type=del 2024-08-27T02:38:03.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~HH7CT8JHR8BZ.0 size=21850 2024-08-27T02:38:03.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.147+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=HH7CT8JHR8BZ tag=ZVCDMZJ3127D type=write size=1070426 2024-08-27T02:38:03.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.151+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=MWE6UDL9VVBO type=del 2024-08-27T02:38:03.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~UVUXQ5KHXLJR.0 size=550682 2024-08-27T02:38:03.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.155+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=UVUXQ5KHXLJR tag=SGK7A5E0696T type=write size=1599258 2024-08-27T02:38:03.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.159+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=0XCKDM31HAU8 type=del 2024-08-27T02:38:03.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.163+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~O4KCQ58PCVGR.0 size=1048576 2024-08-27T02:38:03.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.167+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~O4KCQ58PCVGR.1 size=1048576 2024-08-27T02:38:03.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.171+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~O4KCQ58PCVGR.2 size=613771 2024-08-27T02:38:03.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.171+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=O4KCQ58PCVGR tag=0PAMZ31611KC type=write size=3759499 2024-08-27T02:38:03.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.175+0000 7f3e0cc408c0 1 < suggested remove operation key=JLAGXRZVF50G tag=26K2MMTXEL6N type=del 2024-08-27T02:38:03.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.179+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=65KNWMBQBRT1 type=del size=1800442 2024-08-27T02:38:03.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.183+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~NIXNGIO06COO.0 size=1048576 2024-08-27T02:38:03.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.183+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~NIXNGIO06COO.1 size=1048576 2024-08-27T02:38:03.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.183+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~NIXNGIO06COO.2 size=641490 2024-08-27T02:38:03.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.191+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=NIXNGIO06COO tag=B56RXWNVG68M type=write size=3787218 2024-08-27T02:38:03.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.195+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~IA2H1GS6LSBW.0 size=1048576 2024-08-27T02:38:03.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~IA2H1GS6LSBW.1 size=1048576 2024-08-27T02:38:03.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~IA2H1GS6LSBW.2 size=596105 2024-08-27T02:38:03.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.199+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=IA2H1GS6LSBW tag=JMN8EFQ1287N type=write size=3741833 2024-08-27T02:38:03.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.203+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~WL3ILDSE6GMK.0 size=324066 2024-08-27T02:38:03.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.207+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=WL3ILDSE6GMK tag=5R1M0G8QUWD3 type=write size=1372642 2024-08-27T02:38:03.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.211+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~TSSX15D8HHEB.0 size=1048576 2024-08-27T02:38:03.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.215+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~TSSX15D8HHEB.1 size=1048576 2024-08-27T02:38:03.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.215+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~TSSX15D8HHEB.2 size=181207 2024-08-27T02:38:03.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.215+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=TSSX15D8HHEB tag=NET41R18ACJD type=write size=3326935 2024-08-27T02:38:03.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.219+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~R0R2HDLB2SNO.0 size=1048576 2024-08-27T02:38:03.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.223+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~R0R2HDLB2SNO.1 size=1048576 2024-08-27T02:38:03.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.223+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~R0R2HDLB2SNO.2 size=390968 2024-08-27T02:38:03.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.227+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=R0R2HDLB2SNO tag=ZSSBPASCTBTI type=write size=3536696 2024-08-27T02:38:03.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.231+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=ZI8OTBDSFIEU type=del size=2541509 2024-08-27T02:38:03.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.235+0000 7f3e0cc408c0 1 < suggested update operation key=O66XJ7GJMPCU tag=KABY26P4K6XM type=del size=3688588 2024-08-27T02:38:03.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.243+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=A1KABMW5P1Y6 type=del size=4100383 2024-08-27T02:38:03.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.247+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=7F0N3Z6X0TZY type=del 2024-08-27T02:38:03.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.251+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~8QJXKW0J82O2.0 size=1048576 2024-08-27T02:38:03.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.255+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~8QJXKW0J82O2.1 size=358713 2024-08-27T02:38:03.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.255+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=8QJXKW0J82O2 tag=SN2NOV8XRGZJ type=write size=2455865 2024-08-27T02:38:03.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.255+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~4E26YTL9BIM0.0 size=155331 2024-08-27T02:38:03.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.259+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=4E26YTL9BIM0 tag=ZO03VF6VNAEO type=write size=1203907 2024-08-27T02:38:03.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.263+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=KUDDJUCIR7PQ type=del size=2466849 2024-08-27T02:38:03.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.267+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=GLBZPNA9J5MX type=del 2024-08-27T02:38:03.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.271+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=H3VJZ9V084EN type=del size=2226695 2024-08-27T02:38:03.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.275+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~5WCS8FHA7MLQ.0 size=1048576 2024-08-27T02:38:03.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.279+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~5WCS8FHA7MLQ.1 size=1048576 2024-08-27T02:38:03.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.279+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~5WCS8FHA7MLQ.2 size=745560 2024-08-27T02:38:03.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.283+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=5WCS8FHA7MLQ tag=PMSTV2XX08K4 type=write size=3891288 2024-08-27T02:38:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.287+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=N993LC0RWGJ7 type=write size=502613 2024-08-27T02:38:03.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.291+0000 7f3e0cc408c0 1 < canceled operation key=IISECLYEAR19 tag=BUNFVVX2VC68 type=write size=967149 2024-08-27T02:38:03.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.291+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=0ZSE42W9T7XU type=write size=762807 2024-08-27T02:38:03.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.295+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~034UP0HR0Z7Z.0 size=725132 2024-08-27T02:38:03.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.299+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=034UP0HR0Z7Z tag=58HA0ELJMLRP type=write size=1773708 2024-08-27T02:38:03.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.303+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=JO417BBAYBBU type=write size=717635 2024-08-27T02:38:03.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.307+0000 7f3e0cc408c0 1 < canceled part key=_multipart_KTPZGZSQCERQ.2~231M1T2VMM30.0 size=1048576 2024-08-27T02:38:03.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.307+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~231M1T2VMM30.1 size=807103 2024-08-27T02:38:03.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.315+0000 7f3e0cc408c0 1 < canceled multipart upload key=KTPZGZSQCERQ upload=231M1T2VMM30 tag=QNX53YPF12DS type=write size=2904255 2024-08-27T02:38:03.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.315+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=KQND7VAJ2SXM type=del size=3282046 2024-08-27T02:38:03.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~V6TXA9YC3FU2.0 size=1048576 2024-08-27T02:38:03.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.323+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~V6TXA9YC3FU2.1 size=1048576 2024-08-27T02:38:03.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.323+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~V6TXA9YC3FU2.2 size=891002 2024-08-27T02:38:03.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.327+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=V6TXA9YC3FU2 tag=Z7MQLRMX7BLM type=write size=4036730 2024-08-27T02:38:03.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.331+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=0C54ODXPX430 type=del size=2018019 2024-08-27T02:38:03.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.335+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~HH7CT8JHR8BZ.0 size=21850 2024-08-27T02:38:03.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.339+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=HH7CT8JHR8BZ tag=ZVCDMZJ3127D type=write size=1070426 2024-08-27T02:38:03.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.343+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~GKNEVNSTTOWL.0 size=1048576 2024-08-27T02:38:03.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.347+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~GKNEVNSTTOWL.1 size=485698 2024-08-27T02:38:03.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.347+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=GKNEVNSTTOWL tag=2M5H43S3ZKGQ type=write size=2582850 2024-08-27T02:38:03.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.351+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~UVUXQ5KHXLJR.0 size=550682 2024-08-27T02:38:03.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.359+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=UVUXQ5KHXLJR tag=SGK7A5E0696T type=write size=1599258 2024-08-27T02:38:03.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.363+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=AL5SX4R4CFOS type=del size=3500316 2024-08-27T02:38:03.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~O4KCQ58PCVGR.0 size=1048576 2024-08-27T02:38:03.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~O4KCQ58PCVGR.1 size=1048576 2024-08-27T02:38:03.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~O4KCQ58PCVGR.2 size=613771 2024-08-27T02:38:03.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.375+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=O4KCQ58PCVGR tag=0PAMZ31611KC type=write size=3759499 2024-08-27T02:38:03.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~3T7P25WRJWUS.0 size=1048576 2024-08-27T02:38:03.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~3T7P25WRJWUS.1 size=693972 2024-08-27T02:38:03.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.383+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=3T7P25WRJWUS tag=FR5FF011F25M type=write size=2791124 2024-08-27T02:38:03.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.387+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=65KNWMBQBRT1 type=del 2024-08-27T02:38:03.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.391+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=W2CI3N6XDDXO type=write size=563492 2024-08-27T02:38:03.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.395+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~IA2H1GS6LSBW.0 size=1048576 2024-08-27T02:38:03.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.395+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~IA2H1GS6LSBW.1 size=1048576 2024-08-27T02:38:03.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.399+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~IA2H1GS6LSBW.2 size=596105 2024-08-27T02:38:03.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.403+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=IA2H1GS6LSBW tag=JMN8EFQ1287N type=write size=3741833 2024-08-27T02:38:03.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~YU97LYC7MEGI.0 size=1048576 2024-08-27T02:38:03.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~YU97LYC7MEGI.1 size=652898 2024-08-27T02:38:03.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.411+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=YU97LYC7MEGI tag=2LPL9BRLA5K1 type=write size=2750050 2024-08-27T02:38:03.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.415+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~TSSX15D8HHEB.0 size=1048576 2024-08-27T02:38:03.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.419+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~TSSX15D8HHEB.1 size=1048576 2024-08-27T02:38:03.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.419+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~TSSX15D8HHEB.2 size=181207 2024-08-27T02:38:03.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.423+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=TSSX15D8HHEB tag=NET41R18ACJD type=write size=3326935 2024-08-27T02:38:03.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.427+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=DC0C785MIRZJ type=del size=2463549 2024-08-27T02:38:03.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.431+0000 7f3e0cc408c0 -1 < failed to complete operation key=O66XJ7GJMPCU tag=ZI8OTBDSFIEU type=del size=2541509: (22) Invalid argument 2024-08-27T02:38:03.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.435+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=W5DQ6SX3T3N0 type=del size=599772 2024-08-27T02:38:03.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.435+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=A1KABMW5P1Y6 type=del 2024-08-27T02:38:03.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.439+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=N0TDESJPANWD type=del size=1075196 2024-08-27T02:38:03.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.439+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JLAGXRZVF50G.2~8QJXKW0J82O2.0 size=1048576 2024-08-27T02:38:03.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.443+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~8QJXKW0J82O2.1 size=358713 2024-08-27T02:38:03.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.447+0000 7f3e0cc408c0 1 < canceled multipart upload key=JLAGXRZVF50G upload=8QJXKW0J82O2 tag=SN2NOV8XRGZJ type=write size=2455865 2024-08-27T02:38:03.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.451+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=KOBIWI4X5Q9E type=del size=1158300 2024-08-27T02:38:03.454 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.455+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=KUDDJUCIR7PQ type=del 2024-08-27T02:38:03.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.459+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=P6MRQZ9QNTJX type=del size=1046599 2024-08-27T02:38:03.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.463+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=H3VJZ9V084EN type=del 2024-08-27T02:38:03.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.463+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=MJTMZV0BIZY9 type=del size=1800379 2024-08-27T02:38:03.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.471+0000 7f3e0cc408c0 1 < suggested remove operation key=8VSA6T2H8FDI tag=N993LC0RWGJ7 type=write 2024-08-27T02:38:03.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.475+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=N3MGWM5Y78I0 type=del size=3064817 2024-08-27T02:38:03.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.479+0000 7f3e0cc408c0 1 < canceled operation key=D7YWS7BWXT37 tag=0ZSE42W9T7XU type=write size=762807 2024-08-27T02:38:03.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.483+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=YWY8EZYRXIVP type=write size=457344 2024-08-27T02:38:03.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.483+0000 7f3e0cc408c0 1 < canceled operation key=0U59R3BXL181 tag=JO417BBAYBBU type=write size=717635 2024-08-27T02:38:03.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.487+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=3C4TTJ1SUIU0 type=write size=527452 2024-08-27T02:38:03.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.491+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=KQND7VAJ2SXM type=del 2024-08-27T02:38:03.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.495+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=8ZCZ6RHXGFW9 type=write size=898680 2024-08-27T02:38:03.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.495+0000 7f3e0cc408c0 1 < canceled operation key=A0RUXE4YL6NR tag=0C54ODXPX430 type=del size=2018019 2024-08-27T02:38:03.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.503+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~AMUFQ0QM6TJE.0 size=1048576 2024-08-27T02:38:03.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.507+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~AMUFQ0QM6TJE.1 size=1048576 2024-08-27T02:38:03.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.507+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~AMUFQ0QM6TJE.2 size=766473 2024-08-27T02:38:03.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.507+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=AMUFQ0QM6TJE tag=UJ0LU6INVHCK type=write size=3912201 2024-08-27T02:38:03.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.511+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~GKNEVNSTTOWL.0 size=1048576 2024-08-27T02:38:03.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.511+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~GKNEVNSTTOWL.1 size=485698 2024-08-27T02:38:03.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.519+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=GKNEVNSTTOWL tag=2M5H43S3ZKGQ type=write size=2582850 2024-08-27T02:38:03.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.523+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~VM0L32QWN9YL.0 size=1048576 2024-08-27T02:38:03.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~VM0L32QWN9YL.1 size=274641 2024-08-27T02:38:03.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.527+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=VM0L32QWN9YL tag=3374IR81YA3P type=write size=2371793 2024-08-27T02:38:03.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.531+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=AL5SX4R4CFOS type=del 2024-08-27T02:38:03.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~D31500CPL9I6.0 size=1048576 2024-08-27T02:38:03.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.543+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~D31500CPL9I6.1 size=1048576 2024-08-27T02:38:03.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.543+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~D31500CPL9I6.2 size=263552 2024-08-27T02:38:03.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.543+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=D31500CPL9I6 tag=TTZ4H6B5RTFC type=write size=3409280 2024-08-27T02:38:03.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~3T7P25WRJWUS.0 size=1048576 2024-08-27T02:38:03.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.551+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~3T7P25WRJWUS.1 size=693972 2024-08-27T02:38:03.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.555+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=3T7P25WRJWUS tag=FR5FF011F25M type=write size=2791124 2024-08-27T02:38:03.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~XSR24QEMDKDD.0 size=1048576 2024-08-27T02:38:03.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~XSR24QEMDKDD.1 size=1048576 2024-08-27T02:38:03.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.571+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~XSR24QEMDKDD.2 size=807952 2024-08-27T02:38:03.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.571+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=XSR24QEMDKDD tag=9IK6B3JEGY4X type=write size=3953680 2024-08-27T02:38:03.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.571+0000 7f3e0cc408c0 1 < completed write operation key=SG9T1RD5EATR tag=W2CI3N6XDDXO type=write size=563492 2024-08-27T02:38:03.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~YT2BJZ3XDR2L.0 size=1048576 2024-08-27T02:38:03.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.583+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~YT2BJZ3XDR2L.1 size=1048576 2024-08-27T02:38:03.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.583+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~YT2BJZ3XDR2L.2 size=73667 2024-08-27T02:38:03.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.583+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=YT2BJZ3XDR2L tag=3JMVBOE22HVI type=write size=3219395 2024-08-27T02:38:03.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.587+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~YU97LYC7MEGI.0 size=1048576 2024-08-27T02:38:03.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.591+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~YU97LYC7MEGI.1 size=652898 2024-08-27T02:38:03.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.595+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=YU97LYC7MEGI tag=2LPL9BRLA5K1 type=write size=2750050 2024-08-27T02:38:03.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~YB5N4JGN83LY.0 size=715873 2024-08-27T02:38:03.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.603+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=YB5N4JGN83LY tag=DVQ6TSTMGDIH type=write size=1764449 2024-08-27T02:38:03.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.607+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=DC0C785MIRZJ type=del 2024-08-27T02:38:03.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.611+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~NPM4KYLPMXQ7.0 size=334227 2024-08-27T02:38:03.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.611+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=NPM4KYLPMXQ7 tag=XT14S0E57IHY type=write size=1382803 2024-08-27T02:38:03.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.619+0000 7f3e0cc408c0 1 < suggested remove operation key=ZMN8Y0VQVHLB tag=W5DQ6SX3T3N0 type=del 2024-08-27T02:38:03.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.623+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=EJ4ZHO1WLI9A type=del size=871471 2024-08-27T02:38:03.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.631+0000 7f3e0cc408c0 1 < suggested remove operation key=XBURHQSU6IML tag=N0TDESJPANWD type=del 2024-08-27T02:38:03.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.635+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=N1IR1H5EQ77C type=del size=3225700 2024-08-27T02:38:03.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.635+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=KOBIWI4X5Q9E type=del 2024-08-27T02:38:03.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.643+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~UBTQRHKT6L0S.0 size=1048576 2024-08-27T02:38:03.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~UBTQRHKT6L0S.1 size=1048576 2024-08-27T02:38:03.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~UBTQRHKT6L0S.2 size=646503 2024-08-27T02:38:03.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.647+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=UBTQRHKT6L0S tag=U0S4UG03PBUR type=write size=3792231 2024-08-27T02:38:03.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.655+0000 7f3e0cc408c0 1 < suggested update operation key=SG9T1RD5EATR tag=P6MRQZ9QNTJX type=del size=1046599 2024-08-27T02:38:03.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.659+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=69UAU7IM56DL type=del size=2028489 2024-08-27T02:38:03.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.663+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=MJTMZV0BIZY9 type=del 2024-08-27T02:38:03.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.667+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=2KJGON5PDMNP type=del size=2407012 2024-08-27T02:38:03.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.671+0000 7f3e0cc408c0 1 < suggested remove operation key=VSDJU5KQLFKE tag=N3MGWM5Y78I0 type=del 2024-08-27T02:38:03.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.675+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=FG5WW5T8NEB2 type=del size=1808557 2024-08-27T02:38:03.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.679+0000 7f3e0cc408c0 1 < completed write operation key=B9DPI871LQ7E tag=YWY8EZYRXIVP type=write size=457344 2024-08-27T02:38:03.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.683+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=2IUZ9OYR0T3F type=del size=948212 2024-08-27T02:38:03.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.687+0000 7f3e0cc408c0 1 < suggested update operation key=A0RUXE4YL6NR tag=3C4TTJ1SUIU0 type=write size=527452 2024-08-27T02:38:03.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.691+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=OAIPQQEB05LP type=del size=1765199 2024-08-27T02:38:03.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.695+0000 7f3e0cc408c0 1 < completed write operation key=13M7JVZT12I2 tag=8ZCZ6RHXGFW9 type=write size=898680 2024-08-27T02:38:03.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.699+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=5V8OKOYZZQ53 type=del size=4073462 2024-08-27T02:38:03.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.703+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~AMUFQ0QM6TJE.0 size=1048576 2024-08-27T02:38:03.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.703+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~AMUFQ0QM6TJE.1 size=1048576 2024-08-27T02:38:03.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.707+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~AMUFQ0QM6TJE.2 size=766473 2024-08-27T02:38:03.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.715+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=AMUFQ0QM6TJE tag=UJ0LU6INVHCK type=write size=3912201 2024-08-27T02:38:03.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.719+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=OWA2BDVBFROB type=del size=1407598 2024-08-27T02:38:03.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.723+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~VM0L32QWN9YL.0 size=1048576 2024-08-27T02:38:03.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.723+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~VM0L32QWN9YL.1 size=274641 2024-08-27T02:38:03.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.731+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=VM0L32QWN9YL tag=3374IR81YA3P type=write size=2371793 2024-08-27T02:38:03.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.735+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=0UOSZ508M77C type=del size=1620385 2024-08-27T02:38:03.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~D31500CPL9I6.0 size=1048576 2024-08-27T02:38:03.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~D31500CPL9I6.1 size=1048576 2024-08-27T02:38:03.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.743+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~D31500CPL9I6.2 size=263552 2024-08-27T02:38:03.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.751+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=D31500CPL9I6 tag=TTZ4H6B5RTFC type=write size=3409280 2024-08-27T02:38:03.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.755+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=D2NCKK3BW3BY type=del size=3880328 2024-08-27T02:38:03.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.759+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~XSR24QEMDKDD.0 size=1048576 2024-08-27T02:38:03.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.759+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~XSR24QEMDKDD.1 size=1048576 2024-08-27T02:38:03.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.763+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~XSR24QEMDKDD.2 size=807952 2024-08-27T02:38:03.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.767+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=XSR24QEMDKDD tag=9IK6B3JEGY4X type=write size=3953680 2024-08-27T02:38:03.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.771+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~CX3DCXIJGC96.0 size=1048576 2024-08-27T02:38:03.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.775+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~CX3DCXIJGC96.1 size=1048576 2024-08-27T02:38:03.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~CX3DCXIJGC96.2 size=508633 2024-08-27T02:38:03.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.779+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=CX3DCXIJGC96 tag=DYH9VGOIK66V type=write size=3654361 2024-08-27T02:38:03.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.779+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~YT2BJZ3XDR2L.0 size=1048576 2024-08-27T02:38:03.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.783+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~YT2BJZ3XDR2L.1 size=1048576 2024-08-27T02:38:03.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.787+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~YT2BJZ3XDR2L.2 size=73667 2024-08-27T02:38:03.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.791+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=YT2BJZ3XDR2L tag=3JMVBOE22HVI type=write size=3219395 2024-08-27T02:38:03.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.795+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=YVR5AVL4K08S type=del size=1564439 2024-08-27T02:38:03.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.799+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~YB5N4JGN83LY.0 size=715873 2024-08-27T02:38:03.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.803+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=YB5N4JGN83LY tag=DVQ6TSTMGDIH type=write size=1764449 2024-08-27T02:38:03.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.807+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=E23VPYHGSR1E type=del size=2913368 2024-08-27T02:38:03.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.811+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~NPM4KYLPMXQ7.0 size=334227 2024-08-27T02:38:03.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.815+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=NPM4KYLPMXQ7 tag=XT14S0E57IHY type=write size=1382803 2024-08-27T02:38:03.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.819+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=24VLE0L7WZKZ type=del size=3188076 2024-08-27T02:38:03.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.823+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=EJ4ZHO1WLI9A type=del 2024-08-27T02:38:03.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.827+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=Y4KS9W991AYS type=del size=1139449 2024-08-27T02:38:03.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.831+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=N1IR1H5EQ77C type=del 2024-08-27T02:38:03.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~W3GMVNLYCAHD.0 size=1048576 2024-08-27T02:38:03.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.839+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~W3GMVNLYCAHD.1 size=250520 2024-08-27T02:38:03.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.839+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=W3GMVNLYCAHD tag=J9N3SV4JGUT2 type=write size=2347672 2024-08-27T02:38:03.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.839+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~UBTQRHKT6L0S.0 size=1048576 2024-08-27T02:38:03.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.847+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~UBTQRHKT6L0S.1 size=1048576 2024-08-27T02:38:03.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~UBTQRHKT6L0S.2 size=646503 2024-08-27T02:38:03.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.855+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=UBTQRHKT6L0S tag=U0S4UG03PBUR type=write size=3792231 2024-08-27T02:38:03.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.859+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~TWJWBW07BOXN.0 size=995259 2024-08-27T02:38:03.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.859+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=TWJWBW07BOXN tag=IHJOI7QD0TP1 type=write size=2043835 2024-08-27T02:38:03.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.863+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=69UAU7IM56DL type=del 2024-08-27T02:38:03.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.863+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=U09ME50YXSSM type=del size=1310310 2024-08-27T02:38:03.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.871+0000 7f3e0cc408c0 1 < suggested remove operation key=6QE1HU65GQZZ tag=2KJGON5PDMNP type=del 2024-08-27T02:38:03.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~G7CJPG5CHYZR.0 size=1048576 2024-08-27T02:38:03.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.879+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~G7CJPG5CHYZR.1 size=389098 2024-08-27T02:38:03.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.879+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=G7CJPG5CHYZR tag=T3XZM7MDF42K type=write size=2486250 2024-08-27T02:38:03.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.883+0000 7f3e0cc408c0 1 < suggested update operation key=0OLVDEQWBCAQ tag=FG5WW5T8NEB2 type=del size=1808557 2024-08-27T02:38:03.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.887+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~CEO2841071OE.0 size=1048576 2024-08-27T02:38:03.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.891+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~CEO2841071OE.1 size=38135 2024-08-27T02:38:03.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.891+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=CEO2841071OE tag=TXTL7H76OOPC type=write size=2135287 2024-08-27T02:38:03.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.895+0000 7f3e0cc408c0 -1 < failed to complete operation key=6QE1HU65GQZZ tag=2IUZ9OYR0T3F type=del size=948212: (22) Invalid argument 2024-08-27T02:38:03.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.899+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=CXA9K1V8NVXU type=del size=4101588 2024-08-27T02:38:03.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.899+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=OAIPQQEB05LP type=del 2024-08-27T02:38:03.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~1DO6C7ODTS3R.0 size=1048576 2024-08-27T02:38:03.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.907+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~1DO6C7ODTS3R.1 size=1048576 2024-08-27T02:38:03.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.911+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~1DO6C7ODTS3R.2 size=439956 2024-08-27T02:38:03.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.911+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=1DO6C7ODTS3R tag=UPXGENJBO8F6 type=write size=3585684 2024-08-27T02:38:03.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.919+0000 7f3e0cc408c0 1 < suggested update operation key=HKDJMA7O2DFM tag=5V8OKOYZZQ53 type=del size=4073462 2024-08-27T02:38:03.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.923+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~5KGFNHVZ4LPP.0 size=399200 2024-08-27T02:38:03.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.923+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=5KGFNHVZ4LPP tag=EPNX63PVR7E1 type=write size=1447776 2024-08-27T02:38:03.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.927+0000 7f3e0cc408c0 1 < canceled operation key=XBURHQSU6IML tag=OWA2BDVBFROB type=del size=1407598 2024-08-27T02:38:03.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.931+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=ZYF70YP1M4TW type=write size=208520 2024-08-27T02:38:03.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.935+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=0UOSZ508M77C type=del 2024-08-27T02:38:03.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~NO19LP3IKNP3.0 size=458094 2024-08-27T02:38:03.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.939+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=NO19LP3IKNP3 tag=MJHMES2H3JGN type=write size=1506670 2024-08-27T02:38:03.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.943+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=D2NCKK3BW3BY type=del 2024-08-27T02:38:03.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.951+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~25EMHF3EO7JJ.0 size=1048576 2024-08-27T02:38:03.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.951+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~25EMHF3EO7JJ.1 size=564991 2024-08-27T02:38:03.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.951+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=25EMHF3EO7JJ tag=EX0ME5ESOIXI type=write size=2662143 2024-08-27T02:38:03.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~CX3DCXIJGC96.0 size=1048576 2024-08-27T02:38:03.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.955+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~CX3DCXIJGC96.1 size=1048576 2024-08-27T02:38:03.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~CX3DCXIJGC96.2 size=508633 2024-08-27T02:38:03.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.963+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=CX3DCXIJGC96 tag=DYH9VGOIK66V type=write size=3654361 2024-08-27T02:38:03.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.967+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=88RL57SZYRAS type=del size=1189921 2024-08-27T02:38:03.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.971+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=YVR5AVL4K08S type=del 2024-08-27T02:38:03.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~3F7KYR876LK7.0 size=342864 2024-08-27T02:38:03.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.975+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=3F7KYR876LK7 tag=QZ4HGT4WW4S7 type=write size=1391440 2024-08-27T02:38:03.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.979+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=E23VPYHGSR1E type=del 2024-08-27T02:38:03.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.983+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=WZHBC36DW6NM type=del size=3762980 2024-08-27T02:38:03.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.983+0000 7f3e0cc408c0 -1 < no bi entry to suggest for operation key=6QE1HU65GQZZ tag=24VLE0L7WZKZ type=del size=3188076: (2) No such file or directory 2024-08-27T02:38:03.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.987+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=BBSXV6UTHEEQ type=del size=3213011 2024-08-27T02:38:03.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.991+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=Y4KS9W991AYS type=del 2024-08-27T02:38:03.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:03.999+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~3L171EQ9DF49.0 size=1048576 2024-08-27T02:38:04.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~3L171EQ9DF49.1 size=1048576 2024-08-27T02:38:04.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~3L171EQ9DF49.2 size=658232 2024-08-27T02:38:04.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.003+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=3L171EQ9DF49 tag=0E1UPHZWGIRO type=write size=3803960 2024-08-27T02:38:04.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.003+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~W3GMVNLYCAHD.0 size=1048576 2024-08-27T02:38:04.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.007+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~W3GMVNLYCAHD.1 size=250520 2024-08-27T02:38:04.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.015+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=W3GMVNLYCAHD tag=J9N3SV4JGUT2 type=write size=2347672 2024-08-27T02:38:04.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.019+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~KUAX9V3JK10M.0 size=1048576 2024-08-27T02:38:04.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.023+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~KUAX9V3JK10M.1 size=1048576 2024-08-27T02:38:04.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.023+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~KUAX9V3JK10M.2 size=720770 2024-08-27T02:38:04.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.023+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=KUAX9V3JK10M tag=DFY2VI5QWXMT type=write size=3866498 2024-08-27T02:38:04.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.027+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~TWJWBW07BOXN.0 size=995259 2024-08-27T02:38:04.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.035+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=TWJWBW07BOXN tag=IHJOI7QD0TP1 type=write size=2043835 2024-08-27T02:38:04.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.039+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~C2RMKYZ85639.0 size=240093 2024-08-27T02:38:04.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.039+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=C2RMKYZ85639 tag=116HSJ6ZPOWM type=write size=1288669 2024-08-27T02:38:04.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.043+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=U09ME50YXSSM type=del 2024-08-27T02:38:04.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~DC9QPLRXSLR8.0 size=1048576 2024-08-27T02:38:04.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~DC9QPLRXSLR8.1 size=918206 2024-08-27T02:38:04.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.051+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=DC9QPLRXSLR8 tag=YG9R1DTNBVNV type=write size=3015358 2024-08-27T02:38:04.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.055+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~G7CJPG5CHYZR.0 size=1048576 2024-08-27T02:38:04.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.059+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~G7CJPG5CHYZR.1 size=389098 2024-08-27T02:38:04.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.063+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=G7CJPG5CHYZR tag=T3XZM7MDF42K type=write size=2486250 2024-08-27T02:38:04.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.067+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=HTS3R6CFF5Z7 type=del size=1429097 2024-08-27T02:38:04.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.071+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~CEO2841071OE.0 size=1048576 2024-08-27T02:38:04.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.075+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~CEO2841071OE.1 size=38135 2024-08-27T02:38:04.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.083+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=CEO2841071OE tag=TXTL7H76OOPC type=write size=2135287 2024-08-27T02:38:04.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.083+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=IBUDB0G95NOI type=del size=386846 2024-08-27T02:38:04.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.091+0000 7f3e0cc408c0 1 < suggested update operation key=4SSZQK6YIL1O tag=CXA9K1V8NVXU type=del size=4101588 2024-08-27T02:38:04.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.095+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=5TCJOVBGYVNE type=del size=3522772 2024-08-27T02:38:04.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.099+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~1DO6C7ODTS3R.0 size=1048576 2024-08-27T02:38:04.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.103+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~1DO6C7ODTS3R.1 size=1048576 2024-08-27T02:38:04.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.103+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~1DO6C7ODTS3R.2 size=439956 2024-08-27T02:38:04.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.111+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=1DO6C7ODTS3R tag=UPXGENJBO8F6 type=write size=3585684 2024-08-27T02:38:04.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.111+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=K6O26AUC7T3R type=del size=489663 2024-08-27T02:38:04.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~5KGFNHVZ4LPP.0 size=399200 2024-08-27T02:38:04.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.123+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=5KGFNHVZ4LPP tag=EPNX63PVR7E1 type=write size=1447776 2024-08-27T02:38:04.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.127+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=MDPDS32384NE type=write size=447616 2024-08-27T02:38:04.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.131+0000 7f3e0cc408c0 1 < suggested update operation key=O66XJ7GJMPCU tag=ZYF70YP1M4TW type=write size=208520 2024-08-27T02:38:04.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.139+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~WURW5O1S1KR8.0 size=986203 2024-08-27T02:38:04.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.139+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=WURW5O1S1KR8 tag=ZK3IEZF6O3CM type=write size=2034779 2024-08-27T02:38:04.141 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.143+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~NO19LP3IKNP3.0 size=458094 2024-08-27T02:38:04.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.147+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=NO19LP3IKNP3 tag=MJHMES2H3JGN type=write size=1506670 2024-08-27T02:38:04.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.155+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=MGZ67XK9X5BC type=del size=1734871 2024-08-27T02:38:04.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~25EMHF3EO7JJ.0 size=1048576 2024-08-27T02:38:04.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~25EMHF3EO7JJ.1 size=564991 2024-08-27T02:38:04.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.167+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=25EMHF3EO7JJ tag=EX0ME5ESOIXI type=write size=2662143 2024-08-27T02:38:04.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.171+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=1GXUPZ4MXWRO type=del size=3655223 2024-08-27T02:38:04.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.175+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=88RL57SZYRAS type=del 2024-08-27T02:38:04.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.183+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~336O6BVP2EZ3.0 size=1048576 2024-08-27T02:38:04.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~336O6BVP2EZ3.1 size=1048576 2024-08-27T02:38:04.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~336O6BVP2EZ3.2 size=72528 2024-08-27T02:38:04.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.187+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=336O6BVP2EZ3 tag=NFTJJVMMJMFL type=write size=3218256 2024-08-27T02:38:04.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.191+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~3F7KYR876LK7.0 size=342864 2024-08-27T02:38:04.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.195+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=3F7KYR876LK7 tag=QZ4HGT4WW4S7 type=write size=1391440 2024-08-27T02:38:04.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.199+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=4CBAA2HQT3J4 type=del size=1307003 2024-08-27T02:38:04.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.203+0000 7f3e0cc408c0 1 < canceled operation key=4BV3C9MTIFT5 tag=WZHBC36DW6NM type=del size=3762980 2024-08-27T02:38:04.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.211+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~DEWMQ8MWSU16.0 size=1048576 2024-08-27T02:38:04.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.211+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~DEWMQ8MWSU16.1 size=1048576 2024-08-27T02:38:04.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.215+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~DEWMQ8MWSU16.2 size=892184 2024-08-27T02:38:04.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.215+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=DEWMQ8MWSU16 tag=O1R6Y9OIRZMR type=write size=4037912 2024-08-27T02:38:04.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.219+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=BBSXV6UTHEEQ type=del 2024-08-27T02:38:04.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.223+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=GA407BMX16N6 type=del size=956674 2024-08-27T02:38:04.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.227+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~3L171EQ9DF49.0 size=1048576 2024-08-27T02:38:04.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~3L171EQ9DF49.1 size=1048576 2024-08-27T02:38:04.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~3L171EQ9DF49.2 size=658232 2024-08-27T02:38:04.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.235+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=3L171EQ9DF49 tag=0E1UPHZWGIRO type=write size=3803960 2024-08-27T02:38:04.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.243+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~X9ZDMAS3WULQ.0 size=1048576 2024-08-27T02:38:04.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.243+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~X9ZDMAS3WULQ.1 size=548216 2024-08-27T02:38:04.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.243+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=X9ZDMAS3WULQ tag=LAPUNUWPSJ8A type=write size=2645368 2024-08-27T02:38:04.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~KUAX9V3JK10M.0 size=1048576 2024-08-27T02:38:04.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.251+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~KUAX9V3JK10M.1 size=1048576 2024-08-27T02:38:04.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.251+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~KUAX9V3JK10M.2 size=720770 2024-08-27T02:38:04.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.255+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=KUAX9V3JK10M tag=DFY2VI5QWXMT type=write size=3866498 2024-08-27T02:38:04.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.263+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~BPCVIW6AD932.0 size=1048576 2024-08-27T02:38:04.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.263+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~BPCVIW6AD932.1 size=1048576 2024-08-27T02:38:04.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~BPCVIW6AD932.2 size=1030290 2024-08-27T02:38:04.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.267+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=BPCVIW6AD932 tag=G7NL23929QS6 type=write size=4176018 2024-08-27T02:38:04.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.267+0000 7f3e0cc408c0 1 < canceled part key=_multipart_4SSZQK6YIL1O.2~C2RMKYZ85639.0 size=240093 2024-08-27T02:38:04.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.271+0000 7f3e0cc408c0 1 < canceled multipart upload key=4SSZQK6YIL1O upload=C2RMKYZ85639 tag=116HSJ6ZPOWM type=write size=1288669 2024-08-27T02:38:04.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.275+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=U5K8SDSPLPMG type=del size=3510552 2024-08-27T02:38:04.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.279+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~DC9QPLRXSLR8.0 size=1048576 2024-08-27T02:38:04.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.279+0000 7f3e0cc408c0 1 < canceled part key=_multipart_O66XJ7GJMPCU.2~DC9QPLRXSLR8.1 size=918206 2024-08-27T02:38:04.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.283+0000 7f3e0cc408c0 1 < canceled multipart upload key=O66XJ7GJMPCU upload=DC9QPLRXSLR8 tag=YG9R1DTNBVNV type=write size=3015358 2024-08-27T02:38:04.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.283+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=4YRQD57HMWN8 type=del size=565705 2024-08-27T02:38:04.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.287+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=HTS3R6CFF5Z7 type=del 2024-08-27T02:38:04.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.291+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~RCUI2YYPEABH.0 size=968107 2024-08-27T02:38:04.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.291+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=RCUI2YYPEABH tag=HALTCFGZ6W8T type=write size=2016683 2024-08-27T02:38:04.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.299+0000 7f3e0cc408c0 1 < suggested remove operation key=6YTZJKE4V5HQ tag=IBUDB0G95NOI type=del 2024-08-27T02:38:04.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.299+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=SLTP7LE81ECH type=write size=462738 2024-08-27T02:38:04.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.303+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=5TCJOVBGYVNE type=del 2024-08-27T02:38:04.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~JZDIE04D87I4.0 size=698411 2024-08-27T02:38:04.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.307+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=JZDIE04D87I4 tag=Y5HUY2O65XBH type=write size=1746987 2024-08-27T02:38:04.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.311+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=K6O26AUC7T3R type=del 2024-08-27T02:38:04.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.315+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=R2FENVNR1OAG type=del size=1673309 2024-08-27T02:38:04.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.319+0000 7f3e0cc408c0 1 < canceled operation key=F4MCLPFLY531 tag=MDPDS32384NE type=write size=447616 2024-08-27T02:38:04.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.323+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=XQE0KE4V25ZT type=write size=350129 2024-08-27T02:38:04.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.323+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~WURW5O1S1KR8.0 size=986203 2024-08-27T02:38:04.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.327+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=WURW5O1S1KR8 tag=ZK3IEZF6O3CM type=write size=2034779 2024-08-27T02:38:04.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~4FFN1A9U69X2.0 size=415101 2024-08-27T02:38:04.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.335+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=4FFN1A9U69X2 tag=EQY57V0O3BV3 type=write size=1463677 2024-08-27T02:38:04.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.335+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=MGZ67XK9X5BC type=del 2024-08-27T02:38:04.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.339+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=8D56QXDV9Z65 type=del size=1091755 2024-08-27T02:38:04.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.343+0000 7f3e0cc408c0 1 < suggested remove operation key=JLAGXRZVF50G tag=1GXUPZ4MXWRO type=del 2024-08-27T02:38:04.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.347+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=DWX09UX3QZF1 type=write size=995198 2024-08-27T02:38:04.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.347+0000 7f3e0cc408c0 1 < canceled part key=_multipart_MNE5WNFBH9HG.2~336O6BVP2EZ3.0 size=1048576 2024-08-27T02:38:04.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.351+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~336O6BVP2EZ3.1 size=1048576 2024-08-27T02:38:04.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.351+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~336O6BVP2EZ3.2 size=72528 2024-08-27T02:38:04.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.359+0000 7f3e0cc408c0 1 < canceled multipart upload key=MNE5WNFBH9HG upload=336O6BVP2EZ3 tag=NFTJJVMMJMFL type=write size=3218256 2024-08-27T02:38:04.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.359+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=0ITCEX11EN65 type=del size=3968700 2024-08-27T02:38:04.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.363+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=4CBAA2HQT3J4 type=del 2024-08-27T02:38:04.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~V2J0CZMXDFCH.0 size=607456 2024-08-27T02:38:04.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.367+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=V2J0CZMXDFCH tag=VBGTNXXMM2HA type=write size=1656032 2024-08-27T02:38:04.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~DEWMQ8MWSU16.0 size=1048576 2024-08-27T02:38:04.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~DEWMQ8MWSU16.1 size=1048576 2024-08-27T02:38:04.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.375+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~DEWMQ8MWSU16.2 size=892184 2024-08-27T02:38:04.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.379+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=DEWMQ8MWSU16 tag=O1R6Y9OIRZMR type=write size=4037912 2024-08-27T02:38:04.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.379+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=3O7U0O5Q0TJQ type=del size=1147187 2024-08-27T02:38:04.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.383+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=GA407BMX16N6 type=del 2024-08-27T02:38:04.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.387+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=FQVI4BI3TUW8 type=del size=889287 2024-08-27T02:38:04.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~X9ZDMAS3WULQ.0 size=1048576 2024-08-27T02:38:04.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~X9ZDMAS3WULQ.1 size=548216 2024-08-27T02:38:04.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.395+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=X9ZDMAS3WULQ tag=LAPUNUWPSJ8A type=write size=2645368 2024-08-27T02:38:04.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.399+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=ZX2GK1KTH327 type=del size=150667 2024-08-27T02:38:04.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.403+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~BPCVIW6AD932.0 size=1048576 2024-08-27T02:38:04.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.403+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~BPCVIW6AD932.1 size=1048576 2024-08-27T02:38:04.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.403+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~BPCVIW6AD932.2 size=1030290 2024-08-27T02:38:04.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.407+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=BPCVIW6AD932 tag=G7NL23929QS6 type=write size=4176018 2024-08-27T02:38:04.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.411+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=X6ZSWSIT80AM type=del size=3966798 2024-08-27T02:38:04.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.415+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=U5K8SDSPLPMG type=del 2024-08-27T02:38:04.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.419+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~GNUL8FS5L86D.0 size=944954 2024-08-27T02:38:04.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.419+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=GNUL8FS5L86D tag=I6QT70DOYSV5 type=write size=1993530 2024-08-27T02:38:04.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.423+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=4YRQD57HMWN8 type=del 2024-08-27T02:38:04.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.431+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~BAS1Y2UDNRF8.0 size=845393 2024-08-27T02:38:04.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.431+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=BAS1Y2UDNRF8 tag=85CCDOA7TI6L type=write size=1893969 2024-08-27T02:38:04.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.435+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~RCUI2YYPEABH.0 size=968107 2024-08-27T02:38:04.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.439+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=RCUI2YYPEABH tag=HALTCFGZ6W8T type=write size=2016683 2024-08-27T02:38:04.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~K6OGR2GGGHCL.0 size=1048576 2024-08-27T02:38:04.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.447+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~K6OGR2GGGHCL.1 size=1048576 2024-08-27T02:38:04.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~K6OGR2GGGHCL.2 size=399825 2024-08-27T02:38:04.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.451+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=K6OGR2GGGHCL tag=PNZWLM9M57K6 type=write size=3545553 2024-08-27T02:38:04.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.451+0000 7f3e0cc408c0 1 < completed write operation key=XBURHQSU6IML tag=SLTP7LE81ECH type=write size=462738 2024-08-27T02:38:04.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.455+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=F1F5OPOB9THN type=write size=977813 2024-08-27T02:38:04.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.455+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~JZDIE04D87I4.0 size=698411 2024-08-27T02:38:04.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.459+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=JZDIE04D87I4 tag=Y5HUY2O65XBH type=write size=1746987 2024-08-27T02:38:04.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.467+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~2S6R2IW92LFJ.0 size=149542 2024-08-27T02:38:04.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.467+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=2S6R2IW92LFJ tag=OVR45IP116RR type=write size=1198118 2024-08-27T02:38:04.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.467+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=R2FENVNR1OAG type=del 2024-08-27T02:38:04.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.471+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=3F42MN6W3RWN type=del size=2124914 2024-08-27T02:38:04.476 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.475+0000 7f3e0cc408c0 1 < suggested update operation key=2CXWPDABA9XJ tag=XQE0KE4V25ZT type=write size=350129 2024-08-27T02:38:04.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.479+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=TNJ524WM3STK type=del size=1730499 2024-08-27T02:38:04.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.483+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~4FFN1A9U69X2.0 size=415101 2024-08-27T02:38:04.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.487+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=4FFN1A9U69X2 tag=EQY57V0O3BV3 type=write size=1463677 2024-08-27T02:38:04.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.487+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=3V1KVJGDDAO4 type=del size=4065301 2024-08-27T02:38:04.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.495+0000 7f3e0cc408c0 1 < suggested remove operation key=6QE1HU65GQZZ tag=8D56QXDV9Z65 type=del 2024-08-27T02:38:04.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.495+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=51TQ1AJMK6LB type=del size=2651386 2024-08-27T02:38:04.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.499+0000 7f3e0cc408c0 1 < completed write operation key=UGSWC9ZK9S7S tag=DWX09UX3QZF1 type=write size=995198 2024-08-27T02:38:04.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.499+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=TV9XWUMV9PLQ type=write size=230812 2024-08-27T02:38:04.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.503+0000 7f3e0cc408c0 1 < canceled operation key=MNE5WNFBH9HG tag=0ITCEX11EN65 type=del size=3968700 2024-08-27T02:38:04.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.507+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=00AV5ORQOI3C type=del size=3426915 2024-08-27T02:38:04.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.507+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~V2J0CZMXDFCH.0 size=607456 2024-08-27T02:38:04.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.511+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=V2J0CZMXDFCH tag=VBGTNXXMM2HA type=write size=1656032 2024-08-27T02:38:04.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.515+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=6BUT76C69XEK type=write size=705004 2024-08-27T02:38:04.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.515+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=3O7U0O5Q0TJQ type=del 2024-08-27T02:38:04.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.519+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=6MXO1IKMYZOO type=del size=588511 2024-08-27T02:38:04.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.523+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=FQVI4BI3TUW8 type=del 2024-08-27T02:38:04.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.523+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=OZL52RMA7DRN type=write size=904455 2024-08-27T02:38:04.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.527+0000 7f3e0cc408c0 1 < suggested update operation key=13M7JVZT12I2 tag=ZX2GK1KTH327 type=del size=150667 2024-08-27T02:38:04.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~7ZCSB1Q9QCNX.0 size=1048576 2024-08-27T02:38:04.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~7ZCSB1Q9QCNX.1 size=1047462 2024-08-27T02:38:04.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.535+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=7ZCSB1Q9QCNX tag=WLBDKA4BO29X type=write size=3144614 2024-08-27T02:38:04.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.539+0000 7f3e0cc408c0 1 < suggested update operation key=VSDJU5KQLFKE tag=X6ZSWSIT80AM type=del size=3966798 2024-08-27T02:38:04.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.543+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=KBTN3INQ119F type=del size=2979303 2024-08-27T02:38:04.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.543+0000 7f3e0cc408c0 1 < canceled part key=_multipart_MNE5WNFBH9HG.2~GNUL8FS5L86D.0 size=944954 2024-08-27T02:38:04.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.547+0000 7f3e0cc408c0 1 < canceled multipart upload key=MNE5WNFBH9HG upload=GNUL8FS5L86D tag=I6QT70DOYSV5 type=write size=1993530 2024-08-27T02:38:04.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.551+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~AQQ4A2RMV6WT.0 size=1048576 2024-08-27T02:38:04.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.555+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~AQQ4A2RMV6WT.1 size=1048576 2024-08-27T02:38:04.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.555+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~AQQ4A2RMV6WT.2 size=289849 2024-08-27T02:38:04.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.555+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=AQQ4A2RMV6WT tag=2BPULY6H0Z7E type=write size=3435577 2024-08-27T02:38:04.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.559+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~BAS1Y2UDNRF8.0 size=845393 2024-08-27T02:38:04.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.563+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=BAS1Y2UDNRF8 tag=85CCDOA7TI6L type=write size=1893969 2024-08-27T02:38:04.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.567+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=QWA7PASB37HZ type=del size=2496706 2024-08-27T02:38:04.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.567+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~K6OGR2GGGHCL.0 size=1048576 2024-08-27T02:38:04.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.567+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~K6OGR2GGGHCL.1 size=1048576 2024-08-27T02:38:04.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.571+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~K6OGR2GGGHCL.2 size=399825 2024-08-27T02:38:04.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.575+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=K6OGR2GGGHCL tag=PNZWLM9M57K6 type=write size=3545553 2024-08-27T02:38:04.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.575+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=Q32EHQG0V5ZV type=del size=2139136 2024-08-27T02:38:04.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.579+0000 7f3e0cc408c0 1 < completed write operation key=B9DPI871LQ7E tag=F1F5OPOB9THN type=write size=977813 2024-08-27T02:38:04.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.583+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=81DED2ME041G type=del size=1563248 2024-08-27T02:38:04.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.583+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~2S6R2IW92LFJ.0 size=149542 2024-08-27T02:38:04.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.587+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=2S6R2IW92LFJ tag=OVR45IP116RR type=write size=1198118 2024-08-27T02:38:04.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.591+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~KWMQBA08MI34.0 size=1048576 2024-08-27T02:38:04.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.595+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~KWMQBA08MI34.1 size=171999 2024-08-27T02:38:04.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.595+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=KWMQBA08MI34 tag=MLMFH05S1BQO type=write size=2269151 2024-08-27T02:38:04.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.599+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=3F42MN6W3RWN type=del 2024-08-27T02:38:04.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~ZJPIFW3T8PTG.0 size=1048576 2024-08-27T02:38:04.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~ZJPIFW3T8PTG.1 size=182811 2024-08-27T02:38:04.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.603+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=ZJPIFW3T8PTG tag=UALGCXY50N28 type=write size=2279963 2024-08-27T02:38:04.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.611+0000 7f3e0cc408c0 1 < suggested update operation key=1ZIJ9JJTM4ZC tag=TNJ524WM3STK type=del size=1730499 2024-08-27T02:38:04.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.611+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=4CNBB8ZMUB2W type=del size=2634598 2024-08-27T02:38:04.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.615+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=3V1KVJGDDAO4 type=del 2024-08-27T02:38:04.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.619+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=8J36IQ5ZED11 type=del size=2975958 2024-08-27T02:38:04.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.623+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=51TQ1AJMK6LB type=del 2024-08-27T02:38:04.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~3O3LVXSK7P14.0 size=1048576 2024-08-27T02:38:04.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~3O3LVXSK7P14.1 size=100591 2024-08-27T02:38:04.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.627+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=3O3LVXSK7P14 tag=J3KMYSLJZPBZ type=write size=2197743 2024-08-27T02:38:04.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.631+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=TV9XWUMV9PLQ type=write size=230812 2024-08-27T02:38:04.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.635+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=8O826WZMPX89 type=del size=715056 2024-08-27T02:38:04.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.635+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=00AV5ORQOI3C type=del 2024-08-27T02:38:04.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.639+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=1GE0PWP9IREK type=del size=888396 2024-08-27T02:38:04.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.643+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=6BUT76C69XEK type=write size=705004 2024-08-27T02:38:04.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~4OI9CA3ST3SP.0 size=1048576 2024-08-27T02:38:04.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.647+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~4OI9CA3ST3SP.1 size=1048576 2024-08-27T02:38:04.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.651+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~4OI9CA3ST3SP.2 size=953075 2024-08-27T02:38:04.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.651+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=4OI9CA3ST3SP tag=U9HFTSZVSQDN type=write size=4098803 2024-08-27T02:38:04.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.655+0000 7f3e0cc408c0 1 < suggested remove operation key=4SSZQK6YIL1O tag=6MXO1IKMYZOO type=del 2024-08-27T02:38:04.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.659+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=S8NZCKWP36PI type=del size=68714 2024-08-27T02:38:04.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.659+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=OZL52RMA7DRN type=write size=904455 2024-08-27T02:38:04.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.663+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=EZMFE6KT23NP type=del size=2267153 2024-08-27T02:38:04.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.667+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~7ZCSB1Q9QCNX.0 size=1048576 2024-08-27T02:38:04.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.667+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~7ZCSB1Q9QCNX.1 size=1047462 2024-08-27T02:38:04.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.675+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=7ZCSB1Q9QCNX tag=WLBDKA4BO29X type=write size=3144614 2024-08-27T02:38:04.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.679+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=BB3M1HWNC75N type=del size=1421170 2024-08-27T02:38:04.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.679+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=KBTN3INQ119F type=del 2024-08-27T02:38:04.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.687+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~N6KL1TEAV5WR.0 size=942725 2024-08-27T02:38:04.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.687+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=N6KL1TEAV5WR tag=7ZHS96IDVSDJ type=write size=1991301 2024-08-27T02:38:04.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~AQQ4A2RMV6WT.0 size=1048576 2024-08-27T02:38:04.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.691+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~AQQ4A2RMV6WT.1 size=1048576 2024-08-27T02:38:04.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.691+0000 7f3e0cc408c0 1 < canceled part key=_multipart_4BV3C9MTIFT5.2~AQQ4A2RMV6WT.2 size=289849 2024-08-27T02:38:04.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.695+0000 7f3e0cc408c0 1 < canceled multipart upload key=4BV3C9MTIFT5 upload=AQQ4A2RMV6WT tag=2BPULY6H0Z7E type=write size=3435577 2024-08-27T02:38:04.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.699+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=VM17TSPUZDPU type=write size=611582 2024-08-27T02:38:04.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.703+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=QWA7PASB37HZ type=del 2024-08-27T02:38:04.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.703+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=FC8YXSYH26I6 type=del size=1882423 2024-08-27T02:38:04.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.707+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=Q32EHQG0V5ZV type=del 2024-08-27T02:38:04.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.711+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~EX8FO9ZDGZ3M.0 size=1048576 2024-08-27T02:38:04.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.715+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~EX8FO9ZDGZ3M.1 size=454377 2024-08-27T02:38:04.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.715+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=EX8FO9ZDGZ3M tag=BV5C3HSRQTFJ type=write size=2551529 2024-08-27T02:38:04.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.719+0000 7f3e0cc408c0 1 < suggested remove operation key=UGSWC9ZK9S7S tag=81DED2ME041G type=del 2024-08-27T02:38:04.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.719+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=P3VTRBOBOPKN type=write size=55864 2024-08-27T02:38:04.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.723+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~KWMQBA08MI34.0 size=1048576 2024-08-27T02:38:04.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.727+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~KWMQBA08MI34.1 size=171999 2024-08-27T02:38:04.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.731+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=KWMQBA08MI34 tag=MLMFH05S1BQO type=write size=2269151 2024-08-27T02:38:04.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.735+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~NV3MDTBM5JTC.0 size=1048576 2024-08-27T02:38:04.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.735+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~NV3MDTBM5JTC.1 size=1033227 2024-08-27T02:38:04.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.735+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=NV3MDTBM5JTC tag=S8GD5YEFDVF2 type=write size=3130379 2024-08-27T02:38:04.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~ZJPIFW3T8PTG.0 size=1048576 2024-08-27T02:38:04.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.743+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~ZJPIFW3T8PTG.1 size=182811 2024-08-27T02:38:04.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.747+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=ZJPIFW3T8PTG tag=UALGCXY50N28 type=write size=2279963 2024-08-27T02:38:04.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.747+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=JB1I0R3AW5ZV type=write size=288339 2024-08-27T02:38:04.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.755+0000 7f3e0cc408c0 1 < suggested update operation key=MKB40KOOCCNT tag=4CNBB8ZMUB2W type=del size=2634598 2024-08-27T02:38:04.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.755+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=OO22XUDLA9H0 type=del size=1726933 2024-08-27T02:38:04.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.759+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=8J36IQ5ZED11 type=del 2024-08-27T02:38:04.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.763+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~O0NOCLZG6ROZ.0 size=1048576 2024-08-27T02:38:04.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~O0NOCLZG6ROZ.1 size=106747 2024-08-27T02:38:04.766 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.767+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=O0NOCLZG6ROZ tag=0WG3Q899RW35 type=write size=2203899 2024-08-27T02:38:04.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~3O3LVXSK7P14.0 size=1048576 2024-08-27T02:38:04.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.767+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~3O3LVXSK7P14.1 size=100591 2024-08-27T02:38:04.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.771+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=3O3LVXSK7P14 tag=J3KMYSLJZPBZ type=write size=2197743 2024-08-27T02:38:04.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.775+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~WDXF2BMPZPS4.0 size=929341 2024-08-27T02:38:04.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.775+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=WDXF2BMPZPS4 tag=GYFSFCB52YCE type=write size=1977917 2024-08-27T02:38:04.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.783+0000 7f3e0cc408c0 1 < suggested remove operation key=F4MCLPFLY531 tag=8O826WZMPX89 type=del 2024-08-27T02:38:04.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~JZW53EC8B6FF.0 size=1048576 2024-08-27T02:38:04.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~JZW53EC8B6FF.1 size=1048576 2024-08-27T02:38:04.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~JZW53EC8B6FF.2 size=731278 2024-08-27T02:38:04.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.791+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=JZW53EC8B6FF tag=IVIYK7CNSK3K type=write size=3877006 2024-08-27T02:38:04.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.795+0000 7f3e0cc408c0 1 < suggested remove operation key=KTPZGZSQCERQ tag=1GE0PWP9IREK type=del 2024-08-27T02:38:04.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.799+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=6159BY2TAA7A type=del size=2534269 2024-08-27T02:38:04.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.799+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~4OI9CA3ST3SP.0 size=1048576 2024-08-27T02:38:04.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.803+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~4OI9CA3ST3SP.1 size=1048576 2024-08-27T02:38:04.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.803+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~4OI9CA3ST3SP.2 size=953075 2024-08-27T02:38:04.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.807+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=4OI9CA3ST3SP tag=U9HFTSZVSQDN type=write size=4098803 2024-08-27T02:38:04.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.811+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=UM9ZC52IGMQR type=write size=110245 2024-08-27T02:38:04.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.815+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=S8NZCKWP36PI type=del 2024-08-27T02:38:04.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.815+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=KSKV7WG01Y7V type=del size=1491515 2024-08-27T02:38:04.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.819+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=EZMFE6KT23NP type=del 2024-08-27T02:38:04.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~ANZVY5FUKX3A.0 size=641133 2024-08-27T02:38:04.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.823+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=ANZVY5FUKX3A tag=QWKRGA7PVE0C type=write size=1689709 2024-08-27T02:38:04.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.827+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=BB3M1HWNC75N type=del 2024-08-27T02:38:04.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.831+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~M02MCBWD1QNT.0 size=1048576 2024-08-27T02:38:04.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~M02MCBWD1QNT.1 size=881487 2024-08-27T02:38:04.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.835+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=M02MCBWD1QNT tag=ZF5SSQYXC1UX type=write size=2978639 2024-08-27T02:38:04.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.835+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~N6KL1TEAV5WR.0 size=942725 2024-08-27T02:38:04.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.839+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=N6KL1TEAV5WR tag=7ZHS96IDVSDJ type=write size=1991301 2024-08-27T02:38:04.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.847+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~SII242EVH84A.0 size=1048576 2024-08-27T02:38:04.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.847+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~SII242EVH84A.1 size=1048576 2024-08-27T02:38:04.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~SII242EVH84A.2 size=996017 2024-08-27T02:38:04.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.851+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=SII242EVH84A tag=GLDN3BY5XD11 type=write size=4141745 2024-08-27T02:38:04.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.855+0000 7f3e0cc408c0 -1 < failed to complete operation key=KTPZGZSQCERQ tag=VM17TSPUZDPU type=write size=611582: (22) Invalid argument 2024-08-27T02:38:04.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.859+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~DA9UDX836E5F.0 size=1048576 2024-08-27T02:38:04.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.859+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~DA9UDX836E5F.1 size=1048576 2024-08-27T02:38:04.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~DA9UDX836E5F.2 size=163553 2024-08-27T02:38:04.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.863+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=DA9UDX836E5F tag=757LNBKVMMUY type=write size=3309281 2024-08-27T02:38:04.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.867+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=FC8YXSYH26I6 type=del 2024-08-27T02:38:04.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.867+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=D0R94IJ0CJR6 type=del size=2266086 2024-08-27T02:38:04.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.871+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~EX8FO9ZDGZ3M.0 size=1048576 2024-08-27T02:38:04.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.871+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~EX8FO9ZDGZ3M.1 size=454377 2024-08-27T02:38:04.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.879+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=EX8FO9ZDGZ3M tag=BV5C3HSRQTFJ type=write size=2551529 2024-08-27T02:38:04.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.879+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=HQNECQJK4VLJ type=del size=370608 2024-08-27T02:38:04.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.887+0000 7f3e0cc408c0 1 < suggested update operation key=0OLVDEQWBCAQ tag=P3VTRBOBOPKN type=write size=55864 2024-08-27T02:38:04.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.887+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=TOX8XZYQ0AKT type=del size=2719576 2024-08-27T02:38:04.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.891+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~NV3MDTBM5JTC.0 size=1048576 2024-08-27T02:38:04.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.891+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~NV3MDTBM5JTC.1 size=1033227 2024-08-27T02:38:04.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.895+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=NV3MDTBM5JTC tag=S8GD5YEFDVF2 type=write size=3130379 2024-08-27T02:38:04.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.903+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~MESR30RN7CSK.0 size=1048576 2024-08-27T02:38:04.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.903+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~MESR30RN7CSK.1 size=1048576 2024-08-27T02:38:04.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.903+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~MESR30RN7CSK.2 size=444407 2024-08-27T02:38:04.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.903+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=MESR30RN7CSK tag=QZQYPKWU4N9A type=write size=3590135 2024-08-27T02:38:04.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.907+0000 7f3e0cc408c0 1 < completed write operation key=6QE1HU65GQZZ tag=JB1I0R3AW5ZV type=write size=288339 2024-08-27T02:38:04.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.911+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=UU17UJ9KPVQU type=del size=104552 2024-08-27T02:38:04.916 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.915+0000 7f3e0cc408c0 1 < suggested update operation key=JDV1RIGAO7J1 tag=OO22XUDLA9H0 type=del size=1726933 2024-08-27T02:38:04.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.919+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=AHPRR242FL65 type=del size=2814130 2024-08-27T02:38:04.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.923+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~O0NOCLZG6ROZ.0 size=1048576 2024-08-27T02:38:04.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.923+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~O0NOCLZG6ROZ.1 size=106747 2024-08-27T02:38:04.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.927+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=O0NOCLZG6ROZ tag=0WG3Q899RW35 type=write size=2203899 2024-08-27T02:38:04.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.931+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~5RTOLHA28JGC.0 size=1048576 2024-08-27T02:38:04.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~5RTOLHA28JGC.1 size=598971 2024-08-27T02:38:04.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.935+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=5RTOLHA28JGC tag=8OKP3LYZ0UJS type=write size=2696123 2024-08-27T02:38:04.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.935+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~WDXF2BMPZPS4.0 size=929341 2024-08-27T02:38:04.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.943+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=WDXF2BMPZPS4 tag=GYFSFCB52YCE type=write size=1977917 2024-08-27T02:38:04.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~O15HQMDI94HH.0 size=1048576 2024-08-27T02:38:04.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~O15HQMDI94HH.1 size=1048576 2024-08-27T02:38:04.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~O15HQMDI94HH.2 size=193244 2024-08-27T02:38:04.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.947+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=O15HQMDI94HH tag=6J33AHZULT73 type=write size=3338972 2024-08-27T02:38:04.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.951+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~JZW53EC8B6FF.0 size=1048576 2024-08-27T02:38:04.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~JZW53EC8B6FF.1 size=1048576 2024-08-27T02:38:04.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~JZW53EC8B6FF.2 size=731278 2024-08-27T02:38:04.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.959+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=JZW53EC8B6FF tag=IVIYK7CNSK3K type=write size=3877006 2024-08-27T02:38:04.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.963+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=MLTF6VLP51PJ type=del size=209380 2024-08-27T02:38:04.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.967+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=6159BY2TAA7A type=del 2024-08-27T02:38:04.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.967+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=79OWKYZ2B3BV type=write size=476444 2024-08-27T02:38:04.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.971+0000 7f3e0cc408c0 1 < completed write operation key=HTEOX3BV94K2 tag=UM9ZC52IGMQR type=write size=110245 2024-08-27T02:38:04.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~JBJ2ED9ECXPQ.0 size=1048576 2024-08-27T02:38:04.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~JBJ2ED9ECXPQ.1 size=1048576 2024-08-27T02:38:04.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~JBJ2ED9ECXPQ.2 size=959174 2024-08-27T02:38:04.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.979+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=JBJ2ED9ECXPQ tag=5E4RBLDFKG7N type=write size=4104902 2024-08-27T02:38:04.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.983+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=KSKV7WG01Y7V type=del 2024-08-27T02:38:04.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.987+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=BYSSM2A9CTUJ type=del size=3197548 2024-08-27T02:38:04.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.987+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~ANZVY5FUKX3A.0 size=641133 2024-08-27T02:38:04.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.991+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=ANZVY5FUKX3A tag=QWKRGA7PVE0C type=write size=1689709 2024-08-27T02:38:04.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.995+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=D0QCU9NH9R08 type=del size=2178952 2024-08-27T02:38:04.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.999+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~M02MCBWD1QNT.0 size=1048576 2024-08-27T02:38:05.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:04.999+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~M02MCBWD1QNT.1 size=881487 2024-08-27T02:38:05.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.007+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=M02MCBWD1QNT tag=ZF5SSQYXC1UX type=write size=2978639 2024-08-27T02:38:05.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~3HFNA9ZWXJWA.0 size=1048576 2024-08-27T02:38:05.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~3HFNA9ZWXJWA.1 size=1048576 2024-08-27T02:38:05.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.015+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~3HFNA9ZWXJWA.2 size=811807 2024-08-27T02:38:05.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.015+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=3HFNA9ZWXJWA tag=W3Z7V1UTGCZT type=write size=3957535 2024-08-27T02:38:05.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~SII242EVH84A.0 size=1048576 2024-08-27T02:38:05.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~SII242EVH84A.1 size=1048576 2024-08-27T02:38:05.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~SII242EVH84A.2 size=996017 2024-08-27T02:38:05.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.027+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=SII242EVH84A tag=GLDN3BY5XD11 type=write size=4141745 2024-08-27T02:38:05.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.027+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=10XZUF62N9LX type=del size=1851987 2024-08-27T02:38:05.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~DA9UDX836E5F.0 size=1048576 2024-08-27T02:38:05.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~DA9UDX836E5F.1 size=1048576 2024-08-27T02:38:05.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~DA9UDX836E5F.2 size=163553 2024-08-27T02:38:05.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.039+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=DA9UDX836E5F tag=757LNBKVMMUY type=write size=3309281 2024-08-27T02:38:05.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.043+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~FV2II91IM041.0 size=133512 2024-08-27T02:38:05.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.043+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=FV2II91IM041 tag=FANJOE4OLVKW type=write size=1182088 2024-08-27T02:38:05.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.047+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=D0R94IJ0CJR6 type=del 2024-08-27T02:38:05.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~9SPI110S1SBJ.0 size=1048576 2024-08-27T02:38:05.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~9SPI110S1SBJ.1 size=860364 2024-08-27T02:38:05.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.051+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=9SPI110S1SBJ tag=OKJ43RMK4U20 type=write size=2957516 2024-08-27T02:38:05.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.055+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=HQNECQJK4VLJ type=del 2024-08-27T02:38:05.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.059+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~M06UG9PI4WH4.0 size=265836 2024-08-27T02:38:05.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.059+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=M06UG9PI4WH4 tag=18TK5NWNL600 type=write size=1314412 2024-08-27T02:38:05.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.063+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=TOX8XZYQ0AKT type=del 2024-08-27T02:38:05.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.067+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=U4CR38PGWX40 type=del size=847074 2024-08-27T02:38:05.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~MESR30RN7CSK.0 size=1048576 2024-08-27T02:38:05.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.071+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~MESR30RN7CSK.1 size=1048576 2024-08-27T02:38:05.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.071+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~MESR30RN7CSK.2 size=444407 2024-08-27T02:38:05.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.079+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=MESR30RN7CSK tag=QZQYPKWU4N9A type=write size=3590135 2024-08-27T02:38:05.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.079+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=2YX2GGOY6HIJ type=del size=1911643 2024-08-27T02:38:05.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.083+0000 7f3e0cc408c0 1 < suggested update operation key=MKB40KOOCCNT tag=UU17UJ9KPVQU type=del size=104552 2024-08-27T02:38:05.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.091+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~1J06V9P0649B.0 size=681883 2024-08-27T02:38:05.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.091+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=1J06V9P0649B tag=OIPH14T49G2N type=write size=1730459 2024-08-27T02:38:05.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.091+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=AHPRR242FL65 type=del 2024-08-27T02:38:05.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~VOG6EZ6YOQ3Z.0 size=658843 2024-08-27T02:38:05.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.099+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=VOG6EZ6YOQ3Z tag=Z06S9PU8JV1C type=write size=1707419 2024-08-27T02:38:05.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.099+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~5RTOLHA28JGC.0 size=1048576 2024-08-27T02:38:05.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.103+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~5RTOLHA28JGC.1 size=598971 2024-08-27T02:38:05.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.107+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=5RTOLHA28JGC tag=8OKP3LYZ0UJS type=write size=2696123 2024-08-27T02:38:05.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.111+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~6AXE1IQVCXNV.0 size=548954 2024-08-27T02:38:05.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.111+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=6AXE1IQVCXNV tag=36JWKF95M8L4 type=write size=1597530 2024-08-27T02:38:05.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~O15HQMDI94HH.0 size=1048576 2024-08-27T02:38:05.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~O15HQMDI94HH.1 size=1048576 2024-08-27T02:38:05.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~O15HQMDI94HH.2 size=193244 2024-08-27T02:38:05.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.123+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=O15HQMDI94HH tag=6J33AHZULT73 type=write size=3338972 2024-08-27T02:38:05.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~VSGVZHET15C5.0 size=1048576 2024-08-27T02:38:05.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~VSGVZHET15C5.1 size=810154 2024-08-27T02:38:05.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.131+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=VSGVZHET15C5 tag=O2AZA6NNULB7 type=write size=2907306 2024-08-27T02:38:05.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.139+0000 7f3e0cc408c0 1 < suggested update operation key=OY551242R8T6 tag=MLTF6VLP51PJ type=del size=209380 2024-08-27T02:38:05.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.139+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=6M5FLVF9Z7Z6 type=del size=210444 2024-08-27T02:38:05.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.143+0000 7f3e0cc408c0 1 < completed write operation key=13M7JVZT12I2 tag=79OWKYZ2B3BV type=write size=476444 2024-08-27T02:38:05.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.147+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=QW8YRYDG8JOP type=del size=673044 2024-08-27T02:38:05.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.147+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~JBJ2ED9ECXPQ.0 size=1048576 2024-08-27T02:38:05.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.151+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~JBJ2ED9ECXPQ.1 size=1048576 2024-08-27T02:38:05.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~JBJ2ED9ECXPQ.2 size=959174 2024-08-27T02:38:05.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.163+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=JBJ2ED9ECXPQ tag=5E4RBLDFKG7N type=write size=4104902 2024-08-27T02:38:05.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.167+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~Q0UC3AKUAQIH.0 size=255626 2024-08-27T02:38:05.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.167+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=Q0UC3AKUAQIH tag=TBKT049VE6VV type=write size=1304202 2024-08-27T02:38:05.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.171+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=BYSSM2A9CTUJ type=del 2024-08-27T02:38:05.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.175+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=0B8WMBVPYL5J type=write size=648845 2024-08-27T02:38:05.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.175+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=D0QCU9NH9R08 type=del 2024-08-27T02:38:05.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.179+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=0A38AS5RP9Y2 type=del size=4114952 2024-08-27T02:38:05.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.183+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~3HFNA9ZWXJWA.0 size=1048576 2024-08-27T02:38:05.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.183+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~3HFNA9ZWXJWA.1 size=1048576 2024-08-27T02:38:05.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.187+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~3HFNA9ZWXJWA.2 size=811807 2024-08-27T02:38:05.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.191+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=3HFNA9ZWXJWA tag=W3Z7V1UTGCZT type=write size=3957535 2024-08-27T02:38:05.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.191+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=7LJ4RLEUGY09 type=del size=1179786 2024-08-27T02:38:05.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.199+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=10XZUF62N9LX type=del 2024-08-27T02:38:05.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~D8LFS3H1PI88.0 size=1048576 2024-08-27T02:38:05.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~D8LFS3H1PI88.1 size=159425 2024-08-27T02:38:05.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.203+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=D8LFS3H1PI88 tag=9366TJBOMOGO type=write size=2256577 2024-08-27T02:38:05.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.207+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~FV2II91IM041.0 size=133512 2024-08-27T02:38:05.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.211+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=FV2II91IM041 tag=FANJOE4OLVKW type=write size=1182088 2024-08-27T02:38:05.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.215+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=PVEJ7BSFI8W7 type=del size=1234646 2024-08-27T02:38:05.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.215+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~9SPI110S1SBJ.0 size=1048576 2024-08-27T02:38:05.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.219+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~9SPI110S1SBJ.1 size=860364 2024-08-27T02:38:05.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.223+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=9SPI110S1SBJ tag=OKJ43RMK4U20 type=write size=2957516 2024-08-27T02:38:05.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.227+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=FNBV0BXZXAKN type=del size=2944856 2024-08-27T02:38:05.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.227+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~M06UG9PI4WH4.0 size=265836 2024-08-27T02:38:05.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.231+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=M06UG9PI4WH4 tag=18TK5NWNL600 type=write size=1314412 2024-08-27T02:38:05.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.235+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~B8F37SX9KS76.0 size=1032961 2024-08-27T02:38:05.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.235+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=B8F37SX9KS76 tag=SG7TOYLPCLGV type=write size=2081537 2024-08-27T02:38:05.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.239+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=U4CR38PGWX40 type=del 2024-08-27T02:38:05.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.243+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~S9GO94W9MUZC.0 size=1048576 2024-08-27T02:38:05.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~S9GO94W9MUZC.1 size=1048576 2024-08-27T02:38:05.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~S9GO94W9MUZC.2 size=875422 2024-08-27T02:38:05.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.247+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=S9GO94W9MUZC tag=HV1H7XWEGDD8 type=write size=4021150 2024-08-27T02:38:05.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.251+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=2YX2GGOY6HIJ type=del 2024-08-27T02:38:05.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.255+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~4NWV5MYGDCOY.0 size=1048576 2024-08-27T02:38:05.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~4NWV5MYGDCOY.1 size=1048576 2024-08-27T02:38:05.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~4NWV5MYGDCOY.2 size=952153 2024-08-27T02:38:05.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.259+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=4NWV5MYGDCOY tag=PFEWIK1I62RQ type=write size=4097881 2024-08-27T02:38:05.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.263+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~1J06V9P0649B.0 size=681883 2024-08-27T02:38:05.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.267+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=1J06V9P0649B tag=OIPH14T49G2N type=write size=1730459 2024-08-27T02:38:05.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.271+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=K9KRPGWX26IU type=del size=2457032 2024-08-27T02:38:05.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.275+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~VOG6EZ6YOQ3Z.0 size=658843 2024-08-27T02:38:05.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.279+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=VOG6EZ6YOQ3Z tag=Z06S9PU8JV1C type=write size=1707419 2024-08-27T02:38:05.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.283+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=K69HB8FWIH0K type=del size=1454079 2024-08-27T02:38:05.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.283+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~6AXE1IQVCXNV.0 size=548954 2024-08-27T02:38:05.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.287+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=6AXE1IQVCXNV tag=36JWKF95M8L4 type=write size=1597530 2024-08-27T02:38:05.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.291+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=00MFQ5V6JPAA type=del size=651205 2024-08-27T02:38:05.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.295+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~VSGVZHET15C5.0 size=1048576 2024-08-27T02:38:05.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.295+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~VSGVZHET15C5.1 size=810154 2024-08-27T02:38:05.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.299+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=VSGVZHET15C5 tag=O2AZA6NNULB7 type=write size=2907306 2024-08-27T02:38:05.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.303+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=UM31AQBO13L7 type=del size=2184047 2024-08-27T02:38:05.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.303+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=6M5FLVF9Z7Z6 type=del 2024-08-27T02:38:05.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.307+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=74O5GKE6PQ0T type=del size=3331377 2024-08-27T02:38:05.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.307+0000 7f3e0cc408c0 -1 < failed to complete operation key=JDV1RIGAO7J1 tag=QW8YRYDG8JOP type=del size=673044: (22) Invalid argument 2024-08-27T02:38:05.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~OAZI21XD2IG5.0 size=651453 2024-08-27T02:38:05.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.315+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=OAZI21XD2IG5 tag=75K96ODGNNCO type=write size=1700029 2024-08-27T02:38:05.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.315+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~Q0UC3AKUAQIH.0 size=255626 2024-08-27T02:38:05.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.319+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=Q0UC3AKUAQIH tag=TBKT049VE6VV type=write size=1304202 2024-08-27T02:38:05.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~IB811FHU1P4G.0 size=1048576 2024-08-27T02:38:05.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~IB811FHU1P4G.1 size=740405 2024-08-27T02:38:05.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.327+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=IB811FHU1P4G tag=APWAS9RALMU0 type=write size=2837557 2024-08-27T02:38:05.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.331+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=0B8WMBVPYL5J type=write size=648845 2024-08-27T02:38:05.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~HSNHOABUB6EZ.0 size=1048576 2024-08-27T02:38:05.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~HSNHOABUB6EZ.1 size=569600 2024-08-27T02:38:05.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.335+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=HSNHOABUB6EZ tag=JTITGOSJC02E type=write size=2666752 2024-08-27T02:38:05.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.339+0000 7f3e0cc408c0 1 < canceled operation key=13M7JVZT12I2 tag=0A38AS5RP9Y2 type=del size=4114952 2024-08-27T02:38:05.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.343+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=2F2YCN7YDWMN type=del size=2984538 2024-08-27T02:38:05.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.343+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=7LJ4RLEUGY09 type=del 2024-08-27T02:38:05.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.351+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~5MRWCT5NGSV7.0 size=1048576 2024-08-27T02:38:05.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.351+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~5MRWCT5NGSV7.1 size=854049 2024-08-27T02:38:05.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.351+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=5MRWCT5NGSV7 tag=4VH7KVO35JEX type=write size=2951201 2024-08-27T02:38:05.354 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.355+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~D8LFS3H1PI88.0 size=1048576 2024-08-27T02:38:05.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.355+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~D8LFS3H1PI88.1 size=159425 2024-08-27T02:38:05.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.359+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=D8LFS3H1PI88 tag=9366TJBOMOGO type=write size=2256577 2024-08-27T02:38:05.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.363+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=404NCR328HAR type=del size=3526009 2024-08-27T02:38:05.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.367+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=PVEJ7BSFI8W7 type=del 2024-08-27T02:38:05.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.367+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=1CYT4UYR33FF type=del size=210247 2024-08-27T02:38:05.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.371+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=FNBV0BXZXAKN type=del 2024-08-27T02:38:05.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.375+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=ZHM8DPB9HZYV type=del size=2786951 2024-08-27T02:38:05.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.375+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~B8F37SX9KS76.0 size=1032961 2024-08-27T02:38:05.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.379+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=B8F37SX9KS76 tag=SG7TOYLPCLGV type=write size=2081537 2024-08-27T02:38:05.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~N3CZJH752I1M.0 size=495768 2024-08-27T02:38:05.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.383+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=N3CZJH752I1M tag=JU1IJFGIQL4L type=write size=1544344 2024-08-27T02:38:05.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~S9GO94W9MUZC.0 size=1048576 2024-08-27T02:38:05.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~S9GO94W9MUZC.1 size=1048576 2024-08-27T02:38:05.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~S9GO94W9MUZC.2 size=875422 2024-08-27T02:38:05.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.399+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=S9GO94W9MUZC tag=HV1H7XWEGDD8 type=write size=4021150 2024-08-27T02:38:05.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.403+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=FO75VOKH6H7U type=del size=1803400 2024-08-27T02:38:05.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.403+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~4NWV5MYGDCOY.0 size=1048576 2024-08-27T02:38:05.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.407+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~4NWV5MYGDCOY.1 size=1048576 2024-08-27T02:38:05.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.407+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~4NWV5MYGDCOY.2 size=952153 2024-08-27T02:38:05.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.415+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=4NWV5MYGDCOY tag=PFEWIK1I62RQ type=write size=4097881 2024-08-27T02:38:05.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.415+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=97ZR3WP1UABH type=write size=884864 2024-08-27T02:38:05.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.419+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=K9KRPGWX26IU type=del 2024-08-27T02:38:05.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.423+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~3GRJ79H24F5O.0 size=1048576 2024-08-27T02:38:05.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~3GRJ79H24F5O.1 size=1048576 2024-08-27T02:38:05.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.427+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~3GRJ79H24F5O.2 size=927042 2024-08-27T02:38:05.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.427+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=3GRJ79H24F5O tag=PC2W2NQZLR7I type=write size=4072770 2024-08-27T02:38:05.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.431+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=K69HB8FWIH0K type=del size=1454079 2024-08-27T02:38:05.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.435+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=5GL1XIMPVIMJ type=del size=203969 2024-08-27T02:38:05.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.439+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=00MFQ5V6JPAA type=del 2024-08-27T02:38:05.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.443+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=OIAVABZCGSII type=del size=4150677 2024-08-27T02:38:05.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.443+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=UM31AQBO13L7 type=del 2024-08-27T02:38:05.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.447+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=V4SX1YCXG97T type=del size=3717164 2024-08-27T02:38:05.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.447+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=74O5GKE6PQ0T type=del 2024-08-27T02:38:05.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.451+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=W6TJ22M7E8JW type=del size=3679241 2024-08-27T02:38:05.454 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.455+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~OAZI21XD2IG5.0 size=651453 2024-08-27T02:38:05.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.459+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=OAZI21XD2IG5 tag=75K96ODGNNCO type=write size=1700029 2024-08-27T02:38:05.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.463+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=ONJXMSVDSAF4 type=del size=3634479 2024-08-27T02:38:05.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.463+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~IB811FHU1P4G.0 size=1048576 2024-08-27T02:38:05.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.467+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~IB811FHU1P4G.1 size=740405 2024-08-27T02:38:05.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.471+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=IB811FHU1P4G tag=APWAS9RALMU0 type=write size=2837557 2024-08-27T02:38:05.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.475+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=ZWHFE39GF3WN type=del size=3019382 2024-08-27T02:38:05.476 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~HSNHOABUB6EZ.0 size=1048576 2024-08-27T02:38:05.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.479+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~HSNHOABUB6EZ.1 size=569600 2024-08-27T02:38:05.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.483+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=HSNHOABUB6EZ tag=JTITGOSJC02E type=write size=2666752 2024-08-27T02:38:05.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.487+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=H9ME80UE7CKF type=del size=3278705 2024-08-27T02:38:05.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.491+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=2F2YCN7YDWMN type=del 2024-08-27T02:38:05.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.495+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=0GCANMYQ8JL4 type=del size=682046 2024-08-27T02:38:05.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.495+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~5MRWCT5NGSV7.0 size=1048576 2024-08-27T02:38:05.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.499+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~5MRWCT5NGSV7.1 size=854049 2024-08-27T02:38:05.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.503+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=5MRWCT5NGSV7 tag=4VH7KVO35JEX type=write size=2951201 2024-08-27T02:38:05.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.507+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=XKNQ19M4EKA0 type=del size=409738 2024-08-27T02:38:05.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.511+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=404NCR328HAR type=del 2024-08-27T02:38:05.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.515+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~2MBUV8KE0LKZ.0 size=1048576 2024-08-27T02:38:05.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.519+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~2MBUV8KE0LKZ.1 size=995715 2024-08-27T02:38:05.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.519+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=2MBUV8KE0LKZ tag=QX88LHRIPXY2 type=write size=3092867 2024-08-27T02:38:05.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.523+0000 7f3e0cc408c0 1 < suggested remove operation key=13M7JVZT12I2 tag=1CYT4UYR33FF type=del 2024-08-27T02:38:05.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~XHDM0XBF2YKA.0 size=1048576 2024-08-27T02:38:05.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~XHDM0XBF2YKA.1 size=1048576 2024-08-27T02:38:05.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~XHDM0XBF2YKA.2 size=457720 2024-08-27T02:38:05.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.531+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=XHDM0XBF2YKA tag=QY1LRZS8KHOW type=write size=3603448 2024-08-27T02:38:05.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.535+0000 7f3e0cc408c0 1 < suggested update operation key=KTPZGZSQCERQ tag=ZHM8DPB9HZYV type=del size=2786951 2024-08-27T02:38:05.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.539+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=WHI3Q2A40LCX type=write size=785917 2024-08-27T02:38:05.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.539+0000 7f3e0cc408c0 1 < canceled part key=_multipart_D7YWS7BWXT37.2~N3CZJH752I1M.0 size=495768 2024-08-27T02:38:05.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.543+0000 7f3e0cc408c0 1 < canceled multipart upload key=D7YWS7BWXT37 upload=N3CZJH752I1M tag=JU1IJFGIQL4L type=write size=1544344 2024-08-27T02:38:05.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.551+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~1IQ6WXG6SG49.0 size=1048576 2024-08-27T02:38:05.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.551+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~1IQ6WXG6SG49.1 size=1029714 2024-08-27T02:38:05.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.551+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=1IQ6WXG6SG49 tag=OL5C46M93L07 type=write size=3126866 2024-08-27T02:38:05.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.559+0000 7f3e0cc408c0 1 < suggested update operation key=6YTZJKE4V5HQ tag=FO75VOKH6H7U type=del size=1803400 2024-08-27T02:38:05.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.563+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=901J0ZMO1QTH type=del size=2490782 2024-08-27T02:38:05.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.567+0000 7f3e0cc408c0 1 < completed write operation key=A0RUXE4YL6NR tag=97ZR3WP1UABH type=write size=884864 2024-08-27T02:38:05.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.571+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=X2ZJ1X1O1F12 type=del size=833888 2024-08-27T02:38:05.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.571+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~3GRJ79H24F5O.0 size=1048576 2024-08-27T02:38:05.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.575+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~3GRJ79H24F5O.1 size=1048576 2024-08-27T02:38:05.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~3GRJ79H24F5O.2 size=927042 2024-08-27T02:38:05.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.583+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=3GRJ79H24F5O tag=PC2W2NQZLR7I type=write size=4072770 2024-08-27T02:38:05.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.587+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=WXC3P3PMYJP6 type=write size=945797 2024-08-27T02:38:05.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.591+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=5GL1XIMPVIMJ type=del 2024-08-27T02:38:05.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.595+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=D0XZXBF1IBKF type=del size=3882618 2024-08-27T02:38:05.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.599+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=OIAVABZCGSII type=del 2024-08-27T02:38:05.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.603+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=FAX3P659G2C7 type=del size=1169828 2024-08-27T02:38:05.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.607+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=V4SX1YCXG97T type=del 2024-08-27T02:38:05.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.611+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~QD3A528TEY2O.0 size=610676 2024-08-27T02:38:05.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.611+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=QD3A528TEY2O tag=NY72NVCH2P4V type=write size=1659252 2024-08-27T02:38:05.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.615+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=W6TJ22M7E8JW type=del 2024-08-27T02:38:05.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.623+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~GWQZBTAYT7PM.0 size=1048576 2024-08-27T02:38:05.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.623+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~GWQZBTAYT7PM.1 size=1048576 2024-08-27T02:38:05.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~GWQZBTAYT7PM.2 size=255324 2024-08-27T02:38:05.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.627+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=GWQZBTAYT7PM tag=IEYGFAYW54DW type=write size=3401052 2024-08-27T02:38:05.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.631+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=ONJXMSVDSAF4 type=del 2024-08-27T02:38:05.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.639+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~YQ4EPMRXX3K3.0 size=1048576 2024-08-27T02:38:05.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.639+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~YQ4EPMRXX3K3.1 size=1048576 2024-08-27T02:38:05.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.643+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~YQ4EPMRXX3K3.2 size=54147 2024-08-27T02:38:05.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.643+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=YQ4EPMRXX3K3 tag=42XYM8JPROP9 type=write size=3199875 2024-08-27T02:38:05.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.651+0000 7f3e0cc408c0 1 < suggested update operation key=2CXWPDABA9XJ tag=ZWHFE39GF3WN type=del size=3019382 2024-08-27T02:38:05.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.659+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~EXM1HW4NXNG0.0 size=1048576 2024-08-27T02:38:05.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.659+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~EXM1HW4NXNG0.1 size=1048576 2024-08-27T02:38:05.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.663+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~EXM1HW4NXNG0.2 size=294430 2024-08-27T02:38:05.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.663+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=EXM1HW4NXNG0 tag=8RTLN5F84NNO type=write size=3440158 2024-08-27T02:38:05.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.671+0000 7f3e0cc408c0 1 < suggested update operation key=ZMN8Y0VQVHLB tag=H9ME80UE7CKF type=del size=3278705 2024-08-27T02:38:05.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.671+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=8NZS6PFC1G84 type=del size=2978982 2024-08-27T02:38:05.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.675+0000 7f3e0cc408c0 -1 < failed to complete operation key=13M7JVZT12I2 tag=0GCANMYQ8JL4 type=del size=682046: (22) Invalid argument 2024-08-27T02:38:05.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.683+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=M8CG9PJDVPH1 type=write size=823147 2024-08-27T02:38:05.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.687+0000 7f3e0cc408c0 -1 < failed to complete operation key=KTPZGZSQCERQ tag=XKNQ19M4EKA0 type=del size=409738: (22) Invalid argument 2024-08-27T02:38:05.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.691+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=7DSPBE9W7MBL type=del size=3280196 2024-08-27T02:38:05.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.695+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~2MBUV8KE0LKZ.0 size=1048576 2024-08-27T02:38:05.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.695+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~2MBUV8KE0LKZ.1 size=995715 2024-08-27T02:38:05.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.703+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=2MBUV8KE0LKZ tag=QX88LHRIPXY2 type=write size=3092867 2024-08-27T02:38:05.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.703+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=SRTLKASXLF5C type=del size=808318 2024-08-27T02:38:05.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.707+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~XHDM0XBF2YKA.0 size=1048576 2024-08-27T02:38:05.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~XHDM0XBF2YKA.1 size=1048576 2024-08-27T02:38:05.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.711+0000 7f3e0cc408c0 1 < canceled part key=_multipart_SG9T1RD5EATR.2~XHDM0XBF2YKA.2 size=457720 2024-08-27T02:38:05.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.719+0000 7f3e0cc408c0 1 < canceled multipart upload key=SG9T1RD5EATR upload=XHDM0XBF2YKA tag=QY1LRZS8KHOW type=write size=3603448 2024-08-27T02:38:05.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.719+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=I6M9TLKJ0SKQ type=del size=2905059 2024-08-27T02:38:05.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.727+0000 7f3e0cc408c0 1 < suggested update operation key=8VSA6T2H8FDI tag=WHI3Q2A40LCX type=write size=785917 2024-08-27T02:38:05.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.731+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=KR7SCGIWS4DO type=del size=3305666 2024-08-27T02:38:05.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.735+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~1IQ6WXG6SG49.0 size=1048576 2024-08-27T02:38:05.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.735+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~1IQ6WXG6SG49.1 size=1029714 2024-08-27T02:38:05.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.739+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=1IQ6WXG6SG49 tag=OL5C46M93L07 type=write size=3126866 2024-08-27T02:38:05.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.743+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=A81JYK56EDJU type=del size=2630452 2024-08-27T02:38:05.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.747+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=901J0ZMO1QTH type=del 2024-08-27T02:38:05.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.751+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=RIZMMSARGHIX type=del size=2894850 2024-08-27T02:38:05.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.755+0000 7f3e0cc408c0 1 < suggested remove operation key=A0RUXE4YL6NR tag=X2ZJ1X1O1F12 type=del 2024-08-27T02:38:05.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~1LH44T0GA4QF.0 size=770426 2024-08-27T02:38:05.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.759+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=1LH44T0GA4QF tag=9LPKYTJXL8H6 type=write size=1819002 2024-08-27T02:38:05.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.763+0000 7f3e0cc408c0 1 < completed write operation key=MNE5WNFBH9HG tag=WXC3P3PMYJP6 type=write size=945797 2024-08-27T02:38:05.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.771+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~14OJ94FYR2N8.0 size=1048576 2024-08-27T02:38:05.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.771+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~14OJ94FYR2N8.1 size=569910 2024-08-27T02:38:05.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.771+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=14OJ94FYR2N8 tag=4KT6FZ6U0UT5 type=write size=2667062 2024-08-27T02:38:05.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.775+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=D0XZXBF1IBKF type=del 2024-08-27T02:38:05.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.783+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~MA8CWQ7O7AK8.0 size=1048576 2024-08-27T02:38:05.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.783+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~MA8CWQ7O7AK8.1 size=1048576 2024-08-27T02:38:05.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~MA8CWQ7O7AK8.2 size=373398 2024-08-27T02:38:05.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.787+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=MA8CWQ7O7AK8 tag=N13H60QTBWAY type=write size=3519126 2024-08-27T02:38:05.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.791+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=FAX3P659G2C7 type=del 2024-08-27T02:38:05.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.795+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=DIEB9F21P2K5 type=del size=2248844 2024-08-27T02:38:05.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.799+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~QD3A528TEY2O.0 size=610676 2024-08-27T02:38:05.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.803+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=QD3A528TEY2O tag=NY72NVCH2P4V type=write size=1659252 2024-08-27T02:38:05.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~CY2GZ6XF4ZZK.0 size=1048576 2024-08-27T02:38:05.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.815+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~CY2GZ6XF4ZZK.1 size=1048576 2024-08-27T02:38:05.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.815+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~CY2GZ6XF4ZZK.2 size=535347 2024-08-27T02:38:05.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.815+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=CY2GZ6XF4ZZK tag=29GJRGXP1M4N type=write size=3681075 2024-08-27T02:38:05.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~GWQZBTAYT7PM.0 size=1048576 2024-08-27T02:38:05.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.823+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~GWQZBTAYT7PM.1 size=1048576 2024-08-27T02:38:05.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.827+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~GWQZBTAYT7PM.2 size=255324 2024-08-27T02:38:05.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.831+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=GWQZBTAYT7PM tag=IEYGFAYW54DW type=write size=3401052 2024-08-27T02:38:05.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.839+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~Z4VGHXWS3YHL.0 size=1048576 2024-08-27T02:38:05.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.843+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~Z4VGHXWS3YHL.1 size=1048576 2024-08-27T02:38:05.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.843+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~Z4VGHXWS3YHL.2 size=672174 2024-08-27T02:38:05.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.843+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=Z4VGHXWS3YHL tag=1B1VMD87RP0N type=write size=3817902 2024-08-27T02:38:05.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.847+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~YQ4EPMRXX3K3.0 size=1048576 2024-08-27T02:38:05.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~YQ4EPMRXX3K3.1 size=1048576 2024-08-27T02:38:05.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~YQ4EPMRXX3K3.2 size=54147 2024-08-27T02:38:05.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.859+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=YQ4EPMRXX3K3 tag=42XYM8JPROP9 type=write size=3199875 2024-08-27T02:38:05.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.859+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=0A79816JFS4H type=write size=1029814 2024-08-27T02:38:05.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.863+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~EXM1HW4NXNG0.0 size=1048576 2024-08-27T02:38:05.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~EXM1HW4NXNG0.1 size=1048576 2024-08-27T02:38:05.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~EXM1HW4NXNG0.2 size=294430 2024-08-27T02:38:05.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.875+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=EXM1HW4NXNG0 tag=8RTLN5F84NNO type=write size=3440158 2024-08-27T02:38:05.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.875+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=QGLYJZSNXSR4 type=del size=922728 2024-08-27T02:38:05.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.883+0000 7f3e0cc408c0 1 < suggested remove operation key=SG9T1RD5EATR tag=8NZS6PFC1G84 type=del 2024-08-27T02:38:05.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.887+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=U9HGVJ6CN02A type=del size=3455699 2024-08-27T02:38:05.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.891+0000 7f3e0cc408c0 1 < suggested remove operation key=4SSZQK6YIL1O tag=M8CG9PJDVPH1 type=write 2024-08-27T02:38:05.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.895+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=3JNI3Q4M2AL3 type=del size=2321150 2024-08-27T02:38:05.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.899+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=7DSPBE9W7MBL type=del 2024-08-27T02:38:05.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.903+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=5B27P5DIJ17V type=del size=1436648 2024-08-27T02:38:05.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.903+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=SRTLKASXLF5C type=del 2024-08-27T02:38:05.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.911+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~7V1X0388N9U6.0 size=179070 2024-08-27T02:38:05.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.911+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=7V1X0388N9U6 tag=RV6NCSEYNNUF type=write size=1227646 2024-08-27T02:38:05.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.915+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=I6M9TLKJ0SKQ type=del 2024-08-27T02:38:05.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.919+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~LTBCMRDELF6P.0 size=1048576 2024-08-27T02:38:05.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.923+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~LTBCMRDELF6P.1 size=1048576 2024-08-27T02:38:05.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.923+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~LTBCMRDELF6P.2 size=644281 2024-08-27T02:38:05.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.923+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=LTBCMRDELF6P tag=YF9RWZHAAVDB type=write size=3790009 2024-08-27T02:38:05.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.931+0000 7f3e0cc408c0 1 < suggested remove operation key=O66XJ7GJMPCU tag=KR7SCGIWS4DO type=del 2024-08-27T02:38:05.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.935+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=4GGG9VG90BFV type=del size=1904706 2024-08-27T02:38:05.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.939+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=A81JYK56EDJU type=del 2024-08-27T02:38:05.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.939+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=N4W3P72CHJL9 type=del size=3585995 2024-08-27T02:38:05.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.943+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=RIZMMSARGHIX type=del 2024-08-27T02:38:05.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.947+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=RJH78XDNI8R9 type=del size=3546067 2024-08-27T02:38:05.950 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.951+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~1LH44T0GA4QF.0 size=770426 2024-08-27T02:38:05.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.955+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=1LH44T0GA4QF tag=9LPKYTJXL8H6 type=write size=1819002 2024-08-27T02:38:05.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.959+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=DZHA6NCOFR9L type=del size=3943595 2024-08-27T02:38:05.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.963+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~14OJ94FYR2N8.0 size=1048576 2024-08-27T02:38:05.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.967+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~14OJ94FYR2N8.1 size=569910 2024-08-27T02:38:05.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.971+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=14OJ94FYR2N8 tag=4KT6FZ6U0UT5 type=write size=2667062 2024-08-27T02:38:05.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.975+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=DCFMK077V8XE type=write size=299037 2024-08-27T02:38:05.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.979+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~MA8CWQ7O7AK8.0 size=1048576 2024-08-27T02:38:05.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.983+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~MA8CWQ7O7AK8.1 size=1048576 2024-08-27T02:38:05.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~MA8CWQ7O7AK8.2 size=373398 2024-08-27T02:38:05.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:05.995+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=MA8CWQ7O7AK8 tag=N13H60QTBWAY type=write size=3519126 2024-08-27T02:38:06.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~9S4E819FYTTF.0 size=470560 2024-08-27T02:38:06.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.003+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=9S4E819FYTTF tag=D58AY3YW22BL type=write size=1519136 2024-08-27T02:38:06.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.007+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=DIEB9F21P2K5 type=del 2024-08-27T02:38:06.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.011+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=8J4EYFLC20VJ type=del size=3115708 2024-08-27T02:38:06.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.011+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~CY2GZ6XF4ZZK.0 size=1048576 2024-08-27T02:38:06.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.015+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~CY2GZ6XF4ZZK.1 size=1048576 2024-08-27T02:38:06.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~CY2GZ6XF4ZZK.2 size=535347 2024-08-27T02:38:06.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.023+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=CY2GZ6XF4ZZK tag=29GJRGXP1M4N type=write size=3681075 2024-08-27T02:38:06.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.027+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=Z2AN2D7M7B0M type=del size=3437066 2024-08-27T02:38:06.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~Z4VGHXWS3YHL.0 size=1048576 2024-08-27T02:38:06.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~Z4VGHXWS3YHL.1 size=1048576 2024-08-27T02:38:06.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~Z4VGHXWS3YHL.2 size=672174 2024-08-27T02:38:06.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.039+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=Z4VGHXWS3YHL tag=1B1VMD87RP0N type=write size=3817902 2024-08-27T02:38:06.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.047+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~N4F1P69FHBFI.0 size=25852 2024-08-27T02:38:06.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.047+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=N4F1P69FHBFI tag=FU2B9RV8WGET type=write size=1074428 2024-08-27T02:38:06.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.051+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=0A79816JFS4H type=write size=1029814 2024-08-27T02:38:06.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.055+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=FLHTCXB39UA2 type=del size=3152465 2024-08-27T02:38:06.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.059+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=QGLYJZSNXSR4 type=del 2024-08-27T02:38:06.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.063+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~6W0VZKNVMX5L.0 size=1048576 2024-08-27T02:38:06.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.067+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~6W0VZKNVMX5L.1 size=178696 2024-08-27T02:38:06.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.067+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=6W0VZKNVMX5L tag=0IA7K071MJMX type=write size=2275848 2024-08-27T02:38:06.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.067+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=U9HGVJ6CN02A type=del 2024-08-27T02:38:06.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.071+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=UOYEKUXGZUR9 type=del size=3861901 2024-08-27T02:38:06.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.075+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=3JNI3Q4M2AL3 type=del 2024-08-27T02:38:06.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.079+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=QI8UYH9AU3WE type=del size=964284 2024-08-27T02:38:06.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.083+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=5B27P5DIJ17V type=del 2024-08-27T02:38:06.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.087+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=SB9U5LFZOYM7 type=del size=587764 2024-08-27T02:38:06.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.091+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~7V1X0388N9U6.0 size=179070 2024-08-27T02:38:06.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.095+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=7V1X0388N9U6 tag=RV6NCSEYNNUF type=write size=1227646 2024-08-27T02:38:06.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~5MA07D2JN8SX.0 size=1048576 2024-08-27T02:38:06.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~5MA07D2JN8SX.1 size=1048576 2024-08-27T02:38:06.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~5MA07D2JN8SX.2 size=618475 2024-08-27T02:38:06.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.107+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=5MA07D2JN8SX tag=PB54RXKXCZCB type=write size=3764203 2024-08-27T02:38:06.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.107+0000 7f3e0cc408c0 1 < canceled part key=_multipart_S5ANS33DXN7X.2~LTBCMRDELF6P.0 size=1048576 2024-08-27T02:38:06.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.111+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~LTBCMRDELF6P.1 size=1048576 2024-08-27T02:38:06.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~LTBCMRDELF6P.2 size=644281 2024-08-27T02:38:06.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.119+0000 7f3e0cc408c0 1 < canceled multipart upload key=S5ANS33DXN7X upload=LTBCMRDELF6P tag=YF9RWZHAAVDB type=write size=3790009 2024-08-27T02:38:06.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.123+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=IPRM3IZESPQF type=del size=156521 2024-08-27T02:38:06.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.127+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=4GGG9VG90BFV type=del 2024-08-27T02:38:06.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.131+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=31LLGO3W9SM5 type=del size=1527082 2024-08-27T02:38:06.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.139+0000 7f3e0cc408c0 1 < suggested remove operation key=F4MCLPFLY531 tag=N4W3P72CHJL9 type=del 2024-08-27T02:38:06.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.143+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~841YONK99ZBF.0 size=1048576 2024-08-27T02:38:06.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~841YONK99ZBF.1 size=57472 2024-08-27T02:38:06.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.147+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=841YONK99ZBF tag=G7Z14GZ9AO8X type=write size=2154624 2024-08-27T02:38:06.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.151+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=RJH78XDNI8R9 type=del 2024-08-27T02:38:06.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.155+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=BY2GPMW0KJZ3 type=del size=218977 2024-08-27T02:38:06.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.159+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=DZHA6NCOFR9L type=del 2024-08-27T02:38:06.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.159+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=5IHILLST3NMD type=del size=1608157 2024-08-27T02:38:06.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.163+0000 7f3e0cc408c0 1 < completed write operation key=2CXWPDABA9XJ tag=DCFMK077V8XE type=write size=299037 2024-08-27T02:38:06.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.167+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=345S2KL3LRVJ type=write size=578046 2024-08-27T02:38:06.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.171+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~9S4E819FYTTF.0 size=470560 2024-08-27T02:38:06.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.175+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=9S4E819FYTTF tag=D58AY3YW22BL type=write size=1519136 2024-08-27T02:38:06.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.183+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~2NHBO02CO339.0 size=1048576 2024-08-27T02:38:06.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.183+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~2NHBO02CO339.1 size=1048576 2024-08-27T02:38:06.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~2NHBO02CO339.2 size=910068 2024-08-27T02:38:06.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.187+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=2NHBO02CO339 tag=PPV0V63VV48U type=write size=4055796 2024-08-27T02:38:06.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.191+0000 7f3e0cc408c0 1 < suggested remove operation key=1ZIJ9JJTM4ZC tag=8J4EYFLC20VJ type=del 2024-08-27T02:38:06.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~MY62ENL9DW5H.0 size=1048576 2024-08-27T02:38:06.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~MY62ENL9DW5H.1 size=1048576 2024-08-27T02:38:06.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~MY62ENL9DW5H.2 size=867216 2024-08-27T02:38:06.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.203+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=MY62ENL9DW5H tag=V7DDEP8ZPKLI type=write size=4012944 2024-08-27T02:38:06.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.207+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=Z2AN2D7M7B0M type=del 2024-08-27T02:38:06.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.211+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=UY31QNZ5M09B type=del size=1771745 2024-08-27T02:38:06.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.211+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~N4F1P69FHBFI.0 size=25852 2024-08-27T02:38:06.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.219+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=N4F1P69FHBFI tag=FU2B9RV8WGET type=write size=1074428 2024-08-27T02:38:06.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.219+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=NAHP5TTXYXC2 type=del size=1453727 2024-08-27T02:38:06.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.223+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=FLHTCXB39UA2 type=del 2024-08-27T02:38:06.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.227+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=Z8FQREG39H5U type=del size=1278457 2024-08-27T02:38:06.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.231+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~6W0VZKNVMX5L.0 size=1048576 2024-08-27T02:38:06.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.231+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~6W0VZKNVMX5L.1 size=178696 2024-08-27T02:38:06.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.239+0000 7f3e0cc408c0 1 < canceled multipart upload key=1ZIJ9JJTM4ZC upload=6W0VZKNVMX5L tag=0IA7K071MJMX type=write size=2275848 2024-08-27T02:38:06.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.243+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=O5IR1U8M8G5E type=del size=3162717 2024-08-27T02:38:06.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.247+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=UOYEKUXGZUR9 type=del 2024-08-27T02:38:06.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.251+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~YIV4ACVLS584.0 size=1048576 2024-08-27T02:38:06.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.255+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~YIV4ACVLS584.1 size=633294 2024-08-27T02:38:06.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.255+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=YIV4ACVLS584 tag=01OXEV0BMFOK type=write size=2730446 2024-08-27T02:38:06.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.259+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=QI8UYH9AU3WE type=del 2024-08-27T02:38:06.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.263+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=WZ48VBPPZ543 type=del size=3943556 2024-08-27T02:38:06.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.263+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=SB9U5LFZOYM7 type=del 2024-08-27T02:38:06.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.271+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~LE1V8U167WFH.0 size=1048576 2024-08-27T02:38:06.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.275+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~LE1V8U167WFH.1 size=212221 2024-08-27T02:38:06.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.275+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=LE1V8U167WFH tag=MOZ61CT0K2M0 type=write size=2309373 2024-08-27T02:38:06.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.279+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~5MA07D2JN8SX.0 size=1048576 2024-08-27T02:38:06.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.279+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6YTZJKE4V5HQ.2~5MA07D2JN8SX.1 size=1048576 2024-08-27T02:38:06.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.283+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~5MA07D2JN8SX.2 size=618475 2024-08-27T02:38:06.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.287+0000 7f3e0cc408c0 1 < canceled multipart upload key=6YTZJKE4V5HQ upload=5MA07D2JN8SX tag=PB54RXKXCZCB type=write size=3764203 2024-08-27T02:38:06.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.291+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=M15AV1LW4T7B type=write size=375723 2024-08-27T02:38:06.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.295+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=IPRM3IZESPQF type=del 2024-08-27T02:38:06.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.299+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=ITU35RKZNOGS type=del size=4013911 2024-08-27T02:38:06.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.303+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=31LLGO3W9SM5 type=del 2024-08-27T02:38:06.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.307+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=PRBC2SSSB9W4 type=del size=1996413 2024-08-27T02:38:06.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~841YONK99ZBF.0 size=1048576 2024-08-27T02:38:06.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.315+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~841YONK99ZBF.1 size=57472 2024-08-27T02:38:06.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.319+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=841YONK99ZBF tag=G7Z14GZ9AO8X type=write size=2154624 2024-08-27T02:38:06.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.323+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=PKD6ZVIO51PF type=del size=1944026 2024-08-27T02:38:06.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.327+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=BY2GPMW0KJZ3 type=del 2024-08-27T02:38:06.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.331+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=Q72LAH69I8FG type=write size=937473 2024-08-27T02:38:06.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.335+0000 7f3e0cc408c0 1 < suggested remove operation key=PLC076BXR38P tag=5IHILLST3NMD type=del 2024-08-27T02:38:06.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.339+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=8Q7PYOS5QPDC type=write size=1045897 2024-08-27T02:38:06.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.343+0000 7f3e0cc408c0 1 < completed write operation key=O66XJ7GJMPCU tag=345S2KL3LRVJ type=write size=578046 2024-08-27T02:38:06.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.343+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=S01SRVXMA80T type=del size=228288 2024-08-27T02:38:06.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.347+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~2NHBO02CO339.0 size=1048576 2024-08-27T02:38:06.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.351+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~2NHBO02CO339.1 size=1048576 2024-08-27T02:38:06.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.351+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~2NHBO02CO339.2 size=910068 2024-08-27T02:38:06.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.359+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=2NHBO02CO339 tag=PPV0V63VV48U type=write size=4055796 2024-08-27T02:38:06.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.363+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=BEJ0Z3PFCWXY type=del size=4185623 2024-08-27T02:38:06.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~MY62ENL9DW5H.0 size=1048576 2024-08-27T02:38:06.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~MY62ENL9DW5H.1 size=1048576 2024-08-27T02:38:06.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~MY62ENL9DW5H.2 size=867216 2024-08-27T02:38:06.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.375+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=MY62ENL9DW5H tag=V7DDEP8ZPKLI type=write size=4012944 2024-08-27T02:38:06.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.379+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=KMPNFL21722W type=del size=1448358 2024-08-27T02:38:06.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.383+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=UY31QNZ5M09B type=del 2024-08-27T02:38:06.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~M2IHR3D4R7RJ.0 size=1048576 2024-08-27T02:38:06.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.391+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~M2IHR3D4R7RJ.1 size=227816 2024-08-27T02:38:06.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.391+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=M2IHR3D4R7RJ tag=7Y626YWZCB2U type=write size=2324968 2024-08-27T02:38:06.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.395+0000 7f3e0cc408c0 1 < suggested update operation key=SG9T1RD5EATR tag=NAHP5TTXYXC2 type=del size=1453727 2024-08-27T02:38:06.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.403+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~8EWDZUPWEU5N.0 size=1048576 2024-08-27T02:38:06.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.403+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~8EWDZUPWEU5N.1 size=1048576 2024-08-27T02:38:06.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.407+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~8EWDZUPWEU5N.2 size=925640 2024-08-27T02:38:06.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.407+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=8EWDZUPWEU5N tag=3WOBYZUNX2DS type=write size=4071368 2024-08-27T02:38:06.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.411+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=Z8FQREG39H5U type=del 2024-08-27T02:38:06.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.415+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=19TFBSG12MOF type=del size=1120222 2024-08-27T02:38:06.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.415+0000 7f3e0cc408c0 1 < canceled operation key=6QE1HU65GQZZ tag=O5IR1U8M8G5E type=del size=3162717 2024-08-27T02:38:06.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.419+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=5MZNIYREZJ04 type=del size=2491200 2024-08-27T02:38:06.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.423+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~YIV4ACVLS584.0 size=1048576 2024-08-27T02:38:06.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.427+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~YIV4ACVLS584.1 size=633294 2024-08-27T02:38:06.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.431+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=YIV4ACVLS584 tag=01OXEV0BMFOK type=write size=2730446 2024-08-27T02:38:06.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.435+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~E3YVW3V3HB82.0 size=983953 2024-08-27T02:38:06.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.435+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=E3YVW3V3HB82 tag=QBUT9KO6UCGD type=write size=2032529 2024-08-27T02:38:06.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.439+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=WZ48VBPPZ543 type=del 2024-08-27T02:38:06.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.443+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=KFL2B8XDT8TS type=del size=140435 2024-08-27T02:38:06.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~LE1V8U167WFH.0 size=1048576 2024-08-27T02:38:06.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~LE1V8U167WFH.1 size=212221 2024-08-27T02:38:06.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.455+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=LE1V8U167WFH tag=MOZ61CT0K2M0 type=write size=2309373 2024-08-27T02:38:06.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.459+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~GG7FF5QBRT2K.0 size=1048576 2024-08-27T02:38:06.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~GG7FF5QBRT2K.1 size=1048576 2024-08-27T02:38:06.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~GG7FF5QBRT2K.2 size=535200 2024-08-27T02:38:06.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.463+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=GG7FF5QBRT2K tag=Z3V2UDVAORTC type=write size=3680928 2024-08-27T02:38:06.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.467+0000 7f3e0cc408c0 1 < canceled operation key=HKDJMA7O2DFM tag=M15AV1LW4T7B type=write size=375723 2024-08-27T02:38:06.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.471+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=QROG3HKYX4N2 type=write size=69972 2024-08-27T02:38:06.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.475+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=ITU35RKZNOGS type=del 2024-08-27T02:38:06.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.479+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=ZIPWQOMLCBCY type=del size=2537393 2024-08-27T02:38:06.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.483+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=PRBC2SSSB9W4 type=del 2024-08-27T02:38:06.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.487+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=8JR02AECLO88 type=del size=929531 2024-08-27T02:38:06.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.487+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=PKD6ZVIO51PF type=del 2024-08-27T02:38:06.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.495+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~XP8MMXU60RV1.0 size=1048576 2024-08-27T02:38:06.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~XP8MMXU60RV1.1 size=1048576 2024-08-27T02:38:06.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~XP8MMXU60RV1.2 size=95092 2024-08-27T02:38:06.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.499+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=XP8MMXU60RV1 tag=8W5OYEOXNFDN type=write size=3240820 2024-08-27T02:38:06.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.503+0000 7f3e0cc408c0 1 < completed write operation key=O66XJ7GJMPCU tag=Q72LAH69I8FG type=write size=937473 2024-08-27T02:38:06.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.507+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=B5OGNXE0U9CF type=del size=1021977 2024-08-27T02:38:06.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.515+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=8Q7PYOS5QPDC type=write size=1045897 2024-08-27T02:38:06.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.519+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=X9CGCPEPUPQZ type=write size=329153 2024-08-27T02:38:06.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.523+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=S01SRVXMA80T type=del 2024-08-27T02:38:06.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~LW29XR837OQE.0 size=1048576 2024-08-27T02:38:06.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.531+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~LW29XR837OQE.1 size=1048576 2024-08-27T02:38:06.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.535+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~LW29XR837OQE.2 size=290074 2024-08-27T02:38:06.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.535+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=LW29XR837OQE tag=8ARVRLVFBX5E type=write size=3435802 2024-08-27T02:38:06.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.539+0000 7f3e0cc408c0 1 < completed delete operation key=2CXWPDABA9XJ tag=BEJ0Z3PFCWXY type=del 2024-08-27T02:38:06.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.543+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~URV5PDH01IYU.0 size=1048576 2024-08-27T02:38:06.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.547+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~URV5PDH01IYU.1 size=1048576 2024-08-27T02:38:06.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.547+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~URV5PDH01IYU.2 size=1014706 2024-08-27T02:38:06.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.547+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=URV5PDH01IYU tag=C9VC6TV2Q90Z type=write size=4160434 2024-08-27T02:38:06.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.551+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=KMPNFL21722W type=del 2024-08-27T02:38:06.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.555+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=0UYTP0XTCKCX type=del size=750179 2024-08-27T02:38:06.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.559+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~M2IHR3D4R7RJ.0 size=1048576 2024-08-27T02:38:06.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.559+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~M2IHR3D4R7RJ.1 size=227816 2024-08-27T02:38:06.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.567+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=M2IHR3D4R7RJ tag=7Y626YWZCB2U type=write size=2324968 2024-08-27T02:38:06.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.571+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=HNCQPPETW4FI type=del size=1238399 2024-08-27T02:38:06.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.571+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~8EWDZUPWEU5N.0 size=1048576 2024-08-27T02:38:06.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.575+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~8EWDZUPWEU5N.1 size=1048576 2024-08-27T02:38:06.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.575+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~8EWDZUPWEU5N.2 size=925640 2024-08-27T02:38:06.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.583+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=8EWDZUPWEU5N tag=3WOBYZUNX2DS type=write size=4071368 2024-08-27T02:38:06.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.583+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=NSXD5P3Q66IT type=del size=3441957 2024-08-27T02:38:06.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.587+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=19TFBSG12MOF type=del 2024-08-27T02:38:06.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.591+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=ESDLMWJ4I8SH type=write size=890556 2024-08-27T02:38:06.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.595+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=5MZNIYREZJ04 type=del 2024-08-27T02:38:06.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.599+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~SUMNTJSOWNWN.0 size=1048576 2024-08-27T02:38:06.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~SUMNTJSOWNWN.1 size=1048576 2024-08-27T02:38:06.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.607+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~SUMNTJSOWNWN.2 size=673124 2024-08-27T02:38:06.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.607+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=SUMNTJSOWNWN tag=MJVAS8GO27FB type=write size=3818852 2024-08-27T02:38:06.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.611+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~E3YVW3V3HB82.0 size=983953 2024-08-27T02:38:06.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.615+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=E3YVW3V3HB82 tag=QBUT9KO6UCGD type=write size=2032529 2024-08-27T02:38:06.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.619+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=X37R0L4R7Q66 type=del size=2259131 2024-08-27T02:38:06.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.623+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=KFL2B8XDT8TS type=del 2024-08-27T02:38:06.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.627+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~W5H5BMV8VJQP.0 size=851693 2024-08-27T02:38:06.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.627+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=W5H5BMV8VJQP tag=1RU2FVF4T115 type=write size=1900269 2024-08-27T02:38:06.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.631+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~GG7FF5QBRT2K.0 size=1048576 2024-08-27T02:38:06.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.635+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~GG7FF5QBRT2K.1 size=1048576 2024-08-27T02:38:06.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.635+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~GG7FF5QBRT2K.2 size=535200 2024-08-27T02:38:06.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.639+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=GG7FF5QBRT2K tag=Z3V2UDVAORTC type=write size=3680928 2024-08-27T02:38:06.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.643+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=HKLV0P3BIIW5 type=del size=3969663 2024-08-27T02:38:06.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.643+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=QROG3HKYX4N2 type=write size=69972 2024-08-27T02:38:06.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.647+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=SG2N3GF76MZI type=del size=804657 2024-08-27T02:38:06.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.651+0000 7f3e0cc408c0 1 < canceled operation key=2CXWPDABA9XJ tag=ZIPWQOMLCBCY type=del size=2537393 2024-08-27T02:38:06.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~TVLEB3FWNMHC.0 size=920883 2024-08-27T02:38:06.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.655+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=TVLEB3FWNMHC tag=14DT36U21DXL type=write size=1969459 2024-08-27T02:38:06.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.659+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=8JR02AECLO88 type=del 2024-08-27T02:38:06.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.663+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~12JZ30E7LZEF.0 size=1048576 2024-08-27T02:38:06.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~12JZ30E7LZEF.1 size=1048576 2024-08-27T02:38:06.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~12JZ30E7LZEF.2 size=16464 2024-08-27T02:38:06.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.667+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=12JZ30E7LZEF tag=PBNY2P3NL2NW type=write size=3162192 2024-08-27T02:38:06.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.671+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~XP8MMXU60RV1.0 size=1048576 2024-08-27T02:38:06.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~XP8MMXU60RV1.1 size=1048576 2024-08-27T02:38:06.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~XP8MMXU60RV1.2 size=95092 2024-08-27T02:38:06.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.683+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=XP8MMXU60RV1 tag=8W5OYEOXNFDN type=write size=3240820 2024-08-27T02:38:06.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.687+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~BKS5EENO5THE.0 size=1048576 2024-08-27T02:38:06.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.687+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~BKS5EENO5THE.1 size=62417 2024-08-27T02:38:06.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.687+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=BKS5EENO5THE tag=ZOHXRYSM416R type=write size=2159569 2024-08-27T02:38:06.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.691+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=B5OGNXE0U9CF type=del 2024-08-27T02:38:06.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.695+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=MQU4U00QKL9T type=del size=2345521 2024-08-27T02:38:06.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.699+0000 7f3e0cc408c0 1 < completed write operation key=4BV3C9MTIFT5 tag=X9CGCPEPUPQZ type=write size=329153 2024-08-27T02:38:06.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.703+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~E1JTPJDU0GVU.0 size=1048576 2024-08-27T02:38:06.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.707+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~E1JTPJDU0GVU.1 size=502420 2024-08-27T02:38:06.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.707+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=E1JTPJDU0GVU tag=P3IO4Q8T5ZE1 type=write size=2599572 2024-08-27T02:38:06.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.707+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~LW29XR837OQE.0 size=1048576 2024-08-27T02:38:06.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~LW29XR837OQE.1 size=1048576 2024-08-27T02:38:06.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~LW29XR837OQE.2 size=290074 2024-08-27T02:38:06.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.719+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=LW29XR837OQE tag=8ARVRLVFBX5E type=write size=3435802 2024-08-27T02:38:06.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.723+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~AX1JI169NN5Z.0 size=1048576 2024-08-27T02:38:06.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.727+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~AX1JI169NN5Z.1 size=1048576 2024-08-27T02:38:06.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.727+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~AX1JI169NN5Z.2 size=930373 2024-08-27T02:38:06.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.727+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=AX1JI169NN5Z tag=6WK6NPHN3YT7 type=write size=4076101 2024-08-27T02:38:06.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.731+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~URV5PDH01IYU.0 size=1048576 2024-08-27T02:38:06.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.735+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~URV5PDH01IYU.1 size=1048576 2024-08-27T02:38:06.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.735+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~URV5PDH01IYU.2 size=1014706 2024-08-27T02:38:06.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.739+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=URV5PDH01IYU tag=C9VC6TV2Q90Z type=write size=4160434 2024-08-27T02:38:06.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.743+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=LL3OZLACWZAT type=del size=1758842 2024-08-27T02:38:06.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.747+0000 7f3e0cc408c0 1 < canceled operation key=IISECLYEAR19 tag=0UYTP0XTCKCX type=del size=750179 2024-08-27T02:38:06.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.751+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=JH7SWXSQUTNY type=del size=1715878 2024-08-27T02:38:06.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.755+0000 7f3e0cc408c0 1 < suggested remove operation key=SG9T1RD5EATR tag=HNCQPPETW4FI type=del 2024-08-27T02:38:06.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.759+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=R4R00DG57CCB type=del size=2892274 2024-08-27T02:38:06.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.763+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=NSXD5P3Q66IT type=del 2024-08-27T02:38:06.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~BOCF182R8EVR.0 size=409215 2024-08-27T02:38:06.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.767+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=BOCF182R8EVR tag=DLGKV8EEISV5 type=write size=1457791 2024-08-27T02:38:06.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.775+0000 7f3e0cc408c0 1 < suggested update operation key=13M7JVZT12I2 tag=ESDLMWJ4I8SH type=write size=890556 2024-08-27T02:38:06.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.779+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~2EH1SRL3J18C.0 size=1048576 2024-08-27T02:38:06.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.783+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~2EH1SRL3J18C.1 size=634867 2024-08-27T02:38:06.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.783+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=2EH1SRL3J18C tag=7D40P9XCYX1M type=write size=2732019 2024-08-27T02:38:06.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.783+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0U59R3BXL181.2~SUMNTJSOWNWN.0 size=1048576 2024-08-27T02:38:06.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.787+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~SUMNTJSOWNWN.1 size=1048576 2024-08-27T02:38:06.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.787+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~SUMNTJSOWNWN.2 size=673124 2024-08-27T02:38:06.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.795+0000 7f3e0cc408c0 1 < canceled multipart upload key=0U59R3BXL181 upload=SUMNTJSOWNWN tag=MJVAS8GO27FB type=write size=3818852 2024-08-27T02:38:06.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.795+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=79B8H1VMV686 type=del size=1632093 2024-08-27T02:38:06.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.803+0000 7f3e0cc408c0 1 < suggested update operation key=IISECLYEAR19 tag=X37R0L4R7Q66 type=del size=2259131 2024-08-27T02:38:06.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.807+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~A3LAV2KTC75F.0 size=493281 2024-08-27T02:38:06.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.807+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=A3LAV2KTC75F tag=AY6CAA4XALTT type=write size=1541857 2024-08-27T02:38:06.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.811+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~W5H5BMV8VJQP.0 size=851693 2024-08-27T02:38:06.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.815+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=W5H5BMV8VJQP tag=1RU2FVF4T115 type=write size=1900269 2024-08-27T02:38:06.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.819+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=65DJWI3JG9EU type=write size=902015 2024-08-27T02:38:06.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.823+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=HKLV0P3BIIW5 type=del 2024-08-27T02:38:06.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.827+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=GC0CZU964FWD type=del size=1124548 2024-08-27T02:38:06.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.831+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=SG2N3GF76MZI type=del 2024-08-27T02:38:06.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~8R192LLOE0IK.0 size=322783 2024-08-27T02:38:06.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.835+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=8R192LLOE0IK tag=MMPJNJ591NEC type=write size=1371359 2024-08-27T02:38:06.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.839+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~TVLEB3FWNMHC.0 size=920883 2024-08-27T02:38:06.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.843+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=TVLEB3FWNMHC tag=14DT36U21DXL type=write size=1969459 2024-08-27T02:38:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.847+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=IUBVYN9A06MI type=del size=3016596 2024-08-27T02:38:06.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~12JZ30E7LZEF.0 size=1048576 2024-08-27T02:38:06.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~12JZ30E7LZEF.1 size=1048576 2024-08-27T02:38:06.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.855+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~12JZ30E7LZEF.2 size=16464 2024-08-27T02:38:06.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.859+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=12JZ30E7LZEF tag=PBNY2P3NL2NW type=write size=3162192 2024-08-27T02:38:06.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~74Z5OICG8M5C.0 size=1048576 2024-08-27T02:38:06.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.867+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~74Z5OICG8M5C.1 size=1048576 2024-08-27T02:38:06.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.871+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~74Z5OICG8M5C.2 size=851226 2024-08-27T02:38:06.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.871+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=74Z5OICG8M5C tag=X27XDC10SMTI type=write size=3996954 2024-08-27T02:38:06.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.871+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~BKS5EENO5THE.0 size=1048576 2024-08-27T02:38:06.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.875+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~BKS5EENO5THE.1 size=62417 2024-08-27T02:38:06.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.879+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=BKS5EENO5THE tag=ZOHXRYSM416R type=write size=2159569 2024-08-27T02:38:06.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.887+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=BPINM26RBFAR type=del size=4115214 2024-08-27T02:38:06.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.891+0000 7f3e0cc408c0 1 < completed delete operation key=QVG1NTF6O8L2 tag=MQU4U00QKL9T type=del 2024-08-27T02:38:06.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.895+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=VPI5EJF63MOB type=del size=570588 2024-08-27T02:38:06.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.899+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~E1JTPJDU0GVU.0 size=1048576 2024-08-27T02:38:06.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.899+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~E1JTPJDU0GVU.1 size=502420 2024-08-27T02:38:06.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.903+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=E1JTPJDU0GVU tag=P3IO4Q8T5ZE1 type=write size=2599572 2024-08-27T02:38:06.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.907+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=J8CR87A0P3HX type=del size=2013428 2024-08-27T02:38:06.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.911+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~AX1JI169NN5Z.0 size=1048576 2024-08-27T02:38:06.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.911+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~AX1JI169NN5Z.1 size=1048576 2024-08-27T02:38:06.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.915+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~AX1JI169NN5Z.2 size=930373 2024-08-27T02:38:06.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.919+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=AX1JI169NN5Z tag=6WK6NPHN3YT7 type=write size=4076101 2024-08-27T02:38:06.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.923+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=M8A99BL2EFCE type=del size=462074 2024-08-27T02:38:06.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.927+0000 7f3e0cc408c0 -1 < failed to complete operation key=SG9T1RD5EATR tag=LL3OZLACWZAT type=del size=1758842: (22) Invalid argument 2024-08-27T02:38:06.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.931+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~N2X8JD0X9M8F.0 size=1048576 2024-08-27T02:38:06.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~N2X8JD0X9M8F.1 size=1048576 2024-08-27T02:38:06.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~N2X8JD0X9M8F.2 size=224222 2024-08-27T02:38:06.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.935+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=N2X8JD0X9M8F tag=HKEJ5I0OHW8D type=write size=3369950 2024-08-27T02:38:06.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.939+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=JH7SWXSQUTNY type=del 2024-08-27T02:38:06.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.943+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=KZFFI9LTACDD type=del size=2674183 2024-08-27T02:38:06.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.947+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=R4R00DG57CCB type=del 2024-08-27T02:38:06.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.951+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~SK7Q6VNKD4OW.0 size=1048576 2024-08-27T02:38:06.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.955+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~SK7Q6VNKD4OW.1 size=703909 2024-08-27T02:38:06.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.955+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=SK7Q6VNKD4OW tag=GLE6KCKM2C3T type=write size=2801061 2024-08-27T02:38:06.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~BOCF182R8EVR.0 size=409215 2024-08-27T02:38:06.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.963+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=BOCF182R8EVR tag=DLGKV8EEISV5 type=write size=1457791 2024-08-27T02:38:06.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.967+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=EULULAVU7S8E type=del size=2781173 2024-08-27T02:38:06.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.971+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~2EH1SRL3J18C.0 size=1048576 2024-08-27T02:38:06.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.971+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~2EH1SRL3J18C.1 size=634867 2024-08-27T02:38:06.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.979+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=2EH1SRL3J18C tag=7D40P9XCYX1M type=write size=2732019 2024-08-27T02:38:06.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.983+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=1OM4S231ZO8Q type=del size=2046624 2024-08-27T02:38:06.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.983+0000 7f3e0cc408c0 1 < canceled operation key=S5ANS33DXN7X tag=79B8H1VMV686 type=del size=1632093 2024-08-27T02:38:06.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.987+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=D6UOBVLPJMNT type=del size=754027 2024-08-27T02:38:06.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~A3LAV2KTC75F.0 size=493281 2024-08-27T02:38:06.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.995+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=A3LAV2KTC75F tag=AY6CAA4XALTT type=write size=1541857 2024-08-27T02:38:06.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:06.999+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=KG160VM5JG4H type=write size=790164 2024-08-27T02:38:07.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.003+0000 7f3e0cc408c0 1 < canceled operation key=6QE1HU65GQZZ tag=65DJWI3JG9EU type=write size=902015 2024-08-27T02:38:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.007+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~64A5ALJUGRPG.0 size=1048576 2024-08-27T02:38:07.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.011+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~64A5ALJUGRPG.1 size=1016370 2024-08-27T02:38:07.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.011+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=64A5ALJUGRPG tag=DJS51S3WNRA5 type=write size=3113522 2024-08-27T02:38:07.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.015+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=GC0CZU964FWD type=del 2024-08-27T02:38:07.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.015+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=Z7VOG0I34QHU type=del size=3279414 2024-08-27T02:38:07.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~8R192LLOE0IK.0 size=322783 2024-08-27T02:38:07.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.027+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=8R192LLOE0IK tag=MMPJNJ591NEC type=write size=1371359 2024-08-27T02:38:07.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.027+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=W43GM0F6GCBH type=del size=1520167 2024-08-27T02:38:07.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.031+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=IUBVYN9A06MI type=del 2024-08-27T02:38:07.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.035+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=9X48T6GRCMDT type=del size=849681 2024-08-27T02:38:07.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.039+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~74Z5OICG8M5C.0 size=1048576 2024-08-27T02:38:07.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.039+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~74Z5OICG8M5C.1 size=1048576 2024-08-27T02:38:07.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~74Z5OICG8M5C.2 size=851226 2024-08-27T02:38:07.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.047+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=74Z5OICG8M5C tag=X27XDC10SMTI type=write size=3996954 2024-08-27T02:38:07.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.055+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~K7OUGB950TUY.0 size=1048576 2024-08-27T02:38:07.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.055+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~K7OUGB950TUY.1 size=76015 2024-08-27T02:38:07.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.055+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=K7OUGB950TUY tag=BF3JF3LDP2PK type=write size=2173167 2024-08-27T02:38:07.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.059+0000 7f3e0cc408c0 1 < canceled operation key=S5ANS33DXN7X tag=BPINM26RBFAR type=del size=4115214 2024-08-27T02:38:07.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.063+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=CO7TDYV0Q78G type=del size=1740796 2024-08-27T02:38:07.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.067+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=VPI5EJF63MOB type=del 2024-08-27T02:38:07.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.067+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=J3MNSBCFPF1A type=del size=3753276 2024-08-27T02:38:07.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.071+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=J8CR87A0P3HX type=del 2024-08-27T02:38:07.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.075+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=HHF2L48H615K type=write size=572749 2024-08-27T02:38:07.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.075+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=M8A99BL2EFCE type=del 2024-08-27T02:38:07.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.083+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~K5VF7USGWCH8.0 size=1048576 2024-08-27T02:38:07.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.087+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~K5VF7USGWCH8.1 size=1048576 2024-08-27T02:38:07.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.087+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~K5VF7USGWCH8.2 size=261700 2024-08-27T02:38:07.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.087+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=K5VF7USGWCH8 tag=3ZUHCPLQW0QV type=write size=3407428 2024-08-27T02:38:07.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.091+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~N2X8JD0X9M8F.0 size=1048576 2024-08-27T02:38:07.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.095+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~N2X8JD0X9M8F.1 size=1048576 2024-08-27T02:38:07.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.095+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~N2X8JD0X9M8F.2 size=224222 2024-08-27T02:38:07.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.103+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=N2X8JD0X9M8F tag=HKEJ5I0OHW8D type=write size=3369950 2024-08-27T02:38:07.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.103+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=M6PIFNP8TZ45 type=write size=812072 2024-08-27T02:38:07.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.107+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=KZFFI9LTACDD type=del 2024-08-27T02:38:07.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.111+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=3XHW902RBAHU type=del size=1921746 2024-08-27T02:38:07.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~SK7Q6VNKD4OW.0 size=1048576 2024-08-27T02:38:07.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.115+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JLAGXRZVF50G.2~SK7Q6VNKD4OW.1 size=703909 2024-08-27T02:38:07.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.119+0000 7f3e0cc408c0 1 < canceled multipart upload key=JLAGXRZVF50G upload=SK7Q6VNKD4OW tag=GLE6KCKM2C3T type=write size=2801061 2024-08-27T02:38:07.126 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~QMTUQLLTH9LO.0 size=1048576 2024-08-27T02:38:07.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~QMTUQLLTH9LO.1 size=1048576 2024-08-27T02:38:07.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~QMTUQLLTH9LO.2 size=122002 2024-08-27T02:38:07.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.131+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=QMTUQLLTH9LO tag=HHZXD6SXC410 type=write size=3267730 2024-08-27T02:38:07.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.135+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=EULULAVU7S8E type=del 2024-08-27T02:38:07.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.143+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~JW0Z67R8BY09.0 size=1048576 2024-08-27T02:38:07.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~JW0Z67R8BY09.1 size=986957 2024-08-27T02:38:07.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.147+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=JW0Z67R8BY09 tag=NAA6H29647RX type=write size=3084109 2024-08-27T02:38:07.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.151+0000 7f3e0cc408c0 1 < suggested update operation key=B9DPI871LQ7E tag=1OM4S231ZO8Q type=del size=2046624 2024-08-27T02:38:07.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.155+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=JJ3YN1MTTURO type=del size=3465456 2024-08-27T02:38:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.159+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=D6UOBVLPJMNT type=del 2024-08-27T02:38:07.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.163+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=Q7BTOEZU8J8F type=del size=4121995 2024-08-27T02:38:07.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.167+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=KG160VM5JG4H type=write size=790164 2024-08-27T02:38:07.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.171+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=RLB9AA409VPA type=del size=3544211 2024-08-27T02:38:07.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.175+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~64A5ALJUGRPG.0 size=1048576 2024-08-27T02:38:07.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.175+0000 7f3e0cc408c0 1 < canceled part key=_multipart_4SSZQK6YIL1O.2~64A5ALJUGRPG.1 size=1016370 2024-08-27T02:38:07.179 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.179+0000 7f3e0cc408c0 1 < canceled multipart upload key=4SSZQK6YIL1O upload=64A5ALJUGRPG tag=DJS51S3WNRA5 type=write size=3113522 2024-08-27T02:38:07.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.187+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~XTR92228DGGK.0 size=1048576 2024-08-27T02:38:07.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.191+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~XTR92228DGGK.1 size=1048576 2024-08-27T02:38:07.194 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.195+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~XTR92228DGGK.2 size=517799 2024-08-27T02:38:07.194 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.195+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=XTR92228DGGK tag=TOGWJIG92IT3 type=write size=3663527 2024-08-27T02:38:07.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.199+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=Z7VOG0I34QHU type=del 2024-08-27T02:38:07.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.199+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=VH7PUP0XVREO type=del size=1193861 2024-08-27T02:38:07.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.203+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=W43GM0F6GCBH type=del 2024-08-27T02:38:07.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.207+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=9O50LMM2XQKA type=del size=737312 2024-08-27T02:38:07.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.211+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=9X48T6GRCMDT type=del 2024-08-27T02:38:07.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.215+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=P5W5H2CGQZKE type=del size=1085362 2024-08-27T02:38:07.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.219+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~K7OUGB950TUY.0 size=1048576 2024-08-27T02:38:07.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.219+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~K7OUGB950TUY.1 size=76015 2024-08-27T02:38:07.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.223+0000 7f3e0cc408c0 1 < canceled multipart upload key=1ZIJ9JJTM4ZC upload=K7OUGB950TUY tag=BF3JF3LDP2PK type=write size=2173167 2024-08-27T02:38:07.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.227+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=FD0CFKIZUMGD type=del size=1973419 2024-08-27T02:38:07.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.231+0000 7f3e0cc408c0 1 < suggested remove operation key=QVG1NTF6O8L2 tag=CO7TDYV0Q78G type=del 2024-08-27T02:38:07.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.239+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~ECNAZZGNFZ87.0 size=442298 2024-08-27T02:38:07.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.239+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=ECNAZZGNFZ87 tag=7Y3UQZRFMOKP type=write size=1490874 2024-08-27T02:38:07.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.243+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=J3MNSBCFPF1A type=del 2024-08-27T02:38:07.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.247+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=9NEKBBWTKPFU type=del size=4182638 2024-08-27T02:38:07.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.251+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=HHF2L48H615K type=write size=572749 2024-08-27T02:38:07.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.255+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=W8RJFSV9F34F type=del size=4005545 2024-08-27T02:38:07.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.259+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~K5VF7USGWCH8.0 size=1048576 2024-08-27T02:38:07.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.259+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~K5VF7USGWCH8.1 size=1048576 2024-08-27T02:38:07.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.263+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~K5VF7USGWCH8.2 size=261700 2024-08-27T02:38:07.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.271+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=K5VF7USGWCH8 tag=3ZUHCPLQW0QV type=write size=3407428 2024-08-27T02:38:07.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.271+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=GY7KVZLB18W7 type=del size=1481667 2024-08-27T02:38:07.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.275+0000 7f3e0cc408c0 1 < completed write operation key=D7YWS7BWXT37 tag=M6PIFNP8TZ45 type=write size=812072 2024-08-27T02:38:07.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.287+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~8MDR67BSG1Q4.0 size=1048576 2024-08-27T02:38:07.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.287+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~8MDR67BSG1Q4.1 size=455594 2024-08-27T02:38:07.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.287+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=8MDR67BSG1Q4 tag=P7M177IBT8FP type=write size=2552746 2024-08-27T02:38:07.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.295+0000 7f3e0cc408c0 1 < suggested update operation key=OY551242R8T6 tag=3XHW902RBAHU type=del size=1921746 2024-08-27T02:38:07.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~GLUKF3P81NXY.0 size=1048576 2024-08-27T02:38:07.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.303+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~GLUKF3P81NXY.1 size=1048576 2024-08-27T02:38:07.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.303+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~GLUKF3P81NXY.2 size=571025 2024-08-27T02:38:07.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.303+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=GLUKF3P81NXY tag=Q5PT5NMEF0M0 type=write size=3716753 2024-08-27T02:38:07.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.307+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~QMTUQLLTH9LO.0 size=1048576 2024-08-27T02:38:07.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~QMTUQLLTH9LO.1 size=1048576 2024-08-27T02:38:07.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~QMTUQLLTH9LO.2 size=122002 2024-08-27T02:38:07.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.319+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=QMTUQLLTH9LO tag=HHZXD6SXC410 type=write size=3267730 2024-08-27T02:38:07.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~XXDPBX1GZ2T3.0 size=1048576 2024-08-27T02:38:07.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~XXDPBX1GZ2T3.1 size=1048576 2024-08-27T02:38:07.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~XXDPBX1GZ2T3.2 size=596910 2024-08-27T02:38:07.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.327+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=XXDPBX1GZ2T3 tag=MXKSTXJDM8B4 type=write size=3742638 2024-08-27T02:38:07.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.331+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~JW0Z67R8BY09.0 size=1048576 2024-08-27T02:38:07.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.335+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~JW0Z67R8BY09.1 size=986957 2024-08-27T02:38:07.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.339+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=JW0Z67R8BY09 tag=NAA6H29647RX type=write size=3084109 2024-08-27T02:38:07.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.343+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~IIP3D3DHUI4L.0 size=916515 2024-08-27T02:38:07.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.343+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=IIP3D3DHUI4L tag=1ZDJYC5PI0KZ type=write size=1965091 2024-08-27T02:38:07.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.347+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=JJ3YN1MTTURO type=del 2024-08-27T02:38:07.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.351+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=U755ULU5C046 type=write size=861862 2024-08-27T02:38:07.354 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.355+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=Q7BTOEZU8J8F type=del 2024-08-27T02:38:07.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.359+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=6DSOV7CJ7MJP type=del size=2510911 2024-08-27T02:38:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.359+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=RLB9AA409VPA type=del 2024-08-27T02:38:07.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.363+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=BPFN852AJI68 type=del size=2325236 2024-08-27T02:38:07.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~XTR92228DGGK.0 size=1048576 2024-08-27T02:38:07.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.367+0000 7f3e0cc408c0 1 < canceled part key=_multipart_1ZIJ9JJTM4ZC.2~XTR92228DGGK.1 size=1048576 2024-08-27T02:38:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~XTR92228DGGK.2 size=517799 2024-08-27T02:38:07.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.375+0000 7f3e0cc408c0 1 < canceled multipart upload key=1ZIJ9JJTM4ZC upload=XTR92228DGGK tag=TOGWJIG92IT3 type=write size=3663527 2024-08-27T02:38:07.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.379+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~X6NMHVS1YH1X.0 size=416318 2024-08-27T02:38:07.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.379+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=X6NMHVS1YH1X tag=PRPC0GEY33A1 type=write size=1464894 2024-08-27T02:38:07.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.383+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=VH7PUP0XVREO type=del 2024-08-27T02:38:07.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.387+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=COETYTXTXOUZ type=del size=1021558 2024-08-27T02:38:07.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.387+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=9O50LMM2XQKA type=del 2024-08-27T02:38:07.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.391+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=SIRI22P5G6VN type=write size=739006 2024-08-27T02:38:07.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.395+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=P5W5H2CGQZKE type=del 2024-08-27T02:38:07.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.399+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=DEFEUQOPDVN0 type=write size=444242 2024-08-27T02:38:07.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.399+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=FD0CFKIZUMGD type=del 2024-08-27T02:38:07.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.407+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~UGUFR4WQ82EN.0 size=860479 2024-08-27T02:38:07.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.407+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=UGUFR4WQ82EN tag=IJWXSUORLPSQ type=write size=1909055 2024-08-27T02:38:07.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~ECNAZZGNFZ87.0 size=442298 2024-08-27T02:38:07.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.415+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=ECNAZZGNFZ87 tag=7Y3UQZRFMOKP type=write size=1490874 2024-08-27T02:38:07.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.419+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=NYV9WZX20P7X type=del size=1977887 2024-08-27T02:38:07.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.423+0000 7f3e0cc408c0 1 < suggested update operation key=QVG1NTF6O8L2 tag=9NEKBBWTKPFU type=del size=4182638 2024-08-27T02:38:07.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.427+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=YWR3BNUT00YL type=del size=4160319 2024-08-27T02:38:07.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.435+0000 7f3e0cc408c0 1 < suggested remove operation key=HTEOX3BV94K2 tag=W8RJFSV9F34F type=del 2024-08-27T02:38:07.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~CQDR5MVMKPEE.0 size=1048576 2024-08-27T02:38:07.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~CQDR5MVMKPEE.1 size=1048576 2024-08-27T02:38:07.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~CQDR5MVMKPEE.2 size=57578 2024-08-27T02:38:07.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.443+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=CQDR5MVMKPEE tag=ROTTS6PP27BQ type=write size=3203306 2024-08-27T02:38:07.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.447+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=GY7KVZLB18W7 type=del 2024-08-27T02:38:07.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.451+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~DWCNIGOL9IE3.0 size=1048576 2024-08-27T02:38:07.454 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.455+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~DWCNIGOL9IE3.1 size=580613 2024-08-27T02:38:07.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.455+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=DWCNIGOL9IE3 tag=QS2WTEH40KNU type=write size=2677765 2024-08-27T02:38:07.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.459+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~8MDR67BSG1Q4.0 size=1048576 2024-08-27T02:38:07.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.459+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~8MDR67BSG1Q4.1 size=455594 2024-08-27T02:38:07.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.463+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=8MDR67BSG1Q4 tag=P7M177IBT8FP type=write size=2552746 2024-08-27T02:38:07.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.467+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=Q8O09ACT3MAZ type=write size=700263 2024-08-27T02:38:07.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.471+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~GLUKF3P81NXY.0 size=1048576 2024-08-27T02:38:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.471+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~GLUKF3P81NXY.1 size=1048576 2024-08-27T02:38:07.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~GLUKF3P81NXY.2 size=571025 2024-08-27T02:38:07.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.483+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=GLUKF3P81NXY tag=Q5PT5NMEF0M0 type=write size=3716753 2024-08-27T02:38:07.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.487+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=LCY17BXBC2LY type=del size=185409 2024-08-27T02:38:07.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.487+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~XXDPBX1GZ2T3.0 size=1048576 2024-08-27T02:38:07.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.491+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~XXDPBX1GZ2T3.1 size=1048576 2024-08-27T02:38:07.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.495+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~XXDPBX1GZ2T3.2 size=596910 2024-08-27T02:38:07.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.499+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=XXDPBX1GZ2T3 tag=MXKSTXJDM8B4 type=write size=3742638 2024-08-27T02:38:07.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.503+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=V930665TKI3F type=del size=4140070 2024-08-27T02:38:07.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.503+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~IIP3D3DHUI4L.0 size=916515 2024-08-27T02:38:07.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.511+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=IIP3D3DHUI4L tag=1ZDJYC5PI0KZ type=write size=1965091 2024-08-27T02:38:07.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.511+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=J74GSCS18P5O type=del size=45192 2024-08-27T02:38:07.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.515+0000 7f3e0cc408c0 1 < completed write operation key=IISECLYEAR19 tag=U755ULU5C046 type=write size=861862 2024-08-27T02:38:07.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.519+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=IE2CIO7AUR12 type=del size=2270437 2024-08-27T02:38:07.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.523+0000 7f3e0cc408c0 1 < canceled operation key=MNE5WNFBH9HG tag=6DSOV7CJ7MJP type=del size=2510911 2024-08-27T02:38:07.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~1IH5FHR2JV1D.0 size=1048576 2024-08-27T02:38:07.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.527+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~1IH5FHR2JV1D.1 size=34068 2024-08-27T02:38:07.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.527+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=1IH5FHR2JV1D tag=IWIPFQ6SY1L0 type=write size=2131220 2024-08-27T02:38:07.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.531+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=BPFN852AJI68 type=del 2024-08-27T02:38:07.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.535+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=KQFWXXJXNAVZ type=del size=3137650 2024-08-27T02:38:07.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.539+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~X6NMHVS1YH1X.0 size=416318 2024-08-27T02:38:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.543+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=X6NMHVS1YH1X tag=PRPC0GEY33A1 type=write size=1464894 2024-08-27T02:38:07.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.547+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=0Y5HRJMEAB20 type=del size=172362 2024-08-27T02:38:07.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.551+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=COETYTXTXOUZ type=del 2024-08-27T02:38:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.555+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=SUF33YSU9PWK type=del size=3598309 2024-08-27T02:38:07.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.555+0000 7f3e0cc408c0 1 < completed write operation key=13M7JVZT12I2 tag=SIRI22P5G6VN type=write size=739006 2024-08-27T02:38:07.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~ESC3GKQZY2PS.0 size=1048576 2024-08-27T02:38:07.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~ESC3GKQZY2PS.1 size=1048576 2024-08-27T02:38:07.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~ESC3GKQZY2PS.2 size=902929 2024-08-27T02:38:07.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.567+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=ESC3GKQZY2PS tag=POQMUN5JC5O4 type=write size=4048657 2024-08-27T02:38:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.571+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=DEFEUQOPDVN0 type=write size=444242 2024-08-27T02:38:07.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.575+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=8TEN7BC1RHPJ type=del size=3680603 2024-08-27T02:38:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.579+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~UGUFR4WQ82EN.0 size=860479 2024-08-27T02:38:07.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.587+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=UGUFR4WQ82EN tag=IJWXSUORLPSQ type=write size=1909055 2024-08-27T02:38:07.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.587+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=NQDF20VCKFTO type=del size=2511494 2024-08-27T02:38:07.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.595+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=NYV9WZX20P7X type=del size=1977887 2024-08-27T02:38:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.599+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~3ZGYJG54DRW7.0 size=1048576 2024-08-27T02:38:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~3ZGYJG54DRW7.1 size=546824 2024-08-27T02:38:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.603+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=3ZGYJG54DRW7 tag=FHNM9WRHXQNE type=write size=2643976 2024-08-27T02:38:07.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.607+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=YWR3BNUT00YL type=del 2024-08-27T02:38:07.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.611+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=NF6VT19XO6SP type=del size=721415 2024-08-27T02:38:07.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.611+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~CQDR5MVMKPEE.0 size=1048576 2024-08-27T02:38:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.615+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~CQDR5MVMKPEE.1 size=1048576 2024-08-27T02:38:07.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~CQDR5MVMKPEE.2 size=57578 2024-08-27T02:38:07.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.623+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=CQDR5MVMKPEE tag=ROTTS6PP27BQ type=write size=3203306 2024-08-27T02:38:07.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.627+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=J44R284ZO2EC type=del size=3752049 2024-08-27T02:38:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.627+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~DWCNIGOL9IE3.0 size=1048576 2024-08-27T02:38:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.631+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~DWCNIGOL9IE3.1 size=580613 2024-08-27T02:38:07.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.635+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=DWCNIGOL9IE3 tag=QS2WTEH40KNU type=write size=2677765 2024-08-27T02:38:07.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.639+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~LTNSQD460KFP.0 size=1048576 2024-08-27T02:38:07.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.643+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~LTNSQD460KFP.1 size=27306 2024-08-27T02:38:07.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.643+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=LTNSQD460KFP tag=Z4T4IK287DCS type=write size=2124458 2024-08-27T02:38:07.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.647+0000 7f3e0cc408c0 1 < suggested remove operation key=IISECLYEAR19 tag=Q8O09ACT3MAZ type=write 2024-08-27T02:38:07.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.651+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=WQNUGP04C516 type=del size=3245633 2024-08-27T02:38:07.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.659+0000 7f3e0cc408c0 1 < suggested update operation key=HTEOX3BV94K2 tag=LCY17BXBC2LY type=del size=185409 2024-08-27T02:38:07.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.663+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~IB3MRVGH65NT.0 size=1048576 2024-08-27T02:38:07.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~IB3MRVGH65NT.1 size=1048576 2024-08-27T02:38:07.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~IB3MRVGH65NT.2 size=714352 2024-08-27T02:38:07.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.667+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=IB3MRVGH65NT tag=DRB77GIVWISW type=write size=3860080 2024-08-27T02:38:07.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.671+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=V930665TKI3F type=del 2024-08-27T02:38:07.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.675+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~QS2XU19AVQVM.0 size=1048576 2024-08-27T02:38:07.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.679+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~QS2XU19AVQVM.1 size=1048576 2024-08-27T02:38:07.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.683+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~QS2XU19AVQVM.2 size=1036262 2024-08-27T02:38:07.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.683+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=QS2XU19AVQVM tag=7ZDDX59PLJ3Z type=write size=4181990 2024-08-27T02:38:07.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.687+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=J74GSCS18P5O type=del 2024-08-27T02:38:07.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.687+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=GJXY8Y8SG5UY type=del size=3535276 2024-08-27T02:38:07.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.691+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=IE2CIO7AUR12 type=del 2024-08-27T02:38:07.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.695+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=QZQVT0CVZFH2 type=del size=2797402 2024-08-27T02:38:07.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.699+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~1IH5FHR2JV1D.0 size=1048576 2024-08-27T02:38:07.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.699+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~1IH5FHR2JV1D.1 size=34068 2024-08-27T02:38:07.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.703+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=1IH5FHR2JV1D tag=IWIPFQ6SY1L0 type=write size=2131220 2024-08-27T02:38:07.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.707+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=EZ1ODVZ2B0NS type=write size=969170 2024-08-27T02:38:07.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.711+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=KQFWXXJXNAVZ type=del 2024-08-27T02:38:07.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.715+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~16YILKBXC8D5.0 size=1048576 2024-08-27T02:38:07.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.719+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~16YILKBXC8D5.1 size=1048576 2024-08-27T02:38:07.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.719+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~16YILKBXC8D5.2 size=43281 2024-08-27T02:38:07.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.719+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=16YILKBXC8D5 tag=I4G2OTA0PIIE type=write size=3189009 2024-08-27T02:38:07.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.723+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=0Y5HRJMEAB20 type=del 2024-08-27T02:38:07.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.727+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=YVHFPHFZT2W5 type=del size=629398 2024-08-27T02:38:07.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.731+0000 7f3e0cc408c0 1 < suggested update operation key=XBURHQSU6IML tag=SUF33YSU9PWK type=del size=3598309 2024-08-27T02:38:07.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.735+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~XKMTKA311H2M.0 size=1048576 2024-08-27T02:38:07.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.739+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~XKMTKA311H2M.1 size=1048576 2024-08-27T02:38:07.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.743+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~XKMTKA311H2M.2 size=301400 2024-08-27T02:38:07.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.743+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=XKMTKA311H2M tag=YJJFJ8UZOFF9 type=write size=3447128 2024-08-27T02:38:07.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.743+0000 7f3e0cc408c0 1 < canceled part key=_multipart_SG9T1RD5EATR.2~ESC3GKQZY2PS.0 size=1048576 2024-08-27T02:38:07.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.743+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~ESC3GKQZY2PS.1 size=1048576 2024-08-27T02:38:07.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.747+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~ESC3GKQZY2PS.2 size=902929 2024-08-27T02:38:07.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.751+0000 7f3e0cc408c0 1 < canceled multipart upload key=SG9T1RD5EATR upload=ESC3GKQZY2PS tag=POQMUN5JC5O4 type=write size=4048657 2024-08-27T02:38:07.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.755+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=IFVFDW8T4NDB type=del size=1915000 2024-08-27T02:38:07.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.759+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=8TEN7BC1RHPJ type=del 2024-08-27T02:38:07.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.767+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~VC9URPM4EPZ7.0 size=1048576 2024-08-27T02:38:07.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.771+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~VC9URPM4EPZ7.1 size=805693 2024-08-27T02:38:07.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.771+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=VC9URPM4EPZ7 tag=LUYDMJ4YLWN9 type=write size=2902845 2024-08-27T02:38:07.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.783+0000 7f3e0cc408c0 1 < suggested remove operation key=MKB40KOOCCNT tag=NQDF20VCKFTO type=del 2024-08-27T02:38:07.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.787+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=5AJNCLCAJZCM type=write size=1003647 2024-08-27T02:38:07.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.787+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~3ZGYJG54DRW7.0 size=1048576 2024-08-27T02:38:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.791+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~3ZGYJG54DRW7.1 size=546824 2024-08-27T02:38:07.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.795+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=3ZGYJG54DRW7 tag=FHNM9WRHXQNE type=write size=2643976 2024-08-27T02:38:07.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.799+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=687K1BU67QHT type=del size=505473 2024-08-27T02:38:07.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.803+0000 7f3e0cc408c0 1 < completed delete operation key=0OLVDEQWBCAQ tag=NF6VT19XO6SP type=del 2024-08-27T02:38:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.807+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=CO6UYWUTRPMM type=del size=1469980 2024-08-27T02:38:07.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.807+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=J44R284ZO2EC type=del 2024-08-27T02:38:07.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.811+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=KM5RAXB880X2 type=write size=1023201 2024-08-27T02:38:07.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.811+0000 7f3e0cc408c0 1 < canceled part key=_multipart_2CXWPDABA9XJ.2~LTNSQD460KFP.0 size=1048576 2024-08-27T02:38:07.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.815+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~LTNSQD460KFP.1 size=27306 2024-08-27T02:38:07.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.819+0000 7f3e0cc408c0 1 < canceled multipart upload key=2CXWPDABA9XJ upload=LTNSQD460KFP tag=Z4T4IK287DCS type=write size=2124458 2024-08-27T02:38:07.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.823+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=K51S3HZCLRJQ type=del size=641752 2024-08-27T02:38:07.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.823+0000 7f3e0cc408c0 -1 < failed to complete operation key=HTEOX3BV94K2 tag=WQNUGP04C516 type=del size=3245633: (22) Invalid argument 2024-08-27T02:38:07.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.827+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=0PQM2UT7D21E type=del size=2452634 2024-08-27T02:38:07.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.831+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~IB3MRVGH65NT.0 size=1048576 2024-08-27T02:38:07.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.831+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~IB3MRVGH65NT.1 size=1048576 2024-08-27T02:38:07.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.835+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~IB3MRVGH65NT.2 size=714352 2024-08-27T02:38:07.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.839+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=IB3MRVGH65NT tag=DRB77GIVWISW type=write size=3860080 2024-08-27T02:38:07.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.843+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~DABR20IXIO4B.0 size=262714 2024-08-27T02:38:07.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.843+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=DABR20IXIO4B tag=93CBE2SPLR77 type=write size=1311290 2024-08-27T02:38:07.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.847+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~QS2XU19AVQVM.0 size=1048576 2024-08-27T02:38:07.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~QS2XU19AVQVM.1 size=1048576 2024-08-27T02:38:07.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~QS2XU19AVQVM.2 size=1036262 2024-08-27T02:38:07.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.859+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=QS2XU19AVQVM tag=7ZDDX59PLJ3Z type=write size=4181990 2024-08-27T02:38:07.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.863+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~ADB1T2AOA2PG.0 size=1048576 2024-08-27T02:38:07.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.867+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~ADB1T2AOA2PG.1 size=1048576 2024-08-27T02:38:07.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.867+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~ADB1T2AOA2PG.2 size=101802 2024-08-27T02:38:07.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.867+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=ADB1T2AOA2PG tag=CP4MCFEB41LD type=write size=3247530 2024-08-27T02:38:07.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.871+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=GJXY8Y8SG5UY type=del 2024-08-27T02:38:07.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.875+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=W671N1G7OCC6 type=del size=2608266 2024-08-27T02:38:07.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.879+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=QZQVT0CVZFH2 type=del size=2797402 2024-08-27T02:38:07.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.883+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=1DYJX8QJZO2N type=del size=2277685 2024-08-27T02:38:07.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.887+0000 7f3e0cc408c0 1 < canceled operation key=O66XJ7GJMPCU tag=EZ1ODVZ2B0NS type=write size=969170 2024-08-27T02:38:07.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.891+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=LY2SMTZTGLCV type=del size=220861 2024-08-27T02:38:07.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.891+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~16YILKBXC8D5.0 size=1048576 2024-08-27T02:38:07.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.895+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~16YILKBXC8D5.1 size=1048576 2024-08-27T02:38:07.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.899+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~16YILKBXC8D5.2 size=43281 2024-08-27T02:38:07.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.903+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=16YILKBXC8D5 tag=I4G2OTA0PIIE type=write size=3189009 2024-08-27T02:38:07.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.907+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=L82NH74HHL83 type=del size=2097343 2024-08-27T02:38:07.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.911+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=YVHFPHFZT2W5 type=del 2024-08-27T02:38:07.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.911+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=99KPVNQH4HNT type=del size=4063329 2024-08-27T02:38:07.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.915+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~XKMTKA311H2M.0 size=1048576 2024-08-27T02:38:07.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.919+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~XKMTKA311H2M.1 size=1048576 2024-08-27T02:38:07.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.919+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~XKMTKA311H2M.2 size=301400 2024-08-27T02:38:07.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.927+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=XKMTKA311H2M tag=YJJFJ8UZOFF9 type=write size=3447128 2024-08-27T02:38:07.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.927+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=5OE4JAS046H4 type=write size=495604 2024-08-27T02:38:07.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.931+0000 7f3e0cc408c0 1 < canceled operation key=KTPZGZSQCERQ tag=IFVFDW8T4NDB type=del size=1915000 2024-08-27T02:38:07.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~H8IRL0E0NXGS.0 size=1048576 2024-08-27T02:38:07.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~H8IRL0E0NXGS.1 size=384445 2024-08-27T02:38:07.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.939+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=H8IRL0E0NXGS tag=SIPK3WRZI1M3 type=write size=2481597 2024-08-27T02:38:07.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.943+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~VC9URPM4EPZ7.0 size=1048576 2024-08-27T02:38:07.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.947+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~VC9URPM4EPZ7.1 size=805693 2024-08-27T02:38:07.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.951+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=VC9URPM4EPZ7 tag=LUYDMJ4YLWN9 type=write size=2902845 2024-08-27T02:38:07.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.955+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~NQ9YAD9HDP05.0 size=1048576 2024-08-27T02:38:07.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.959+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~NQ9YAD9HDP05.1 size=1048576 2024-08-27T02:38:07.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.963+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~NQ9YAD9HDP05.2 size=523245 2024-08-27T02:38:07.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.963+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=NQ9YAD9HDP05 tag=85KE35KJ0Z76 type=write size=3668973 2024-08-27T02:38:07.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.967+0000 7f3e0cc408c0 1 < suggested remove operation key=0U59R3BXL181 tag=5AJNCLCAJZCM type=write 2024-08-27T02:38:07.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.971+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~F55TCF3MP1WR.0 size=1048576 2024-08-27T02:38:07.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~F55TCF3MP1WR.1 size=48042 2024-08-27T02:38:07.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.975+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=F55TCF3MP1WR tag=W27A13DNTHFU type=write size=2145194 2024-08-27T02:38:07.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.979+0000 7f3e0cc408c0 1 < suggested remove operation key=4SSZQK6YIL1O tag=687K1BU67QHT type=del 2024-08-27T02:38:07.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.987+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~NAQ6TE7HI3Y1.0 size=878103 2024-08-27T02:38:07.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.987+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=NAQ6TE7HI3Y1 tag=FFF675ROSV5T type=write size=1926679 2024-08-27T02:38:07.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.987+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=CO6UYWUTRPMM type=del 2024-08-27T02:38:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.995+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~ALDUT1AHOVPC.0 size=1048576 2024-08-27T02:38:07.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.995+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~ALDUT1AHOVPC.1 size=55343 2024-08-27T02:38:07.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.995+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=ALDUT1AHOVPC tag=Y8ZQ6JGXWGO8 type=write size=2152495 2024-08-27T02:38:07.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:07.999+0000 7f3e0cc408c0 1 < completed write operation key=O66XJ7GJMPCU tag=KM5RAXB880X2 type=write size=1023201 2024-08-27T02:38:08.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~301D9SC9DAF4.0 size=193444 2024-08-27T02:38:08.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.003+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=301D9SC9DAF4 tag=A79OL5DPVO36 type=write size=1242020 2024-08-27T02:38:08.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.007+0000 7f3e0cc408c0 1 < suggested update operation key=F4MCLPFLY531 tag=K51S3HZCLRJQ type=del size=641752 2024-08-27T02:38:08.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.011+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=FE9W6BWFWKU5 type=del size=2724772 2024-08-27T02:38:08.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.015+0000 7f3e0cc408c0 1 < suggested update operation key=8VSA6T2H8FDI tag=0PQM2UT7D21E type=del size=2452634 2024-08-27T02:38:08.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.019+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=65ANV67UPZEN type=del size=1686380 2024-08-27T02:38:08.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~DABR20IXIO4B.0 size=262714 2024-08-27T02:38:08.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.027+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=DABR20IXIO4B tag=93CBE2SPLR77 type=write size=1311290 2024-08-27T02:38:08.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.031+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=V5GZXYGQI3P9 type=del size=3790109 2024-08-27T02:38:08.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~ADB1T2AOA2PG.0 size=1048576 2024-08-27T02:38:08.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.031+0000 7f3e0cc408c0 1 < canceled part key=_multipart_SG9T1RD5EATR.2~ADB1T2AOA2PG.1 size=1048576 2024-08-27T02:38:08.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.035+0000 7f3e0cc408c0 1 < canceled part key=_multipart_SG9T1RD5EATR.2~ADB1T2AOA2PG.2 size=101802 2024-08-27T02:38:08.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.039+0000 7f3e0cc408c0 1 < canceled multipart upload key=SG9T1RD5EATR upload=ADB1T2AOA2PG tag=CP4MCFEB41LD type=write size=3247530 2024-08-27T02:38:08.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.039+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=KZGDS4IA7XWU type=del size=519131 2024-08-27T02:38:08.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.051+0000 7f3e0cc408c0 1 < suggested update operation key=PLC076BXR38P tag=W671N1G7OCC6 type=del size=2608266 2024-08-27T02:38:08.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.055+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~FJ3XCF3LFZCG.0 size=1048576 2024-08-27T02:38:08.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.059+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~FJ3XCF3LFZCG.1 size=414564 2024-08-27T02:38:08.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.059+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=FJ3XCF3LFZCG tag=E2M5ODUPU6HD type=write size=2511716 2024-08-27T02:38:08.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.059+0000 7f3e0cc408c0 1 < canceled operation key=MKB40KOOCCNT tag=1DYJX8QJZO2N type=del size=2277685 2024-08-27T02:38:08.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.063+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=DRVV362I9GRO type=write size=942363 2024-08-27T02:38:08.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.067+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=LY2SMTZTGLCV type=del 2024-08-27T02:38:08.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.071+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=NISEZVW41LDA type=del size=1846954 2024-08-27T02:38:08.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.071+0000 7f3e0cc408c0 -1 < failed to complete operation key=F4MCLPFLY531 tag=L82NH74HHL83 type=del size=2097343: (22) Invalid argument 2024-08-27T02:38:08.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.075+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=JMLK9PKBMIBB type=write size=554304 2024-08-27T02:38:08.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.079+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=99KPVNQH4HNT type=del 2024-08-27T02:38:08.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.079+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=WNRLTZWBZG5N type=del size=2494624 2024-08-27T02:38:08.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.083+0000 7f3e0cc408c0 1 < completed write operation key=SG9T1RD5EATR tag=5OE4JAS046H4 type=write size=495604 2024-08-27T02:38:08.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.087+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=XFG2IGI8AIGU type=del size=2159402 2024-08-27T02:38:08.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.087+0000 7f3e0cc408c0 1 < canceled part key=_multipart_QVG1NTF6O8L2.2~H8IRL0E0NXGS.0 size=1048576 2024-08-27T02:38:08.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.091+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~H8IRL0E0NXGS.1 size=384445 2024-08-27T02:38:08.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.095+0000 7f3e0cc408c0 1 < canceled multipart upload key=QVG1NTF6O8L2 upload=H8IRL0E0NXGS tag=SIPK3WRZI1M3 type=write size=2481597 2024-08-27T02:38:08.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.099+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=1U9RRCS8OUJJ type=del size=1396363 2024-08-27T02:38:08.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.099+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~NQ9YAD9HDP05.0 size=1048576 2024-08-27T02:38:08.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.103+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~NQ9YAD9HDP05.1 size=1048576 2024-08-27T02:38:08.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.103+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~NQ9YAD9HDP05.2 size=523245 2024-08-27T02:38:08.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.111+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=NQ9YAD9HDP05 tag=85KE35KJ0Z76 type=write size=3668973 2024-08-27T02:38:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.115+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=P1N028RUMJ0V type=del size=3383870 2024-08-27T02:38:08.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.115+0000 7f3e0cc408c0 1 < canceled part key=_multipart_MKB40KOOCCNT.2~F55TCF3MP1WR.0 size=1048576 2024-08-27T02:38:08.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~F55TCF3MP1WR.1 size=48042 2024-08-27T02:38:08.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.123+0000 7f3e0cc408c0 1 < canceled multipart upload key=MKB40KOOCCNT upload=F55TCF3MP1WR tag=W27A13DNTHFU type=write size=2145194 2024-08-27T02:38:08.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.127+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=YTSXSMDP01O1 type=write size=985591 2024-08-27T02:38:08.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.127+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~NAQ6TE7HI3Y1.0 size=878103 2024-08-27T02:38:08.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.135+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=NAQ6TE7HI3Y1 tag=FFF675ROSV5T type=write size=1926679 2024-08-27T02:38:08.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.139+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=J5U44AY3CWVQ type=del size=357917 2024-08-27T02:38:08.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.139+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~ALDUT1AHOVPC.0 size=1048576 2024-08-27T02:38:08.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.139+0000 7f3e0cc408c0 1 < canceled part key=_multipart_A0RUXE4YL6NR.2~ALDUT1AHOVPC.1 size=55343 2024-08-27T02:38:08.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.147+0000 7f3e0cc408c0 1 < canceled multipart upload key=A0RUXE4YL6NR upload=ALDUT1AHOVPC tag=Y8ZQ6JGXWGO8 type=write size=2152495 2024-08-27T02:38:08.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.151+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~WXLIJWVWXBBM.0 size=1048576 2024-08-27T02:38:08.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.155+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~WXLIJWVWXBBM.1 size=827753 2024-08-27T02:38:08.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.155+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=WXLIJWVWXBBM tag=DG5JT701G0YV type=write size=2924905 2024-08-27T02:38:08.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~301D9SC9DAF4.0 size=193444 2024-08-27T02:38:08.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.163+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=301D9SC9DAF4 tag=A79OL5DPVO36 type=write size=1242020 2024-08-27T02:38:08.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.167+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=8NHUVPP01ICR type=del size=3170477 2024-08-27T02:38:08.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.167+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=FE9W6BWFWKU5 type=del 2024-08-27T02:38:08.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.171+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=GPIGPKV5IATD type=del size=3802102 2024-08-27T02:38:08.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.175+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=65ANV67UPZEN type=del 2024-08-27T02:38:08.179 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.179+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~Z07WAL5JFCHO.0 size=577355 2024-08-27T02:38:08.179 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.179+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=Z07WAL5JFCHO tag=LM0SE9FFWL7Z type=write size=1625931 2024-08-27T02:38:08.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.183+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=V5GZXYGQI3P9 type=del 2024-08-27T02:38:08.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.183+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=HPJRMM1CS89N type=del size=1952252 2024-08-27T02:38:08.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.187+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=KZGDS4IA7XWU type=del 2024-08-27T02:38:08.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.191+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=8T47KJT52905 type=del size=3792437 2024-08-27T02:38:08.194 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.195+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~FJ3XCF3LFZCG.0 size=1048576 2024-08-27T02:38:08.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.195+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~FJ3XCF3LFZCG.1 size=414564 2024-08-27T02:38:08.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.199+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=FJ3XCF3LFZCG tag=E2M5ODUPU6HD type=write size=2511716 2024-08-27T02:38:08.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.207+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~SNEUPROPWSCV.0 size=1048576 2024-08-27T02:38:08.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.207+0000 7f3e0cc408c0 1 > prepared part key=_multipart_O66XJ7GJMPCU.2~SNEUPROPWSCV.1 size=387358 2024-08-27T02:38:08.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.207+0000 7f3e0cc408c0 1 > prepared multipart upload key=O66XJ7GJMPCU upload=SNEUPROPWSCV tag=350DC6Q5Z00Y type=write size=2484510 2024-08-27T02:38:08.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.211+0000 7f3e0cc408c0 1 < suggested remove operation key=S5ANS33DXN7X tag=DRVV362I9GRO type=write 2024-08-27T02:38:08.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.215+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=MBUK6NAM6Y2U type=del size=119679 2024-08-27T02:38:08.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.219+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=NISEZVW41LDA type=del 2024-08-27T02:38:08.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.219+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=77A2PUHIS6VX type=del size=947853 2024-08-27T02:38:08.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.223+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=JMLK9PKBMIBB type=write size=554304 2024-08-27T02:38:08.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.227+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=F4247ZS8087F type=del size=3507884 2024-08-27T02:38:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.227+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=WNRLTZWBZG5N type=del 2024-08-27T02:38:08.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.231+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=8OLWGOKT1NHS type=del size=3795579 2024-08-27T02:38:08.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.235+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=XFG2IGI8AIGU type=del 2024-08-27T02:38:08.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.235+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=MTDH44EMVGJR type=del size=479541 2024-08-27T02:38:08.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.239+0000 7f3e0cc408c0 1 < completed delete operation key=13M7JVZT12I2 tag=1U9RRCS8OUJJ type=del 2024-08-27T02:38:08.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.247+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~TCHSCO0NJWZ7.0 size=308340 2024-08-27T02:38:08.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.247+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=TCHSCO0NJWZ7 tag=6BDF07BUB5EY type=write size=1356916 2024-08-27T02:38:08.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.247+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=P1N028RUMJ0V type=del 2024-08-27T02:38:08.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.251+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=VLYF3HPEPB01 type=del size=808792 2024-08-27T02:38:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.255+0000 7f3e0cc408c0 1 < completed write operation key=PLC076BXR38P tag=YTSXSMDP01O1 type=write size=985591 2024-08-27T02:38:08.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.259+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=9BKAV9CLE2SB type=del size=3324312 2024-08-27T02:38:08.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.259+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=J5U44AY3CWVQ type=del 2024-08-27T02:38:08.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.263+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=PB1NPK8EZLWX type=del size=2906410 2024-08-27T02:38:08.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.267+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~WXLIJWVWXBBM.0 size=1048576 2024-08-27T02:38:08.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.267+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~WXLIJWVWXBBM.1 size=827753 2024-08-27T02:38:08.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.271+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=WXLIJWVWXBBM tag=DG5JT701G0YV type=write size=2924905 2024-08-27T02:38:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.275+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=10A1LWW9WTW9 type=del size=2829004 2024-08-27T02:38:08.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.279+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=8NHUVPP01ICR type=del 2024-08-27T02:38:08.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.279+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=UNNLOY591S8A type=write size=312073 2024-08-27T02:38:08.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.283+0000 7f3e0cc408c0 1 < canceled operation key=KTPZGZSQCERQ tag=GPIGPKV5IATD type=del size=3802102 2024-08-27T02:38:08.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.287+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~5LQFCIRO62D4.0 size=1048576 2024-08-27T02:38:08.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.291+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~5LQFCIRO62D4.1 size=1048576 2024-08-27T02:38:08.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.291+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~5LQFCIRO62D4.2 size=616797 2024-08-27T02:38:08.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.291+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=5LQFCIRO62D4 tag=VLOHZRC20YKV type=write size=3762525 2024-08-27T02:38:08.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.295+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~Z07WAL5JFCHO.0 size=577355 2024-08-27T02:38:08.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.299+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=Z07WAL5JFCHO tag=LM0SE9FFWL7Z type=write size=1625931 2024-08-27T02:38:08.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.303+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~QKUYBVRIPWQA.0 size=1048576 2024-08-27T02:38:08.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~QKUYBVRIPWQA.1 size=1048576 2024-08-27T02:38:08.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.307+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~QKUYBVRIPWQA.2 size=329864 2024-08-27T02:38:08.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.307+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=QKUYBVRIPWQA tag=44PD9T3WRJ0F type=write size=3475592 2024-08-27T02:38:08.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.311+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=HPJRMM1CS89N type=del 2024-08-27T02:38:08.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.315+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=IXKR0PL4GSL0 type=del size=3796119 2024-08-27T02:38:08.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.319+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=8T47KJT52905 type=del 2024-08-27T02:38:08.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.323+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=MDX30OLRGU9A type=del size=3545953 2024-08-27T02:38:08.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.327+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~SNEUPROPWSCV.0 size=1048576 2024-08-27T02:38:08.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.327+0000 7f3e0cc408c0 1 < completed part key=_multipart_O66XJ7GJMPCU.2~SNEUPROPWSCV.1 size=387358 2024-08-27T02:38:08.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.331+0000 7f3e0cc408c0 1 < completed multipart upload key=O66XJ7GJMPCU upload=SNEUPROPWSCV tag=350DC6Q5Z00Y type=write size=2484510 2024-08-27T02:38:08.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~8Y35E5QHGI37.0 size=1048576 2024-08-27T02:38:08.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.339+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~8Y35E5QHGI37.1 size=1048576 2024-08-27T02:38:08.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.343+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~8Y35E5QHGI37.2 size=554481 2024-08-27T02:38:08.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.343+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=8Y35E5QHGI37 tag=Q24WFV173TLV type=write size=3700209 2024-08-27T02:38:08.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.347+0000 7f3e0cc408c0 1 < suggested update operation key=2CXWPDABA9XJ tag=MBUK6NAM6Y2U type=del size=119679 2024-08-27T02:38:08.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.351+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=OZ5A0S3VZ7JB type=del size=716600 2024-08-27T02:38:08.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.355+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=77A2PUHIS6VX type=del 2024-08-27T02:38:08.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.355+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=45RST0LZY1H0 type=del size=1772005 2024-08-27T02:38:08.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.359+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=F4247ZS8087F type=del 2024-08-27T02:38:08.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~W7Y6EEXV0DQP.0 size=1048576 2024-08-27T02:38:08.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~W7Y6EEXV0DQP.1 size=1035835 2024-08-27T02:38:08.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.367+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=W7Y6EEXV0DQP tag=24PD8L3GFFWK type=write size=3132987 2024-08-27T02:38:08.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.371+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=8OLWGOKT1NHS type=del 2024-08-27T02:38:08.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.375+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=H5PIYSRV99HQ type=del size=4058721 2024-08-27T02:38:08.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.379+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=MTDH44EMVGJR type=del 2024-08-27T02:38:08.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~M7BWCT7PIJ3S.0 size=1048576 2024-08-27T02:38:08.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~M7BWCT7PIJ3S.1 size=1048576 2024-08-27T02:38:08.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.387+0000 7f3e0cc408c0 1 > prepared part key=_multipart_IISECLYEAR19.2~M7BWCT7PIJ3S.2 size=959060 2024-08-27T02:38:08.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.387+0000 7f3e0cc408c0 1 > prepared multipart upload key=IISECLYEAR19 upload=M7BWCT7PIJ3S tag=C81KKU7OAU5J type=write size=4104788 2024-08-27T02:38:08.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~TCHSCO0NJWZ7.0 size=308340 2024-08-27T02:38:08.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.395+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=TCHSCO0NJWZ7 tag=6BDF07BUB5EY type=write size=1356916 2024-08-27T02:38:08.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.399+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=EVXARAWP5L5L type=del size=982632 2024-08-27T02:38:08.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.403+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=VLYF3HPEPB01 type=del 2024-08-27T02:38:08.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.407+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=L52JGSFT0842 type=write size=987410 2024-08-27T02:38:08.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.411+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=9BKAV9CLE2SB type=del 2024-08-27T02:38:08.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.415+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~04Y8Z357N64P.0 size=1048576 2024-08-27T02:38:08.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.419+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~04Y8Z357N64P.1 size=1048576 2024-08-27T02:38:08.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.419+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~04Y8Z357N64P.2 size=514315 2024-08-27T02:38:08.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.419+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=04Y8Z357N64P tag=QPURAY25YNB0 type=write size=3660043 2024-08-27T02:38:08.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.423+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=PB1NPK8EZLWX type=del 2024-08-27T02:38:08.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.427+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=PG8A4UWFGQ7C type=del size=958150 2024-08-27T02:38:08.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.431+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=10A1LWW9WTW9 type=del 2024-08-27T02:38:08.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.435+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~LVMPW9AYSRQO.0 size=1048576 2024-08-27T02:38:08.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.439+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~LVMPW9AYSRQO.1 size=817030 2024-08-27T02:38:08.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.439+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=LVMPW9AYSRQO tag=3L51YDG5526E type=write size=2914182 2024-08-27T02:38:08.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.443+0000 7f3e0cc408c0 1 < completed write operation key=0OLVDEQWBCAQ tag=UNNLOY591S8A type=write size=312073 2024-08-27T02:38:08.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.447+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=II9IJ0U52X21 type=del size=2692947 2024-08-27T02:38:08.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~5LQFCIRO62D4.0 size=1048576 2024-08-27T02:38:08.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~5LQFCIRO62D4.1 size=1048576 2024-08-27T02:38:08.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.455+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~5LQFCIRO62D4.2 size=616797 2024-08-27T02:38:08.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.459+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=5LQFCIRO62D4 tag=VLOHZRC20YKV type=write size=3762525 2024-08-27T02:38:08.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.463+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~LNXGIE1R1AI3.0 size=1048576 2024-08-27T02:38:08.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.467+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~LNXGIE1R1AI3.1 size=912500 2024-08-27T02:38:08.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.467+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=LNXGIE1R1AI3 tag=ZGIUGX89W9HC type=write size=3009652 2024-08-27T02:38:08.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.471+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~QKUYBVRIPWQA.0 size=1048576 2024-08-27T02:38:08.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.471+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~QKUYBVRIPWQA.1 size=1048576 2024-08-27T02:38:08.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~QKUYBVRIPWQA.2 size=329864 2024-08-27T02:38:08.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.479+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=QKUYBVRIPWQA tag=44PD9T3WRJ0F type=write size=3475592 2024-08-27T02:38:08.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.483+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~WG2B4THFFFQW.0 size=1048576 2024-08-27T02:38:08.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.487+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~WG2B4THFFFQW.1 size=1048576 2024-08-27T02:38:08.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.491+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~WG2B4THFFFQW.2 size=386413 2024-08-27T02:38:08.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.491+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=WG2B4THFFFQW tag=42TUZZEWRUX0 type=write size=3532141 2024-08-27T02:38:08.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.491+0000 7f3e0cc408c0 1 < canceled operation key=0OLVDEQWBCAQ tag=IXKR0PL4GSL0 type=del size=3796119 2024-08-27T02:38:08.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~ZCHBQT5BL6OL.0 size=1048576 2024-08-27T02:38:08.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~ZCHBQT5BL6OL.1 size=1048576 2024-08-27T02:38:08.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.503+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~ZCHBQT5BL6OL.2 size=728498 2024-08-27T02:38:08.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.503+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=ZCHBQT5BL6OL tag=U8FKFM4TYHL8 type=write size=3874226 2024-08-27T02:38:08.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.507+0000 7f3e0cc408c0 1 < canceled operation key=HTEOX3BV94K2 tag=MDX30OLRGU9A type=del size=3545953 2024-08-27T02:38:08.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.511+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=WSULBBS9T33G type=del size=2907632 2024-08-27T02:38:08.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.511+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~8Y35E5QHGI37.0 size=1048576 2024-08-27T02:38:08.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.515+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~8Y35E5QHGI37.1 size=1048576 2024-08-27T02:38:08.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.519+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~8Y35E5QHGI37.2 size=554481 2024-08-27T02:38:08.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.523+0000 7f3e0cc408c0 1 < completed multipart upload key=IISECLYEAR19 upload=8Y35E5QHGI37 tag=Q24WFV173TLV type=write size=3700209 2024-08-27T02:38:08.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.527+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=XM9HN8CGGRV5 type=del size=2797116 2024-08-27T02:38:08.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.527+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=OZ5A0S3VZ7JB type=del 2024-08-27T02:38:08.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.531+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=UYLZS8QN8F2M type=write size=331989 2024-08-27T02:38:08.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.535+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=45RST0LZY1H0 type=del 2024-08-27T02:38:08.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.539+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~H5AXD8HF0UFH.0 size=1048576 2024-08-27T02:38:08.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.543+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~H5AXD8HF0UFH.1 size=219249 2024-08-27T02:38:08.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.543+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=H5AXD8HF0UFH tag=2Y400GKRAY41 type=write size=2316401 2024-08-27T02:38:08.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.543+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~W7Y6EEXV0DQP.0 size=1048576 2024-08-27T02:38:08.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.547+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~W7Y6EEXV0DQP.1 size=1035835 2024-08-27T02:38:08.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.551+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=W7Y6EEXV0DQP tag=24PD8L3GFFWK type=write size=3132987 2024-08-27T02:38:08.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.555+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=1K8XE0ILYATR type=del size=3774364 2024-08-27T02:38:08.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.555+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=H5PIYSRV99HQ type=del 2024-08-27T02:38:08.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.559+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~O4HX3FEPRW1T.0 size=1048576 2024-08-27T02:38:08.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~O4HX3FEPRW1T.1 size=1048576 2024-08-27T02:38:08.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~O4HX3FEPRW1T.2 size=847883 2024-08-27T02:38:08.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.563+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=O4HX3FEPRW1T tag=KPM4USLYLJ9W type=write size=3993611 2024-08-27T02:38:08.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.567+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~M7BWCT7PIJ3S.0 size=1048576 2024-08-27T02:38:08.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.567+0000 7f3e0cc408c0 1 < canceled part key=_multipart_IISECLYEAR19.2~M7BWCT7PIJ3S.1 size=1048576 2024-08-27T02:38:08.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.571+0000 7f3e0cc408c0 1 < completed part key=_multipart_IISECLYEAR19.2~M7BWCT7PIJ3S.2 size=959060 2024-08-27T02:38:08.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.575+0000 7f3e0cc408c0 1 < canceled multipart upload key=IISECLYEAR19 upload=M7BWCT7PIJ3S tag=C81KKU7OAU5J type=write size=4104788 2024-08-27T02:38:08.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~HJ1NQ1HQVX45.0 size=1048576 2024-08-27T02:38:08.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.579+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~HJ1NQ1HQVX45.1 size=1048576 2024-08-27T02:38:08.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.583+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~HJ1NQ1HQVX45.2 size=188537 2024-08-27T02:38:08.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.583+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=HJ1NQ1HQVX45 tag=2M1Z3CYCA816 type=write size=3334265 2024-08-27T02:38:08.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.583+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=EVXARAWP5L5L type=del 2024-08-27T02:38:08.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.587+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=W68O4CPMQ1GH type=del size=1792574 2024-08-27T02:38:08.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.591+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=L52JGSFT0842 type=write size=987410 2024-08-27T02:38:08.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.599+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~HUXU0NUVXC4X.0 size=1048576 2024-08-27T02:38:08.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.599+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~HUXU0NUVXC4X.1 size=1048576 2024-08-27T02:38:08.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.603+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~HUXU0NUVXC4X.2 size=750588 2024-08-27T02:38:08.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.603+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=HUXU0NUVXC4X tag=AL25OD9YL0OS type=write size=3896316 2024-08-27T02:38:08.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~04Y8Z357N64P.0 size=1048576 2024-08-27T02:38:08.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~04Y8Z357N64P.1 size=1048576 2024-08-27T02:38:08.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~04Y8Z357N64P.2 size=514315 2024-08-27T02:38:08.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.611+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=04Y8Z357N64P tag=QPURAY25YNB0 type=write size=3660043 2024-08-27T02:38:08.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.615+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=CNJ957AOUUG1 type=del size=3719431 2024-08-27T02:38:08.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.619+0000 7f3e0cc408c0 1 < canceled operation key=IISECLYEAR19 tag=PG8A4UWFGQ7C type=del size=958150 2024-08-27T02:38:08.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.619+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=5ZTUQHE7NMGI type=write size=1016991 2024-08-27T02:38:08.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~LVMPW9AYSRQO.0 size=1048576 2024-08-27T02:38:08.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~LVMPW9AYSRQO.1 size=817030 2024-08-27T02:38:08.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.631+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=LVMPW9AYSRQO tag=3L51YDG5526E type=write size=2914182 2024-08-27T02:38:08.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~CMI899JBQYCJ.0 size=1048576 2024-08-27T02:38:08.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.635+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~CMI899JBQYCJ.1 size=858896 2024-08-27T02:38:08.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.635+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=CMI899JBQYCJ tag=J5279S99H4CM type=write size=2956048 2024-08-27T02:38:08.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.639+0000 7f3e0cc408c0 1 < canceled operation key=8VSA6T2H8FDI tag=II9IJ0U52X21 type=del size=2692947 2024-08-27T02:38:08.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.643+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=NOQ8R2OS2ET2 type=write size=403342 2024-08-27T02:38:08.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.643+0000 7f3e0cc408c0 1 < canceled part key=_multipart_UGSWC9ZK9S7S.2~LNXGIE1R1AI3.0 size=1048576 2024-08-27T02:38:08.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.643+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~LNXGIE1R1AI3.1 size=912500 2024-08-27T02:38:08.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.647+0000 7f3e0cc408c0 1 < canceled multipart upload key=UGSWC9ZK9S7S upload=LNXGIE1R1AI3 tag=ZGIUGX89W9HC type=write size=3009652 2024-08-27T02:38:08.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.651+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~MFJ1FP8D4ZUE.0 size=1048576 2024-08-27T02:38:08.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.655+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~MFJ1FP8D4ZUE.1 size=744748 2024-08-27T02:38:08.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.655+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=MFJ1FP8D4ZUE tag=MFY95L0WJ68B type=write size=2841900 2024-08-27T02:38:08.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.659+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~WG2B4THFFFQW.0 size=1048576 2024-08-27T02:38:08.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.659+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~WG2B4THFFFQW.1 size=1048576 2024-08-27T02:38:08.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.663+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~WG2B4THFFFQW.2 size=386413 2024-08-27T02:38:08.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.667+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=WG2B4THFFFQW tag=42TUZZEWRUX0 type=write size=3532141 2024-08-27T02:38:08.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.671+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=2TUEOCB2ZM38 type=del size=288461 2024-08-27T02:38:08.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.671+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~ZCHBQT5BL6OL.0 size=1048576 2024-08-27T02:38:08.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~ZCHBQT5BL6OL.1 size=1048576 2024-08-27T02:38:08.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~ZCHBQT5BL6OL.2 size=728498 2024-08-27T02:38:08.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.679+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=ZCHBQT5BL6OL tag=U8FKFM4TYHL8 type=write size=3874226 2024-08-27T02:38:08.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.683+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~LG67MBOQOIA8.0 size=1048576 2024-08-27T02:38:08.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.687+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~LG67MBOQOIA8.1 size=169608 2024-08-27T02:38:08.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.687+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=LG67MBOQOIA8 tag=022UTPRVFLCJ type=write size=2266760 2024-08-27T02:38:08.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.691+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=WSULBBS9T33G type=del 2024-08-27T02:38:08.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.695+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~NXUCMISSQRWH.0 size=1048576 2024-08-27T02:38:08.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.695+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~NXUCMISSQRWH.1 size=583503 2024-08-27T02:38:08.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.695+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=NXUCMISSQRWH tag=O6XNBHHNXJ6N type=write size=2680655 2024-08-27T02:38:08.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.699+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=XM9HN8CGGRV5 type=del 2024-08-27T02:38:08.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.703+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~OG8RFMXD2DTH.0 size=1048576 2024-08-27T02:38:08.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.707+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~OG8RFMXD2DTH.1 size=1048576 2024-08-27T02:38:08.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.707+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~OG8RFMXD2DTH.2 size=424469 2024-08-27T02:38:08.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.707+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=OG8RFMXD2DTH tag=JC5HTOOFN3TQ type=write size=3570197 2024-08-27T02:38:08.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.715+0000 7f3e0cc408c0 1 < suggested update operation key=S5ANS33DXN7X tag=UYLZS8QN8F2M type=write size=331989 2024-08-27T02:38:08.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.719+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~3W224Z9ZMDBC.0 size=271182 2024-08-27T02:38:08.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.719+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=3W224Z9ZMDBC tag=4WS54W67OVMU type=write size=1319758 2024-08-27T02:38:08.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.719+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6QE1HU65GQZZ.2~H5AXD8HF0UFH.0 size=1048576 2024-08-27T02:38:08.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.719+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~H5AXD8HF0UFH.1 size=219249 2024-08-27T02:38:08.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.727+0000 7f3e0cc408c0 1 < canceled multipart upload key=6QE1HU65GQZZ upload=H5AXD8HF0UFH tag=2Y400GKRAY41 type=write size=2316401 2024-08-27T02:38:08.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.727+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=KEBDOF6NCASW type=del size=1564123 2024-08-27T02:38:08.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.731+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=1K8XE0ILYATR type=del 2024-08-27T02:38:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.735+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~8QKH3OGZ19B4.0 size=901583 2024-08-27T02:38:08.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.735+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=8QKH3OGZ19B4 tag=46FUIF43EZTT type=write size=1950159 2024-08-27T02:38:08.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~O4HX3FEPRW1T.0 size=1048576 2024-08-27T02:38:08.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.739+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~O4HX3FEPRW1T.1 size=1048576 2024-08-27T02:38:08.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.743+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~O4HX3FEPRW1T.2 size=847883 2024-08-27T02:38:08.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.747+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=O4HX3FEPRW1T tag=KPM4USLYLJ9W type=write size=3993611 2024-08-27T02:38:08.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.751+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~JA4PXII6V2D6.0 size=646166 2024-08-27T02:38:08.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.751+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=JA4PXII6V2D6 tag=GQ81E210QWNL type=write size=1694742 2024-08-27T02:38:08.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.755+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~HJ1NQ1HQVX45.0 size=1048576 2024-08-27T02:38:08.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.755+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~HJ1NQ1HQVX45.1 size=1048576 2024-08-27T02:38:08.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.759+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~HJ1NQ1HQVX45.2 size=188537 2024-08-27T02:38:08.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.763+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=HJ1NQ1HQVX45 tag=2M1Z3CYCA816 type=write size=3334265 2024-08-27T02:38:08.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.763+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=61X87UBBRQ1J type=del size=2442593 2024-08-27T02:38:08.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.767+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=W68O4CPMQ1GH type=del 2024-08-27T02:38:08.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.771+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=3JKVOVCE7P0H type=del size=1554708 2024-08-27T02:38:08.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.771+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~HUXU0NUVXC4X.0 size=1048576 2024-08-27T02:38:08.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.775+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~HUXU0NUVXC4X.1 size=1048576 2024-08-27T02:38:08.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.779+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~HUXU0NUVXC4X.2 size=750588 2024-08-27T02:38:08.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.783+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=HUXU0NUVXC4X tag=AL25OD9YL0OS type=write size=3896316 2024-08-27T02:38:08.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~BIL0DYIPXQV2.0 size=1048576 2024-08-27T02:38:08.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~BIL0DYIPXQV2.1 size=1048576 2024-08-27T02:38:08.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~BIL0DYIPXQV2.2 size=83339 2024-08-27T02:38:08.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.791+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=BIL0DYIPXQV2 tag=PBVXV405AAJZ type=write size=3229067 2024-08-27T02:38:08.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.795+0000 7f3e0cc408c0 1 < completed delete operation key=6YTZJKE4V5HQ tag=CNJ957AOUUG1 type=del 2024-08-27T02:38:08.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.795+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=2GB1FQJPLBF4 type=write size=735018 2024-08-27T02:38:08.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.799+0000 7f3e0cc408c0 1 < completed write operation key=4BV3C9MTIFT5 tag=5ZTUQHE7NMGI type=write size=1016991 2024-08-27T02:38:08.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~LRMN5LGTG310.0 size=1048576 2024-08-27T02:38:08.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~LRMN5LGTG310.1 size=223549 2024-08-27T02:38:08.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.803+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=LRMN5LGTG310 tag=2DFJ5ASGQ4JK type=write size=2320701 2024-08-27T02:38:08.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.807+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~CMI899JBQYCJ.0 size=1048576 2024-08-27T02:38:08.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.811+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~CMI899JBQYCJ.1 size=858896 2024-08-27T02:38:08.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.815+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=CMI899JBQYCJ tag=J5279S99H4CM type=write size=2956048 2024-08-27T02:38:08.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.815+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=RUTPP27H1IJG type=del size=1481738 2024-08-27T02:38:08.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.819+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=NOQ8R2OS2ET2 type=write size=403342 2024-08-27T02:38:08.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~LZEMN0PXLFIY.0 size=1048576 2024-08-27T02:38:08.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.831+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~LZEMN0PXLFIY.1 size=11303 2024-08-27T02:38:08.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.831+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=LZEMN0PXLFIY tag=R092REQUSI79 type=write size=2108455 2024-08-27T02:38:08.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.831+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~MFJ1FP8D4ZUE.0 size=1048576 2024-08-27T02:38:08.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.831+0000 7f3e0cc408c0 1 < canceled part key=_multipart_S5ANS33DXN7X.2~MFJ1FP8D4ZUE.1 size=744748 2024-08-27T02:38:08.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.835+0000 7f3e0cc408c0 1 < canceled multipart upload key=S5ANS33DXN7X upload=MFJ1FP8D4ZUE tag=MFY95L0WJ68B type=write size=2841900 2024-08-27T02:38:08.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.839+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=FN475KI7J78D type=write size=930991 2024-08-27T02:38:08.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.843+0000 7f3e0cc408c0 1 < suggested remove operation key=PLC076BXR38P tag=2TUEOCB2ZM38 type=del 2024-08-27T02:38:08.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.847+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~BTRTKJM2MQQY.0 size=1048576 2024-08-27T02:38:08.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~BTRTKJM2MQQY.1 size=1048576 2024-08-27T02:38:08.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~BTRTKJM2MQQY.2 size=533799 2024-08-27T02:38:08.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.851+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=BTRTKJM2MQQY tag=JYK25P83MPKV type=write size=3679527 2024-08-27T02:38:08.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.855+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~LG67MBOQOIA8.0 size=1048576 2024-08-27T02:38:08.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.855+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~LG67MBOQOIA8.1 size=169608 2024-08-27T02:38:08.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.859+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=LG67MBOQOIA8 tag=022UTPRVFLCJ type=write size=2266760 2024-08-27T02:38:08.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.863+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=UCER6YIPZYLE type=write size=757042 2024-08-27T02:38:08.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~NXUCMISSQRWH.0 size=1048576 2024-08-27T02:38:08.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.867+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~NXUCMISSQRWH.1 size=583503 2024-08-27T02:38:08.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.871+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=NXUCMISSQRWH tag=O6XNBHHNXJ6N type=write size=2680655 2024-08-27T02:38:08.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.875+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~9TBQJ0KJCFYZ.0 size=1048576 2024-08-27T02:38:08.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.879+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~9TBQJ0KJCFYZ.1 size=1048576 2024-08-27T02:38:08.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.879+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~9TBQJ0KJCFYZ.2 size=337538 2024-08-27T02:38:08.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.879+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=9TBQJ0KJCFYZ tag=SM0ID3BMQGC6 type=write size=3483266 2024-08-27T02:38:08.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.883+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~OG8RFMXD2DTH.0 size=1048576 2024-08-27T02:38:08.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.883+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~OG8RFMXD2DTH.1 size=1048576 2024-08-27T02:38:08.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.887+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~OG8RFMXD2DTH.2 size=424469 2024-08-27T02:38:08.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.891+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=OG8RFMXD2DTH tag=JC5HTOOFN3TQ type=write size=3570197 2024-08-27T02:38:08.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.895+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~QJPAKJTP5AJH.0 size=1048576 2024-08-27T02:38:08.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~QJPAKJTP5AJH.1 size=1048576 2024-08-27T02:38:08.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~QJPAKJTP5AJH.2 size=502685 2024-08-27T02:38:08.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.899+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=QJPAKJTP5AJH tag=COG08A765SGR type=write size=3648413 2024-08-27T02:38:08.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.899+0000 7f3e0cc408c0 1 < canceled part key=_multipart_PLC076BXR38P.2~3W224Z9ZMDBC.0 size=271182 2024-08-27T02:38:08.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.903+0000 7f3e0cc408c0 1 < canceled multipart upload key=PLC076BXR38P upload=3W224Z9ZMDBC tag=4WS54W67OVMU type=write size=1319758 2024-08-27T02:38:08.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.907+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=I27RK78NHMU7 type=del size=2866880 2024-08-27T02:38:08.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.907+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=KEBDOF6NCASW type=del 2024-08-27T02:38:08.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.915+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~NQAJFIX5WCEK.0 size=1048576 2024-08-27T02:38:08.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.915+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~NQAJFIX5WCEK.1 size=1048576 2024-08-27T02:38:08.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.919+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~NQAJFIX5WCEK.2 size=400731 2024-08-27T02:38:08.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.919+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=NQAJFIX5WCEK tag=FF5WJSUZRKN4 type=write size=3546459 2024-08-27T02:38:08.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.919+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~8QKH3OGZ19B4.0 size=901583 2024-08-27T02:38:08.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.923+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=8QKH3OGZ19B4 tag=46FUIF43EZTT type=write size=1950159 2024-08-27T02:38:08.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.927+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=JPQIFCSG8ZCN type=del size=1941174 2024-08-27T02:38:08.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.931+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~JA4PXII6V2D6.0 size=646166 2024-08-27T02:38:08.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.935+0000 7f3e0cc408c0 1 < completed multipart upload key=SG9T1RD5EATR upload=JA4PXII6V2D6 tag=GQ81E210QWNL type=write size=1694742 2024-08-27T02:38:08.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~S0BK54FQ5R3G.0 size=1048576 2024-08-27T02:38:08.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_13M7JVZT12I2.2~S0BK54FQ5R3G.1 size=818601 2024-08-27T02:38:08.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.939+0000 7f3e0cc408c0 1 > prepared multipart upload key=13M7JVZT12I2 upload=S0BK54FQ5R3G tag=IOEKYX3B0Z66 type=write size=2915753 2024-08-27T02:38:08.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.943+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=61X87UBBRQ1J type=del 2024-08-27T02:38:08.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.947+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~W1BS6JSUAF02.0 size=581177 2024-08-27T02:38:08.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.947+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=W1BS6JSUAF02 tag=L3XLI3QO3LZK type=write size=1629753 2024-08-27T02:38:08.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.951+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=3JKVOVCE7P0H type=del 2024-08-27T02:38:08.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.951+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=VXFC8CDF4RHE type=write size=92445 2024-08-27T02:38:08.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~BIL0DYIPXQV2.0 size=1048576 2024-08-27T02:38:08.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.955+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~BIL0DYIPXQV2.1 size=1048576 2024-08-27T02:38:08.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.959+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~BIL0DYIPXQV2.2 size=83339 2024-08-27T02:38:08.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.963+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=BIL0DYIPXQV2 tag=PBVXV405AAJZ type=write size=3229067 2024-08-27T02:38:08.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~MY9E3ZSU43FJ.0 size=1048576 2024-08-27T02:38:08.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~MY9E3ZSU43FJ.1 size=1048576 2024-08-27T02:38:08.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.971+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~MY9E3ZSU43FJ.2 size=272431 2024-08-27T02:38:08.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.971+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=MY9E3ZSU43FJ tag=SP00L4WBD6U9 type=write size=3418159 2024-08-27T02:38:08.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.971+0000 7f3e0cc408c0 -1 < no bi entry to suggest for operation key=PLC076BXR38P tag=2GB1FQJPLBF4 type=write size=735018: (2) No such file or directory 2024-08-27T02:38:08.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~JSTKW2XCP8S7.0 size=482903 2024-08-27T02:38:08.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.975+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=JSTKW2XCP8S7 tag=0KV0IWTAAGFQ type=write size=1531479 2024-08-27T02:38:08.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.979+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~LRMN5LGTG310.0 size=1048576 2024-08-27T02:38:08.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.979+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~LRMN5LGTG310.1 size=223549 2024-08-27T02:38:08.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.983+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=LRMN5LGTG310 tag=2DFJ5ASGQ4JK type=write size=2320701 2024-08-27T02:38:08.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.987+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=C69HEHCPZ743 type=del size=2703275 2024-08-27T02:38:08.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.991+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=RUTPP27H1IJG type=del size=1481738 2024-08-27T02:38:08.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.995+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=QZQ3K8S4UPVH type=del size=386018 2024-08-27T02:38:08.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.995+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~LZEMN0PXLFIY.0 size=1048576 2024-08-27T02:38:08.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:08.999+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~LZEMN0PXLFIY.1 size=11303 2024-08-27T02:38:09.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.003+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=LZEMN0PXLFIY tag=R092REQUSI79 type=write size=2108455 2024-08-27T02:38:09.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.003+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=J093HIRW0CDI type=del size=1135026 2024-08-27T02:38:09.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.011+0000 7f3e0cc408c0 1 < suggested remove operation key=A0RUXE4YL6NR tag=FN475KI7J78D type=write 2024-08-27T02:38:09.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.011+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=DATTGTMG5W9V type=del size=1348360 2024-08-27T02:38:09.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.015+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~BTRTKJM2MQQY.0 size=1048576 2024-08-27T02:38:09.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.015+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~BTRTKJM2MQQY.1 size=1048576 2024-08-27T02:38:09.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.019+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~BTRTKJM2MQQY.2 size=533799 2024-08-27T02:38:09.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.023+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=BTRTKJM2MQQY tag=JYK25P83MPKV type=write size=3679527 2024-08-27T02:38:09.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~ZB56Q5U38S6B.0 size=1048576 2024-08-27T02:38:09.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.031+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~ZB56Q5U38S6B.1 size=795819 2024-08-27T02:38:09.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.031+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=ZB56Q5U38S6B tag=HVDVYUEO1W98 type=write size=2892971 2024-08-27T02:38:09.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.031+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=UCER6YIPZYLE type=write size=757042 2024-08-27T02:38:09.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.035+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=AMVOS15E9CIM type=del size=1604328 2024-08-27T02:38:09.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.039+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~9TBQJ0KJCFYZ.0 size=1048576 2024-08-27T02:38:09.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.039+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~9TBQJ0KJCFYZ.1 size=1048576 2024-08-27T02:38:09.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~9TBQJ0KJCFYZ.2 size=337538 2024-08-27T02:38:09.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.047+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=9TBQJ0KJCFYZ tag=SM0ID3BMQGC6 type=write size=3483266 2024-08-27T02:38:09.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.051+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~A3YPY5USZGS6.0 size=1048576 2024-08-27T02:38:09.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.055+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~A3YPY5USZGS6.1 size=1048576 2024-08-27T02:38:09.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.059+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~A3YPY5USZGS6.2 size=28207 2024-08-27T02:38:09.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.059+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=A3YPY5USZGS6 tag=Q8JKNVVW3DJ8 type=write size=3173935 2024-08-27T02:38:09.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~QJPAKJTP5AJH.0 size=1048576 2024-08-27T02:38:09.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~QJPAKJTP5AJH.1 size=1048576 2024-08-27T02:38:09.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~QJPAKJTP5AJH.2 size=502685 2024-08-27T02:38:09.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.071+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=QJPAKJTP5AJH tag=COG08A765SGR type=write size=3648413 2024-08-27T02:38:09.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.075+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=K5OHR1O6FF09 type=write size=115308 2024-08-27T02:38:09.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.079+0000 7f3e0cc408c0 1 < suggested update operation key=A0RUXE4YL6NR tag=I27RK78NHMU7 type=del size=2866880 2024-08-27T02:38:09.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.087+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~ZCRKNTFOKBGR.0 size=968731 2024-08-27T02:38:09.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.087+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=ZCRKNTFOKBGR tag=TF3XP2C2WN9O type=write size=2017307 2024-08-27T02:38:09.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.087+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~NQAJFIX5WCEK.0 size=1048576 2024-08-27T02:38:09.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.091+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~NQAJFIX5WCEK.1 size=1048576 2024-08-27T02:38:09.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.095+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~NQAJFIX5WCEK.2 size=400731 2024-08-27T02:38:09.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.099+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=NQAJFIX5WCEK tag=FF5WJSUZRKN4 type=write size=3546459 2024-08-27T02:38:09.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~2ZXUQJ0IYN9T.0 size=1048576 2024-08-27T02:38:09.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~2ZXUQJ0IYN9T.1 size=690700 2024-08-27T02:38:09.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.107+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=2ZXUQJ0IYN9T tag=BSEOQ7ZTB5EF type=write size=2787852 2024-08-27T02:38:09.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.107+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=JPQIFCSG8ZCN type=del 2024-08-27T02:38:09.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.111+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=ZI7OIZVABMUC type=del size=3854665 2024-08-27T02:38:09.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~S0BK54FQ5R3G.0 size=1048576 2024-08-27T02:38:09.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.119+0000 7f3e0cc408c0 1 < completed part key=_multipart_13M7JVZT12I2.2~S0BK54FQ5R3G.1 size=818601 2024-08-27T02:38:09.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.123+0000 7f3e0cc408c0 1 < completed multipart upload key=13M7JVZT12I2 upload=S0BK54FQ5R3G tag=IOEKYX3B0Z66 type=write size=2915753 2024-08-27T02:38:09.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~15J56949XD7Q.0 size=1048576 2024-08-27T02:38:09.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~15J56949XD7Q.1 size=1048576 2024-08-27T02:38:09.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.131+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~15J56949XD7Q.2 size=746685 2024-08-27T02:38:09.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.131+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=15J56949XD7Q tag=KH07G8BPIBZY type=write size=3892413 2024-08-27T02:38:09.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.135+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~W1BS6JSUAF02.0 size=581177 2024-08-27T02:38:09.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.139+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=W1BS6JSUAF02 tag=L3XLI3QO3LZK type=write size=1629753 2024-08-27T02:38:09.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~JJ2BLR3ZQN4O.0 size=602975 2024-08-27T02:38:09.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.147+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=JJ2BLR3ZQN4O tag=VK11BB6V71C7 type=write size=1651551 2024-08-27T02:38:09.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.147+0000 7f3e0cc408c0 1 < canceled operation key=6QE1HU65GQZZ tag=VXFC8CDF4RHE type=write size=92445 2024-08-27T02:38:09.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.151+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=IPUHJ9XDASNO type=del size=2643681 2024-08-27T02:38:09.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.155+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~MY9E3ZSU43FJ.0 size=1048576 2024-08-27T02:38:09.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.155+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~MY9E3ZSU43FJ.1 size=1048576 2024-08-27T02:38:09.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~MY9E3ZSU43FJ.2 size=272431 2024-08-27T02:38:09.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.167+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=MY9E3ZSU43FJ tag=SP00L4WBD6U9 type=write size=3418159 2024-08-27T02:38:09.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.167+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=IXJ9LE10OVTO type=del size=763911 2024-08-27T02:38:09.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.171+0000 7f3e0cc408c0 1 < canceled part key=_multipart_OY551242R8T6.2~JSTKW2XCP8S7.0 size=482903 2024-08-27T02:38:09.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.175+0000 7f3e0cc408c0 1 < canceled multipart upload key=OY551242R8T6 upload=JSTKW2XCP8S7 tag=0KV0IWTAAGFQ type=write size=1531479 2024-08-27T02:38:09.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.179+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~DDKFJPWI3BEN.0 size=923317 2024-08-27T02:38:09.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.179+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=DDKFJPWI3BEN tag=AH3GRUNNXQM9 type=write size=1971893 2024-08-27T02:38:09.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.187+0000 7f3e0cc408c0 1 < suggested update operation key=0U59R3BXL181 tag=C69HEHCPZ743 type=del size=2703275 2024-08-27T02:38:09.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.191+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=SF03ITMBFU9V type=del size=2228884 2024-08-27T02:38:09.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.195+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=QZQ3K8S4UPVH type=del 2024-08-27T02:38:09.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.199+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~05HIY4EAP0MF.0 size=1048576 2024-08-27T02:38:09.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4SSZQK6YIL1O.2~05HIY4EAP0MF.1 size=482931 2024-08-27T02:38:09.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.203+0000 7f3e0cc408c0 1 > prepared multipart upload key=4SSZQK6YIL1O upload=05HIY4EAP0MF tag=N7TQ5KQRYVPS type=write size=2580083 2024-08-27T02:38:09.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.207+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=J093HIRW0CDI type=del 2024-08-27T02:38:09.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.207+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=W0LVDM35XD8F type=del size=3909982 2024-08-27T02:38:09.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.211+0000 7f3e0cc408c0 1 < canceled operation key=QVG1NTF6O8L2 tag=DATTGTMG5W9V type=del size=1348360 2024-08-27T02:38:09.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.215+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=O3HC0COPU4CH type=del size=1449419 2024-08-27T02:38:09.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.219+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~ZB56Q5U38S6B.0 size=1048576 2024-08-27T02:38:09.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.219+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~ZB56Q5U38S6B.1 size=795819 2024-08-27T02:38:09.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.223+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=ZB56Q5U38S6B tag=HVDVYUEO1W98 type=write size=2892971 2024-08-27T02:38:09.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.231+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~G4JQS8NC9GYA.0 size=1048576 2024-08-27T02:38:09.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.231+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~G4JQS8NC9GYA.1 size=1048576 2024-08-27T02:38:09.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.235+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~G4JQS8NC9GYA.2 size=941439 2024-08-27T02:38:09.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.235+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=G4JQS8NC9GYA tag=1D91KMPZTD68 type=write size=4087167 2024-08-27T02:38:09.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.239+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=AMVOS15E9CIM type=del 2024-08-27T02:38:09.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.239+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=N3Z7D9DE7XA0 type=write size=224507 2024-08-27T02:38:09.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.243+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~A3YPY5USZGS6.0 size=1048576 2024-08-27T02:38:09.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~A3YPY5USZGS6.1 size=1048576 2024-08-27T02:38:09.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.247+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~A3YPY5USZGS6.2 size=28207 2024-08-27T02:38:09.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.255+0000 7f3e0cc408c0 1 < completed multipart upload key=B9DPI871LQ7E upload=A3YPY5USZGS6 tag=Q8JKNVVW3DJ8 type=write size=3173935 2024-08-27T02:38:09.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~8H0PKSKB607Y.0 size=1048576 2024-08-27T02:38:09.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.259+0000 7f3e0cc408c0 1 > prepared part key=_multipart_D7YWS7BWXT37.2~8H0PKSKB607Y.1 size=769623 2024-08-27T02:38:09.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.259+0000 7f3e0cc408c0 1 > prepared multipart upload key=D7YWS7BWXT37 upload=8H0PKSKB607Y tag=PPAGTM7FA9BL type=write size=2866775 2024-08-27T02:38:09.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.263+0000 7f3e0cc408c0 1 < canceled operation key=KTPZGZSQCERQ tag=K5OHR1O6FF09 type=write size=115308 2024-08-27T02:38:09.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.267+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=28ME7HOGZE2T type=del size=3222115 2024-08-27T02:38:09.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.271+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~ZCRKNTFOKBGR.0 size=968731 2024-08-27T02:38:09.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.275+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=ZCRKNTFOKBGR tag=TF3XP2C2WN9O type=write size=2017307 2024-08-27T02:38:09.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.279+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=YVEX0CE0J4L5 type=del size=2728282 2024-08-27T02:38:09.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.279+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~2ZXUQJ0IYN9T.0 size=1048576 2024-08-27T02:38:09.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.283+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~2ZXUQJ0IYN9T.1 size=690700 2024-08-27T02:38:09.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.291+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=2ZXUQJ0IYN9T tag=BSEOQ7ZTB5EF type=write size=2787852 2024-08-27T02:38:09.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.291+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=OP912PQ8DLWI type=del size=80702 2024-08-27T02:38:09.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.295+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=ZI7OIZVABMUC type=del 2024-08-27T02:38:09.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.299+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=NYVEBMMMAT11 type=del size=3911040 2024-08-27T02:38:09.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.299+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~15J56949XD7Q.0 size=1048576 2024-08-27T02:38:09.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.303+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~15J56949XD7Q.1 size=1048576 2024-08-27T02:38:09.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.303+0000 7f3e0cc408c0 1 < canceled part key=_multipart_6YTZJKE4V5HQ.2~15J56949XD7Q.2 size=746685 2024-08-27T02:38:09.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.307+0000 7f3e0cc408c0 1 < canceled multipart upload key=6YTZJKE4V5HQ upload=15J56949XD7Q tag=KH07G8BPIBZY type=write size=3892413 2024-08-27T02:38:09.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~ZDOIWOCSL5HN.0 size=1048576 2024-08-27T02:38:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.315+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~ZDOIWOCSL5HN.1 size=963403 2024-08-27T02:38:09.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.315+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=ZDOIWOCSL5HN tag=T2TAARJZ4QWD type=write size=3060555 2024-08-27T02:38:09.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.319+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~JJ2BLR3ZQN4O.0 size=602975 2024-08-27T02:38:09.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.323+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=JJ2BLR3ZQN4O tag=VK11BB6V71C7 type=write size=1651551 2024-08-27T02:38:09.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~C0RR6DM79FAB.0 size=1048576 2024-08-27T02:38:09.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.335+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~C0RR6DM79FAB.1 size=626531 2024-08-27T02:38:09.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.335+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=C0RR6DM79FAB tag=NU554135JYJT type=write size=2723683 2024-08-27T02:38:09.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.339+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=IPUHJ9XDASNO type=del 2024-08-27T02:38:09.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.347+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~MYB0J1VDD6UQ.0 size=1048576 2024-08-27T02:38:09.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.347+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~MYB0J1VDD6UQ.1 size=1048576 2024-08-27T02:38:09.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.351+0000 7f3e0cc408c0 1 > prepared part key=_multipart_SG9T1RD5EATR.2~MYB0J1VDD6UQ.2 size=202857 2024-08-27T02:38:09.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.351+0000 7f3e0cc408c0 1 > prepared multipart upload key=SG9T1RD5EATR upload=MYB0J1VDD6UQ tag=CNLJ31CPXYCY type=write size=3348585 2024-08-27T02:38:09.355 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.355+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=IXJ9LE10OVTO type=del 2024-08-27T02:38:09.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.359+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=N7145BYOL36N type=del size=4145588 2024-08-27T02:38:09.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.363+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~DDKFJPWI3BEN.0 size=923317 2024-08-27T02:38:09.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.367+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=DDKFJPWI3BEN tag=AH3GRUNNXQM9 type=write size=1971893 2024-08-27T02:38:09.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.375+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~1OA4HOKO0KJ5.0 size=651979 2024-08-27T02:38:09.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.375+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=1OA4HOKO0KJ5 tag=HWAQIEIWCZK9 type=write size=1700555 2024-08-27T02:38:09.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.379+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=SF03ITMBFU9V type=del 2024-08-27T02:38:09.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~UB80IESUBNO3.0 size=388980 2024-08-27T02:38:09.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.383+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=UB80IESUBNO3 tag=4JACY54R1SPT type=write size=1437556 2024-08-27T02:38:09.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~05HIY4EAP0MF.0 size=1048576 2024-08-27T02:38:09.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.391+0000 7f3e0cc408c0 1 < completed part key=_multipart_4SSZQK6YIL1O.2~05HIY4EAP0MF.1 size=482931 2024-08-27T02:38:09.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.395+0000 7f3e0cc408c0 1 < completed multipart upload key=4SSZQK6YIL1O upload=05HIY4EAP0MF tag=N7TQ5KQRYVPS type=write size=2580083 2024-08-27T02:38:09.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.399+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=RAFYQXRG6VDR type=del size=1688314 2024-08-27T02:38:09.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.399+0000 7f3e0cc408c0 1 < canceled operation key=PLC076BXR38P tag=W0LVDM35XD8F type=del size=3909982 2024-08-27T02:38:09.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.403+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=IHJXKLOP8X5G type=del size=1610974 2024-08-27T02:38:09.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.407+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=O3HC0COPU4CH type=del 2024-08-27T02:38:09.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.411+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~J0EDBH2JWDUD.0 size=1048576 2024-08-27T02:38:09.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.415+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~J0EDBH2JWDUD.1 size=1048576 2024-08-27T02:38:09.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.419+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~J0EDBH2JWDUD.2 size=116375 2024-08-27T02:38:09.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.419+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=J0EDBH2JWDUD tag=UEQS4POSKPW3 type=write size=3262103 2024-08-27T02:38:09.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.419+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~G4JQS8NC9GYA.0 size=1048576 2024-08-27T02:38:09.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.419+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~G4JQS8NC9GYA.1 size=1048576 2024-08-27T02:38:09.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.423+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~G4JQS8NC9GYA.2 size=941439 2024-08-27T02:38:09.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.427+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=G4JQS8NC9GYA tag=1D91KMPZTD68 type=write size=4087167 2024-08-27T02:38:09.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.431+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=JDESUCLACB15 type=del size=1014079 2024-08-27T02:38:09.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.435+0000 7f3e0cc408c0 1 < completed write operation key=1ZIJ9JJTM4ZC tag=N3Z7D9DE7XA0 type=write size=224507 2024-08-27T02:38:09.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~OUOAMGX66C1Z.0 size=1048576 2024-08-27T02:38:09.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~OUOAMGX66C1Z.1 size=758987 2024-08-27T02:38:09.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.443+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=OUOAMGX66C1Z tag=K8CHO0J21022 type=write size=2856139 2024-08-27T02:38:09.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.447+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~8H0PKSKB607Y.0 size=1048576 2024-08-27T02:38:09.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_D7YWS7BWXT37.2~8H0PKSKB607Y.1 size=769623 2024-08-27T02:38:09.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.455+0000 7f3e0cc408c0 1 < completed multipart upload key=D7YWS7BWXT37 upload=8H0PKSKB607Y tag=PPAGTM7FA9BL type=write size=2866775 2024-08-27T02:38:09.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.459+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=TR5563SAGWL6 type=del size=1840129 2024-08-27T02:38:09.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.467+0000 7f3e0cc408c0 1 < suggested update operation key=13M7JVZT12I2 tag=28ME7HOGZE2T type=del size=3222115 2024-08-27T02:38:09.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.471+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=WDRO6VXRQZD2 type=del size=3382543 2024-08-27T02:38:09.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.475+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=YVEX0CE0J4L5 type=del 2024-08-27T02:38:09.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.479+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=72B1TBTYJJFX type=del size=1997393 2024-08-27T02:38:09.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.483+0000 7f3e0cc408c0 1 < suggested update operation key=S5ANS33DXN7X tag=OP912PQ8DLWI type=del size=80702 2024-08-27T02:38:09.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.487+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=3NRCAUG1DD9E type=del size=1952569 2024-08-27T02:38:09.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.491+0000 7f3e0cc408c0 1 < completed delete operation key=PLC076BXR38P tag=NYVEBMMMAT11 type=del 2024-08-27T02:38:09.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~M7JNB4PR8FDY.0 size=427249 2024-08-27T02:38:09.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.499+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=M7JNB4PR8FDY tag=TCF10EI3COMZ type=write size=1475825 2024-08-27T02:38:09.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.503+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~ZDOIWOCSL5HN.0 size=1048576 2024-08-27T02:38:09.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.507+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~ZDOIWOCSL5HN.1 size=963403 2024-08-27T02:38:09.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.511+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=ZDOIWOCSL5HN tag=T2TAARJZ4QWD type=write size=3060555 2024-08-27T02:38:09.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.519+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~CHZSV6XUAYSF.0 size=532357 2024-08-27T02:38:09.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.519+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=CHZSV6XUAYSF tag=4IHJ1Y06KW5K type=write size=1580933 2024-08-27T02:38:09.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.519+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~C0RR6DM79FAB.0 size=1048576 2024-08-27T02:38:09.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.523+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~C0RR6DM79FAB.1 size=626531 2024-08-27T02:38:09.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.527+0000 7f3e0cc408c0 1 < completed multipart upload key=ZMN8Y0VQVHLB upload=C0RR6DM79FAB tag=NU554135JYJT type=write size=2723683 2024-08-27T02:38:09.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.531+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=0NNZTOWTUK99 type=write size=86040 2024-08-27T02:38:09.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.535+0000 7f3e0cc408c0 1 < canceled part key=_multipart_SG9T1RD5EATR.2~MYB0J1VDD6UQ.0 size=1048576 2024-08-27T02:38:09.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.535+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~MYB0J1VDD6UQ.1 size=1048576 2024-08-27T02:38:09.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.539+0000 7f3e0cc408c0 1 < completed part key=_multipart_SG9T1RD5EATR.2~MYB0J1VDD6UQ.2 size=202857 2024-08-27T02:38:09.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.543+0000 7f3e0cc408c0 1 < canceled multipart upload key=SG9T1RD5EATR upload=MYB0J1VDD6UQ tag=CNLJ31CPXYCY type=write size=3348585 2024-08-27T02:38:09.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.547+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=CVB4SWI4JLVY type=del size=365015 2024-08-27T02:38:09.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.551+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=N7145BYOL36N type=del 2024-08-27T02:38:09.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.555+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=N9CYZLQVQAKL type=del size=3660168 2024-08-27T02:38:09.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.555+0000 7f3e0cc408c0 1 < canceled part key=_multipart_B9DPI871LQ7E.2~1OA4HOKO0KJ5.0 size=651979 2024-08-27T02:38:09.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.559+0000 7f3e0cc408c0 1 < canceled multipart upload key=B9DPI871LQ7E upload=1OA4HOKO0KJ5 tag=HWAQIEIWCZK9 type=write size=1700555 2024-08-27T02:38:09.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.563+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=KPFAWE2V3T2R type=del size=2945891 2024-08-27T02:38:09.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.567+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~UB80IESUBNO3.0 size=388980 2024-08-27T02:38:09.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.575+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=UB80IESUBNO3 tag=4JACY54R1SPT type=write size=1437556 2024-08-27T02:38:09.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.579+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=2VII7EJZQ8K0 type=del size=2659274 2024-08-27T02:38:09.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.583+0000 7f3e0cc408c0 1 < suggested update operation key=HKDJMA7O2DFM tag=RAFYQXRG6VDR type=del size=1688314 2024-08-27T02:38:09.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.587+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=3QMHZZXHBKCI type=write size=621411 2024-08-27T02:38:09.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.595+0000 7f3e0cc408c0 1 < suggested update operation key=13M7JVZT12I2 tag=IHJXKLOP8X5G type=del size=1610974 2024-08-27T02:38:09.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.599+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=L3YUD3L18WP9 type=del size=1073560 2024-08-27T02:38:09.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~J0EDBH2JWDUD.0 size=1048576 2024-08-27T02:38:09.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.603+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~J0EDBH2JWDUD.1 size=1048576 2024-08-27T02:38:09.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.607+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~J0EDBH2JWDUD.2 size=116375 2024-08-27T02:38:09.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.615+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=J0EDBH2JWDUD tag=UEQS4POSKPW3 type=write size=3262103 2024-08-27T02:38:09.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.615+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=GOIFDXYDUCQH type=del size=2643849 2024-08-27T02:38:09.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.623+0000 7f3e0cc408c0 -1 < failed to complete operation key=13M7JVZT12I2 tag=JDESUCLACB15 type=del size=1014079: (22) Invalid argument 2024-08-27T02:38:09.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.623+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=TSX69205C768 type=del size=865175 2024-08-27T02:38:09.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.623+0000 7f3e0cc408c0 1 < canceled part key=_multipart_F4MCLPFLY531.2~OUOAMGX66C1Z.0 size=1048576 2024-08-27T02:38:09.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.627+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~OUOAMGX66C1Z.1 size=758987 2024-08-27T02:38:09.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.631+0000 7f3e0cc408c0 1 < canceled multipart upload key=F4MCLPFLY531 upload=OUOAMGX66C1Z tag=K8CHO0J21022 type=write size=2856139 2024-08-27T02:38:09.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.635+0000 7f3e0cc408c0 1 > prepared operation key=MKB40KOOCCNT tag=MGXS5LORBHUF type=del size=1854390 2024-08-27T02:38:09.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.643+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=TR5563SAGWL6 type=del 2024-08-27T02:38:09.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.643+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=YPN8CU9P05AH type=del size=1428672 2024-08-27T02:38:09.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.651+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=WDRO6VXRQZD2 type=del 2024-08-27T02:38:09.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.655+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=RZNCUCHY3BQS type=del size=518502 2024-08-27T02:38:09.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.659+0000 7f3e0cc408c0 -1 < failed to complete operation key=JDV1RIGAO7J1 tag=72B1TBTYJJFX type=del size=1997393: (22) Invalid argument 2024-08-27T02:38:09.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.663+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=PESDCVQ6XZKE type=del size=548900 2024-08-27T02:38:09.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.667+0000 7f3e0cc408c0 1 < suggested remove operation key=IISECLYEAR19 tag=3NRCAUG1DD9E type=del 2024-08-27T02:38:09.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.675+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~HCLYDZOP8JDJ.0 size=1048576 2024-08-27T02:38:09.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.679+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~HCLYDZOP8JDJ.1 size=839040 2024-08-27T02:38:09.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.679+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=HCLYDZOP8JDJ tag=31SHM7JDPK8H type=write size=2936192 2024-08-27T02:38:09.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.683+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~M7JNB4PR8FDY.0 size=427249 2024-08-27T02:38:09.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.687+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=M7JNB4PR8FDY tag=TCF10EI3COMZ type=write size=1475825 2024-08-27T02:38:09.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.691+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~K7CQFF1S48W2.0 size=84326 2024-08-27T02:38:09.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.691+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=K7CQFF1S48W2 tag=893C8L4DW671 type=write size=1132902 2024-08-27T02:38:09.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.695+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~CHZSV6XUAYSF.0 size=532357 2024-08-27T02:38:09.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.699+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=CHZSV6XUAYSF tag=4IHJ1Y06KW5K type=write size=1580933 2024-08-27T02:38:09.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.703+0000 7f3e0cc408c0 1 > prepared operation key=2CXWPDABA9XJ tag=ZEDF1N5T2IJP type=write size=223669 2024-08-27T02:38:09.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.707+0000 7f3e0cc408c0 1 < completed write operation key=D7YWS7BWXT37 tag=0NNZTOWTUK99 type=write size=86040 2024-08-27T02:38:09.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.711+0000 7f3e0cc408c0 1 > prepared operation key=13M7JVZT12I2 tag=LQ2NBMSRMN90 type=write size=91048 2024-08-27T02:38:09.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.715+0000 7f3e0cc408c0 1 < suggested update operation key=0OLVDEQWBCAQ tag=CVB4SWI4JLVY type=del size=365015 2024-08-27T02:38:09.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.723+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~XJFCURU2UX7U.0 size=1048576 2024-08-27T02:38:09.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.727+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~XJFCURU2UX7U.1 size=1048576 2024-08-27T02:38:09.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.727+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HTEOX3BV94K2.2~XJFCURU2UX7U.2 size=321268 2024-08-27T02:38:09.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.727+0000 7f3e0cc408c0 1 > prepared multipart upload key=HTEOX3BV94K2 upload=XJFCURU2UX7U tag=HRTULYDLHQTL type=write size=3466996 2024-08-27T02:38:09.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.731+0000 7f3e0cc408c0 1 < completed delete operation key=S5ANS33DXN7X tag=N9CYZLQVQAKL type=del 2024-08-27T02:38:09.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.735+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~VQZ0QK6FUHBY.0 size=1048576 2024-08-27T02:38:09.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.739+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~VQZ0QK6FUHBY.1 size=508094 2024-08-27T02:38:09.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.739+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=VQZ0QK6FUHBY tag=O80PRLKRGLEL type=write size=2605246 2024-08-27T02:38:09.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.743+0000 7f3e0cc408c0 1 < canceled operation key=0U59R3BXL181 tag=KPFAWE2V3T2R type=del size=2945891 2024-08-27T02:38:09.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.747+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=EZ1RU17O97G1 type=del size=332132 2024-08-27T02:38:09.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.751+0000 7f3e0cc408c0 1 < suggested remove operation key=HTEOX3BV94K2 tag=2VII7EJZQ8K0 type=del 2024-08-27T02:38:09.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.755+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=TFBFRW8KICW7 type=write size=994239 2024-08-27T02:38:09.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.763+0000 7f3e0cc408c0 1 < suggested remove operation key=JDV1RIGAO7J1 tag=3QMHZZXHBKCI type=write 2024-08-27T02:38:09.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.763+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=1GA3DTL2N2A3 type=del size=104244 2024-08-27T02:38:09.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.767+0000 7f3e0cc408c0 1 < completed delete operation key=6QE1HU65GQZZ tag=L3YUD3L18WP9 type=del 2024-08-27T02:38:09.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.771+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=Z9QZSVOPX3MB type=write size=421858 2024-08-27T02:38:09.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.779+0000 7f3e0cc408c0 1 < suggested update operation key=JLAGXRZVF50G tag=GOIFDXYDUCQH type=del size=2643849 2024-08-27T02:38:09.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.779+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=2F6A75JJJ09D type=del size=867289 2024-08-27T02:38:09.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.783+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=TSX69205C768 type=del 2024-08-27T02:38:09.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~AR1OWJVSU5CD.0 size=1048576 2024-08-27T02:38:09.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~AR1OWJVSU5CD.1 size=1048576 2024-08-27T02:38:09.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.795+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~AR1OWJVSU5CD.2 size=205034 2024-08-27T02:38:09.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.795+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=AR1OWJVSU5CD tag=SCAQ54CHY6N8 type=write size=3350762 2024-08-27T02:38:09.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.799+0000 7f3e0cc408c0 1 < completed delete operation key=MKB40KOOCCNT tag=MGXS5LORBHUF type=del 2024-08-27T02:38:09.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.803+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=9S7RHWWTEYW5 type=write size=132494 2024-08-27T02:38:09.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.807+0000 7f3e0cc408c0 -1 < failed to complete operation key=HTEOX3BV94K2 tag=YPN8CU9P05AH type=del size=1428672: (22) Invalid argument 2024-08-27T02:38:09.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.811+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~JOEVK0CCOV1U.0 size=996341 2024-08-27T02:38:09.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.811+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=JOEVK0CCOV1U tag=0ONHLGWL35HN type=write size=2044917 2024-08-27T02:38:09.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.819+0000 7f3e0cc408c0 1 < suggested update operation key=O66XJ7GJMPCU tag=RZNCUCHY3BQS type=del size=518502 2024-08-27T02:38:09.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.823+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~TQP0GAV4F6E6.0 size=310268 2024-08-27T02:38:09.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.823+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=TQP0GAV4F6E6 tag=Y6PXKVOXH2LW type=write size=1358844 2024-08-27T02:38:09.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.827+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=PESDCVQ6XZKE type=del 2024-08-27T02:38:09.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.831+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~K5F5Z24PPVN4.0 size=384097 2024-08-27T02:38:09.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.831+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=K5F5Z24PPVN4 tag=0I6ROONZ9LVK type=write size=1432673 2024-08-27T02:38:09.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.835+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~HCLYDZOP8JDJ.0 size=1048576 2024-08-27T02:38:09.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.839+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~HCLYDZOP8JDJ.1 size=839040 2024-08-27T02:38:09.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.843+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=HCLYDZOP8JDJ tag=31SHM7JDPK8H type=write size=2936192 2024-08-27T02:38:09.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~J2LRFV1O6HFS.0 size=1048576 2024-08-27T02:38:09.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.851+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~J2LRFV1O6HFS.1 size=75221 2024-08-27T02:38:09.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.851+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=J2LRFV1O6HFS tag=VI29UIJB1MBE type=write size=2172373 2024-08-27T02:38:09.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.855+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~K7CQFF1S48W2.0 size=84326 2024-08-27T02:38:09.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.859+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=K7CQFF1S48W2 tag=893C8L4DW671 type=write size=1132902 2024-08-27T02:38:09.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.867+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~ORSQS97VPIJ4.0 size=1048576 2024-08-27T02:38:09.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.867+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~ORSQS97VPIJ4.1 size=1048576 2024-08-27T02:38:09.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.871+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~ORSQS97VPIJ4.2 size=310190 2024-08-27T02:38:09.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.871+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=ORSQS97VPIJ4 tag=PCV3T5ZPBY6V type=write size=3455918 2024-08-27T02:38:09.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.875+0000 7f3e0cc408c0 1 < suggested update operation key=2CXWPDABA9XJ tag=ZEDF1N5T2IJP type=write size=223669 2024-08-27T02:38:09.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.883+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~FDFEXY5Z0GPW.0 size=1048576 2024-08-27T02:38:09.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.883+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~FDFEXY5Z0GPW.1 size=1048576 2024-08-27T02:38:09.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.887+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~FDFEXY5Z0GPW.2 size=414458 2024-08-27T02:38:09.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.887+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=FDFEXY5Z0GPW tag=4ORV4CRVKJ5C type=write size=3560186 2024-08-27T02:38:09.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.891+0000 7f3e0cc408c0 1 < suggested update operation key=13M7JVZT12I2 tag=LQ2NBMSRMN90 type=write size=91048 2024-08-27T02:38:09.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~HZMXQCACG8CX.0 size=1048576 2024-08-27T02:38:09.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.899+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~HZMXQCACG8CX.1 size=1048576 2024-08-27T02:38:09.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.903+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~HZMXQCACG8CX.2 size=553517 2024-08-27T02:38:09.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.903+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=HZMXQCACG8CX tag=F3YXHB5EPIAO type=write size=3699245 2024-08-27T02:38:09.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.907+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~XJFCURU2UX7U.0 size=1048576 2024-08-27T02:38:09.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.907+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~XJFCURU2UX7U.1 size=1048576 2024-08-27T02:38:09.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.911+0000 7f3e0cc408c0 1 < completed part key=_multipart_HTEOX3BV94K2.2~XJFCURU2UX7U.2 size=321268 2024-08-27T02:38:09.916 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.915+0000 7f3e0cc408c0 1 < completed multipart upload key=HTEOX3BV94K2 upload=XJFCURU2UX7U tag=HRTULYDLHQTL type=write size=3466996 2024-08-27T02:38:09.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.919+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=580EB3OW7WOQ type=del size=3433732 2024-08-27T02:38:09.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.923+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~VQZ0QK6FUHBY.0 size=1048576 2024-08-27T02:38:09.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.927+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~VQZ0QK6FUHBY.1 size=508094 2024-08-27T02:38:09.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.931+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=VQZ0QK6FUHBY tag=O80PRLKRGLEL type=write size=2605246 2024-08-27T02:38:09.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~190ACLUYQ3AA.0 size=397435 2024-08-27T02:38:09.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.935+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=190ACLUYQ3AA tag=OOV4WDWGHA66 type=write size=1446011 2024-08-27T02:38:09.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.939+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=EZ1RU17O97G1 type=del 2024-08-27T02:38:09.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.943+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=Z205OO0IV1AY type=del size=692731 2024-08-27T02:38:09.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.947+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=TFBFRW8KICW7 type=write size=994239 2024-08-27T02:38:09.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.951+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~RM2TZDDXUGB7.0 size=1048576 2024-08-27T02:38:09.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.955+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~RM2TZDDXUGB7.1 size=850030 2024-08-27T02:38:09.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.955+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=RM2TZDDXUGB7 tag=I5P8I5KLVGPK type=write size=2947182 2024-08-27T02:38:09.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.959+0000 7f3e0cc408c0 -1 < failed to complete operation key=O66XJ7GJMPCU tag=1GA3DTL2N2A3 type=del size=104244: (22) Invalid argument 2024-08-27T02:38:09.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.959+0000 7f3e0cc408c0 1 > prepared operation key=S5ANS33DXN7X tag=9FPM0FIXL5T9 type=write size=684285 2024-08-27T02:38:09.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.963+0000 7f3e0cc408c0 1 < completed write operation key=6YTZJKE4V5HQ tag=Z9QZSVOPX3MB type=write size=421858 2024-08-27T02:38:09.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.967+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~2OJKAD9RC5FZ.0 size=1048576 2024-08-27T02:38:09.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.971+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~2OJKAD9RC5FZ.1 size=698992 2024-08-27T02:38:09.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.971+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=2OJKAD9RC5FZ tag=29ZPVR6I5DKE type=write size=2796144 2024-08-27T02:38:09.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.971+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=2F6A75JJJ09D type=del 2024-08-27T02:38:09.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.975+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~7J3XM7V2IN47.0 size=1048576 2024-08-27T02:38:09.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.979+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~7J3XM7V2IN47.1 size=281783 2024-08-27T02:38:09.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.979+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=7J3XM7V2IN47 tag=3N8UZ662FPIZ type=write size=2378935 2024-08-27T02:38:09.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.979+0000 7f3e0cc408c0 1 < canceled part key=_multipart_PLC076BXR38P.2~AR1OWJVSU5CD.0 size=1048576 2024-08-27T02:38:09.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.983+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~AR1OWJVSU5CD.1 size=1048576 2024-08-27T02:38:09.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.983+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~AR1OWJVSU5CD.2 size=205034 2024-08-27T02:38:09.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.987+0000 7f3e0cc408c0 1 < canceled multipart upload key=PLC076BXR38P upload=AR1OWJVSU5CD tag=SCAQ54CHY6N8 type=write size=3350762 2024-08-27T02:38:09.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.991+0000 7f3e0cc408c0 1 > prepared operation key=HTEOX3BV94K2 tag=F7Y3ETPHS9KK type=del size=194733 2024-08-27T02:38:09.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.995+0000 7f3e0cc408c0 1 < completed write operation key=MNE5WNFBH9HG tag=9S7RHWWTEYW5 type=write size=132494 2024-08-27T02:38:10.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:09.999+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~0U1F0D7LRBYA.0 size=1048576 2024-08-27T02:38:10.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_UGSWC9ZK9S7S.2~0U1F0D7LRBYA.1 size=327448 2024-08-27T02:38:10.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.003+0000 7f3e0cc408c0 1 > prepared multipart upload key=UGSWC9ZK9S7S upload=0U1F0D7LRBYA tag=07CJY0TXST8N type=write size=2424600 2024-08-27T02:38:10.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.003+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~JOEVK0CCOV1U.0 size=996341 2024-08-27T02:38:10.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.007+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=JOEVK0CCOV1U tag=0ONHLGWL35HN type=write size=2044917 2024-08-27T02:38:10.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.011+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=78P0NRZ8XX0W type=write size=167960 2024-08-27T02:38:10.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.015+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~TQP0GAV4F6E6.0 size=310268 2024-08-27T02:38:10.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.015+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=TQP0GAV4F6E6 tag=Y6PXKVOXH2LW type=write size=1358844 2024-08-27T02:38:10.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.019+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~5IL0I7LKIMD9.0 size=978600 2024-08-27T02:38:10.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.019+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=5IL0I7LKIMD9 tag=IAF8GJOZNDWS type=write size=2027176 2024-08-27T02:38:10.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.023+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~K5F5Z24PPVN4.0 size=384097 2024-08-27T02:38:10.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.027+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=K5F5Z24PPVN4 tag=0I6ROONZ9LVK type=write size=1432673 2024-08-27T02:38:10.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.031+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=EIJ1B0FXJ37P type=write size=44427 2024-08-27T02:38:10.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.031+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~J2LRFV1O6HFS.0 size=1048576 2024-08-27T02:38:10.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.035+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~J2LRFV1O6HFS.1 size=75221 2024-08-27T02:38:10.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.039+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=J2LRFV1O6HFS tag=VI29UIJB1MBE type=write size=2172373 2024-08-27T02:38:10.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.039+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=1PBLH23LUZB8 type=del size=1758060 2024-08-27T02:38:10.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~ORSQS97VPIJ4.0 size=1048576 2024-08-27T02:38:10.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.043+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~ORSQS97VPIJ4.1 size=1048576 2024-08-27T02:38:10.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.047+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~ORSQS97VPIJ4.2 size=310190 2024-08-27T02:38:10.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.051+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=ORSQS97VPIJ4 tag=PCV3T5ZPBY6V type=write size=3455918 2024-08-27T02:38:10.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.051+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=W5MU5S9Y2BRZ type=del size=2066398 2024-08-27T02:38:10.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.055+0000 7f3e0cc408c0 1 < canceled part key=_multipart_B9DPI871LQ7E.2~FDFEXY5Z0GPW.0 size=1048576 2024-08-27T02:38:10.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.055+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~FDFEXY5Z0GPW.1 size=1048576 2024-08-27T02:38:10.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.059+0000 7f3e0cc408c0 1 < completed part key=_multipart_B9DPI871LQ7E.2~FDFEXY5Z0GPW.2 size=414458 2024-08-27T02:38:10.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.059+0000 7f3e0cc408c0 1 < canceled multipart upload key=B9DPI871LQ7E upload=FDFEXY5Z0GPW tag=4ORV4CRVKJ5C type=write size=3560186 2024-08-27T02:38:10.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.067+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~XGKRVFZVTYB5.0 size=1048576 2024-08-27T02:38:10.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.067+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~XGKRVFZVTYB5.1 size=582205 2024-08-27T02:38:10.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.067+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=XGKRVFZVTYB5 tag=K8F042TEHJQI type=write size=2679357 2024-08-27T02:38:10.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.071+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~HZMXQCACG8CX.0 size=1048576 2024-08-27T02:38:10.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.071+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~HZMXQCACG8CX.1 size=1048576 2024-08-27T02:38:10.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.075+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~HZMXQCACG8CX.2 size=553517 2024-08-27T02:38:10.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.079+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=HZMXQCACG8CX tag=F3YXHB5EPIAO type=write size=3699245 2024-08-27T02:38:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.079+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=MBXR6Z95M8M3 type=del size=2678742 2024-08-27T02:38:10.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.083+0000 7f3e0cc408c0 1 < canceled operation key=IISECLYEAR19 tag=580EB3OW7WOQ type=del size=3433732 2024-08-27T02:38:10.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.083+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=C10WSQMT3COJ type=write size=697251 2024-08-27T02:38:10.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.087+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~190ACLUYQ3AA.0 size=397435 2024-08-27T02:38:10.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.091+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=190ACLUYQ3AA tag=OOV4WDWGHA66 type=write size=1446011 2024-08-27T02:38:10.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~OON8ENA4GFMD.0 size=1048576 2024-08-27T02:38:10.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.095+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~OON8ENA4GFMD.1 size=1048576 2024-08-27T02:38:10.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.099+0000 7f3e0cc408c0 1 > prepared part key=_multipart_PLC076BXR38P.2~OON8ENA4GFMD.2 size=53513 2024-08-27T02:38:10.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.099+0000 7f3e0cc408c0 1 > prepared multipart upload key=PLC076BXR38P upload=OON8ENA4GFMD tag=51FE3GF04GVH type=write size=3199241 2024-08-27T02:38:10.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.099+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=Z205OO0IV1AY type=del 2024-08-27T02:38:10.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.103+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=2WI3AUOFZF0L type=del size=2476755 2024-08-27T02:38:10.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~RM2TZDDXUGB7.0 size=1048576 2024-08-27T02:38:10.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~RM2TZDDXUGB7.1 size=850030 2024-08-27T02:38:10.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.111+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=RM2TZDDXUGB7 tag=I5P8I5KLVGPK type=write size=2947182 2024-08-27T02:38:10.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.115+0000 7f3e0cc408c0 1 > prepared operation key=ZMN8Y0VQVHLB tag=VC1O6SB6GX30 type=del size=3934701 2024-08-27T02:38:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.115+0000 7f3e0cc408c0 1 < completed write operation key=S5ANS33DXN7X tag=9FPM0FIXL5T9 type=write size=684285 2024-08-27T02:38:10.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.119+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~S0SBSIMZQLFO.0 size=1048576 2024-08-27T02:38:10.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.123+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~S0SBSIMZQLFO.1 size=1048576 2024-08-27T02:38:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.123+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~S0SBSIMZQLFO.2 size=667574 2024-08-27T02:38:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.123+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=S0SBSIMZQLFO tag=FJK0BMMBUH12 type=write size=3813302 2024-08-27T02:38:10.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.127+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~2OJKAD9RC5FZ.0 size=1048576 2024-08-27T02:38:10.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.127+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~2OJKAD9RC5FZ.1 size=698992 2024-08-27T02:38:10.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.131+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=2OJKAD9RC5FZ tag=29ZPVR6I5DKE type=write size=2796144 2024-08-27T02:38:10.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.135+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=J2XGP4CUEZF0 type=write size=138801 2024-08-27T02:38:10.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.135+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~7J3XM7V2IN47.0 size=1048576 2024-08-27T02:38:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.139+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~7J3XM7V2IN47.1 size=281783 2024-08-27T02:38:10.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.139+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=7J3XM7V2IN47 tag=3N8UZ662FPIZ type=write size=2378935 2024-08-27T02:38:10.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~469BZC5OI8D4.0 size=1048576 2024-08-27T02:38:10.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~469BZC5OI8D4.1 size=1048576 2024-08-27T02:38:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.147+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~469BZC5OI8D4.2 size=887095 2024-08-27T02:38:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.147+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=469BZC5OI8D4 tag=NT50CN84DAR2 type=write size=4032823 2024-08-27T02:38:10.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.151+0000 7f3e0cc408c0 1 < completed delete operation key=HTEOX3BV94K2 tag=F7Y3ETPHS9KK type=del 2024-08-27T02:38:10.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.155+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=3631T5CSFUPR type=del size=617823 2024-08-27T02:38:10.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.155+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~0U1F0D7LRBYA.0 size=1048576 2024-08-27T02:38:10.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.159+0000 7f3e0cc408c0 1 < completed part key=_multipart_UGSWC9ZK9S7S.2~0U1F0D7LRBYA.1 size=327448 2024-08-27T02:38:10.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.159+0000 7f3e0cc408c0 1 < completed multipart upload key=UGSWC9ZK9S7S upload=0U1F0D7LRBYA tag=07CJY0TXST8N type=write size=2424600 2024-08-27T02:38:10.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.167+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=LY12MIVKK2XI type=del size=2003046 2024-08-27T02:38:10.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.171+0000 7f3e0cc408c0 1 < completed write operation key=SG9T1RD5EATR tag=78P0NRZ8XX0W type=write size=167960 2024-08-27T02:38:10.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.175+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~LCL5AMVQO2SJ.0 size=860689 2024-08-27T02:38:10.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.175+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=LCL5AMVQO2SJ tag=K7393OSO3AK1 type=write size=1909265 2024-08-27T02:38:10.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.179+0000 7f3e0cc408c0 1 < completed part key=_multipart_S5ANS33DXN7X.2~5IL0I7LKIMD9.0 size=978600 2024-08-27T02:38:10.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.183+0000 7f3e0cc408c0 1 < completed multipart upload key=S5ANS33DXN7X upload=5IL0I7LKIMD9 tag=IAF8GJOZNDWS type=write size=2027176 2024-08-27T02:38:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.183+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=2HSZ1YDH42UK type=del size=1286541 2024-08-27T02:38:10.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.187+0000 7f3e0cc408c0 1 < suggested remove operation key=F4MCLPFLY531 tag=EIJ1B0FXJ37P type=write 2024-08-27T02:38:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.195+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~LO7F8VJ1DOFN.0 size=1048576 2024-08-27T02:38:10.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.195+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~LO7F8VJ1DOFN.1 size=461101 2024-08-27T02:38:10.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.195+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=LO7F8VJ1DOFN tag=HBA202Y60RFB type=write size=2558253 2024-08-27T02:38:10.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.199+0000 7f3e0cc408c0 1 < suggested update operation key=QVG1NTF6O8L2 tag=1PBLH23LUZB8 type=del size=1758060 2024-08-27T02:38:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.203+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~L09DVCVN1EK2.0 size=1048576 2024-08-27T02:38:10.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.207+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~L09DVCVN1EK2.1 size=751754 2024-08-27T02:38:10.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.207+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=L09DVCVN1EK2 tag=KDB83VA93156 type=write size=2848906 2024-08-27T02:38:10.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.211+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=W5MU5S9Y2BRZ type=del 2024-08-27T02:38:10.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.215+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~4BQVT107X9YR.0 size=1048576 2024-08-27T02:38:10.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.215+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~4BQVT107X9YR.1 size=1048576 2024-08-27T02:38:10.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.219+0000 7f3e0cc408c0 1 > prepared part key=_multipart_QVG1NTF6O8L2.2~4BQVT107X9YR.2 size=923174 2024-08-27T02:38:10.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.219+0000 7f3e0cc408c0 1 > prepared multipart upload key=QVG1NTF6O8L2 upload=4BQVT107X9YR tag=0QFTFH3JJ672 type=write size=4068902 2024-08-27T02:38:10.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.223+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~XGKRVFZVTYB5.0 size=1048576 2024-08-27T02:38:10.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.223+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~XGKRVFZVTYB5.1 size=582205 2024-08-27T02:38:10.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.231+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=XGKRVFZVTYB5 tag=K8F042TEHJQI type=write size=2679357 2024-08-27T02:38:10.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.231+0000 7f3e0cc408c0 1 > prepared operation key=PLC076BXR38P tag=1GTDOVR83MZR type=del size=1032161 2024-08-27T02:38:10.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.235+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=MBXR6Z95M8M3 type=del 2024-08-27T02:38:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.239+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~716CGV710VB6.0 size=1048576 2024-08-27T02:38:10.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.243+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~716CGV710VB6.1 size=1048576 2024-08-27T02:38:10.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.243+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~716CGV710VB6.2 size=976228 2024-08-27T02:38:10.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.243+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=716CGV710VB6 tag=16VTS7FV442G type=write size=4121956 2024-08-27T02:38:10.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.247+0000 7f3e0cc408c0 1 < completed write operation key=HKDJMA7O2DFM tag=C10WSQMT3COJ type=write size=697251 2024-08-27T02:38:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.251+0000 7f3e0cc408c0 1 > prepared operation key=OY551242R8T6 tag=7L3MGZZCNILG type=del size=780773 2024-08-27T02:38:10.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.251+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~OON8ENA4GFMD.0 size=1048576 2024-08-27T02:38:10.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.255+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~OON8ENA4GFMD.1 size=1048576 2024-08-27T02:38:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.255+0000 7f3e0cc408c0 1 < completed part key=_multipart_PLC076BXR38P.2~OON8ENA4GFMD.2 size=53513 2024-08-27T02:38:10.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.263+0000 7f3e0cc408c0 1 < completed multipart upload key=PLC076BXR38P upload=OON8ENA4GFMD tag=51FE3GF04GVH type=write size=3199241 2024-08-27T02:38:10.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.267+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0U59R3BXL181.2~45T2U24F3RW2.0 size=423778 2024-08-27T02:38:10.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.267+0000 7f3e0cc408c0 1 > prepared multipart upload key=0U59R3BXL181 upload=45T2U24F3RW2 tag=35OU39BA4SZC type=write size=1472354 2024-08-27T02:38:10.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.267+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=2WI3AUOFZF0L type=del 2024-08-27T02:38:10.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.275+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~3KBAUAJQACA3.0 size=303037 2024-08-27T02:38:10.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.275+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=3KBAUAJQACA3 tag=3P38SE1AFEY7 type=write size=1351613 2024-08-27T02:38:10.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.279+0000 7f3e0cc408c0 1 < completed delete operation key=ZMN8Y0VQVHLB tag=VC1O6SB6GX30 type=del 2024-08-27T02:38:10.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.279+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=HD4Y7Y642PTJ type=del size=25270 2024-08-27T02:38:10.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.279+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~S0SBSIMZQLFO.0 size=1048576 2024-08-27T02:38:10.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.283+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~S0SBSIMZQLFO.1 size=1048576 2024-08-27T02:38:10.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.287+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~S0SBSIMZQLFO.2 size=667574 2024-08-27T02:38:10.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.291+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=S0SBSIMZQLFO tag=FJK0BMMBUH12 type=write size=3813302 2024-08-27T02:38:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.295+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~Z4WJ6CTO0DUK.0 size=1048576 2024-08-27T02:38:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~Z4WJ6CTO0DUK.1 size=1048576 2024-08-27T02:38:10.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.299+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~Z4WJ6CTO0DUK.2 size=982568 2024-08-27T02:38:10.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.299+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=Z4WJ6CTO0DUK tag=A2CCCUKWB1KL type=write size=4128296 2024-08-27T02:38:10.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.303+0000 7f3e0cc408c0 1 < suggested update operation key=IISECLYEAR19 tag=J2XGP4CUEZF0 type=write size=138801 2024-08-27T02:38:10.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.307+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=ER9HXSEUHSIU type=write size=935185 2024-08-27T02:38:10.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.307+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~469BZC5OI8D4.0 size=1048576 2024-08-27T02:38:10.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.307+0000 7f3e0cc408c0 1 < canceled part key=_multipart_8VSA6T2H8FDI.2~469BZC5OI8D4.1 size=1048576 2024-08-27T02:38:10.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.311+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~469BZC5OI8D4.2 size=887095 2024-08-27T02:38:10.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.315+0000 7f3e0cc408c0 1 < canceled multipart upload key=8VSA6T2H8FDI upload=469BZC5OI8D4 tag=NT50CN84DAR2 type=write size=4032823 2024-08-27T02:38:10.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.319+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~YZC080KKNK2P.0 size=1048576 2024-08-27T02:38:10.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.319+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~YZC080KKNK2P.1 size=1048576 2024-08-27T02:38:10.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.323+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~YZC080KKNK2P.2 size=964399 2024-08-27T02:38:10.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.323+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=YZC080KKNK2P tag=G6QNN1RCKSEG type=write size=4110127 2024-08-27T02:38:10.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.323+0000 7f3e0cc408c0 1 < completed delete operation key=D7YWS7BWXT37 tag=3631T5CSFUPR type=del 2024-08-27T02:38:10.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.327+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~W2C6LTIYWLDS.0 size=1048576 2024-08-27T02:38:10.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.331+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~W2C6LTIYWLDS.1 size=1048576 2024-08-27T02:38:10.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.331+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~W2C6LTIYWLDS.2 size=193766 2024-08-27T02:38:10.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.331+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=W2C6LTIYWLDS tag=QJJ3MU6IKCQ6 type=write size=3339494 2024-08-27T02:38:10.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.335+0000 7f3e0cc408c0 1 < completed delete operation key=JDV1RIGAO7J1 tag=LY12MIVKK2XI type=del 2024-08-27T02:38:10.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.339+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=5I9SD8ZP74LD type=del size=3196382 2024-08-27T02:38:10.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.339+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~LCL5AMVQO2SJ.0 size=860689 2024-08-27T02:38:10.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.343+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=LCL5AMVQO2SJ tag=K7393OSO3AK1 type=write size=1909265 2024-08-27T02:38:10.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.347+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=YRO5MFFCBHQC type=del size=3776689 2024-08-27T02:38:10.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.351+0000 7f3e0cc408c0 1 < canceled operation key=4SSZQK6YIL1O tag=2HSZ1YDH42UK type=del size=1286541 2024-08-27T02:38:10.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.355+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~57VKEOCFRZ1I.0 size=25857 2024-08-27T02:38:10.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.355+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=57VKEOCFRZ1I tag=7RCQH70530SL type=write size=1074433 2024-08-27T02:38:10.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.355+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~LO7F8VJ1DOFN.0 size=1048576 2024-08-27T02:38:10.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.359+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~LO7F8VJ1DOFN.1 size=461101 2024-08-27T02:38:10.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.363+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=LO7F8VJ1DOFN tag=HBA202Y60RFB type=write size=2558253 2024-08-27T02:38:10.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.367+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~PFZ7QS17ZZMW.0 size=632775 2024-08-27T02:38:10.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.367+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=PFZ7QS17ZZMW tag=YON9OYEI8Q9I type=write size=1681351 2024-08-27T02:38:10.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.367+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~L09DVCVN1EK2.0 size=1048576 2024-08-27T02:38:10.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.371+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~L09DVCVN1EK2.1 size=751754 2024-08-27T02:38:10.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.375+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=L09DVCVN1EK2 tag=KDB83VA93156 type=write size=2848906 2024-08-27T02:38:10.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.379+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~1IRCXEZATMDW.0 size=1048576 2024-08-27T02:38:10.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.383+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~1IRCXEZATMDW.1 size=752584 2024-08-27T02:38:10.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.383+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=1IRCXEZATMDW tag=KGPBLPQ1S00T type=write size=2849736 2024-08-27T02:38:10.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.383+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~4BQVT107X9YR.0 size=1048576 2024-08-27T02:38:10.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~4BQVT107X9YR.1 size=1048576 2024-08-27T02:38:10.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.387+0000 7f3e0cc408c0 1 < completed part key=_multipart_QVG1NTF6O8L2.2~4BQVT107X9YR.2 size=923174 2024-08-27T02:38:10.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.391+0000 7f3e0cc408c0 1 < completed multipart upload key=QVG1NTF6O8L2 upload=4BQVT107X9YR tag=0QFTFH3JJ672 type=write size=4068902 2024-08-27T02:38:10.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.395+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=3W3K96FVIRT6 type=del size=1080238 2024-08-27T02:38:10.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.399+0000 7f3e0cc408c0 1 < suggested update operation key=PLC076BXR38P tag=1GTDOVR83MZR type=del size=1032161 2024-08-27T02:38:10.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.403+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=LL9LP72MSRZ3 type=del size=502916 2024-08-27T02:38:10.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.407+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~716CGV710VB6.0 size=1048576 2024-08-27T02:38:10.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.407+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~716CGV710VB6.1 size=1048576 2024-08-27T02:38:10.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.411+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~716CGV710VB6.2 size=976228 2024-08-27T02:38:10.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.415+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=716CGV710VB6 tag=16VTS7FV442G type=write size=4121956 2024-08-27T02:38:10.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.415+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=QBYTLBKARJJR type=del size=1573223 2024-08-27T02:38:10.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.419+0000 7f3e0cc408c0 1 < completed delete operation key=OY551242R8T6 tag=7L3MGZZCNILG type=del 2024-08-27T02:38:10.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.423+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=8ZTWUFHSZX0E type=write size=693105 2024-08-27T02:38:10.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.423+0000 7f3e0cc408c0 1 < completed part key=_multipart_0U59R3BXL181.2~45T2U24F3RW2.0 size=423778 2024-08-27T02:38:10.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.427+0000 7f3e0cc408c0 1 < completed multipart upload key=0U59R3BXL181 upload=45T2U24F3RW2 tag=35OU39BA4SZC type=write size=1472354 2024-08-27T02:38:10.429 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.431+0000 7f3e0cc408c0 1 > prepared operation key=0OLVDEQWBCAQ tag=5GZF0QJ9GW92 type=del size=275820 2024-08-27T02:38:10.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.431+0000 7f3e0cc408c0 1 < canceled part key=_multipart_XBURHQSU6IML.2~3KBAUAJQACA3.0 size=303037 2024-08-27T02:38:10.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.435+0000 7f3e0cc408c0 1 < canceled multipart upload key=XBURHQSU6IML upload=3KBAUAJQACA3 tag=3P38SE1AFEY7 type=write size=1351613 2024-08-27T02:38:10.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.435+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=0S6WR0IZXM0A type=write size=271335 2024-08-27T02:38:10.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.439+0000 7f3e0cc408c0 1 < suggested update operation key=0OLVDEQWBCAQ tag=HD4Y7Y642PTJ type=del size=25270 2024-08-27T02:38:10.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.443+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~D0WVQ9IW3N3A.0 size=1048576 2024-08-27T02:38:10.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.447+0000 7f3e0cc408c0 1 > prepared part key=_multipart_XBURHQSU6IML.2~D0WVQ9IW3N3A.1 size=749983 2024-08-27T02:38:10.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.447+0000 7f3e0cc408c0 1 > prepared multipart upload key=XBURHQSU6IML upload=D0WVQ9IW3N3A tag=JY41ASZQ3DFW type=write size=2847135 2024-08-27T02:38:10.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~Z4WJ6CTO0DUK.0 size=1048576 2024-08-27T02:38:10.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.451+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~Z4WJ6CTO0DUK.1 size=1048576 2024-08-27T02:38:10.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.455+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~Z4WJ6CTO0DUK.2 size=982568 2024-08-27T02:38:10.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.459+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=Z4WJ6CTO0DUK tag=A2CCCUKWB1KL type=write size=4128296 2024-08-27T02:38:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.459+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=I42MFP21TKAX type=del size=1852306 2024-08-27T02:38:10.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.463+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=ER9HXSEUHSIU type=write size=935185 2024-08-27T02:38:10.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.467+0000 7f3e0cc408c0 1 > prepared operation key=UGSWC9ZK9S7S tag=S2DLXOAZQXU2 type=del size=69275 2024-08-27T02:38:10.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.467+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JDV1RIGAO7J1.2~YZC080KKNK2P.0 size=1048576 2024-08-27T02:38:10.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.467+0000 7f3e0cc408c0 1 < canceled part key=_multipart_JDV1RIGAO7J1.2~YZC080KKNK2P.1 size=1048576 2024-08-27T02:38:10.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.467+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~YZC080KKNK2P.2 size=964399 2024-08-27T02:38:10.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.471+0000 7f3e0cc408c0 1 < canceled multipart upload key=JDV1RIGAO7J1 upload=YZC080KKNK2P tag=G6QNN1RCKSEG type=write size=4110127 2024-08-27T02:38:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.475+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=UNAPLHX7W5TF type=del size=2920025 2024-08-27T02:38:10.476 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.475+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~W2C6LTIYWLDS.0 size=1048576 2024-08-27T02:38:10.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.479+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~W2C6LTIYWLDS.1 size=1048576 2024-08-27T02:38:10.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.479+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~W2C6LTIYWLDS.2 size=193766 2024-08-27T02:38:10.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.483+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=W2C6LTIYWLDS tag=QJJ3MU6IKCQ6 type=write size=3339494 2024-08-27T02:38:10.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.483+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=W6MT52F7YY2C type=del size=242225 2024-08-27T02:38:10.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.487+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=5I9SD8ZP74LD type=del 2024-08-27T02:38:10.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.491+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=BTDBIU3I2F2C type=del size=228997 2024-08-27T02:38:10.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.491+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=YRO5MFFCBHQC type=del 2024-08-27T02:38:10.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.495+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~CPLNBMA2K9TH.0 size=1048576 2024-08-27T02:38:10.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~CPLNBMA2K9TH.1 size=1048576 2024-08-27T02:38:10.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.499+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~CPLNBMA2K9TH.2 size=705702 2024-08-27T02:38:10.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.499+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=CPLNBMA2K9TH tag=512EXUA7LG22 type=write size=3851430 2024-08-27T02:38:10.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.503+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~57VKEOCFRZ1I.0 size=25857 2024-08-27T02:38:10.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.507+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=57VKEOCFRZ1I tag=7RCQH70530SL type=write size=1074433 2024-08-27T02:38:10.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.511+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=UKTLYX6Z2WJ8 type=del size=2772174 2024-08-27T02:38:10.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.511+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~PFZ7QS17ZZMW.0 size=632775 2024-08-27T02:38:10.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.515+0000 7f3e0cc408c0 1 < completed multipart upload key=MNE5WNFBH9HG upload=PFZ7QS17ZZMW tag=YON9OYEI8Q9I type=write size=1681351 2024-08-27T02:38:10.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.523+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~27SDOVX5LP18.0 size=760503 2024-08-27T02:38:10.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.523+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=27SDOVX5LP18 tag=A27F2QJ4VISS type=write size=1809079 2024-08-27T02:38:10.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.523+0000 7f3e0cc408c0 1 < canceled part key=_multipart_ZMN8Y0VQVHLB.2~1IRCXEZATMDW.0 size=1048576 2024-08-27T02:38:10.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.523+0000 7f3e0cc408c0 1 < completed part key=_multipart_ZMN8Y0VQVHLB.2~1IRCXEZATMDW.1 size=752584 2024-08-27T02:38:10.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.527+0000 7f3e0cc408c0 1 < canceled multipart upload key=ZMN8Y0VQVHLB upload=1IRCXEZATMDW tag=KGPBLPQ1S00T type=write size=2849736 2024-08-27T02:38:10.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.531+0000 7f3e0cc408c0 1 > prepared operation key=6QE1HU65GQZZ tag=43U0XF035JZ4 type=write size=1021679 2024-08-27T02:38:10.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.531+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=3W3K96FVIRT6 type=del 2024-08-27T02:38:10.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.535+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=M4CS084FRQFW type=del size=2787236 2024-08-27T02:38:10.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.539+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=LL9LP72MSRZ3 type=del 2024-08-27T02:38:10.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.543+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~M3F1RMYDMFUR.0 size=1048576 2024-08-27T02:38:10.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.543+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~M3F1RMYDMFUR.1 size=933616 2024-08-27T02:38:10.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.543+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=M3F1RMYDMFUR tag=JXPAH0ZUJHHZ type=write size=3030768 2024-08-27T02:38:10.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.547+0000 7f3e0cc408c0 1 < completed delete operation key=4BV3C9MTIFT5 tag=QBYTLBKARJJR type=del 2024-08-27T02:38:10.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.551+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~58UTTE6MVW08.0 size=1048576 2024-08-27T02:38:10.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.555+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~58UTTE6MVW08.1 size=1048576 2024-08-27T02:38:10.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.555+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~58UTTE6MVW08.2 size=537864 2024-08-27T02:38:10.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.555+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=58UTTE6MVW08 tag=PC7X31G645LU type=write size=3683592 2024-08-27T02:38:10.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.559+0000 7f3e0cc408c0 1 < completed write operation key=4SSZQK6YIL1O tag=8ZTWUFHSZX0E type=write size=693105 2024-08-27T02:38:10.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~DAVUOO1L56WC.0 size=1048576 2024-08-27T02:38:10.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.563+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~DAVUOO1L56WC.1 size=1048576 2024-08-27T02:38:10.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.567+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6QE1HU65GQZZ.2~DAVUOO1L56WC.2 size=380441 2024-08-27T02:38:10.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.567+0000 7f3e0cc408c0 1 > prepared multipart upload key=6QE1HU65GQZZ upload=DAVUOO1L56WC tag=JTD2FFJFT06J type=write size=3526169 2024-08-27T02:38:10.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.571+0000 7f3e0cc408c0 1 < suggested update operation key=0OLVDEQWBCAQ tag=5GZF0QJ9GW92 type=del size=275820 2024-08-27T02:38:10.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.575+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=Q2E06BFXSM21 type=del size=2015911 2024-08-27T02:38:10.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.579+0000 7f3e0cc408c0 1 < suggested update operation key=1ZIJ9JJTM4ZC tag=0S6WR0IZXM0A type=write size=271335 2024-08-27T02:38:10.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.583+0000 7f3e0cc408c0 1 > prepared operation key=KTPZGZSQCERQ tag=IZNRM1DGZM6R type=del size=2185111 2024-08-27T02:38:10.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.583+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~D0WVQ9IW3N3A.0 size=1048576 2024-08-27T02:38:10.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.587+0000 7f3e0cc408c0 1 < completed part key=_multipart_XBURHQSU6IML.2~D0WVQ9IW3N3A.1 size=749983 2024-08-27T02:38:10.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.591+0000 7f3e0cc408c0 1 < completed multipart upload key=XBURHQSU6IML upload=D0WVQ9IW3N3A tag=JY41ASZQ3DFW type=write size=2847135 2024-08-27T02:38:10.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.595+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~4O0Z3ENR15FG.0 size=608429 2024-08-27T02:38:10.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.595+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=4O0Z3ENR15FG tag=6WB85R2WQO1R type=write size=1657005 2024-08-27T02:38:10.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.595+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=I42MFP21TKAX type=del 2024-08-27T02:38:10.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.599+0000 7f3e0cc408c0 1 > prepared operation key=1ZIJ9JJTM4ZC tag=WPK4RL5EPRT3 type=del size=342186 2024-08-27T02:38:10.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.599+0000 7f3e0cc408c0 1 < completed delete operation key=UGSWC9ZK9S7S tag=S2DLXOAZQXU2 type=del 2024-08-27T02:38:10.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.603+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=U79JSRE26J3V type=del size=3113444 2024-08-27T02:38:10.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.607+0000 7f3e0cc408c0 1 < completed delete operation key=JLAGXRZVF50G tag=UNAPLHX7W5TF type=del 2024-08-27T02:38:10.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.607+0000 7f3e0cc408c0 1 > prepared operation key=8VSA6T2H8FDI tag=6GPYNJ6DMRCE type=del size=768366 2024-08-27T02:38:10.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.611+0000 7f3e0cc408c0 1 < completed delete operation key=VSDJU5KQLFKE tag=W6MT52F7YY2C type=del 2024-08-27T02:38:10.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.611+0000 7f3e0cc408c0 1 > prepared operation key=QVG1NTF6O8L2 tag=VBZXQKCZVP6E type=del size=3562395 2024-08-27T02:38:10.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.615+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=BTDBIU3I2F2C type=del 2024-08-27T02:38:10.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.615+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=VMSJQSHAL298 type=del size=910494 2024-08-27T02:38:10.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.619+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~CPLNBMA2K9TH.0 size=1048576 2024-08-27T02:38:10.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~CPLNBMA2K9TH.1 size=1048576 2024-08-27T02:38:10.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.623+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~CPLNBMA2K9TH.2 size=705702 2024-08-27T02:38:10.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.631+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=CPLNBMA2K9TH tag=512EXUA7LG22 type=write size=3851430 2024-08-27T02:38:10.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.631+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=XT67AED339R3 type=del size=1779174 2024-08-27T02:38:10.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.635+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=UKTLYX6Z2WJ8 type=del 2024-08-27T02:38:10.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.639+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~239AIV3F8TJY.0 size=1048576 2024-08-27T02:38:10.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.639+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~239AIV3F8TJY.1 size=82035 2024-08-27T02:38:10.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.639+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=239AIV3F8TJY tag=MYAV2W8WD15B type=write size=2179187 2024-08-27T02:38:10.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.643+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~27SDOVX5LP18.0 size=760503 2024-08-27T02:38:10.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.647+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=27SDOVX5LP18 tag=A27F2QJ4VISS type=write size=1809079 2024-08-27T02:38:10.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.647+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=IADYL9GLOKQF type=del size=641012 2024-08-27T02:38:10.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.651+0000 7f3e0cc408c0 1 < completed write operation key=6QE1HU65GQZZ tag=43U0XF035JZ4 type=write size=1021679 2024-08-27T02:38:10.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.651+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=W29LM6OH2SQQ type=del size=2964560 2024-08-27T02:38:10.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.655+0000 7f3e0cc408c0 1 < canceled operation key=SG9T1RD5EATR tag=M4CS084FRQFW type=del size=2787236 2024-08-27T02:38:10.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.655+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=K95O82QH9OM0 type=del size=3646045 2024-08-27T02:38:10.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.659+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~M3F1RMYDMFUR.0 size=1048576 2024-08-27T02:38:10.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.659+0000 7f3e0cc408c0 1 < completed part key=_multipart_8VSA6T2H8FDI.2~M3F1RMYDMFUR.1 size=933616 2024-08-27T02:38:10.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.663+0000 7f3e0cc408c0 1 < completed multipart upload key=8VSA6T2H8FDI upload=M3F1RMYDMFUR tag=JXPAH0ZUJHHZ type=write size=3030768 2024-08-27T02:38:10.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.667+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JLAGXRZVF50G.2~FOYWCSIQ66C2.0 size=223801 2024-08-27T02:38:10.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.667+0000 7f3e0cc408c0 1 > prepared multipart upload key=JLAGXRZVF50G upload=FOYWCSIQ66C2 tag=8JE6JFZG6HHJ type=write size=1272377 2024-08-27T02:38:10.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.671+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~58UTTE6MVW08.0 size=1048576 2024-08-27T02:38:10.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~58UTTE6MVW08.1 size=1048576 2024-08-27T02:38:10.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.675+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~58UTTE6MVW08.2 size=537864 2024-08-27T02:38:10.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.679+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=58UTTE6MVW08 tag=PC7X31G645LU type=write size=3683592 2024-08-27T02:38:10.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.683+0000 7f3e0cc408c0 1 > prepared part key=_multipart_4BV3C9MTIFT5.2~XITFX6Z4YP8M.0 size=210094 2024-08-27T02:38:10.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.683+0000 7f3e0cc408c0 1 > prepared multipart upload key=4BV3C9MTIFT5 upload=XITFX6Z4YP8M tag=H4WXS50NE33Y type=write size=1258670 2024-08-27T02:38:10.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.683+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~DAVUOO1L56WC.0 size=1048576 2024-08-27T02:38:10.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~DAVUOO1L56WC.1 size=1048576 2024-08-27T02:38:10.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.687+0000 7f3e0cc408c0 1 < completed part key=_multipart_6QE1HU65GQZZ.2~DAVUOO1L56WC.2 size=380441 2024-08-27T02:38:10.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.691+0000 7f3e0cc408c0 1 < completed multipart upload key=6QE1HU65GQZZ upload=DAVUOO1L56WC tag=JTD2FFJFT06J type=write size=3526169 2024-08-27T02:38:10.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.695+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~OKKDMEHD7GML.0 size=1048576 2024-08-27T02:38:10.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.699+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~OKKDMEHD7GML.1 size=1048576 2024-08-27T02:38:10.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.699+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~OKKDMEHD7GML.2 size=402354 2024-08-27T02:38:10.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.699+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=OKKDMEHD7GML tag=1CGH5C2UXCX3 type=write size=3548082 2024-08-27T02:38:10.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.703+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=Q2E06BFXSM21 type=del 2024-08-27T02:38:10.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.707+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=CJ9CTZXB6E4H type=del size=1900178 2024-08-27T02:38:10.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.707+0000 7f3e0cc408c0 1 < completed delete operation key=KTPZGZSQCERQ tag=IZNRM1DGZM6R type=del 2024-08-27T02:38:10.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.711+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=RUTQA4KX8KY5 type=write size=17297 2024-08-27T02:38:10.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.711+0000 7f3e0cc408c0 1 < completed part key=_multipart_OY551242R8T6.2~4O0Z3ENR15FG.0 size=608429 2024-08-27T02:38:10.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.715+0000 7f3e0cc408c0 1 < completed multipart upload key=OY551242R8T6 upload=4O0Z3ENR15FG tag=6WB85R2WQO1R type=write size=1657005 2024-08-27T02:38:10.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.719+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~TF9RKEWPS8R8.0 size=1048576 2024-08-27T02:38:10.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.723+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~TF9RKEWPS8R8.1 size=31833 2024-08-27T02:38:10.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.723+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=TF9RKEWPS8R8 tag=0HSQ0C0MS4TC type=write size=2128985 2024-08-27T02:38:10.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.723+0000 7f3e0cc408c0 1 < completed delete operation key=1ZIJ9JJTM4ZC tag=WPK4RL5EPRT3 type=del 2024-08-27T02:38:10.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.727+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~I5Q5IWOM86JM.0 size=1048576 2024-08-27T02:38:10.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.731+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~I5Q5IWOM86JM.1 size=1048576 2024-08-27T02:38:10.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.731+0000 7f3e0cc408c0 1 > prepared part key=_multipart_HKDJMA7O2DFM.2~I5Q5IWOM86JM.2 size=147430 2024-08-27T02:38:10.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.731+0000 7f3e0cc408c0 1 > prepared multipart upload key=HKDJMA7O2DFM upload=I5Q5IWOM86JM tag=R1X1VUBKR5O6 type=write size=3293158 2024-08-27T02:38:10.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.735+0000 7f3e0cc408c0 1 < suggested remove operation key=O66XJ7GJMPCU tag=U79JSRE26J3V type=del 2024-08-27T02:38:10.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.739+0000 7f3e0cc408c0 1 > prepared operation key=D7YWS7BWXT37 tag=FALYW8A8MTEZ type=del size=2173564 2024-08-27T02:38:10.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.739+0000 7f3e0cc408c0 1 < completed delete operation key=8VSA6T2H8FDI tag=6GPYNJ6DMRCE type=del 2024-08-27T02:38:10.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.743+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=H7JSWT5ZGSCE type=del size=2082690 2024-08-27T02:38:10.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.747+0000 7f3e0cc408c0 1 < suggested remove operation key=QVG1NTF6O8L2 tag=VBZXQKCZVP6E type=del 2024-08-27T02:38:10.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.747+0000 7f3e0cc408c0 1 > prepared operation key=4BV3C9MTIFT5 tag=10WRHBNUFV13 type=del size=1568136 2024-08-27T02:38:10.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.751+0000 7f3e0cc408c0 1 < completed delete operation key=XBURHQSU6IML tag=VMSJQSHAL298 type=del 2024-08-27T02:38:10.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.755+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~TEITSJOVUKI8.0 size=1048576 2024-08-27T02:38:10.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~TEITSJOVUKI8.1 size=1048576 2024-08-27T02:38:10.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.759+0000 7f3e0cc408c0 1 > prepared part key=_multipart_F4MCLPFLY531.2~TEITSJOVUKI8.2 size=444093 2024-08-27T02:38:10.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.759+0000 7f3e0cc408c0 1 > prepared multipart upload key=F4MCLPFLY531 upload=TEITSJOVUKI8 tag=WRI5P5B1L43A type=write size=3589821 2024-08-27T02:38:10.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.763+0000 7f3e0cc408c0 1 < completed delete operation key=B9DPI871LQ7E tag=XT67AED339R3 type=del 2024-08-27T02:38:10.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.763+0000 7f3e0cc408c0 1 > prepared operation key=A0RUXE4YL6NR tag=7F8YE0YQUUEQ type=del size=541354 2024-08-27T02:38:10.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.763+0000 7f3e0cc408c0 1 < canceled part key=_multipart_0OLVDEQWBCAQ.2~239AIV3F8TJY.0 size=1048576 2024-08-27T02:38:10.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.767+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~239AIV3F8TJY.1 size=82035 2024-08-27T02:38:10.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.771+0000 7f3e0cc408c0 1 < canceled multipart upload key=0OLVDEQWBCAQ upload=239AIV3F8TJY tag=MYAV2W8WD15B type=write size=2179187 2024-08-27T02:38:10.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.771+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=7ZTT820VDU6D type=del size=366178 2024-08-27T02:38:10.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.775+0000 7f3e0cc408c0 1 < completed delete operation key=MNE5WNFBH9HG tag=IADYL9GLOKQF type=del 2024-08-27T02:38:10.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.779+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=3SCDB3W1O3HU type=del size=2330353 2024-08-27T02:38:10.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.779+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=W29LM6OH2SQQ type=del 2024-08-27T02:38:10.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.787+0000 7f3e0cc408c0 1 > prepared part key=_multipart_VSDJU5KQLFKE.2~YP99PJIJ7ZTW.0 size=448366 2024-08-27T02:38:10.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.787+0000 7f3e0cc408c0 1 > prepared multipart upload key=VSDJU5KQLFKE upload=YP99PJIJ7ZTW tag=DK4S4GCSZ2AQ type=write size=1496942 2024-08-27T02:38:10.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.787+0000 7f3e0cc408c0 1 < completed delete operation key=4SSZQK6YIL1O tag=K95O82QH9OM0 type=del 2024-08-27T02:38:10.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.791+0000 7f3e0cc408c0 1 > prepared part key=_multipart_A0RUXE4YL6NR.2~VQFJTJR5NDUY.0 size=791785 2024-08-27T02:38:10.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.791+0000 7f3e0cc408c0 1 > prepared multipart upload key=A0RUXE4YL6NR upload=VQFJTJR5NDUY tag=UCDHI6MDTSHH type=write size=1840361 2024-08-27T02:38:10.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.795+0000 7f3e0cc408c0 1 < completed part key=_multipart_JLAGXRZVF50G.2~FOYWCSIQ66C2.0 size=223801 2024-08-27T02:38:10.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.799+0000 7f3e0cc408c0 1 < completed multipart upload key=JLAGXRZVF50G upload=FOYWCSIQ66C2 tag=8JE6JFZG6HHJ type=write size=1272377 2024-08-27T02:38:10.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~1RYCETZAG1F1.0 size=1048576 2024-08-27T02:38:10.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.803+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~1RYCETZAG1F1.1 size=1048576 2024-08-27T02:38:10.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.807+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MNE5WNFBH9HG.2~1RYCETZAG1F1.2 size=88051 2024-08-27T02:38:10.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.807+0000 7f3e0cc408c0 1 > prepared multipart upload key=MNE5WNFBH9HG upload=1RYCETZAG1F1 tag=01JHBS9WHFLT type=write size=3233779 2024-08-27T02:38:10.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.807+0000 7f3e0cc408c0 1 < completed part key=_multipart_4BV3C9MTIFT5.2~XITFX6Z4YP8M.0 size=210094 2024-08-27T02:38:10.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.811+0000 7f3e0cc408c0 1 < completed multipart upload key=4BV3C9MTIFT5 upload=XITFX6Z4YP8M tag=H4WXS50NE33Y type=write size=1258670 2024-08-27T02:38:10.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.815+0000 7f3e0cc408c0 1 > prepared operation key=F4MCLPFLY531 tag=584MOH7GZRN7 type=write size=70192 2024-08-27T02:38:10.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~OKKDMEHD7GML.0 size=1048576 2024-08-27T02:38:10.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.819+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~OKKDMEHD7GML.1 size=1048576 2024-08-27T02:38:10.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.823+0000 7f3e0cc408c0 1 < completed part key=_multipart_KTPZGZSQCERQ.2~OKKDMEHD7GML.2 size=402354 2024-08-27T02:38:10.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.827+0000 7f3e0cc408c0 1 < completed multipart upload key=KTPZGZSQCERQ upload=OKKDMEHD7GML tag=1CGH5C2UXCX3 type=write size=3548082 2024-08-27T02:38:10.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.827+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=0UOY5QHPTM76 type=del size=3743284 2024-08-27T02:38:10.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.831+0000 7f3e0cc408c0 1 < completed delete operation key=F4MCLPFLY531 tag=CJ9CTZXB6E4H type=del 2024-08-27T02:38:10.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~0PI23O8GAZ7I.0 size=1048576 2024-08-27T02:38:10.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.835+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~0PI23O8GAZ7I.1 size=459258 2024-08-27T02:38:10.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.835+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=0PI23O8GAZ7I tag=6HMWUSVVUP36 type=write size=2556410 2024-08-27T02:38:10.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.839+0000 7f3e0cc408c0 1 < completed write operation key=VSDJU5KQLFKE tag=RUTQA4KX8KY5 type=write size=17297 2024-08-27T02:38:10.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.847+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~D7SRW8P31ZIO.0 size=308823 2024-08-27T02:38:10.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.847+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=D7SRW8P31ZIO tag=W2DUVQGYVABH type=write size=1357399 2024-08-27T02:38:10.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.847+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~TF9RKEWPS8R8.0 size=1048576 2024-08-27T02:38:10.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.851+0000 7f3e0cc408c0 1 < completed part key=_multipart_1ZIJ9JJTM4ZC.2~TF9RKEWPS8R8.1 size=31833 2024-08-27T02:38:10.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.855+0000 7f3e0cc408c0 1 < completed multipart upload key=1ZIJ9JJTM4ZC upload=TF9RKEWPS8R8 tag=0HSQ0C0MS4TC type=write size=2128985 2024-08-27T02:38:10.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.855+0000 7f3e0cc408c0 1 > prepared operation key=MNE5WNFBH9HG tag=ORCZC5DK3194 type=del size=3628152 2024-08-27T02:38:10.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.859+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~I5Q5IWOM86JM.0 size=1048576 2024-08-27T02:38:10.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.863+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~I5Q5IWOM86JM.1 size=1048576 2024-08-27T02:38:10.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.863+0000 7f3e0cc408c0 1 < completed part key=_multipart_HKDJMA7O2DFM.2~I5Q5IWOM86JM.2 size=147430 2024-08-27T02:38:10.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.867+0000 7f3e0cc408c0 1 < completed multipart upload key=HKDJMA7O2DFM upload=I5Q5IWOM86JM tag=R1X1VUBKR5O6 type=write size=3293158 2024-08-27T02:38:10.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.871+0000 7f3e0cc408c0 1 > prepared operation key=VSDJU5KQLFKE tag=7LIQUFFW2G7A type=del size=2039661 2024-08-27T02:38:10.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.875+0000 7f3e0cc408c0 1 < suggested update operation key=D7YWS7BWXT37 tag=FALYW8A8MTEZ type=del size=2173564 2024-08-27T02:38:10.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.879+0000 7f3e0cc408c0 1 > prepared operation key=SG9T1RD5EATR tag=LOYQ6VLCSS0D type=del size=3579597 2024-08-27T02:38:10.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.883+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=H7JSWT5ZGSCE type=del 2024-08-27T02:38:10.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.883+0000 7f3e0cc408c0 1 > prepared operation key=O66XJ7GJMPCU tag=YXIP116L414L type=del size=1027972 2024-08-27T02:38:10.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.887+0000 7f3e0cc408c0 1 < suggested update operation key=4BV3C9MTIFT5 tag=10WRHBNUFV13 type=del size=1568136 2024-08-27T02:38:10.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.891+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~4LEQEE5K0Y6D.0 size=1048576 2024-08-27T02:38:10.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.895+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~4LEQEE5K0Y6D.1 size=1048576 2024-08-27T02:38:10.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.895+0000 7f3e0cc408c0 1 > prepared part key=_multipart_MKB40KOOCCNT.2~4LEQEE5K0Y6D.2 size=7563 2024-08-27T02:38:10.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.895+0000 7f3e0cc408c0 1 > prepared multipart upload key=MKB40KOOCCNT upload=4LEQEE5K0Y6D tag=BZBTJ0S42KVH type=write size=3153291 2024-08-27T02:38:10.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.899+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~TEITSJOVUKI8.0 size=1048576 2024-08-27T02:38:10.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.899+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~TEITSJOVUKI8.1 size=1048576 2024-08-27T02:38:10.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.903+0000 7f3e0cc408c0 1 < completed part key=_multipart_F4MCLPFLY531.2~TEITSJOVUKI8.2 size=444093 2024-08-27T02:38:10.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.907+0000 7f3e0cc408c0 1 < completed multipart upload key=F4MCLPFLY531 upload=TEITSJOVUKI8 tag=WRI5P5B1L43A type=write size=3589821 2024-08-27T02:38:10.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.911+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~2WIOT50QKDIW.0 size=1048576 2024-08-27T02:38:10.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.911+0000 7f3e0cc408c0 1 > prepared part key=_multipart_0OLVDEQWBCAQ.2~2WIOT50QKDIW.1 size=609543 2024-08-27T02:38:10.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.911+0000 7f3e0cc408c0 1 > prepared multipart upload key=0OLVDEQWBCAQ upload=2WIOT50QKDIW tag=O6UO9UNVUFMN type=write size=2706695 2024-08-27T02:38:10.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.915+0000 7f3e0cc408c0 1 < completed delete operation key=A0RUXE4YL6NR tag=7F8YE0YQUUEQ type=del 2024-08-27T02:38:10.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.919+0000 7f3e0cc408c0 1 > prepared operation key=0U59R3BXL181 tag=3IUYT6BA1NHN type=del size=200312 2024-08-27T02:38:10.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.919+0000 7f3e0cc408c0 1 < canceled operation key=0U59R3BXL181 tag=7ZTT820VDU6D type=del size=366178 2024-08-27T02:38:10.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.927+0000 7f3e0cc408c0 1 > prepared part key=_multipart_2CXWPDABA9XJ.2~OBSX5FD8QFYA.0 size=736851 2024-08-27T02:38:10.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.927+0000 7f3e0cc408c0 1 > prepared multipart upload key=2CXWPDABA9XJ upload=OBSX5FD8QFYA tag=YKAB0BPT2330 type=write size=1785427 2024-08-27T02:38:10.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.927+0000 7f3e0cc408c0 1 < completed delete operation key=HKDJMA7O2DFM tag=3SCDB3W1O3HU type=del 2024-08-27T02:38:10.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~1AMWJNQZRYOP.0 size=1048576 2024-08-27T02:38:10.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.935+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~1AMWJNQZRYOP.1 size=1048576 2024-08-27T02:38:10.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.939+0000 7f3e0cc408c0 1 > prepared part key=_multipart_JDV1RIGAO7J1.2~1AMWJNQZRYOP.2 size=35847 2024-08-27T02:38:10.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.939+0000 7f3e0cc408c0 1 > prepared multipart upload key=JDV1RIGAO7J1 upload=1AMWJNQZRYOP tag=M7FRSCJJXWC6 type=write size=3181575 2024-08-27T02:38:10.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.939+0000 7f3e0cc408c0 1 < completed part key=_multipart_VSDJU5KQLFKE.2~YP99PJIJ7ZTW.0 size=448366 2024-08-27T02:38:10.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.943+0000 7f3e0cc408c0 1 < completed multipart upload key=VSDJU5KQLFKE upload=YP99PJIJ7ZTW tag=DK4S4GCSZ2AQ type=write size=1496942 2024-08-27T02:38:10.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.947+0000 7f3e0cc408c0 1 > prepared operation key=IISECLYEAR19 tag=357U7QGCHZBR type=del size=2902598 2024-08-27T02:38:10.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.951+0000 7f3e0cc408c0 1 < completed part key=_multipart_A0RUXE4YL6NR.2~VQFJTJR5NDUY.0 size=791785 2024-08-27T02:38:10.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.955+0000 7f3e0cc408c0 1 < completed multipart upload key=A0RUXE4YL6NR upload=VQFJTJR5NDUY tag=UCDHI6MDTSHH type=write size=1840361 2024-08-27T02:38:10.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.959+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~GSKCDCH8I8M4.0 size=1048576 2024-08-27T02:38:10.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.959+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~GSKCDCH8I8M4.1 size=1048576 2024-08-27T02:38:10.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.963+0000 7f3e0cc408c0 1 > prepared part key=_multipart_1ZIJ9JJTM4ZC.2~GSKCDCH8I8M4.2 size=892830 2024-08-27T02:38:10.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.963+0000 7f3e0cc408c0 1 > prepared multipart upload key=1ZIJ9JJTM4ZC upload=GSKCDCH8I8M4 tag=KKBBGMCUEL6Y type=write size=4038558 2024-08-27T02:38:10.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.967+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~1RYCETZAG1F1.0 size=1048576 2024-08-27T02:38:10.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.967+0000 7f3e0cc408c0 1 < completed part key=_multipart_MNE5WNFBH9HG.2~1RYCETZAG1F1.1 size=1048576 2024-08-27T02:38:10.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.967+0000 7f3e0cc408c0 1 < canceled part key=_multipart_MNE5WNFBH9HG.2~1RYCETZAG1F1.2 size=88051 2024-08-27T02:38:10.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.971+0000 7f3e0cc408c0 1 < canceled multipart upload key=MNE5WNFBH9HG upload=1RYCETZAG1F1 tag=01JHBS9WHFLT type=write size=3233779 2024-08-27T02:38:10.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.975+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=W8LJY31NF8GK type=del size=4064439 2024-08-27T02:38:10.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.979+0000 7f3e0cc408c0 1 < completed write operation key=F4MCLPFLY531 tag=584MOH7GZRN7 type=write size=70192 2024-08-27T02:38:10.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.979+0000 7f3e0cc408c0 1 > prepared operation key=4SSZQK6YIL1O tag=ZHOI6MS9ZCHS type=del size=3032740 2024-08-27T02:38:10.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.983+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=0UOY5QHPTM76 type=del 2024-08-27T02:38:10.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.987+0000 7f3e0cc408c0 1 > prepared part key=_multipart_KTPZGZSQCERQ.2~28BLOYKE4FDC.0 size=680812 2024-08-27T02:38:10.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.987+0000 7f3e0cc408c0 1 > prepared multipart upload key=KTPZGZSQCERQ upload=28BLOYKE4FDC tag=K1XDRMC3C6XI type=write size=1729388 2024-08-27T02:38:10.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~0PI23O8GAZ7I.0 size=1048576 2024-08-27T02:38:10.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.991+0000 7f3e0cc408c0 1 < completed part key=_multipart_6YTZJKE4V5HQ.2~0PI23O8GAZ7I.1 size=459258 2024-08-27T02:38:10.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:10.995+0000 7f3e0cc408c0 1 < completed multipart upload key=6YTZJKE4V5HQ upload=0PI23O8GAZ7I tag=6HMWUSVVUP36 type=write size=2556410 2024-08-27T02:38:11.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~G950YFMALVEJ.0 size=1048576 2024-08-27T02:38:11.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.003+0000 7f3e0cc408c0 1 > prepared part key=_multipart_S5ANS33DXN7X.2~G950YFMALVEJ.1 size=647766 2024-08-27T02:38:11.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.003+0000 7f3e0cc408c0 1 > prepared multipart upload key=S5ANS33DXN7X upload=G950YFMALVEJ tag=7AP3FODU91BN type=write size=2744918 2024-08-27T02:38:11.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.007+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~D7SRW8P31ZIO.0 size=308823 2024-08-27T02:38:11.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.011+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=D7SRW8P31ZIO tag=W2DUVQGYVABH type=write size=1357399 2024-08-27T02:38:11.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.015+0000 7f3e0cc408c0 1 > prepared operation key=B9DPI871LQ7E tag=UP4F2CBQRSBI type=write size=363345 2024-08-27T02:38:11.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.019+0000 7f3e0cc408c0 1 < suggested update operation key=MNE5WNFBH9HG tag=ORCZC5DK3194 type=del size=3628152 2024-08-27T02:38:11.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.023+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~3UM2GFJ0N770.0 size=1048576 2024-08-27T02:38:11.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.027+0000 7f3e0cc408c0 1 > prepared part key=_multipart_ZMN8Y0VQVHLB.2~3UM2GFJ0N770.1 size=12052 2024-08-27T02:38:11.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.027+0000 7f3e0cc408c0 1 > prepared multipart upload key=ZMN8Y0VQVHLB upload=3UM2GFJ0N770 tag=0UN3RMZ1EWHR type=write size=2109204 2024-08-27T02:38:11.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.031+0000 7f3e0cc408c0 1 < suggested remove operation key=VSDJU5KQLFKE tag=7LIQUFFW2G7A type=del 2024-08-27T02:38:11.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.035+0000 7f3e0cc408c0 1 > prepared operation key=JDV1RIGAO7J1 tag=Z6TMIEVWDOZW type=del size=453922 2024-08-27T02:38:11.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.035+0000 7f3e0cc408c0 1 < completed delete operation key=SG9T1RD5EATR tag=LOYQ6VLCSS0D type=del 2024-08-27T02:38:11.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.039+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~2Z9U5GZU2Y4R.0 size=1048576 2024-08-27T02:38:11.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.043+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~2Z9U5GZU2Y4R.1 size=1048576 2024-08-27T02:38:11.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.043+0000 7f3e0cc408c0 1 > prepared part key=_multipart_B9DPI871LQ7E.2~2Z9U5GZU2Y4R.2 size=392059 2024-08-27T02:38:11.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.043+0000 7f3e0cc408c0 1 > prepared multipart upload key=B9DPI871LQ7E upload=2Z9U5GZU2Y4R tag=BDOJB5VBMLKS type=write size=3537787 2024-08-27T02:38:11.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.047+0000 7f3e0cc408c0 1 < completed delete operation key=O66XJ7GJMPCU tag=YXIP116L414L type=del 2024-08-27T02:38:11.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.047+0000 7f3e0cc408c0 1 > prepared operation key=XBURHQSU6IML tag=SC2XZ1K4YW1I type=del size=1532828 2024-08-27T02:38:11.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.051+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~4LEQEE5K0Y6D.0 size=1048576 2024-08-27T02:38:11.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.055+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~4LEQEE5K0Y6D.1 size=1048576 2024-08-27T02:38:11.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.055+0000 7f3e0cc408c0 1 < completed part key=_multipart_MKB40KOOCCNT.2~4LEQEE5K0Y6D.2 size=7563 2024-08-27T02:38:11.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.059+0000 7f3e0cc408c0 1 < completed multipart upload key=MKB40KOOCCNT upload=4LEQEE5K0Y6D tag=BZBTJ0S42KVH type=write size=3153291 2024-08-27T02:38:11.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.063+0000 7f3e0cc408c0 1 > prepared operation key=HKDJMA7O2DFM tag=AXO1ZMDDM1PY type=del size=2108086 2024-08-27T02:38:11.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.063+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~2WIOT50QKDIW.0 size=1048576 2024-08-27T02:38:11.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.067+0000 7f3e0cc408c0 1 < completed part key=_multipart_0OLVDEQWBCAQ.2~2WIOT50QKDIW.1 size=609543 2024-08-27T02:38:11.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.071+0000 7f3e0cc408c0 1 < completed multipart upload key=0OLVDEQWBCAQ upload=2WIOT50QKDIW tag=O6UO9UNVUFMN type=write size=2706695 2024-08-27T02:38:11.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.079+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~NYEXZ4GUJIRG.0 size=1048576 2024-08-27T02:38:11.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.083+0000 7f3e0cc408c0 1 > prepared part key=_multipart_6YTZJKE4V5HQ.2~NYEXZ4GUJIRG.1 size=958278 2024-08-27T02:38:11.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.083+0000 7f3e0cc408c0 1 > prepared multipart upload key=6YTZJKE4V5HQ upload=NYEXZ4GUJIRG tag=JEIYGO27R8AC type=write size=3055430 2024-08-27T02:38:11.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.087+0000 7f3e0cc408c0 1 < completed delete operation key=0U59R3BXL181 tag=3IUYT6BA1NHN type=del 2024-08-27T02:38:11.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.087+0000 7f3e0cc408c0 1 > prepared operation key=JLAGXRZVF50G tag=2QT06B2Y8HH4 type=del size=3308223 2024-08-27T02:38:11.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.091+0000 7f3e0cc408c0 1 < completed part key=_multipart_2CXWPDABA9XJ.2~OBSX5FD8QFYA.0 size=736851 2024-08-27T02:38:11.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.095+0000 7f3e0cc408c0 1 < completed multipart upload key=2CXWPDABA9XJ upload=OBSX5FD8QFYA tag=YKAB0BPT2330 type=write size=1785427 2024-08-27T02:38:11.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~D2MRGVA6207Y.0 size=1048576 2024-08-27T02:38:11.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.103+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~D2MRGVA6207Y.1 size=1048576 2024-08-27T02:38:11.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.107+0000 7f3e0cc408c0 1 > prepared part key=_multipart_8VSA6T2H8FDI.2~D2MRGVA6207Y.2 size=295232 2024-08-27T02:38:11.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.107+0000 7f3e0cc408c0 1 > prepared multipart upload key=8VSA6T2H8FDI upload=D2MRGVA6207Y tag=1CKSBEM8NH1Z type=write size=3440960 2024-08-27T02:38:11.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.107+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~1AMWJNQZRYOP.0 size=1048576 2024-08-27T02:38:11.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.111+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~1AMWJNQZRYOP.1 size=1048576 2024-08-27T02:38:11.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.115+0000 7f3e0cc408c0 1 < completed part key=_multipart_JDV1RIGAO7J1.2~1AMWJNQZRYOP.2 size=35847 2024-08-27T02:38:11.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.119+0000 7f3e0cc408c0 1 < completed multipart upload key=JDV1RIGAO7J1 upload=1AMWJNQZRYOP tag=M7FRSCJJXWC6 type=write size=3181575 2024-08-27T02:38:11.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.123+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~YW3U85MXO7HF.0 size=1048576 2024-08-27T02:38:11.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~YW3U85MXO7HF.1 size=1048576 2024-08-27T02:38:11.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.127+0000 7f3e0cc408c0 1 > prepared part key=_multipart_OY551242R8T6.2~YW3U85MXO7HF.2 size=777129 2024-08-27T02:38:11.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.127+0000 7f3e0cc408c0 1 > prepared multipart upload key=OY551242R8T6 upload=YW3U85MXO7HF tag=SN6RUOE976TY type=write size=3922857 2024-08-27T02:38:11.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.131+0000 7f3e0cc408c0 1 < completed delete operation key=IISECLYEAR19 tag=357U7QGCHZBR type=del 2024-08-27T02:38:11.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:38:11.135+0000 7f3e0cc408c0 1 > prepared operation key=6YTZJKE4V5HQ tag=ZRQ9A6AA6LM0 type=write size=56302 2024-08-27T02:38:11.134 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] cls_rgw_stats.simulate (21878 ms) 2024-08-27T02:38:11.134 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 1 test from cls_rgw_stats (21878 ms total) 2024-08-27T02:38:11.134 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:38:11.134 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:38:11.308 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 1 test from 1 test suite ran. (23921 ms total) 2024-08-27T02:38:11.308 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 1 test. 2024-08-27T02:38:11.317 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:38:11.317 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:38:11.373 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-08-27T02:38:11.374 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-08-27T02:38:11.374 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-08-27T02:38:11.440 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:38:11.440 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 31 tests from 1 test suite. 2024-08-27T02:38:11.440 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:38:13.321 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 31 tests from CmpOmap 2024-08-27T02:38:13.321 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-08-27T02:38:13.362 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (41 ms) 2024-08-27T02:38:13.362 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-08-27T02:38:13.372 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (10 ms) 2024-08-27T02:38:13.372 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-08-27T02:38:13.379 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (7 ms) 2024-08-27T02:38:13.379 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-08-27T02:38:13.385 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (6 ms) 2024-08-27T02:38:13.385 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-08-27T02:38:13.400 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_str (16 ms) 2024-08-27T02:38:13.401 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-08-27T02:38:13.414 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_u64 (13 ms) 2024-08-27T02:38:13.414 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-08-27T02:38:13.423 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (9 ms) 2024-08-27T02:38:13.423 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-08-27T02:38:13.432 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (9 ms) 2024-08-27T02:38:13.432 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-08-27T02:38:13.441 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (10 ms) 2024-08-27T02:38:13.441 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-08-27T02:38:13.451 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (9 ms) 2024-08-27T02:38:13.451 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-08-27T02:38:13.453 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-08-27T02:38:13.453 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-08-27T02:38:13.455 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-08-27T02:38:13.455 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-08-27T02:38:13.472 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (17 ms) 2024-08-27T02:38:13.472 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-08-27T02:38:13.490 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (17 ms) 2024-08-27T02:38:13.490 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-08-27T02:38:13.506 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (16 ms) 2024-08-27T02:38:13.506 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-08-27T02:38:13.522 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (16 ms) 2024-08-27T02:38:13.522 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-08-27T02:38:13.542 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_str (20 ms) 2024-08-27T02:38:13.542 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-08-27T02:38:13.563 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-08-27T02:38:13.563 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-08-27T02:38:13.571 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (8 ms) 2024-08-27T02:38:13.571 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-08-27T02:38:13.577 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-08-27T02:38:13.577 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-08-27T02:38:13.580 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-08-27T02:38:13.580 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-08-27T02:38:13.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-08-27T02:38:13.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-08-27T02:38:13.599 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-08-27T02:38:13.599 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-08-27T02:38:13.616 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (17 ms) 2024-08-27T02:38:13.616 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-08-27T02:38:13.635 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (19 ms) 2024-08-27T02:38:13.635 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-08-27T02:38:13.656 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (21 ms) 2024-08-27T02:38:13.656 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-08-27T02:38:13.662 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-08-27T02:38:13.662 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-08-27T02:38:13.668 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-08-27T02:38:13.669 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-08-27T02:38:13.671 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-08-27T02:38:13.671 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-08-27T02:38:13.673 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-08-27T02:38:13.674 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-08-27T02:38:13.694 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (20 ms) 2024-08-27T02:38:13.694 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 31 tests from CmpOmap (373 ms total) 2024-08-27T02:38:13.694 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:38:13.694 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:38:14.341 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 31 tests from 1 test suite ran. (2901 ms total) 2024-08-27T02:38:14.341 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 31 tests. 2024-08-27T02:38:14.348 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:38:14.348 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:38:14.406 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-08-27T02:38:14.407 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-08-27T02:38:14.407 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-08-27T02:38:14.476 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:38:14.477 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-27T02:38:14.477 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:38:14.477 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from TestCls2PCQueue 2024-08-27T02:38:14.477 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-08-27T02:38:17.369 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2892 ms) 2024-08-27T02:38:17.370 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-08-27T02:38:20.401 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3029 ms) 2024-08-27T02:38:20.401 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-08-27T02:38:23.468 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.Reserve (3069 ms) 2024-08-27T02:38:23.469 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-08-27T02:38:26.522 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3055 ms) 2024-08-27T02:38:26.522 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-08-27T02:38:30.580 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.Commit (4058 ms) 2024-08-27T02:38:30.580 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-08-27T02:38:34.630 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.Stats (4051 ms) 2024-08-27T02:38:34.630 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-08-27T02:38:38.712 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4081 ms) 2024-08-27T02:38:38.712 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-08-27T02:38:41.777 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.Abort (3063 ms) 2024-08-27T02:38:41.777 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-08-27T02:38:44.832 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.ReserveError (3056 ms) 2024-08-27T02:38:44.832 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-08-27T02:38:47.876 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.CommitError (3045 ms) 2024-08-27T02:38:47.877 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-08-27T02:38:50.906 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.AbortError (3029 ms) 2024-08-27T02:38:50.906 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-08-27T02:38:53.976 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3070 ms) 2024-08-27T02:38:53.976 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-08-27T02:38:57.024 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3048 ms) 2024-08-27T02:38:57.024 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-08-27T02:39:00.056 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3033 ms) 2024-08-27T02:39:00.056 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-08-27T02:39:03.140 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3083 ms) 2024-08-27T02:39:03.140 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-08-27T02:39:06.149 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3009 ms) 2024-08-27T02:39:06.149 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-08-27T02:39:09.180 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3028 ms) 2024-08-27T02:39:09.180 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-08-27T02:39:12.185 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.Cleanup (3009 ms) 2024-08-27T02:39:12.185 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-08-27T02:39:24.262 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12077 ms) 2024-08-27T02:39:24.263 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-08-27T02:39:29.363 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5101 ms) 2024-08-27T02:39:29.363 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-08-27T02:39:43.440 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14077 ms) 2024-08-27T02:39:43.440 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-08-27T02:39:49.520 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6076 ms) 2024-08-27T02:39:49.520 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-08-27T02:39:59.533 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10017 ms) 2024-08-27T02:39:59.533 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-08-27T02:40:09.570 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10038 ms) 2024-08-27T02:40:09.571 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from TestCls2PCQueue (115095 ms total) 2024-08-27T02:40:09.571 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:40:09.571 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:40:09.571 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 24 tests from 1 test suite ran. (115096 ms total) 2024-08-27T02:40:09.571 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 24 tests. 2024-08-27T02:40:09.577 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:40:09.578 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:40:09.636 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-08-27T02:40:09.637 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-08-27T02:40:09.637 DEBUG:teuthology.orchestra.run.smithi143:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-08-27T02:40:09.715 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:40:09.715 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:40:09.715 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 4 tests from 1 test suite. 2024-08-27T02:40:09.715 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:40:11.599 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 4 tests from ClsAccount 2024-08-27T02:40:11.599 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsAccount.add 2024-08-27T02:40:11.640 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsAccount.add (41 ms) 2024-08-27T02:40:11.640 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsAccount.get 2024-08-27T02:40:11.650 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsAccount.get (10 ms) 2024-08-27T02:40:11.650 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsAccount.rm 2024-08-27T02:40:11.791 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsAccount.rm (141 ms) 2024-08-27T02:40:11.791 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] ClsAccount.list 2024-08-27T02:40:11.833 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] ClsAccount.list (41 ms) 2024-08-27T02:40:11.833 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 4 tests from ClsAccount (233 ms total) 2024-08-27T02:40:11.833 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:40:11.833 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:40:12.633 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 4 tests from 1 test suite ran. (2917 ms total) 2024-08-27T02:40:12.633 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 4 tests. 2024-08-27T02:40:12.637 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:40:12.638 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:40:12.693 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-08-27T02:40:12.694 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-08-27T02:40:12.694 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-08-27T02:40:12.773 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:40:12.773 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:40:12.773 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 6 tests from 1 test suite. 2024-08-27T02:40:12.773 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:40:14.652 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 6 tests from rgw_gc_log 2024-08-27T02:40:14.652 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-08-27T02:40:14.696 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] rgw_gc_log.init_existing_queue (45 ms) 2024-08-27T02:40:14.696 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-08-27T02:40:14.702 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2024-08-27T02:40:14.702 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-08-27T02:40:14.708 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-08-27T02:40:14.708 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-08-27T02:40:14.711 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-08-27T02:40:14.711 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-08-27T02:40:14.717 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-08-27T02:40:14.717 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-08-27T02:40:14.720 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-08-27T02:40:14.721 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 6 tests from rgw_gc_log (69 ms total) 2024-08-27T02:40:14.721 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:40:14.721 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:40:15.646 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 6 tests from 1 test suite ran. (2872 ms total) 2024-08-27T02:40:15.646 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 6 tests. 2024-08-27T02:40:15.651 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:40:15.651 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:40:15.709 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-08-27T02:40:15.710 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-08-27T02:40:15.710 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-08-27T02:40:15.781 INFO:tasks.workunit.client.0.smithi143.stdout:Running main() from gmock_main.cc 2024-08-27T02:40:15.781 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 4 tests from 1 test suite. 2024-08-27T02:40:15.781 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:40:15.781 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 4 tests from TestRGWObj 2024-08-27T02:40:15.781 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestRGWObj.underscore 2024-08-27T02:40:15.781 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns= i= 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns= i= 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns= i= 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.782 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.783 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.784 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.785 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.786 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.787 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns=ns i= 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns=ns i= 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns=ns i= 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.788 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.789 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.790 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.791 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.792 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.793 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns= i=v1 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns= i=v1 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns= i=v1 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.794 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.795 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.796 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.797 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.798 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.799 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns=ns i=v1 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns=ns i=v1 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: _obj[v1] 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: _obj ns=ns i=v1 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.800 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.801 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.802 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.803 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.804 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_obj", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.805 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestRGWObj.no_underscore 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns= i= 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns= i= 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns= i= 2024-08-27T02:40:15.806 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.807 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.808 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.809 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.810 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.811 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns=ns i= 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns=ns i= 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns=ns i= 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.812 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.813 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.814 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.815 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.816 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.817 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns= i=v1 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns= i=v1 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns= i=v1 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.818 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.819 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.820 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.821 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.822 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.823 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns=ns i=v1 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns=ns i=v1 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:parsed: obj[v1] 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:stripped: obj ns=ns i=v1 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.824 INFO:tasks.workunit.client.0.smithi143.stdout: "obj1": { 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.825 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "obj2": { 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.826 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3": { 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.827 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "obj3-2": { 2024-08-27T02:40:15.828 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.829 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "obj", 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "v1", 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.830 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.831 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.832 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker_myobj", 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.833 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.834 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.835 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.836 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.837 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker_myobj", 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.838 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.839 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.840 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.841 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns_myobj", 2024-08-27T02:40:15.842 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.843 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.844 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.845 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.846 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns_myobj", 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.847 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.848 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.849 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.850 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.851 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst_myobj", 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.852 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.853 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.854 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.855 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.856 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst_myobj", 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.857 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.858 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.859 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.860 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.861 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.861 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.861 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.861 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.861 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst_myobj", 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.862 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.863 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.864 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.865 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.866 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.867 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst_myobj", 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.868 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.869 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.870 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.871 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.872 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj", 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.873 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.874 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.875 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.876 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.877 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj", 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.878 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.879 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.880 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.881 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.882 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj", 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.883 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.884 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.885 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.886 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.887 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj", 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.888 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.889 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.890 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.891 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.892 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj", 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.893 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.894 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.895 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.896 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.897 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj", 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.898 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.899 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.900 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.901 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.902 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.903 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj", 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.904 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.905 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.906 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.907 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.907 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.907 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.910 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.910 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.910 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.911 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj", 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.912 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.913 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.914 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.915 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.916 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj_", 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.917 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.918 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.919 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.920 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.921 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj_", 2024-08-27T02:40:15.922 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.923 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.924 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.925 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.926 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.927 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj_", 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.928 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.929 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.930 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.931 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.932 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj_", 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.933 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.934 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.935 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.936 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.937 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.938 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj_", 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.939 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.940 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.941 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.942 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.943 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj_", 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.944 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.945 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.946 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.947 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.948 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": "default-placement.data", 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-27T02:40:15.949 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "test", 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.950 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": "", 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": "" 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.951 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.952 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "obj": { 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.953 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.954 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.955 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.956 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker_myobj", 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.957 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.958 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker_myobj 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker_myobj", 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.959 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.960 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker_myobj 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.961 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns_myobj", 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.962 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.963 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__ns_myobj 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns_myobj", 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.964 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.965 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__ns_myobj 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst_myobj", 2024-08-27T02:40:15.966 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.967 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.968 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__:inst_myobj 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst_myobj", 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.969 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.970 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__:inst_myobj 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst_myobj", 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.971 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.972 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.973 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst_myobj", 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.974 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "myobj", 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.975 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj", 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.976 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.977 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker___myobj 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj", 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.978 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.979 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker___myobj 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.980 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj", 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.981 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.982 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__ns__myobj 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj", 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.983 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.984 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__ns__myobj 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.985 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj", 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.986 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.987 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__:inst__myobj 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj", 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj" 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.988 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.989 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__:inst__myobj 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj", 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.990 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.991 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-08-27T02:40:15.992 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj", 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.993 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj", 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:15.994 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj_", 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.995 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.996 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker___myobj_ 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:15.997 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker___myobj_", 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:15.998 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:15.999 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker___myobj_ 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj_", 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.000 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:16.001 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__ns__myobj_ 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:16.002 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns__myobj_", 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:16.003 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "", 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.004 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj_", 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:16.005 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:16.006 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:16.007 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__:inst__myobj_", 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "marker__myobj_" 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:16.008 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "" 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.009 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj": { 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj": { 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:16.010 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:16.011 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout: "raw_obj2": { 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout: "pool": ".data-pool", 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout: "oid": "marker__ns:inst__myobj_", 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout: "loc": "" 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.012 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "new_obj2": { 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket": { 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "ebtest", 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "marker": "marker", 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_id": "bucket-id", 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "tenant": "", 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "explicit_placement": { 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "data_pool": ".data-pool", 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "data_extra_pool": "", 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "index_pool": ".index-pool" 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:16.013 INFO:tasks.workunit.client.0.smithi143.stdout: "key": { 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout: "name": "_myobj_", 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout: "instance": "inst", 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout: "ns": "ns" 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:40:16.014 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-08-27T02:40:16.015 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 4 tests. 2024-08-27T02:40:16.015 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:40:16.015 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:40:16.029 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-08-27T02:40:16.030 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-08-27T02:40:16.031 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-08-27T02:40:16.504 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:40:16.504 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:40:16.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:16.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:16.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 realm 2024-08-27T02:40:16.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:16.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:16.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:40:16.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:16.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:16.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.577+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:16.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.581+0000 7f4a277f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:40:16.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.581+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:16.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.581+0000 7f4a277f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:40:16.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.581+0000 7f4a277f79c0 20 searching for the correct realm 2024-08-27T02:40:16.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.593+0000 7f4a252fd640 0 -- 172.21.15.143:0/1145124641 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f4a18067040 msgr2=0x7f4a1805f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:40:16.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:16.797+0000 7f4a252fd640 0 -- 172.21.15.143:0/1145124641 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f48f007e700 msgr2=0x7f48f0080b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:40:17.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:17.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.217+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:40:17.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 zone default found 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 4 Realm: () 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 zonegroup default 2024-08-27T02:40:17.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:17.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:17.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.221+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.225+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:17.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.225+0000 7f4a277f79c0 20 started sync module instance, tier type = 2024-08-27T02:40:17.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.225+0000 7f4a277f79c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:40:17.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=0 2024-08-27T02:40:17.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=1 2024-08-27T02:40:17.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=2 2024-08-27T02:40:17.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=3 2024-08-27T02:40:17.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=4 2024-08-27T02:40:17.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=5 2024-08-27T02:40:17.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=6 2024-08-27T02:40:17.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 20 add_watcher() i=7 2024-08-27T02:40:17.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.249+0000 7f4a277f79c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:40:17.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.253+0000 7f48dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 5 note: GC not initialized 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f48dafe5640 20 reqs_thread_entry: start 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 init_complete bucket index max shards: 11 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 Filter name: none 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f48d8fe1640 20 reqs_thread_entry: start 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-08-27T02:40:17.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:17.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 cache get: name=default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= : miss 2024-08-27T02:40:17.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:40:17.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:40:17.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 cache put: name=default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= info.flags=0x0 2024-08-27T02:40:17.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 adding default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= to cache LRU end 2024-08-27T02:40:17.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.257+0000 7f4a277f79c0 10 cache get: name=default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= : hit (negative entry) 2024-08-27T02:40:17.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.261+0000 7f4a277f79c0 10 cache get: name=default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= : hit (negative entry) 2024-08-27T02:40:17.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.261+0000 7f4a277f79c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-08-27T02:40:17.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.261+0000 7f4a277f79c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-08-27T02:40:17.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.261+0000 7f4a277f79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-08-27T02:40:17.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.265+0000 7f4908ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94518571021088 notifier 5342 bl.length()=697 2024-08-27T02:40:17.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.265+0000 7f4908ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-08-27T02:40:17.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.265+0000 7f4908ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-08-27T02:40:17.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.269+0000 7f4a277f79c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-08-27T02:40:17.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.269+0000 7f4a277f79c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-08-27T02:40:17.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.269+0000 7f4a277f79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-08-27T02:40:17.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.269+0000 7f4908ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725888 cookie 94518571017040 notifier 5342 bl.length()=194 2024-08-27T02:40:17.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.269+0000 7f4908ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-08-27T02:40:17.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.269+0000 7f4908ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-08-27T02:40:17.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.273+0000 7f4a277f79c0 10 cache put: name=default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= info.flags=0x7 2024-08-27T02:40:17.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.273+0000 7f4a277f79c0 10 moving default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= to cache LRU end 2024-08-27T02:40:17.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.273+0000 7f4a277f79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:T8f9a3nZpmqrcBgqE9ORpMh3bNA=, ofs0, ns] 2024-08-27T02:40:17.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.277+0000 7f48f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94518571017040 notifier 5342 bl.length()=203 2024-08-27T02:40:17.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.277+0000 7f48f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= info.flags=0x7 2024-08-27T02:40:17.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.277+0000 7f48f7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+T8f9a3nZpmqrcBgqE9ORpMh3bNA= to cache LRU end 2024-08-27T02:40:17.279 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:40:17.279 INFO:tasks.workunit.client.0.smithi143.stdout: "user_id": "ceph-test-librgw-file", 2024-08-27T02:40:17.279 INFO:tasks.workunit.client.0.smithi143.stdout: "display_name": "librgw test user", 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "email": "librgw@example.com", 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "suspended": 0, 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "max_buckets": 1000, 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "subusers": [], 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "keys": [ 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: { 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "user": "ceph-test-librgw-file", 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "access_key": "T8f9a3nZpmqrcBgqE9ORpMh3bNA=", 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "secret_key": "4yMbr7PoXOa2qtBxiQnVOI4KR8FFnij2TEsJsx7Q0nhUDMgry6eOdw==", 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "active": true, 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "create_date": "2024-08-27T02:40:17.264284Z" 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: ], 2024-08-27T02:40:17.280 INFO:tasks.workunit.client.0.smithi143.stdout: "swift_keys": [], 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "caps": [], 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "default_placement": "", 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "default_storage_class": "", 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "placement_tags": [], 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_quota": { 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "enabled": false, 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size": -1, 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "max_objects": -1 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "user_quota": { 2024-08-27T02:40:17.281 INFO:tasks.workunit.client.0.smithi143.stdout: "enabled": false, 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size": -1, 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "max_objects": -1 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "temp_url_keys": [], 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "type": "rgw", 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "mfa_ids": [], 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "account_id": "", 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "path": "/", 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "create_date": "2024-08-27T02:40:17.264239Z", 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "tags": [], 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout: "group_ids": [] 2024-08-27T02:40:17.282 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:40:17.283 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:40:17.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.277+0000 7f48dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:40:17.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.285+0000 7f4a277f79c0 20 remove_watcher() i=0 2024-08-27T02:40:17.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.285+0000 7f4a277f79c0 2 removed watcher, disabling cache 2024-08-27T02:40:17.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.285+0000 7f4a277f79c0 20 remove_watcher() i=1 2024-08-27T02:40:17.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.289+0000 7f4a277f79c0 20 remove_watcher() i=2 2024-08-27T02:40:17.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.289+0000 7f4a277f79c0 20 remove_watcher() i=3 2024-08-27T02:40:17.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.293+0000 7f4a277f79c0 20 remove_watcher() i=4 2024-08-27T02:40:17.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.293+0000 7f4a277f79c0 20 remove_watcher() i=5 2024-08-27T02:40:17.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.297+0000 7f4a277f79c0 20 remove_watcher() i=6 2024-08-27T02:40:17.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:17.297+0000 7f4a277f79c0 20 remove_watcher() i=7 2024-08-27T02:40:17.314 INFO:tasks.workunit.client.0.smithi143.stdout:phase 1.1 2024-08-27T02:40:17.335 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-27T02:40:17.335 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:40:17.336 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from LibRGW 2024-08-27T02:40:17.336 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:40:17.348 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:40:17.348 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:40:17.632 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (296 ms) 2024-08-27T02:40:17.632 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-08-27T02:40:17.634 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-08-27T02:40:17.635 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:40:17.635 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-08-27T02:40:17.635 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-08-27T02:40:17.654 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/quux 2024-08-27T02:40:17.662 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/f1 2024-08-27T02:40:17.668 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/f2 2024-08-27T02:40:17.676 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/f1 2024-08-27T02:40:17.681 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/d1/ 2024-08-27T02:40:17.687 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-08-27T02:40:17.693 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-08-27T02:40:17.702 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/momma 2024-08-27T02:40:17.706 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-08-27T02:40:17.712 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-08-27T02:40:17.716 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-08-27T02:40:17.722 INFO:tasks.workunit.client.0.smithi143.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-08-27T02:40:17.729 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETUP_HIER1 (95 ms) 2024-08-27T02:40:17.729 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-08-27T02:40:18.014 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETUP_DIRS1 (284 ms) 2024-08-27T02:40:18.014 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETATTR 2024-08-27T02:40:18.014 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-08-27T02:40:18.014 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-08-27T02:40:18.060 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (47 ms) 2024-08-27T02:40:18.060 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-08-27T02:40:18.179 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (118 ms) 2024-08-27T02:40:18.179 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-08-27T02:40:18.179 INFO:tasks.workunit.client.0.smithi143.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-08-27T02:40:18.197 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (19 ms) 2024-08-27T02:40:18.197 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-08-27T02:40:18.197 INFO:tasks.workunit.client.0.smithi143.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-08-27T02:40:18.214 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (17 ms) 2024-08-27T02:40:18.214 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-08-27T02:40:18.214 INFO:tasks.workunit.client.0.smithi143.stdout:scanning objects in /bdirs1/dir_0 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout:scanning objects in /bdirs1/dir_1 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout:scanning objects in /bdirs1/dir_2 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-27T02:40:18.215 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-27T02:40:18.216 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-27T02:40:18.216 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-08-27T02:40:18.216 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-08-27T02:40:18.216 INFO:tasks.workunit.client.0.smithi143.stdout:read back objects in /bdirs1/dir_0 2024-08-27T02:40:18.216 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_0/sfile_0 2024-08-27T02:40:18.219 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-27T02:40:18.219 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_0/sfile_1 2024-08-27T02:40:18.223 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-27T02:40:18.223 INFO:tasks.workunit.client.0.smithi143.stdout:read back objects in /bdirs1/dir_1 2024-08-27T02:40:18.223 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_1/sfile_0 2024-08-27T02:40:18.227 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-27T02:40:18.227 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_1/sfile_1 2024-08-27T02:40:18.232 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-27T02:40:18.232 INFO:tasks.workunit.client.0.smithi143.stdout:read back objects in /bdirs1/dir_2 2024-08-27T02:40:18.232 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_2/sfile_0 2024-08-27T02:40:18.236 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-27T02:40:18.236 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_2/sfile_1 2024-08-27T02:40:18.239 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-27T02:40:18.239 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READ_DIRS1 (25 ms) 2024-08-27T02:40:18.239 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READF_SETUP1 (225 ms) 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_0 type: DIR refs: 2 2024-08-27T02:40:18.465 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_0 type: FILE refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_1 type: DIR refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_1 type: FILE refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_0 type: DIR refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_0 type: FILE refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_1 type: DIR refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_1 type: FILE refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_0 type: DIR refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_0 type: FILE refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_1 type: DIR refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_1 type: FILE refs: 2 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (1 ms) 2024-08-27T02:40:18.466 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.HIER1 2024-08-27T02:40:18.481 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/f2 (f2): FILE 2024-08-27T02:40:18.482 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/f1 (f1): FILE 2024-08-27T02:40:18.488 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-08-27T02:40:18.491 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-08-27T02:40:18.498 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-27T02:40:18.499 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-27T02:40:18.500 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-08-27T02:40:18.500 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-08-27T02:40:18.502 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-27T02:40:18.502 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-27T02:40:18.504 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-08-27T02:40:18.507 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar (bar): DIR 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo (foo): DIR 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot (nfsroot): DIR 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.HIER1 (42 ms) 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-27T02:40:18.508 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:40:18.509 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:40:18.509 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:40:18.509 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:40:18.509 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:40:18.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:18.509+0000 7fe6a9969a80 -1 shutting down 2024-08-27T02:40:18.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:18.509+0000 7fe5836bb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55496, si_uid : 1000, si_addr0x3e80000d8c8, si_status0 2024-08-27T02:40:47.993 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (29486 ms) 2024-08-27T02:40:47.993 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from LibRGW (30658 ms total) 2024-08-27T02:40:47.994 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:40:47.994 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:40:47.994 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 24 tests from 1 test suite ran. (30658 ms total) 2024-08-27T02:40:47.994 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 24 tests. 2024-08-27T02:40:48.008 INFO:tasks.workunit.client.0.smithi143.stdout:phase 1.2 2024-08-27T02:40:48.033 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-27T02:40:48.033 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:40:48.033 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from LibRGW 2024-08-27T02:40:48.033 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:40:48.043 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:40:48.043 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:40:48.351 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (318 ms) 2024-08-27T02:40:48.351 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-08-27T02:40:48.353 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-08-27T02:40:48.353 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETATTR 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-08-27T02:40:48.354 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-08-27T02:40:48.355 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.HIER1 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:40:48.356 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:40:48.357 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:40:48.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:48.352+0000 7f83e61d6a80 -1 shutting down 2024-08-27T02:40:48.357 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:40:48.356+0000 7f82bff28640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56142, si_uid : 1000, si_addr0x3e80000db4e, si_status0 2024-08-27T02:41:18.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (30230 ms) 2024-08-27T02:41:18.583 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from LibRGW (30550 ms total) 2024-08-27T02:41:18.583 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:41:18.583 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:41:18.583 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 24 tests from 1 test suite ran. (30550 ms total) 2024-08-27T02:41:18.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 24 tests. 2024-08-27T02:41:18.596 INFO:tasks.workunit.client.0.smithi143.stdout:phase 1.3 2024-08-27T02:41:18.619 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 24 tests from 1 test suite. 2024-08-27T02:41:18.619 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:41:18.619 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from LibRGW 2024-08-27T02:41:18.619 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:41:18.632 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:41:18.633 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:41:18.929 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (309 ms) 2024-08-27T02:41:18.929 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-08-27T02:41:18.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-08-27T02:41:18.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:41:18.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-08-27T02:41:18.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-08-27T02:41:18.941 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETUP_HIER1 (10 ms) 2024-08-27T02:41:18.941 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-08-27T02:41:19.078 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETUP_DIRS1 (137 ms) 2024-08-27T02:41:19.078 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SETATTR 2024-08-27T02:41:19.078 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-08-27T02:41:19.078 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout:scanning objects in /bdirs1/dir_0 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-27T02:41:19.079 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout:scanning objects in /bdirs1/dir_1 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout:scanning objects in /bdirs1/dir_2 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout:read back objects in /bdirs1/dir_0 2024-08-27T02:41:19.080 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_0/sfile_0 2024-08-27T02:41:19.082 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-27T02:41:19.082 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_0/sfile_1 2024-08-27T02:41:19.084 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-27T02:41:19.084 INFO:tasks.workunit.client.0.smithi143.stdout:read back objects in /bdirs1/dir_1 2024-08-27T02:41:19.084 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_1/sfile_0 2024-08-27T02:41:19.086 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-27T02:41:19.086 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_1/sfile_1 2024-08-27T02:41:19.089 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-27T02:41:19.089 INFO:tasks.workunit.client.0.smithi143.stdout:read back objects in /bdirs1/dir_2 2024-08-27T02:41:19.089 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_2/sfile_0 2024-08-27T02:41:19.091 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_0 : "data for sfile_0" 2024-08-27T02:41:19.091 INFO:tasks.workunit.client.0.smithi143.stdout:reading 0,256 dir_2/sfile_1 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout: read back from sfile_1 : "data for sfile_1" 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READ_DIRS1 (15 ms) 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_0 type: DIR refs: 2 2024-08-27T02:41:19.093 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_0 type: FILE refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_1 type: DIR refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_1 type: FILE refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_0 type: DIR refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_0 type: FILE refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_1 type: DIR refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_1 type: FILE refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_0 type: DIR refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_0 type: FILE refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sdir_1 type: DIR refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:release sfile_1 type: FILE refs: 2 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-08-27T02:41:19.094 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.HIER1 2024-08-27T02:41:19.110 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/f2 (f2): FILE 2024-08-27T02:41:19.111 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/f1 (f1): FILE 2024-08-27T02:41:19.117 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-08-27T02:41:19.120 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-08-27T02:41:19.127 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-27T02:41:19.129 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-08-27T02:41:19.130 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-08-27T02:41:19.131 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-08-27T02:41:19.132 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-27T02:41:19.133 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-08-27T02:41:19.134 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-08-27T02:41:19.139 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-08-27T02:41:19.140 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-08-27T02:41:19.140 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo/bar (bar): DIR 2024-08-27T02:41:19.140 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot/foo (foo): DIR 2024-08-27T02:41:19.140 INFO:tasks.workunit.client.0.smithi143.stdout:/nfsroot (nfsroot): DIR 2024-08-27T02:41:19.140 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.HIER1 (46 ms) 2024-08-27T02:41:19.140 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-27T02:41:19.141 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-08-27T02:41:19.141 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-27T02:41:19.141 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-27T02:41:19.141 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-27T02:41:19.142 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-27T02:41:19.142 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-27T02:41:19.142 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-27T02:41:19.142 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:41:19.142 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:41:19.142 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:41:19.143 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:41:19.143 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:41:19.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:41:19.144+0000 7f7333801a80 -1 shutting down 2024-08-27T02:41:19.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:41:19.144+0000 7f720d553640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56788, si_uid : 1000, si_addr0x3e80000ddd4, si_status0 2024-08-27T02:41:49.251 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (30112 ms) 2024-08-27T02:41:49.251 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 24 tests from LibRGW (30631 ms total) 2024-08-27T02:41:49.251 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:41:49.251 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:41:49.251 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 24 tests from 1 test suite ran. (30631 ms total) 2024-08-27T02:41:49.251 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 24 tests. 2024-08-27T02:41:49.265 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2.1 2024-08-27T02:41:49.288 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 9 tests from 1 test suite. 2024-08-27T02:41:49.288 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:41:49.288 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 9 tests from LibRGW 2024-08-27T02:41:49.288 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:41:49.299 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:41:49.299 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:41:49.604 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (316 ms) 2024-08-27T02:41:49.604 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:41:49.606 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-27T02:41:49.606 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-27T02:41:49.624 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET (18 ms) 2024-08-27T02:41:49.624 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-27T02:41:49.624 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-08-27T02:41:49.624 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-08-27T02:41:49.642 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave0 2024-08-27T02:41:49.660 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave1 2024-08-27T02:41:49.679 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave2 2024-08-27T02:41:49.699 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave3 2024-08-27T02:41:49.719 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave4 2024-08-27T02:41:49.737 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave5 2024-08-27T02:41:49.755 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave6 2024-08-27T02:41:49.773 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave7 2024-08-27T02:41:49.800 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave8 2024-08-27T02:41:49.819 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave9 2024-08-27T02:41:49.819 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (195 ms) 2024-08-27T02:41:49.819 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-08-27T02:41:50.524 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (705 ms) 2024-08-27T02:41:50.525 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:41:50.525 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:41:50.525 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:41:50.525 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:41:50.525 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:41:50.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:41:50.527+0000 7f4407d09a80 -1 shutting down 2024-08-27T02:41:50.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:41:50.531+0000 7f42e1a5b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57433, si_uid : 1000, si_addr0x3e80000e059, si_status0 2024-08-27T02:42:19.791 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (29263 ms) 2024-08-27T02:42:19.791 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 9 tests from LibRGW (30499 ms total) 2024-08-27T02:42:19.791 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:42:19.791 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:42:19.791 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 9 tests from 1 test suite ran. (30499 ms total) 2024-08-27T02:42:19.792 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 9 tests. 2024-08-27T02:42:19.801 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2.2 2024-08-27T02:42:19.824 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 9 tests from 1 test suite. 2024-08-27T02:42:19.824 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:42:19.824 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 9 tests from LibRGW 2024-08-27T02:42:19.824 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:42:19.835 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:42:19.835 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:42:20.394 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (571 ms) 2024-08-27T02:42:20.395 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:42:20.396 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-27T02:42:20.397 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-27T02:42:20.397 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-08-27T02:42:20.397 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-27T02:42:20.453 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET (57 ms) 2024-08-27T02:42:20.453 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-08-27T02:42:20.471 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave0 2024-08-27T02:42:20.493 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave1 2024-08-27T02:42:20.515 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave2 2024-08-27T02:42:20.536 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave3 2024-08-27T02:42:20.558 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave4 2024-08-27T02:42:20.578 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave5 2024-08-27T02:42:20.603 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave6 2024-08-27T02:42:20.628 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave7 2024-08-27T02:42:20.653 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave8 2024-08-27T02:42:20.680 INFO:tasks.workunit.client.0.smithi143.stdout:created: sorrydave9 2024-08-27T02:42:20.680 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (226 ms) 2024-08-27T02:42:20.680 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-08-27T02:42:21.468 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (789 ms) 2024-08-27T02:42:21.469 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:42:21.469 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:42:21.469 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:42:21.469 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:42:21.469 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:42:21.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:42:21.471+0000 7fe8f2bcaa80 -1 shutting down 2024-08-27T02:42:21.471 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:42:21.475+0000 7fe7cc91c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58079, si_uid : 1000, si_addr0x3e80000e2df, si_status0 2024-08-27T02:42:50.553 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (29084 ms) 2024-08-27T02:42:50.554 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 9 tests from LibRGW (30729 ms total) 2024-08-27T02:42:50.554 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:42:50.554 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:42:50.554 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 9 tests from 1 test suite ran. (30729 ms total) 2024-08-27T02:42:50.554 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 9 tests. 2024-08-27T02:42:50.568 INFO:tasks.workunit.client.0.smithi143.stdout:phase 3.1 2024-08-27T02:42:50.909 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 13 tests from 1 test suite. 2024-08-27T02:42:50.909 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:42:50.909 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 13 tests from LibRGW 2024-08-27T02:42:50.909 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:42:50.919 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:42:50.919 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:42:51.477 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (567 ms) 2024-08-27T02:42:51.477 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:42:51.478 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-27T02:42:51.479 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-27T02:42:51.497 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-08-27T02:42:51.498 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-27T02:42:51.503 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-08-27T02:42:51.503 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-27T02:42:51.506 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-08-27T02:42:51.506 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LARGE1 2024-08-27T02:42:52.024 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LARGE1 (518 ms) 2024-08-27T02:42:52.024 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LARGE2 2024-08-27T02:42:52.106 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LARGE2 (82 ms) 2024-08-27T02:42:52.106 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-27T02:42:52.106 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-27T02:42:52.106 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:42:52.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:42:52.111+0000 7f09912d0a80 -1 shutting down 2024-08-27T02:42:52.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:42:52.115+0000 7f086b022640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58724, si_uid : 1000, si_addr0x3e80000e564, si_status0 2024-08-27T02:43:21.578 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (29471 ms) 2024-08-27T02:43:21.578 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 13 tests from LibRGW (30668 ms total) 2024-08-27T02:43:21.578 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:43:21.578 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:43:21.579 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 13 tests from 1 test suite ran. (30668 ms total) 2024-08-27T02:43:21.579 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 13 tests. 2024-08-27T02:43:21.596 INFO:tasks.workunit.client.0.smithi143.stdout:phase 3.2 2024-08-27T02:43:21.939 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 13 tests from 1 test suite. 2024-08-27T02:43:21.939 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:43:21.939 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 13 tests from LibRGW 2024-08-27T02:43:21.939 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:43:21.948 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:43:21.948 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:43:22.748 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (809 ms) 2024-08-27T02:43:22.749 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:43:22.751 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-08-27T02:43:22.751 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-27T02:43:22.751 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-08-27T02:43:22.751 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-27T02:43:22.759 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-08-27T02:43:22.760 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-27T02:43:22.767 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (8 ms) 2024-08-27T02:43:22.767 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LARGE1 2024-08-27T02:43:22.848 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LARGE1 (80 ms) 2024-08-27T02:43:22.848 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LARGE2 2024-08-27T02:43:22.848 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-08-27T02:43:22.848 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-27T02:43:22.848 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-27T02:43:22.848 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-27T02:43:22.859 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_OBJECT (12 ms) 2024-08-27T02:43:22.859 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-27T02:43:22.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET (71 ms) 2024-08-27T02:43:22.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:43:22.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:43:22.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:43:22.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:43:22.931 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:43:22.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:43:22.934+0000 7f12e81fda80 -1 shutting down 2024-08-27T02:43:22.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:43:22.938+0000 7f11c1f4f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59369, si_uid : 1000, si_addr0x3e80000e7e9, si_status0 2024-08-27T02:43:53.050 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (30119 ms) 2024-08-27T02:43:53.050 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 13 tests from LibRGW (31111 ms total) 2024-08-27T02:43:53.050 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:43:53.050 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:43:53.050 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 13 tests from 1 test suite ran. (31111 ms total) 2024-08-27T02:43:53.050 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 13 tests. 2024-08-27T02:43:53.067 INFO:tasks.workunit.client.0.smithi143.stdout:phase 4.1 2024-08-27T02:43:53.090 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 11 tests from 1 test suite. 2024-08-27T02:43:53.090 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:43:53.090 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 11 tests from LibRGW 2024-08-27T02:43:53.090 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.TVAR 2024-08-27T02:43:53.090 INFO:tasks.workunit.client.0.smithi143.stdout:read i1: 64001 2024-08-27T02:43:53.090 INFO:tasks.workunit.client.0.smithi143.stdout:read s1: blunderbuss 2024-08-27T02:43:53.090 INFO:tasks.workunit.client.0.smithi143.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-08-27T02:43:53.091 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:43:53.104 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:43:53.104 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:43:53.682 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (591 ms) 2024-08-27T02:43:53.682 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:43:53.684 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-08-27T02:43:53.684 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-27T02:43:53.722 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (37 ms) 2024-08-27T02:43:53.723 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-27T02:43:55.066 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_0 2024-08-27T02:43:55.066 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_1 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_2 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_3 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_4 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_5 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_6 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_7 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_8 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_9 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_10 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_11 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_12 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_13 2024-08-27T02:43:55.067 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_14 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_15 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_16 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_17 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_18 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_19 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_20 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_21 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_22 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_23 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_24 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_25 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_26 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_27 2024-08-27T02:43:55.068 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_28 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_29 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_30 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_31 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_32 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_33 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_34 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_35 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_36 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_37 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_38 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_39 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_40 2024-08-27T02:43:55.069 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_41 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_42 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_43 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_44 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_45 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_46 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_47 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_48 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_49 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_50 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_51 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_52 2024-08-27T02:43:55.070 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_53 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_54 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_55 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_56 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_57 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_58 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_59 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_60 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_61 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_62 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_63 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_64 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_65 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_66 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_67 2024-08-27T02:43:55.071 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_68 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_69 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_70 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_71 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_72 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_73 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_74 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_75 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_76 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_77 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_78 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_79 2024-08-27T02:43:55.072 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_80 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_81 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_82 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_83 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_84 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_85 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_86 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_87 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_88 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_89 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_90 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_91 2024-08-27T02:43:55.073 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_92 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_93 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_94 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_95 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_96 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_97 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_98 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:created: dmarker:f_99 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1345 ms) 2024-08-27T02:43:55.074 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-08-27T02:43:55.075 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-08-27T02:43:55.076 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-08-27T02:43:55.077 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-08-27T02:43:55.078 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-08-27T02:43:55.079 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-08-27T02:43:55.080 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-08-27T02:43:55.081 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-08-27T02:43:55.082 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-08-27T02:43:55.083 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-08-27T02:43:55.083 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-08-27T02:43:55.083 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-08-27T02:43:55.083 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_READDIR (6 ms) 2024-08-27T02:43:55.083 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-08-27T02:43:55.084 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-08-27T02:43:55.085 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-08-27T02:43:55.086 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-08-27T02:43:55.087 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-08-27T02:43:55.088 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-08-27T02:43:55.089 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-08-27T02:43:55.090 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-27T02:43:55.091 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-27T02:43:55.092 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:43:55.092 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:43:55.092 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:43:55.092 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-08-27T02:43:55.092 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:43:55.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:43:55.082+0000 7f69a1318a80 -1 shutting down 2024-08-27T02:43:55.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:43:55.086+0000 7f687b06a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60014, si_uid : 1000, si_addr0x3e80000ea6e, si_status0 2024-08-27T02:44:23.813 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (28733 ms) 2024-08-27T02:44:23.813 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 11 tests from LibRGW (30722 ms total) 2024-08-27T02:44:23.813 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:44:23.813 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:44:23.813 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 11 tests from 1 test suite ran. (30722 ms total) 2024-08-27T02:44:23.813 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 11 tests. 2024-08-27T02:44:23.824 INFO:tasks.workunit.client.0.smithi143.stdout:phase 4.2 2024-08-27T02:44:23.847 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 11 tests from 1 test suite. 2024-08-27T02:44:23.847 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:44:23.847 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 11 tests from LibRGW 2024-08-27T02:44:23.847 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.TVAR 2024-08-27T02:44:23.848 INFO:tasks.workunit.client.0.smithi143.stdout:read i1: 64001 2024-08-27T02:44:23.848 INFO:tasks.workunit.client.0.smithi143.stdout:read s1: blunderbuss 2024-08-27T02:44:23.848 INFO:tasks.workunit.client.0.smithi143.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-08-27T02:44:23.848 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:44:23.856 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:44:23.857 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:44:25.235 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (1389 ms) 2024-08-27T02:44:25.235 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:44:25.236 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-08-27T02:44:25.237 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-08-27T02:44:25.253 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-08-27T02:44:25.253 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-08-27T02:44:25.254 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-08-27T02:44:25.254 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-08-27T02:44:25.254 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-08-27T02:44:25.254 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-08-27T02:44:25.258 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-08-27T02:44:25.258 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-08-27T02:44:25.259 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-08-27T02:44:25.260 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-08-27T02:44:25.261 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-08-27T02:44:25.262 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-08-27T02:44:25.263 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-08-27T02:44:25.264 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-08-27T02:44:25.265 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:44:25.266 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:44:25.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:44:25.261+0000 7fdd89e10a80 -1 shutting down 2024-08-27T02:44:25.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:44:25.265+0000 7fdc63b62640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60659, si_uid : 1000, si_addr0x3e80000ecf3, si_status0 2024-08-27T02:44:55.520 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (30262 ms) 2024-08-27T02:44:55.521 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 11 tests from LibRGW (31674 ms total) 2024-08-27T02:44:55.521 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:44:55.521 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:44:55.521 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 11 tests from 1 test suite ran. (31674 ms total) 2024-08-27T02:44:55.522 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 11 tests. 2024-08-27T02:44:55.534 INFO:tasks.workunit.client.0.smithi143.stdout:phase 5.1 2024-08-27T02:44:55.568 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 19 tests from 1 test suite. 2024-08-27T02:44:55.568 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:44:55.568 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 19 tests from LibRGW 2024-08-27T02:44:55.569 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:44:55.580 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:44:55.580 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:44:55.891 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (322 ms) 2024-08-27T02:44:55.891 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:44:55.892 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-27T02:44:55.892 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-27T02:44:55.910 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET (18 ms) 2024-08-27T02:44:55.910 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-27T02:44:55.916 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-08-27T02:44:55.916 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-08-27T02:44:55.916 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-08-27T02:44:55.916 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-27T02:44:55.919 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-08-27T02:44:55.919 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-08-27T02:44:55.919 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-08-27T02:44:55.920 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-08-27T02:44:55.929 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.PUT_OBJECT (10 ms) 2024-08-27T02:44:55.929 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-08-27T02:44:55.933 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-08-27T02:44:55.933 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-27T02:44:55.933 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-27T02:44:55.933 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-08-27T02:44:55.933 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.WRITEV 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READV 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READV (0 ms) 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-27T02:44:55.934 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-08-27T02:44:55.935 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:44:55.935 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:44:55.936 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:44:55.936 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:44:55.936 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:44:55.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:44:55.936+0000 7f30cc354a80 -1 shutting down 2024-08-27T02:44:55.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:44:55.936+0000 7f2fa60a6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61304, si_uid : 1000, si_addr0x3e80000ef78, si_status0 2024-08-27T02:45:26.184 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (30250 ms) 2024-08-27T02:45:26.185 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 19 tests from LibRGW (30616 ms total) 2024-08-27T02:45:26.185 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:45:26.185 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:45:26.185 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 19 tests from 1 test suite ran. (30616 ms total) 2024-08-27T02:45:26.185 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 19 tests. 2024-08-27T02:45:26.198 INFO:tasks.workunit.client.0.smithi143.stdout:phase 5.2 2024-08-27T02:45:26.232 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 19 tests from 1 test suite. 2024-08-27T02:45:26.232 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:45:26.233 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 19 tests from LibRGW 2024-08-27T02:45:26.233 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:45:26.241 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:45:26.241 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:45:26.570 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (337 ms) 2024-08-27T02:45:26.570 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:45:26.571 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-27T02:45:26.571 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-08-27T02:45:26.571 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-08-27T02:45:26.572 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-08-27T02:45:26.581 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-08-27T02:45:26.581 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-08-27T02:45:26.581 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-08-27T02:45:26.581 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.WRITEV 2024-08-27T02:45:26.582 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-08-27T02:45:26.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READV 2024-08-27T02:45:26.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READV (0 ms) 2024-08-27T02:45:26.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-08-27T02:45:26.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-08-27T02:45:26.583 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-08-27T02:45:26.591 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-08-27T02:45:26.591 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-08-27T02:45:26.646 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.DELETE_BUCKET (55 ms) 2024-08-27T02:45:26.647 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:45:26.647 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:45:26.647 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:45:26.647 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:45:26.647 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:45:26.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:45:26.652+0000 7f537c28fa80 -1 shutting down 2024-08-27T02:45:26.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:45:26.656+0000 7f5255fe1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61954, si_uid : 1000, si_addr0x3e80000f202, si_status0 2024-08-27T02:45:56.872 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (30225 ms) 2024-08-27T02:45:56.873 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 19 tests from LibRGW (30639 ms total) 2024-08-27T02:45:56.873 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:45:56.873 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:45:56.873 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 19 tests from 1 test suite ran. (30640 ms total) 2024-08-27T02:45:56.873 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 19 tests. 2024-08-27T02:45:56.886 INFO:tasks.workunit.client.0.smithi143.stdout:phase 6.1 2024-08-27T02:45:56.910 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] Running 10 tests from 1 test suite. 2024-08-27T02:45:56.910 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment set-up. 2024-08-27T02:45:56.910 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 10 tests from LibRGW 2024-08-27T02:45:56.910 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.INIT 2024-08-27T02:45:56.919 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:45:56.919 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:45:57.487 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.INIT (578 ms) 2024-08-27T02:45:57.487 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.MOUNT 2024-08-27T02:45:57.489 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-08-27T02:45:57.489 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-08-27T02:45:57.532 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CREATE_BUCKETS (43 ms) 2024-08-27T02:45:57.532 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-08-27T02:45:57.546 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (14 ms) 2024-08-27T02:45:57.546 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-08-27T02:45:57.584 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.TOPDIR_RENAME (37 ms) 2024-08-27T02:45:57.584 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-08-27T02:45:57.639 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SUBDIR_RENAME (56 ms) 2024-08-27T02:45:57.639 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-08-27T02:45:57.695 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (55 ms) 2024-08-27T02:45:57.695 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.CLEANUP 2024-08-27T02:45:57.695 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-08-27T02:45:57.695 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.UMOUNT 2024-08-27T02:45:57.695 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-08-27T02:45:57.695 INFO:tasks.workunit.client.0.smithi143.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-08-27T02:45:57.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:45:57.698+0000 7f68b335fa80 -1 shutting down 2024-08-27T02:45:57.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:45:57.702+0000 7f678d0b1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62599, si_uid : 1000, si_addr0x3e80000f487, si_status0 2024-08-27T02:46:27.754 INFO:tasks.workunit.client.0.smithi143.stdout:[ OK ] LibRGW.SHUTDOWN (30059 ms) 2024-08-27T02:46:27.754 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] 10 tests from LibRGW (30844 ms total) 2024-08-27T02:46:27.754 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:46:27.754 INFO:tasks.workunit.client.0.smithi143.stdout:[----------] Global test environment tear-down 2024-08-27T02:46:27.755 INFO:tasks.workunit.client.0.smithi143.stdout:[==========] 10 tests from 1 test suite ran. (30844 ms total) 2024-08-27T02:46:27.755 INFO:tasks.workunit.client.0.smithi143.stdout:[ PASSED ] 10 tests. 2024-08-27T02:46:27.765 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:46:27.766 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:46:27.781 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-08-27T02:46:27.783 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-08-27T02:46:27.783 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-08-27T02:46:27.833 INFO:tasks.workunit.client.0.smithi143.stderr:+ [ -z ] 2024-08-27T02:46:27.833 INFO:tasks.workunit.client.0.smithi143.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-08-27T02:46:27.833 INFO:tasks.workunit.client.0.smithi143.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-08-27T02:46:27.834 INFO:tasks.workunit.client.0.smithi143.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-08-27T02:46:27.874 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:46:27.874 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:46:27.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.921+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.921+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.921+0000 7f0a2669c9c0 20 realm 2024-08-27T02:46:27.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.921+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:46:27.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:46:27.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:46:27.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.925+0000 7f0a2669c9c0 20 searching for the correct realm 2024-08-27T02:46:27.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.933+0000 7f0a249a3640 0 -- 172.21.15.143:0/3505380274 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x562c13a9df90 msgr2=0x562c13aa0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:46:27.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.937+0000 7f0a239a1640 0 -- 172.21.15.143:0/3505380274 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f0a14051020 msgr2=0x7f0a14034030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:46:27.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:46:27.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:46:27.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:46:27.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:46:27.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:46:27.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:46:27.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.943 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 zone default found 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 4 Realm: () 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:46:27.944 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 zonegroup default 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 started sync module instance, tier type = 2024-08-27T02:46:27.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.945+0000 7f0a2669c9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:46:27.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.961+0000 7f0a2669c9c0 20 add_watcher() i=0 2024-08-27T02:46:27.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.961+0000 7f0a2669c9c0 20 add_watcher() i=1 2024-08-27T02:46:27.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.961+0000 7f0a2669c9c0 20 add_watcher() i=2 2024-08-27T02:46:27.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.961+0000 7f0a2669c9c0 20 add_watcher() i=3 2024-08-27T02:46:27.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.961+0000 7f0a2669c9c0 20 add_watcher() i=4 2024-08-27T02:46:27.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.961+0000 7f0a2669c9c0 20 add_watcher() i=5 2024-08-27T02:46:27.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.961+0000 7f0a2669c9c0 20 add_watcher() i=6 2024-08-27T02:46:27.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f0a2669c9c0 20 add_watcher() i=7 2024-08-27T02:46:27.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f0a2669c9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:46:27.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f08dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:46:27.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f0a2669c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:46:27.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f0a2669c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:46:27.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f0a2669c9c0 5 note: GC not initialized 2024-08-27T02:46:27.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f08d9fdb640 20 reqs_thread_entry: start 2024-08-27T02:46:27.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f0a2669c9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:46:27.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.965+0000 7f0a2669c9c0 20 Filter name: none 2024-08-27T02:46:27.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f084b7fe640 20 reqs_thread_entry: start 2024-08-27T02:46:27.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-08-27T02:46:27.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-08-27T02:46:27.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:46:27.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:46:27.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-08-27T02:46:27.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-08-27T02:46:27.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-08-27T02:46:27.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-08-27T02:46:27.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-08-27T02:46:27.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-08-27T02:46:27.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f0a2669c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-08-27T02:46:27.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f08fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725895 cookie 94747308517168 notifier 5564 bl.length()=677 2024-08-27T02:46:27.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f08fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-08-27T02:46:27.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.969+0000 7f08fb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-08-27T02:46:27.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.973+0000 7f0a2669c9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-08-27T02:46:27.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.973+0000 7f0a2669c9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-08-27T02:46:27.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.973+0000 7f0a2669c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-08-27T02:46:27.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.973+0000 7f08faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725895 cookie 94747308457648 notifier 5564 bl.length()=187 2024-08-27T02:46:27.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.973+0000 7f08faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-08-27T02:46:27.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.973+0000 7f08faffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-08-27T02:46:27.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.981+0000 7f0a2669c9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-08-27T02:46:27.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.981+0000 7f0a2669c9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-08-27T02:46:27.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.981+0000 7f0a2669c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-08-27T02:46:27.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.981+0000 7f08faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725896 cookie 94747308457648 notifier 5564 bl.length()=197 2024-08-27T02:46:27.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.981+0000 7f08faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-08-27T02:46:27.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.981+0000 7f08faffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-08-27T02:46:27.980 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:46:27.980 INFO:tasks.workunit.client.0.smithi143.stdout: "user_id": "ceph-test-maven", 2024-08-27T02:46:27.980 INFO:tasks.workunit.client.0.smithi143.stdout: "display_name": "maven test user", 2024-08-27T02:46:27.980 INFO:tasks.workunit.client.0.smithi143.stdout: "email": "sigv4@example.com", 2024-08-27T02:46:27.980 INFO:tasks.workunit.client.0.smithi143.stdout: "suspended": 0, 2024-08-27T02:46:27.980 INFO:tasks.workunit.client.0.smithi143.stdout: "max_buckets": 1000, 2024-08-27T02:46:27.980 INFO:tasks.workunit.client.0.smithi143.stdout: "subusers": [], 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "keys": [ 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: { 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "user": "ceph-test-maven", 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "active": true, 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "create_date": "2024-08-27T02:46:27.973378Z" 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: ], 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "swift_keys": [], 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "caps": [], 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "default_placement": "", 2024-08-27T02:46:27.981 INFO:tasks.workunit.client.0.smithi143.stdout: "default_storage_class": "", 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "placement_tags": [], 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_quota": { 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "enabled": false, 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size": -1, 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "max_objects": -1 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "user_quota": { 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "enabled": false, 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:46:27.982 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size": -1, 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "max_objects": -1 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "temp_url_keys": [], 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "type": "rgw", 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "mfa_ids": [], 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "account_id": "", 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "path": "/", 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "create_date": "2024-08-27T02:46:27.973365Z", 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "tags": [], 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: "group_ids": [] 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:46:27.983 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:46:27.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.985+0000 7f08dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:46:27.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.989+0000 7f0a2669c9c0 20 remove_watcher() i=0 2024-08-27T02:46:27.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.989+0000 7f0a2669c9c0 2 removed watcher, disabling cache 2024-08-27T02:46:27.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.989+0000 7f0a2669c9c0 20 remove_watcher() i=1 2024-08-27T02:46:27.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.993+0000 7f0a2669c9c0 20 remove_watcher() i=2 2024-08-27T02:46:27.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.993+0000 7f0a2669c9c0 20 remove_watcher() i=3 2024-08-27T02:46:27.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.997+0000 7f0a2669c9c0 20 remove_watcher() i=4 2024-08-27T02:46:27.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.997+0000 7f0a2669c9c0 20 remove_watcher() i=5 2024-08-27T02:46:27.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:27.997+0000 7f0a2669c9c0 20 remove_watcher() i=6 2024-08-27T02:46:27.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:46:28.001+0000 7f0a2669c9c0 20 remove_watcher() i=7 2024-08-27T02:46:28.011 INFO:tasks.workunit.client.0.smithi143.stderr:+ [ -z ] 2024-08-27T02:46:28.011 INFO:tasks.workunit.client.0.smithi143.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-08-27T02:46:28.011 INFO:tasks.workunit.client.0.smithi143.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-08-27T02:46:28.012 INFO:tasks.workunit.client.0.smithi143.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi143.front.sepia.ceph.com:80 2024-08-27T02:46:28.012 INFO:tasks.workunit.client.0.smithi143.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-08-27T02:46:28.012 INFO:tasks.workunit.client.0.smithi143.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-08-27T02:46:28.012 INFO:tasks.workunit.client.0.smithi143.stderr:+ ./mvnw clean package 2024-08-27T02:46:28.017 INFO:tasks.workunit.client.0.smithi143.stdout:Warning: JAVA_HOME environment variable is not set. 2024-08-27T02:46:32.290 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Scanning for projects... 2024-08-27T02:46:32.413 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-08-27T02:46:32.504 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 60 kB/s) 2024-08-27T02:46:32.538 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-08-27T02:46:32.572 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-08-27T02:46:32.582 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-08-27T02:46:32.603 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-08-27T02:46:32.639 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:32.639 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-08-27T02:46:32.639 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Building jcksum 1.0 2024-08-27T02:46:32.639 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] from pom.xml 2024-08-27T02:46:32.639 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-08-27T02:46:32.643 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-08-27T02:46:32.659 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-08-27T02:46:32.668 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-08-27T02:46:32.685 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 582 kB/s) 2024-08-27T02:46:32.688 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-08-27T02:46:32.703 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-08-27T02:46:32.710 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-08-27T02:46:32.726 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-08-27T02:46:32.742 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-08-27T02:46:32.758 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-08-27T02:46:32.765 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-08-27T02:46:32.782 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 453 kB/s) 2024-08-27T02:46:32.785 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-08-27T02:46:32.800 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 578 kB/s) 2024-08-27T02:46:32.802 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-08-27T02:46:32.818 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-08-27T02:46:32.824 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-08-27T02:46:32.839 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-08-27T02:46:32.847 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-08-27T02:46:32.863 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-08-27T02:46:32.871 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-08-27T02:46:32.887 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-08-27T02:46:32.894 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-08-27T02:46:32.914 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.3 MB/s) 2024-08-27T02:46:32.924 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-08-27T02:46:32.940 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-08-27T02:46:32.942 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-08-27T02:46:32.959 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-08-27T02:46:32.963 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-08-27T02:46:32.979 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-08-27T02:46:32.984 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-08-27T02:46:32.999 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-08-27T02:46:33.006 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-08-27T02:46:33.021 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-08-27T02:46:33.025 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-08-27T02:46:33.042 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.6 MB/s) 2024-08-27T02:46:33.049 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-08-27T02:46:33.065 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-08-27T02:46:33.070 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-08-27T02:46:33.084 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-08-27T02:46:33.086 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-08-27T02:46:33.103 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-08-27T02:46:33.107 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-08-27T02:46:33.122 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-08-27T02:46:33.128 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-08-27T02:46:33.145 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.6/27 kB Progress (1): 19/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-08-27T02:46:33.163 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-08-27T02:46:33.178 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 380 kB/s) 2024-08-27T02:46:33.180 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-08-27T02:46:33.197 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-08-27T02:46:33.204 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-08-27T02:46:33.221 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-08-27T02:46:33.233 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-08-27T02:46:33.249 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-08-27T02:46:33.252 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-08-27T02:46:33.268 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-08-27T02:46:33.271 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-08-27T02:46:33.287 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 139 kB/s) 2024-08-27T02:46:33.295 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-08-27T02:46:33.312 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-08-27T02:46:33.318 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-08-27T02:46:33.334 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-08-27T02:46:33.340 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-08-27T02:46:33.357 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-08-27T02:46:33.365 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-08-27T02:46:33.383 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 99 kB/s) 2024-08-27T02:46:33.391 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-08-27T02:46:33.409 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-08-27T02:46:33.417 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-08-27T02:46:33.433 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-08-27T02:46:33.438 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-08-27T02:46:33.454 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-08-27T02:46:33.458 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-08-27T02:46:33.473 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-08-27T02:46:33.478 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-08-27T02:46:33.491 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-08-27T02:46:33.496 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-08-27T02:46:33.512 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-08-27T02:46:33.518 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-08-27T02:46:33.534 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-08-27T02:46:33.540 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-08-27T02:46:33.556 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-08-27T02:46:33.561 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-08-27T02:46:33.578 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 463 kB/s) 2024-08-27T02:46:33.584 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-08-27T02:46:33.602 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 287 kB/s) 2024-08-27T02:46:33.609 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-08-27T02:46:33.626 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 205 kB/s) 2024-08-27T02:46:33.635 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-08-27T02:46:33.653 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 231 kB/s) 2024-08-27T02:46:33.658 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-08-27T02:46:33.676 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-08-27T02:46:33.684 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-08-27T02:46:33.703 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/6.4 kB Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 322 kB/s) 2024-08-27T02:46:33.712 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-08-27T02:46:33.731 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 303 kB/s) 2024-08-27T02:46:33.742 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-08-27T02:46:33.760 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 157 kB/s) 2024-08-27T02:46:33.768 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-08-27T02:46:33.785 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-08-27T02:46:33.795 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-08-27T02:46:33.812 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-08-27T02:46:33.816 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-08-27T02:46:33.833 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-08-27T02:46:33.841 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-08-27T02:46:33.861 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 330 kB/s) 2024-08-27T02:46:33.868 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-08-27T02:46:33.887 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-08-27T02:46:33.891 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-08-27T02:46:33.908 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-08-27T02:46:33.917 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-08-27T02:46:33.934 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-08-27T02:46:33.942 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-08-27T02:46:33.957 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 310 kB/s) 2024-08-27T02:46:33.961 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-08-27T02:46:33.978 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-08-27T02:46:33.986 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-08-27T02:46:34.003 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 873 kB/s) 2024-08-27T02:46:34.007 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-08-27T02:46:34.025 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.6 MB/s) 2024-08-27T02:46:34.216 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-08-27T02:46:34.234 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 825 kB/s) 2024-08-27T02:46:34.244 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-08-27T02:46:34.261 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-08-27T02:46:34.266 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-08-27T02:46:34.286 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-08-27T02:46:34.297 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-08-27T02:46:34.314 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-08-27T02:46:34.323 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-08-27T02:46:34.341 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-08-27T02:46:34.347 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-08-27T02:46:34.368 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.7 MB/s) 2024-08-27T02:46:34.383 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-08-27T02:46:34.400 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-08-27T02:46:34.405 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-08-27T02:46:34.422 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-08-27T02:46:34.429 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-08-27T02:46:34.447 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 169 kB/s) 2024-08-27T02:46:34.453 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-08-27T02:46:34.471 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 168 kB/s) 2024-08-27T02:46:34.479 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-08-27T02:46:34.497 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 113 kB/s) 2024-08-27T02:46:34.504 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-08-27T02:46:34.523 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 149 kB/s) 2024-08-27T02:46:34.530 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-08-27T02:46:34.547 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 85 kB/s) 2024-08-27T02:46:34.553 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-08-27T02:46:34.572 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 167 kB/s) 2024-08-27T02:46:34.578 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-08-27T02:46:34.594 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-08-27T02:46:34.599 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-08-27T02:46:34.618 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 160 kB/s) 2024-08-27T02:46:34.624 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-08-27T02:46:34.641 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-08-27T02:46:34.649 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-08-27T02:46:34.667 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 54 kB/s) 2024-08-27T02:46:34.673 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-08-27T02:46:34.690 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-08-27T02:46:34.698 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-08-27T02:46:34.717 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 160 kB/s) 2024-08-27T02:46:34.724 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-08-27T02:46:34.745 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 172 kB/s) 2024-08-27T02:46:34.752 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-08-27T02:46:34.772 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.7/3.4 kB Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 181 kB/s) 2024-08-27T02:46:34.776 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-08-27T02:46:34.794 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-08-27T02:46:34.843 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-08-27T02:46:34.962 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 28 MB/s) 2024-08-27T02:46:34.965 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-08-27T02:46:34.965 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-08-27T02:46:34.965 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-08-27T02:46:34.965 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-08-27T02:46:34.968 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-08-27T02:46:34.998 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 464 kB/s) 2024-08-27T02:46:34.998 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-08-27T02:46:35.018 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/71 kB Progress (1): 2.8/71 kB Progress (1): 4.1/71 kB Progress (1): 5.5/71 kB Progress (1): 6.9/71 kB Progress (1): 8.3/71 kB Progress (1): 9.7/71 kB Progress (1): 11/71 kB Progress (2): 11/71 kB | 1.4/35 kB Progress (2): 12/71 kB | 1.4/35 kB Progress (2): 12/71 kB | 2.8/35 kB Progress (2): 14/71 kB | 2.8/35 kB Progress (2): 14/71 kB | 4.1/35 kB Progress (2): 15/71 kB | 4.1/35 kB Progress (3): 15/71 kB | 4.1/35 kB | 16/16 kB Progress (3): 15/71 kB | 5.5/35 kB | 16/16 kB Progress (3): 15/71 kB | 5.5/35 kB | 16 kB Progress (3): 17/71 kB | 5.5/35 kB | 16 kB Progress (3): 17/71 kB | 6.9/35 kB | 16 kB Progress (3): 18/71 kB | 6.9/35 kB | 16 kB Progress (3): 18/71 kB | 8.3/35 kB | 16 kB Progress (3): 19/71 kB | 8.3/35 kB | 16 kB Progress (3): 19/71 kB | 9.7/35 kB | 16 kB Progress (3): 21/71 kB | 9.7/35 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 327 kB/s) 2024-08-27T02:46:35.019 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 21/71 kB | 11/35 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-08-27T02:46:35.021 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 22/71 kB | 11/35 kB Progress (2): 22/71 kB | 12/35 kB Progress (2): 23/71 kB | 12/35 kB Progress (2): 23/71 kB | 14/35 kB Progress (2): 25/71 kB | 14/35 kB Progress (2): 25/71 kB | 15/35 kB Progress (2): 26/71 kB | 15/35 kB Progress (2): 26/71 kB | 17/35 kB Progress (2): 28/71 kB | 17/35 kB Progress (2): 28/71 kB | 18/35 kB Progress (2): 29/71 kB | 18/35 kB Progress (2): 29/71 kB | 19/35 kB Progress (2): 30/71 kB | 19/35 kB Progress (2): 30/71 kB | 21/35 kB Progress (2): 32/71 kB | 21/35 kB Progress (2): 32/71 kB | 22/35 kB Progress (2): 32/71 kB | 23/35 kB Progress (2): 32/71 kB | 25/35 kB Progress (2): 33/71 kB | 25/35 kB Progress (2): 33/71 kB | 26/35 kB Progress (2): 34/71 kB | 26/35 kB Progress (2): 34/71 kB | 28/35 kB Progress (2): 36/71 kB | 28/35 kB Progress (2): 36/71 kB | 29/35 kB Progress (2): 36/71 kB | 30/35 kB Progress (2): 36/71 kB | 32/35 kB Progress (2): 37/71 kB | 32/35 kB Progress (2): 39/71 kB | 32/35 kB Progress (2): 39/71 kB | 33/35 kB Progress (2): 39/71 kB | 34/35 kB Progress (2): 39/71 kB | 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 617 kB/s) 2024-08-27T02:46:35.021 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-08-27T02:46:35.030 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 40/71 kB Progress (1): 41/71 kB Progress (1): 43/71 kB Progress (1): 44/71 kB Progress (1): 46/71 kB Progress (1): 47/71 kB Progress (1): 48/71 kB Progress (1): 50/71 kB Progress (1): 51/71 kB Progress (1): 52/71 kB Progress (1): 54/71 kB Progress (1): 55/71 kB Progress (1): 57/71 kB Progress (1): 58/71 kB Progress (1): 59/71 kB Progress (1): 61/71 kB Progress (1): 62/71 kB Progress (1): 63/71 kB Progress (1): 64/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.1 MB/s) 2024-08-27T02:46:35.030 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-08-27T02:46:35.037 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/782 kB Progress (1): 33/782 kB Progress (1): 49/782 kB Progress (1): 66/782 kB Progress (1): 82/782 kB Progress (1): 98/782 kB Progress (2): 98/782 kB | 1.4/11 kB Progress (2): 98/782 kB | 2.8/11 kB Progress (2): 98/782 kB | 4.1/11 kB Progress (2): 115/782 kB | 4.1/11 kB Progress (2): 115/782 kB | 5.5/11 kB Progress (2): 115/782 kB | 6.9/11 kB Progress (2): 115/782 kB | 8.3/11 kB Progress (2): 115/782 kB | 9.7/11 kB Progress (2): 131/782 kB | 9.7/11 kB Progress (2): 131/782 kB | 11/11 kB Progress (2): 131/782 kB | 11 kB Progress (2): 147/782 kB | 11 kB Progress (2): 164/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 165 kB/s) 2024-08-27T02:46:35.037 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-08-27T02:46:35.053 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 180/782 kB Progress (1): 197/782 kB Progress (1): 213/782 kB Progress (1): 229/782 kB Progress (2): 229/782 kB | 1.4/49 kB Progress (2): 246/782 kB | 1.4/49 kB Progress (2): 246/782 kB | 2.8/49 kB Progress (2): 246/782 kB | 4.1/49 kB Progress (2): 246/782 kB | 5.5/49 kB Progress (2): 246/782 kB | 6.9/49 kB Progress (2): 262/782 kB | 6.9/49 kB Progress (2): 262/782 kB | 8.3/49 kB Progress (2): 262/782 kB | 9.7/49 kB Progress (2): 262/782 kB | 11/49 kB Progress (2): 279/782 kB | 11/49 kB Progress (2): 279/782 kB | 12/49 kB Progress (2): 279/782 kB | 14/49 kB Progress (2): 279/782 kB | 15/49 kB Progress (2): 295/782 kB | 15/49 kB Progress (2): 295/782 kB | 16/49 kB Progress (2): 311/782 kB | 16/49 kB Progress (2): 311/782 kB | 18/49 kB Progress (2): 311/782 kB | 19/49 kB Progress (2): 311/782 kB | 21/49 kB Progress (2): 328/782 kB | 21/49 kB Progress (2): 344/782 kB | 21/49 kB Progress (2): 344/782 kB | 22/49 kB Progress (2): 344/782 kB | 23/49 kB Progress (2): 344/782 kB | 25/49 kB Progress (2): 360/782 kB | 25/49 kB Progress (3): 360/782 kB | 25/49 kB | 1.4/98 kB Progress (3): 360/782 kB | 26/49 kB | 1.4/98 kB Progress (3): 360/782 kB | 26/49 kB | 2.8/98 kB Progress (3): 377/782 kB | 26/49 kB | 2.8/98 kB Progress (3): 377/782 kB | 26/49 kB | 4.1/98 kB Progress (3): 377/782 kB | 27/49 kB | 4.1/98 kB Progress (3): 377/782 kB | 27/49 kB | 5.5/98 kB Progress (3): 377/782 kB | 29/49 kB | 5.5/98 kB Progress (3): 393/782 kB | 29/49 kB | 5.5/98 kB Progress (3): 393/782 kB | 29/49 kB | 6.9/98 kB Progress (3): 393/782 kB | 30/49 kB | 6.9/98 kB Progress (3): 393/782 kB | 30/49 kB | 8.3/98 kB Progress (3): 410/782 kB | 30/49 kB | 8.3/98 kB Progress (3): 410/782 kB | 32/49 kB | 8.3/98 kB Progress (3): 410/782 kB | 32/49 kB | 9.7/98 kB Progress (3): 410/782 kB | 32/49 kB | 11/98 kB Progress (3): 410/782 kB | 33/49 kB | 11/98 kB Progress (3): 410/782 kB | 33/49 kB | 12/98 kB Progress (3): 410/782 kB | 34/49 kB | 12/98 kB Progress (3): 410/782 kB | 34/49 kB | 14/98 kB Progress (3): 426/782 kB | 34/49 kB | 14/98 kB Progress (3): 426/782 kB | 36/49 kB | 14/98 kB Progress (3): 426/782 kB | 36/49 kB | 15/98 kB Progress (3): 426/782 kB | 37/49 kB | 15/98 kB Progress (3): 426/782 kB | 37/49 kB | 16/98 kB Progress (3): 442/782 kB | 37/49 kB | 16/98 kB Progress (3): 442/782 kB | 37/49 kB | 18/98 kB Progress (3): 442/782 kB | 38/49 kB | 18/98 kB Progress (3): 442/782 kB | 38/49 kB | 19/98 kB Progress (3): 442/782 kB | 38/49 kB | 21/98 kB Progress (3): 459/782 kB | 38/49 kB | 21/98 kB Progress (3): 459/782 kB | 38/49 kB | 22/98 kB Progress (3): 459/782 kB | 38/49 kB | 23/98 kB Progress (3): 459/782 kB | 38/49 kB | 25/98 kB Progress (3): 459/782 kB | 38/49 kB | 26/98 kB Progress (3): 475/782 kB | 38/49 kB | 26/98 kB Progress (3): 475/782 kB | 38/49 kB | 27/98 kB Progress (3): 492/782 kB | 38/49 kB | 27/98 kB Progress (3): 492/782 kB | 38/49 kB | 29/98 kB Progress (3): 492/782 kB | 38/49 kB | 30/98 kB Progress (3): 492/782 kB | 38/49 kB | 32/98 kB Progress (3): 508/782 kB | 38/49 kB | 32/98 kB Progress (3): 508/782 kB | 38/49 kB | 33/98 kB Progress (3): 524/782 kB | 38/49 kB | 33/98 kB Progress (3): 524/782 kB | 38/49 kB | 34/98 kB Progress (3): 524/782 kB | 38/49 kB | 36/98 kB Progress (4): 524/782 kB | 38/49 kB | 36/98 kB | 16/205 kB Progress (4): 524/782 kB | 38/49 kB | 37/98 kB | 16/205 kB Progress (4): 541/782 kB | 38/49 kB | 37/98 kB | 16/205 kB Progress (4): 541/782 kB | 38/49 kB | 37/98 kB | 33/205 kB Progress (4): 557/782 kB | 38/49 kB | 37/98 kB | 33/205 kB Progress (4): 557/782 kB | 38/49 kB | 38/98 kB | 33/205 kB Progress (4): 573/782 kB | 38/49 kB | 38/98 kB | 33/205 kB Progress (4): 573/782 kB | 38/49 kB | 38/98 kB | 49/205 kB Progress (4): 590/782 kB | 38/49 kB | 38/98 kB | 49/205 kB Progress (4): 606/782 kB | 38/49 kB | 38/98 kB | 49/205 kB Progress (4): 606/782 kB | 38/49 kB | 38/98 kB | 65/205 kB Progress (4): 623/782 kB | 38/49 kB | 38/98 kB | 65/205 kB Progress (4): 639/782 kB | 38/49 kB | 38/98 kB | 65/205 kB Progress (4): 639/782 kB | 38/49 kB | 38/98 kB | 81/205 kB Progress (4): 655/782 kB | 38/49 kB | 38/98 kB | 81/205 kB Progress (4): 655/782 kB | 40/49 kB | 38/98 kB | 81/205 kB Progress (4): 672/782 kB | 40/49 kB | 38/98 kB | 81/205 kB Progress (4): 672/782 kB | 41/49 kB | 38/98 kB | 81/205 kB Progress (4): 672/782 kB | 43/49 kB | 38/98 kB | 81/205 kB Progress (4): 672/782 kB | 44/49 kB | 38/98 kB | 81/205 kB Progress (4): 672/782 kB | 44/49 kB | 38/98 kB | 98/205 kB Progress (4): 688/782 kB | 44/49 kB | 38/98 kB | 98/205 kB Progress (4): 688/782 kB | 45/49 kB | 38/98 kB | 98/205 kB Progress (4): 688/782 kB | 47/49 kB | 38/98 kB | 98/205 kB Progress (4): 688/782 kB | 48/49 kB | 38/98 kB | 98/205 kB Progress (4): 705/782 kB | 48/49 kB | 38/98 kB | 98/205 kB Progress (4): 705/782 kB | 49 kB | 38/98 kB | 98/205 kB Progress (4): 721/782 kB | 49 kB | 38/98 kB | 98/205 kB Progress (5): 721/782 kB | 49 kB | 38/98 kB | 98/205 kB | 16/30 kB Progress (5): 737/782 kB | 49 kB | 38/98 kB | 98/205 kB | 16/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 559 kB/s) 2024-08-27T02:46:35.053 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (4): 737/782 kB | 38/98 kB | 98/205 kB | 30 kB Progress (4): 754/782 kB | 38/98 kB | 98/205 kB | 30 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-08-27T02:46:35.054 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (4): 754/782 kB | 40/98 kB | 98/205 kB | 30 kB Progress (4): 770/782 kB | 40/98 kB | 98/205 kB | 30 kB Progress (4): 770/782 kB | 41/98 kB | 98/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 351 kB/s) 2024-08-27T02:46:35.054 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 770/782 kB | 43/98 kB | 98/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-08-27T02:46:35.056 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 770/782 kB | 44/98 kB | 98/205 kB Progress (3): 782 kB | 44/98 kB | 98/205 kB Progress (3): 782 kB | 45/98 kB | 98/205 kB Progress (3): 782 kB | 47/98 kB | 98/205 kB Progress (3): 782 kB | 48/98 kB | 98/205 kB Progress (3): 782 kB | 49/98 kB | 98/205 kB Progress (3): 782 kB | 51/98 kB | 98/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 8.9 MB/s) 2024-08-27T02:46:35.056 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 52/98 kB | 98/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-08-27T02:46:35.072 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 54/98 kB | 98/205 kB Progress (2): 55/98 kB | 98/205 kB Progress (2): 56/98 kB | 98/205 kB Progress (2): 58/98 kB | 98/205 kB Progress (2): 59/98 kB | 98/205 kB Progress (2): 61/98 kB | 98/205 kB Progress (2): 62/98 kB | 98/205 kB Progress (2): 78/98 kB | 98/205 kB Progress (2): 78/98 kB | 114/205 kB Progress (2): 78/98 kB | 131/205 kB Progress (2): 95/98 kB | 131/205 kB Progress (2): 98 kB | 131/205 kB Progress (2): 98 kB | 147/205 kB Progress (3): 98 kB | 147/205 kB | 1.4/13 kB Progress (3): 98 kB | 147/205 kB | 2.8/13 kB Progress (3): 98 kB | 147/205 kB | 4.1/13 kB Progress (3): 98 kB | 163/205 kB | 4.1/13 kB Progress (3): 98 kB | 163/205 kB | 5.5/13 kB Progress (4): 98 kB | 163/205 kB | 5.5/13 kB | 16/81 kB Progress (4): 98 kB | 163/205 kB | 6.9/13 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 892 kB/s) 2024-08-27T02:46:35.073 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 163/205 kB | 8.3/13 kB | 16/81 kB Progress (3): 180/205 kB | 8.3/13 kB | 16/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-08-27T02:46:35.076 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 180/205 kB | 9.7/13 kB | 16/81 kB Progress (3): 180/205 kB | 9.7/13 kB | 33/81 kB Progress (3): 180/205 kB | 11/13 kB | 33/81 kB Progress (4): 180/205 kB | 11/13 kB | 33/81 kB | 16/798 kB Progress (4): 180/205 kB | 12/13 kB | 33/81 kB | 16/798 kB Progress (4): 196/205 kB | 12/13 kB | 33/81 kB | 16/798 kB Progress (4): 196/205 kB | 13 kB | 33/81 kB | 16/798 kB Progress (4): 196/205 kB | 13 kB | 49/81 kB | 16/798 kB Progress (4): 196/205 kB | 13 kB | 49/81 kB | 33/798 kB Progress (4): 205 kB | 13 kB | 49/81 kB | 33/798 kB Progress (4): 205 kB | 13 kB | 49/81 kB | 49/798 kB Progress (4): 205 kB | 13 kB | 62/81 kB | 49/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 124 kB/s) 2024-08-27T02:46:35.076 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-08-27T02:46:35.076 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 205 kB | 62/81 kB | 63/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.9 MB/s) 2024-08-27T02:46:35.076 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-08-27T02:46:35.084 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 62/81 kB | 79/798 kB Progress (2): 62/81 kB | 96/798 kB Progress (2): 62/81 kB | 112/798 kB Progress (2): 62/81 kB | 128/798 kB Progress (2): 62/81 kB | 145/798 kB Progress (2): 62/81 kB | 161/798 kB Progress (2): 62/81 kB | 178/798 kB Progress (2): 62/81 kB | 194/798 kB Progress (2): 62/81 kB | 210/798 kB Progress (2): 62/81 kB | 227/798 kB Progress (2): 62/81 kB | 243/798 kB Progress (2): 62/81 kB | 260/798 kB Progress (2): 62/81 kB | 276/798 kB Progress (2): 62/81 kB | 292/798 kB Progress (2): 62/81 kB | 309/798 kB Progress (2): 62/81 kB | 325/798 kB Progress (2): 62/81 kB | 341/798 kB Progress (2): 62/81 kB | 358/798 kB Progress (2): 62/81 kB | 366/798 kB Progress (2): 78/81 kB | 366/798 kB Progress (2): 81 kB | 366/798 kB Progress (2): 81 kB | 382/798 kB Progress (2): 81 kB | 399/798 kB Progress (2): 81 kB | 415/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 713 kB/s) 2024-08-27T02:46:35.084 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-08-27T02:46:35.090 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 432/798 kB Progress (1): 448/798 kB Progress (1): 456/798 kB Progress (1): 473/798 kB Progress (1): 489/798 kB Progress (1): 505/798 kB Progress (1): 522/798 kB Progress (1): 538/798 kB Progress (1): 554/798 kB Progress (1): 571/798 kB Progress (1): 587/798 kB Progress (1): 604/798 kB Progress (1): 620/798 kB Progress (1): 636/798 kB Progress (1): 653/798 kB Progress (1): 669/798 kB Progress (1): 686/798 kB Progress (1): 702/798 kB Progress (1): 718/798 kB Progress (1): 735/798 kB Progress (1): 751/798 kB Progress (1): 767/798 kB Progress (1): 784/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.7 MB/s) 2024-08-27T02:46:35.090 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-08-27T02:46:35.094 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/182 kB Progress (1): 33/182 kB Progress (1): 49/182 kB Progress (1): 66/182 kB Progress (1): 82/182 kB Progress (1): 98/182 kB Progress (2): 98/182 kB | 16/27 kB Progress (2): 115/182 kB | 16/27 kB Progress (2): 131/182 kB | 16/27 kB Progress (2): 131/182 kB | 27 kB Progress (2): 147/182 kB | 27 kB Progress (2): 164/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 222 kB/s) 2024-08-27T02:46:35.094 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-08-27T02:46:35.095 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 180/182 kB Progress (1): 182 kB Progress (2): 182 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.5 MB/s) 2024-08-27T02:46:35.095 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-08-27T02:46:35.098 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 33/151 kB Progress (1): 49/151 kB Progress (1): 66/151 kB Progress (1): 82/151 kB Progress (2): 82/151 kB | 16/30 kB Progress (2): 82/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 235 kB/s) 2024-08-27T02:46:35.098 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-08-27T02:46:35.112 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 98/151 kB Progress (2): 98/151 kB | 16/385 kB Progress (2): 112/151 kB | 16/385 kB Progress (2): 112/151 kB | 33/385 kB Progress (2): 112/151 kB | 49/385 kB Progress (2): 112/151 kB | 66/385 kB Progress (2): 128/151 kB | 66/385 kB Progress (2): 128/151 kB | 82/385 kB Progress (2): 128/151 kB | 98/385 kB Progress (2): 128/151 kB | 115/385 kB Progress (3): 128/151 kB | 115/385 kB | 13 kB Progress (3): 128/151 kB | 129/385 kB | 13 kB Progress (3): 145/151 kB | 129/385 kB | 13 kB Progress (3): 145/151 kB | 146/385 kB | 13 kB Progress (3): 151 kB | 146/385 kB | 13 kB Progress (3): 151 kB | 162/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 97 kB/s) 2024-08-27T02:46:35.113 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-08-27T02:46:35.113 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 151 kB | 179/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-08-27T02:46:35.113 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-08-27T02:46:35.113 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 195/385 kB Progress (1): 211/385 kB Progress (1): 228/385 kB Progress (2): 228/385 kB | 16/75 kB Progress (2): 244/385 kB | 16/75 kB Progress (2): 244/385 kB | 33/75 kB Progress (2): 260/385 kB | 33/75 kB Progress (2): 277/385 kB | 33/75 kB Progress (2): 293/385 kB | 33/75 kB Progress (2): 310/385 kB | 33/75 kB Progress (2): 310/385 kB | 49/75 kB Progress (2): 326/385 kB | 49/75 kB Progress (2): 342/385 kB | 49/75 kB Progress (2): 342/385 kB | 65/75 kB Progress (2): 359/385 kB | 65/75 kB Progress (2): 359/385 kB | 75 kB Progress (2): 375/385 kB | 75 kB Progress (2): 385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 532 kB/s) 2024-08-27T02:46:35.113 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.7 MB/s) 2024-08-27T02:46:35.114 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-08-27T02:46:35.114 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-08-27T02:46:35.145 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 66/780 kB Progress (1): 82/780 kB Progress (1): 97/780 kB Progress (1): 114/780 kB Progress (1): 130/780 kB Progress (1): 146/780 kB Progress (2): 146/780 kB | 16/501 kB Progress (2): 146/780 kB | 33/501 kB Progress (3): 146/780 kB | 33/501 kB | 16/329 kB Progress (3): 146/780 kB | 49/501 kB | 16/329 kB Progress (3): 146/780 kB | 49/501 kB | 33/329 kB Progress (3): 146/780 kB | 49/501 kB | 49/329 kB Progress (3): 146/780 kB | 65/501 kB | 49/329 kB Progress (3): 146/780 kB | 65/501 kB | 63/329 kB Progress (3): 146/780 kB | 81/501 kB | 63/329 kB Progress (3): 146/780 kB | 81/501 kB | 79/329 kB Progress (3): 146/780 kB | 81/501 kB | 96/329 kB Progress (3): 146/780 kB | 97/501 kB | 96/329 kB Progress (3): 146/780 kB | 114/501 kB | 96/329 kB Progress (3): 146/780 kB | 114/501 kB | 112/329 kB Progress (3): 146/780 kB | 130/501 kB | 112/329 kB Progress (3): 146/780 kB | 130/501 kB | 129/329 kB Progress (3): 163/780 kB | 130/501 kB | 129/329 kB Progress (3): 163/780 kB | 147/501 kB | 129/329 kB Progress (3): 179/780 kB | 147/501 kB | 129/329 kB Progress (3): 179/780 kB | 147/501 kB | 145/329 kB Progress (3): 179/780 kB | 163/501 kB | 145/329 kB Progress (3): 179/780 kB | 163/501 kB | 161/329 kB Progress (3): 196/780 kB | 163/501 kB | 161/329 kB Progress (3): 196/780 kB | 179/501 kB | 161/329 kB Progress (3): 196/780 kB | 179/501 kB | 178/329 kB Progress (4): 196/780 kB | 179/501 kB | 178/329 kB | 16/41 kB Progress (4): 212/780 kB | 179/501 kB | 178/329 kB | 16/41 kB Progress (4): 212/780 kB | 196/501 kB | 178/329 kB | 16/41 kB Progress (4): 212/780 kB | 196/501 kB | 194/329 kB | 16/41 kB Progress (4): 212/780 kB | 196/501 kB | 194/329 kB | 33/41 kB Progress (4): 228/780 kB | 196/501 kB | 194/329 kB | 33/41 kB Progress (4): 228/780 kB | 212/501 kB | 194/329 kB | 33/41 kB Progress (4): 228/780 kB | 212/501 kB | 210/329 kB | 33/41 kB Progress (4): 228/780 kB | 212/501 kB | 210/329 kB | 41 kB Progress (4): 245/780 kB | 212/501 kB | 210/329 kB | 41 kB Progress (4): 245/780 kB | 212/501 kB | 227/329 kB | 41 kB Progress (5): 245/780 kB | 212/501 kB | 227/329 kB | 41 kB | 16/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 265 kB/s) 2024-08-27T02:46:35.145 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-08-27T02:46:35.146 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (4): 245/780 kB | 212/501 kB | 227/329 kB | 33/354 kB Progress (4): 245/780 kB | 212/501 kB | 227/329 kB | 49/354 kB Progress (4): 245/780 kB | 228/501 kB | 227/329 kB | 49/354 kB Progress (4): 245/780 kB | 228/501 kB | 243/329 kB | 49/354 kB Progress (4): 261/780 kB | 228/501 kB | 243/329 kB | 49/354 kB Progress (4): 261/780 kB | 228/501 kB | 243/329 kB | 62/354 kB Progress (4): 261/780 kB | 245/501 kB | 243/329 kB | 62/354 kB Progress (4): 277/780 kB | 245/501 kB | 243/329 kB | 62/354 kB Progress (4): 277/780 kB | 261/501 kB | 243/329 kB | 62/354 kB Progress (4): 277/780 kB | 261/501 kB | 243/329 kB | 78/354 kB Progress (4): 277/780 kB | 278/501 kB | 243/329 kB | 78/354 kB Progress (4): 294/780 kB | 278/501 kB | 243/329 kB | 78/354 kB Progress (4): 294/780 kB | 278/501 kB | 243/329 kB | 95/354 kB Progress (4): 294/780 kB | 294/501 kB | 243/329 kB | 95/354 kB Progress (4): 310/780 kB | 294/501 kB | 243/329 kB | 95/354 kB Progress (4): 310/780 kB | 310/501 kB | 243/329 kB | 95/354 kB Progress (4): 310/780 kB | 310/501 kB | 243/329 kB | 111/354 kB Progress (4): 327/780 kB | 310/501 kB | 243/329 kB | 111/354 kB Progress (4): 327/780 kB | 327/501 kB | 243/329 kB | 111/354 kB Progress (4): 327/780 kB | 327/501 kB | 243/329 kB | 128/354 kB Progress (4): 327/780 kB | 343/501 kB | 243/329 kB | 128/354 kB Progress (4): 343/780 kB | 343/501 kB | 243/329 kB | 128/354 kB Progress (4): 343/780 kB | 343/501 kB | 243/329 kB | 144/354 kB Progress (4): 343/780 kB | 360/501 kB | 243/329 kB | 144/354 kB Progress (4): 359/780 kB | 360/501 kB | 243/329 kB | 144/354 kB Progress (4): 359/780 kB | 360/501 kB | 243/329 kB | 160/354 kB Progress (4): 376/780 kB | 360/501 kB | 243/329 kB | 160/354 kB Progress (4): 376/780 kB | 360/501 kB | 243/329 kB | 177/354 kB Progress (4): 392/780 kB | 360/501 kB | 243/329 kB | 177/354 kB Progress (4): 392/780 kB | 360/501 kB | 243/329 kB | 193/354 kB Progress (4): 409/780 kB | 360/501 kB | 243/329 kB | 193/354 kB Progress (4): 409/780 kB | 360/501 kB | 243/329 kB | 209/354 kB Progress (4): 425/780 kB | 360/501 kB | 243/329 kB | 209/354 kB Progress (4): 425/780 kB | 360/501 kB | 243/329 kB | 226/354 kB Progress (4): 425/780 kB | 376/501 kB | 243/329 kB | 226/354 kB Progress (4): 441/780 kB | 376/501 kB | 243/329 kB | 226/354 kB Progress (4): 441/780 kB | 376/501 kB | 243/329 kB | 242/354 kB Progress (4): 441/780 kB | 392/501 kB | 243/329 kB | 242/354 kB Progress (4): 458/780 kB | 392/501 kB | 243/329 kB | 242/354 kB Progress (4): 458/780 kB | 392/501 kB | 243/329 kB | 259/354 kB Progress (4): 458/780 kB | 409/501 kB | 243/329 kB | 259/354 kB Progress (4): 458/780 kB | 409/501 kB | 260/329 kB | 259/354 kB Progress (4): 474/780 kB | 409/501 kB | 260/329 kB | 259/354 kB Progress (4): 474/780 kB | 409/501 kB | 260/329 kB | 275/354 kB Progress (4): 474/780 kB | 425/501 kB | 260/329 kB | 275/354 kB Progress (4): 474/780 kB | 425/501 kB | 276/329 kB | 275/354 kB Progress (4): 474/780 kB | 425/501 kB | 276/329 kB | 291/354 kB Progress (4): 474/780 kB | 441/501 kB | 276/329 kB | 291/354 kB Progress (4): 474/780 kB | 441/501 kB | 292/329 kB | 291/354 kB Progress (4): 474/780 kB | 441/501 kB | 292/329 kB | 308/354 kB Progress (4): 474/780 kB | 458/501 kB | 292/329 kB | 308/354 kB Progress (4): 474/780 kB | 458/501 kB | 309/329 kB | 308/354 kB Progress (4): 474/780 kB | 458/501 kB | 309/329 kB | 324/354 kB Progress (4): 474/780 kB | 474/501 kB | 309/329 kB | 324/354 kB Progress (4): 474/780 kB | 474/501 kB | 325/329 kB | 324/354 kB Progress (4): 474/780 kB | 474/501 kB | 329 kB | 324/354 kB Progress (4): 474/780 kB | 474/501 kB | 329 kB | 341/354 kB Progress (4): 474/780 kB | 491/501 kB | 329 kB | 341/354 kB Progress (4): 490/780 kB | 491/501 kB | 329 kB | 341/354 kB Progress (4): 490/780 kB | 501 kB | 329 kB | 341/354 kB Progress (4): 490/780 kB | 501 kB | 329 kB | 354 kB Progress (4): 507/780 kB | 501 kB | 329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-08-27T02:46:35.146 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.1 MB/s) 2024-08-27T02:46:35.146 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-08-27T02:46:35.146 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-08-27T02:46:35.146 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.1 MB/s) 2024-08-27T02:46:35.146 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-08-27T02:46:35.147 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 523/780 kB Progress (1): 540/780 kB Progress (1): 556/780 kB Progress (1): 572/780 kB Progress (1): 589/780 kB Progress (1): 605/780 kB Progress (1): 622/780 kB Progress (1): 638/780 kB Progress (1): 654/780 kB Progress (1): 671/780 kB Progress (1): 687/780 kB Progress (1): 703/780 kB Progress (1): 720/780 kB Progress (1): 736/780 kB Progress (1): 753/780 kB Progress (1): 769/780 kB Progress (2): 769/780 kB | 6.4 kB Progress (2): 780 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-08-27T02:46:35.147 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-08-27T02:46:35.147 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.6 MB/s) 2024-08-27T02:46:35.147 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-08-27T02:46:35.150 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 80 kB/s) 2024-08-27T02:46:35.150 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-08-27T02:46:35.155 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/211 kB Progress (2): 16/211 kB | 16/586 kB Progress (2): 16/211 kB | 33/586 kB Progress (2): 33/211 kB | 33/586 kB Progress (2): 33/211 kB | 49/586 kB Progress (2): 49/211 kB | 49/586 kB Progress (2): 49/211 kB | 64/586 kB Progress (2): 49/211 kB | 81/586 kB Progress (2): 66/211 kB | 81/586 kB Progress (2): 66/211 kB | 97/586 kB Progress (2): 78/211 kB | 97/586 kB Progress (2): 78/211 kB | 113/586 kB Progress (2): 78/211 kB | 130/586 kB Progress (2): 95/211 kB | 130/586 kB Progress (2): 95/211 kB | 146/586 kB Progress (2): 111/211 kB | 146/586 kB Progress (2): 111/211 kB | 162/586 kB Progress (2): 111/211 kB | 179/586 kB Progress (2): 128/211 kB | 179/586 kB Progress (2): 128/211 kB | 195/586 kB Progress (2): 144/211 kB | 195/586 kB Progress (2): 144/211 kB | 212/586 kB Progress (2): 144/211 kB | 228/586 kB Progress (3): 144/211 kB | 228/586 kB | 6.8 kB Progress (3): 160/211 kB | 228/586 kB | 6.8 kB Progress (3): 160/211 kB | 244/586 kB | 6.8 kB Progress (3): 160/211 kB | 261/586 kB | 6.8 kB Progress (3): 177/211 kB | 261/586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 37 kB/s) 2024-08-27T02:46:35.155 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 177/211 kB | 277/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-08-27T02:46:35.156 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 193/211 kB | 277/586 kB Progress (2): 193/211 kB | 294/586 kB Progress (2): 210/211 kB | 294/586 kB Progress (3): 210/211 kB | 294/586 kB | 16/106 kB Progress (3): 211 kB | 294/586 kB | 16/106 kB Progress (3): 211 kB | 310/586 kB | 16/106 kB Progress (3): 211 kB | 310/586 kB | 32/106 kB Progress (3): 211 kB | 326/586 kB | 32/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-08-27T02:46:35.157 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-08-27T02:46:35.159 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 326/586 kB | 49/106 kB Progress (2): 343/586 kB | 49/106 kB Progress (2): 343/586 kB | 62/106 kB Progress (2): 359/586 kB | 62/106 kB Progress (2): 359/586 kB | 78/106 kB Progress (2): 375/586 kB | 78/106 kB Progress (2): 375/586 kB | 94/106 kB Progress (2): 392/586 kB | 94/106 kB Progress (2): 392/586 kB | 106 kB Progress (2): 408/586 kB | 106 kB Progress (2): 425/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 565 kB/s) 2024-08-27T02:46:35.159 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-08-27T02:46:35.163 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 441/586 kB Progress (1): 457/586 kB Progress (1): 474/586 kB Progress (1): 490/586 kB Progress (1): 507/586 kB Progress (1): 523/586 kB Progress (1): 539/586 kB Progress (1): 556/586 kB Progress (1): 572/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.1 MB/s) 2024-08-27T02:46:35.163 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-08-27T02:46:35.168 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 64/245 kB Progress (1): 80/245 kB Progress (1): 96/245 kB Progress (1): 113/245 kB Progress (1): 129/245 kB Progress (1): 145/245 kB Progress (1): 162/245 kB Progress (1): 178/245 kB Progress (1): 195/245 kB Progress (1): 211/245 kB Progress (1): 227/245 kB Progress (1): 244/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-08-27T02:46:35.168 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-08-27T02:46:35.173 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/205 kB Progress (1): 32/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 16/16 kB Progress (2): 49/205 kB | 16/16 kB Progress (2): 49/205 kB | 16 kB Progress (3): 49/205 kB | 16 kB | 15 kB Progress (3): 62/205 kB | 16 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 81 kB/s) 2024-08-27T02:46:35.173 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-08-27T02:46:35.173 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 75 kB/s) 2024-08-27T02:46:35.173 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-08-27T02:46:35.178 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 78/205 kB Progress (1): 95/205 kB Progress (1): 111/205 kB Progress (1): 127/205 kB Progress (1): 144/205 kB Progress (2): 144/205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 31 kB/s) 2024-08-27T02:46:35.178 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-08-27T02:46:35.182 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 144/205 kB | 16/23 kB Progress (2): 144/205 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 106 kB/s) 2024-08-27T02:46:35.185 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 160/205 kB Progress (1): 177/205 kB Progress (1): 193/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 957 kB/s) 2024-08-27T02:46:35.188 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 80 kB/s) 2024-08-27T02:46:35.190 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 110 kB/s) 2024-08-27T02:46:35.195 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 63/184 kB Progress (1): 79/184 kB Progress (1): 95/184 kB Progress (1): 112/184 kB Progress (1): 128/184 kB Progress (1): 145/184 kB Progress (1): 161/184 kB Progress (1): 177/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 817 kB/s) 2024-08-27T02:46:35.219 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:35.219 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-08-27T02:46:35.227 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-08-27T02:46:35.244 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-08-27T02:46:35.247 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-08-27T02:46:35.263 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-08-27T02:46:35.265 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-08-27T02:46:35.281 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15/43 kB Progress (1): 31/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-08-27T02:46:35.287 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-08-27T02:46:35.302 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-08-27T02:46:35.309 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-08-27T02:46:35.327 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15/153 kB Progress (1): 31/153 kB Progress (1): 48/153 kB Progress (1): 64/153 kB Progress (1): 80/153 kB Progress (1): 96/153 kB Progress (1): 112/153 kB Progress (1): 129/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-08-27T02:46:35.327 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-08-27T02:46:35.345 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 64/215 kB Progress (1): 80/215 kB Progress (1): 97/215 kB Progress (1): 113/215 kB Progress (1): 129/215 kB Progress (1): 146/215 kB Progress (1): 162/215 kB Progress (1): 179/215 kB Progress (1): 195/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-08-27T02:46:35.433 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:35.434 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-08-27T02:46:35.438 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-08-27T02:46:35.454 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-08-27T02:46:35.457 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-08-27T02:46:35.472 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-08-27T02:46:35.477 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-08-27T02:46:35.493 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 548 kB/s) 2024-08-27T02:46:35.497 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-08-27T02:46:35.515 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.4 MB/s) 2024-08-27T02:46:35.520 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-08-27T02:46:35.536 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-08-27T02:46:35.540 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-08-27T02:46:35.556 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-08-27T02:46:35.562 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-08-27T02:46:35.581 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 31 kB/s) 2024-08-27T02:46:35.585 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-08-27T02:46:35.601 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 161 kB/s) 2024-08-27T02:46:35.604 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-08-27T02:46:35.620 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-08-27T02:46:35.623 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-08-27T02:46:35.639 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 200 kB/s) 2024-08-27T02:46:35.643 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-08-27T02:46:35.659 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 492 kB/s) 2024-08-27T02:46:35.664 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-08-27T02:46:35.680 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-08-27T02:46:35.684 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-08-27T02:46:35.699 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-08-27T02:46:35.704 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-08-27T02:46:35.722 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-08-27T02:46:35.731 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-08-27T02:46:35.748 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 283 kB/s) 2024-08-27T02:46:35.754 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-08-27T02:46:35.779 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.2 MB/s) 2024-08-27T02:46:35.788 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-08-27T02:46:35.805 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-08-27T02:46:35.815 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-08-27T02:46:35.833 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-08-27T02:46:35.834 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-08-27T02:46:35.834 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-08-27T02:46:35.834 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-08-27T02:46:35.835 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-08-27T02:46:35.835 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-08-27T02:46:35.849 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (3): 2.5 kB | 16/41 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-08-27T02:46:35.850 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-08-27T02:46:35.851 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 33/41 kB | 16/269 kB Progress (3): 33/41 kB | 16/269 kB | 16/55 kB Progress (3): 33/41 kB | 33/269 kB | 16/55 kB Progress (3): 41 kB | 33/269 kB | 16/55 kB Progress (3): 41 kB | 33/269 kB | 33/55 kB Progress (3): 41 kB | 49/269 kB | 33/55 kB Progress (3): 41 kB | 49/269 kB | 49/55 kB Progress (3): 41 kB | 64/269 kB | 49/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-08-27T02:46:35.851 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 64/269 kB | 55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-08-27T02:46:35.852 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 81/269 kB | 55 kB Progress (2): 97/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-08-27T02:46:35.853 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 113/269 kB Progress (2): 113/269 kB | 8.5 kB Progress (2): 130/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 471 kB/s) 2024-08-27T02:46:35.855 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 146/269 kB Progress (1): 162/269 kB Progress (1): 179/269 kB Progress (1): 195/269 kB Progress (1): 212/269 kB Progress (1): 228/269 kB Progress (1): 244/269 kB Progress (1): 261/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-08-27T02:46:35.871 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 35/327 kB Progress (2): 35/327 kB | 16/587 kB Progress (2): 51/327 kB | 16/587 kB Progress (2): 51/327 kB | 33/587 kB Progress (2): 68/327 kB | 33/587 kB Progress (2): 68/327 kB | 49/587 kB Progress (2): 84/327 kB | 49/587 kB Progress (2): 84/327 kB | 63/587 kB Progress (2): 100/327 kB | 63/587 kB Progress (2): 100/327 kB | 80/587 kB Progress (2): 117/327 kB | 80/587 kB Progress (2): 129/327 kB | 80/587 kB Progress (2): 129/327 kB | 96/587 kB Progress (2): 145/327 kB | 96/587 kB Progress (2): 145/327 kB | 113/587 kB Progress (2): 162/327 kB | 113/587 kB Progress (2): 162/327 kB | 129/587 kB Progress (2): 178/327 kB | 129/587 kB Progress (2): 178/327 kB | 145/587 kB Progress (2): 195/327 kB | 145/587 kB Progress (2): 211/327 kB | 145/587 kB Progress (2): 211/327 kB | 162/587 kB Progress (2): 227/327 kB | 162/587 kB Progress (2): 227/327 kB | 178/587 kB Progress (2): 244/327 kB | 178/587 kB Progress (2): 244/327 kB | 194/587 kB Progress (2): 260/327 kB | 194/587 kB Progress (2): 260/327 kB | 211/587 kB Progress (2): 276/327 kB | 211/587 kB Progress (2): 276/327 kB | 227/587 kB Progress (2): 293/327 kB | 227/587 kB Progress (2): 293/327 kB | 244/587 kB Progress (2): 309/327 kB | 244/587 kB Progress (2): 326/327 kB | 244/587 kB Progress (2): 326/327 kB | 260/587 kB Progress (2): 327 kB | 260/587 kB Progress (2): 327 kB | 276/587 kB Progress (2): 327 kB | 293/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.8 MB/s) 2024-08-27T02:46:35.877 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 309/587 kB Progress (1): 326/587 kB Progress (1): 342/587 kB Progress (1): 358/587 kB Progress (1): 375/587 kB Progress (1): 391/587 kB Progress (1): 407/587 kB Progress (1): 424/587 kB Progress (1): 440/587 kB Progress (1): 457/587 kB Progress (1): 473/587 kB Progress (1): 489/587 kB Progress (1): 506/587 kB Progress (1): 522/587 kB Progress (1): 538/587 kB Progress (1): 555/587 kB Progress (1): 571/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-08-27T02:46:35.927 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-08-27T02:46:35.928 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:35.928 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-08-27T02:46:35.934 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-08-27T02:46:35.949 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-08-27T02:46:35.952 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-08-27T02:46:35.967 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-08-27T02:46:35.970 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-08-27T02:46:35.984 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-08-27T02:46:35.986 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-08-27T02:46:36.000 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-08-27T02:46:36.004 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-08-27T02:46:36.020 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-08-27T02:46:36.022 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-08-27T02:46:36.037 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-08-27T02:46:36.040 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-08-27T02:46:36.056 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.1 MB/s) 2024-08-27T02:46:36.060 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-08-27T02:46:36.075 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-08-27T02:46:36.077 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-08-27T02:46:36.092 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-08-27T02:46:36.095 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-08-27T02:46:36.111 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 148 kB/s) 2024-08-27T02:46:36.112 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-08-27T02:46:36.127 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-08-27T02:46:36.134 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-08-27T02:46:36.146 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-08-27T02:46:36.149 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-08-27T02:46:36.163 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-08-27T02:46:36.166 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-08-27T02:46:36.185 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 56 kB/s) 2024-08-27T02:46:36.187 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-08-27T02:46:36.202 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-08-27T02:46:36.204 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-08-27T02:46:36.219 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-08-27T02:46:36.223 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-08-27T02:46:36.237 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-08-27T02:46:36.240 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-08-27T02:46:36.255 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-08-27T02:46:36.258 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-08-27T02:46:36.273 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-08-27T02:46:36.275 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-08-27T02:46:36.290 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-08-27T02:46:36.292 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-08-27T02:46:36.308 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-08-27T02:46:36.311 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-08-27T02:46:36.327 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-08-27T02:46:36.329 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-08-27T02:46:36.345 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-08-27T02:46:36.354 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-08-27T02:46:36.369 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-08-27T02:46:36.370 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-08-27T02:46:36.370 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-08-27T02:46:36.371 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-08-27T02:46:36.371 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-08-27T02:46:36.371 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-08-27T02:46:36.386 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-08-27T02:46:36.386 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 33/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-08-27T02:46:36.390 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 49/334 kB Progress (2): 49/334 kB | 16/122 kB Progress (2): 66/334 kB | 16/122 kB Progress (3): 66/334 kB | 16/122 kB | 15/27 kB Progress (3): 82/334 kB | 16/122 kB | 15/27 kB Progress (3): 82/334 kB | 32/122 kB | 15/27 kB Progress (3): 82/334 kB | 32/122 kB | 27 kB Progress (3): 98/334 kB | 32/122 kB | 27 kB Progress (3): 98/334 kB | 49/122 kB | 27 kB Progress (3): 115/334 kB | 49/122 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-08-27T02:46:36.390 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 115/334 kB | 49/122 kB | 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-08-27T02:46:36.390 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 115/334 kB | 65/122 kB | 16/55 kB Progress (3): 131/334 kB | 65/122 kB | 16/55 kB Progress (3): 131/334 kB | 65/122 kB | 32/55 kB Progress (3): 131/334 kB | 81/122 kB | 32/55 kB Progress (3): 147/334 kB | 81/122 kB | 32/55 kB Progress (3): 147/334 kB | 98/122 kB | 32/55 kB Progress (3): 164/334 kB | 98/122 kB | 32/55 kB Progress (3): 164/334 kB | 98/122 kB | 49/55 kB Progress (3): 164/334 kB | 98/122 kB | 55 kB Progress (3): 164/334 kB | 114/122 kB | 55 kB Progress (3): 180/334 kB | 114/122 kB | 55 kB Progress (3): 180/334 kB | 122 kB | 55 kB Progress (3): 197/334 kB | 122 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.9 MB/s) 2024-08-27T02:46:36.390 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 213/334 kB | 122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-08-27T02:46:36.390 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-08-27T02:46:36.391 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 16 MB/s) 2024-08-27T02:46:36.402 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 97/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (2): 130/267 kB | 4.7 kB Progress (2): 146/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 150 kB/s) 2024-08-27T02:46:36.403 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 163/267 kB Progress (1): 179/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 228/267 kB Progress (1): 245/267 kB Progress (2): 245/267 kB | 15/23 kB Progress (2): 261/267 kB | 15/23 kB Progress (2): 267 kB | 15/23 kB Progress (2): 267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-08-27T02:46:36.404 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 691 kB/s) 2024-08-27T02:46:36.491 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Changes detected - recompiling the module! :source 2024-08-27T02:46:36.493 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-08-27T02:46:37.633 INFO:tasks.workunit.client.0.smithi143.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-08-27T02:46:37.633 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:37.633 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-08-27T02:46:37.636 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-08-27T02:46:37.636 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:37.636 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-08-27T02:46:37.641 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-08-27T02:46:37.641 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-08-27T02:46:37.874 INFO:tasks.workunit.client.0.smithi143.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-08-27T02:46:37.875 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:37.875 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-08-27T02:46:37.881 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-08-27T02:46:37.896 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-08-27T02:46:37.899 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-08-27T02:46:37.914 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-08-27T02:46:37.919 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-08-27T02:46:37.935 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-08-27T02:46:37.938 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-08-27T02:46:37.953 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-08-27T02:46:37.957 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-08-27T02:46:37.972 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-08-27T02:46:37.976 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-08-27T02:46:37.991 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-08-27T02:46:37.995 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-08-27T02:46:38.010 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-08-27T02:46:38.014 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-08-27T02:46:38.028 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-08-27T02:46:38.029 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-08-27T02:46:38.043 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-08-27T02:46:38.046 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-08-27T02:46:38.060 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-08-27T02:46:38.063 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-08-27T02:46:38.080 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 322 kB/s) 2024-08-27T02:46:38.084 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-08-27T02:46:38.099 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 147 kB/s) 2024-08-27T02:46:38.101 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-08-27T02:46:38.117 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-08-27T02:46:38.119 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-08-27T02:46:38.135 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-08-27T02:46:38.137 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-08-27T02:46:38.153 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 952 kB/s) 2024-08-27T02:46:38.156 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-08-27T02:46:38.170 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-08-27T02:46:38.172 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-08-27T02:46:38.187 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-08-27T02:46:38.190 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-08-27T02:46:38.205 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-08-27T02:46:38.208 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-08-27T02:46:38.223 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-08-27T02:46:38.226 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-08-27T02:46:38.240 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-08-27T02:46:38.245 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-08-27T02:46:38.258 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-08-27T02:46:38.260 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-08-27T02:46:38.273 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-08-27T02:46:38.274 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-08-27T02:46:38.288 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.6 MB/s) 2024-08-27T02:46:38.290 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-08-27T02:46:38.305 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 451 kB/s) 2024-08-27T02:46:38.307 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-08-27T02:46:38.330 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 565 kB/s) 2024-08-27T02:46:38.334 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-08-27T02:46:38.348 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 197 kB/s) 2024-08-27T02:46:38.351 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-08-27T02:46:38.367 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-08-27T02:46:38.371 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-08-27T02:46:38.386 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-08-27T02:46:38.392 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-08-27T02:46:38.407 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-08-27T02:46:38.414 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-08-27T02:46:38.430 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 139 kB/s) 2024-08-27T02:46:38.436 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-08-27T02:46:38.451 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-08-27T02:46:38.460 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-08-27T02:46:38.477 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-08-27T02:46:38.482 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-08-27T02:46:38.498 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-08-27T02:46:38.504 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-08-27T02:46:38.520 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 840 kB/s) 2024-08-27T02:46:38.525 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-08-27T02:46:38.540 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 299 kB/s) 2024-08-27T02:46:38.545 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-08-27T02:46:38.561 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 418 kB/s) 2024-08-27T02:46:38.565 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-08-27T02:46:38.582 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.0 MB/s) 2024-08-27T02:46:38.590 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-08-27T02:46:38.603 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-08-27T02:46:38.605 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-08-27T02:46:38.620 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-08-27T02:46:38.624 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-08-27T02:46:38.639 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-08-27T02:46:38.642 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-08-27T02:46:38.657 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 320 kB/s) 2024-08-27T02:46:38.660 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-08-27T02:46:38.675 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-08-27T02:46:38.680 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-08-27T02:46:38.697 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-08-27T02:46:38.703 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-08-27T02:46:38.719 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-08-27T02:46:38.725 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-08-27T02:46:38.741 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-08-27T02:46:38.746 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-08-27T02:46:38.763 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 204 kB/s) 2024-08-27T02:46:38.769 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-08-27T02:46:38.784 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 684 kB/s) 2024-08-27T02:46:38.788 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-08-27T02:46:38.804 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-08-27T02:46:38.808 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-08-27T02:46:38.824 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-08-27T02:46:38.830 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-08-27T02:46:38.845 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-08-27T02:46:38.849 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-08-27T02:46:38.865 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-08-27T02:46:38.869 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-08-27T02:46:38.885 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-08-27T02:46:38.889 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-08-27T02:46:38.904 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-08-27T02:46:38.909 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-08-27T02:46:38.925 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 457 kB/s) 2024-08-27T02:46:38.931 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-08-27T02:46:38.947 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-08-27T02:46:38.951 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-08-27T02:46:38.969 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 37/78 kB Progress (1): 53/78 kB Progress (1): 69/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-08-27T02:46:38.978 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-08-27T02:46:38.994 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-08-27T02:46:39.002 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-08-27T02:46:39.017 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-08-27T02:46:39.022 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-08-27T02:46:39.037 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.2/4.3 kB Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 267 kB/s) 2024-08-27T02:46:39.041 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-08-27T02:46:39.058 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 177 kB/s) 2024-08-27T02:46:39.061 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-08-27T02:46:39.078 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.7 MB/s) 2024-08-27T02:46:39.084 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-08-27T02:46:39.100 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 139 kB/s) 2024-08-27T02:46:39.113 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-08-27T02:46:39.141 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 64/308 kB Progress (1): 81/308 kB Progress (1): 97/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 146/308 kB Progress (1): 163/308 kB Progress (1): 179/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 228/308 kB Progress (1): 245/308 kB Progress (1): 261/308 kB Progress (1): 277/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-08-27T02:46:39.141 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-08-27T02:46:39.142 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-08-27T02:46:39.142 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-08-27T02:46:39.143 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-08-27T02:46:39.143 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-08-27T02:46:39.159 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15/171 kB Progress (1): 31/171 kB Progress (1): 48/171 kB Progress (1): 64/171 kB Progress (1): 81/171 kB Progress (1): 95/171 kB Progress (2): 95/171 kB | 14 kB Progress (2): 111/171 kB | 14 kB Progress (3): 111/171 kB | 14 kB | 16/118 kB Progress (3): 128/171 kB | 14 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-08-27T02:46:39.160 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-08-27T02:46:39.161 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 128/171 kB | 33/118 kB Progress (2): 144/171 kB | 33/118 kB Progress (3): 144/171 kB | 33/118 kB | 8.2 kB Progress (3): 144/171 kB | 49/118 kB | 8.2 kB Progress (3): 161/171 kB | 49/118 kB | 8.2 kB Progress (4): 161/171 kB | 49/118 kB | 8.2 kB | 15/26 kB Progress (4): 161/171 kB | 63/118 kB | 8.2 kB | 15/26 kB Progress (4): 171 kB | 63/118 kB | 8.2 kB | 15/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-08-27T02:46:39.161 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-08-27T02:46:39.162 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 171 kB | 63/118 kB | 26 kB Progress (3): 171 kB | 79/118 kB | 26 kB Progress (3): 171 kB | 96/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-08-27T02:46:39.162 INFO:tasks.workunit.client.0.smithi143.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.3 MB/s) 2024-08-27T02:46:39.162 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-08-27T02:46:39.162 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-08-27T02:46:39.163 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 112/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.9 MB/s) 2024-08-27T02:46:39.163 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-08-27T02:46:39.178 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/61 kB Progress (1): 33/61 kB Progress (1): 49/61 kB Progress (1): 61 kB Progress (2): 61 kB | 16/146 kB Progress (3): 61 kB | 16/146 kB | 16/136 kB Progress (3): 61 kB | 31/146 kB | 16/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-08-27T02:46:39.178 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-08-27T02:46:39.180 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 31/146 kB | 32/136 kB Progress (3): 31/146 kB | 32/136 kB | 16/58 kB Progress (3): 48/146 kB | 32/136 kB | 16/58 kB Progress (3): 48/146 kB | 32/136 kB | 32/58 kB Progress (3): 48/146 kB | 49/136 kB | 32/58 kB Progress (3): 64/146 kB | 49/136 kB | 32/58 kB Progress (4): 64/146 kB | 49/136 kB | 32/58 kB | 16/501 kB Progress (4): 64/146 kB | 49/136 kB | 49/58 kB | 16/501 kB Progress (4): 64/146 kB | 49/136 kB | 58 kB | 16/501 kB Progress (4): 81/146 kB | 49/136 kB | 58 kB | 16/501 kB Progress (4): 81/146 kB | 49/136 kB | 58 kB | 33/501 kB Progress (4): 81/146 kB | 65/136 kB | 58 kB | 33/501 kB Progress (4): 81/146 kB | 65/136 kB | 58 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-08-27T02:46:39.181 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 97/146 kB | 65/136 kB | 49/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-08-27T02:46:39.183 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 97/146 kB | 65/136 kB | 62/501 kB Progress (3): 97/146 kB | 81/136 kB | 62/501 kB Progress (3): 97/146 kB | 81/136 kB | 79/501 kB Progress (3): 110/146 kB | 81/136 kB | 79/501 kB Progress (3): 110/146 kB | 98/136 kB | 79/501 kB Progress (3): 110/146 kB | 98/136 kB | 95/501 kB Progress (3): 127/146 kB | 98/136 kB | 95/501 kB Progress (3): 127/146 kB | 98/136 kB | 111/501 kB Progress (3): 127/146 kB | 114/136 kB | 111/501 kB Progress (3): 127/146 kB | 114/136 kB | 128/501 kB Progress (3): 143/146 kB | 114/136 kB | 128/501 kB Progress (3): 146 kB | 114/136 kB | 128/501 kB Progress (3): 146 kB | 114/136 kB | 144/501 kB Progress (3): 146 kB | 130/136 kB | 144/501 kB Progress (3): 146 kB | 130/136 kB | 161/501 kB Progress (3): 146 kB | 136 kB | 161/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.7 MB/s) 2024-08-27T02:46:39.183 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 136 kB | 177/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.4 MB/s) 2024-08-27T02:46:39.194 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 193/501 kB Progress (1): 210/501 kB Progress (1): 226/501 kB Progress (1): 242/501 kB Progress (1): 259/501 kB Progress (1): 275/501 kB Progress (1): 292/501 kB Progress (1): 308/501 kB Progress (1): 324/501 kB Progress (1): 341/501 kB Progress (1): 357/501 kB Progress (1): 374/501 kB Progress (1): 390/501 kB Progress (1): 406/501 kB Progress (1): 423/501 kB Progress (1): 439/501 kB Progress (1): 455/501 kB Progress (1): 472/501 kB Progress (1): 488/501 kB Progress (2): 488/501 kB | 16/124 kB Progress (2): 501 kB | 16/124 kB Progress (2): 501 kB | 33/124 kB Progress (2): 501 kB | 49/124 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 10 MB/s) 2024-08-27T02:46:39.197 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 115/124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.3 MB/s) 2024-08-27T02:46:39.246 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 24 MB/s) 2024-08-27T02:46:39.361 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:39.361 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-08-27T02:46:39.364 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-08-27T02:46:39.379 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-08-27T02:46:39.381 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-08-27T02:46:39.396 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-08-27T02:46:39.398 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-08-27T02:46:39.417 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.3 MB/s) 2024-08-27T02:46:39.420 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-08-27T02:46:39.434 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-08-27T02:46:39.439 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-08-27T02:46:39.454 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 324 kB/s) 2024-08-27T02:46:39.457 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-08-27T02:46:39.472 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-08-27T02:46:39.476 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-08-27T02:46:39.492 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 376 kB/s) 2024-08-27T02:46:39.495 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-08-27T02:46:39.509 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-08-27T02:46:39.512 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-08-27T02:46:39.528 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-08-27T02:46:39.534 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-08-27T02:46:39.551 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 808 kB/s) 2024-08-27T02:46:39.554 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-08-27T02:46:39.568 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-08-27T02:46:39.571 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-08-27T02:46:39.587 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 514 kB/s) 2024-08-27T02:46:39.589 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-08-27T02:46:39.604 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-08-27T02:46:39.614 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-08-27T02:46:39.626 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-08-27T02:46:39.627 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-08-27T02:46:39.627 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-08-27T02:46:39.627 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-08-27T02:46:39.627 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-08-27T02:46:39.628 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-08-27T02:46:39.642 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Progress (2): 26 kB | 16/79 kB Progress (3): 26 kB | 16/79 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-08-27T02:46:39.642 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 16/79 kB | 16/58 kB | 0/1.0 MB Progress (4): 16/79 kB | 16/58 kB | 0/1.0 MB | 15/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-08-27T02:46:39.645 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (4): 33/79 kB | 16/58 kB | 0/1.0 MB | 15/211 kB Progress (4): 33/79 kB | 33/58 kB | 0/1.0 MB | 15/211 kB Progress (4): 33/79 kB | 33/58 kB | 0/1.0 MB | 15/211 kB Progress (4): 33/79 kB | 33/58 kB | 0/1.0 MB | 31/211 kB Progress (4): 49/79 kB | 33/58 kB | 0/1.0 MB | 31/211 kB Progress (4): 49/79 kB | 49/58 kB | 0/1.0 MB | 31/211 kB Progress (4): 49/79 kB | 49/58 kB | 0/1.0 MB | 31/211 kB Progress (4): 49/79 kB | 49/58 kB | 0/1.0 MB | 48/211 kB Progress (4): 66/79 kB | 49/58 kB | 0/1.0 MB | 48/211 kB Progress (4): 66/79 kB | 58 kB | 0/1.0 MB | 48/211 kB Progress (4): 66/79 kB | 58 kB | 0.1/1.0 MB | 48/211 kB Progress (4): 66/79 kB | 58 kB | 0.1/1.0 MB | 64/211 kB Progress (4): 79 kB | 58 kB | 0.1/1.0 MB | 64/211 kB Progress (4): 79 kB | 58 kB | 0.1/1.0 MB | 64/211 kB Progress (4): 79 kB | 58 kB | 0.1/1.0 MB | 77/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-08-27T02:46:39.645 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-08-27T02:46:39.645 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 79 kB | 0.1/1.0 MB | 77/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-08-27T02:46:39.649 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 0.1/1.0 MB | 93/211 kB Progress (2): 0.1/1.0 MB | 93/211 kB Progress (2): 0.1/1.0 MB | 110/211 kB Progress (2): 0.1/1.0 MB | 110/211 kB Progress (2): 0.1/1.0 MB | 110/211 kB Progress (2): 0.1/1.0 MB | 126/211 kB Progress (2): 0.2/1.0 MB | 126/211 kB Progress (2): 0.2/1.0 MB | 142/211 kB Progress (2): 0.2/1.0 MB | 142/211 kB Progress (2): 0.2/1.0 MB | 142/211 kB Progress (2): 0.2/1.0 MB | 159/211 kB Progress (2): 0.2/1.0 MB | 159/211 kB Progress (2): 0.2/1.0 MB | 159/211 kB Progress (2): 0.2/1.0 MB | 175/211 kB Progress (2): 0.2/1.0 MB | 175/211 kB Progress (2): 0.2/1.0 MB | 192/211 kB Progress (2): 0.3/1.0 MB | 192/211 kB Progress (2): 0.3/1.0 MB | 192/211 kB Progress (2): 0.3/1.0 MB | 208/211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.2 MB/s) 2024-08-27T02:46:39.657 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.7/1.0 MB | 33/116 kB Progress (2): 0.7/1.0 MB | 49/116 kB Progress (2): 0.7/1.0 MB | 66/116 kB Progress (2): 0.7/1.0 MB | 66/116 kB Progress (2): 0.7/1.0 MB | 82/116 kB Progress (2): 0.7/1.0 MB | 82/116 kB Progress (2): 0.7/1.0 MB | 98/116 kB Progress (2): 0.7/1.0 MB | 98/116 kB Progress (2): 0.7/1.0 MB | 115/116 kB Progress (2): 0.7/1.0 MB | 116 kB Progress (2): 0.7/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-08-27T02:46:39.663 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/267 kB Progress (2): 0.9/1.0 MB | 16/267 kB Progress (2): 0.9/1.0 MB | 16/267 kB Progress (2): 0.9/1.0 MB | 32/267 kB Progress (2): 0.9/1.0 MB | 32/267 kB Progress (2): 0.9/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 62/267 kB Progress (2): 0.9/1.0 MB | 62/267 kB Progress (2): 0.9/1.0 MB | 78/267 kB Progress (2): 0.9/1.0 MB | 78/267 kB Progress (2): 0.9/1.0 MB | 95/267 kB Progress (2): 1.0/1.0 MB | 95/267 kB Progress (2): 1.0/1.0 MB | 111/267 kB Progress (2): 1.0/1.0 MB | 111/267 kB Progress (2): 1.0/1.0 MB | 128/267 kB Progress (2): 1.0/1.0 MB | 128/267 kB Progress (2): 1.0/1.0 MB | 144/267 kB Progress (2): 1.0/1.0 MB | 144/267 kB Progress (2): 1.0 MB | 144/267 kB Progress (2): 1.0 MB | 160/267 kB Progress (2): 1.0 MB | 177/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 28 MB/s) 2024-08-27T02:46:39.665 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 193/267 kB Progress (1): 209/267 kB Progress (1): 226/267 kB Progress (1): 242/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.0 MB/s) 2024-08-27T02:46:39.856 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-08-27T02:46:39.892 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-27T02:46:39.892 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] BUILD SUCCESS 2024-08-27T02:46:39.892 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-27T02:46:39.894 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Total time: 7.644 s 2024-08-27T02:46:39.894 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Finished at: 2024-08-27T02:46:39Z 2024-08-27T02:46:39.894 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-27T02:46:39.924 INFO:tasks.workunit.client.0.smithi143.stderr:+ ./mvnw test -Dtest=PutObjects 2024-08-27T02:46:39.929 INFO:tasks.workunit.client.0.smithi143.stdout:Warning: JAVA_HOME environment variable is not set. 2024-08-27T02:46:41.068 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Scanning for projects... 2024-08-27T02:46:41.177 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:41.177 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-08-27T02:46:41.177 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Building jcksum 1.0 2024-08-27T02:46:41.177 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] from pom.xml 2024-08-27T02:46:41.177 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-08-27T02:46:41.476 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:41.476 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-08-27T02:46:41.596 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-08-27T02:46:41.597 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:41.597 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-08-27T02:46:41.692 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Nothing to compile - all classes are up to date 2024-08-27T02:46:41.692 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:41.692 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-08-27T02:46:41.694 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-08-27T02:46:41.694 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:41.695 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-08-27T02:46:41.699 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Nothing to compile - all classes are up to date 2024-08-27T02:46:41.699 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:41.700 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-08-27T02:46:41.901 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-08-27T02:46:42.166 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-08-27T02:46:42.418 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 18 kB/s) 2024-08-27T02:46:42.430 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-08-27T02:46:42.449 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-08-27T02:46:42.457 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-08-27T02:46:42.476 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 141 kB/s) 2024-08-27T02:46:42.483 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-08-27T02:46:42.501 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-08-27T02:46:42.505 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-08-27T02:46:42.521 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-08-27T02:46:42.524 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-08-27T02:46:42.541 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 94 kB/s) 2024-08-27T02:46:42.545 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-08-27T02:46:42.562 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-08-27T02:46:42.569 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-08-27T02:46:42.594 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-08-27T02:46:42.597 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-08-27T02:46:42.597 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-08-27T02:46:42.598 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-08-27T02:46:42.598 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-08-27T02:46:42.598 INFO:tasks.workunit.client.0.smithi143.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-08-27T02:46:42.638 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 96/169 kB Progress (1): 113/169 kB Progress (1): 129/169 kB Progress (1): 145/169 kB Progress (1): 162/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.9 MB/s) 2024-08-27T02:46:42.656 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 2.8/189 kB Progress (2): 4.1/7.7 kB | 2.8/189 kB Progress (3): 4.1/7.7 kB | 2.8/189 kB | 1.4/103 kB Progress (3): 5.5/7.7 kB | 2.8/189 kB | 1.4/103 kB Progress (3): 5.5/7.7 kB | 2.8/189 kB | 2.8/103 kB Progress (3): 5.5/7.7 kB | 4.1/189 kB | 2.8/103 kB Progress (4): 5.5/7.7 kB | 4.1/189 kB | 2.8/103 kB | 1.4/18 kB Progress (4): 5.5/7.7 kB | 5.5/189 kB | 2.8/103 kB | 1.4/18 kB Progress (4): 5.5/7.7 kB | 5.5/189 kB | 4.1/103 kB | 1.4/18 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 4.1/103 kB | 1.4/18 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 5.5/103 kB | 1.4/18 kB Progress (4): 6.9/7.7 kB | 6.9/189 kB | 5.5/103 kB | 1.4/18 kB Progress (4): 6.9/7.7 kB | 6.9/189 kB | 5.5/103 kB | 2.8/18 kB Progress (4): 6.9/7.7 kB | 8.3/189 kB | 5.5/103 kB | 2.8/18 kB Progress (4): 6.9/7.7 kB | 8.3/189 kB | 6.9/103 kB | 2.8/18 kB Progress (4): 7.7 kB | 8.3/189 kB | 6.9/103 kB | 2.8/18 kB Progress (4): 7.7 kB | 8.3/189 kB | 8.3/103 kB | 2.8/18 kB Progress (4): 7.7 kB | 9.7/189 kB | 8.3/103 kB | 2.8/18 kB Progress (4): 7.7 kB | 9.7/189 kB | 8.3/103 kB | 4.1/18 kB Progress (4): 7.7 kB | 11/189 kB | 8.3/103 kB | 4.1/18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 130 kB/s) 2024-08-27T02:46:42.665 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (3): 11/189 kB | 9.7/103 kB | 4.1/18 kB Progress (3): 12/189 kB | 9.7/103 kB | 4.1/18 kB Progress (3): 12/189 kB | 9.7/103 kB | 5.5/18 kB Progress (3): 14/189 kB | 9.7/103 kB | 5.5/18 kB Progress (3): 14/189 kB | 11/103 kB | 5.5/18 kB Progress (3): 15/189 kB | 11/103 kB | 5.5/18 kB Progress (3): 15/189 kB | 11/103 kB | 6.9/18 kB Progress (3): 16/189 kB | 11/103 kB | 6.9/18 kB Progress (3): 16/189 kB | 12/103 kB | 6.9/18 kB Progress (3): 16/189 kB | 12/103 kB | 8.3/18 kB Progress (3): 16/189 kB | 14/103 kB | 8.3/18 kB Progress (3): 16/189 kB | 14/103 kB | 9.7/18 kB Progress (3): 16/189 kB | 15/103 kB | 9.7/18 kB Progress (3): 16/189 kB | 15/103 kB | 11/18 kB Progress (3): 16/189 kB | 16/103 kB | 11/18 kB Progress (3): 16/189 kB | 16/103 kB | 12/18 kB Progress (3): 32/189 kB | 16/103 kB | 12/18 kB Progress (3): 32/189 kB | 16/103 kB | 14/18 kB Progress (3): 32/189 kB | 32/103 kB | 14/18 kB Progress (3): 32/189 kB | 32/103 kB | 15/18 kB Progress (3): 32/189 kB | 32/103 kB | 16/18 kB Progress (3): 49/189 kB | 32/103 kB | 16/18 kB Progress (3): 49/189 kB | 32/103 kB | 17/18 kB Progress (3): 49/189 kB | 49/103 kB | 17/18 kB Progress (3): 49/189 kB | 49/103 kB | 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 251 kB/s) 2024-08-27T02:46:42.679 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (2): 65/189 kB | 49/103 kB Progress (2): 65/189 kB | 65/103 kB Progress (2): 81/189 kB | 65/103 kB Progress (2): 81/189 kB | 81/103 kB Progress (2): 98/189 kB | 81/103 kB Progress (2): 114/189 kB | 81/103 kB Progress (2): 130/189 kB | 81/103 kB Progress (2): 130/189 kB | 98/103 kB Progress (2): 130/189 kB | 103 kB Progress (2): 147/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-08-27T02:46:42.686 INFO:tasks.workunit.client.0.smithi143.stdout:Progress (1): 163/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-08-27T02:46:42.702 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:46:42.702 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------- 2024-08-27T02:46:42.702 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] T E S T S 2024-08-27T02:46:42.702 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------- 2024-08-27T02:46:43.397 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-08-27T02:46:43.437 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjects.java: starting test run: 2024-08-27T02:46:43.536 INFO:tasks.workunit.client.0.smithi143.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-08-27T02:46:43.536 INFO:tasks.workunit.client.0.smithi143.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-08-27T02:46:43.536 INFO:tasks.workunit.client.0.smithi143.stdout: EndpointUrl=http://smithi143.front.sepia.ceph.com:80 2024-08-27T02:46:43.536 INFO:tasks.workunit.client.0.smithi143.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-08-27T02:46:43.636 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Environment Variables Read 2024-08-27T02:46:43.937 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: S3 Client Initialized 2024-08-27T02:46:43.937 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Generating File 2024-08-27T02:46:43.938 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: File Generated 2024-08-27T02:46:43.938 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Generating File 2024-08-27T02:46:43.938 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: File Generated 2024-08-27T02:46:43.938 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Generating File 2024-08-27T02:46:44.038 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: File Generated 2024-08-27T02:46:44.038 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Generating File 2024-08-27T02:46:44.038 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: File Generated 2024-08-27T02:46:44.038 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Generating File 2024-08-27T02:46:44.038 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: File Generated 2024-08-27T02:46:44.038 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Generating File 2024-08-27T02:46:44.038 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: File Generated 2024-08-27T02:46:44.039 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Generated Big Files 2024-08-27T02:46:44.338 INFO:tasks.workunit.client.0.smithi143.stdout:HeadBucketResponse() 2024-08-27T02:46:44.338 INFO:tasks.workunit.client.0.smithi143.stdout:sheik is ready 2024-08-27T02:46:44.338 INFO:tasks.workunit.client.0.smithi143.stdout:DEBUG: Test Bucket Created 2024-08-27T02:46:44.437 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-0b 2024-08-27T02:46:44.739 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-8b 2024-08-27T02:46:45.139 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-200b 2024-08-27T02:46:45.541 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-21983b 2024-08-27T02:46:45.741 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-5519b 2024-08-27T02:46:46.142 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-204329b 2024-08-27T02:46:46.443 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-256k 2024-08-27T02:46:46.944 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-1m 2024-08-27T02:46:47.545 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-08-27T02:46:48.247 INFO:tasks.workunit.client.0.smithi143.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-08-27T02:46:53.559 INFO:tasks.workunit.client.0.smithi143.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-08-27T02:46:57.968 INFO:tasks.workunit.client.0.smithi143.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-08-27T02:47:34.453 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-0b 2024-08-27T02:47:34.453 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-8b 2024-08-27T02:47:34.455 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-200b 2024-08-27T02:47:34.456 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-21983b 2024-08-27T02:47:34.456 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-5519b 2024-08-27T02:47:34.457 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-204329b 2024-08-27T02:47:34.458 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-256k 2024-08-27T02:47:34.459 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-1m 2024-08-27T02:47:34.461 INFO:tasks.workunit.client.0.smithi143.stdout:arg: file-1038757b 2024-08-27T02:47:34.527 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-0b 2024-08-27T02:47:34.718 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:34.728 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-8b 2024-08-27T02:47:34.828 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:35.028 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-200b 2024-08-27T02:47:35.128 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:35.229 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-21983b 2024-08-27T02:47:35.429 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:35.529 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-5519b 2024-08-27T02:47:35.729 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:35.830 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-204329b 2024-08-27T02:47:36.130 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:36.230 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-256k 2024-08-27T02:47:36.430 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:36.631 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-1m 2024-08-27T02:47:37.031 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:37.232 INFO:tasks.workunit.client.0.smithi143.stdout:putObjectFromFileCksum called with file-1038757b 2024-08-27T02:47:37.832 INFO:tasks.workunit.client.0.smithi143.stdout:PutObjectResponse 2024-08-27T02:47:38.033 INFO:tasks.workunit.client.0.smithi143.stdout:mpuObjectFromFileCksum called with file-5m 2024-08-27T02:47:41.738 INFO:tasks.workunit.client.0.smithi143.stdout:mpuObjectFromFileCksum called with file-10m 2024-08-27T02:47:46.744 INFO:tasks.workunit.client.0.smithi143.stdout:mpuObjectFromFileCksum called with file-100m 2024-08-27T02:48:32.516 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 109.1 s -- in io.ceph.jcksum.PutObjects 2024-08-27T02:48:32.545 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:48:32.545 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Results: 2024-08-27T02:48:32.546 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:48:32.546 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-08-27T02:48:32.546 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] 2024-08-27T02:48:32.548 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-27T02:48:32.548 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] BUILD SUCCESS 2024-08-27T02:48:32.548 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-27T02:48:32.549 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Total time: 01:51 min 2024-08-27T02:48:32.549 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] Finished at: 2024-08-27T02:48:32Z 2024-08-27T02:48:32.549 INFO:tasks.workunit.client.0.smithi143.stdout:[INFO] ------------------------------------------------------------------------ 2024-08-27T02:48:32.571 INFO:tasks.workunit.client.0.smithi143.stderr:+ exit 2024-08-27T02:48:32.572 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:48:32.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:48:32.623 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-08-27T02:48:32.623 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-27T02:48:33.007 DEBUG:teuthology.parallel:result is None 2024-08-27T02:48:33.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:48:33.021 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:48:33.021 DEBUG:teuthology.orchestra.run.smithi143:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:48:33.069 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:48:33.069 INFO:teuthology.run_tasks:Running task workunit... 2024-08-27T02:48:33.078 INFO:tasks.workunit:Pulling workunits from ref d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:48:33.078 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-27T02:48:33.079 DEBUG:teuthology.orchestra.run.smithi143:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:48:33.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:48:33.118 INFO:teuthology.orchestra.run.smithi143.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-27T02:48:33.118 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:48:33.165 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-27T02:48:33.166 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-27T02:48:33.215 INFO:tasks.workunit:timeout=3h 2024-08-27T02:48:33.215 INFO:tasks.workunit:cleanup=True 2024-08-27T02:48:33.216 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:48:33.263 INFO:tasks.workunit.client.0.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-27T02:49:30.785 INFO:tasks.workunit.client.0.smithi143.stderr:Updating files: 98% (12563/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-27T02:49:31.577 INFO:tasks.workunit.client.0.smithi143.stderr:Note: switching to 'd17b22856a85d7d49d47be692c778d4419f41641'. 2024-08-27T02:49:31.577 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:49:31.577 INFO:tasks.workunit.client.0.smithi143.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-27T02:49:31.577 INFO:tasks.workunit.client.0.smithi143.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-27T02:49:31.577 INFO:tasks.workunit.client.0.smithi143.stderr:state without impacting any branches by switching back to a branch. 2024-08-27T02:49:31.577 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:49:31.577 INFO:tasks.workunit.client.0.smithi143.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr: git switch -c 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr:Or undo this operation with: 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr: git switch - 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:49:31.578 INFO:tasks.workunit.client.0.smithi143.stderr:HEAD is now at d17b22856a8 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-08-27T02:49:31.584 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-27T02:49:31.633 INFO:tasks.workunit.client.0.smithi143.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-27T02:49:31.636 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:49:31.637 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-27T02:49:31.687 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-27T02:49:31.744 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-27T02:49:31.785 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:49:31.786 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:49:31.786 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-27T02:49:31.828 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:49:31.832 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:49:31.832 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-27T02:49:31.881 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-08-27T02:49:31.882 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-08-27T02:49:31.882 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-08-27T02:49:31.936 INFO:tasks.workunit.client.0.smithi143.stdout:INFO: fully qualified domain name: smithi143.front.sepia.ceph.com 2024-08-27T02:49:31.936 INFO:tasks.workunit.client.0.smithi143.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-08-27T02:49:31.936 INFO:tasks.workunit.client.0.smithi143.stdout:== TESTING VERSIONED BUCKET == 2024-08-27T02:49:35.182 INFO:tasks.workunit.client.0.smithi143.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-27T02:49:35.375 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting pip 2024-08-27T02:49:35.381 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-27T02:49:35.419 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: pip 2024-08-27T02:49:35.419 INFO:tasks.workunit.client.0.smithi143.stdout: Attempting uninstall: pip 2024-08-27T02:49:35.420 INFO:tasks.workunit.client.0.smithi143.stdout: Found existing installation: pip 22.0.2 2024-08-27T02:49:35.696 INFO:tasks.workunit.client.0.smithi143.stdout: Uninstalling pip-22.0.2: 2024-08-27T02:49:35.703 INFO:tasks.workunit.client.0.smithi143.stdout: Successfully uninstalled pip-22.0.2 2024-08-27T02:49:36.741 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed pip-24.2 2024-08-27T02:49:37.794 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting boto3 2024-08-27T02:49:37.796 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached boto3-1.35.6-py3-none-any.whl.metadata (6.6 kB) 2024-08-27T02:49:38.287 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting botocore<1.36.0,>=1.35.6 (from boto3) 2024-08-27T02:49:38.288 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached botocore-1.35.6-py3-none-any.whl.metadata (5.7 kB) 2024-08-27T02:49:38.335 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-08-27T02:49:38.336 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-08-27T02:49:38.381 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-08-27T02:49:38.382 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-08-27T02:49:38.433 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:49:38.434 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-08-27T02:49:38.512 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:49:38.513 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-08-27T02:49:38.655 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:49:38.656 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-27T02:49:38.659 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached boto3-1.35.6-py3-none-any.whl (139 kB) 2024-08-27T02:49:38.661 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached botocore-1.35.6-py3-none-any.whl (12.5 MB) 2024-08-27T02:49:38.671 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-08-27T02:49:38.672 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-08-27T02:49:38.673 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-08-27T02:49:38.674 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-08-27T02:49:38.676 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-27T02:49:38.743 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-08-27T02:49:39.813 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed boto3-1.35.6 botocore-1.35.6 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-08-27T02:49:40.409 INFO:tasks.workunit.client.0.smithi143.stdout:INFO: creating user 2024-08-27T02:49:40.548 INFO:tasks.workunit.client.0.smithi143.stdout:{ 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "user_id": "testid", 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "display_name": "M. Tester", 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "email": "tester@ceph.com", 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "suspended": 0, 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "max_buckets": 1000, 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "subusers": [], 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "keys": [ 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: { 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "user": "testid", 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "access_key": "0555b35654ad1656d804", 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "active": true, 2024-08-27T02:49:40.549 INFO:tasks.workunit.client.0.smithi143.stdout: "create_date": "2024-08-27T02:49:40.542874Z" 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: } 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: ], 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "swift_keys": [], 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "caps": [], 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "default_placement": "", 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "default_storage_class": "", 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "placement_tags": [], 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "bucket_quota": { 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "enabled": false, 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size": -1, 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:49:40.550 INFO:tasks.workunit.client.0.smithi143.stdout: "max_objects": -1 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "user_quota": { 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "enabled": false, 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size": -1, 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "max_objects": -1 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: }, 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "temp_url_keys": [], 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "type": "rgw", 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "mfa_ids": [], 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "account_id": "", 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "path": "/", 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "create_date": "2024-08-27T02:49:40.542864Z", 2024-08-27T02:49:40.551 INFO:tasks.workunit.client.0.smithi143.stdout: "tags": [], 2024-08-27T02:49:40.552 INFO:tasks.workunit.client.0.smithi143.stdout: "group_ids": [] 2024-08-27T02:49:40.552 INFO:tasks.workunit.client.0.smithi143.stdout:} 2024-08-27T02:49:40.552 INFO:tasks.workunit.client.0.smithi143.stdout: 2024-08-27T02:49:41.023 INFO:tasks.workunit.client.0.smithi143.stderr:5+0 records in 2024-08-27T02:49:41.023 INFO:tasks.workunit.client.0.smithi143.stderr:5+0 records out 2024-08-27T02:49:41.023 INFO:tasks.workunit.client.0.smithi143.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0230057 s, 228 MB/s 2024-08-27T02:50:20.021 INFO:tasks.workunit.client.0.smithi143.stdout:bucket nams is reupload-bkt-115766 2024-08-27T02:50:20.021 INFO:tasks.workunit.client.0.smithi143.stdout:endpoint is http://smithi143.front.sepia.ceph.com:80 2024-08-27T02:50:20.021 INFO:tasks.workunit.client.0.smithi143.stdout:start UploadId=2~TeJlM6lDWsJJR62n28JfoZmdEp_Vt-L 2024-08-27T02:50:20.021 INFO:tasks.workunit.client.0.smithi143.stdout:phase 1 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.021 INFO:tasks.workunit.client.0.smithi143.stdout:phase 1 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 2} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.022 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.023 INFO:tasks.workunit.client.0.smithi143.stdout:phase 2 uploaded part {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1} 2024-08-27T02:50:20.023 INFO:tasks.workunit.client.0.smithi143.stdout:completing multipart upload, parts=[{'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 1}, {'ETag': '"f199659200bf9ab1568ca21fccad7563"', 'PartNumber': 2}] 2024-08-27T02:50:21.296 INFO:tasks.workunit.client.0.smithi143.stdout:radosgw-admin bucket radoslist: 2024-08-27T02:50:21.297 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3__:92VOvuby4XyOFI4baIzYjKvnpGLuizd_mpu_test4 2024-08-27T02:50:21.297 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3_mpu_test4 2024-08-27T02:50:21.297 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3__multipart_mpu_test4.2~TeJlM6lDWsJJR62n28JfoZmdEp_Vt-L.2 2024-08-27T02:50:21.297 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3__multipart_mpu_test4.gJJu8M6KiGGNREcxtUluFcrj_AjswPqj.1 2024-08-27T02:50:21.384 INFO:tasks.workunit.client.0.smithi143.stdout:rados ls: 2024-08-27T02:50:21.385 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3__:92VOvuby4XyOFI4baIzYjKvnpGLuizd_mpu_test4 2024-08-27T02:50:21.385 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3_mpu_test4 2024-08-27T02:50:21.385 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3__multipart_mpu_test4.2~TeJlM6lDWsJJR62n28JfoZmdEp_Vt-L.2 2024-08-27T02:50:21.385 INFO:tasks.workunit.client.0.smithi143.stdout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3__multipart_mpu_test4.gJJu8M6KiGGNREcxtUluFcrj_AjswPqj.1 2024-08-27T02:50:21.395 INFO:tasks.workunit.client.0.smithi143.stdout:== PASSED == 2024-08-27T02:50:21.396 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:50:21.396 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:50:21.446 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-08-27T02:50:21.446 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-27T02:50:21.845 DEBUG:teuthology.parallel:result is None 2024-08-27T02:50:21.846 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:50:21.857 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:50:21.858 DEBUG:teuthology.orchestra.run.smithi143:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:50:21.909 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:50:21.909 INFO:teuthology.run_tasks:Running task ragweed... 2024-08-27T02:50:21.923 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-08-27T02:50:21.923 INFO:tasks.ragweed:Downloading ragweed... 2024-08-27T02:50:21.923 INFO:tasks.ragweed:Using branch 'pr-56597' for ragweed 2024-08-27T02:50:21.923 DEBUG:teuthology.orchestra.run.smithi143:> git clone -b pr-56597 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-08-27T02:50:21.957 INFO:teuthology.orchestra.run.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-08-27T02:50:22.014 INFO:teuthology.orchestra.run.smithi143.stderr:fatal: Remote branch pr-56597 not found in upstream origin 2024-08-27T02:50:22.015 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-08-27T02:50:22.016 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-08-27T02:50:22.016 DEBUG:teuthology.orchestra.run.smithi143:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-08-27T02:50:22.062 INFO:teuthology.orchestra.run.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-08-27T02:50:22.245 INFO:tasks.ragweed:Creating rgw users... 2024-08-27T02:50:22.246 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-08-27T02:50:22.246 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PTORMECOYFQACTCGGEMK --secret 433TH02HsxUGgcdNejEXPDDjR+yK/iqhSWLFm8RhEpu7ccwHCLDgJg== --email ragweed.client.0+test@test.test --system false 2024-08-27T02:50:22.336 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:50:22.336 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:50:22.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.379+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 realm 2024-08-27T02:50:22.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:50:22.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:50:22.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:50:22.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.383+0000 7f50f4b309c0 20 searching for the correct realm 2024-08-27T02:50:22.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.595+0000 7f50f1e35640 0 -- 172.21.15.143:0/4067140181 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x561efa0b7a70 msgr2=0x561efa0b9f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:50:22.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.603+0000 7f50f2636640 0 -- 172.21.15.143:0/4067140181 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f50dc054090 msgr2=0x7f50dc068a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:50:22.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:50:22.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:50:22.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:50:22.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:50:22.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:50:22.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:50:22.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:50:22.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.615+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 zone default found 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 4 Realm: () 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 zonegroup default 2024-08-27T02:50:22.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 started sync module instance, tier type = 2024-08-27T02:50:22.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.619+0000 7f50f4b309c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:50:22.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=0 2024-08-27T02:50:22.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=1 2024-08-27T02:50:22.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=2 2024-08-27T02:50:22.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=3 2024-08-27T02:50:22.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=4 2024-08-27T02:50:22.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=5 2024-08-27T02:50:22.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=6 2024-08-27T02:50:22.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 20 add_watcher() i=7 2024-08-27T02:50:22.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.643+0000 7f50f4b309c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:50:22.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.647+0000 7f4fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:50:22.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.647+0000 7f50f4b309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:50:22.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.647+0000 7f50f4b309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:50:22.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.647+0000 7f50f4b309c0 5 note: GC not initialized 2024-08-27T02:50:22.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.647+0000 7f4fa37fe640 20 reqs_thread_entry: start 2024-08-27T02:50:22.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 init_complete bucket index max shards: 11 2024-08-27T02:50:22.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 Filter name: none 2024-08-27T02:50:22.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f4fa17fa640 20 reqs_thread_entry: start 2024-08-27T02:50:22.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-08-27T02:50:22.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-08-27T02:50:22.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-08-27T02:50:22.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache get: name=default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK : miss 2024-08-27T02:50:22.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache put: name=default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK info.flags=0x0 2024-08-27T02:50:22.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 adding default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK to cache LRU end 2024-08-27T02:50:22.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache get: name=default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK : hit (negative entry) 2024-08-27T02:50:22.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.651+0000 7f50f4b309c0 10 cache get: name=default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK : hit (negative entry) 2024-08-27T02:50:22.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.655+0000 7f50f4b309c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-08-27T02:50:22.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.655+0000 7f50f4b309c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-27T02:50:22.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.655+0000 7f50f4b309c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-08-27T02:50:22.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.655+0000 7f4fd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627798 cookie 94691044086784 notifier 5672 bl.length()=675 2024-08-27T02:50:22.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.655+0000 7f4fd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-08-27T02:50:22.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.655+0000 7f4fd5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-27T02:50:22.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.663+0000 7f50f4b309c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-08-27T02:50:22.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.663+0000 7f50f4b309c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-08-27T02:50:22.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.663+0000 7f50f4b309c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-08-27T02:50:22.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.663+0000 7f4fd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627785 cookie 94691044081344 notifier 5672 bl.length()=202 2024-08-27T02:50:22.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.663+0000 7f4fd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-08-27T02:50:22.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.663+0000 7f4fd57fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-08-27T02:50:22.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.667+0000 7f50f4b309c0 10 cache put: name=default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK info.flags=0x7 2024-08-27T02:50:22.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.667+0000 7f50f4b309c0 10 moving default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK to cache LRU end 2024-08-27T02:50:22.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.667+0000 7f50f4b309c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:PTORMECOYFQACTCGGEMK, ofs0, ns] 2024-08-27T02:50:22.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.667+0000 7f4fd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627825 cookie 94691044079072 notifier 5672 bl.length()=190 2024-08-27T02:50:22.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.667+0000 7f4fd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK info.flags=0x7 2024-08-27T02:50:22.665 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.667+0000 7f4fd57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PTORMECOYFQACTCGGEMK to cache LRU end 2024-08-27T02:50:22.666 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T02:50:22.666 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "ragweed.client.0", 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr. ragweed.client.0", 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "ragweed.client.0+test@test.test", 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "ragweed.client.0", 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "PTORMECOYFQACTCGGEMK", 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "433TH02HsxUGgcdNejEXPDDjR+yK/iqhSWLFm8RhEpu7ccwHCLDgJg==", 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T02:50:22.667 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T02:50:22.655363Z" 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T02:50:22.668 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "rgw", 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "", 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T02:50:22.669 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T02:50:22.655341Z", 2024-08-27T02:50:22.670 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T02:50:22.670 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T02:50:22.670 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T02:50:22.670 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:50:22.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.671+0000 7f4fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:50:22.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.675+0000 7f50f4b309c0 20 remove_watcher() i=0 2024-08-27T02:50:22.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.675+0000 7f50f4b309c0 2 removed watcher, disabling cache 2024-08-27T02:50:22.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.679+0000 7f50f4b309c0 20 remove_watcher() i=1 2024-08-27T02:50:22.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.683+0000 7f50f4b309c0 20 remove_watcher() i=2 2024-08-27T02:50:22.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.683+0000 7f50f4b309c0 20 remove_watcher() i=3 2024-08-27T02:50:22.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.687+0000 7f50f4b309c0 20 remove_watcher() i=4 2024-08-27T02:50:22.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.687+0000 7f50f4b309c0 20 remove_watcher() i=5 2024-08-27T02:50:22.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.687+0000 7f50f4b309c0 20 remove_watcher() i=6 2024-08-27T02:50:22.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.691+0000 7f50f4b309c0 20 remove_watcher() i=7 2024-08-27T02:50:22.702 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-08-27T02:50:22.702 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key IYZWYDFDZIKTSHWUVTQG --secret pO5IA92MVKpGtacu+aqMPwk8hh+ozKNiy+jn48ca3X4UD7P29Zptng== --email sysuser.client.0+test@test.test --system true 2024-08-27T02:50:22.747 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:50:22.747 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:50:22.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 realm 2024-08-27T02:50:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:50:22.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.791+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.795+0000 7fc9840719c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:50:22.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.795+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.795+0000 7fc9840719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:50:22.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.795+0000 7fc9840719c0 20 searching for the correct realm 2024-08-27T02:50:22.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.803+0000 7fc981376640 0 -- 172.21.15.143:0/2009288365 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc97407a110 msgr2=0x7fc97409fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:50:22.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.807+0000 7fc981376640 0 -- 172.21.15.143:0/2009288365 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc84c07f540 msgr2=0x7fc84c081970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:50:22.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 zone default found 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 4 Realm: () 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 zonegroup default 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 started sync module instance, tier type = 2024-08-27T02:50:22.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.815+0000 7fc9840719c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:50:22.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.831+0000 7fc9840719c0 20 add_watcher() i=0 2024-08-27T02:50:22.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.831+0000 7fc9840719c0 20 add_watcher() i=1 2024-08-27T02:50:22.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.831+0000 7fc9840719c0 20 add_watcher() i=2 2024-08-27T02:50:22.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.831+0000 7fc9840719c0 20 add_watcher() i=3 2024-08-27T02:50:22.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.831+0000 7fc9840719c0 20 add_watcher() i=4 2024-08-27T02:50:22.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.831+0000 7fc9840719c0 20 add_watcher() i=5 2024-08-27T02:50:22.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.831+0000 7fc9840719c0 20 add_watcher() i=6 2024-08-27T02:50:22.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc9840719c0 20 add_watcher() i=7 2024-08-27T02:50:22.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc9840719c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:50:22.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc8337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:50:22.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc9840719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:50:22.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc9840719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:50:22.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc9840719c0 5 note: GC not initialized 2024-08-27T02:50:22.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc8327fc640 20 reqs_thread_entry: start 2024-08-27T02:50:22.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.835+0000 7fc9840719c0 20 init_complete bucket index max shards: 11 2024-08-27T02:50:22.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 20 Filter name: none 2024-08-27T02:50:22.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc7a3fff640 20 reqs_thread_entry: start 2024-08-27T02:50:22.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-08-27T02:50:22.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-08-27T02:50:22.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache get: name=default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG : miss 2024-08-27T02:50:22.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 20 rados->read ofs=0 len=0 2024-08-27T02:50:22.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:50:22.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache put: name=default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG info.flags=0x0 2024-08-27T02:50:22.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 adding default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG to cache LRU end 2024-08-27T02:50:22.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache get: name=default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG : hit (negative entry) 2024-08-27T02:50:22.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache get: name=default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG : hit (negative entry) 2024-08-27T02:50:22.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-08-27T02:50:22.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-27T02:50:22.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.839+0000 7fc9840719c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-08-27T02:50:22.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.843+0000 7fc8657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627786 cookie 94316717259056 notifier 5931 bl.length()=675 2024-08-27T02:50:22.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.843+0000 7fc8657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-08-27T02:50:22.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.843+0000 7fc8657fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-27T02:50:22.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.847+0000 7fc9840719c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-08-27T02:50:22.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.847+0000 7fc9840719c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-08-27T02:50:22.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.847+0000 7fc9840719c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-08-27T02:50:22.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.847+0000 7fc864ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627799 cookie 94316717265616 notifier 5931 bl.length()=202 2024-08-27T02:50:22.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.847+0000 7fc864ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-08-27T02:50:22.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.847+0000 7fc864ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-08-27T02:50:22.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.851+0000 7fc9840719c0 10 cache put: name=default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG info.flags=0x7 2024-08-27T02:50:22.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.851+0000 7fc9840719c0 10 moving default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG to cache LRU end 2024-08-27T02:50:22.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.851+0000 7fc9840719c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:IYZWYDFDZIKTSHWUVTQG, ofs0, ns] 2024-08-27T02:50:22.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.851+0000 7fc8657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627784 cookie 94316717262896 notifier 5931 bl.length()=190 2024-08-27T02:50:22.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.851+0000 7fc8657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG info.flags=0x7 2024-08-27T02:50:22.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.851+0000 7fc8657fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IYZWYDFDZIKTSHWUVTQG to cache LRU end 2024-08-27T02:50:22.848 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T02:50:22.848 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "sysuser.client.0", 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr. sysuser.client.0", 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "sysuser.client.0+test@test.test", 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "sysuser.client.0", 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "IYZWYDFDZIKTSHWUVTQG", 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "pO5IA92MVKpGtacu+aqMPwk8hh+ozKNiy+jn48ca3X4UD7P29Zptng==", 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T02:50:22.849 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T02:50:22.841991Z" 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "system": true, 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:50:22.850 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "rgw", 2024-08-27T02:50:22.851 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "", 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T02:50:22.841971Z", 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:50:22.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.855+0000 7fc8337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:50:22.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.859+0000 7fc9840719c0 20 remove_watcher() i=0 2024-08-27T02:50:22.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.859+0000 7fc9840719c0 2 removed watcher, disabling cache 2024-08-27T02:50:22.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.859+0000 7fc9840719c0 20 remove_watcher() i=1 2024-08-27T02:50:22.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.863+0000 7fc9840719c0 20 remove_watcher() i=2 2024-08-27T02:50:22.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.863+0000 7fc9840719c0 20 remove_watcher() i=3 2024-08-27T02:50:22.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.867+0000 7fc9840719c0 20 remove_watcher() i=4 2024-08-27T02:50:22.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.867+0000 7fc9840719c0 20 remove_watcher() i=5 2024-08-27T02:50:22.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.871+0000 7fc9840719c0 20 remove_watcher() i=6 2024-08-27T02:50:22.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:50:22.871+0000 7fc9840719c0 20 remove_watcher() i=7 2024-08-27T02:50:22.880 INFO:tasks.ragweed:Configuring ragweed... 2024-08-27T02:50:22.880 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:50:22.880 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-08-27T02:50:22.885 INFO:tasks.ragweed:Configuring boto... 2024-08-27T02:50:22.885 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:50:22.885 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-08-27T02:50:22.933 DEBUG:teuthology.orchestra.run.smithi143:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-08-27T02:50:23.117 INFO:teuthology.orchestra.run.smithi143.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-08-27T02:50:23.299 INFO:teuthology.orchestra.run.smithi143.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-08-27T02:50:23.829 INFO:teuthology.orchestra.run.smithi143.stdout:py installdeps: -rrequirements.txt 2024-08-27T02:50:26.602 INFO:teuthology.orchestra.run.smithi143.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-08-27T02:50:28.819 INFO:teuthology.orchestra.run.smithi143.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=8b8df38bbee554669e2924a769fbc770c40efbec6631e2bb7a0cc21c8831c796,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-08-27T02:50:28.820 INFO:teuthology.orchestra.run.smithi143.stdout:py run-test-pre: PYTHONHASHSEED='2524322738' 2024-08-27T02:50:28.820 INFO:teuthology.orchestra.run.smithi143.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-08-27T02:50:28.991 INFO:teuthology.orchestra.run.smithi143.stdout:============================= test session starts ============================== 2024-08-27T02:50:28.991 INFO:teuthology.orchestra.run.smithi143.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-08-27T02:50:28.991 INFO:teuthology.orchestra.run.smithi143.stdout:cachedir: .tox/py/.pytest_cache 2024-08-27T02:50:28.991 INFO:teuthology.orchestra.run.smithi143.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-08-27T02:50:29.171 INFO:teuthology.orchestra.run.smithi143.stdout:collecting ... collected 9 items 2024-08-27T02:50:29.171 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:50:34.416 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-08-27T02:50:38.251 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-08-27T02:50:41.805 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-08-27T02:50:45.847 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-08-27T02:50:50.199 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-08-27T02:51:01.586 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-08-27T02:51:11.364 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-08-27T02:51:21.032 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-08-27T02:51:37.073 INFO:teuthology.orchestra.run.smithi143.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-08-27T02:51:37.073 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:51:37.074 INFO:teuthology.orchestra.run.smithi143.stdout:=============================== warnings summary =============================== 2024-08-27T02:51:37.074 INFO:teuthology.orchestra.run.smithi143.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-08-27T02:51:37.074 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-08-27T02:51:37.074 INFO:teuthology.orchestra.run.smithi143.stdout: import imp 2024-08-27T02:51:37.074 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:51:37.074 INFO:teuthology.orchestra.run.smithi143.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-08-27T02:51:37.074 INFO:teuthology.orchestra.run.smithi143.stdout:=================== 9 passed, 1 warning in 68.08s (0:01:08) ==================== 2024-08-27T02:51:37.124 INFO:teuthology.orchestra.run.smithi143.stdout:___________________________________ summary ____________________________________ 2024-08-27T02:51:37.124 INFO:teuthology.orchestra.run.smithi143.stdout: py: commands succeeded 2024-08-27T02:51:37.124 INFO:teuthology.orchestra.run.smithi143.stdout: congratulations :) 2024-08-27T02:51:37.149 INFO:tasks.ragweed:Cleaning up boto... 2024-08-27T02:51:37.150 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-08-27T02:51:37.156 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-08-27T02:51:37.234 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:51:37.234 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:51:37.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.276+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.276+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.276+0000 7f073c2d79c0 20 realm 2024-08-27T02:51:37.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.276+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.276+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.276+0000 7f073c2d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:51:37.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.276+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.280+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.280+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.280+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:51:37.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.280+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.280+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:51:37.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.280+0000 7f073c2d79c0 20 searching for the correct realm 2024-08-27T02:51:37.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.288+0000 7f07395dc640 0 -- 172.21.15.143:0/3903985254 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x562bfe3bd390 msgr2=0x562bfe3bf850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:51:37.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.292+0000 7f0739ddd640 0 -- 172.21.15.143:0/3903985254 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f07340a03a0 msgr2=0x7f073400f9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:51:37.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:51:37.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:51:37.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:51:37.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:51:37.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:51:37.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:51:37.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.300+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 zone default found 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 4 Realm: () 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 zonegroup default 2024-08-27T02:51:37.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 started sync module instance, tier type = 2024-08-27T02:51:37.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.304+0000 7f073c2d79c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:51:37.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.320+0000 7f073c2d79c0 20 add_watcher() i=0 2024-08-27T02:51:37.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.320+0000 7f073c2d79c0 20 add_watcher() i=1 2024-08-27T02:51:37.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.320+0000 7f073c2d79c0 20 add_watcher() i=2 2024-08-27T02:51:37.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.320+0000 7f073c2d79c0 20 add_watcher() i=3 2024-08-27T02:51:37.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.320+0000 7f073c2d79c0 20 add_watcher() i=4 2024-08-27T02:51:37.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.320+0000 7f073c2d79c0 20 add_watcher() i=5 2024-08-27T02:51:37.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.320+0000 7f073c2d79c0 20 add_watcher() i=6 2024-08-27T02:51:37.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.324+0000 7f073c2d79c0 20 add_watcher() i=7 2024-08-27T02:51:37.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.324+0000 7f073c2d79c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:51:37.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.324+0000 7f05eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:51:37.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.324+0000 7f073c2d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:51:37.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.324+0000 7f073c2d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:51:37.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.404+0000 7f05edfe3640 20 reqs_thread_entry: start 2024-08-27T02:51:37.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.404+0000 7f073c2d79c0 20 init_complete bucket index max shards: 11 2024-08-27T02:51:37.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.404+0000 7f073c2d79c0 20 Filter name: none 2024-08-27T02:51:37.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.404+0000 7f055f7fe640 20 reqs_thread_entry: start 2024-08-27T02:51:37.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.404+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-08-27T02:51:37.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.404+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=486 2024-08-27T02:51:37.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-08-27T02:51:37.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-08-27T02:51:37.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 : miss 2024-08-27T02:51:37.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=426 2024-08-27T02:51:37.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 info.flags=0x17 2024-08-27T02:51:37.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 to cache LRU end 2024-08-27T02:51:37.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:37.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.408+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 2024-08-27T02:51:37.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-08-27T02:51:37.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-08-27T02:51:37.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-08-27T02:51:37.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-08-27T02:51:37.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-08-27T02:51:37.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-08-27T02:51:37.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-08-27T02:51:37.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-08-27T02:51:37.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-08-27T02:51:37.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.416+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.416+0000 7f073c2d79c0 10 manifest: total_size = 7752 2024-08-27T02:51:37.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.416+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17845348312195308310 2024-08-27T02:51:37.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.416+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.416+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.416+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.1 2024-08-27T02:51:37.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=7752 stripe_ofs=7752 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17845348312195308310 2024-08-27T02:51:37.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.CKzArEVS6mloU9jwWWQn23nOYbdGfGl_0 2024-08-27T02:51:37.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-08-27T02:51:37.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.420+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17845348312195308310 2024-08-27T02:51:37.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.424+0000 7f060ffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-08-27T02:51:37.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.424+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.424+0000 7f073c2d79c0 10 manifest: total_size = 12813 2024-08-27T02:51:37.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.424+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5397974099950019039 2024-08-27T02:51:37.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.424+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.424+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.424+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.2 2024-08-27T02:51:37.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=12813 stripe_ofs=12813 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5397974099950019039 2024-08-27T02:51:37.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.aB9b4HGRYzoKEIvMpSm7D48gAB3m1B2_0 2024-08-27T02:51:37.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:37.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5397974099950019039 2024-08-27T02:51:37.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-08-27T02:51:37.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.432+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.436+0000 7f073c2d79c0 10 manifest: total_size = 5278 2024-08-27T02:51:37.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.436+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13281359917374753065 2024-08-27T02:51:37.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.436+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.436+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.436+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.2 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5278 stripe_ofs=5278 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13281359917374753065 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.iZbh8aZp2x9DuAo5SpCdNU7ShM8sEch_0 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13281359917374753065 2024-08-27T02:51:37.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.440+0000 7f060ffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-08-27T02:51:37.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.444+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.444+0000 7f073c2d79c0 10 manifest: total_size = 13087 2024-08-27T02:51:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.444+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1597749818344361333 2024-08-27T02:51:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.444+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.444+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.444+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.3 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=13087 stripe_ofs=13087 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1597749818344361333 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_._9m3P_xYwqYM7aBV6rsPcSCX6KJu-t4_0 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1597749818344361333 2024-08-27T02:51:37.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.448+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-08-27T02:51:37.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.452+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.452+0000 7f073c2d79c0 10 manifest: total_size = 5244 2024-08-27T02:51:37.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.452+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5893125081181443936 2024-08-27T02:51:37.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.452+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.452+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.452+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.4 2024-08-27T02:51:37.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5244 stripe_ofs=5244 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5893125081181443936 2024-08-27T02:51:37.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.UwUKY_7Mqpx_5PZ4RijBpEwGU8ZCGY9_0 2024-08-27T02:51:37.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:37.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5893125081181443936 2024-08-27T02:51:37.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f060ffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-08-27T02:51:37.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.456+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.460+0000 7f073c2d79c0 10 manifest: total_size = 7622 2024-08-27T02:51:37.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.460+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3450394327470063873 2024-08-27T02:51:37.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.460+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.460+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.460+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.4 2024-08-27T02:51:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=7622 stripe_ofs=7622 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3450394327470063873 2024-08-27T02:51:37.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_._92g-E-J27HtLwafgFpAP2-QHAAYHYN_0 2024-08-27T02:51:37.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:37.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3450394327470063873 2024-08-27T02:51:37.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.464+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-08-27T02:51:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.468+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.468+0000 7f073c2d79c0 10 manifest: total_size = 4869 2024-08-27T02:51:37.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.468+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6830176550805702513 2024-08-27T02:51:37.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.468+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.468+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.468+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.5 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=4869 stripe_ofs=4869 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6830176550805702513 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.MmGV5w0jkf0bqLRiYtw704_8TPXiPzp_0 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.472+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6830176550805702513 2024-08-27T02:51:37.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.476+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.476+0000 7f073c2d79c0 10 manifest: total_size = 7809 2024-08-27T02:51:37.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.476+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10415926590581396717 2024-08-27T02:51:37.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.476+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240d8ad0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.476+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.476+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.7 2024-08-27T02:51:37.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.476+0000 7f060ffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=7809 stripe_ofs=7809 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10415926590581396717 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.n08LFwXyIV_hSVLxE-wts0WJoVJ7515_0 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.480+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10415926590581396717 2024-08-27T02:51:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.484+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734077150 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.484+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-08-27T02:51:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.484+0000 7f073c2d79c0 10 manifest: total_size = 38488 2024-08-27T02:51:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.484+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9843786184789892698 2024-08-27T02:51:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.484+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734077150 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562bfe46b5d8 s->prefetch_data=0 2024-08-27T02:51:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.484+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe46b5d8 2024-08-27T02:51:37.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.484+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4.8 2024-08-27T02:51:37.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=38488 stripe_ofs=38488 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9843786184789892698 2024-08-27T02:51:37.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.AqolxfjUMNK-ANLPOfi1svmS3SmjmO8_0 2024-08-27T02:51:37.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:37.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.488+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9843786184789892698 2024-08-27T02:51:37.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f060ffff640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-08-27T02:51:37.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:37.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:37.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:37.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:37.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:37.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:37.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.492+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:37.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.496+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-08-27T02:51:37.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.496+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.496+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=204 2024-08-27T02:51:37.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.496+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-08-27T02:51:37.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.496+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-08-27T02:51:37.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.500+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-08-27T02:51:37.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.500+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-08-27T02:51:37.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.500+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94746948885760 notifier 5964 bl.length()=162 2024-08-27T02:51:37.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.504+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 from cache 2024-08-27T02:51:37.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.504+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4, ofs0, ns] 2024-08-27T02:51:37.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.504+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431584 cookie 94746948928272 notifier 5964 bl.length()=219 2024-08-27T02:51:37.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.512+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 : miss 2024-08-27T02:51:37.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.512+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.512+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.512+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 info.flags=0x0 2024-08-27T02:51:37.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.512+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4 to cache LRU end 2024-08-27T02:51:37.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 : miss 2024-08-27T02:51:37.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=457 2024-08-27T02:51:37.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 info.flags=0x17 2024-08-27T02:51:37.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 to cache LRU end 2024-08-27T02:51:37.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:37.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.516+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 2024-08-27T02:51:37.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.528+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo 2024-08-27T02:51:37.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.528+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562bfe3f7cf8 s->prefetch_data=0 2024-08-27T02:51:37.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.528+0000 7f073c2d79c0 10 manifest: total_size = 886297 2024-08-27T02:51:37.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.528+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13435006586829840363 2024-08-27T02:51:37.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.528+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562bfe3f7cf8 s->prefetch_data=0 2024-08-27T02:51:37.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.528+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3f7cf8 2024-08-27T02:51:37.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.528+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11.10 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-08-27T02:51:37.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13435006586829840363 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.1 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.2 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.3 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.4 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.532+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13435006586829840363 2024-08-27T02:51:37.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.536+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo 2024-08-27T02:51:37.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.536+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:37.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.536+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:37.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.540+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.540+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.540+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.540+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:37.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.540+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:37.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.544+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-08-27T02:51:37.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.544+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.544+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=235 2024-08-27T02:51:37.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.544+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-08-27T02:51:37.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.544+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-08-27T02:51:37.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.548+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-08-27T02:51:37.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.548+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-08-27T02:51:37.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.548+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94746948919296 notifier 5964 bl.length()=191 2024-08-27T02:51:37.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.552+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 from cache 2024-08-27T02:51:37.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.552+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11, ofs0, ns] 2024-08-27T02:51:37.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.552+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94746948931824 notifier 5964 bl.length()=249 2024-08-27T02:51:37.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.560+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 : miss 2024-08-27T02:51:37.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.560+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.560+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.560+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 info.flags=0x0 2024-08-27T02:51:37.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.560+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11 to cache LRU end 2024-08-27T02:51:37.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 : miss 2024-08-27T02:51:37.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=464 2024-08-27T02:51:37.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 info.flags=0x17 2024-08-27T02:51:37.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 to cache LRU end 2024-08-27T02:51:37.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:37.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.564+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 2024-08-27T02:51:37.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.576+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo 2024-08-27T02:51:37.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.576+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c028f80 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562bfe271c18 s->prefetch_data=0 2024-08-27T02:51:37.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.576+0000 7f073c2d79c0 10 manifest: total_size = 18874368 2024-08-27T02:51:37.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.576+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14273655400213239496 2024-08-27T02:51:37.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.576+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c028f80 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562bfe271c18 s->prefetch_data=0 2024-08-27T02:51:37.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.576+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe271c18 2024-08-27T02:51:37.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.576+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12.10 2024-08-27T02:51:37.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:37.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-08-27T02:51:37.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:37.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:37.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:37.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14273655400213239496 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.1 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.2 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-08-27T02:51:37.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.3 2024-08-27T02:51:37.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-08-27T02:51:37.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.4 2024-08-27T02:51:37.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-08-27T02:51:37.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.580+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14273655400213239496 2024-08-27T02:51:37.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.584+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo 2024-08-27T02:51:37.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.584+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:37.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.584+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:37.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.588+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:37.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.588+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:37.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.588+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:37.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.588+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:37.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.588+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:37.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.592+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-08-27T02:51:37.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.592+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.592+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=242 2024-08-27T02:51:37.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.592+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-08-27T02:51:37.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.592+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-08-27T02:51:37.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.596+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-08-27T02:51:37.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.596+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-08-27T02:51:37.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.596+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431568 cookie 94746948883552 notifier 5964 bl.length()=198 2024-08-27T02:51:37.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.604+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 from cache 2024-08-27T02:51:37.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.604+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12, ofs0, ns] 2024-08-27T02:51:37.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.604+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 94746948921504 notifier 5964 bl.length()=256 2024-08-27T02:51:37.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.612+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 : miss 2024-08-27T02:51:37.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.612+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.612+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.612+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 info.flags=0x0 2024-08-27T02:51:37.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.612+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12 to cache LRU end 2024-08-27T02:51:37.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 : miss 2024-08-27T02:51:37.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=459 2024-08-27T02:51:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 info.flags=0x17 2024-08-27T02:51:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 to cache LRU end 2024-08-27T02:51:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:37.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.616+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 2024-08-27T02:51:37.626 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.628+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo[2OzE7GRqhzi.H4zs92p-KpNFk3q5z49] 2024-08-27T02:51:37.626 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.628+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10.10 2024-08-27T02:51:37.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.628+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004600 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562bfe417548 s->prefetch_data=0 2024-08-27T02:51:37.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.628+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to a07e6dnmz5rd57e3h49vu5tcx33kzmhn 2024-08-27T02:51:37.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.628+0000 7f073c2d79c0 20 get_obj_state_impl: setting s->olh_tag to 2rc9i4ztxi6hl9bb9m8l0x6wvvy9urcj 2024-08-27T02:51:37.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.628+0000 7f073c2d79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2rc9i4ztxi6hl9bb9m8l0x6wvvy9urcj 2024-08-27T02:51:37.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.632+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10.10 2024-08-27T02:51:37.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10.10 2024-08-27T02:51:37.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-08-27T02:51:37.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 olh_log_entry: epoch=3 op=3 key=foo[2OzE7GRqhzi.H4zs92p-KpNFk3q5z49] 2024-08-27T02:51:37.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004600 obj=test-client.0-r-test-multipart-index-versioning.1:_:2OzE7GRqhzi.H4zs92p-KpNFk3q5z49_foo state=0x562bfe271c18 s->prefetch_data=0 2024-08-27T02:51:37.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 10 manifest: total_size = 74198 2024-08-27T02:51:37.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9368570598442424896 2024-08-27T02:51:37.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004600 obj=test-client.0-r-test-multipart-index-versioning.1:_:2OzE7GRqhzi.H4zs92p-KpNFk3q5z49_foo state=0x562bfe271c18 s->prefetch_data=0 2024-08-27T02:51:37.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe271c18 2024-08-27T02:51:37.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.636+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10.10 2024-08-27T02:51:37.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9368570598442424896 2024-08-27T02:51:37.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.1 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.2 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.3 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.4 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9368570598442424896 2024-08-27T02:51:37.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.644+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo[2OzE7GRqhzi.H4zs92p-KpNFk3q5z49] 2024-08-27T02:51:37.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.648+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004600 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562bfe417548 s->prefetch_data=0 2024-08-27T02:51:37.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.652+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10.10 2024-08-27T02:51:37.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10.10 2024-08-27T02:51:37.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:37.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:37.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:37.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:37.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:37.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:37.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.656+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:37.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.660+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-08-27T02:51:37.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.660+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.660+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=237 2024-08-27T02:51:37.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.660+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-08-27T02:51:37.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.660+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-08-27T02:51:37.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.664+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-08-27T02:51:37.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.664+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-08-27T02:51:37.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.664+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431569 cookie 94746948883552 notifier 5964 bl.length()=193 2024-08-27T02:51:37.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.668+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 from cache 2024-08-27T02:51:37.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.668+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10, ofs0, ns] 2024-08-27T02:51:37.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.672+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 94746948919296 notifier 5964 bl.length()=251 2024-08-27T02:51:37.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.680+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 : miss 2024-08-27T02:51:37.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.680+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.680+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.680+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 info.flags=0x0 2024-08-27T02:51:37.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.680+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10 to cache LRU end 2024-08-27T02:51:37.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 : miss 2024-08-27T02:51:37.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=447 2024-08-27T02:51:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 info.flags=0x17 2024-08-27T02:51:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 to cache LRU end 2024-08-27T02:51:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:37.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.684+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 2024-08-27T02:51:37.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.692+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo 2024-08-27T02:51:37.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.692+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f6340 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562bfe409c88 s->prefetch_data=0 2024-08-27T02:51:37.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.692+0000 7f073c2d79c0 10 manifest: total_size = 74198 2024-08-27T02:51:37.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.692+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6398504671496126439 2024-08-27T02:51:37.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.692+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f6340 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562bfe409c88 s->prefetch_data=0 2024-08-27T02:51:37.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.692+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe409c88 2024-08-27T02:51:37.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.696+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9.10 2024-08-27T02:51:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-08-27T02:51:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-08-27T02:51:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-08-27T02:51:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-08-27T02:51:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-08-27T02:51:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-08-27T02:51:37.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6398504671496126439 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.1 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.2 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.3 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-08-27T02:51:37.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.4 2024-08-27T02:51:37.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-08-27T02:51:37.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.700+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6398504671496126439 2024-08-27T02:51:37.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.704+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:37.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.704+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:37.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.704+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo 2024-08-27T02:51:37.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.708+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:37.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.708+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:37.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.708+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:37.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.708+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:37.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.708+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:37.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.708+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-08-27T02:51:37.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.708+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.712+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=225 2024-08-27T02:51:37.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.712+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-08-27T02:51:37.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.712+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-08-27T02:51:37.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.712+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-08-27T02:51:37.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.712+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-08-27T02:51:37.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.716+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94746948928272 notifier 5964 bl.length()=183 2024-08-27T02:51:37.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.720+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 from cache 2024-08-27T02:51:37.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.720+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9, ofs0, ns] 2024-08-27T02:51:37.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.720+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 94746948883552 notifier 5964 bl.length()=240 2024-08-27T02:51:37.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.732+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 : miss 2024-08-27T02:51:37.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.732+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.736+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.736+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 info.flags=0x0 2024-08-27T02:51:37.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.736+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9 to cache LRU end 2024-08-27T02:51:37.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 : miss 2024-08-27T02:51:37.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=455 2024-08-27T02:51:37.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 info.flags=0x17 2024-08-27T02:51:37.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 to cache LRU end 2024-08-27T02:51:37.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:37.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 2024-08-27T02:51:37.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.740+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-08-27T02:51:37.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.744+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-08-27T02:51:37.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.744+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-27T02:51:37.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-08-27T02:51:37.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-08-27T02:51:37.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-27T02:51:37.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-08-27T02:51:37.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-27T02:51:37.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-08-27T02:51:37.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-08-27T02:51:37.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-08-27T02:51:37.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.748+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-08-27T02:51:37.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.752+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.752+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.752+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _81D212ofo07J2B3WSiTat9QnZpuY-Iw 2024-08-27T02:51:37.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.752+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.752+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.752+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.0 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _81D212ofo07J2B3WSiTat9QnZpuY-Iw 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.SJQyrHOhjjsYBeEc_D5ZoQ_fwPFeOfM_0 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.756+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _81D212ofo07J2B3WSiTat9QnZpuY-Iw 2024-08-27T02:51:37.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.760+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-08-27T02:51:37.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.760+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.760+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.760+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _Xyzb35TfKkhVltWuQ4kb8OQHVJyz5fd 2024-08-27T02:51:37.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.760+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.760+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.760+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.2 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Xyzb35TfKkhVltWuQ4kb8OQHVJyz5fd 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.RPB9cvyse27pYgxJSjqKy2Kunyno5TX_0 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.768+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _Xyzb35TfKkhVltWuQ4kb8OQHVJyz5fd 2024-08-27T02:51:37.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.772+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562bfe401318 s->prefetch_data=0 2024-08-27T02:51:37.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.772+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-08-27T02:51:37.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.772+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.772+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11908115347689430045 2024-08-27T02:51:37.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.772+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562bfe401318 s->prefetch_data=0 2024-08-27T02:51:37.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.772+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe401318 2024-08-27T02:51:37.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.772+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.3 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11908115347689430045 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.TPq_DYXG2eqjyeRb0J88qHGpHma-GlI_0 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11908115347689430045 2024-08-27T02:51:37.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562bfe401318 s->prefetch_data=0 2024-08-27T02:51:37.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.780+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-27T02:51:37.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.784+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.784+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _6H0_IH7Sp_IDquUdoq0_4VzsDbQgiXv 2024-08-27T02:51:37.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.784+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562bfe401318 s->prefetch_data=0 2024-08-27T02:51:37.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.784+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe401318 2024-08-27T02:51:37.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.784+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.5 2024-08-27T02:51:37.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _6H0_IH7Sp_IDquUdoq0_4VzsDbQgiXv 2024-08-27T02:51:37.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.q7dJ8r0fB9P4Oqhf52ySjb3hDWjJ1Jk_0 2024-08-27T02:51:37.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-27T02:51:37.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.788+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _6H0_IH7Sp_IDquUdoq0_4VzsDbQgiXv 2024-08-27T02:51:37.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.792+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-08-27T02:51:37.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.792+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.792+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.792+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _sRo19q0wqNqJdBYKN_cI2qNLRhgIQF2 2024-08-27T02:51:37.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.792+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.792+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.792+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.5 2024-08-27T02:51:37.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _sRo19q0wqNqJdBYKN_cI2qNLRhgIQF2 2024-08-27T02:51:37.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.n-S-Ly_kfDOvygL-u5ruh8Unswla2Rm_0 2024-08-27T02:51:37.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-27T02:51:37.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _sRo19q0wqNqJdBYKN_cI2qNLRhgIQF2 2024-08-27T02:51:37.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.800+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-08-27T02:51:37.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.804+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.804+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.804+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11698415085266806171 2024-08-27T02:51:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.804+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.804+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.804+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.5 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11698415085266806171 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.VL0XtvXxmCr3PDpX8QXqVj7m5GVyeH2_0 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.808+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11698415085266806171 2024-08-27T02:51:37.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.812+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-27T02:51:37.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.812+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.812+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.812+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _H97z9BAArcmEeNXUtrxSWqFST36zA4K 2024-08-27T02:51:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.812+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.812+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.812+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.7 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _H97z9BAArcmEeNXUtrxSWqFST36zA4K 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.tDETIc7NTCcTUOU-v81kLvXTZLbKb5H_0 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.816+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _H97z9BAArcmEeNXUtrxSWqFST36zA4K 2024-08-27T02:51:37.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.820+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-08-27T02:51:37.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.820+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.820+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.820+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16385088205274346938 2024-08-27T02:51:37.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.820+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3eb430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.820+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.820+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.7 2024-08-27T02:51:37.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16385088205274346938 2024-08-27T02:51:37.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.KbEHqa5TVOcVC24Fb67qxwZRa0bcgJL_0 2024-08-27T02:51:37.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-08-27T02:51:37.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16385088205274346938 2024-08-27T02:51:37.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.828+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-27T02:51:37.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.832+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.832+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.832+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14880595314255087498 2024-08-27T02:51:37.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.832+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.832+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.832+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.7 2024-08-27T02:51:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14880595314255087498 2024-08-27T02:51:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.VL0XtvXxmCr3PDpX8QXqVj7m5GVyeH2_0 2024-08-27T02:51:37.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-08-27T02:51:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.836+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14880595314255087498 2024-08-27T02:51:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.840+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-08-27T02:51:37.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.840+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.840+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.840+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3812342768397689261 2024-08-27T02:51:37.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.840+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.840+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.840+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.8 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3812342768397689261 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.KbEHqa5TVOcVC24Fb67qxwZRa0bcgJL_0 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.844+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3812342768397689261 2024-08-27T02:51:37.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.848+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-08-27T02:51:37.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.848+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.848+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.848+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _O1v3-fraq0O-nxPCE_VT5ydA9HWQZjv 2024-08-27T02:51:37.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.848+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.848+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.848+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.8 2024-08-27T02:51:37.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _O1v3-fraq0O-nxPCE_VT5ydA9HWQZjv 2024-08-27T02:51:37.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.5YxajOCAsilaKGzCxMphXHTLt8hgqJI_0 2024-08-27T02:51:37.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-27T02:51:37.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _O1v3-fraq0O-nxPCE_VT5ydA9HWQZjv 2024-08-27T02:51:37.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.856+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-08-27T02:51:37.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.860+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.860+0000 7f073c2d79c0 10 manifest: total_size = 5242880 2024-08-27T02:51:37.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.860+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13167264532570149005 2024-08-27T02:51:37.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.860+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734004dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562bfe2728e8 s->prefetch_data=0 2024-08-27T02:51:37.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.860+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe2728e8 2024-08-27T02:51:37.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.860+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15.9 2024-08-27T02:51:37.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13167264532570149005 2024-08-27T02:51:37.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.TPq_DYXG2eqjyeRb0J88qHGpHma-GlI_0 2024-08-27T02:51:37.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-08-27T02:51:37.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13167264532570149005 2024-08-27T02:51:37.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-08-27T02:51:37.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:37.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.868+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.872+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.872+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.872+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.872+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:37.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.872+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:37.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.876+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-08-27T02:51:37.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.876+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.876+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=233 2024-08-27T02:51:37.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.876+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-08-27T02:51:37.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.876+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-08-27T02:51:37.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.880+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-08-27T02:51:37.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.880+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-08-27T02:51:37.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.880+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 94746948883552 notifier 5964 bl.length()=189 2024-08-27T02:51:37.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.884+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 from cache 2024-08-27T02:51:37.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.884+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15, ofs0, ns] 2024-08-27T02:51:37.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.888+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94746948919296 notifier 5964 bl.length()=247 2024-08-27T02:51:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.896+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 : miss 2024-08-27T02:51:37.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.896+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.896+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:37.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.896+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 info.flags=0x0 2024-08-27T02:51:37.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.896+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15 to cache LRU end 2024-08-27T02:51:37.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 : miss 2024-08-27T02:51:37.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:37.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=465 2024-08-27T02:51:37.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 info.flags=0x17 2024-08-27T02:51:37.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 to cache LRU end 2024-08-27T02:51:37.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:37.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:37.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.900+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 2024-08-27T02:51:37.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.904+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-08-27T02:51:37.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.904+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-08-27T02:51:37.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.904+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-27T02:51:37.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-08-27T02:51:37.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-08-27T02:51:37.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-27T02:51:37.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-08-27T02:51:37.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-27T02:51:37.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-08-27T02:51:37.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-08-27T02:51:37.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.908+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-08-27T02:51:37.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.912+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-08-27T02:51:37.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.912+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:37.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.912+0000 7f073c2d79c0 10 manifest: total_size = 541681 2024-08-27T02:51:37.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.912+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _RVWuf4KJ8GgYP5ms9VauxO6iJWrQO5a 2024-08-27T02:51:37.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.912+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:37.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.912+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:37.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.912+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.0 2024-08-27T02:51:37.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _RVWuf4KJ8GgYP5ms9VauxO6iJWrQO5a 2024-08-27T02:51:37.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.tC0eGq-Wso_R45U43ZNOIFpnWZuyeZb_0 2024-08-27T02:51:37.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-27T02:51:37.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.916+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _RVWuf4KJ8GgYP5ms9VauxO6iJWrQO5a 2024-08-27T02:51:37.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.920+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-08-27T02:51:37.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.920+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f3eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:37.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.920+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:37.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.920+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _ioJQ9P1v1UKo5h9OaM1IuGfwlImzZTL 2024-08-27T02:51:37.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.920+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f3eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:37.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.920+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3f0fb8 2024-08-27T02:51:37.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.920+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.2 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _ioJQ9P1v1UKo5h9OaM1IuGfwlImzZTL 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.xbw_1iuesSUeazuILKfTxsHzgBG0vtd_0 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.xbw_1iuesSUeazuILKfTxsHzgBG0vtd_1 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.928+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _ioJQ9P1v1UKo5h9OaM1IuGfwlImzZTL 2024-08-27T02:51:37.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.932+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-08-27T02:51:37.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.932+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.932+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:37.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.932+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16730277245573170381 2024-08-27T02:51:37.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.932+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.932+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe415be8 2024-08-27T02:51:37.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.932+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.3 2024-08-27T02:51:37.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:37.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16730277245573170381 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.1 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.2 2024-08-27T02:51:37.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-08-27T02:51:37.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.3 2024-08-27T02:51:37.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-08-27T02:51:37.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16730277245573170381 2024-08-27T02:51:37.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.940+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe272f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.944+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-27T02:51:37.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.944+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:37.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.944+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _YtpZQ3yL6ibr_BiFeve1yldi4DuLQzX 2024-08-27T02:51:37.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.944+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe272f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.944+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe415be8 2024-08-27T02:51:37.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.944+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.5 2024-08-27T02:51:37.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _YtpZQ3yL6ibr_BiFeve1yldi4DuLQzX 2024-08-27T02:51:37.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EqVpSLoGKHO3VIXuEDhzmcQodJZEgL7_0 2024-08-27T02:51:37.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-08-27T02:51:37.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EqVpSLoGKHO3VIXuEDhzmcQodJZEgL7_1 2024-08-27T02:51:37.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-08-27T02:51:37.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.948+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _YtpZQ3yL6ibr_BiFeve1yldi4DuLQzX 2024-08-27T02:51:37.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.952+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-08-27T02:51:37.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.952+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.956+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:37.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.956+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _oCnPvLnha8Sxf9AaJcupsW0-FSfbXpB 2024-08-27T02:51:37.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.956+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.956+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe415be8 2024-08-27T02:51:37.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.956+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.5 2024-08-27T02:51:37.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _oCnPvLnha8Sxf9AaJcupsW0-FSfbXpB 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.MrfT33g9JhHTR_RWY-XWjKLfJTtmQvo_0 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.MrfT33g9JhHTR_RWY-XWjKLfJTtmQvo_1 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.960+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _oCnPvLnha8Sxf9AaJcupsW0-FSfbXpB 2024-08-27T02:51:37.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.964+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-08-27T02:51:37.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.964+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f3600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.964+0000 7f073c2d79c0 10 manifest: total_size = 541681 2024-08-27T02:51:37.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.964+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3800155153566058829 2024-08-27T02:51:37.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.964+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f3600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562bfe415be8 s->prefetch_data=0 2024-08-27T02:51:37.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.964+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe415be8 2024-08-27T02:51:37.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.964+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.5 2024-08-27T02:51:37.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-27T02:51:37.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3800155153566058829 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.1 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.2 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-08-27T02:51:37.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.3 2024-08-27T02:51:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-08-27T02:51:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.972+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3800155153566058829 2024-08-27T02:51:37.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.976+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-27T02:51:37.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.976+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:37.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.976+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:37.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.976+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _z7G6yppMkmlZ9a8GL8QOavFX5eDWHOh 2024-08-27T02:51:37.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.976+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:37.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.976+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3f0fb8 2024-08-27T02:51:37.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.976+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.7 2024-08-27T02:51:37.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _z7G6yppMkmlZ9a8GL8QOavFX5eDWHOh 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EeKnOUouumN_mUhFD3GoJl_CccU78LY_0 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EeKnOUouumN_mUhFD3GoJl_CccU78LY_1 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.980+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _z7G6yppMkmlZ9a8GL8QOavFX5eDWHOh 2024-08-27T02:51:37.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.984+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-08-27T02:51:37.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.984+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:37.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.988+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:37.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.988+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10310647463942057623 2024-08-27T02:51:37.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.988+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:37.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.988+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:37.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.988+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.7 2024-08-27T02:51:37.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:37.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-27T02:51:37.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10310647463942057623 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.1 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.2 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.3 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:37.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.992+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10310647463942057623 2024-08-27T02:51:37.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.996+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-27T02:51:37.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.996+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734073300 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:37.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.996+0000 7f073c2d79c0 10 manifest: total_size = 541681 2024-08-27T02:51:37.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.996+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.74863098461428060 2024-08-27T02:51:37.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.996+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f0734073300 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:37.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.996+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:37.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:37.996+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.7 2024-08-27T02:51:38.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-27T02:51:38.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-08-27T02:51:38.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.74863098461428060 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.1 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 362 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.2 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.3 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.74863098461428060 2024-08-27T02:51:38.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-08-27T02:51:38.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.004+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe416c00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:38.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.008+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:38.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.008+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1644728237607016545 2024-08-27T02:51:38.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.008+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe416c00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:38.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.008+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3f0fb8 2024-08-27T02:51:38.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.008+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.8 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1644728237607016545 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.1 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.2 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.3 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.012+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1644728237607016545 2024-08-27T02:51:38.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.016+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:38.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.016+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-08-27T02:51:38.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.020+0000 7f073c2d79c0 10 manifest: total_size = 541681 2024-08-27T02:51:38.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.020+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to _pGEWWPLGxjKqZeFhAWtbvT5zb7id338 2024-08-27T02:51:38.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.020+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f07240edbf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:38.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.020+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3f0fb8 2024-08-27T02:51:38.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.020+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.8 2024-08-27T02:51:38.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: _pGEWWPLGxjKqZeFhAWtbvT5zb7id338 2024-08-27T02:51:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.QRDGRViM7aeCq47vDB0-KkYyKN3wz8H_0 2024-08-27T02:51:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-08-27T02:51:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.024+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _pGEWWPLGxjKqZeFhAWtbvT5zb7id338 2024-08-27T02:51:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.028+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-08-27T02:51:38.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.028+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f3eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.028+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.028+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6657849659679012043 2024-08-27T02:51:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.028+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f3eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562bfe3f0fb8 s->prefetch_data=0 2024-08-27T02:51:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.028+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3f0fb8 2024-08-27T02:51:38.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.028+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16.9 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6657849659679012043 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.1 2024-08-27T02:51:38.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-08-27T02:51:38.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.2 2024-08-27T02:51:38.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-08-27T02:51:38.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.3 2024-08-27T02:51:38.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-08-27T02:51:38.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.036+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6657849659679012043 2024-08-27T02:51:38.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.040+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-08-27T02:51:38.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.040+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:38.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.040+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:38.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.044+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:38.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.044+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:38.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.044+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:38.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.044+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:38.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.044+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:38.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.048+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-08-27T02:51:38.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.048+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.048+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=243 2024-08-27T02:51:38.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.048+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-08-27T02:51:38.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.048+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-08-27T02:51:38.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.052+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-08-27T02:51:38.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.052+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-08-27T02:51:38.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.052+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431565 cookie 94746948921504 notifier 5964 bl.length()=199 2024-08-27T02:51:38.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.060+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 from cache 2024-08-27T02:51:38.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.060+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16, ofs0, ns] 2024-08-27T02:51:38.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.060+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94746948928272 notifier 5964 bl.length()=257 2024-08-27T02:51:38.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.068+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 : miss 2024-08-27T02:51:38.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.068+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.072+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.072+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 info.flags=0x0 2024-08-27T02:51:38.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.072+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16 to cache LRU end 2024-08-27T02:51:38.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 : miss 2024-08-27T02:51:38.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=460 2024-08-27T02:51:38.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 info.flags=0x17 2024-08-27T02:51:38.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 to cache LRU end 2024-08-27T02:51:38.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:38.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:38.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.076+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 2024-08-27T02:51:38.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.080+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-27T02:51:38.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.084+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-27T02:51:38.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.084+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-27T02:51:38.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.088+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe272e90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.088+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.088+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14790647768880777944 2024-08-27T02:51:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.088+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe272e90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.088+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:38.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.088+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14.3 2024-08-27T02:51:38.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14790647768880777944 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-FROZEN.2~iE7g4jPm2C0elBNe9i5H_djTO0QBvQZ.1 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-08-27T02:51:38.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-FROZEN.2~iE7g4jPm2C0elBNe9i5H_djTO0QBvQZ.2 2024-08-27T02:51:38.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-08-27T02:51:38.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-FROZEN.2~iE7g4jPm2C0elBNe9i5H_djTO0QBvQZ.3 2024-08-27T02:51:38.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-08-27T02:51:38.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14790647768880777944 2024-08-27T02:51:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.096+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-27T02:51:38.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.100+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c02acd0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.100+0000 7f073c2d79c0 10 manifest: total_size = 16377 2024-08-27T02:51:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.100+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12458050068362940887 2024-08-27T02:51:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.100+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c02acd0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.100+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:38.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.100+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14.5 2024-08-27T02:51:38.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-08-27T02:51:38.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7670 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12458050068362940887 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-STANDARD.2~6FLdmTCaNp8EkpYO2zuyVV9ncm6WkXV.1 2024-08-27T02:51:38.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-08-27T02:51:38.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-STANDARD.2~6FLdmTCaNp8EkpYO2zuyVV9ncm6WkXV.2 2024-08-27T02:51:38.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-08-27T02:51:38.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-STANDARD.2~6FLdmTCaNp8EkpYO2zuyVV9ncm6WkXV.3 2024-08-27T02:51:38.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-08-27T02:51:38.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.104+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12458050068362940887 2024-08-27T02:51:38.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.108+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-27T02:51:38.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.108+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562bfe3f20f8 s->prefetch_data=0 2024-08-27T02:51:38.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.112+0000 7f073c2d79c0 10 manifest: total_size = 11534336 2024-08-27T02:51:38.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.112+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15533611480471717735 2024-08-27T02:51:38.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.112+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562bfe3f20f8 s->prefetch_data=0 2024-08-27T02:51:38.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.112+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3f20f8 2024-08-27T02:51:38.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.112+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14.7 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-08-27T02:51:38.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15533611480471717735 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-LUKEWARM.2~aCqGOu28WvaQFhTz9lN0vhj53Pbsl9s.1 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-LUKEWARM.2~aCqGOu28WvaQFhTz9lN0vhj53Pbsl9s.2 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-LUKEWARM.2~aCqGOu28WvaQFhTz9lN0vhj53Pbsl9s.3 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.116+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15533611480471717735 2024-08-27T02:51:38.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.120+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-27T02:51:38.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.120+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:38.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.120+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:38.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.124+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:38.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.124+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:38.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.124+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:38.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.124+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:38.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.124+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:38.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.128+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-08-27T02:51:38.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.128+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.128+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=238 2024-08-27T02:51:38.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.128+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-08-27T02:51:38.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.128+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-08-27T02:51:38.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.132+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-08-27T02:51:38.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.132+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-08-27T02:51:38.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.132+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94746948925280 notifier 5964 bl.length()=194 2024-08-27T02:51:38.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.136+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 from cache 2024-08-27T02:51:38.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.136+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14, ofs0, ns] 2024-08-27T02:51:38.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.140+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94746948928272 notifier 5964 bl.length()=252 2024-08-27T02:51:38.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.148+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 : miss 2024-08-27T02:51:38.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.148+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.148+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.148+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 info.flags=0x0 2024-08-27T02:51:38.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.148+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14 to cache LRU end 2024-08-27T02:51:38.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.152+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 : miss 2024-08-27T02:51:38.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.152+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.152+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=450 2024-08-27T02:51:38.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.152+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 info.flags=0x17 2024-08-27T02:51:38.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.152+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 to cache LRU end 2024-08-27T02:51:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.152+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.152+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:38.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.156+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 2024-08-27T02:51:38.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.156+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-08-27T02:51:38.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.160+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-08-27T02:51:38.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.160+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-08-27T02:51:38.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.164+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f83b0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562bfe400d88 s->prefetch_data=0 2024-08-27T02:51:38.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.164+0000 7f073c2d79c0 10 manifest: total_size = 10485760 2024-08-27T02:51:38.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.164+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4548311035917569556 2024-08-27T02:51:38.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.164+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f83b0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562bfe400d88 s->prefetch_data=0 2024-08-27T02:51:38.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.164+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe400d88 2024-08-27T02:51:38.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.164+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13.3 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4548311035917569556 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.MZiB9Ie5JISBQrsa_wTNyDeJWtUe_9R_0 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.MZiB9Ie5JISBQrsa_wTNyDeJWtUe_9R_1 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.172+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4548311035917569556 2024-08-27T02:51:38.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.176+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-08-27T02:51:38.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.176+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f2800 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562bfe400d88 s->prefetch_data=0 2024-08-27T02:51:38.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.176+0000 7f073c2d79c0 10 manifest: total_size = 53508 2024-08-27T02:51:38.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.176+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10629963107393991617 2024-08-27T02:51:38.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.176+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f2800 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562bfe400d88 s->prefetch_data=0 2024-08-27T02:51:38.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.176+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe400d88 2024-08-27T02:51:38.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.176+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13.5 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=53508 stripe_ofs=53508 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10629963107393991617 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.YBDwLCoytx8n8BdrmtNwvn1mDWW4Hto_0 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10629963107393991617 2024-08-27T02:51:38.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f060ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-08-27T02:51:38.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.184+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46d460 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562bfe400d88 s->prefetch_data=0 2024-08-27T02:51:38.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.188+0000 7f073c2d79c0 10 manifest: total_size = 10485760 2024-08-27T02:51:38.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.188+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6425506128856056288 2024-08-27T02:51:38.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.188+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46d460 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562bfe400d88 s->prefetch_data=0 2024-08-27T02:51:38.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.188+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe400d88 2024-08-27T02:51:38.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.188+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13.7 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6425506128856056288 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.vx5CsmgWIjYqZyfv7i-XWeuWBbxisZB_0 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.vx5CsmgWIjYqZyfv7i-XWeuWBbxisZB_1 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-08-27T02:51:38.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.192+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6425506128856056288 2024-08-27T02:51:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.196+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-08-27T02:51:38.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.196+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:38.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.196+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.200+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.200+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.200+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.200+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:38.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.200+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:38.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.204+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-08-27T02:51:38.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.204+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.204+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=228 2024-08-27T02:51:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.204+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-08-27T02:51:38.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.204+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-08-27T02:51:38.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.208+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-08-27T02:51:38.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.208+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-08-27T02:51:38.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.208+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 94746948883552 notifier 5964 bl.length()=184 2024-08-27T02:51:38.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.216+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 from cache 2024-08-27T02:51:38.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.216+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13, ofs0, ns] 2024-08-27T02:51:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.216+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 94746948921504 notifier 5964 bl.length()=242 2024-08-27T02:51:38.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.228+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 : miss 2024-08-27T02:51:38.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.228+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.228+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.228+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 info.flags=0x0 2024-08-27T02:51:38.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.228+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13 to cache LRU end 2024-08-27T02:51:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.232+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 : miss 2024-08-27T02:51:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.232+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.236+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=445 2024-08-27T02:51:38.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.236+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 info.flags=0x17 2024-08-27T02:51:38.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.236+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 to cache LRU end 2024-08-27T02:51:38.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.236+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:38.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.236+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:38.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.236+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 2024-08-27T02:51:38.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.236+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got ___ 2024-08-27T02:51:38.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.240+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got __ _ 2024-08-27T02:51:38.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.240+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got __ 2024-08-27T02:51:38.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.244+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got obj 2024-08-27T02:51:38.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.244+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.248+0000 7f073c2d79c0 10 manifest: total_size = 0 2024-08-27T02:51:38.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.248+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11227473623973686846 2024-08-27T02:51:38.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.248+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.248+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3ffd78 2024-08-27T02:51:38.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.248+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6.2 2024-08-27T02:51:38.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.252+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.256+0000 7f073c2d79c0 10 manifest: total_size = 0 2024-08-27T02:51:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.256+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14455838775102190373 2024-08-27T02:51:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.256+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.256+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3ffd78 2024-08-27T02:51:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.256+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6.3 2024-08-27T02:51:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.256+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=___ 2024-08-27T02:51:38.261 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.260+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.264+0000 7f073c2d79c0 10 manifest: total_size = 0 2024-08-27T02:51:38.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.264+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5084961387508030207 2024-08-27T02:51:38.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.264+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.264+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3ffd78 2024-08-27T02:51:38.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.264+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6.6 2024-08-27T02:51:38.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.264+0000 7f060ffff640 20 handle_completion(): completion ok for obj=__ _ 2024-08-27T02:51:38.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.268+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.272+0000 7f073c2d79c0 10 manifest: total_size = 0 2024-08-27T02:51:38.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.272+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9054562145875307711 2024-08-27T02:51:38.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.272+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe46cdf0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562bfe3ffd78 s->prefetch_data=0 2024-08-27T02:51:38.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.272+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe3ffd78 2024-08-27T02:51:38.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.272+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6.8 2024-08-27T02:51:38.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.272+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=__ 2024-08-27T02:51:38.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.276+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:38.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.276+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:38.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.280+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=obj 2024-08-27T02:51:38.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.280+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:38.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.280+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:38.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.280+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:38.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.280+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:38.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.280+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:38.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.284+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-08-27T02:51:38.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.288+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.288+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=223 2024-08-27T02:51:38.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.288+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-08-27T02:51:38.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.288+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-08-27T02:51:38.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.292+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-08-27T02:51:38.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.292+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-08-27T02:51:38.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.292+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94746948919296 notifier 5964 bl.length()=181 2024-08-27T02:51:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.296+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 from cache 2024-08-27T02:51:38.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.296+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6, ofs0, ns] 2024-08-27T02:51:38.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.300+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 94746948935520 notifier 5964 bl.length()=238 2024-08-27T02:51:38.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.308+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 : miss 2024-08-27T02:51:38.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.308+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.308+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.308+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 info.flags=0x0 2024-08-27T02:51:38.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.308+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6 to cache LRU end 2024-08-27T02:51:38.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.312+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 : miss 2024-08-27T02:51:38.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.312+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.316+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=445 2024-08-27T02:51:38.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.316+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 info.flags=0x17 2024-08-27T02:51:38.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.316+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 to cache LRU end 2024-08-27T02:51:38.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.316+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:38.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.316+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:38.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.316+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 2024-08-27T02:51:38.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.320+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got ___ 2024-08-27T02:51:38.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.320+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got __ _ 2024-08-27T02:51:38.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.324+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got __ 2024-08-27T02:51:38.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.324+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got obj 2024-08-27T02:51:38.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.328+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.328+0000 7f073c2d79c0 10 manifest: total_size = 524288 2024-08-27T02:51:38.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.328+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15744680007775551418 2024-08-27T02:51:38.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.328+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.328+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:38.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.328+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7.2 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15744680007775551418 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.zvcKsujCJxY1SWEN6_VCHvEQAvOS9JD_0 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.336+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15744680007775551418 2024-08-27T02:51:38.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.340+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=___ 2024-08-27T02:51:38.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.340+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.340+0000 7f073c2d79c0 10 manifest: total_size = 38 2024-08-27T02:51:38.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.340+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14205558240301958369 2024-08-27T02:51:38.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.340+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.340+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:38.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.340+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7.3 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14205558240301958369 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.vsv4KhjOE2ubpernZ9zNE_j2NOpzzim_0 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.348+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14205558240301958369 2024-08-27T02:51:38.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.352+0000 7f060ffff640 20 handle_completion(): completion ok for obj=__ _ 2024-08-27T02:51:38.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.352+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.352+0000 7f073c2d79c0 10 manifest: total_size = 2078 2024-08-27T02:51:38.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.352+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7891615183043664557 2024-08-27T02:51:38.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.352+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.352+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:38.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.352+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7.6 2024-08-27T02:51:38.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7891615183043664557 2024-08-27T02:51:38.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.4nj3Y8jfZQvTdrJbHrE4viSHBS8Bz1P_0 2024-08-27T02:51:38.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:38.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.360+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7891615183043664557 2024-08-27T02:51:38.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.364+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=__ 2024-08-27T02:51:38.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.364+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.364+0000 7f073c2d79c0 10 manifest: total_size = 2078 2024-08-27T02:51:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.364+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.532761653474932060 2024-08-27T02:51:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.364+0000 7f073c2d79c0 20 get_obj_state: octx=0x7f072c001820 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562bfe402578 s->prefetch_data=0 2024-08-27T02:51:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.364+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe402578 2024-08-27T02:51:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.364+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7.8 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.532761653474932060 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.kbPIT0v5OhAb2KSDV659Gm0D6KqRYeu_0 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.372+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.532761653474932060 2024-08-27T02:51:38.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f060ffff640 20 handle_completion(): completion ok for obj=obj 2024-08-27T02:51:38.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:38.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:38.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:38.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:38.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:38.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:38.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.376+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:38.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.380+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-08-27T02:51:38.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.380+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.384+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=223 2024-08-27T02:51:38.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.384+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-08-27T02:51:38.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.384+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-08-27T02:51:38.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.384+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-08-27T02:51:38.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.384+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-08-27T02:51:38.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.388+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94746948919296 notifier 5964 bl.length()=181 2024-08-27T02:51:38.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.392+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 from cache 2024-08-27T02:51:38.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.392+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7, ofs0, ns] 2024-08-27T02:51:38.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.392+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 94746948935520 notifier 5964 bl.length()=238 2024-08-27T02:51:38.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.404+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 : miss 2024-08-27T02:51:38.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.404+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.404+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.404+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 info.flags=0x0 2024-08-27T02:51:38.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.404+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7 to cache LRU end 2024-08-27T02:51:38.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 : miss 2024-08-27T02:51:38.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=445 2024-08-27T02:51:38.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 info.flags=0x17 2024-08-27T02:51:38.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 to cache LRU end 2024-08-27T02:51:38.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:38.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T02:51:38.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.408+0000 7f073c2d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 2024-08-27T02:51:38.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.412+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got ___ 2024-08-27T02:51:38.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.416+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got __ _ 2024-08-27T02:51:38.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.416+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got __ 2024-08-27T02:51:38.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.420+0000 7f073c2d79c0 10 cls_bucket_list_unordered: got obj 2024-08-27T02:51:38.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.420+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.420+0000 7f073c2d79c0 10 manifest: total_size = 1048576 2024-08-27T02:51:38.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.420+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14852746294301319909 2024-08-27T02:51:38.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.420+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.420+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe400b68 2024-08-27T02:51:38.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.420+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8.2 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14852746294301319909 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_.W5QFu5GPpi4jdSRsJEBZW-d39YF2VmS_0 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.428+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14852746294301319909 2024-08-27T02:51:38.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.432+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.432+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=___ 2024-08-27T02:51:38.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.432+0000 7f073c2d79c0 10 manifest: total_size = 1035 2024-08-27T02:51:38.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.432+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3152496642347424061 2024-08-27T02:51:38.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.432+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.432+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe400b68 2024-08-27T02:51:38.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.432+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8.3 2024-08-27T02:51:38.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3152496642347424061 2024-08-27T02:51:38.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_._HSv1OVz8A8skcCDdQFi8VRb7Dwj8_z_0 2024-08-27T02:51:38.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:38.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.440+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3152496642347424061 2024-08-27T02:51:38.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.444+0000 7f060ffff640 20 handle_completion(): completion ok for obj=__ _ 2024-08-27T02:51:38.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.444+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.444+0000 7f073c2d79c0 10 manifest: total_size = 1035 2024-08-27T02:51:38.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.444+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13329108310039862321 2024-08-27T02:51:38.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.444+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.444+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe400b68 2024-08-27T02:51:38.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.444+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8.6 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13329108310039862321 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_.bEPMx3MmsUZfIKsx1ukmFMuKRknGEtc_0 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13329108310039862321 2024-08-27T02:51:38.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.452+0000 7f060f7fe640 20 handle_completion(): completion ok for obj=__ 2024-08-27T02:51:38.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.456+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.456+0000 7f073c2d79c0 10 manifest: total_size = 49187 2024-08-27T02:51:38.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.456+0000 7f073c2d79c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5501784563914453315 2024-08-27T02:51:38.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.456+0000 7f073c2d79c0 20 get_obj_state: octx=0x562bfe3f8190 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562bfe400b68 s->prefetch_data=0 2024-08-27T02:51:38.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.456+0000 7f073c2d79c0 20 prepare_atomic_modification: state is not atomic. state=0x562bfe400b68 2024-08-27T02:51:38.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.456+0000 7f073c2d79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8.8 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5501784563914453315 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_.44VIaRn-K_JYy-s1jxI9NKvA8is5llZ_0 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-08-27T02:51:38.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f073c2d79c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5501784563914453315 2024-08-27T02:51:38.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.464+0000 7f060ffff640 20 handle_completion(): completion ok for obj=obj 2024-08-27T02:51:38.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.468+0000 7f073c2d79c0 20 list_objects_ordered: starting attempt 1 2024-08-27T02:51:38.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.468+0000 7f073c2d79c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-08-27T02:51:38.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.468+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-08-27T02:51:38.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.468+0000 7f073c2d79c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-08-27T02:51:38.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.468+0000 7f073c2d79c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-08-27T02:51:38.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.468+0000 7f073c2d79c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-08-27T02:51:38.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.468+0000 7f073c2d79c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8])"; uploads.size()=0; is_truncated=0 2024-08-27T02:51:38.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.476+0000 7f073c2d79c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-08-27T02:51:38.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.476+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.476+0000 7f073c2d79c0 20 rados_obj.operate() r=0 bl.length=223 2024-08-27T02:51:38.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.476+0000 7f073c2d79c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-08-27T02:51:38.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.476+0000 7f073c2d79c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-08-27T02:51:38.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.480+0000 7f073c2d79c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-08-27T02:51:38.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.480+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-08-27T02:51:38.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.480+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94746948919296 notifier 5964 bl.length()=181 2024-08-27T02:51:38.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.484+0000 7f073c2d79c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 from cache 2024-08-27T02:51:38.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.484+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8, ofs0, ns] 2024-08-27T02:51:38.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.488+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431568 cookie 94746948935520 notifier 5964 bl.length()=238 2024-08-27T02:51:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.496+0000 7f073c2d79c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 : miss 2024-08-27T02:51:38.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.496+0000 7f073c2d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.496+0000 7f073c2d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.496+0000 7f073c2d79c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 info.flags=0x0 2024-08-27T02:51:38.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.496+0000 7f073c2d79c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8 to cache LRU end 2024-08-27T02:51:38.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.500+0000 7f073c2d79c0 10 removing key index: PTORMECOYFQACTCGGEMK 2024-08-27T02:51:38.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.504+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:PTORMECOYFQACTCGGEMK, ofs0, ns] 2024-08-27T02:51:38.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.504+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94746948919296 notifier 5964 bl.length()=170 2024-08-27T02:51:38.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.508+0000 7f073c2d79c0 10 removing email index: ragweed.client.0+test@test.test 2024-08-27T02:51:38.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.512+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-08-27T02:51:38.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.512+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 94746948883552 notifier 5964 bl.length()=182 2024-08-27T02:51:38.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.516+0000 7f073c2d79c0 10 removing user buckets index 2024-08-27T02:51:38.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.520+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-08-27T02:51:38.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.520+0000 7f060f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94746948925280 notifier 5964 bl.length()=173 2024-08-27T02:51:38.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.524+0000 7f073c2d79c0 10 removing user index: ragweed.client.0 2024-08-27T02:51:38.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.528+0000 7f073c2d79c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-08-27T02:51:38.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.528+0000 7f073c2d79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-08-27T02:51:38.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.528+0000 7f060ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94746948928272 notifier 5964 bl.length()=165 2024-08-27T02:51:38.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.536+0000 7f05eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:51:38.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.544+0000 7f073c2d79c0 20 remove_watcher() i=0 2024-08-27T02:51:38.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.544+0000 7f073c2d79c0 2 removed watcher, disabling cache 2024-08-27T02:51:38.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.544+0000 7f073c2d79c0 20 remove_watcher() i=1 2024-08-27T02:51:38.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.548+0000 7f073c2d79c0 20 remove_watcher() i=2 2024-08-27T02:51:38.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.552+0000 7f073c2d79c0 20 remove_watcher() i=3 2024-08-27T02:51:38.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.556+0000 7f073c2d79c0 20 remove_watcher() i=4 2024-08-27T02:51:38.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.556+0000 7f073c2d79c0 20 remove_watcher() i=5 2024-08-27T02:51:38.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.560+0000 7f073c2d79c0 20 remove_watcher() i=6 2024-08-27T02:51:38.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.560+0000 7f073c2d79c0 20 remove_watcher() i=7 2024-08-27T02:51:38.580 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-08-27T02:51:38.662 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:51:38.662 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:51:38.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.704+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.704+0000 7fb38f2459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.704+0000 7fb38f2459c0 20 realm 2024-08-27T02:51:38.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.704+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:51:38.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:51:38.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:51:38.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.708+0000 7fb38f2459c0 20 searching for the correct realm 2024-08-27T02:51:38.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.716+0000 7fb38c54a640 0 -- 172.21.15.143:0/2118182853 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb384122c20 msgr2=0x7fb384124090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:51:38.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.720+0000 7fb38c54a640 0 -- 172.21.15.143:0/2118182853 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb2580810c0 msgr2=0x7fb2580834f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:51:38.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:51:38.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:51:38.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:51:38.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:51:38.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:51:38.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:51:38.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.728+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 zone default found 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 4 Realm: () 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 zonegroup default 2024-08-27T02:51:38.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:51:38.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 started sync module instance, tier type = 2024-08-27T02:51:38.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.732+0000 7fb38f2459c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:51:38.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=0 2024-08-27T02:51:38.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=1 2024-08-27T02:51:38.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=2 2024-08-27T02:51:38.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=3 2024-08-27T02:51:38.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=4 2024-08-27T02:51:38.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=5 2024-08-27T02:51:38.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=6 2024-08-27T02:51:38.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 20 add_watcher() i=7 2024-08-27T02:51:38.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.748+0000 7fb38f2459c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:51:38.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.752+0000 7fb242fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:51:38.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.752+0000 7fb38f2459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:51:38.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.752+0000 7fb38f2459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:51:38.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.824+0000 7fb241fe3640 20 reqs_thread_entry: start 2024-08-27T02:51:38.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.824+0000 7fb38f2459c0 20 init_complete bucket index max shards: 11 2024-08-27T02:51:38.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.824+0000 7fb38f2459c0 20 Filter name: none 2024-08-27T02:51:38.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.824+0000 7fb1b37fe640 20 reqs_thread_entry: start 2024-08-27T02:51:38.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.824+0000 7fb38f2459c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-08-27T02:51:38.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.824+0000 7fb38f2459c0 20 rados->read ofs=0 len=0 2024-08-27T02:51:38.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.828+0000 7fb38f2459c0 20 rados_obj.operate() r=0 bl.length=486 2024-08-27T02:51:38.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.828+0000 7fb38f2459c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-08-27T02:51:38.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.828+0000 7fb38f2459c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-08-27T02:51:38.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.828+0000 7fb38f2459c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:51:38.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.828+0000 7fb38f2459c0 10 removing key index: IYZWYDFDZIKTSHWUVTQG 2024-08-27T02:51:38.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.828+0000 7fb38f2459c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:IYZWYDFDZIKTSHWUVTQG, ofs0, ns] 2024-08-27T02:51:38.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.828+0000 7fb263fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 94509584602528 notifier 5729 bl.length()=170 2024-08-27T02:51:38.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.832+0000 7fb38f2459c0 10 removing email index: sysuser.client.0+test@test.test 2024-08-27T02:51:38.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.836+0000 7fb38f2459c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-08-27T02:51:38.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.836+0000 7fb2637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94509584607792 notifier 5729 bl.length()=182 2024-08-27T02:51:38.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.836+0000 7fb38f2459c0 10 removing user buckets index 2024-08-27T02:51:38.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.840+0000 7fb38f2459c0 10 removing user index: sysuser.client.0 2024-08-27T02:51:38.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.844+0000 7fb38f2459c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-08-27T02:51:38.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.844+0000 7fb38f2459c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-08-27T02:51:38.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.844+0000 7fb2637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431574 cookie 94509584605120 notifier 5729 bl.length()=165 2024-08-27T02:51:38.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.848+0000 7fb242fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:51:38.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.852+0000 7fb38f2459c0 20 remove_watcher() i=0 2024-08-27T02:51:38.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.852+0000 7fb38f2459c0 2 removed watcher, disabling cache 2024-08-27T02:51:38.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.856+0000 7fb38f2459c0 20 remove_watcher() i=1 2024-08-27T02:51:38.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.856+0000 7fb38f2459c0 20 remove_watcher() i=2 2024-08-27T02:51:38.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.860+0000 7fb38f2459c0 20 remove_watcher() i=3 2024-08-27T02:51:38.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.860+0000 7fb38f2459c0 20 remove_watcher() i=4 2024-08-27T02:51:38.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.864+0000 7fb38f2459c0 20 remove_watcher() i=5 2024-08-27T02:51:38.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.864+0000 7fb38f2459c0 20 remove_watcher() i=6 2024-08-27T02:51:38.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:51:38.868+0000 7fb38f2459c0 20 remove_watcher() i=7 2024-08-27T02:51:38.882 INFO:tasks.ragweed:Removing ragweed... 2024-08-27T02:51:38.882 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-08-27T02:51:38.973 INFO:teuthology.run_tasks:Running task workunit... 2024-08-27T02:51:38.986 INFO:tasks.workunit:Pulling workunits from ref d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:51:38.986 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-27T02:51:38.986 DEBUG:teuthology.orchestra.run.smithi143:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:51:38.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T02:51:38.991 INFO:teuthology.orchestra.run.smithi143.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-27T02:51:38.991 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:51:39.038 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-27T02:51:39.038 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-27T02:51:39.086 INFO:tasks.workunit:timeout=3h 2024-08-27T02:51:39.086 INFO:tasks.workunit:cleanup=True 2024-08-27T02:51:39.086 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T02:51:39.136 INFO:tasks.workunit.client.0.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-27T02:52:35.844 INFO:tasks.workunit.client.0.smithi143.stderr:Note: switching to 'd17b22856a85d7d49d47be692c778d4419f41641'. 2024-08-27T02:52:35.845 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:35.845 INFO:tasks.workunit.client.0.smithi143.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-27T02:52:35.845 INFO:tasks.workunit.client.0.smithi143.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-27T02:52:35.845 INFO:tasks.workunit.client.0.smithi143.stderr:state without impacting any branches by switching back to a branch. 2024-08-27T02:52:35.845 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:35.845 INFO:tasks.workunit.client.0.smithi143.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-27T02:52:35.845 INFO:tasks.workunit.client.0.smithi143.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr: git switch -c 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr:Or undo this operation with: 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr: git switch - 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:35.846 INFO:tasks.workunit.client.0.smithi143.stderr:HEAD is now at d17b22856a8 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-08-27T02:52:35.850 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-27T02:52:35.898 INFO:tasks.workunit.client.0.smithi143.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-27T02:52:35.902 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:52:35.902 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-27T02:52:35.959 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-27T02:52:36.012 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-27T02:52:36.052 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T02:52:36.054 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:52:36.054 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-27T02:52:36.098 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T02:52:36.102 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:52:36.102 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-27T02:52:36.150 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-08-27T02:52:36.152 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-08-27T02:52:36.152 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-08-27T02:52:36.203 INFO:tasks.workunit.client.0.smithi143.stderr:+ ulimit -c 0 2024-08-27T02:52:36.203 INFO:tasks.workunit.client.0.smithi143.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-08-27T02:52:36.204 INFO:tasks.workunit.client.0.smithi143.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T02:52:36.204 INFO:tasks.workunit.client.0.smithi143.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T02:52:39.134 INFO:tasks.workunit.client.0.smithi143.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-08-27T02:52:39.134 INFO:tasks.workunit.client.0.smithi143.stderr:++ deactivate nondestructive 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ hash -r 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ unset VIRTUAL_ENV 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T02:52:39.135 INFO:tasks.workunit.client.0.smithi143.stderr:++ export VIRTUAL_ENV 2024-08-27T02:52:39.136 INFO:tasks.workunit.client.0.smithi143.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T02:52:39.136 INFO:tasks.workunit.client.0.smithi143.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T02:52:39.136 INFO:tasks.workunit.client.0.smithi143.stderr:++ export PATH 2024-08-27T02:52:39.136 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -z '' ']' 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ _OLD_VIRTUAL_PS1= 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ PS1='(rgw) ' 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ export PS1 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ export VIRTUAL_ENV_PROMPT 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:++ hash -r 2024-08-27T02:52:39.137 INFO:tasks.workunit.client.0.smithi143.stderr:+ pip install pip --upgrade 2024-08-27T02:52:39.495 INFO:tasks.workunit.client.0.smithi143.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-27T02:52:39.699 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting pip 2024-08-27T02:52:39.705 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-27T02:52:39.740 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: pip 2024-08-27T02:52:39.740 INFO:tasks.workunit.client.0.smithi143.stdout: Attempting uninstall: pip 2024-08-27T02:52:39.740 INFO:tasks.workunit.client.0.smithi143.stdout: Found existing installation: pip 22.0.2 2024-08-27T02:52:40.006 INFO:tasks.workunit.client.0.smithi143.stdout: Uninstalling pip-22.0.2: 2024-08-27T02:52:40.012 INFO:tasks.workunit.client.0.smithi143.stdout: Successfully uninstalled pip-22.0.2 2024-08-27T02:52:40.770 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed pip-24.2 2024-08-27T02:52:40.838 INFO:tasks.workunit.client.0.smithi143.stderr:+ pip install boto3 2024-08-27T02:52:41.817 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting boto3 2024-08-27T02:52:41.818 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached boto3-1.35.6-py3-none-any.whl.metadata (6.6 kB) 2024-08-27T02:52:42.368 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting botocore<1.36.0,>=1.35.6 (from boto3) 2024-08-27T02:52:42.369 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached botocore-1.35.6-py3-none-any.whl.metadata (5.7 kB) 2024-08-27T02:52:42.419 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-08-27T02:52:42.421 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-08-27T02:52:42.479 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-08-27T02:52:42.480 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-08-27T02:52:42.536 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:52:42.537 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-08-27T02:52:42.649 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:52:42.650 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-08-27T02:52:42.856 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T02:52:42.857 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-27T02:52:42.860 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached boto3-1.35.6-py3-none-any.whl (139 kB) 2024-08-27T02:52:42.862 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached botocore-1.35.6-py3-none-any.whl (12.5 MB) 2024-08-27T02:52:42.871 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-08-27T02:52:42.872 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-08-27T02:52:42.874 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-08-27T02:52:42.875 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-08-27T02:52:42.876 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-27T02:52:42.944 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-08-27T02:52:44.310 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed boto3-1.35.6 botocore-1.35.6 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-08-27T02:52:44.531 INFO:tasks.workunit.client.0.smithi143.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-08-27T02:52:44.673 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-08-27T02:52:44.712 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:44.713 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:44.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:44.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 realm 2024-08-27T02:52:44.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:44.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:44.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:44.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.758+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.762+0000 7fe8a906d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:44.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.762+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.762+0000 7fe8a906d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:44.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.762+0000 7fe8a906d9c0 20 searching for the correct realm 2024-08-27T02:52:44.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.766+0000 7fe8a7374640 0 -- 172.21.15.143:0/510886664 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fe89002cb90 msgr2=0x7fe89002b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:44.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.982+0000 7fe8a6b73640 0 -- 172.21.15.143:0/510886664 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55fc04a23d10 msgr2=0x55fc04a26100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:44.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:44.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:44.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:44.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:44.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:44.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:44.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:44.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:44.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 zone default found 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 4 Realm: () 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 zonegroup default 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.990+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.994+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.994+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.994+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:44.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.994+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:44.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.994+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:44.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.994+0000 7fe8a906d9c0 20 started sync module instance, tier type = 2024-08-27T02:52:44.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:44.994+0000 7fe8a906d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:45.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=0 2024-08-27T02:52:45.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=1 2024-08-27T02:52:45.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=2 2024-08-27T02:52:45.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=3 2024-08-27T02:52:45.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=4 2024-08-27T02:52:45.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=5 2024-08-27T02:52:45.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=6 2024-08-27T02:52:45.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 20 add_watcher() i=7 2024-08-27T02:52:45.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.018+0000 7fe8a906d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:45.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.022+0000 7fe75d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:45.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:45.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:45.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 5 note: GC not initialized 2024-08-27T02:52:45.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe6d7fff640 20 reqs_thread_entry: start 2024-08-27T02:52:45.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:45.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 Filter name: none 2024-08-27T02:52:45.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe6d5ffb640 20 reqs_thread_entry: start 2024-08-27T02:52:45.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-08-27T02:52:45.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-08-27T02:52:45.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-08-27T02:52:45.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-08-27T02:52:45.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-08-27T02:52:45.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-08-27T02:52:45.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-08-27T02:52:45.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.026+0000 7fe8a906d9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-08-27T02:52:45.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.030+0000 7fe8a906d9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-08-27T02:52:45.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.030+0000 7fe8a906d9c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-08-27T02:52:45.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.030+0000 7fe8a906d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-08-27T02:52:45.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.030+0000 7fe78a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 94540897909440 notifier 6003 bl.length()=569 2024-08-27T02:52:45.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.030+0000 7fe78a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-08-27T02:52:45.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.030+0000 7fe78a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-08-27T02:52:45.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.034+0000 7fe8a906d9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-08-27T02:52:45.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.034+0000 7fe8a906d9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-08-27T02:52:45.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.034+0000 7fe8a906d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-08-27T02:52:45.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.034+0000 7fe78a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366213 cookie 94540897908384 notifier 6003 bl.length()=180 2024-08-27T02:52:45.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.034+0000 7fe78a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-08-27T02:52:45.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.034+0000 7fe78a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-08-27T02:52:45.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.038+0000 7fe75d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:45.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.046+0000 7fe8a906d9c0 20 remove_watcher() i=0 2024-08-27T02:52:45.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.046+0000 7fe8a906d9c0 2 removed watcher, disabling cache 2024-08-27T02:52:45.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.046+0000 7fe8a906d9c0 20 remove_watcher() i=1 2024-08-27T02:52:45.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.050+0000 7fe8a906d9c0 20 remove_watcher() i=2 2024-08-27T02:52:45.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.050+0000 7fe8a906d9c0 20 remove_watcher() i=3 2024-08-27T02:52:45.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.054+0000 7fe8a906d9c0 20 remove_watcher() i=4 2024-08-27T02:52:45.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.054+0000 7fe8a906d9c0 20 remove_watcher() i=5 2024-08-27T02:52:45.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.058+0000 7fe8a906d9c0 20 remove_watcher() i=6 2024-08-27T02:52:45.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.058+0000 7fe8a906d9c0 20 remove_watcher() i=7 2024-08-27T02:52:45.723 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard add 2024-08-27T02:52:45.723 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:45.723 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:52:45.756 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:45.756 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:45.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.802+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 realm 2024-08-27T02:52:45.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:45.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:45.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:45.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.806+0000 7f76f2c6b9c0 20 searching for the correct realm 2024-08-27T02:52:45.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.814+0000 7f76eff70640 0 -- 172.21.15.143:0/902449346 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f76e012dc50 msgr2=0x7f76e00e10c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:45.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.822+0000 7f76eff70640 0 -- 172.21.15.143:0/902449346 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f75b8081170 msgr2=0x7f75b80835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:45.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:45.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.826+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:45.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 zone default found 2024-08-27T02:52:45.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 4 Realm: () 2024-08-27T02:52:45.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:45.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:45.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:45.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 zonegroup default 2024-08-27T02:52:45.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:45.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 started sync module instance, tier type = 2024-08-27T02:52:45.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.830+0000 7f76f2c6b9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:45.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=0 2024-08-27T02:52:45.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=1 2024-08-27T02:52:45.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=2 2024-08-27T02:52:45.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=3 2024-08-27T02:52:45.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=4 2024-08-27T02:52:45.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=5 2024-08-27T02:52:45.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=6 2024-08-27T02:52:45.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 20 add_watcher() i=7 2024-08-27T02:52:45.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.846+0000 7f76f2c6b9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:45.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f75a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:45.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:45.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:45.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 5 note: GC not initialized 2024-08-27T02:52:45.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f75a5fdb640 20 reqs_thread_entry: start 2024-08-27T02:52:45.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:45.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 20 Filter name: none 2024-08-27T02:52:45.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f75177fe640 20 reqs_thread_entry: start 2024-08-27T02:52:45.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:45.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.850+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:45.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f76f2c6b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:45.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:45.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f76f2c6b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:45.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f76f2c6b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:45.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f76f2c6b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:45.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.854+0000 7f75a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:45.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.862+0000 7f76f2c6b9c0 20 remove_watcher() i=0 2024-08-27T02:52:45.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.862+0000 7f76f2c6b9c0 2 removed watcher, disabling cache 2024-08-27T02:52:45.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.862+0000 7f76f2c6b9c0 20 remove_watcher() i=1 2024-08-27T02:52:45.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.866+0000 7f76f2c6b9c0 20 remove_watcher() i=2 2024-08-27T02:52:45.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.866+0000 7f76f2c6b9c0 20 remove_watcher() i=3 2024-08-27T02:52:45.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.870+0000 7f76f2c6b9c0 20 remove_watcher() i=4 2024-08-27T02:52:45.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.870+0000 7f76f2c6b9c0 20 remove_watcher() i=5 2024-08-27T02:52:45.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.870+0000 7f76f2c6b9c0 20 remove_watcher() i=6 2024-08-27T02:52:45.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:45.874+0000 7f76f2c6b9c0 20 remove_watcher() i=7 2024-08-27T02:52:45.884 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:45.884 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:52:45.884 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-08-27T02:52:45.884 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:45.885 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-08-27T02:52:45.914 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:45.914 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:46.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.142+0000 7fc727068640 0 --2- 172.21.15.143:0/2730315230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558a9426bc30 0x558a94329310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-27T02:52:46.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.166+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 realm 2024-08-27T02:52:46.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:46.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:46.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.170+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.174+0000 7fc728d619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:46.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.174+0000 7fc728d619c0 20 searching for the correct realm 2024-08-27T02:52:46.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.174+0000 7fc727068640 0 -- 172.21.15.143:0/3945415161 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fc71c022b80 msgr2=0x7fc71c031930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:46.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.386+0000 7fc727068640 0 -- 172.21.15.143:0/3945415161 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fc71c00b440 msgr2=0x7fc71c00b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:52:46.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:46.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:46.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:46.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:46.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:46.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:46.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:46.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.610+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 zone default found 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 4 Realm: () 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 zonegroup default 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 started sync module instance, tier type = 2024-08-27T02:52:46.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.614+0000 7fc728d619c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:46.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.638+0000 7fc728d619c0 20 add_watcher() i=0 2024-08-27T02:52:46.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.638+0000 7fc728d619c0 20 add_watcher() i=1 2024-08-27T02:52:46.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.638+0000 7fc728d619c0 20 add_watcher() i=2 2024-08-27T02:52:46.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.638+0000 7fc728d619c0 20 add_watcher() i=3 2024-08-27T02:52:46.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.638+0000 7fc728d619c0 20 add_watcher() i=4 2024-08-27T02:52:46.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.638+0000 7fc728d619c0 20 add_watcher() i=5 2024-08-27T02:52:46.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.638+0000 7fc728d619c0 20 add_watcher() i=6 2024-08-27T02:52:46.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.642+0000 7fc728d619c0 20 add_watcher() i=7 2024-08-27T02:52:46.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.642+0000 7fc728d619c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:46.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc5dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:46.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:46.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:46.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 5 note: GC not initialized 2024-08-27T02:52:46.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc557fff640 20 reqs_thread_entry: start 2024-08-27T02:52:46.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:46.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 20 Filter name: none 2024-08-27T02:52:46.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc555ffb640 20 reqs_thread_entry: start 2024-08-27T02:52:46.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:52:46.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:46.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:52:46.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:52:46.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:52:46.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.646+0000 7fc728d619c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.650+0000 7fc728d619c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.650+0000 7fc728d619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.650+0000 7fc728d619c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.650+0000 7fc728d619c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:52:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.650+0000 7fc728d619c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.650+0000 7fc728d619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:46.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.650+0000 7fc5dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:46.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.658+0000 7fc728d619c0 20 remove_watcher() i=0 2024-08-27T02:52:46.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.658+0000 7fc728d619c0 2 removed watcher, disabling cache 2024-08-27T02:52:46.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.658+0000 7fc728d619c0 20 remove_watcher() i=1 2024-08-27T02:52:46.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.662+0000 7fc728d619c0 20 remove_watcher() i=2 2024-08-27T02:52:46.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.662+0000 7fc728d619c0 20 remove_watcher() i=3 2024-08-27T02:52:46.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.666+0000 7fc728d619c0 20 remove_watcher() i=4 2024-08-27T02:52:46.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.666+0000 7fc728d619c0 20 remove_watcher() i=5 2024-08-27T02:52:46.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.670+0000 7fc728d619c0 20 remove_watcher() i=6 2024-08-27T02:52:46.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.670+0000 7fc728d619c0 20 remove_watcher() i=7 2024-08-27T02:52:46.684 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshard list 2024-08-27T02:52:46.710 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:46.710 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:46.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.754+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 realm 2024-08-27T02:52:46.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:46.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:46.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.758+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.762+0000 7fcc2c0229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:46.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.762+0000 7fcc2c0229c0 20 searching for the correct realm 2024-08-27T02:52:46.764 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.766+0000 7fcc2a329640 0 -- 172.21.15.143:0/441819655 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x559301e35ce0 msgr2=0x559301e38180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:46.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.774+0000 7fcc29327640 0 -- 172.21.15.143:0/441819655 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fcc24101000 msgr2=0x7fcc240f65e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:52:46.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:46.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:46.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:46.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:46.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:46.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:46.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 zone default found 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 4 Realm: () 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:46.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:46.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 zonegroup default 2024-08-27T02:52:46.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 started sync module instance, tier type = 2024-08-27T02:52:46.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.782+0000 7fcc2c0229c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:46.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=0 2024-08-27T02:52:46.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=1 2024-08-27T02:52:46.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=2 2024-08-27T02:52:46.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=3 2024-08-27T02:52:46.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=4 2024-08-27T02:52:46.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=5 2024-08-27T02:52:46.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=6 2024-08-27T02:52:46.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 20 add_watcher() i=7 2024-08-27T02:52:46.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.798+0000 7fcc2c0229c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:46.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fcadb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:46.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fcc2c0229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:46.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fcc2c0229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:46.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fcc2c0229c0 5 note: GC not initialized 2024-08-27T02:52:46.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fcada7fc640 20 reqs_thread_entry: start 2024-08-27T02:52:46.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fcc2c0229c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:46.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fcc2c0229c0 20 Filter name: none 2024-08-27T02:52:46.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.802+0000 7fca4bfff640 20 reqs_thread_entry: start 2024-08-27T02:52:46.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.814+0000 7fcadb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:46.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.818+0000 7fcc2c0229c0 20 remove_watcher() i=0 2024-08-27T02:52:46.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.818+0000 7fcc2c0229c0 2 removed watcher, disabling cache 2024-08-27T02:52:46.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.818+0000 7fcc2c0229c0 20 remove_watcher() i=1 2024-08-27T02:52:46.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.822+0000 7fcc2c0229c0 20 remove_watcher() i=2 2024-08-27T02:52:46.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.822+0000 7fcc2c0229c0 20 remove_watcher() i=3 2024-08-27T02:52:46.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.826+0000 7fcc2c0229c0 20 remove_watcher() i=4 2024-08-27T02:52:46.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.826+0000 7fcc2c0229c0 20 remove_watcher() i=5 2024-08-27T02:52:46.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.830+0000 7fcc2c0229c0 20 remove_watcher() i=6 2024-08-27T02:52:46.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.830+0000 7fcc2c0229c0 20 remove_watcher() i=7 2024-08-27T02:52:46.842 INFO:tasks.workunit.client.0.smithi143.stderr:bucket name a-bucket 2024-08-27T02:52:46.843 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard process 2024-08-27T02:52:46.843 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:46.843 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshard process 2024-08-27T02:52:46.867 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:46.868 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:46.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.910+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 realm 2024-08-27T02:52:46.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:46.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:46.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:46.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.914+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:46.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.918+0000 7ff8238499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:46.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.918+0000 7ff8238499c0 20 searching for the correct realm 2024-08-27T02:52:46.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:46.922+0000 7ff821b50640 0 -- 172.21.15.143:0/3119027779 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7ff818008040 msgr2=0x7ff81805b5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:47.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.138+0000 7ff82134f640 0 -- 172.21.15.143:0/3119027779 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55b4ddb2c0a0 msgr2=0x55b4ddb2e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:47.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:47.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:47.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:47.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:47.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:47.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:47.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:47.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:47.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:47.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 zone default found 2024-08-27T02:52:47.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 4 Realm: () 2024-08-27T02:52:47.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:47.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:47.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:47.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 zonegroup default 2024-08-27T02:52:47.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.146+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.150+0000 7ff8238499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:47.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.150+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.150+0000 7ff8238499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:47.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.150+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.150+0000 7ff8238499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:47.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.150+0000 7ff8238499c0 20 started sync module instance, tier type = 2024-08-27T02:52:47.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.150+0000 7ff8238499c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:47.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.174+0000 7ff8238499c0 20 add_watcher() i=0 2024-08-27T02:52:47.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.174+0000 7ff8238499c0 20 add_watcher() i=1 2024-08-27T02:52:47.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.174+0000 7ff8238499c0 20 add_watcher() i=2 2024-08-27T02:52:47.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.174+0000 7ff8238499c0 20 add_watcher() i=3 2024-08-27T02:52:47.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.174+0000 7ff8238499c0 20 add_watcher() i=4 2024-08-27T02:52:47.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.174+0000 7ff8238499c0 20 add_watcher() i=5 2024-08-27T02:52:47.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.174+0000 7ff8238499c0 20 add_watcher() i=6 2024-08-27T02:52:47.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.178+0000 7ff8238499c0 20 add_watcher() i=7 2024-08-27T02:52:47.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.178+0000 7ff8238499c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:47.179 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff6d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:47.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff8238499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:47.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff8238499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:47.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff8238499c0 5 note: GC not initialized 2024-08-27T02:52:47.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff6d67e4640 20 reqs_thread_entry: start 2024-08-27T02:52:47.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff8238499c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:47.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff8238499c0 20 Filter name: none 2024-08-27T02:52:47.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff647fff640 20 reqs_thread_entry: start 2024-08-27T02:52:47.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.182+0000 7ff8238499c0 20 processing logshard = reshard.0000000000 2024-08-27T02:52:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.190+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-08-27T02:52:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.190+0000 7ff8238499c0 20 processing logshard = reshard.0000000001 2024-08-27T02:52:47.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.194+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-08-27T02:52:47.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.194+0000 7ff8238499c0 20 processing logshard = reshard.0000000002 2024-08-27T02:52:47.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.198+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-08-27T02:52:47.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.198+0000 7ff8238499c0 20 processing logshard = reshard.0000000003 2024-08-27T02:52:47.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.202+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-08-27T02:52:47.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.202+0000 7ff8238499c0 20 processing logshard = reshard.0000000004 2024-08-27T02:52:47.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.210+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-08-27T02:52:47.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.210+0000 7ff8238499c0 20 processing logshard = reshard.0000000005 2024-08-27T02:52:47.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.214+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-08-27T02:52:47.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.214+0000 7ff8238499c0 20 processing logshard = reshard.0000000006 2024-08-27T02:52:47.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 20 process_entry resharding a-bucket 2024-08-27T02:52:47.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:52:47.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:47.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-08-27T02:52:47.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:52:47.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:52:47.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:47.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:47.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:47.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:47.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:52:47.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:47.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.218+0000 7ff8238499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff8238499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff8238499c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff8238499c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff8238499c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:52:47.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff6f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94235301988864 notifier 6081 bl.length()=827 2024-08-27T02:52:47.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff6f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:47.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff6f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:47.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.234+0000 7ff6f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:47.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.238+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:52:47.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.238+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:52:47.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.238+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:52:47.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.238+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:52:47.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.0 2024-08-27T02:52:47.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.0 2024-08-27T02:52:47.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.1 2024-08-27T02:52:47.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.1 2024-08-27T02:52:47.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.2 2024-08-27T02:52:47.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.2 2024-08-27T02:52:47.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.3 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.3 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.4 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.4 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.5 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.5 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.6 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.6 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.7 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.7 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.8 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.8 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.9 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.9 2024-08-27T02:52:47.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.10 2024-08-27T02:52:47.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.10 2024-08-27T02:52:47.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.11 2024-08-27T02:52:47.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.11 2024-08-27T02:52:47.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.0 2024-08-27T02:52:47.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1 2024-08-27T02:52:47.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2 2024-08-27T02:52:47.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.250+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3 2024-08-27T02:52:47.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.254+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.4 2024-08-27T02:52:47.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.254+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.5 2024-08-27T02:52:47.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.254+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.6 2024-08-27T02:52:47.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.254+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.7 2024-08-27T02:52:47.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.258+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.8 2024-08-27T02:52:47.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.258+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.9 2024-08-27T02:52:47.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.258+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.10 2024-08-27T02:52:47.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.258+0000 7ff8238499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : hit (requested=0x17, cached=0x17) 2024-08-27T02:52:47.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.258+0000 7ff8238499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:47.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff8238499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:47.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff8238499c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:47.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff8238499c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:47.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff8238499c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:52:47.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff6f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 94235301988864 notifier 6081 bl.length()=827 2024-08-27T02:52:47.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff6f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:47.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff6f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:47.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.262+0000 7ff6f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:47.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.266+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:52:47.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.266+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:52:47.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.266+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:52:47.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.266+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:52:47.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.270+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.0 2024-08-27T02:52:47.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.274+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1 2024-08-27T02:52:47.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.274+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2 2024-08-27T02:52:47.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.274+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3 2024-08-27T02:52:47.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.274+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.4 2024-08-27T02:52:47.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.274+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.5 2024-08-27T02:52:47.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.274+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.6 2024-08-27T02:52:47.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.278+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.7 2024-08-27T02:52:47.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.278+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.8 2024-08-27T02:52:47.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.278+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.9 2024-08-27T02:52:47.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.278+0000 7ff8238499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.10 2024-08-27T02:52:47.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.278+0000 7ff8238499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : hit (requested=0x17, cached=0x17) 2024-08-27T02:52:47.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.278+0000 7ff8238499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:47.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff8238499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:47.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff8238499c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:47.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff8238499c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:47.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff8238499c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:52:47.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff704ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94235301988864 notifier 6081 bl.length()=795 2024-08-27T02:52:47.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff704ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:47.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff704ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:47.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.282+0000 7ff704ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:47.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.286+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:52:47.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.286+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:52:47.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.286+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:52:47.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.286+0000 7ff8238499c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:52:47.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.290+0000 7ff8238499c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-08-27T02:52:47.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.294+0000 7ff8238499c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-08-27T02:52:47.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.302+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-08-27T02:52:47.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.302+0000 7ff8238499c0 20 processing logshard = reshard.0000000007 2024-08-27T02:52:47.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.306+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-08-27T02:52:47.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.306+0000 7ff8238499c0 20 processing logshard = reshard.0000000008 2024-08-27T02:52:47.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.314+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-08-27T02:52:47.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.314+0000 7ff8238499c0 20 processing logshard = reshard.0000000009 2024-08-27T02:52:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.322+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-08-27T02:52:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.322+0000 7ff8238499c0 20 processing logshard = reshard.0000000010 2024-08-27T02:52:47.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.326+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-08-27T02:52:47.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.326+0000 7ff8238499c0 20 processing logshard = reshard.0000000011 2024-08-27T02:52:47.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.330+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-08-27T02:52:47.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.330+0000 7ff8238499c0 20 processing logshard = reshard.0000000012 2024-08-27T02:52:47.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.338+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-08-27T02:52:47.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.338+0000 7ff8238499c0 20 processing logshard = reshard.0000000013 2024-08-27T02:52:47.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.346+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-08-27T02:52:47.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.346+0000 7ff8238499c0 20 processing logshard = reshard.0000000014 2024-08-27T02:52:47.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.350+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-08-27T02:52:47.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.350+0000 7ff8238499c0 20 processing logshard = reshard.0000000015 2024-08-27T02:52:47.355 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.358+0000 7ff8238499c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-08-27T02:52:47.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.358+0000 7ff6d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:47.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.362+0000 7ff8238499c0 20 remove_watcher() i=0 2024-08-27T02:52:47.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.362+0000 7ff8238499c0 2 removed watcher, disabling cache 2024-08-27T02:52:47.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.366+0000 7ff8238499c0 20 remove_watcher() i=1 2024-08-27T02:52:47.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.370+0000 7ff8238499c0 20 remove_watcher() i=2 2024-08-27T02:52:47.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.370+0000 7ff8238499c0 20 remove_watcher() i=3 2024-08-27T02:52:47.370 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.374+0000 7ff8238499c0 20 remove_watcher() i=4 2024-08-27T02:52:47.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.374+0000 7ff8238499c0 20 remove_watcher() i=5 2024-08-27T02:52:47.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.378+0000 7ff8238499c0 20 remove_watcher() i=6 2024-08-27T02:52:47.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:47.378+0000 7ff8238499c0 20 remove_watcher() i=7 2024-08-27T02:52:52.402 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:52:52.433 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:52.433 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:52.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:52.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 realm 2024-08-27T02:52:52.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:52.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:52.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:52.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.482+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.486+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:52.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.486+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.486+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:52.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.486+0000 7fc9b10f69c0 20 searching for the correct realm 2024-08-27T02:52:52.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.494+0000 7fc9af3fd640 0 -- 172.21.15.143:0/3231291754 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fc9a402e920 msgr2=0x7fc9a40593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:52.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.710+0000 7fc9aebfc640 0 -- 172.21.15.143:0/3231291754 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x562bafe543e0 msgr2=0x562bafe567d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:52.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:52.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:52.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:52.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:52.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:52.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:52.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:52.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.718+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:52.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 zone default found 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 4 Realm: () 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 zonegroup default 2024-08-27T02:52:52.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:52.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:52.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:52.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 started sync module instance, tier type = 2024-08-27T02:52:52.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.722+0000 7fc9b10f69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:52.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=0 2024-08-27T02:52:52.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=1 2024-08-27T02:52:52.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=2 2024-08-27T02:52:52.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=3 2024-08-27T02:52:52.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=4 2024-08-27T02:52:52.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=5 2024-08-27T02:52:52.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=6 2024-08-27T02:52:52.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 20 add_watcher() i=7 2024-08-27T02:52:52.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.746+0000 7fc9b10f69c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:52.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.750+0000 7fc8657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:52.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:52.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:52.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 5 note: GC not initialized 2024-08-27T02:52:52.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc7dffff640 20 reqs_thread_entry: start 2024-08-27T02:52:52.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:52.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 Filter name: none 2024-08-27T02:52:52.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc7ddffb640 20 reqs_thread_entry: start 2024-08-27T02:52:52.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:52.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:52.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:52.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.754+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.758+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:52.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.758+0000 7fc9b10f69c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:52.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.758+0000 7fc9b10f69c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:52.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.758+0000 7fc9b10f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:52.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.762+0000 7fc8657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:52.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.766+0000 7fc9b10f69c0 20 remove_watcher() i=0 2024-08-27T02:52:52.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.766+0000 7fc9b10f69c0 2 removed watcher, disabling cache 2024-08-27T02:52:52.765 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.766+0000 7fc9b10f69c0 20 remove_watcher() i=1 2024-08-27T02:52:52.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.770+0000 7fc9b10f69c0 20 remove_watcher() i=2 2024-08-27T02:52:52.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.774+0000 7fc9b10f69c0 20 remove_watcher() i=3 2024-08-27T02:52:52.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.774+0000 7fc9b10f69c0 20 remove_watcher() i=4 2024-08-27T02:52:52.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.778+0000 7fc9b10f69c0 20 remove_watcher() i=5 2024-08-27T02:52:52.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.778+0000 7fc9b10f69c0 20 remove_watcher() i=6 2024-08-27T02:52:52.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:52.778+0000 7fc9b10f69c0 20 remove_watcher() i=7 2024-08-27T02:52:52.792 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:52.792 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:52:52.792 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-08-27T02:52:52.792 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:52.792 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard add non empty bucket 2024-08-27T02:52:52.792 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:53.590 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:52:53.625 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:53.625 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:53.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.670+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 realm 2024-08-27T02:52:53.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:53.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:53.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.674+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.678+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:53.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.678+0000 7fda189119c0 20 searching for the correct realm 2024-08-27T02:52:53.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.682+0000 7fda15c16640 0 -- 172.21.15.143:0/4230398350 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x55dbdcd196a0 msgr2=0x55dbdcd1ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:53.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.690+0000 7fda16417640 0 -- 172.21.15.143:0/4230398350 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fda0c101610 msgr2=0x7fda0c101a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:53.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:53.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:53.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:53.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:53.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:53.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:53.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 zone default found 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 4 Realm: () 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 zonegroup default 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 started sync module instance, tier type = 2024-08-27T02:52:53.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.698+0000 7fda189119c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:53.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.714+0000 7fda189119c0 20 add_watcher() i=0 2024-08-27T02:52:53.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.714+0000 7fda189119c0 20 add_watcher() i=1 2024-08-27T02:52:53.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.714+0000 7fda189119c0 20 add_watcher() i=2 2024-08-27T02:52:53.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.714+0000 7fda189119c0 20 add_watcher() i=3 2024-08-27T02:52:53.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.714+0000 7fda189119c0 20 add_watcher() i=4 2024-08-27T02:52:53.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.714+0000 7fda189119c0 20 add_watcher() i=5 2024-08-27T02:52:53.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.714+0000 7fda189119c0 20 add_watcher() i=6 2024-08-27T02:52:53.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.718+0000 7fda189119c0 20 add_watcher() i=7 2024-08-27T02:52:53.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.718+0000 7fda189119c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:53.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.718+0000 7fd8ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:53.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.718+0000 7fda189119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:53.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.718+0000 7fda189119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:53.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.718+0000 7fda189119c0 5 note: GC not initialized 2024-08-27T02:52:53.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.718+0000 7fd8477fe640 20 reqs_thread_entry: start 2024-08-27T02:52:53.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:53.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 Filter name: none 2024-08-27T02:52:53.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fd8457fa640 20 reqs_thread_entry: start 2024-08-27T02:52:53.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:53.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:53.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:53.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:53.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:53.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.722+0000 7fda189119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:53.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.726+0000 7fd8ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:53.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.730+0000 7fda189119c0 20 remove_watcher() i=0 2024-08-27T02:52:53.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.730+0000 7fda189119c0 2 removed watcher, disabling cache 2024-08-27T02:52:53.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.734+0000 7fda189119c0 20 remove_watcher() i=1 2024-08-27T02:52:53.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.734+0000 7fda189119c0 20 remove_watcher() i=2 2024-08-27T02:52:53.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.734+0000 7fda189119c0 20 remove_watcher() i=3 2024-08-27T02:52:53.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.738+0000 7fda189119c0 20 remove_watcher() i=4 2024-08-27T02:52:53.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.738+0000 7fda189119c0 20 remove_watcher() i=5 2024-08-27T02:52:53.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.742+0000 7fda189119c0 20 remove_watcher() i=6 2024-08-27T02:52:53.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.742+0000 7fda189119c0 20 remove_watcher() i=7 2024-08-27T02:52:53.753 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:53.754 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:52:53.754 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-08-27T02:52:53.754 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:53.754 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-08-27T02:52:53.782 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:53.782 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:53.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.826+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.826+0000 7fc50269f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.826+0000 7fc50269f9c0 20 realm 2024-08-27T02:52:53.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:53.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:53.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:53.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:53.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:53.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.830+0000 7fc50269f9c0 20 searching for the correct realm 2024-08-27T02:52:53.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:53.838+0000 7fc5009a6640 0 -- 172.21.15.143:0/3530407594 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fc4f4046040 msgr2=0x7fc4f4047940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:54.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.054+0000 7fc5001a5640 0 -- 172.21.15.143:0/3530407594 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x557b87802200 msgr2=0x557b878045f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:54.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:54.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:54.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:54.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:54.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:54.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:54.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:54.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.062+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 zone default found 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 4 Realm: () 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 zonegroup default 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 started sync module instance, tier type = 2024-08-27T02:52:54.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.066+0000 7fc50269f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.090+0000 7fc50269f9c0 20 add_watcher() i=0 2024-08-27T02:52:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.090+0000 7fc50269f9c0 20 add_watcher() i=1 2024-08-27T02:52:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.090+0000 7fc50269f9c0 20 add_watcher() i=2 2024-08-27T02:52:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.090+0000 7fc50269f9c0 20 add_watcher() i=3 2024-08-27T02:52:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.090+0000 7fc50269f9c0 20 add_watcher() i=4 2024-08-27T02:52:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.090+0000 7fc50269f9c0 20 add_watcher() i=5 2024-08-27T02:52:54.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.090+0000 7fc50269f9c0 20 add_watcher() i=6 2024-08-27T02:52:54.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.094+0000 7fc50269f9c0 20 add_watcher() i=7 2024-08-27T02:52:54.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.094+0000 7fc50269f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:54.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc3b77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:54.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc50269f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:54.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc50269f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:54.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc50269f9c0 5 note: GC not initialized 2024-08-27T02:52:54.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc3b67dc640 20 reqs_thread_entry: start 2024-08-27T02:52:54.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc50269f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:54.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc50269f9c0 20 Filter name: none 2024-08-27T02:52:54.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc3af7fe640 20 reqs_thread_entry: start 2024-08-27T02:52:54.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc50269f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:52:54.098 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.098+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:54.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:52:54.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:52:54.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:52:54.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:54.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:52:54.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.102+0000 7fc50269f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:54.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.106+0000 7fc3b77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:54.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.110+0000 7fc50269f9c0 20 remove_watcher() i=0 2024-08-27T02:52:54.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.110+0000 7fc50269f9c0 2 removed watcher, disabling cache 2024-08-27T02:52:54.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.114+0000 7fc50269f9c0 20 remove_watcher() i=1 2024-08-27T02:52:54.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.118+0000 7fc50269f9c0 20 remove_watcher() i=2 2024-08-27T02:52:54.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.118+0000 7fc50269f9c0 20 remove_watcher() i=3 2024-08-27T02:52:54.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.122+0000 7fc50269f9c0 20 remove_watcher() i=4 2024-08-27T02:52:54.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.122+0000 7fc50269f9c0 20 remove_watcher() i=5 2024-08-27T02:52:54.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.122+0000 7fc50269f9c0 20 remove_watcher() i=6 2024-08-27T02:52:54.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.126+0000 7fc50269f9c0 20 remove_watcher() i=7 2024-08-27T02:52:54.146 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshard list 2024-08-27T02:52:54.174 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:54.174 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:54.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.222+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.222+0000 7f1b116e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.222+0000 7f1b116e19c0 20 realm 2024-08-27T02:52:54.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.222+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:54.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:54.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:54.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.226+0000 7f1b116e19c0 20 searching for the correct realm 2024-08-27T02:52:54.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.234+0000 7f1b0e9e6640 0 -- 172.21.15.143:0/1516167946 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f1b000780a0 msgr2=0x7f1b0003ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:54.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.238+0000 7f1b0f9e8640 0 -- 172.21.15.143:0/1516167946 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f1b040cf400 msgr2=0x7f1b040cf840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:54.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:54.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 zone default found 2024-08-27T02:52:54.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 4 Realm: () 2024-08-27T02:52:54.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:54.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:54.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:54.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 zonegroup default 2024-08-27T02:52:54.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.246+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.250+0000 7f1b116e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.250+0000 7f1b116e19c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.250+0000 7f1b116e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.250+0000 7f1b116e19c0 20 started sync module instance, tier type = 2024-08-27T02:52:54.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.250+0000 7f1b116e19c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:54.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.262+0000 7f1b116e19c0 20 add_watcher() i=0 2024-08-27T02:52:54.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.262+0000 7f1b116e19c0 20 add_watcher() i=1 2024-08-27T02:52:54.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.262+0000 7f1b116e19c0 20 add_watcher() i=2 2024-08-27T02:52:54.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.262+0000 7f1b116e19c0 20 add_watcher() i=3 2024-08-27T02:52:54.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.262+0000 7f1b116e19c0 20 add_watcher() i=4 2024-08-27T02:52:54.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.262+0000 7f1b116e19c0 20 add_watcher() i=5 2024-08-27T02:52:54.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.262+0000 7f1b116e19c0 20 add_watcher() i=6 2024-08-27T02:52:54.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.266+0000 7f1b116e19c0 20 add_watcher() i=7 2024-08-27T02:52:54.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.266+0000 7f1b116e19c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:54.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.266+0000 7f19c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:54.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.266+0000 7f1b116e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:54.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.266+0000 7f1b116e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:54.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.270+0000 7f1b116e19c0 5 note: GC not initialized 2024-08-27T02:52:54.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.270+0000 7f19c4fe1640 20 reqs_thread_entry: start 2024-08-27T02:52:54.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.270+0000 7f1b116e19c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:54.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.270+0000 7f1b116e19c0 20 Filter name: none 2024-08-27T02:52:54.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.270+0000 7f193e7fc640 20 reqs_thread_entry: start 2024-08-27T02:52:54.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.278+0000 7f19c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:54.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.282+0000 7f1b116e19c0 20 remove_watcher() i=0 2024-08-27T02:52:54.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.282+0000 7f1b116e19c0 2 removed watcher, disabling cache 2024-08-27T02:52:54.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.286+0000 7f1b116e19c0 20 remove_watcher() i=1 2024-08-27T02:52:54.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.286+0000 7f1b116e19c0 20 remove_watcher() i=2 2024-08-27T02:52:54.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.290+0000 7f1b116e19c0 20 remove_watcher() i=3 2024-08-27T02:52:54.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.290+0000 7f1b116e19c0 20 remove_watcher() i=4 2024-08-27T02:52:54.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.294+0000 7f1b116e19c0 20 remove_watcher() i=5 2024-08-27T02:52:54.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.294+0000 7f1b116e19c0 20 remove_watcher() i=6 2024-08-27T02:52:54.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.294+0000 7f1b116e19c0 20 remove_watcher() i=7 2024-08-27T02:52:54.308 INFO:tasks.workunit.client.0.smithi143.stderr:bucket name a-bucket 2024-08-27T02:52:54.308 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard process non empty bucket 2024-08-27T02:52:54.308 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:54.308 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshard process 2024-08-27T02:52:54.332 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:54.333 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:54.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 realm 2024-08-27T02:52:54.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:54.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.378+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.382+0000 7fc6ea33b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:54.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.382+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.382+0000 7fc6ea33b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:54.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.382+0000 7fc6ea33b9c0 20 searching for the correct realm 2024-08-27T02:52:54.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.390+0000 7fc6e8642640 0 -- 172.21.15.143:0/3993251618 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fc6d01084d0 msgr2=0x7fc6d01209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:54.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.606+0000 7fc6e7e41640 0 -- 172.21.15.143:0/3993251618 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x563e87f63f10 msgr2=0x563e87f66300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:54.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:54.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.614+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:54.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 zone default found 2024-08-27T02:52:54.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 4 Realm: () 2024-08-27T02:52:54.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:54.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:54.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:54.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 zonegroup default 2024-08-27T02:52:54.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 started sync module instance, tier type = 2024-08-27T02:52:54.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.618+0000 7fc6ea33b9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:54.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.642+0000 7fc6ea33b9c0 20 add_watcher() i=0 2024-08-27T02:52:54.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.642+0000 7fc6ea33b9c0 20 add_watcher() i=1 2024-08-27T02:52:54.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.642+0000 7fc6ea33b9c0 20 add_watcher() i=2 2024-08-27T02:52:54.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.642+0000 7fc6ea33b9c0 20 add_watcher() i=3 2024-08-27T02:52:54.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.642+0000 7fc6ea33b9c0 20 add_watcher() i=4 2024-08-27T02:52:54.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.642+0000 7fc6ea33b9c0 20 add_watcher() i=5 2024-08-27T02:52:54.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.642+0000 7fc6ea33b9c0 20 add_watcher() i=6 2024-08-27T02:52:54.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.646+0000 7fc6ea33b9c0 20 add_watcher() i=7 2024-08-27T02:52:54.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.646+0000 7fc6ea33b9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:54.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc59dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:54.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc6ea33b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:54.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc6ea33b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:54.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc6ea33b9c0 5 note: GC not initialized 2024-08-27T02:52:54.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc59cfe1640 20 reqs_thread_entry: start 2024-08-27T02:52:54.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc6ea33b9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:54.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc6ea33b9c0 20 Filter name: none 2024-08-27T02:52:54.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc5167fc640 20 reqs_thread_entry: start 2024-08-27T02:52:54.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.650+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000000 2024-08-27T02:52:54.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.658+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-08-27T02:52:54.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.658+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000001 2024-08-27T02:52:54.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.662+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-08-27T02:52:54.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.662+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000002 2024-08-27T02:52:54.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.666+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-08-27T02:52:54.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.666+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000003 2024-08-27T02:52:54.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.670+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-08-27T02:52:54.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.670+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000004 2024-08-27T02:52:54.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.678+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-08-27T02:52:54.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.678+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000005 2024-08-27T02:52:54.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.682+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-08-27T02:52:54.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.682+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000006 2024-08-27T02:52:54.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 20 process_entry resharding a-bucket 2024-08-27T02:52:54.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:52:54.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:54.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-08-27T02:52:54.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:52:54.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:52:54.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.686+0000 7fc6ea33b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.690+0000 7fc6ea33b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:54.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.690+0000 7fc6ea33b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.690+0000 7fc6ea33b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.690+0000 7fc6ea33b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:52:54.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.690+0000 7fc6ea33b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.690+0000 7fc6ea33b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc6ea33b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc6ea33b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc6ea33b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc6ea33b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc5c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94826569069584 notifier 5900 bl.length()=827 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc5c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc5c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.702+0000 7fc5c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.706+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:52:54.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.706+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:52:54.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.706+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:52:54.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.706+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:52:54.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:52:54.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.0 2024-08-27T02:52:54.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.0 2024-08-27T02:52:54.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.1 2024-08-27T02:52:54.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.1 2024-08-27T02:52:54.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.2 2024-08-27T02:52:54.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.722+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.2 2024-08-27T02:52:54.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.3 2024-08-27T02:52:54.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.3 2024-08-27T02:52:54.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.4 2024-08-27T02:52:54.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.4 2024-08-27T02:52:54.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.5 2024-08-27T02:52:54.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.5 2024-08-27T02:52:54.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.6 2024-08-27T02:52:54.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.726+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.6 2024-08-27T02:52:54.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.730+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.7 2024-08-27T02:52:54.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.730+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.7 2024-08-27T02:52:54.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.730+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.8 2024-08-27T02:52:54.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.730+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.8 2024-08-27T02:52:54.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.730+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.9 2024-08-27T02:52:54.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.730+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.9 2024-08-27T02:52:54.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.734+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.10 2024-08-27T02:52:54.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.734+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.10 2024-08-27T02:52:54.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.734+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.11 2024-08-27T02:52:54.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.734+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.11 2024-08-27T02:52:54.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.738+0000 7fc6ea33b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : hit (requested=0x17, cached=0x17) 2024-08-27T02:52:54.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.738+0000 7fc6ea33b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:54.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc6ea33b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc6ea33b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc6ea33b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc6ea33b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:52:54.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc5c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94826569069584 notifier 5900 bl.length()=827 2024-08-27T02:52:54.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc5c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc5c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.742+0000 7fc5c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.746+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:52:54.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.746+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:52:54.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.746+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:52:54.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.746+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:52:54.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.750+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.0 2024-08-27T02:52:54.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.750+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.0 2024-08-27T02:52:54.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.750+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.1 2024-08-27T02:52:54.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.750+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.1 2024-08-27T02:52:54.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.2 2024-08-27T02:52:54.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.2 2024-08-27T02:52:54.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.3 2024-08-27T02:52:54.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.3 2024-08-27T02:52:54.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.4 2024-08-27T02:52:54.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.4 2024-08-27T02:52:54.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.5 2024-08-27T02:52:54.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.5 2024-08-27T02:52:54.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.6 2024-08-27T02:52:54.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.754+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.6 2024-08-27T02:52:54.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.7 2024-08-27T02:52:54.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.7 2024-08-27T02:52:54.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.8 2024-08-27T02:52:54.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.8 2024-08-27T02:52:54.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.9 2024-08-27T02:52:54.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.9 2024-08-27T02:52:54.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.10 2024-08-27T02:52:54.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.10 2024-08-27T02:52:54.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.11 2024-08-27T02:52:54.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.1.11 2024-08-27T02:52:54.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : hit (requested=0x17, cached=0x17) 2024-08-27T02:52:54.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.758+0000 7fc6ea33b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:52:54.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc6ea33b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc6ea33b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc6ea33b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc6ea33b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:52:54.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc5c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94826569069584 notifier 5900 bl.length()=795 2024-08-27T02:52:54.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc5c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:52:54.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc5c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:52:54.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.762+0000 7fc5c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:52:54.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.766+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:52:54.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.766+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:52:54.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.766+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:52:54.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.766+0000 7fc6ea33b9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:52:54.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.770+0000 7fc6ea33b9c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-08-27T02:52:54.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.774+0000 7fc6ea33b9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-08-27T02:52:54.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.778+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-08-27T02:52:54.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.778+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000007 2024-08-27T02:52:54.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.782+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-08-27T02:52:54.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.782+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000008 2024-08-27T02:52:54.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.790+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-08-27T02:52:54.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.790+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000009 2024-08-27T02:52:54.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.798+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-08-27T02:52:54.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.798+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000010 2024-08-27T02:52:54.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.802+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-08-27T02:52:54.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.802+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000011 2024-08-27T02:52:54.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.806+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-08-27T02:52:54.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.806+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000012 2024-08-27T02:52:54.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.814+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-08-27T02:52:54.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.814+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000013 2024-08-27T02:52:54.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.822+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-08-27T02:52:54.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.822+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000014 2024-08-27T02:52:54.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.826+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-08-27T02:52:54.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.826+0000 7fc6ea33b9c0 20 processing logshard = reshard.0000000015 2024-08-27T02:52:54.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.830+0000 7fc6ea33b9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-08-27T02:52:54.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.834+0000 7fc59dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:54.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.838+0000 7fc6ea33b9c0 20 remove_watcher() i=0 2024-08-27T02:52:54.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.838+0000 7fc6ea33b9c0 2 removed watcher, disabling cache 2024-08-27T02:52:54.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.842+0000 7fc6ea33b9c0 20 remove_watcher() i=1 2024-08-27T02:52:54.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.842+0000 7fc6ea33b9c0 20 remove_watcher() i=2 2024-08-27T02:52:54.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.846+0000 7fc6ea33b9c0 20 remove_watcher() i=3 2024-08-27T02:52:54.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.846+0000 7fc6ea33b9c0 20 remove_watcher() i=4 2024-08-27T02:52:54.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.850+0000 7fc6ea33b9c0 20 remove_watcher() i=5 2024-08-27T02:52:54.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.850+0000 7fc6ea33b9c0 20 remove_watcher() i=6 2024-08-27T02:52:54.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.854+0000 7fc6ea33b9c0 20 remove_watcher() i=7 2024-08-27T02:52:54.873 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:52:54.901 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:54.901 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:54.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 realm 2024-08-27T02:52:54.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:54.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:54.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.950+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.954+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:54.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.954+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:54.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.954+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:54.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.954+0000 7fe5bf3679c0 20 searching for the correct realm 2024-08-27T02:52:54.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:54.958+0000 7fe5bd66e640 0 -- 172.21.15.143:0/1137917683 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fe5b00676c0 msgr2=0x7fe5b0065830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:55.172 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.174+0000 7fe5bce6d640 0 -- 172.21.15.143:0/1137917683 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55fd4ea15620 msgr2=0x55fd4ea17ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:55.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:55.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.182+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:55.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 zone default found 2024-08-27T02:52:55.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 4 Realm: () 2024-08-27T02:52:55.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:55.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:55.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:55.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 zonegroup default 2024-08-27T02:52:55.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:55.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:55.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:55.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 started sync module instance, tier type = 2024-08-27T02:52:55.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.186+0000 7fe5bf3679c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:55.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.210+0000 7fe5bf3679c0 20 add_watcher() i=0 2024-08-27T02:52:55.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.210+0000 7fe5bf3679c0 20 add_watcher() i=1 2024-08-27T02:52:55.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.210+0000 7fe5bf3679c0 20 add_watcher() i=2 2024-08-27T02:52:55.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.210+0000 7fe5bf3679c0 20 add_watcher() i=3 2024-08-27T02:52:55.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.210+0000 7fe5bf3679c0 20 add_watcher() i=4 2024-08-27T02:52:55.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.210+0000 7fe5bf3679c0 20 add_watcher() i=5 2024-08-27T02:52:55.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.210+0000 7fe5bf3679c0 20 add_watcher() i=6 2024-08-27T02:52:55.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.214+0000 7fe5bf3679c0 20 add_watcher() i=7 2024-08-27T02:52:55.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.214+0000 7fe5bf3679c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:55.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe472fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:55.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:55.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:55.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 5 note: GC not initialized 2024-08-27T02:52:55.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe471fe3640 20 reqs_thread_entry: start 2024-08-27T02:52:55.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:55.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 20 Filter name: none 2024-08-27T02:52:55.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe3e37fe640 20 reqs_thread_entry: start 2024-08-27T02:52:55.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:55.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.218+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.222+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:55.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.222+0000 7fe5bf3679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:55.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.222+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.222+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:52:55.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.222+0000 7fe5bf3679c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:55.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.222+0000 7fe5bf3679c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:52:55.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.222+0000 7fe5bf3679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:55.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.226+0000 7fe472fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:55.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.230+0000 7fe5bf3679c0 20 remove_watcher() i=0 2024-08-27T02:52:55.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.230+0000 7fe5bf3679c0 2 removed watcher, disabling cache 2024-08-27T02:52:55.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.234+0000 7fe5bf3679c0 20 remove_watcher() i=1 2024-08-27T02:52:55.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.234+0000 7fe5bf3679c0 20 remove_watcher() i=2 2024-08-27T02:52:55.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.238+0000 7fe5bf3679c0 20 remove_watcher() i=3 2024-08-27T02:52:55.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.238+0000 7fe5bf3679c0 20 remove_watcher() i=4 2024-08-27T02:52:55.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.238+0000 7fe5bf3679c0 20 remove_watcher() i=5 2024-08-27T02:52:55.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.242+0000 7fe5bf3679c0 20 remove_watcher() i=6 2024-08-27T02:52:55.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:55.242+0000 7fe5bf3679c0 20 remove_watcher() i=7 2024-08-27T02:52:55.257 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:55.257 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:52:55.257 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-08-27T02:52:55.257 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:55.257 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-08-27T02:52:55.257 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:57.374 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-27T02:52:57.408 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:57.408 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:57.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.454+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 realm 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:57.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:57.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.458+0000 7f66b07c89c0 20 searching for the correct realm 2024-08-27T02:52:57.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.466+0000 7f66aeacf640 0 -- 172.21.15.143:0/3119616142 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55c48c3dce20 msgr2=0x55c48c3df2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:57.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.474+0000 7f66adacd640 0 -- 172.21.15.143:0/3119616142 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f66a80e8020 msgr2=0x7f66a81189f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.478+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 zone default found 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 4 Realm: () 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:57.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 zonegroup default 2024-08-27T02:52:57.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 started sync module instance, tier type = 2024-08-27T02:52:57.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.482+0000 7f66b07c89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:57.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=0 2024-08-27T02:52:57.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=1 2024-08-27T02:52:57.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=2 2024-08-27T02:52:57.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=3 2024-08-27T02:52:57.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=4 2024-08-27T02:52:57.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=5 2024-08-27T02:52:57.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=6 2024-08-27T02:52:57.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 20 add_watcher() i=7 2024-08-27T02:52:57.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.498+0000 7f66b07c89c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:57.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f6564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:57.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:57.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:57.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 5 note: GC not initialized 2024-08-27T02:52:57.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f64df7fe640 20 reqs_thread_entry: start 2024-08-27T02:52:57.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:57.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 Filter name: none 2024-08-27T02:52:57.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f64dd7fa640 20 reqs_thread_entry: start 2024-08-27T02:52:57.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.502+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.506+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.506+0000 7f66b07c89c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.506+0000 7f66b07c89c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:57.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.506+0000 7f66b07c89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:57.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.506+0000 7f6564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:57.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.510+0000 7f66b07c89c0 20 remove_watcher() i=0 2024-08-27T02:52:57.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.510+0000 7f66b07c89c0 2 removed watcher, disabling cache 2024-08-27T02:52:57.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.514+0000 7f66b07c89c0 20 remove_watcher() i=1 2024-08-27T02:52:57.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.514+0000 7f66b07c89c0 20 remove_watcher() i=2 2024-08-27T02:52:57.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.518+0000 7f66b07c89c0 20 remove_watcher() i=3 2024-08-27T02:52:57.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.518+0000 7f66b07c89c0 20 remove_watcher() i=4 2024-08-27T02:52:57.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.522+0000 7f66b07c89c0 20 remove_watcher() i=5 2024-08-27T02:52:57.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.522+0000 7f66b07c89c0 20 remove_watcher() i=6 2024-08-27T02:52:57.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.522+0000 7f66b07c89c0 20 remove_watcher() i=7 2024-08-27T02:52:57.535 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:57.535 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:52:57.536 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:52:57.536 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:57.536 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-08-27T02:52:57.567 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:57.568 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:57.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 realm 2024-08-27T02:52:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.614+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.618+0000 7fc5bb9059c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:57.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.618+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.618+0000 7fc5bb9059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:57.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.618+0000 7fc5bb9059c0 20 searching for the correct realm 2024-08-27T02:52:57.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.622+0000 7fc5b8c0a640 0 -- 172.21.15.143:0/761999488 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc5ac0093d0 msgr2=0x7fc5ac009850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:57.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.630+0000 7fc5b8c0a640 0 -- 172.21.15.143:0/761999488 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc4840812e0 msgr2=0x7fc484083710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:57.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:57.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:57.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:57.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:57.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:57.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:57.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:57.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:57.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 zone default found 2024-08-27T02:52:57.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 4 Realm: () 2024-08-27T02:52:57.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:57.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 zonegroup default 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 started sync module instance, tier type = 2024-08-27T02:52:57.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.638+0000 7fc5bb9059c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:57.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=0 2024-08-27T02:52:57.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=1 2024-08-27T02:52:57.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=2 2024-08-27T02:52:57.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=3 2024-08-27T02:52:57.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=4 2024-08-27T02:52:57.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=5 2024-08-27T02:52:57.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=6 2024-08-27T02:52:57.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 20 add_watcher() i=7 2024-08-27T02:52:57.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.654+0000 7fc5bb9059c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:57.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc46f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 5 note: GC not initialized 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc46e7e4640 20 reqs_thread_entry: start 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 Filter name: none 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc3dffff640 20 reqs_thread_entry: start 2024-08-27T02:52:57.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-08-27T02:52:57.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:57.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-08-27T02:52:57.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-08-27T02:52:57.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 : miss 2024-08-27T02:52:57.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:57.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:57.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:57.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:52:57.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:57.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.658+0000 7fc5bb9059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 2024-08-27T02:52:57.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.666+0000 7fc5bb9059c0 -1 Injecting error=-5 at location=set_target_layout 2024-08-27T02:52:57.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.666+0000 7fc5bb9059c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-08-27T02:52:57.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.674+0000 7fc46f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:57.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.678+0000 7fc5bb9059c0 20 remove_watcher() i=0 2024-08-27T02:52:57.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.678+0000 7fc5bb9059c0 2 removed watcher, disabling cache 2024-08-27T02:52:57.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.682+0000 7fc5bb9059c0 20 remove_watcher() i=1 2024-08-27T02:52:57.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.682+0000 7fc5bb9059c0 20 remove_watcher() i=2 2024-08-27T02:52:57.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.686+0000 7fc5bb9059c0 20 remove_watcher() i=3 2024-08-27T02:52:57.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.686+0000 7fc5bb9059c0 20 remove_watcher() i=4 2024-08-27T02:52:57.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.690+0000 7fc5bb9059c0 20 remove_watcher() i=5 2024-08-27T02:52:57.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.690+0000 7fc5bb9059c0 20 remove_watcher() i=6 2024-08-27T02:52:57.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.690+0000 7fc5bb9059c0 20 remove_watcher() i=7 2024-08-27T02:52:57.702 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-27T02:52:57.728 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:57.728 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:57.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 realm 2024-08-27T02:52:57.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:57.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.774+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.778+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:57.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.778+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.778+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:57.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.778+0000 7f25b36749c0 20 searching for the correct realm 2024-08-27T02:52:57.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.782+0000 7f25abfff640 0 -- 172.21.15.143:0/2285436254 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f25a4006340 msgr2=0x7f25a4063dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:57.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.790+0000 7f25abfff640 0 -- 172.21.15.143:0/2285436254 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f247c081170 msgr2=0x7f247c0835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:57.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.794+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:57.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 zone default found 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 4 Realm: () 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 zonegroup default 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:57.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 started sync module instance, tier type = 2024-08-27T02:52:57.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.798+0000 7f25b36749c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:57.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=0 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=1 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=2 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=3 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=4 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=5 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=6 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 20 add_watcher() i=7 2024-08-27T02:52:57.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.814+0000 7f25b36749c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:57.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f24677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 5 note: GC not initialized 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f24667e4640 20 reqs_thread_entry: start 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 Filter name: none 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f23d7fff640 20 reqs_thread_entry: start 2024-08-27T02:52:57.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:57.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:57.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:57.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:57.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:57.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.818+0000 7f25b36749c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:57.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.822+0000 7f25b36749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:57.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.822+0000 7f24677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:57.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.826+0000 7f25b36749c0 20 remove_watcher() i=0 2024-08-27T02:52:57.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.826+0000 7f25b36749c0 2 removed watcher, disabling cache 2024-08-27T02:52:57.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.830+0000 7f25b36749c0 20 remove_watcher() i=1 2024-08-27T02:52:57.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.830+0000 7f25b36749c0 20 remove_watcher() i=2 2024-08-27T02:52:57.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.834+0000 7f25b36749c0 20 remove_watcher() i=3 2024-08-27T02:52:57.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.834+0000 7f25b36749c0 20 remove_watcher() i=4 2024-08-27T02:52:57.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.838+0000 7f25b36749c0 20 remove_watcher() i=5 2024-08-27T02:52:57.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.838+0000 7f25b36749c0 20 remove_watcher() i=6 2024-08-27T02:52:57.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:57.838+0000 7f25b36749c0 20 remove_watcher() i=7 2024-08-27T02:52:57.850 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:57.850 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:52:57.850 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:52:57.850 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:57.951 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:52:57.986 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:57.987 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:58.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.030+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 realm 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:58.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:58.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.034+0000 7f217ebfc9c0 20 searching for the correct realm 2024-08-27T02:52:58.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.042+0000 7f217cf03640 0 -- 172.21.15.143:0/4009758102 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x555ae023f3a0 msgr2=0x555ae0241840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:58.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.046+0000 7f217bf01640 0 -- 172.21.15.143:0/4009758102 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f216c03ba40 msgr2=0x7f216c072a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:52:58.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:58.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:58.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:58.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:58.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:58.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:58.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.054+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:58.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:58.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 zone default found 2024-08-27T02:52:58.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 4 Realm: () 2024-08-27T02:52:58.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:58.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:58.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:58.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 zonegroup default 2024-08-27T02:52:58.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 started sync module instance, tier type = 2024-08-27T02:52:58.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.058+0000 7f217ebfc9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=0 2024-08-27T02:52:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=1 2024-08-27T02:52:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=2 2024-08-27T02:52:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=3 2024-08-27T02:52:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=4 2024-08-27T02:52:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=5 2024-08-27T02:52:58.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=6 2024-08-27T02:52:58.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 20 add_watcher() i=7 2024-08-27T02:52:58.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.074+0000 7f217ebfc9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:58.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f20337de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:58.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:58.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:58.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 5 note: GC not initialized 2024-08-27T02:52:58.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f20327dc640 20 reqs_thread_entry: start 2024-08-27T02:52:58.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:58.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 Filter name: none 2024-08-27T02:52:58.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f202b7fe640 20 reqs_thread_entry: start 2024-08-27T02:52:58.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-08-27T02:52:58.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 : miss 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:58.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.078+0000 7f217ebfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 2024-08-27T02:52:58.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f217ebfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:58.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f217ebfc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:58.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f217ebfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:58.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f217ebfc9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19, ofs0, ns] 2024-08-27T02:52:58.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f20537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 93848795928112 notifier 6264 bl.length()=925 2024-08-27T02:52:58.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f20537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:58.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f20537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:58.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.086+0000 7f20537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:58.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.090+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): orig_sources= new_sources= 2024-08-27T02:52:58.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.090+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): potential sources added=[] removed=[] 2024-08-27T02:52:58.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.090+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): orig_dests= new_dests= 2024-08-27T02:52:58.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.090+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): potential dests added=[] removed=[] 2024-08-27T02:52:58.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.0 2024-08-27T02:52:58.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.0 2024-08-27T02:52:58.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.1 2024-08-27T02:52:58.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.1 2024-08-27T02:52:58.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.2 2024-08-27T02:52:58.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.2 2024-08-27T02:52:58.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.3 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.3 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.4 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.4 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.5 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.5 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.6 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.6 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.7 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.7 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.8 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.8 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.9 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.9 2024-08-27T02:52:58.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.10 2024-08-27T02:52:58.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.10 2024-08-27T02:52:58.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.11 2024-08-27T02:52:58.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1.11 2024-08-27T02:52:58.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.102+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.0 2024-08-27T02:52:58.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.106+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1 2024-08-27T02:52:58.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.106+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.2 2024-08-27T02:52:58.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.106+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.3 2024-08-27T02:52:58.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.106+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.4 2024-08-27T02:52:58.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.106+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.5 2024-08-27T02:52:58.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.110+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.6 2024-08-27T02:52:58.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.110+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.7 2024-08-27T02:52:58.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.110+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.8 2024-08-27T02:52:58.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.114+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.9 2024-08-27T02:52:58.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.114+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.10 2024-08-27T02:52:58.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f217ebfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 : hit (requested=0x17, cached=0x17) 2024-08-27T02:52:58.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f217ebfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 2024-08-27T02:52:58.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f217ebfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:58.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f217ebfc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:58.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f217ebfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:58.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f217ebfc9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19, ofs0, ns] 2024-08-27T02:52:58.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f20537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 93848795928112 notifier 6264 bl.length()=925 2024-08-27T02:52:58.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f20537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:58.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f20537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:58.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.122+0000 7f20537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:58.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.126+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): orig_sources= new_sources= 2024-08-27T02:52:58.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.126+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): potential sources added=[] removed=[] 2024-08-27T02:52:58.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.126+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): orig_dests= new_dests= 2024-08-27T02:52:58.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.126+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): potential dests added=[] removed=[] 2024-08-27T02:52:58.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.130+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.0 2024-08-27T02:52:58.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.134+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.1 2024-08-27T02:52:58.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.134+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.2 2024-08-27T02:52:58.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.134+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.3 2024-08-27T02:52:58.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.134+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.4 2024-08-27T02:52:58.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.134+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.5 2024-08-27T02:52:58.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.138+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.6 2024-08-27T02:52:58.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.138+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.7 2024-08-27T02:52:58.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.138+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.8 2024-08-27T02:52:58.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.138+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.9 2024-08-27T02:52:58.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.142+0000 7f217ebfc9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19.10 2024-08-27T02:52:58.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.142+0000 7f217ebfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 : hit (requested=0x17, cached=0x17) 2024-08-27T02:52:58.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.142+0000 7f217ebfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 2024-08-27T02:52:58.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f217ebfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:58.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f217ebfc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:58.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f217ebfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:58.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f217ebfc9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19, ofs0, ns] 2024-08-27T02:52:58.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f20537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 93848795928112 notifier 6264 bl.length()=893 2024-08-27T02:52:58.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f20537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 info.flags=0x17 2024-08-27T02:52:58.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f20537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 to cache LRU end 2024-08-27T02:52:58.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.146+0000 7f20537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:52:58.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.150+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): orig_sources= new_sources= 2024-08-27T02:52:58.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.150+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): potential sources added=[] removed=[] 2024-08-27T02:52:58.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.150+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): orig_dests= new_dests= 2024-08-27T02:52:58.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.150+0000 7f217ebfc9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19]): potential dests added=[] removed=[] 2024-08-27T02:52:58.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.154+0000 7f217ebfc9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-08-27T02:52:58.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.158+0000 7f20337de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:58.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.162+0000 7f217ebfc9c0 20 remove_watcher() i=0 2024-08-27T02:52:58.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.162+0000 7f217ebfc9c0 2 removed watcher, disabling cache 2024-08-27T02:52:58.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.166+0000 7f217ebfc9c0 20 remove_watcher() i=1 2024-08-27T02:52:58.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.170+0000 7f217ebfc9c0 20 remove_watcher() i=2 2024-08-27T02:52:58.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.170+0000 7f217ebfc9c0 20 remove_watcher() i=3 2024-08-27T02:52:58.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.174+0000 7f217ebfc9c0 20 remove_watcher() i=4 2024-08-27T02:52:58.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.174+0000 7f217ebfc9c0 20 remove_watcher() i=5 2024-08-27T02:52:58.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.178+0000 7f217ebfc9c0 20 remove_watcher() i=6 2024-08-27T02:52:58.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.178+0000 7f217ebfc9c0 20 remove_watcher() i=7 2024-08-27T02:52:58.191 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-27T02:52:58.221 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:52:58.221 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:52:58.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.266+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 realm 2024-08-27T02:52:58.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:52:58.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:58.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:52:58.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.270+0000 7f2dda7bc9c0 20 searching for the correct realm 2024-08-27T02:52:58.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.278+0000 7f2dd8ac3640 0 -- 172.21.15.143:0/871218191 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x562879774240 msgr2=0x562879776700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:58.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.486+0000 7f2dd82c2640 0 -- 172.21.15.143:0/871218191 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f2dc00093d0 msgr2=0x7f2dc0009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:52:58.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:52:58.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:52:58.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:52:58.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:52:58.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:52:58.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:52:58.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.902+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:52:58.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 zone default found 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 4 Realm: () 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 zonegroup default 2024-08-27T02:52:58.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.906+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.910+0000 7f2dda7bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:52:58.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.910+0000 7f2dda7bc9c0 20 started sync module instance, tier type = 2024-08-27T02:52:58.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.910+0000 7f2dda7bc9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:52:58.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=0 2024-08-27T02:52:58.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=1 2024-08-27T02:52:58.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=2 2024-08-27T02:52:58.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=3 2024-08-27T02:52:58.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=4 2024-08-27T02:52:58.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=5 2024-08-27T02:52:58.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=6 2024-08-27T02:52:58.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 20 add_watcher() i=7 2024-08-27T02:52:58.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.934+0000 7f2dda7bc9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:52:58.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.938+0000 7f2c8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:58.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:52:58.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:52:58.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 5 note: GC not initialized 2024-08-27T02:52:58.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2c8d7e2640 20 reqs_thread_entry: start 2024-08-27T02:52:58.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:52:58.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 Filter name: none 2024-08-27T02:52:58.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2bfeffd640 20 reqs_thread_entry: start 2024-08-27T02:52:58.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:58.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:58.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:58.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:52:58.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.942+0000 7f2dda7bc9c0 20 rados->read ofs=0 len=0 2024-08-27T02:52:58.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.946+0000 7f2dda7bc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:52:58.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.946+0000 7f2dda7bc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:52:58.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.950+0000 7f2c8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:52:58.950 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.954+0000 7f2dda7bc9c0 20 remove_watcher() i=0 2024-08-27T02:52:58.950 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.954+0000 7f2dda7bc9c0 2 removed watcher, disabling cache 2024-08-27T02:52:58.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.954+0000 7f2dda7bc9c0 20 remove_watcher() i=1 2024-08-27T02:52:58.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.958+0000 7f2dda7bc9c0 20 remove_watcher() i=2 2024-08-27T02:52:58.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.958+0000 7f2dda7bc9c0 20 remove_watcher() i=3 2024-08-27T02:52:58.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.962+0000 7f2dda7bc9c0 20 remove_watcher() i=4 2024-08-27T02:52:58.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.962+0000 7f2dda7bc9c0 20 remove_watcher() i=5 2024-08-27T02:52:58.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.966+0000 7f2dda7bc9c0 20 remove_watcher() i=6 2024-08-27T02:52:58.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:52:58.966+0000 7f2dda7bc9c0 20 remove_watcher() i=7 2024-08-27T02:52:58.982 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:58.982 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:52:58.982 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:52:58.982 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:52:59.889 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-08-27T02:52:59.889 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:02.109 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-27T02:53:02.142 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:02.142 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:02.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 realm 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.190+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.194+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:02.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.194+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.194+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:02.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.194+0000 7f65d9c409c0 20 searching for the correct realm 2024-08-27T02:53:02.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.198+0000 7f65d6f45640 0 -- 172.21.15.143:0/2014331273 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f65c80b5030 msgr2=0x7f65c80fdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:02.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.414+0000 7f65d7746640 0 -- 172.21.15.143:0/2014331273 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f65cc03a3e0 msgr2=0x7f65cc03a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:02.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.630+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 zone default found 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 4 Realm: () 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 zonegroup default 2024-08-27T02:53:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 started sync module instance, tier type = 2024-08-27T02:53:02.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.634+0000 7f65d9c409c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:02.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.662+0000 7f65d9c409c0 20 add_watcher() i=0 2024-08-27T02:53:02.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.662+0000 7f65d9c409c0 20 add_watcher() i=1 2024-08-27T02:53:02.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.662+0000 7f65d9c409c0 20 add_watcher() i=2 2024-08-27T02:53:02.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.662+0000 7f65d9c409c0 20 add_watcher() i=3 2024-08-27T02:53:02.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.662+0000 7f65d9c409c0 20 add_watcher() i=4 2024-08-27T02:53:02.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.662+0000 7f65d9c409c0 20 add_watcher() i=5 2024-08-27T02:53:02.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.662+0000 7f65d9c409c0 20 add_watcher() i=6 2024-08-27T02:53:02.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.666+0000 7f65d9c409c0 20 add_watcher() i=7 2024-08-27T02:53:02.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.666+0000 7f65d9c409c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:02.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.670+0000 7f648dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:02.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:02.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:02.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 5 note: GC not initialized 2024-08-27T02:53:02.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f648cfe1640 20 reqs_thread_entry: start 2024-08-27T02:53:02.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:02.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 20 Filter name: none 2024-08-27T02:53:02.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f64067fc640 20 reqs_thread_entry: start 2024-08-27T02:53:02.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:02.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.674+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.678+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:02.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.678+0000 7f65d9c409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:02.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.678+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.678+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:02.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.678+0000 7f65d9c409c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.678+0000 7f65d9c409c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:02.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.678+0000 7f65d9c409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:02.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.682+0000 7f648dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:02.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.686+0000 7f65d9c409c0 20 remove_watcher() i=0 2024-08-27T02:53:02.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.686+0000 7f65d9c409c0 2 removed watcher, disabling cache 2024-08-27T02:53:02.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.690+0000 7f65d9c409c0 20 remove_watcher() i=1 2024-08-27T02:53:02.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.690+0000 7f65d9c409c0 20 remove_watcher() i=2 2024-08-27T02:53:02.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.694+0000 7f65d9c409c0 20 remove_watcher() i=3 2024-08-27T02:53:02.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.694+0000 7f65d9c409c0 20 remove_watcher() i=4 2024-08-27T02:53:02.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.698+0000 7f65d9c409c0 20 remove_watcher() i=5 2024-08-27T02:53:02.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.698+0000 7f65d9c409c0 20 remove_watcher() i=6 2024-08-27T02:53:02.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.698+0000 7f65d9c409c0 20 remove_watcher() i=7 2024-08-27T02:53:02.714 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:02.714 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:02.715 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:53:02.715 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:02.715 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-08-27T02:53:02.751 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:02.751 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:02.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 realm 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:02.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.798+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.802+0000 7f77d4fd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.802+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.802+0000 7f77d4fd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:02.800 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.802+0000 7f77d4fd69c0 20 searching for the correct realm 2024-08-27T02:53:02.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:02.810+0000 7f77d32dd640 0 -- 172.21.15.143:0/2926642000 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f77c806d350 msgr2=0x7f77c80918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:03.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.026+0000 7f77d2adc640 0 -- 172.21.15.143:0/2926642000 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55a7a8269ca0 msgr2=0x55a7a826c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:03.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:03.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:03.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:03.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:03.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:03.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:03.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:03.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.034+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:03.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 zone default found 2024-08-27T02:53:03.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 4 Realm: () 2024-08-27T02:53:03.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:03.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:03.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:03.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 zonegroup default 2024-08-27T02:53:03.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 started sync module instance, tier type = 2024-08-27T02:53:03.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.038+0000 7f77d4fd69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.066+0000 7f77d4fd69c0 20 add_watcher() i=0 2024-08-27T02:53:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.066+0000 7f77d4fd69c0 20 add_watcher() i=1 2024-08-27T02:53:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.066+0000 7f77d4fd69c0 20 add_watcher() i=2 2024-08-27T02:53:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.066+0000 7f77d4fd69c0 20 add_watcher() i=3 2024-08-27T02:53:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.066+0000 7f77d4fd69c0 20 add_watcher() i=4 2024-08-27T02:53:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.066+0000 7f77d4fd69c0 20 add_watcher() i=5 2024-08-27T02:53:03.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.066+0000 7f77d4fd69c0 20 add_watcher() i=6 2024-08-27T02:53:03.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.070+0000 7f77d4fd69c0 20 add_watcher() i=7 2024-08-27T02:53:03.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.070+0000 7f77d4fd69c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:03.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f76897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:03.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:03.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:03.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 5 note: GC not initialized 2024-08-27T02:53:03.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f7603fff640 20 reqs_thread_entry: start 2024-08-27T02:53:03.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:03.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 20 Filter name: none 2024-08-27T02:53:03.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f7601ffb640 20 reqs_thread_entry: start 2024-08-27T02:53:03.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-08-27T02:53:03.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:03.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-08-27T02:53:03.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.074+0000 7f77d4fd69c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-08-27T02:53:03.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 : miss 2024-08-27T02:53:03.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:03.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 info.flags=0x17 2024-08-27T02:53:03.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 to cache LRU end 2024-08-27T02:53:03.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:03.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:03.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.078+0000 7f77d4fd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 2024-08-27T02:53:03.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.086+0000 7f77d4fd69c0 -1 Injecting error=-125 at location=set_target_layout 2024-08-27T02:53:03.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f77d4fd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 info.flags=0x17 2024-08-27T02:53:03.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f77d4fd69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 to cache LRU end 2024-08-27T02:53:03.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f77d4fd69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:03.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f77d4fd69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20, ofs0, ns] 2024-08-27T02:53:03.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f76b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366227 cookie 94178569043536 notifier 6035 bl.length()=925 2024-08-27T02:53:03.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f76b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 info.flags=0x17 2024-08-27T02:53:03.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f76b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 to cache LRU end 2024-08-27T02:53:03.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.090+0000 7f76b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:03.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.094+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): orig_sources= new_sources= 2024-08-27T02:53:03.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.094+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): potential sources added=[] removed=[] 2024-08-27T02:53:03.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.094+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): orig_dests= new_dests= 2024-08-27T02:53:03.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.094+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): potential dests added=[] removed=[] 2024-08-27T02:53:03.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.0 2024-08-27T02:53:03.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.0 2024-08-27T02:53:03.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.1 2024-08-27T02:53:03.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.1 2024-08-27T02:53:03.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.2 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.2 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.3 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.3 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.4 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.4 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.5 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.5 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.6 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.6 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.7 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.7 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.8 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.8 2024-08-27T02:53:03.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.9 2024-08-27T02:53:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.9 2024-08-27T02:53:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.10 2024-08-27T02:53:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.10 2024-08-27T02:53:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.11 2024-08-27T02:53:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1.11 2024-08-27T02:53:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.0 2024-08-27T02:53:03.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.102+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1 2024-08-27T02:53:03.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.106+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.2 2024-08-27T02:53:03.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.106+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.3 2024-08-27T02:53:03.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.106+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.4 2024-08-27T02:53:03.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.110+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.5 2024-08-27T02:53:03.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.110+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.6 2024-08-27T02:53:03.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.110+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.7 2024-08-27T02:53:03.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.110+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.8 2024-08-27T02:53:03.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.114+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.9 2024-08-27T02:53:03.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.114+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.10 2024-08-27T02:53:03.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.118+0000 7f77d4fd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:03.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.118+0000 7f77d4fd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 2024-08-27T02:53:03.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f77d4fd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 info.flags=0x17 2024-08-27T02:53:03.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f77d4fd69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 to cache LRU end 2024-08-27T02:53:03.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f77d4fd69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f77d4fd69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20, ofs0, ns] 2024-08-27T02:53:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f76b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94178569043536 notifier 6035 bl.length()=925 2024-08-27T02:53:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f76b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 info.flags=0x17 2024-08-27T02:53:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f76b5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 to cache LRU end 2024-08-27T02:53:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.122+0000 7f76b5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:03.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.126+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): orig_sources= new_sources= 2024-08-27T02:53:03.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.126+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): potential sources added=[] removed=[] 2024-08-27T02:53:03.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.126+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): orig_dests= new_dests= 2024-08-27T02:53:03.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.126+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): potential dests added=[] removed=[] 2024-08-27T02:53:03.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.130+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.0 2024-08-27T02:53:03.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.130+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.1 2024-08-27T02:53:03.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.134+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.2 2024-08-27T02:53:03.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.134+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.3 2024-08-27T02:53:03.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.134+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.4 2024-08-27T02:53:03.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.134+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.5 2024-08-27T02:53:03.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.134+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.6 2024-08-27T02:53:03.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.134+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.7 2024-08-27T02:53:03.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.138+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.8 2024-08-27T02:53:03.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.138+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.9 2024-08-27T02:53:03.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.138+0000 7f77d4fd69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20.10 2024-08-27T02:53:03.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.138+0000 7f77d4fd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:03.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.138+0000 7f77d4fd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 2024-08-27T02:53:03.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f77d4fd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 info.flags=0x17 2024-08-27T02:53:03.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f77d4fd69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 to cache LRU end 2024-08-27T02:53:03.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f77d4fd69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:03.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f77d4fd69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20, ofs0, ns] 2024-08-27T02:53:03.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f76b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366229 cookie 94178569043536 notifier 6035 bl.length()=893 2024-08-27T02:53:03.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f76b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 info.flags=0x17 2024-08-27T02:53:03.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f76b5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 to cache LRU end 2024-08-27T02:53:03.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.142+0000 7f76b5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:03.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.146+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): orig_sources= new_sources= 2024-08-27T02:53:03.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.146+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): potential sources added=[] removed=[] 2024-08-27T02:53:03.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.146+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): orig_dests= new_dests= 2024-08-27T02:53:03.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.146+0000 7f77d4fd69c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20]): potential dests added=[] removed=[] 2024-08-27T02:53:03.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.150+0000 7f77d4fd69c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-08-27T02:53:03.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.154+0000 7f76897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:03.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.158+0000 7f77d4fd69c0 20 remove_watcher() i=0 2024-08-27T02:53:03.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.158+0000 7f77d4fd69c0 2 removed watcher, disabling cache 2024-08-27T02:53:03.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.162+0000 7f77d4fd69c0 20 remove_watcher() i=1 2024-08-27T02:53:03.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.162+0000 7f77d4fd69c0 20 remove_watcher() i=2 2024-08-27T02:53:03.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.166+0000 7f77d4fd69c0 20 remove_watcher() i=3 2024-08-27T02:53:03.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.166+0000 7f77d4fd69c0 20 remove_watcher() i=4 2024-08-27T02:53:03.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.170+0000 7f77d4fd69c0 20 remove_watcher() i=5 2024-08-27T02:53:03.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.170+0000 7f77d4fd69c0 20 remove_watcher() i=6 2024-08-27T02:53:03.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.174+0000 7f77d4fd69c0 20 remove_watcher() i=7 2024-08-27T02:53:03.188 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-08-27T02:53:03.217 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:03.217 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:03.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.262+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 realm 2024-08-27T02:53:03.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:03.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:03.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.266+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.270+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:03.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.270+0000 7f3f6971f9c0 20 searching for the correct realm 2024-08-27T02:53:03.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.274+0000 7f3f66a24640 0 -- 172.21.15.143:0/622185829 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f3f58139230 msgr2=0x7f3f580c6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:03.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.282+0000 7f3f66a24640 0 -- 172.21.15.143:0/622185829 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f3e30081140 msgr2=0x7f3e30083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:03.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.286+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:03.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:03.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 zone default found 2024-08-27T02:53:03.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 4 Realm: () 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 zonegroup default 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:03.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 started sync module instance, tier type = 2024-08-27T02:53:03.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.290+0000 7f3f6971f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:03.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=0 2024-08-27T02:53:03.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=1 2024-08-27T02:53:03.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=2 2024-08-27T02:53:03.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=3 2024-08-27T02:53:03.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=4 2024-08-27T02:53:03.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=5 2024-08-27T02:53:03.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=6 2024-08-27T02:53:03.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 20 add_watcher() i=7 2024-08-27T02:53:03.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.306+0000 7f3f6971f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:03.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3e1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:03.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:03.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:03.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 5 note: GC not initialized 2024-08-27T02:53:03.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3e1cfe1640 20 reqs_thread_entry: start 2024-08-27T02:53:03.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:03.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 20 Filter name: none 2024-08-27T02:53:03.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3d967fc640 20 reqs_thread_entry: start 2024-08-27T02:53:03.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:03.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.310+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.314+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:03.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.314+0000 7f3f6971f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:03.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.314+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.314+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:03.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.314+0000 7f3f6971f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:03.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.314+0000 7f3f6971f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:03.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.314+0000 7f3f6971f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:03.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.318+0000 7f3e1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:03.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.322+0000 7f3f6971f9c0 20 remove_watcher() i=0 2024-08-27T02:53:03.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.322+0000 7f3f6971f9c0 2 removed watcher, disabling cache 2024-08-27T02:53:03.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.322+0000 7f3f6971f9c0 20 remove_watcher() i=1 2024-08-27T02:53:03.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.326+0000 7f3f6971f9c0 20 remove_watcher() i=2 2024-08-27T02:53:03.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.326+0000 7f3f6971f9c0 20 remove_watcher() i=3 2024-08-27T02:53:03.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.330+0000 7f3f6971f9c0 20 remove_watcher() i=4 2024-08-27T02:53:03.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.330+0000 7f3f6971f9c0 20 remove_watcher() i=5 2024-08-27T02:53:03.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.330+0000 7f3f6971f9c0 20 remove_watcher() i=6 2024-08-27T02:53:03.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:03.334+0000 7f3f6971f9c0 20 remove_watcher() i=7 2024-08-27T02:53:03.345 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:03.345 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:03.345 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-08-27T02:53:03.345 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:04.321 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with abort at set_target_layout 2024-08-27T02:53:04.321 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:06.534 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-08-27T02:53:06.567 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:06.567 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:06.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.613+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 realm 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:06.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:06.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:06.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.617+0000 7f7cca5589c0 20 searching for the correct realm 2024-08-27T02:53:06.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.625+0000 7f7cc885f640 0 -- 172.21.15.143:0/748905567 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f7cbc0da030 msgr2=0x7f7cbc0ce420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:06.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.629+0000 7f7cc805e640 0 -- 172.21.15.143:0/748905567 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f7cbc0c18f0 msgr2=0x7f7cbc0da410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.845+0000 7f7cca5589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.845+0000 7f7cca5589c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.845+0000 7f7cca5589c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.845+0000 7f7cca5589c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.845+0000 7f7cca5589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.845+0000 7f7cca5589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:06.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.845+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:06.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:06.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:06.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 zone default found 2024-08-27T02:53:06.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 4 Realm: () 2024-08-27T02:53:06.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:06.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:06.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:06.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 zonegroup default 2024-08-27T02:53:06.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:06.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:06.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.849+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.853+0000 7f7cca5589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:06.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.853+0000 7f7cca5589c0 20 started sync module instance, tier type = 2024-08-27T02:53:06.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.853+0000 7f7cca5589c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:06.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=0 2024-08-27T02:53:06.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=1 2024-08-27T02:53:06.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=2 2024-08-27T02:53:06.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=3 2024-08-27T02:53:06.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=4 2024-08-27T02:53:06.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=5 2024-08-27T02:53:06.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=6 2024-08-27T02:53:06.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 20 add_watcher() i=7 2024-08-27T02:53:06.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.877+0000 7f7cca5589c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:06.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.881+0000 7f7b7e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:06.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:06.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:06.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 5 note: GC not initialized 2024-08-27T02:53:06.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7b7d7e2640 20 reqs_thread_entry: start 2024-08-27T02:53:06.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:06.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 20 Filter name: none 2024-08-27T02:53:06.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7aeeffd640 20 reqs_thread_entry: start 2024-08-27T02:53:06.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:06.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.885+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.889+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:06.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.889+0000 7f7cca5589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:06.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.889+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.889+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:06.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.889+0000 7f7cca5589c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:06.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.889+0000 7f7cca5589c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:06.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.889+0000 7f7cca5589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:06.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.893+0000 7f7b7e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:06.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.897+0000 7f7cca5589c0 20 remove_watcher() i=0 2024-08-27T02:53:06.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.897+0000 7f7cca5589c0 2 removed watcher, disabling cache 2024-08-27T02:53:06.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.901+0000 7f7cca5589c0 20 remove_watcher() i=1 2024-08-27T02:53:06.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.901+0000 7f7cca5589c0 20 remove_watcher() i=2 2024-08-27T02:53:06.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.905+0000 7f7cca5589c0 20 remove_watcher() i=3 2024-08-27T02:53:06.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.905+0000 7f7cca5589c0 20 remove_watcher() i=4 2024-08-27T02:53:06.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.909+0000 7f7cca5589c0 20 remove_watcher() i=5 2024-08-27T02:53:06.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.909+0000 7f7cca5589c0 20 remove_watcher() i=6 2024-08-27T02:53:06.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:06.909+0000 7f7cca5589c0 20 remove_watcher() i=7 2024-08-27T02:53:06.926 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:06.926 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:06.926 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:53:06.926 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:06.926 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-08-27T02:53:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:07.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.005+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 realm 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:07.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.009+0000 7fb251b689c0 20 searching for the correct realm 2024-08-27T02:53:07.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.013+0000 7fb24ee6d640 0 -- 172.21.15.143:0/2163194904 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb240104070 msgr2=0x7fb24011e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:07.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.229+0000 7fb24f66e640 0 -- 172.21.15.143:0/2163194904 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fb244072eb0 msgr2=0x7fb2440965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:07.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:07.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:07.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:07.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:07.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:07.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:07.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:07.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 zone default found 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 4 Realm: () 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 zonegroup default 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 started sync module instance, tier type = 2024-08-27T02:53:07.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.449+0000 7fb251b689c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=0 2024-08-27T02:53:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=1 2024-08-27T02:53:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=2 2024-08-27T02:53:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=3 2024-08-27T02:53:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=4 2024-08-27T02:53:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=5 2024-08-27T02:53:07.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=6 2024-08-27T02:53:07.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.477+0000 7fb251b689c0 20 add_watcher() i=7 2024-08-27T02:53:07.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.477+0000 7fb251b689c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:07.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:07.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:07.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:07.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 5 note: GC not initialized 2024-08-27T02:53:07.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb104fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:07.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:07.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 20 Filter name: none 2024-08-27T02:53:07.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb07e7fc640 20 reqs_thread_entry: start 2024-08-27T02:53:07.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-27T02:53:07.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:07.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-27T02:53:07.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-27T02:53:07.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 : miss 2024-08-27T02:53:07.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.485+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:07.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.485+0000 7fb251b689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:07.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.485+0000 7fb251b689c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:07.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.485+0000 7fb251b689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:07.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.485+0000 7fb251b689c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:07.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.485+0000 7fb251b689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 2024-08-27T02:53:07.491 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb251b689c0 time 2024-08-27T02:53:07.497364+0000 2024-08-27T02:53:07.491 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb2554422eb] 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:07.496 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.497+0000 7fb251b689c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb251b689c0 time 2024-08-27T02:53:07.497364+0000 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb2554422eb] 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:07.497 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:07.498 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.498 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:53:07.498 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb251b689c0 thread_name:radosgw-admin 2024-08-27T02:53:07.535 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.535 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb2542c1520] 2024-08-27T02:53:07.535 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:07.535 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:07.535 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb255442345] 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.497+0000 7fb251b689c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb251b689c0 thread_name:radosgw-admin 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.536 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb2542c1520] 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb255442345] 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:07.537 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.863555s 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773bdbdc0 auth_method 0 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.538 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x7fb2380023c0 auth_method 0 2024-08-27T02:53:07.539 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.539 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.539 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.539 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.539 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.539 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.539 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_done global_id 6071 payload 274 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 1 monclient: found mon.noname-c 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:07.542 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: dump: 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.543 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6071 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: get_monmap_and_config success 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:53:06.985+0000 7fb251b689c0 4 set_mon_vals no callback set 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: dump: 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.544 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: shutdown 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 asok(0x5647739ca280) unregister_commands rotate-key 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.545 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding auth protocol: cephx 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding auth protocol: cephx 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding auth protocol: cephx 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.546 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:53:06.985+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: starting msgr at 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: starting objecter 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command objecter_requests hook 0x564773a65920 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: setting wanted keys 2024-08-27T02:53:07.547 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: calling monclient init 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding auth protocol: cephx 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding auth protocol: cephx 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding auth protocol: cephx 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.548 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:53:06.985+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:53:06.985+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key hook 0x564773bd51b8 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773bdb520 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773bdbdc0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x7fb2380023c0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.549 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.866592s 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773bdbdc0 auth_method 0 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request con 0x7fb2380023c0 auth_method 0 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.550 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_done global_id 6074 payload 824 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 1 monclient: found mon.noname-c 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: dump: 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.551 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:07.552 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: dump: 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:53:06.985+0000 7fb13d60a640 4 set_mon_vals no callback set 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6074 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.553 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:53:06.989+0000 7fb251b689c0 1 librados: init done 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:53:06.989+0000 7fb13be07640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:53:06.989+0000 7fb13be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:53:06.989+0000 7fb13be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:53:06.989+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb134070ad0 auth_method 0 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:53:06.989+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x564773c054d0 auth_method 0 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:53:06.989+0000 7fb24f66e640 10 monclient: get_auth_request con 0x564773c21790 auth_method 0 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:53:06.993+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x564773c26820 auth_method 0 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:53:06.997+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.554 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding auth protocol: cephx 2024-08-27T02:53:07.555 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding auth protocol: cephx 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding auth protocol: cephx 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.556 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:53:06.997+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command objecter_requests cmddesc objecter_requests hook 0x564773c2e280 EEXIST 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding auth protocol: cephx 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding auth protocol: cephx 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding auth protocol: cephx 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.557 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:53:06.997+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:53:06.997+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key cmddesc rotate-key hook 0x564773c299e0 EEXIST 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773c52430 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x564773c51d60 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773c50740 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.558 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.877239s 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x564773c52430 auth_method 0 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773c51d60 auth_method 0 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.559 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:53:06.997+0000 7fb24f66e640 1 monclient: found mon.noname-a 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:53:06.997+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x564773c50740 auth_method 0 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: dump: 2024-08-27T02:53:07.560 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.561 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: dump: 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.562 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6372 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:53:06.997+0000 7fb250670640 4 set_mon_vals no callback set 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:53:07.001+0000 7fb139602640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:53:07.001+0000 7fb139602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:53:07.001+0000 7fb139602640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: get_monmap_and_config 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.563 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding auth protocol: cephx 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding auth protocol: cephx 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding auth protocol: cephx 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.564 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x7fb1280709e0 auth_method 0 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.565 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding auth protocol: cephx 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding auth protocol: cephx 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding auth protocol: cephx 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.566 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key cmddesc rotate-key hook 0x7fffade138e8 EEXIST 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773ca6170 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x564773ca1520 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773c96c30 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.567 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.881705s 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x564773ca6170 auth_method 0 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773ca1520 auth_method 0 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.568 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_done global_id 6375 payload 274 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:53:07.001+0000 7fb24f66e640 1 monclient: found mon.noname-a 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: dump: 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.569 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: dump: 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.570 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6375 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: get_monmap_and_config success 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:53:07.001+0000 7fb251b689c0 4 set_mon_vals no callback set 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: shutdown 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.571 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding auth protocol: cephx 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding auth protocol: cephx 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding auth protocol: cephx 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.572 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: starting msgr at 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: starting objecter 2024-08-27T02:53:07.573 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command objecter_requests cmddesc objecter_requests hook 0x564773c53d00 EEXIST 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: setting wanted keys 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: calling monclient init 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding auth protocol: cephx 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding auth protocol: cephx 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding auth protocol: cephx 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.574 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:53:07.005+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:53:07.005+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key cmddesc rotate-key hook 0x564773c54398 EEXIST 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773c96c30 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x564773ca1520 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.575 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773ca6170 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.884317s 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x564773c96c30 auth_method 0 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773ca1520 auth_method 0 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.576 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request con 0x564773ca6170 auth_method 0 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_done global_id 6083 payload 824 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.577 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 1 monclient: found mon.noname-c 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: dump: 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.578 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: dump: 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.579 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:53:07.005+0000 7fb132ffd640 4 set_mon_vals no callback set 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:53:07.005+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6083 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:53:07.005+0000 7fb251b689c0 1 librados: init done 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:53:07.005+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cr dump hook 0x564773c738d8 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:53:07.005+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.580 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:53:07.005+0000 7fb1317fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:53:07.005+0000 7fb1317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:53:07.005+0000 7fb1317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:53:07.009+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x564773cbf980 auth_method 0 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:53:07.009+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb118070aa0 auth_method 0 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 realm 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:53:07.009+0000 7fb251b689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.581 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:53:07.009+0000 7fb24f66e640 10 monclient: get_auth_request con 0x564773cc3c70 auth_method 0 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 searching for the correct realm 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:53:07.009+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x564773cc8dc0 auth_method 0 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:53:07.013+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x7fb244046030 auth_method 0 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:53:07.013+0000 7fb24f66e640 10 monclient: get_auth_request con 0x564773a84da0 auth_method 0 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:53:07.013+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x7fb240104070 auth_method 0 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:53:07.013+0000 7fb24ee6d640 0 -- 172.21.15.143:0/2163194904 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb240104070 msgr2=0x7fb24011e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:07.582 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:53:07.217+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x7fb240104070 auth_method 0 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:53:07.221+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x7fb244017070 auth_method 0 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:53:07.229+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb244072eb0 auth_method 0 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:53:07.229+0000 7fb24f66e640 0 -- 172.21.15.143:0/2163194904 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fb244072eb0 msgr2=0x7fb2440965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:53:07.433+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb244072eb0 auth_method 0 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:07.583 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 zone default found 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:53:07.449+0000 7fb251b689c0 4 Realm: () 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:53:07.449+0000 7fb251b689c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:53:07.449+0000 7fb251b689c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:53:07.449+0000 7fb251b689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 zonegroup default 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.584 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 started sync module instance, tier type = 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=0 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=1 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=2 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=3 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=4 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=5 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=6 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:53:07.477+0000 7fb251b689c0 20 add_watcher() i=7 2024-08-27T02:53:07.585 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:53:07.477+0000 7fb251b689c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding auth protocol: cephx 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding auth protocol: cephx 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding auth protocol: cephx 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:53:07.481+0000 7fb105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.586 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:53:07.481+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache list hook 0x564773c9bdd0 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache inspect hook 0x564773c9bdd0 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache erase hook 0x564773c9bdd0 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache zap hook 0x564773c9bdd0 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 note: GC not initialized 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:53:07.481+0000 7fb104fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace show hook 0x7fb2440018e0 2024-08-27T02:53:07.587 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace history hook 0x7fb2440018e0 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace active hook 0x7fb2440018e0 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace active_short hook 0x7fb2440018e0 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 Filter name: none 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:53:07.481+0000 7fb07e7fc640 20 reqs_thread_entry: start 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 : miss 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.588 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:53:07.485+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:53:07.497+0000 7fb251b689c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb251b689c0 time 2024-08-27T02:53:07.497364+0000 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb2554422eb] 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.589 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:53:07.497+0000 7fb251b689c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb251b689c0 thread_name:radosgw-admin 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb2542c1520] 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:07.590 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb255442345] 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:53:07.591 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:53:07.592 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:53:07.593 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:53:07.594 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:53:07.595 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:53:07.596 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:53:07.597 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb07e7fc640 / http_manager 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb104fe1640 / http_manager 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb105fe3640 / rgw_dt_lg_renew 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb1317fa640 / ms_dispatch 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb132ffd640 / io_context_pool 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb139602640 / ms_dispatch 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb13be07640 / ms_dispatch 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb13d60a640 / io_context_pool 2024-08-27T02:53:07.598 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb24ee6d640 / msgr-worker-2 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb24f66e640 / msgr-worker-1 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb24fe6f640 / msgr-worker-0 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb250670640 / io_context_pool 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb251b689c0 / radosgw-admin 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.81499.log 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.599 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:53:06.981+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.863555s 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773bdbdc0 auth_method 0 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x7fb2380023c0 auth_method 0 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:53:06.981+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.600 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:53:06.981+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_done global_id 6071 payload 274 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 1 monclient: found mon.noname-c 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: dump: 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6071 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: get_monmap_and_config success 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:53:06.985+0000 7fb251b689c0 4 set_mon_vals no callback set 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:53:06.985+0000 7fb13d60a640 10 monclient: dump: 2024-08-27T02:53:07.602 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: shutdown 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 asok(0x5647739ca280) unregister_commands rotate-key 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.603 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding auth protocol: cephx 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding auth protocol: cephx 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding auth protocol: cephx 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.604 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: crc 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bfe8a0) adding con mode: secure 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:53:06.985+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: starting msgr at 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: starting objecter 2024-08-27T02:53:07.605 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command objecter_requests hook 0x564773a65920 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: setting wanted keys 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:53:06.985+0000 7fb251b689c0 1 librados: calling monclient init 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding auth protocol: cephx 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding auth protocol: cephx 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding auth protocol: cephx 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.606 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: crc 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 AuthRegistry(0x564773bd5070) adding con mode: secure 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:53:06.985+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:53:06.985+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key hook 0x564773bd51b8 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773bdb520 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773bdbdc0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x7fb2380023c0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.607 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.866592s 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773bdbdc0 auth_method 0 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request con 0x7fb2380023c0 auth_method 0 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:53:06.985+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.608 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient(hunting): handle_auth_done global_id 6074 payload 824 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 1 monclient: found mon.noname-c 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:53:06.985+0000 7fb24fe6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: dump: 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.609 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:53:06.985+0000 7fb13be07640 10 monclient: dump: 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.610 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:53:06.985+0000 7fb13d60a640 4 set_mon_vals no callback set 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:53:06.985+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6074 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:53:06.985+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:53:06.989+0000 7fb251b689c0 1 librados: init done 2024-08-27T02:53:07.611 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:53:06.989+0000 7fb13be07640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:53:06.989+0000 7fb13be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:53:06.989+0000 7fb13be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:53:06.989+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb134070ad0 auth_method 0 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:53:06.989+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x564773c054d0 auth_method 0 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:53:06.989+0000 7fb24f66e640 10 monclient: get_auth_request con 0x564773c21790 auth_method 0 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:53:06.993+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x564773c26820 auth_method 0 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:53:06.997+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.612 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding auth protocol: cephx 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding auth protocol: cephx 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding auth protocol: cephx 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.613 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: crc 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c2a8e0) adding con mode: secure 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:53:06.997+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command objecter_requests cmddesc objecter_requests hook 0x564773c2e280 EEXIST 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding auth protocol: cephx 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding auth protocol: cephx 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding auth protocol: cephx 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.614 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: crc 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 AuthRegistry(0x564773c29898) adding con mode: secure 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:53:06.997+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:53:06.997+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key cmddesc rotate-key hook 0x564773c299e0 EEXIST 2024-08-27T02:53:07.615 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773c52430 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x564773c51d60 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773c50740 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.877239s 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x564773c52430 auth_method 0 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.616 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773c51d60 auth_method 0 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:53:06.997+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:53:06.997+0000 7fb24f66e640 1 monclient: found mon.noname-a 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:53:06.997+0000 7fb24f66e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.617 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:53:06.997+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x564773c50740 auth_method 0 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: dump: 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.618 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:53:06.997+0000 7fb139602640 10 monclient: dump: 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:53:06.997+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6372 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:53:06.997+0000 7fb250670640 4 set_mon_vals no callback set 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:53:06.997+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:53:07.001+0000 7fb139602640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:53:07.001+0000 7fb139602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:53:07.001+0000 7fb139602640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: get_monmap_and_config 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.620 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding auth protocol: cephx 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding auth protocol: cephx 2024-08-27T02:53:07.621 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding auth protocol: cephx 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: crc 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c71c30) adding con mode: secure 2024-08-27T02:53:07.622 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x7fb1280709e0 auth_method 0 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding auth protocol: cephx 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding auth protocol: cephx 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding auth protocol: cephx 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.623 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: crc 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x7fffade137a0) adding con mode: secure 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key cmddesc rotate-key hook 0x7fffade138e8 EEXIST 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773ca6170 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x564773ca1520 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773c96c30 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.624 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.881705s 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x564773ca6170 auth_method 0 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773ca1520 auth_method 0 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.625 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:53:07.001+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient(hunting): handle_auth_done global_id 6375 payload 274 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:53:07.001+0000 7fb24f66e640 1 monclient: found mon.noname-a 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:53:07.001+0000 7fb24f66e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: dump: 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.626 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:53:07.001+0000 7fb132ffd640 10 monclient: dump: 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.627 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6375 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: get_monmap_and_config success 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:53:07.001+0000 7fb251b689c0 4 set_mon_vals no callback set 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: shutdown 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: build_initial_monmap 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:07.628 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: monmap: 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding auth protocol: cephx 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding auth protocol: cephx 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding auth protocol: cephx 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.629 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: crc 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c970e0) adding con mode: secure 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: starting msgr at 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: starting objecter 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command objecter_requests cmddesc objecter_requests hook 0x564773c53d00 EEXIST 2024-08-27T02:53:07.630 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: setting wanted keys 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:53:07.001+0000 7fb251b689c0 1 librados: calling monclient init 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:53:07.001+0000 7fb251b689c0 10 monclient: init 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding auth protocol: cephx 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding auth protocol: cephx 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding auth protocol: cephx 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.631 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: crc 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:53:07.001+0000 7fb251b689c0 5 AuthRegistry(0x564773c54250) adding con mode: secure 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:53:07.001+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:53:07.005+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:53:07.005+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command rotate-key cmddesc rotate-key hook 0x564773c54398 EEXIST 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-a con 0x564773c96c30 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-c con 0x564773ca1520 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): picked mon.noname-b con 0x564773ca6170 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.632 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient(hunting): authenticate will time out at 2319.884317s 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): get_auth_request con 0x564773c96c30 auth_method 0 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request con 0x564773ca1520 auth_method 0 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.633 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:53:07.005+0000 7fb24f66e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request con 0x564773ca6170 auth_method 0 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:53:07.005+0000 7fb24fe6f640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient(hunting): handle_auth_done global_id 6083 payload 824 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient: _finish_hunting 0 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 1 monclient: found mon.noname-c 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:53:07.005+0000 7fb24ee6d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.634 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: dump: 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: _finish_auth 0 2024-08-27T02:53:07.635 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: _check_auth_tickets 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:53:07.005+0000 7fb1317fa640 10 monclient: dump: 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.636 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:53:07.005+0000 7fb132ffd640 4 set_mon_vals no callback set 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:53:07.005+0000 7fb251b689c0 5 monclient: authenticate success, global_id 6083 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _renew_subs 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:53:07.005+0000 7fb251b689c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:53:07.005+0000 7fb251b689c0 1 librados: init done 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:53:07.005+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cr dump hook 0x564773c738d8 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:53:07.005+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:53:07.005+0000 7fb1317fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:53:07.005+0000 7fb1317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:53:07.005+0000 7fb1317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:53:07.009+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x564773cbf980 auth_method 0 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:53:07.009+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb118070aa0 auth_method 0 2024-08-27T02:53:07.637 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 realm 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:53:07.009+0000 7fb251b689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:53:07.009+0000 7fb24f66e640 10 monclient: get_auth_request con 0x564773cc3c70 auth_method 0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:53:07.009+0000 7fb251b689c0 20 searching for the correct realm 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:53:07.009+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x564773cc8dc0 auth_method 0 2024-08-27T02:53:07.638 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:53:07.013+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x7fb244046030 auth_method 0 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:53:07.013+0000 7fb24f66e640 10 monclient: get_auth_request con 0x564773a84da0 auth_method 0 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:53:07.013+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x7fb240104070 auth_method 0 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:53:07.013+0000 7fb24ee6d640 0 -- 172.21.15.143:0/2163194904 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb240104070 msgr2=0x7fb24011e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:53:07.217+0000 7fb24ee6d640 10 monclient: get_auth_request con 0x7fb240104070 auth_method 0 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:53:07.221+0000 7fb24fe6f640 10 monclient: get_auth_request con 0x7fb244017070 auth_method 0 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:53:07.229+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb244072eb0 auth_method 0 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:53:07.229+0000 7fb24f66e640 0 -- 172.21.15.143:0/2163194904 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fb244072eb0 msgr2=0x7fb2440965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:53:07.433+0000 7fb24f66e640 10 monclient: get_auth_request con 0x7fb244072eb0 auth_method 0 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:07.639 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:53:07.445+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 zone default found 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:53:07.449+0000 7fb251b689c0 4 Realm: () 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:53:07.449+0000 7fb251b689c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:53:07.449+0000 7fb251b689c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:53:07.449+0000 7fb251b689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 zonegroup default 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.640 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 started sync module instance, tier type = 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:53:07.449+0000 7fb251b689c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=0 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=1 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=2 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=3 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=4 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=5 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:53:07.473+0000 7fb251b689c0 20 add_watcher() i=6 2024-08-27T02:53:07.641 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:53:07.477+0000 7fb251b689c0 20 add_watcher() i=7 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:53:07.477+0000 7fb251b689c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding auth protocol: cephx 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding auth protocol: cephx 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding auth protocol: cephx 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:53:07.481+0000 7fb105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.642 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: crc 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 AuthRegistry(0x7fffade13c80) adding con mode: secure 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:53:07.481+0000 7fb251b689c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache list hook 0x564773c9bdd0 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache inspect hook 0x564773c9bdd0 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache erase hook 0x564773c9bdd0 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command cache zap hook 0x564773c9bdd0 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 note: GC not initialized 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:53:07.481+0000 7fb104fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:07.643 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace show hook 0x7fb2440018e0 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace history hook 0x7fb2440018e0 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace active hook 0x7fb2440018e0 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:53:07.481+0000 7fb251b689c0 5 asok(0x5647739ca280) register_command sync trace active_short hook 0x7fb2440018e0 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 Filter name: none 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:53:07.481+0000 7fb07e7fc640 20 reqs_thread_entry: start 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:53:07.481+0000 7fb251b689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 : miss 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:53:07.481+0000 7fb251b689c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:53:07.485+0000 7fb251b689c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:07.644 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:53:07.485+0000 7fb251b689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:53:07.497+0000 7fb251b689c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb251b689c0 time 2024-08-27T02:53:07.497364+0000 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb2554422eb] 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.645 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:53:07.497+0000 7fb251b689c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb251b689c0 thread_name:radosgw-admin 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb2542c1520] 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:07.646 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb255442345] 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb25544249f] 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564770c33b11] 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x141fd78) [0x56477168fd78] 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564770c4915d] 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb2542a8d90] 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:53:07.647 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:53:07.648 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:53:07.649 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:53:07.650 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:53:07.651 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:53:07.652 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:53:07.653 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb07e7fc640 / http_manager 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb104fe1640 / http_manager 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb105fe3640 / rgw_dt_lg_renew 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb1317fa640 / ms_dispatch 2024-08-27T02:53:07.654 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb132ffd640 / io_context_pool 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb139602640 / ms_dispatch 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb13be07640 / ms_dispatch 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb13d60a640 / io_context_pool 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb24ee6d640 / msgr-worker-2 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb24f66e640 / msgr-worker-1 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb24fe6f640 / msgr-worker-0 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb250670640 / io_context_pool 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb251b689c0 / radosgw-admin 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:53:07.504243Z_0f81f11e-da54-432b-ad1d-e0ec8bf78544/log 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:53:07.655 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-08-27T02:53:07.657 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:07.657 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:07.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 realm 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.589+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.593+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.593+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.593+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.593+0000 7fcca7d6c9c0 20 searching for the correct realm 2024-08-27T02:53:07.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.601+0000 7fcca6073640 0 -- 172.21.15.143:0/1664000966 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fcc9c04b940 msgr2=0x7fcc9c02e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:07.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.817+0000 7fcca5872640 0 -- 172.21.15.143:0/1664000966 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55e2b0b5af20 msgr2=0x55e2b0b5d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:07.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:07.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:07.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:07.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:07.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:07.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:07.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:07.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.825+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:07.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 zone default found 2024-08-27T02:53:07.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 4 Realm: () 2024-08-27T02:53:07.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:07.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:07.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:07.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 zonegroup default 2024-08-27T02:53:07.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:07.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 started sync module instance, tier type = 2024-08-27T02:53:07.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.829+0000 7fcca7d6c9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:07.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=0 2024-08-27T02:53:07.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=1 2024-08-27T02:53:07.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=2 2024-08-27T02:53:07.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=3 2024-08-27T02:53:07.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=4 2024-08-27T02:53:07.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=5 2024-08-27T02:53:07.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=6 2024-08-27T02:53:07.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 20 add_watcher() i=7 2024-08-27T02:53:07.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.853+0000 7fcca7d6c9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:07.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.857+0000 7fcb577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:07.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:07.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:07.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 5 note: GC not initialized 2024-08-27T02:53:07.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcb567fc640 20 reqs_thread_entry: start 2024-08-27T02:53:07.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:07.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 Filter name: none 2024-08-27T02:53:07.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcac7fff640 20 reqs_thread_entry: start 2024-08-27T02:53:07.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:07.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:07.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:07.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.861+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.865+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:07.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.865+0000 7fcca7d6c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:07.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.865+0000 7fcca7d6c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:07.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.865+0000 7fcca7d6c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:07.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.869+0000 7fcb577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:07.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.873+0000 7fcca7d6c9c0 20 remove_watcher() i=0 2024-08-27T02:53:07.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.873+0000 7fcca7d6c9c0 2 removed watcher, disabling cache 2024-08-27T02:53:07.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.877+0000 7fcca7d6c9c0 20 remove_watcher() i=1 2024-08-27T02:53:07.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.877+0000 7fcca7d6c9c0 20 remove_watcher() i=2 2024-08-27T02:53:07.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.881+0000 7fcca7d6c9c0 20 remove_watcher() i=3 2024-08-27T02:53:07.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.881+0000 7fcca7d6c9c0 20 remove_watcher() i=4 2024-08-27T02:53:07.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.885+0000 7fcca7d6c9c0 20 remove_watcher() i=5 2024-08-27T02:53:07.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.885+0000 7fcca7d6c9c0 20 remove_watcher() i=6 2024-08-27T02:53:07.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:07.889+0000 7fcca7d6c9c0 20 remove_watcher() i=7 2024-08-27T02:53:07.903 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:07.903 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:07.903 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:53:07.903 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:08.011 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:53:08.047 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:08.047 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:08.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 realm 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:08.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:08.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.093+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.097+0000 7fbdcd2619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:08.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.097+0000 7fbdcd2619c0 20 searching for the correct realm 2024-08-27T02:53:08.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.101+0000 7fbdca566640 0 -- 172.21.15.143:0/614894883 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fbdbc036060 msgr2=0x7fbdbc07a9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:08.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.109+0000 7fbdca566640 0 -- 172.21.15.143:0/614894883 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fbc94081170 msgr2=0x7fbc940835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.113+0000 7fbdcd2619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.113+0000 7fbdcd2619c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.113+0000 7fbdcd2619c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.113+0000 7fbdcd2619c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.113+0000 7fbdcd2619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.113+0000 7fbdcd2619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:08.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.113+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:08.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:08.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 zone default found 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 4 Realm: () 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 zonegroup default 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:08.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:08.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:08.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 started sync module instance, tier type = 2024-08-27T02:53:08.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.117+0000 7fbdcd2619c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:08.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=0 2024-08-27T02:53:08.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=1 2024-08-27T02:53:08.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=2 2024-08-27T02:53:08.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=3 2024-08-27T02:53:08.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=4 2024-08-27T02:53:08.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=5 2024-08-27T02:53:08.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=6 2024-08-27T02:53:08.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 20 add_watcher() i=7 2024-08-27T02:53:08.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.133+0000 7fbdcd2619c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:08.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbc817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 5 note: GC not initialized 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbbfbfff640 20 reqs_thread_entry: start 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 20 Filter name: none 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbbf9ffb640 20 reqs_thread_entry: start 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-27T02:53:08.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:08.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-27T02:53:08.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-27T02:53:08.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 : miss 2024-08-27T02:53:08.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.137+0000 7fbdcd2619c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:08.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbdcd2619c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:08.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbdcd2619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:08.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbdcd2619c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:08.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbdcd2619c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:08.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbdcd2619c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:08.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbdcd2619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 2024-08-27T02:53:08.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbdcd2619c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to be held by another RGW process; skipping for now 2024-08-27T02:53:08.141 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.141+0000 7fbc817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:08.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.149+0000 7fbdcd2619c0 20 remove_watcher() i=0 2024-08-27T02:53:08.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.149+0000 7fbdcd2619c0 2 removed watcher, disabling cache 2024-08-27T02:53:08.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.149+0000 7fbdcd2619c0 20 remove_watcher() i=1 2024-08-27T02:53:08.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.153+0000 7fbdcd2619c0 20 remove_watcher() i=2 2024-08-27T02:53:08.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.153+0000 7fbdcd2619c0 20 remove_watcher() i=3 2024-08-27T02:53:08.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.157+0000 7fbdcd2619c0 20 remove_watcher() i=4 2024-08-27T02:53:08.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.157+0000 7fbdcd2619c0 20 remove_watcher() i=5 2024-08-27T02:53:08.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.157+0000 7fbdcd2619c0 20 remove_watcher() i=6 2024-08-27T02:53:08.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:08.161+0000 7fbdcd2619c0 20 remove_watcher() i=7 2024-08-27T02:53:08.172 INFO:tasks.workunit.client.0.smithi143.stderr:waiting 30 seconds for reshard lock to expire... 2024-08-27T02:53:38.187 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:53:38.223 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:38.224 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:38.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.268+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.268+0000 7f7ee660e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.268+0000 7f7ee660e9c0 20 realm 2024-08-27T02:53:38.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.268+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:38.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:38.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:38.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.272+0000 7f7ee660e9c0 20 searching for the correct realm 2024-08-27T02:53:38.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.280+0000 7f7ee3913640 0 -- 172.21.15.143:0/1930491357 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f7ed4017020 msgr2=0x7f7ed407f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:38.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.288+0000 7f7ee3913640 0 -- 172.21.15.143:0/1930491357 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f7dac0811a0 msgr2=0x7f7dac0835d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:38.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:38.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:38.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 zone default found 2024-08-27T02:53:38.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 4 Realm: () 2024-08-27T02:53:38.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:38.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:38.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:38.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 zonegroup default 2024-08-27T02:53:38.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 started sync module instance, tier type = 2024-08-27T02:53:38.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.296+0000 7f7ee660e9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:38.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.312+0000 7f7ee660e9c0 20 add_watcher() i=0 2024-08-27T02:53:38.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.312+0000 7f7ee660e9c0 20 add_watcher() i=1 2024-08-27T02:53:38.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.312+0000 7f7ee660e9c0 20 add_watcher() i=2 2024-08-27T02:53:38.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.312+0000 7f7ee660e9c0 20 add_watcher() i=3 2024-08-27T02:53:38.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.312+0000 7f7ee660e9c0 20 add_watcher() i=4 2024-08-27T02:53:38.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.312+0000 7f7ee660e9c0 20 add_watcher() i=5 2024-08-27T02:53:38.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.312+0000 7f7ee660e9c0 20 add_watcher() i=6 2024-08-27T02:53:38.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7ee660e9c0 20 add_watcher() i=7 2024-08-27T02:53:38.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7ee660e9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:38.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7d9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:38.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7ee660e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:38.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7ee660e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:38.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7ee660e9c0 5 note: GC not initialized 2024-08-27T02:53:38.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7d99fdb640 20 reqs_thread_entry: start 2024-08-27T02:53:38.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7ee660e9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:38.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.316+0000 7f7ee660e9c0 20 Filter name: none 2024-08-27T02:53:38.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7d0b7fe640 20 reqs_thread_entry: start 2024-08-27T02:53:38.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-08-27T02:53:38.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:38.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-08-27T02:53:38.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-08-27T02:53:38.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 : miss 2024-08-27T02:53:38.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:38.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:38.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:38.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:38.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:38.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.320+0000 7f7ee660e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 2024-08-27T02:53:38.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.328+0000 7f7ee660e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:38.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.328+0000 7f7ee660e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:38.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.328+0000 7f7ee660e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:38.330 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.328+0000 7f7ee660e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21, ofs0, ns] 2024-08-27T02:53:38.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7dbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94621010166768 notifier 6137 bl.length()=925 2024-08-27T02:53:38.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7dbaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:38.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7dbaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:38.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7dbaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:38.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): orig_sources= new_sources= 2024-08-27T02:53:38.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): potential sources added=[] removed=[] 2024-08-27T02:53:38.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): orig_dests= new_dests= 2024-08-27T02:53:38.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.332+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): potential dests added=[] removed=[] 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.0 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.0 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.1 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.1 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.2 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.2 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.3 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.3 2024-08-27T02:53:38.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.4 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.4 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.5 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.5 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.6 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.6 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.7 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.7 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.8 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.8 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.9 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.9 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.10 2024-08-27T02:53:38.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.10 2024-08-27T02:53:38.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.11 2024-08-27T02:53:38.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1.11 2024-08-27T02:53:38.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.0 2024-08-27T02:53:38.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1 2024-08-27T02:53:38.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.344+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.2 2024-08-27T02:53:38.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.348+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.3 2024-08-27T02:53:38.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.348+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.4 2024-08-27T02:53:38.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.348+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.5 2024-08-27T02:53:38.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.352+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.6 2024-08-27T02:53:38.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.352+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.7 2024-08-27T02:53:38.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.352+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.8 2024-08-27T02:53:38.352 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.352+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.9 2024-08-27T02:53:38.353 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.352+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.10 2024-08-27T02:53:38.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.360+0000 7f7ee660e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:38.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.360+0000 7f7ee660e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21, ofs0, ns] 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7dbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94621010166768 notifier 6137 bl.length()=925 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7dbaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7dbaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:38.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7dbaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:38.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): orig_sources= new_sources= 2024-08-27T02:53:38.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): potential sources added=[] removed=[] 2024-08-27T02:53:38.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): orig_dests= new_dests= 2024-08-27T02:53:38.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.364+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): potential dests added=[] removed=[] 2024-08-27T02:53:38.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.372+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.0 2024-08-27T02:53:38.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.372+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.1 2024-08-27T02:53:38.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.372+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.2 2024-08-27T02:53:38.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.372+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.3 2024-08-27T02:53:38.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.372+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.4 2024-08-27T02:53:38.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.376+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.5 2024-08-27T02:53:38.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.376+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.6 2024-08-27T02:53:38.376 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.376+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.7 2024-08-27T02:53:38.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.376+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.8 2024-08-27T02:53:38.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.376+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.9 2024-08-27T02:53:38.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.380+0000 7f7ee660e9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21.10 2024-08-27T02:53:38.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.380+0000 7f7ee660e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:38.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.380+0000 7f7ee660e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 2024-08-27T02:53:38.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.380+0000 7f7ee660e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:38.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.380+0000 7f7ee660e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:38.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.380+0000 7f7ee660e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:38.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.380+0000 7f7ee660e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21, ofs0, ns] 2024-08-27T02:53:38.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7dbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94621010166768 notifier 6137 bl.length()=893 2024-08-27T02:53:38.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7dbb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 info.flags=0x17 2024-08-27T02:53:38.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7dbb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 to cache LRU end 2024-08-27T02:53:38.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7dbb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:38.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): orig_sources= new_sources= 2024-08-27T02:53:38.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): potential sources added=[] removed=[] 2024-08-27T02:53:38.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): orig_dests= new_dests= 2024-08-27T02:53:38.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.384+0000 7f7ee660e9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21]): potential dests added=[] removed=[] 2024-08-27T02:53:38.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.392+0000 7f7ee660e9c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-08-27T02:53:38.394 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.392+0000 7f7d9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:38.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.400+0000 7f7ee660e9c0 20 remove_watcher() i=0 2024-08-27T02:53:38.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.400+0000 7f7ee660e9c0 2 removed watcher, disabling cache 2024-08-27T02:53:38.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.400+0000 7f7ee660e9c0 20 remove_watcher() i=1 2024-08-27T02:53:38.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.404+0000 7f7ee660e9c0 20 remove_watcher() i=2 2024-08-27T02:53:38.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.404+0000 7f7ee660e9c0 20 remove_watcher() i=3 2024-08-27T02:53:38.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.408+0000 7f7ee660e9c0 20 remove_watcher() i=4 2024-08-27T02:53:38.408 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.408+0000 7f7ee660e9c0 20 remove_watcher() i=5 2024-08-27T02:53:38.409 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.408+0000 7f7ee660e9c0 20 remove_watcher() i=6 2024-08-27T02:53:38.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.412+0000 7f7ee660e9c0 20 remove_watcher() i=7 2024-08-27T02:53:38.426 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-08-27T02:53:38.454 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:38.454 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:38.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.496+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 realm 2024-08-27T02:53:38.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:38.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:38.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:38.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.500+0000 7f52c98929c0 20 searching for the correct realm 2024-08-27T02:53:38.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.508+0000 7f52c7b99640 0 -- 172.21.15.143:0/3531970857 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x557c856b9b60 msgr2=0x557c856bbf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:38.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.512+0000 7f52c7398640 0 -- 172.21.15.143:0/3531970857 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f52bc053900 msgr2=0x7f52bc00d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:38.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:38.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:38.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:38.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:38.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:38.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:38.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 zone default found 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 4 Realm: () 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 zonegroup default 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.520+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.524+0000 7f52c98929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.524+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.524+0000 7f52c98929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.524+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.524+0000 7f52c98929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:38.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.524+0000 7f52c98929c0 20 started sync module instance, tier type = 2024-08-27T02:53:38.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.524+0000 7f52c98929c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:38.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=0 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=1 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=2 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=3 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=4 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=5 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=6 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 20 add_watcher() i=7 2024-08-27T02:53:38.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.540+0000 7f52c98929c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:38.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f517dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 5 note: GC not initialized 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f517cfe1640 20 reqs_thread_entry: start 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 20 Filter name: none 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f50f67fc640 20 reqs_thread_entry: start 2024-08-27T02:53:38.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:38.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.544+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.548+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:38.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.548+0000 7f52c98929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:38.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.548+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.548+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=194 2024-08-27T02:53:38.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.548+0000 7f52c98929c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:38.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.548+0000 7f52c98929c0 20 rados_obj.operate() r=0 bl.length=416 2024-08-27T02:53:38.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.548+0000 7f52c98929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:38.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.552+0000 7f517dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:38.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.556+0000 7f52c98929c0 20 remove_watcher() i=0 2024-08-27T02:53:38.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.556+0000 7f52c98929c0 2 removed watcher, disabling cache 2024-08-27T02:53:38.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.560+0000 7f52c98929c0 20 remove_watcher() i=1 2024-08-27T02:53:38.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.560+0000 7f52c98929c0 20 remove_watcher() i=2 2024-08-27T02:53:38.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.564+0000 7f52c98929c0 20 remove_watcher() i=3 2024-08-27T02:53:38.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.564+0000 7f52c98929c0 20 remove_watcher() i=4 2024-08-27T02:53:38.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.564+0000 7f52c98929c0 20 remove_watcher() i=5 2024-08-27T02:53:38.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.568+0000 7f52c98929c0 20 remove_watcher() i=6 2024-08-27T02:53:38.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:38.568+0000 7f52c98929c0 20 remove_watcher() i=7 2024-08-27T02:53:38.581 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:38.581 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:38.581 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-set-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:53:38.581 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:39.467 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-08-27T02:53:39.468 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:41.701 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-08-27T02:53:41.734 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:41.734 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:41.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:41.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:41.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 realm 2024-08-27T02:53:41.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:41.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:41.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:41.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:41.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:41.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.780+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:41.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.784+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:41.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.784+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:41.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.784+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:41.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.784+0000 7f2863c739c0 20 searching for the correct realm 2024-08-27T02:53:41.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:41.788+0000 7f2860f78640 0 -- 172.21.15.143:0/1572315420 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f284c002410 msgr2=0x7f2854104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:42.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.004+0000 7f2861779640 0 -- 172.21.15.143:0/1572315420 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f2858090180 msgr2=0x7f2858089320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:42.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.220+0000 7f2863c739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:42.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.220+0000 7f2863c739c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:42.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.220+0000 7f2863c739c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:42.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.220+0000 7f2863c739c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:42.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.220+0000 7f2863c739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:42.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.220+0000 7f2863c739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:42.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.220+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 zone default found 2024-08-27T02:53:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 4 Realm: () 2024-08-27T02:53:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 zonegroup default 2024-08-27T02:53:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 started sync module instance, tier type = 2024-08-27T02:53:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.224+0000 7f2863c739c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:42.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.248+0000 7f2863c739c0 20 add_watcher() i=0 2024-08-27T02:53:42.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.248+0000 7f2863c739c0 20 add_watcher() i=1 2024-08-27T02:53:42.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.248+0000 7f2863c739c0 20 add_watcher() i=2 2024-08-27T02:53:42.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.248+0000 7f2863c739c0 20 add_watcher() i=3 2024-08-27T02:53:42.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.248+0000 7f2863c739c0 20 add_watcher() i=4 2024-08-27T02:53:42.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.248+0000 7f2863c739c0 20 add_watcher() i=5 2024-08-27T02:53:42.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.248+0000 7f2863c739c0 20 add_watcher() i=6 2024-08-27T02:53:42.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.252+0000 7f2863c739c0 20 add_watcher() i=7 2024-08-27T02:53:42.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.252+0000 7f2863c739c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:42.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f27177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:42.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f2863c739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:42.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f2863c739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:42.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f2863c739c0 5 note: GC not initialized 2024-08-27T02:53:42.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f27167e4640 20 reqs_thread_entry: start 2024-08-27T02:53:42.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f2863c739c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:42.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f2863c739c0 20 Filter name: none 2024-08-27T02:53:42.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f2687fff640 20 reqs_thread_entry: start 2024-08-27T02:53:42.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.256+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.260+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:42.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.260+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.260+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:42.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.260+0000 7f2863c739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:42.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.260+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.260+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:42.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.260+0000 7f2863c739c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.264+0000 7f2863c739c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.264+0000 7f2863c739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.264+0000 7f27177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:42.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.272+0000 7f2863c739c0 20 remove_watcher() i=0 2024-08-27T02:53:42.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.272+0000 7f2863c739c0 2 removed watcher, disabling cache 2024-08-27T02:53:42.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.272+0000 7f2863c739c0 20 remove_watcher() i=1 2024-08-27T02:53:42.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.276+0000 7f2863c739c0 20 remove_watcher() i=2 2024-08-27T02:53:42.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.276+0000 7f2863c739c0 20 remove_watcher() i=3 2024-08-27T02:53:42.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.280+0000 7f2863c739c0 20 remove_watcher() i=4 2024-08-27T02:53:42.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.280+0000 7f2863c739c0 20 remove_watcher() i=5 2024-08-27T02:53:42.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.284+0000 7f2863c739c0 20 remove_watcher() i=6 2024-08-27T02:53:42.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.284+0000 7f2863c739c0 20 remove_watcher() i=7 2024-08-27T02:53:42.298 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:42.298 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:42.299 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-block-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:53:42.299 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:42.299 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-08-27T02:53:42.335 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:42.336 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:42.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.376+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 realm 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:42.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.380+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.384+0000 7f10bf5369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:42.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.384+0000 7f10bf5369c0 20 searching for the correct realm 2024-08-27T02:53:42.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.392+0000 7f10bd83d640 0 -- 172.21.15.143:0/3245591556 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f10b406c050 msgr2=0x7f10b4061fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:42.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.608+0000 7f10bd03c640 0 -- 172.21.15.143:0/3245591556 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x559b40f230a0 msgr2=0x559b40f254b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:42.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:42.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.616+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:42.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 zone default found 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 4 Realm: () 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 zonegroup default 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 started sync module instance, tier type = 2024-08-27T02:53:42.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.620+0000 7f10bf5369c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:42.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.644+0000 7f10bf5369c0 20 add_watcher() i=0 2024-08-27T02:53:42.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.644+0000 7f10bf5369c0 20 add_watcher() i=1 2024-08-27T02:53:42.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.644+0000 7f10bf5369c0 20 add_watcher() i=2 2024-08-27T02:53:42.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.644+0000 7f10bf5369c0 20 add_watcher() i=3 2024-08-27T02:53:42.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.644+0000 7f10bf5369c0 20 add_watcher() i=4 2024-08-27T02:53:42.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.644+0000 7f10bf5369c0 20 add_watcher() i=5 2024-08-27T02:53:42.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.644+0000 7f10bf5369c0 20 add_watcher() i=6 2024-08-27T02:53:42.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.648+0000 7f10bf5369c0 20 add_watcher() i=7 2024-08-27T02:53:42.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.648+0000 7f10bf5369c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.652+0000 7f0f73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:42.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.652+0000 7f10bf5369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:42.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.652+0000 7f10bf5369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:42.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.652+0000 7f10bf5369c0 5 note: GC not initialized 2024-08-27T02:53:42.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.652+0000 7f0f72fe5640 20 reqs_thread_entry: start 2024-08-27T02:53:42.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.652+0000 7f10bf5369c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:42.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.652+0000 7f10bf5369c0 20 Filter name: none 2024-08-27T02:53:42.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f0f70fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:42.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-08-27T02:53:42.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:42.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-08-27T02:53:42.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-08-27T02:53:42.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 : miss 2024-08-27T02:53:42.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:42.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:42.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:42.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:42.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:42.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.656+0000 7f10bf5369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 2024-08-27T02:53:42.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f10bf5369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:42.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f10bf5369c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:42.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f10bf5369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:42.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f10bf5369c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22, ofs0, ns] 2024-08-27T02:53:42.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f0fa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94125297950784 notifier 6182 bl.length()=915 2024-08-27T02:53:42.671 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f0fa0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:42.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f0fa0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:42.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.672+0000 7f0fa0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.676+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_sources= new_sources= 2024-08-27T02:53:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.676+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential sources added=[] removed=[] 2024-08-27T02:53:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.676+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_dests= new_dests= 2024-08-27T02:53:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.676+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential dests added=[] removed=[] 2024-08-27T02:53:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.0 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.0 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.1 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.1 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.2 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.2 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.3 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.3 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.4 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.4 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.5 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.5 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.6 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.6 2024-08-27T02:53:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.7 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.7 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.8 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.8 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.9 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.9 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.10 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.10 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.11 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.11 2024-08-27T02:53:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.684+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.0 2024-08-27T02:53:42.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.688+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1 2024-08-27T02:53:42.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.688+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.2 2024-08-27T02:53:42.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.688+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.3 2024-08-27T02:53:42.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.688+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.4 2024-08-27T02:53:42.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.692+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.5 2024-08-27T02:53:42.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.692+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.6 2024-08-27T02:53:42.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.692+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.7 2024-08-27T02:53:42.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.692+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.8 2024-08-27T02:53:42.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.692+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.9 2024-08-27T02:53:42.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.692+0000 7f10bf5369c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.10 2024-08-27T02:53:42.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.700+0000 7f10bf5369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:42.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.700+0000 7f10bf5369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 2024-08-27T02:53:42.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f10bf5369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:42.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f10bf5369c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:42.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f10bf5369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:42.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f10bf5369c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22, ofs0, ns] 2024-08-27T02:53:42.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f0fa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94125297950784 notifier 6182 bl.length()=915 2024-08-27T02:53:42.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f0fa0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:42.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f0fa0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:42.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.704+0000 7f0fa0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.708+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_sources= new_sources= 2024-08-27T02:53:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.708+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential sources added=[] removed=[] 2024-08-27T02:53:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.708+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_dests= new_dests= 2024-08-27T02:53:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.708+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential dests added=[] removed=[] 2024-08-27T02:53:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.708+0000 7f10bf5369c0 -1 Injecting error=-5 at location=block_writes 2024-08-27T02:53:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.708+0000 7f10bf5369c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-08-27T02:53:42.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.720+0000 7f10bf5369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:42.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.720+0000 7f10bf5369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 2024-08-27T02:53:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f10bf5369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f10bf5369c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f10bf5369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f10bf5369c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22, ofs0, ns] 2024-08-27T02:53:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f0fa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94125297950784 notifier 6182 bl.length()=883 2024-08-27T02:53:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f0fa0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f0fa0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.724+0000 7f0fa0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:42.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.728+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_sources= new_sources= 2024-08-27T02:53:42.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.728+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential sources added=[] removed=[] 2024-08-27T02:53:42.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.728+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_dests= new_dests= 2024-08-27T02:53:42.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.728+0000 7f10bf5369c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential dests added=[] removed=[] 2024-08-27T02:53:42.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.732+0000 7f10bf5369c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-08-27T02:53:42.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.736+0000 7f0f73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:42.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.744+0000 7f10bf5369c0 20 remove_watcher() i=0 2024-08-27T02:53:42.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.744+0000 7f10bf5369c0 2 removed watcher, disabling cache 2024-08-27T02:53:42.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.744+0000 7f10bf5369c0 20 remove_watcher() i=1 2024-08-27T02:53:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.748+0000 7f10bf5369c0 20 remove_watcher() i=2 2024-08-27T02:53:42.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.752+0000 7f10bf5369c0 20 remove_watcher() i=3 2024-08-27T02:53:42.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.752+0000 7f10bf5369c0 20 remove_watcher() i=4 2024-08-27T02:53:42.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.756+0000 7f10bf5369c0 20 remove_watcher() i=5 2024-08-27T02:53:42.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.756+0000 7f10bf5369c0 20 remove_watcher() i=6 2024-08-27T02:53:42.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.756+0000 7f10bf5369c0 20 remove_watcher() i=7 2024-08-27T02:53:42.776 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-08-27T02:53:42.807 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:42.807 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:42.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.852+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.852+0000 7f4eee26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.852+0000 7f4eee26a9c0 20 realm 2024-08-27T02:53:42.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.852+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:42.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:42.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:42.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.856+0000 7f4eee26a9c0 20 searching for the correct realm 2024-08-27T02:53:42.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.864+0000 7f4eeb56f640 0 -- 172.21.15.143:0/3197163014 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f4edc004020 msgr2=0x7f4edc062b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:42.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.868+0000 7f4eeb56f640 0 -- 172.21.15.143:0/3197163014 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f4db40810c0 msgr2=0x7f4db40834f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:42.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:42.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:42.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:42.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:42.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:42.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:42.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:42.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:42.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 zone default found 2024-08-27T02:53:42.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 4 Realm: () 2024-08-27T02:53:42.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:42.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:42.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:42.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 zonegroup default 2024-08-27T02:53:42.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.876+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.880+0000 7f4eee26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.880+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.880+0000 7f4eee26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:42.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.880+0000 7f4eee26a9c0 20 started sync module instance, tier type = 2024-08-27T02:53:42.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.880+0000 7f4eee26a9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:42.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.892+0000 7f4eee26a9c0 20 add_watcher() i=0 2024-08-27T02:53:42.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.892+0000 7f4eee26a9c0 20 add_watcher() i=1 2024-08-27T02:53:42.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.892+0000 7f4eee26a9c0 20 add_watcher() i=2 2024-08-27T02:53:42.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.892+0000 7f4eee26a9c0 20 add_watcher() i=3 2024-08-27T02:53:42.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.892+0000 7f4eee26a9c0 20 add_watcher() i=4 2024-08-27T02:53:42.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.892+0000 7f4eee26a9c0 20 add_watcher() i=5 2024-08-27T02:53:42.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.892+0000 7f4eee26a9c0 20 add_watcher() i=6 2024-08-27T02:53:42.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 20 add_watcher() i=7 2024-08-27T02:53:42.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:42.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4da1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:42.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:42.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:42.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 5 note: GC not initialized 2024-08-27T02:53:42.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4da0fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:42.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:42.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 20 Filter name: none 2024-08-27T02:53:42.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4d1a7fc640 20 reqs_thread_entry: start 2024-08-27T02:53:42.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.896+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:42.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:42.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:42.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:42.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:42.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:42.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.900+0000 7f4eee26a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:42.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.904+0000 7f4da1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:42.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.908+0000 7f4eee26a9c0 20 remove_watcher() i=0 2024-08-27T02:53:42.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.908+0000 7f4eee26a9c0 2 removed watcher, disabling cache 2024-08-27T02:53:42.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.912+0000 7f4eee26a9c0 20 remove_watcher() i=1 2024-08-27T02:53:42.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.912+0000 7f4eee26a9c0 20 remove_watcher() i=2 2024-08-27T02:53:42.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.916+0000 7f4eee26a9c0 20 remove_watcher() i=3 2024-08-27T02:53:42.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.916+0000 7f4eee26a9c0 20 remove_watcher() i=4 2024-08-27T02:53:42.918 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.920+0000 7f4eee26a9c0 20 remove_watcher() i=5 2024-08-27T02:53:42.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.920+0000 7f4eee26a9c0 20 remove_watcher() i=6 2024-08-27T02:53:42.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:42.920+0000 7f4eee26a9c0 20 remove_watcher() i=7 2024-08-27T02:53:42.934 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:42.934 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:42.934 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-block-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:53:42.934 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:43.032 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:53:43.066 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:43.067 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:43.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.108+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 realm 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:43.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:43.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.112+0000 7f4ed5c629c0 20 searching for the correct realm 2024-08-27T02:53:43.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.324+0000 7f4ed2f67640 0 -- 172.21.15.143:0/31003434 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55931b895f00 msgr2=0x55931b898370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:43.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.332+0000 7f4ed2f67640 0 -- 172.21.15.143:0/31003434 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f4ec40db070 msgr2=0x7f4ec40fd8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:43.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:43.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 zone default found 2024-08-27T02:53:43.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 4 Realm: () 2024-08-27T02:53:43.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:43.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:43.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:43.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 zonegroup default 2024-08-27T02:53:43.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.344+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.348+0000 7f4ed5c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.348+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.348+0000 7f4ed5c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.348+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.348+0000 7f4ed5c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.348+0000 7f4ed5c629c0 20 started sync module instance, tier type = 2024-08-27T02:53:43.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.348+0000 7f4ed5c629c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:43.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=0 2024-08-27T02:53:43.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=1 2024-08-27T02:53:43.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=2 2024-08-27T02:53:43.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=3 2024-08-27T02:53:43.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=4 2024-08-27T02:53:43.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=5 2024-08-27T02:53:43.372 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=6 2024-08-27T02:53:43.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 20 add_watcher() i=7 2024-08-27T02:53:43.374 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.372+0000 7f4ed5c629c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:43.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4d8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:43.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:43.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:43.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 5 note: GC not initialized 2024-08-27T02:53:43.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4d897e2640 20 reqs_thread_entry: start 2024-08-27T02:53:43.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:43.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 20 Filter name: none 2024-08-27T02:53:43.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4d827fc640 20 reqs_thread_entry: start 2024-08-27T02:53:43.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-08-27T02:53:43.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:43.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-08-27T02:53:43.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-08-27T02:53:43.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 : miss 2024-08-27T02:53:43.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.380+0000 7f4ed5c629c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.384+0000 7f4ed5c629c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:43.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.384+0000 7f4ed5c629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:43.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.384+0000 7f4ed5c629c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:43.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.384+0000 7f4ed5c629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:43.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.384+0000 7f4ed5c629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:43.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.384+0000 7f4ed5c629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 2024-08-27T02:53:43.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4ed5c629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:43.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4ed5c629c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:43.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4ed5c629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:43.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4ed5c629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22, ofs0, ns] 2024-08-27T02:53:43.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4db6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94090310600080 notifier 6215 bl.length()=915 2024-08-27T02:53:43.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4db6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:43.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4db6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:43.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.396+0000 7f4db6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:43.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.400+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_sources= new_sources= 2024-08-27T02:53:43.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.400+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential sources added=[] removed=[] 2024-08-27T02:53:43.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.400+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_dests= new_dests= 2024-08-27T02:53:43.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.400+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential dests added=[] removed=[] 2024-08-27T02:53:43.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.0 2024-08-27T02:53:43.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.0 2024-08-27T02:53:43.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.1 2024-08-27T02:53:43.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.1 2024-08-27T02:53:43.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.2 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.2 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.3 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.3 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.4 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.4 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.5 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.5 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.6 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.6 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.7 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.7 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.8 2024-08-27T02:53:43.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.8 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.9 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.9 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.10 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.10 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.11 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1.11 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.0 2024-08-27T02:53:43.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1 2024-08-27T02:53:43.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.2 2024-08-27T02:53:43.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.412+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.3 2024-08-27T02:53:43.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.416+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.4 2024-08-27T02:53:43.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.416+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.5 2024-08-27T02:53:43.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.416+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.6 2024-08-27T02:53:43.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.416+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.7 2024-08-27T02:53:43.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.420+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.8 2024-08-27T02:53:43.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.420+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.9 2024-08-27T02:53:43.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.420+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.10 2024-08-27T02:53:43.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.428+0000 7f4ed5c629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:43.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.428+0000 7f4ed5c629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 2024-08-27T02:53:43.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4ed5c629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:43.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4ed5c629c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:43.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4ed5c629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:43.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4ed5c629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22, ofs0, ns] 2024-08-27T02:53:43.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4db67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 94090310600080 notifier 6215 bl.length()=915 2024-08-27T02:53:43.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4db67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:43.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4db67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:43.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.432+0000 7f4db67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:43.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.436+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_sources= new_sources= 2024-08-27T02:53:43.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.436+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential sources added=[] removed=[] 2024-08-27T02:53:43.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.436+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_dests= new_dests= 2024-08-27T02:53:43.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.436+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential dests added=[] removed=[] 2024-08-27T02:53:43.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.440+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.0 2024-08-27T02:53:43.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.440+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.1 2024-08-27T02:53:43.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.444+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.2 2024-08-27T02:53:43.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.444+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.3 2024-08-27T02:53:43.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.444+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.4 2024-08-27T02:53:43.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.444+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.5 2024-08-27T02:53:43.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.444+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.6 2024-08-27T02:53:43.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.444+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.7 2024-08-27T02:53:43.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.448+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.8 2024-08-27T02:53:43.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.448+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.9 2024-08-27T02:53:43.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.448+0000 7f4ed5c629c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22.10 2024-08-27T02:53:43.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.448+0000 7f4ed5c629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:43.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.448+0000 7f4ed5c629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 2024-08-27T02:53:43.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4ed5c629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:43.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4ed5c629c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:43.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4ed5c629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:43.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4ed5c629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22, ofs0, ns] 2024-08-27T02:53:43.452 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4db6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94090310600080 notifier 6215 bl.length()=883 2024-08-27T02:53:43.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4db6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 info.flags=0x17 2024-08-27T02:53:43.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4db6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 to cache LRU end 2024-08-27T02:53:43.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.452+0000 7f4db6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:43.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.456+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_sources= new_sources= 2024-08-27T02:53:43.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.456+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential sources added=[] removed=[] 2024-08-27T02:53:43.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.456+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): orig_dests= new_dests= 2024-08-27T02:53:43.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.456+0000 7f4ed5c629c0 20 handle_bi_update(): bucket=:error-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22]): potential dests added=[] removed=[] 2024-08-27T02:53:43.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.460+0000 7f4ed5c629c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-08-27T02:53:43.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.464+0000 7f4d8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:43.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.468+0000 7f4ed5c629c0 20 remove_watcher() i=0 2024-08-27T02:53:43.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.468+0000 7f4ed5c629c0 2 removed watcher, disabling cache 2024-08-27T02:53:43.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.472+0000 7f4ed5c629c0 20 remove_watcher() i=1 2024-08-27T02:53:43.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.476+0000 7f4ed5c629c0 20 remove_watcher() i=2 2024-08-27T02:53:43.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.476+0000 7f4ed5c629c0 20 remove_watcher() i=3 2024-08-27T02:53:43.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.480+0000 7f4ed5c629c0 20 remove_watcher() i=4 2024-08-27T02:53:43.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.480+0000 7f4ed5c629c0 20 remove_watcher() i=5 2024-08-27T02:53:43.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.484+0000 7f4ed5c629c0 20 remove_watcher() i=6 2024-08-27T02:53:43.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.484+0000 7f4ed5c629c0 20 remove_watcher() i=7 2024-08-27T02:53:43.502 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-08-27T02:53:43.533 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:43.533 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:43.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.576+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.576+0000 7f2a358939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.576+0000 7f2a358939c0 20 realm 2024-08-27T02:53:43.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.576+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:43.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:43.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:43.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.580+0000 7f2a358939c0 20 searching for the correct realm 2024-08-27T02:53:43.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.584+0000 7f2a33b9a640 0 -- 172.21.15.143:0/2381210924 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f2a1c0d1410 msgr2=0x7f2a1c0d1870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:43.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.592+0000 7f2a33399640 0 -- 172.21.15.143:0/2381210924 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f2a1c0aa8e0 msgr2=0x7f2a1c0dc380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:43.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:43.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:43.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:43.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:43.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:43.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:43.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.808+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:43.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 zone default found 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 4 Realm: () 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 zonegroup default 2024-08-27T02:53:43.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:43.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 started sync module instance, tier type = 2024-08-27T02:53:43.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.812+0000 7f2a358939c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:43.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.840+0000 7f2a358939c0 20 add_watcher() i=0 2024-08-27T02:53:43.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.840+0000 7f2a358939c0 20 add_watcher() i=1 2024-08-27T02:53:43.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.840+0000 7f2a358939c0 20 add_watcher() i=2 2024-08-27T02:53:43.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.840+0000 7f2a358939c0 20 add_watcher() i=3 2024-08-27T02:53:43.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.840+0000 7f2a358939c0 20 add_watcher() i=4 2024-08-27T02:53:43.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.840+0000 7f2a358939c0 20 add_watcher() i=5 2024-08-27T02:53:43.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.840+0000 7f2a358939c0 20 add_watcher() i=6 2024-08-27T02:53:43.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.844+0000 7f2a358939c0 20 add_watcher() i=7 2024-08-27T02:53:43.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.844+0000 7f2a358939c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:43.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f28e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:43.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:43.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:43.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 5 note: GC not initialized 2024-08-27T02:53:43.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f28e8fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:43.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:43.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 20 Filter name: none 2024-08-27T02:53:43.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f28627fc640 20 reqs_thread_entry: start 2024-08-27T02:53:43.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:43.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.848+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.852+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:43.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.852+0000 7f2a358939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:43.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.852+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.852+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:43.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.852+0000 7f2a358939c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:43.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.852+0000 7f2a358939c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:43.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.852+0000 7f2a358939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:43.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.856+0000 7f28e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:43.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.864+0000 7f2a358939c0 20 remove_watcher() i=0 2024-08-27T02:53:43.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.864+0000 7f2a358939c0 2 removed watcher, disabling cache 2024-08-27T02:53:43.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.864+0000 7f2a358939c0 20 remove_watcher() i=1 2024-08-27T02:53:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.868+0000 7f2a358939c0 20 remove_watcher() i=2 2024-08-27T02:53:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.868+0000 7f2a358939c0 20 remove_watcher() i=3 2024-08-27T02:53:43.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.872+0000 7f2a358939c0 20 remove_watcher() i=4 2024-08-27T02:53:43.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.876+0000 7f2a358939c0 20 remove_watcher() i=5 2024-08-27T02:53:43.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.876+0000 7f2a358939c0 20 remove_watcher() i=6 2024-08-27T02:53:43.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:43.876+0000 7f2a358939c0 20 remove_watcher() i=7 2024-08-27T02:53:43.895 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-block-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:53:43.895 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:44.881 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with abort at block_writes 2024-08-27T02:53:44.881 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.084 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-08-27T02:53:47.116 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:47.116 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:47.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.160+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.160+0000 7fd60adc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.160+0000 7fd60adc99c0 20 realm 2024-08-27T02:53:47.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.160+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.160+0000 7fd60adc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.160+0000 7fd60adc99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:47.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.160+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.164+0000 7fd60adc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.164+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.164+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.164+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.164+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:47.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.164+0000 7fd60adc99c0 20 searching for the correct realm 2024-08-27T02:53:47.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.172+0000 7fd6080ce640 0 -- 172.21.15.143:0/2274143091 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fd5f802c070 msgr2=0x7fd5f803a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.176+0000 7fd6090d0640 0 -- 172.21.15.143:0/2274143091 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fd5fc070940 msgr2=0x7fd5fc0629a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:47.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:47.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.184+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:47.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 zone default found 2024-08-27T02:53:47.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 4 Realm: () 2024-08-27T02:53:47.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:47.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:47.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:47.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 zonegroup default 2024-08-27T02:53:47.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 started sync module instance, tier type = 2024-08-27T02:53:47.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.188+0000 7fd60adc99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:47.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=0 2024-08-27T02:53:47.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=1 2024-08-27T02:53:47.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=2 2024-08-27T02:53:47.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=3 2024-08-27T02:53:47.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=4 2024-08-27T02:53:47.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=5 2024-08-27T02:53:47.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=6 2024-08-27T02:53:47.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 20 add_watcher() i=7 2024-08-27T02:53:47.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.204+0000 7fd60adc99c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:47.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd4befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 5 note: GC not initialized 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd4bdfe3640 20 reqs_thread_entry: start 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 Filter name: none 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd42f7fe640 20 reqs_thread_entry: start 2024-08-27T02:53:47.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:47.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:47.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:47.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:47.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.208+0000 7fd60adc99c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.212+0000 7fd60adc99c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:47.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.212+0000 7fd60adc99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:47.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.212+0000 7fd4befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:47.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.216+0000 7fd60adc99c0 20 remove_watcher() i=0 2024-08-27T02:53:47.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.216+0000 7fd60adc99c0 2 removed watcher, disabling cache 2024-08-27T02:53:47.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.220+0000 7fd60adc99c0 20 remove_watcher() i=1 2024-08-27T02:53:47.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.220+0000 7fd60adc99c0 20 remove_watcher() i=2 2024-08-27T02:53:47.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.224+0000 7fd60adc99c0 20 remove_watcher() i=3 2024-08-27T02:53:47.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.224+0000 7fd60adc99c0 20 remove_watcher() i=4 2024-08-27T02:53:47.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.228+0000 7fd60adc99c0 20 remove_watcher() i=5 2024-08-27T02:53:47.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.228+0000 7fd60adc99c0 20 remove_watcher() i=6 2024-08-27T02:53:47.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.228+0000 7fd60adc99c0 20 remove_watcher() i=7 2024-08-27T02:53:47.243 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.243 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:47.244 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-block-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:53:47.244 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.244 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-08-27T02:53:47.276 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:47.276 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:47.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.316+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 realm 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:47.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 searching for the correct realm 2024-08-27T02:53:47.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.328+0000 7f1ae3b2d640 0 -- 172.21.15.143:0/881395677 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f1ad80de290 msgr2=0x7f1ad812da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.544+0000 7f1ae332c640 0 -- 172.21.15.143:0/881395677 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55a17a3c5610 msgr2=0x55a17a3c7a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:47.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:47.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:47.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:47.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 zone default found 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 Realm: () 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 zonegroup default 2024-08-27T02:53:47.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 started sync module instance, tier type = 2024-08-27T02:53:47.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:47.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=0 2024-08-27T02:53:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=1 2024-08-27T02:53:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=2 2024-08-27T02:53:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=3 2024-08-27T02:53:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=4 2024-08-27T02:53:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=5 2024-08-27T02:53:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=6 2024-08-27T02:53:47.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.580+0000 7f1ae58269c0 20 add_watcher() i=7 2024-08-27T02:53:47.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.580+0000 7f1ae58269c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:47.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:47.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:47.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:47.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 note: GC not initialized 2024-08-27T02:53:47.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1998fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:47.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:47.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 Filter name: none 2024-08-27T02:53:47.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f19127fc640 20 reqs_thread_entry: start 2024-08-27T02:53:47.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-27T02:53:47.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:47.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-27T02:53:47.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-27T02:53:47.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : miss 2024-08-27T02:53:47.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:47.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:47.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:53:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:53:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94152028909104 notifier 6576 bl.length()=915 2024-08-27T02:53:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:53:47.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:53:47.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:53:47.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:53:47.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.0 2024-08-27T02:53:47.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.0 2024-08-27T02:53:47.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.1 2024-08-27T02:53:47.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.1 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.2 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.2 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.3 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.3 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.4 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.4 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.5 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.5 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.6 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.6 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.7 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.7 2024-08-27T02:53:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.8 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.8 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.9 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.9 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.10 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.10 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.11 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.11 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.0 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1 2024-08-27T02:53:47.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2 2024-08-27T02:53:47.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.3 2024-08-27T02:53:47.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.4 2024-08-27T02:53:47.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.5 2024-08-27T02:53:47.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.6 2024-08-27T02:53:47.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.7 2024-08-27T02:53:47.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.8 2024-08-27T02:53:47.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.9 2024-08-27T02:53:47.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.620+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.10 2024-08-27T02:53:47.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.624+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:47.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.624+0000 7f1ae58269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:53:47.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:53:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94152028909104 notifier 6576 bl.length()=915 2024-08-27T02:53:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:53:47.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:53:47.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:53:47.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:53:47.631 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ae58269c0 time 2024-08-27T02:53:47.636771+0000 2024-08-27T02:53:47.631 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1ae91002eb] 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:47.632 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.632+0000 7f1ae58269c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ae58269c0 time 2024-08-27T02:53:47.636771+0000 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1ae91002eb] 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.633 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:47.634 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:47.634 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.634 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:53:47.634 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f1ae58269c0 thread_name:radosgw-admin 2024-08-27T02:53:47.644 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.645 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1ae7f7f520] 2024-08-27T02:53:47.645 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:47.645 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:47.645 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:47.645 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1ae9100345] 2024-08-27T02:53:47.645 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.646 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.646 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.646 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.646 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:47.646 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.632+0000 7f1ae58269c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f1ae58269c0 thread_name:radosgw-admin 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1ae7f7f520] 2024-08-27T02:53:47.647 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1ae9100345] 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.648 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:47.649 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.649 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:47.649 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:47.649 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:53:47.649 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.649 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 1 librados: calling monclient init 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding auth protocol: cephx 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding auth protocol: cephx 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding auth protocol: cephx 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.650 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key hook 0x55a17a2d58b8 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a1851a0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a185580 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.651 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a21df90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.181242s 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): get_auth_request con 0x55a17a1851a0 auth_method 0 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request con 0x55a17a21df90 auth_method 0 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.652 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_done global_id 6260 payload 824 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:53:47.300+0000 7f1ae332c640 1 monclient: found mon.noname-c 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: dump: 2024-08-27T02:53:47.653 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.654 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: dump: 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.655 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6260 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:53:47.300+0000 7f19d160a640 4 set_mon_vals no callback set 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 1 librados: init done 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:53:47.300+0000 7f19cfe07640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:53:47.300+0000 7f19cfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:53:47.300+0000 7f19cfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:53:47.304+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x7f19c8070ad0 auth_method 0 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:53:47.304+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x55a17a317cc0 auth_method 0 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:53:47.304+0000 7f1ae332c640 10 monclient: get_auth_request con 0x55a17a3211b0 auth_method 0 2024-08-27T02:53:47.656 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x55a17a326240 auth_method 0 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: build_initial_monmap 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: monmap: 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.657 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding auth protocol: cephx 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding auth protocol: cephx 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding auth protocol: cephx 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.658 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55a17a32d960 EEXIST 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding auth protocol: cephx 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding auth protocol: cephx 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding auth protocol: cephx 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.659 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55a17a3290d0 EEXIST 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a355840 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a356940 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.660 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a355eb0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.190020s 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request con 0x55a17a355eb0 auth_method 0 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request con 0x55a17a356940 auth_method 0 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.661 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_done global_id 6263 payload 824 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 1 monclient: found mon.noname-c 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: dump: 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.662 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6263 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.663 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: dump: 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.664 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:53:47.308+0000 7f1ae432e640 4 set_mon_vals no callback set 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:53:47.312+0000 7f19cd602640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:53:47.312+0000 7f19cd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:53:47.312+0000 7f19cd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: get_monmap_and_config 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: build_initial_monmap 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: monmap: 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:47.665 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding auth protocol: cephx 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding auth protocol: cephx 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding auth protocol: cephx 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.666 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:53:47.312+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f19bc0709b0 auth_method 0 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding auth protocol: cephx 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding auth protocol: cephx 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding auth protocol: cephx 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.667 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.668 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key cmddesc rotate-key hook 0x7ffebaacae08 EEXIST 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a3a7be0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a3a2170 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a3a3560 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.194261s 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request con 0x55a17a3a2170 auth_method 0 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.669 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request con 0x55a17a3a3560 auth_method 0 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.670 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_done global_id 6573 payload 274 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 1 monclient: found mon.noname-a 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: dump: 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.671 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:47.672 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: dump: 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6573 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: get_monmap_and_config success 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 4 set_mon_vals no callback set 2024-08-27T02:53:47.673 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: shutdown 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: build_initial_monmap 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: monmap: 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.674 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding auth protocol: cephx 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding auth protocol: cephx 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding auth protocol: cephx 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.675 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: starting msgr at 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: starting objecter 2024-08-27T02:53:47.676 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55a17a379bb0 EEXIST 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: setting wanted keys 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: calling monclient init 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding auth protocol: cephx 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding auth protocol: cephx 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding auth protocol: cephx 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.677 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55a17a368218 EEXIST 2024-08-27T02:53:47.678 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a3a2170 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a3a3560 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a3a7be0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.679 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.196867s 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request con 0x55a17a3a3560 auth_method 0 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): get_auth_request con 0x55a17a3a2170 auth_method 0 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.680 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_done global_id 6576 payload 824 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 1 monclient: found mon.noname-a 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.681 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: dump: 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.682 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: dump: 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.683 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6576 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:53:47.316+0000 7f19c6ffd640 4 set_mon_vals no callback set 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.684 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: init done 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cr dump hook 0x55a17a3987f8 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:53:47.320+0000 7f19c57fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:53:47.320+0000 7f19c57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:53:47.320+0000 7f19c57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:53:47.320+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x55a17a3c13a0 auth_method 0 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:53:47.320+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f19ac070aa0 auth_method 0 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 realm 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.685 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:53:47.320+0000 7f1ae332c640 10 monclient: get_auth_request con 0x55a17a3c5610 auth_method 0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 searching for the correct realm 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:53:47.324+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x55a17a3ca8b0 auth_method 0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:53:47.324+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x7f1ad80d0040 auth_method 0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:53:47.324+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f1adc065370 auth_method 0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:53:47.324+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x7f1ad4017070 auth_method 0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:53:47.328+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x7f1ad80de290 auth_method 0 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:53:47.328+0000 7f1ae3b2d640 0 -- 172.21.15.143:0/881395677 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f1ad80de290 msgr2=0x7f1ad812da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.686 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:53:47.532+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x7f1ad80de290 auth_method 0 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:53:47.536+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f1ad80d08b0 auth_method 0 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:53:47.544+0000 7f1ae332c640 0 -- 172.21.15.143:0/881395677 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55a17a3c5610 msgr2=0x55a17a3c7a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:53:47.544+0000 7f19c57fa640 1 client.6576.objecter ms_handle_reset 0x55a17a3c5610 session 0x55a17a3c4f90 osd.5 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:53:47.544+0000 7f19c57fa640 10 monclient: _renew_subs 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:53:47.544+0000 7f19c57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:53:47.544+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f19ac081140 auth_method 0 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.687 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 zone default found 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 Realm: () 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 zonegroup default 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.688 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 started sync module instance, tier type = 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=0 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=1 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=2 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=3 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=4 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=5 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=6 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:53:47.580+0000 7f1ae58269c0 20 add_watcher() i=7 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:53:47.580+0000 7f1ae58269c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:47.689 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding auth protocol: cephx 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding auth protocol: cephx 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding auth protocol: cephx 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.690 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:53:47.584+0000 7f1999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache list hook 0x55a17a398230 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache inspect hook 0x55a17a398230 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache erase hook 0x55a17a398230 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache zap hook 0x55a17a398230 2024-08-27T02:53:47.691 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 note: GC not initialized 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:53:47.584+0000 7f1998fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace show hook 0x7f1ad80abc30 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace history hook 0x7f1ad80abc30 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace active hook 0x7f1ad80abc30 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace active_short hook 0x7f1ad80abc30 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 Filter name: none 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:53:47.584+0000 7f19127fc640 20 reqs_thread_entry: start 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-27T02:53:47.692 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : miss 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94152028909104 notifier 6576 bl.length()=915 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.693 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.0 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.0 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.1 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.1 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.2 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.2 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.3 2024-08-27T02:53:47.694 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.3 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.4 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.4 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.5 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.5 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.6 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.6 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.7 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.7 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.8 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.8 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.9 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.9 2024-08-27T02:53:47.695 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.10 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.10 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.11 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.11 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.0 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.3 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.4 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.5 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.6 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.7 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.8 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.9 2024-08-27T02:53:47.696 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:53:47.620+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.10 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:53:47.624+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:53:47.624+0000 7f1ae58269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94152028909104 notifier 6576 bl.length()=915 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:53:47.697 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ae58269c0 time 2024-08-27T02:53:47.636771+0000 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1ae91002eb] 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:47.698 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f1ae58269c0 thread_name:radosgw-admin 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1ae7f7f520] 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1ae9100345] 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.699 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:53:47.700 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:53:47.701 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:53:47.702 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:53:47.703 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:53:47.704 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:53:47.705 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:53:47.706 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:53:47.707 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19127fc640 / http_manager 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1998fe1640 / http_manager 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1999fe3640 / rgw_dt_lg_renew 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19c57fa640 / ms_dispatch 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19c67fc640 / io_context_pool 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19c6ffd640 / io_context_pool 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19cd602640 / ms_dispatch 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19cfe07640 / ms_dispatch 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19d160a640 / io_context_pool 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae2b2b640 / msgr-worker-2 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae332c640 / msgr-worker-1 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae3b2d640 / msgr-worker-0 2024-08-27T02:53:47.708 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae432e640 / io_context_pool 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae58269c0 / radosgw-admin 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.87989.log 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 1 librados: calling monclient init 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding auth protocol: cephx 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding auth protocol: cephx 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding auth protocol: cephx 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.709 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: crc 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a2d5770) adding con mode: secure 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key hook 0x55a17a2d58b8 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.710 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a1851a0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a185580 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a21df90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.181242s 2024-08-27T02:53:47.711 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): get_auth_request con 0x55a17a1851a0 auth_method 0 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request con 0x55a17a21df90 auth_method 0 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.712 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:53:47.300+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient(hunting): handle_auth_done global_id 6260 payload 824 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:53:47.300+0000 7f1ae332c640 1 monclient: found mon.noname-c 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:53:47.300+0000 7f1ae332c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: dump: 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.713 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.714 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:53:47.300+0000 7f19cfe07640 10 monclient: dump: 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.715 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6260 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:53:47.300+0000 7f19d160a640 4 set_mon_vals no callback set 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.716 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:53:47.300+0000 7f1ae58269c0 1 librados: init done 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:53:47.300+0000 7f19cfe07640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:53:47.300+0000 7f19cfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:53:47.300+0000 7f19cfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:53:47.304+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x7f19c8070ad0 auth_method 0 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:53:47.304+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x55a17a317cc0 auth_method 0 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:53:47.304+0000 7f1ae332c640 10 monclient: get_auth_request con 0x55a17a3211b0 auth_method 0 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x55a17a326240 auth_method 0 2024-08-27T02:53:47.717 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: build_initial_monmap 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: monmap: 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding auth protocol: cephx 2024-08-27T02:53:47.718 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding auth protocol: cephx 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding auth protocol: cephx 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: crc 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a329f30) adding con mode: secure 2024-08-27T02:53:47.719 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55a17a32d960 EEXIST 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding auth protocol: cephx 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding auth protocol: cephx 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding auth protocol: cephx 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.720 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: crc 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a328f88) adding con mode: secure 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55a17a3290d0 EEXIST 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a355840 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a356940 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a355eb0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.721 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.190020s 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request con 0x55a17a355eb0 auth_method 0 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request con 0x55a17a356940 auth_method 0 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.722 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:53:47.308+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_done global_id 6263 payload 824 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 1 monclient: found mon.noname-c 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:53:47.308+0000 7f1ae3b2d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: dump: 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.723 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6263 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.724 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:53:47.308+0000 7f19cd602640 10 monclient: dump: 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:53:47.308+0000 7f1ae432e640 4 set_mon_vals no callback set 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.725 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:53:47.308+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:53:47.312+0000 7f19cd602640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:53:47.312+0000 7f19cd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:53:47.312+0000 7f19cd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: get_monmap_and_config 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: build_initial_monmap 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: monmap: 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.726 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:47.727 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:47.727 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:47.727 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.727 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding auth protocol: cephx 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding auth protocol: cephx 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding auth protocol: cephx 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.728 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: crc 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a373780) adding con mode: secure 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:53:47.312+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f19bc0709b0 auth_method 0 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding auth protocol: cephx 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding auth protocol: cephx 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding auth protocol: cephx 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.729 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: crc 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacacc0) adding con mode: secure 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key cmddesc rotate-key hook 0x7ffebaacae08 EEXIST 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:53:47.730 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a3a7be0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a3a2170 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a3a3560 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.194261s 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request con 0x55a17a3a2170 auth_method 0 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request con 0x55a17a3a3560 auth_method 0 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.731 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:53:47.312+0000 7f1ae3b2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_done global_id 6573 payload 274 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 1 monclient: found mon.noname-a 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:53:47.312+0000 7f1ae2b2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:47.732 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: dump: 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.733 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:53:47.312+0000 7f19c6ffd640 10 monclient: dump: 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6573 2024-08-27T02:53:47.734 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: get_monmap_and_config success 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 4 set_mon_vals no callback set 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: shutdown 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: build_initial_monmap 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 1 build_initial for_mkfs: 0 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 10 monclient: monmap: 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:53:47.735 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding auth protocol: cephx 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding auth protocol: cephx 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding auth protocol: cephx 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.736 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: crc 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:53:47.312+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a39a1f0) adding con mode: secure 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: starting msgr at 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: starting objecter 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55a17a379bb0 EEXIST 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: setting wanted keys 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: calling monclient init 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: init 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding auth protocol: cephx 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding auth protocol: cephx 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding auth protocol: cephx 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.737 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: crc 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 AuthRegistry(0x55a17a3680d0) adding con mode: secure 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.738 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55a17a368218 EEXIST 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _reopen_session rank -1 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-c con 0x55a17a3a2170 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-a con 0x55a17a3a3560 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): picked mon.noname-b con 0x55a17a3a7be0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): _renew_subs 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient(hunting): authenticate will time out at 2360.196867s 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request con 0x55a17a3a3560 auth_method 0 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.739 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): get_auth_request con 0x55a17a3a2170 auth_method 0 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:53:47.316+0000 7f1ae332c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient(hunting): handle_auth_done global_id 6576 payload 824 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient: _finish_hunting 0 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 1 monclient: found mon.noname-a 2024-08-27T02:53:47.740 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:53:47.316+0000 7f1ae2b2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: dump: 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: _finish_auth 0 2024-08-27T02:53:47.741 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: _check_auth_tickets 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:53:47.316+0000 7f19c57fa640 10 monclient: dump: 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:53:47.742 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 monclient: authenticate success, global_id 6576 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:53:47.316+0000 7f19c6ffd640 4 set_mon_vals no callback set 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _renew_subs 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 1 librados: init done 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cr dump hook 0x55a17a3987f8 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:53:47.316+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.743 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:53:47.320+0000 7f19c57fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:53:47.320+0000 7f19c57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:53:47.320+0000 7f19c57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:53:47.320+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x55a17a3c13a0 auth_method 0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:53:47.320+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f19ac070aa0 auth_method 0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 realm 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:53:47.320+0000 7f1ae332c640 10 monclient: get_auth_request con 0x55a17a3c5610 auth_method 0 2024-08-27T02:53:47.744 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:53:47.320+0000 7f1ae58269c0 20 searching for the correct realm 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:53:47.324+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x55a17a3ca8b0 auth_method 0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:53:47.324+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x7f1ad80d0040 auth_method 0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:53:47.324+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f1adc065370 auth_method 0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:53:47.324+0000 7f1ae2b2b640 10 monclient: get_auth_request con 0x7f1ad4017070 auth_method 0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:53:47.328+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x7f1ad80de290 auth_method 0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:53:47.328+0000 7f1ae3b2d640 0 -- 172.21.15.143:0/881395677 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f1ad80de290 msgr2=0x7f1ad812da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:53:47.532+0000 7f1ae3b2d640 10 monclient: get_auth_request con 0x7f1ad80de290 auth_method 0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:53:47.536+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f1ad80d08b0 auth_method 0 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:53:47.544+0000 7f1ae332c640 0 -- 172.21.15.143:0/881395677 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55a17a3c5610 msgr2=0x55a17a3c7a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.745 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:53:47.544+0000 7f19c57fa640 1 client.6576.objecter ms_handle_reset 0x55a17a3c5610 session 0x55a17a3c4f90 osd.5 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:53:47.544+0000 7f19c57fa640 10 monclient: _renew_subs 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:53:47.544+0000 7f19c57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:53:47.544+0000 7f1ae332c640 10 monclient: get_auth_request con 0x7f19ac081140 auth_method 0 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.746 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 zone default found 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 Realm: () 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 zonegroup default 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:53:47.552+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.747 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 started sync module instance, tier type = 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:53:47.556+0000 7f1ae58269c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=0 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=1 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=2 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=3 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=4 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=5 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:53:47.576+0000 7f1ae58269c0 20 add_watcher() i=6 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:53:47.580+0000 7f1ae58269c0 20 add_watcher() i=7 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:53:47.580+0000 7f1ae58269c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding auth protocol: cephx 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding auth protocol: cephx 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding auth protocol: cephx 2024-08-27T02:53:47.748 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: crc 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 AuthRegistry(0x7ffebaacb1a0) adding con mode: secure 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:53:47.584+0000 7f1999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:53:47.749 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache list hook 0x55a17a398230 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache inspect hook 0x55a17a398230 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache erase hook 0x55a17a398230 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command cache zap hook 0x55a17a398230 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 note: GC not initialized 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:53:47.584+0000 7f1998fe1640 20 reqs_thread_entry: start 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace show hook 0x7f1ad80abc30 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace history hook 0x7f1ad80abc30 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace active hook 0x7f1ad80abc30 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 5 asok(0x55a17a0cb280) register_command sync trace active_short hook 0x7f1ad80abc30 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 Filter name: none 2024-08-27T02:53:47.750 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:53:47.584+0000 7f19127fc640 20 reqs_thread_entry: start 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : miss 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:53:47.584+0000 7f1ae58269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.751 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:53:47.596+0000 7f1ae58269c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94152028909104 notifier 6576 bl.length()=915 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:53:47.596+0000 7f19c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:53:47.600+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.0 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.0 2024-08-27T02:53:47.752 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.1 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.1 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.2 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.2 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.3 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.3 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.4 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.4 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.5 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.5 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.6 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.6 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.7 2024-08-27T02:53:47.753 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.7 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.8 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.8 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.9 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.9 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.10 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.10 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.11 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1.11 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.0 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:53:47.608+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.3 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.4 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:53:47.612+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.5 2024-08-27T02:53:47.754 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.6 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.7 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.8 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:53:47.616+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.9 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:53:47.620+0000 7f1ae58269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.10 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:53:47.624+0000 7f1ae58269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : hit (requested=0x17, cached=0x17) 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:53:47.624+0000 7f1ae58269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:53:47.628+0000 7f1ae58269c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94152028909104 notifier 6576 bl.length()=915 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:47.755 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:53:47.628+0000 7f19c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ae58269c0 time 2024-08-27T02:53:47.636771+0000 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1ae91002eb] 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.756 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:53:47.632+0000 7f1ae58269c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f1ae58269c0 thread_name:radosgw-admin 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1ae7f7f520] 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1ae9100345] 2024-08-27T02:53:47.757 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1ae910049f] 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a178952b11] 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55a17896752b] 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a178968b14] 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1ae7f66d90] 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:53:47.758 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:53:47.759 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:53:47.760 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:53:47.761 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:53:47.762 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:53:47.763 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:53:47.764 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19127fc640 / http_manager 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1998fe1640 / http_manager 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1999fe3640 / rgw_dt_lg_renew 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19c57fa640 / ms_dispatch 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19c67fc640 / io_context_pool 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19c6ffd640 / io_context_pool 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19cd602640 / ms_dispatch 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19cfe07640 / ms_dispatch 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f19d160a640 / io_context_pool 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae2b2b640 / msgr-worker-2 2024-08-27T02:53:47.765 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae332c640 / msgr-worker-1 2024-08-27T02:53:47.766 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae3b2d640 / msgr-worker-0 2024-08-27T02:53:47.766 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae432e640 / io_context_pool 2024-08-27T02:53:47.766 INFO:tasks.workunit.client.0.smithi143.stderr: 7f1ae58269c0 / radosgw-admin 2024-08-27T02:53:47.766 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:53:47.766 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:53:47.766 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:53:47.639240Z_77d322b9-bd87-46ae-b683-8a1e7f12bd95/log 2024-08-27T02:53:47.766 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.716+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 20 realm 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:47.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.720+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.724+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.724+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.724+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.724+0000 7f7b752b59c0 20 searching for the correct realm 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.728+0000 7f7b735bc640 0 -- 172.21.15.143:0/2799439927 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f7b5c064980 msgr2=0x7f7b5c0633f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.736+0000 7f7b72dbb640 0 -- 172.21.15.143:0/2799439927 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f7b5c06d520 msgr2=0x7f7b5c085970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:47.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.952+0000 7f7b752b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.952+0000 7f7b752b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.952+0000 7f7b752b59c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.952+0000 7f7b752b59c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.952+0000 7f7b752b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.952+0000 7f7b752b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.952+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:47.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 zone default found 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 4 Realm: () 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 zonegroup default 2024-08-27T02:53:47.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.956+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.960+0000 7f7b752b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.960+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.960+0000 7f7b752b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:47.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.960+0000 7f7b752b59c0 20 started sync module instance, tier type = 2024-08-27T02:53:47.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.960+0000 7f7b752b59c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:47.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.980+0000 7f7b752b59c0 20 add_watcher() i=0 2024-08-27T02:53:47.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.980+0000 7f7b752b59c0 20 add_watcher() i=1 2024-08-27T02:53:47.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.980+0000 7f7b752b59c0 20 add_watcher() i=2 2024-08-27T02:53:47.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.980+0000 7f7b752b59c0 20 add_watcher() i=3 2024-08-27T02:53:47.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.980+0000 7f7b752b59c0 20 add_watcher() i=4 2024-08-27T02:53:47.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.980+0000 7f7b752b59c0 20 add_watcher() i=5 2024-08-27T02:53:47.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.980+0000 7f7b752b59c0 20 add_watcher() i=6 2024-08-27T02:53:47.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.984+0000 7f7b752b59c0 20 add_watcher() i=7 2024-08-27T02:53:47.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.984+0000 7f7b752b59c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:47.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.988+0000 7f7a297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:47.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.988+0000 7f7b752b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:47.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.988+0000 7f7b752b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:47.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.988+0000 7f7b752b59c0 5 note: GC not initialized 2024-08-27T02:53:47.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f79a3fff640 20 reqs_thread_entry: start 2024-08-27T02:53:47.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:47.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 Filter name: none 2024-08-27T02:53:47.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f79a1ffb640 20 reqs_thread_entry: start 2024-08-27T02:53:47.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:47.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=443 2024-08-27T02:53:47.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:47.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:47.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:47.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 rados_obj.operate() r=0 bl.length=443 2024-08-27T02:53:47.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.992+0000 7f7b752b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:53:47.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:47.996+0000 7f7a297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:48.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.000+0000 7f7b752b59c0 20 remove_watcher() i=0 2024-08-27T02:53:48.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.000+0000 7f7b752b59c0 2 removed watcher, disabling cache 2024-08-27T02:53:48.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.004+0000 7f7b752b59c0 20 remove_watcher() i=1 2024-08-27T02:53:48.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.008+0000 7f7b752b59c0 20 remove_watcher() i=2 2024-08-27T02:53:48.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.008+0000 7f7b752b59c0 20 remove_watcher() i=3 2024-08-27T02:53:48.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.012+0000 7f7b752b59c0 20 remove_watcher() i=4 2024-08-27T02:53:48.013 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.012+0000 7f7b752b59c0 20 remove_watcher() i=5 2024-08-27T02:53:48.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.012+0000 7f7b752b59c0 20 remove_watcher() i=6 2024-08-27T02:53:48.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.016+0000 7f7b752b59c0 20 remove_watcher() i=7 2024-08-27T02:53:48.035 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:48.035 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:53:48.035 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-block-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:53:48.035 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:53:48.164 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:53:48.201 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:53:48.201 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:53:48.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:48.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 realm 2024-08-27T02:53:48.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:48.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:53:48.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:48.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:48.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.248+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.252+0000 7ff2397a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:53:48.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.252+0000 7ff2397a69c0 20 searching for the correct realm 2024-08-27T02:53:48.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.256+0000 7ff236aab640 0 -- 172.21.15.143:0/3960547191 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x564b9c3f2ad0 msgr2=0x564b9c3f4f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:53:48.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.264+0000 7ff2372ac640 0 -- 172.21.15.143:0/3960547191 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7ff220095bb0 msgr2=0x7ff220029fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:53:48.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:53:48.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:53:48.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:53:48.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:53:48.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:53:48.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:53:48.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:48.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 zone default found 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 4 Realm: () 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 zonegroup default 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:48.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:48.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:53:48.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 started sync module instance, tier type = 2024-08-27T02:53:48.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.272+0000 7ff2397a69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=0 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=1 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=2 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=3 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=4 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=5 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=6 2024-08-27T02:53:48.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 20 add_watcher() i=7 2024-08-27T02:53:48.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.288+0000 7ff2397a69c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:53:48.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:48.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:53:48.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:53:48.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 5 note: GC not initialized 2024-08-27T02:53:48.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff0ecfe1640 20 reqs_thread_entry: start 2024-08-27T02:53:48.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 init_complete bucket index max shards: 11 2024-08-27T02:53:48.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 Filter name: none 2024-08-27T02:53:48.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff0667fc640 20 reqs_thread_entry: start 2024-08-27T02:53:48.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-27T02:53:48.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : miss 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 rados->read ofs=0 len=0 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 20 rados_obj.operate() r=0 bl.length=443 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:53:48.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:53:48.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:53:48.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:53:48.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.292+0000 7ff2397a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:53:48.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.296+0000 7ff2397a69c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to be held by another RGW process; skipping for now 2024-08-27T02:53:48.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.296+0000 7ff0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:53:48.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.300+0000 7ff2397a69c0 20 remove_watcher() i=0 2024-08-27T02:53:48.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.300+0000 7ff2397a69c0 2 removed watcher, disabling cache 2024-08-27T02:53:48.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.304+0000 7ff2397a69c0 20 remove_watcher() i=1 2024-08-27T02:53:48.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.308+0000 7ff2397a69c0 20 remove_watcher() i=2 2024-08-27T02:53:48.309 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.308+0000 7ff2397a69c0 20 remove_watcher() i=3 2024-08-27T02:53:48.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.312+0000 7ff2397a69c0 20 remove_watcher() i=4 2024-08-27T02:53:48.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.312+0000 7ff2397a69c0 20 remove_watcher() i=5 2024-08-27T02:53:48.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.312+0000 7ff2397a69c0 20 remove_watcher() i=6 2024-08-27T02:53:48.314 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:53:48.316+0000 7ff2397a69c0 20 remove_watcher() i=7 2024-08-27T02:53:48.327 INFO:tasks.workunit.client.0.smithi143.stderr:waiting 30 seconds for reshard lock to expire... 2024-08-27T02:54:18.359 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:54:18.396 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:18.396 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:18.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.443+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.443+0000 7fd8c3faf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.443+0000 7fd8c3faf9c0 20 realm 2024-08-27T02:54:18.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.443+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.443+0000 7fd8c3faf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.443+0000 7fd8c3faf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:18.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.443+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.447+0000 7fd8c3faf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.447+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.447+0000 7fd8c3faf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:18.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.447+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.447+0000 7fd8c3faf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:18.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.447+0000 7fd8c3faf9c0 20 searching for the correct realm 2024-08-27T02:54:18.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.455+0000 7fd8c12b4640 0 -- 172.21.15.143:0/322160964 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x562a4dd865b0 msgr2=0x562a4dd88a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:18.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.459+0000 7fd8c1ab5640 0 -- 172.21.15.143:0/322160964 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fd8b8123280 msgr2=0x7fd8b80f88c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:18.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:18.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:18.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:18.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:18.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:18.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:18.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 zone default found 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 4 Realm: () 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:18.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 zonegroup default 2024-08-27T02:54:18.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.467+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.471+0000 7fd8c3faf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.471+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.471+0000 7fd8c3faf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.471+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.471+0000 7fd8c3faf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.471+0000 7fd8c3faf9c0 20 started sync module instance, tier type = 2024-08-27T02:54:18.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.471+0000 7fd8c3faf9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:18.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=0 2024-08-27T02:54:18.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=1 2024-08-27T02:54:18.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=2 2024-08-27T02:54:18.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=3 2024-08-27T02:54:18.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=4 2024-08-27T02:54:18.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=5 2024-08-27T02:54:18.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=6 2024-08-27T02:54:18.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 20 add_watcher() i=7 2024-08-27T02:54:18.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.487+0000 7fd8c3faf9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:18.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd7737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:18.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:18.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:18.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 5 note: GC not initialized 2024-08-27T02:54:18.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd7727fc640 20 reqs_thread_entry: start 2024-08-27T02:54:18.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:18.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 Filter name: none 2024-08-27T02:54:18.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd6e3fff640 20 reqs_thread_entry: start 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : miss 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 20 rados_obj.operate() r=0 bl.length=443 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:54:18.491 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:18.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.491+0000 7fd8c3faf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:54:18.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.495+0000 7fd8c3faf9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:54:18.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:54:18.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:54:18.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:18.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:54:18.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd7a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94739694701968 notifier 6320 bl.length()=915 2024-08-27T02:54:18.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd7a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:54:18.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd7a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:54:18.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd7a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:18.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:54:18.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:54:18.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:54:18.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.511+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:54:18.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.0 2024-08-27T02:54:18.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.0 2024-08-27T02:54:18.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.1 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.1 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.2 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.2 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.3 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.3 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.4 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.4 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.5 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.5 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.6 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.6 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.7 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.7 2024-08-27T02:54:18.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.8 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.8 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.9 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.9 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.10 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.10 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.11 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2.11 2024-08-27T02:54:18.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.0 2024-08-27T02:54:18.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1 2024-08-27T02:54:18.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2 2024-08-27T02:54:18.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.3 2024-08-27T02:54:18.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.523+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.4 2024-08-27T02:54:18.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.527+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.5 2024-08-27T02:54:18.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.527+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.6 2024-08-27T02:54:18.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.527+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.7 2024-08-27T02:54:18.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.527+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.8 2024-08-27T02:54:18.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.531+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.9 2024-08-27T02:54:18.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.531+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.10 2024-08-27T02:54:18.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.539+0000 7fd8c3faf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:18.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.539+0000 7fd8c3faf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:54:18.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.539+0000 7fd8c3faf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:54:18.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.539+0000 7fd8c3faf9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:54:18.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.539+0000 7fd8c3faf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:18.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.539+0000 7fd8c3faf9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:54:18.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd7a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94739694701968 notifier 6320 bl.length()=915 2024-08-27T02:54:18.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd7a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:54:18.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd7a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:54:18.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd7a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:18.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:54:18.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:54:18.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:54:18.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.543+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:54:18.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.547+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.0 2024-08-27T02:54:18.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.551+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.1 2024-08-27T02:54:18.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.551+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.2 2024-08-27T02:54:18.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.551+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.3 2024-08-27T02:54:18.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.551+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.4 2024-08-27T02:54:18.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.551+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.5 2024-08-27T02:54:18.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.551+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.6 2024-08-27T02:54:18.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.551+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.7 2024-08-27T02:54:18.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.555+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.8 2024-08-27T02:54:18.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.555+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.9 2024-08-27T02:54:18.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.555+0000 7fd8c3faf9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23.10 2024-08-27T02:54:18.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.555+0000 7fd8c3faf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:18.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.555+0000 7fd8c3faf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 2024-08-27T02:54:18.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:54:18.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:54:18.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:18.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23, ofs0, ns] 2024-08-27T02:54:18.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd7a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94739694701968 notifier 6320 bl.length()=883 2024-08-27T02:54:18.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd7a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 info.flags=0x17 2024-08-27T02:54:18.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd7a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 to cache LRU end 2024-08-27T02:54:18.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd7a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:18.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_sources= new_sources= 2024-08-27T02:54:18.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential sources added=[] removed=[] 2024-08-27T02:54:18.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): orig_dests= new_dests= 2024-08-27T02:54:18.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.559+0000 7fd8c3faf9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23]): potential dests added=[] removed=[] 2024-08-27T02:54:18.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.563+0000 7fd8c3faf9c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-08-27T02:54:18.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.567+0000 7fd7737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:18.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.571+0000 7fd8c3faf9c0 20 remove_watcher() i=0 2024-08-27T02:54:18.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.571+0000 7fd8c3faf9c0 2 removed watcher, disabling cache 2024-08-27T02:54:18.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.575+0000 7fd8c3faf9c0 20 remove_watcher() i=1 2024-08-27T02:54:18.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.575+0000 7fd8c3faf9c0 20 remove_watcher() i=2 2024-08-27T02:54:18.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.579+0000 7fd8c3faf9c0 20 remove_watcher() i=3 2024-08-27T02:54:18.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.579+0000 7fd8c3faf9c0 20 remove_watcher() i=4 2024-08-27T02:54:18.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.583+0000 7fd8c3faf9c0 20 remove_watcher() i=5 2024-08-27T02:54:18.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.583+0000 7fd8c3faf9c0 20 remove_watcher() i=6 2024-08-27T02:54:18.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.587+0000 7fd8c3faf9c0 20 remove_watcher() i=7 2024-08-27T02:54:18.598 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-08-27T02:54:18.627 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:18.627 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:18.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.671+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 realm 2024-08-27T02:54:18.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:18.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:18.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:18.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.675+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:18.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.679+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:18.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.679+0000 7f09220479c0 20 searching for the correct realm 2024-08-27T02:54:18.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.683+0000 7f0917fff640 0 -- 172.21.15.143:0/847516470 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f0910008040 msgr2=0x7f0910039400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:18.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:18.899+0000 7f091fb4d640 0 -- 172.21.15.143:0/847516470 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f090800f990 msgr2=0x7f090808a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:19.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:19.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:19.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:19.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 zone default found 2024-08-27T02:54:19.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 4 Realm: () 2024-08-27T02:54:19.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:19.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:19.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:19.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 zonegroup default 2024-08-27T02:54:19.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.119+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.123+0000 7f09220479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:19.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.123+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.123+0000 7f09220479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:19.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.123+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.123+0000 7f09220479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:19.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.123+0000 7f09220479c0 20 started sync module instance, tier type = 2024-08-27T02:54:19.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.123+0000 7f09220479c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:19.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.147+0000 7f09220479c0 20 add_watcher() i=0 2024-08-27T02:54:19.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.147+0000 7f09220479c0 20 add_watcher() i=1 2024-08-27T02:54:19.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.147+0000 7f09220479c0 20 add_watcher() i=2 2024-08-27T02:54:19.144 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.147+0000 7f09220479c0 20 add_watcher() i=3 2024-08-27T02:54:19.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.147+0000 7f09220479c0 20 add_watcher() i=4 2024-08-27T02:54:19.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.147+0000 7f09220479c0 20 add_watcher() i=5 2024-08-27T02:54:19.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.147+0000 7f09220479c0 20 add_watcher() i=6 2024-08-27T02:54:19.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.151+0000 7f09220479c0 20 add_watcher() i=7 2024-08-27T02:54:19.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.151+0000 7f09220479c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:19.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f07d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:19.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:19.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:19.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 5 note: GC not initialized 2024-08-27T02:54:19.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f07d57e2640 20 reqs_thread_entry: start 2024-08-27T02:54:19.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:19.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 20 Filter name: none 2024-08-27T02:54:19.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f07ce7fc640 20 reqs_thread_entry: start 2024-08-27T02:54:19.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:54:19.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.155+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.159+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:54:19.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.159+0000 7f09220479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:19.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.159+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.159+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T02:54:19.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.159+0000 7f09220479c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:19.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.159+0000 7f09220479c0 20 rados_obj.operate() r=0 bl.length=411 2024-08-27T02:54:19.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.159+0000 7f09220479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:19.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.163+0000 7f07d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:19.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.167+0000 7f09220479c0 20 remove_watcher() i=0 2024-08-27T02:54:19.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.167+0000 7f09220479c0 2 removed watcher, disabling cache 2024-08-27T02:54:19.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.171+0000 7f09220479c0 20 remove_watcher() i=1 2024-08-27T02:54:19.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.171+0000 7f09220479c0 20 remove_watcher() i=2 2024-08-27T02:54:19.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.175+0000 7f09220479c0 20 remove_watcher() i=3 2024-08-27T02:54:19.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.175+0000 7f09220479c0 20 remove_watcher() i=4 2024-08-27T02:54:19.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.179+0000 7f09220479c0 20 remove_watcher() i=5 2024-08-27T02:54:19.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.179+0000 7f09220479c0 20 remove_watcher() i=6 2024-08-27T02:54:19.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:19.179+0000 7f09220479c0 20 remove_watcher() i=7 2024-08-27T02:54:19.193 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:19.193 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:19.193 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-block-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:54:19.193 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:20.093 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-08-27T02:54:20.093 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:22.297 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-27T02:54:22.330 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:22.331 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:22.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 realm 2024-08-27T02:54:22.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:22.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.378 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.379+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.383+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:22.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.383+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.383+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:22.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.383+0000 7f1c133519c0 20 searching for the correct realm 2024-08-27T02:54:22.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.387+0000 7f1c11658640 0 -- 172.21.15.143:0/3912351110 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55fe6a751140 msgr2=0x55fe6a753550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:22.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.395+0000 7f1c10e57640 0 -- 172.21.15.143:0/3912351110 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f1c0401b3c0 msgr2=0x7f1c0401b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:22.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.399+0000 7f1c133519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:22.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.399+0000 7f1c133519c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:22.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.399+0000 7f1c133519c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.399+0000 7f1c133519c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.399+0000 7f1c133519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.399+0000 7f1c133519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.399+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:22.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:22.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 zone default found 2024-08-27T02:54:22.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 4 Realm: () 2024-08-27T02:54:22.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:22.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:22.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:22.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 zonegroup default 2024-08-27T02:54:22.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 started sync module instance, tier type = 2024-08-27T02:54:22.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.403+0000 7f1c133519c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:22.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=0 2024-08-27T02:54:22.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=1 2024-08-27T02:54:22.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=2 2024-08-27T02:54:22.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=3 2024-08-27T02:54:22.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=4 2024-08-27T02:54:22.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=5 2024-08-27T02:54:22.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=6 2024-08-27T02:54:22.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 20 add_watcher() i=7 2024-08-27T02:54:22.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.419+0000 7f1c133519c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:22.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1ac6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:22.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1c133519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:22.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1c133519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:22.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1c133519c0 5 note: GC not initialized 2024-08-27T02:54:22.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1ac5fe3640 20 reqs_thread_entry: start 2024-08-27T02:54:22.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1c133519c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:22.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1c133519c0 20 Filter name: none 2024-08-27T02:54:22.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1a377fe640 20 reqs_thread_entry: start 2024-08-27T02:54:22.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.423+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.427+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:22.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.427+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.427+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:22.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.427+0000 7f1c133519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:22.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.427+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.427+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:22.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.427+0000 7f1c133519c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.431+0000 7f1c133519c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:22.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.431+0000 7f1c133519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:22.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.431+0000 7f1ac6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:22.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.439+0000 7f1c133519c0 20 remove_watcher() i=0 2024-08-27T02:54:22.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.439+0000 7f1c133519c0 2 removed watcher, disabling cache 2024-08-27T02:54:22.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.439+0000 7f1c133519c0 20 remove_watcher() i=1 2024-08-27T02:54:22.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.443+0000 7f1c133519c0 20 remove_watcher() i=2 2024-08-27T02:54:22.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.443+0000 7f1c133519c0 20 remove_watcher() i=3 2024-08-27T02:54:22.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.447+0000 7f1c133519c0 20 remove_watcher() i=4 2024-08-27T02:54:22.445 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.447+0000 7f1c133519c0 20 remove_watcher() i=5 2024-08-27T02:54:22.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.447+0000 7f1c133519c0 20 remove_watcher() i=6 2024-08-27T02:54:22.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.451+0000 7f1c133519c0 20 remove_watcher() i=7 2024-08-27T02:54:22.462 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:22.462 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:22.462 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:54:22.462 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:22.462 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-08-27T02:54:22.496 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:22.496 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:22.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.539+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 realm 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:22.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:22.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.543+0000 7f09968669c0 20 searching for the correct realm 2024-08-27T02:54:22.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.551+0000 7f0993b6b640 0 -- 172.21.15.143:0/3245368469 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f0984089300 msgr2=0x7f0984056120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:22.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.555+0000 7f0993b6b640 0 -- 172.21.15.143:0/3245368469 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f085c081140 msgr2=0x7f085c083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:22.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:22.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:22.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:22.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:22.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:22.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:22.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.562 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 zone default found 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 4 Realm: () 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 zonegroup default 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.563+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.567+0000 7f09968669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.567+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.567+0000 7f09968669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.567+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.567+0000 7f09968669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.567+0000 7f09968669c0 20 started sync module instance, tier type = 2024-08-27T02:54:22.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.567+0000 7f09968669c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:22.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.579+0000 7f09968669c0 20 add_watcher() i=0 2024-08-27T02:54:22.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.579+0000 7f09968669c0 20 add_watcher() i=1 2024-08-27T02:54:22.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.579+0000 7f09968669c0 20 add_watcher() i=2 2024-08-27T02:54:22.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.579+0000 7f09968669c0 20 add_watcher() i=3 2024-08-27T02:54:22.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.579+0000 7f09968669c0 20 add_watcher() i=4 2024-08-27T02:54:22.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.579+0000 7f09968669c0 20 add_watcher() i=5 2024-08-27T02:54:22.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.579+0000 7f09968669c0 20 add_watcher() i=6 2024-08-27T02:54:22.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f09968669c0 20 add_watcher() i=7 2024-08-27T02:54:22.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f09968669c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:22.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f084afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f09968669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f09968669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f09968669c0 5 note: GC not initialized 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f0849fdb640 20 reqs_thread_entry: start 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.583+0000 7f09968669c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 20 Filter name: none 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f07bb7fe640 20 reqs_thread_entry: start 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-08-27T02:54:22.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:22.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-08-27T02:54:22.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-08-27T02:54:22.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 : miss 2024-08-27T02:54:22.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:22.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:22.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:22.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:54:22.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:22.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.587+0000 7f09968669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 2024-08-27T02:54:22.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f09968669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:22.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f09968669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:22.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f09968669c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:22.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f09968669c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24, ofs0, ns] 2024-08-27T02:54:22.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f086affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 93930683592544 notifier 6681 bl.length()=931 2024-08-27T02:54:22.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f086affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:22.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f086affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:22.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.595+0000 7f086affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:22.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.599+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_sources= new_sources= 2024-08-27T02:54:22.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.599+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential sources added=[] removed=[] 2024-08-27T02:54:22.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.599+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_dests= new_dests= 2024-08-27T02:54:22.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.599+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential dests added=[] removed=[] 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.0 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.0 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.1 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.1 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.2 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.2 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.3 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.3 2024-08-27T02:54:22.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.4 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.4 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.5 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.5 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.6 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.6 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.7 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.7 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.8 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.8 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.9 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.9 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.10 2024-08-27T02:54:22.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.10 2024-08-27T02:54:22.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.11 2024-08-27T02:54:22.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1.11 2024-08-27T02:54:22.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.0 2024-08-27T02:54:22.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1 2024-08-27T02:54:22.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2 2024-08-27T02:54:22.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.3 2024-08-27T02:54:22.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.611+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.4 2024-08-27T02:54:22.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.615+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.5 2024-08-27T02:54:22.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.615+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.6 2024-08-27T02:54:22.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.615+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.7 2024-08-27T02:54:22.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.615+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.8 2024-08-27T02:54:22.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.615+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.9 2024-08-27T02:54:22.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.615+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.10 2024-08-27T02:54:22.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f09968669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:22.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f09968669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 2024-08-27T02:54:22.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f09968669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:22.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f09968669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f09968669c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f09968669c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24, ofs0, ns] 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f086b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 93930683592544 notifier 6681 bl.length()=931 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f086b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f086b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.623+0000 7f086b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.627+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_sources= new_sources= 2024-08-27T02:54:22.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.627+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential sources added=[] removed=[] 2024-08-27T02:54:22.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.627+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_dests= new_dests= 2024-08-27T02:54:22.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.627+0000 7f09968669c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential dests added=[] removed=[] 2024-08-27T02:54:22.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.631+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.0 2024-08-27T02:54:22.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.631+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1 2024-08-27T02:54:22.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.631+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2 2024-08-27T02:54:22.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.635+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.3 2024-08-27T02:54:22.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.635+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.4 2024-08-27T02:54:22.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.635+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.5 2024-08-27T02:54:22.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.635+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.6 2024-08-27T02:54:22.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.635+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.7 2024-08-27T02:54:22.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.635+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.8 2024-08-27T02:54:22.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.635+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.9 2024-08-27T02:54:22.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.639+0000 7f09968669c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.10 2024-08-27T02:54:22.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.639+0000 7f09968669c0 -1 Injecting error=-5 at location=commit_target_layout 2024-08-27T02:54:22.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.639+0000 7f09968669c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-08-27T02:54:22.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.647+0000 7f084afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:22.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.651+0000 7f09968669c0 20 remove_watcher() i=0 2024-08-27T02:54:22.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.651+0000 7f09968669c0 2 removed watcher, disabling cache 2024-08-27T02:54:22.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.651+0000 7f09968669c0 20 remove_watcher() i=1 2024-08-27T02:54:22.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.655+0000 7f09968669c0 20 remove_watcher() i=2 2024-08-27T02:54:22.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.655+0000 7f09968669c0 20 remove_watcher() i=3 2024-08-27T02:54:22.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.659+0000 7f09968669c0 20 remove_watcher() i=4 2024-08-27T02:54:22.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.659+0000 7f09968669c0 20 remove_watcher() i=5 2024-08-27T02:54:22.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.659+0000 7f09968669c0 20 remove_watcher() i=6 2024-08-27T02:54:22.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.663+0000 7f09968669c0 20 remove_watcher() i=7 2024-08-27T02:54:22.673 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-27T02:54:22.700 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:22.700 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:22.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.743+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 realm 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:22.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:22.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.747+0000 7fe9322699c0 20 searching for the correct realm 2024-08-27T02:54:22.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.755+0000 7fe930570640 0 -- 172.21.15.143:0/1050890470 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fe924126050 msgr2=0x7fe9240b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:22.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.971+0000 7fe92fd6f640 0 -- 172.21.15.143:0/1050890470 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x556dd8e885e0 msgr2=0x556dd8e8a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:22.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:22.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.979+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:22.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 zone default found 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 4 Realm: () 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 zonegroup default 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:22.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:22.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 started sync module instance, tier type = 2024-08-27T02:54:22.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:22.983+0000 7fe9322699c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:23.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.011+0000 7fe9322699c0 20 add_watcher() i=0 2024-08-27T02:54:23.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.011+0000 7fe9322699c0 20 add_watcher() i=1 2024-08-27T02:54:23.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.011+0000 7fe9322699c0 20 add_watcher() i=2 2024-08-27T02:54:23.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.011+0000 7fe9322699c0 20 add_watcher() i=3 2024-08-27T02:54:23.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.011+0000 7fe9322699c0 20 add_watcher() i=4 2024-08-27T02:54:23.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.011+0000 7fe9322699c0 20 add_watcher() i=5 2024-08-27T02:54:23.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.011+0000 7fe9322699c0 20 add_watcher() i=6 2024-08-27T02:54:23.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.015+0000 7fe9322699c0 20 add_watcher() i=7 2024-08-27T02:54:23.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.015+0000 7fe9322699c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:23.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe7e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:23.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe9322699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:23.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe9322699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:23.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe9322699c0 5 note: GC not initialized 2024-08-27T02:54:23.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe7e4fe1640 20 reqs_thread_entry: start 2024-08-27T02:54:23.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe9322699c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:23.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe9322699c0 20 Filter name: none 2024-08-27T02:54:23.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe75e7fc640 20 reqs_thread_entry: start 2024-08-27T02:54:23.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.019+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:23.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:54:23.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:23.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:23.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:54:23.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.023+0000 7fe9322699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:23.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.027+0000 7fe7e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:23.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.031+0000 7fe9322699c0 20 remove_watcher() i=0 2024-08-27T02:54:23.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.031+0000 7fe9322699c0 2 removed watcher, disabling cache 2024-08-27T02:54:23.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.035+0000 7fe9322699c0 20 remove_watcher() i=1 2024-08-27T02:54:23.034 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.035+0000 7fe9322699c0 20 remove_watcher() i=2 2024-08-27T02:54:23.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.039+0000 7fe9322699c0 20 remove_watcher() i=3 2024-08-27T02:54:23.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.039+0000 7fe9322699c0 20 remove_watcher() i=4 2024-08-27T02:54:23.039 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.043+0000 7fe9322699c0 20 remove_watcher() i=5 2024-08-27T02:54:23.040 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.043+0000 7fe9322699c0 20 remove_watcher() i=6 2024-08-27T02:54:23.042 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.043+0000 7fe9322699c0 20 remove_watcher() i=7 2024-08-27T02:54:23.056 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:23.056 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:23.056 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:54:23.057 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:54:23.205 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:23.205 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:23.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.251+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.251+0000 7f27f58c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.251+0000 7f27f58c29c0 20 realm 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.251+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:23.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:23.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.255+0000 7f27f58c29c0 20 searching for the correct realm 2024-08-27T02:54:23.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.263+0000 7f27f3bc9640 0 -- 172.21.15.143:0/3111971451 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f27e80b63f0 msgr2=0x7f27e80b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:54:23.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.479+0000 7f27f33c8640 0 -- 172.21.15.143:0/3111971451 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55f74270a0c0 msgr2=0x55f74270c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:23.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:23.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:23.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:23.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:23.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:23.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:23.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:23.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.487+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 zone default found 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 4 Realm: () 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 zonegroup default 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 started sync module instance, tier type = 2024-08-27T02:54:23.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.491+0000 7f27f58c29c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:23.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.511+0000 7f27f58c29c0 20 add_watcher() i=0 2024-08-27T02:54:23.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.511+0000 7f27f58c29c0 20 add_watcher() i=1 2024-08-27T02:54:23.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.511+0000 7f27f58c29c0 20 add_watcher() i=2 2024-08-27T02:54:23.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.511+0000 7f27f58c29c0 20 add_watcher() i=3 2024-08-27T02:54:23.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.511+0000 7f27f58c29c0 20 add_watcher() i=4 2024-08-27T02:54:23.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.511+0000 7f27f58c29c0 20 add_watcher() i=5 2024-08-27T02:54:23.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.511+0000 7f27f58c29c0 20 add_watcher() i=6 2024-08-27T02:54:23.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.515+0000 7f27f58c29c0 20 add_watcher() i=7 2024-08-27T02:54:23.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.515+0000 7f27f58c29c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:23.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f26a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:23.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f27f58c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:23.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f27f58c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:23.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f27f58c29c0 5 note: GC not initialized 2024-08-27T02:54:23.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f26a8fe1640 20 reqs_thread_entry: start 2024-08-27T02:54:23.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f27f58c29c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:23.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f27f58c29c0 20 Filter name: none 2024-08-27T02:54:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f26227fc640 20 reqs_thread_entry: start 2024-08-27T02:54:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f27f58c29c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-08-27T02:54:23.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.519+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:23.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-08-27T02:54:23.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-08-27T02:54:23.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 : miss 2024-08-27T02:54:23.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:54:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:54:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:23.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.523+0000 7f27f58c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 2024-08-27T02:54:23.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.527+0000 7f27f58c29c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:54:23.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f27f58c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:23.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f27f58c29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:23.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f27f58c29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:23.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f27f58c29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24, ofs0, ns] 2024-08-27T02:54:23.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f26d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94520460011936 notifier 6717 bl.length()=931 2024-08-27T02:54:23.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f26d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:23.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f26d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:23.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.539+0000 7f26d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:23.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.543+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_sources= new_sources= 2024-08-27T02:54:23.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.543+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential sources added=[] removed=[] 2024-08-27T02:54:23.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.543+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_dests= new_dests= 2024-08-27T02:54:23.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.543+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential dests added=[] removed=[] 2024-08-27T02:54:23.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.0 2024-08-27T02:54:23.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.0 2024-08-27T02:54:23.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.1 2024-08-27T02:54:23.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.1 2024-08-27T02:54:23.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.2 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.2 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.3 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.3 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.4 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.4 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.5 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.5 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.6 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.6 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.7 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.7 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.8 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.8 2024-08-27T02:54:23.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.9 2024-08-27T02:54:23.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.9 2024-08-27T02:54:23.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.10 2024-08-27T02:54:23.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.10 2024-08-27T02:54:23.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.11 2024-08-27T02:54:23.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2.11 2024-08-27T02:54:23.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.0 2024-08-27T02:54:23.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1 2024-08-27T02:54:23.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2 2024-08-27T02:54:23.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.555+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.3 2024-08-27T02:54:23.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.559+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.4 2024-08-27T02:54:23.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.559+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.5 2024-08-27T02:54:23.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.559+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.6 2024-08-27T02:54:23.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.559+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.7 2024-08-27T02:54:23.558 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.559+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.8 2024-08-27T02:54:23.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.563+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.9 2024-08-27T02:54:23.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.563+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.10 2024-08-27T02:54:23.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.567+0000 7f27f58c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:23.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.567+0000 7f27f58c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 2024-08-27T02:54:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f27f58c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f27f58c29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f27f58c29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f27f58c29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24, ofs0, ns] 2024-08-27T02:54:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f26d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94520460011936 notifier 6717 bl.length()=931 2024-08-27T02:54:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f26d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f26d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.571+0000 7f26d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.575+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_sources= new_sources= 2024-08-27T02:54:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.575+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential sources added=[] removed=[] 2024-08-27T02:54:23.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.575+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_dests= new_dests= 2024-08-27T02:54:23.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.575+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential dests added=[] removed=[] 2024-08-27T02:54:23.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.579+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.0 2024-08-27T02:54:23.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.579+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.1 2024-08-27T02:54:23.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.579+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.2 2024-08-27T02:54:23.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.583+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.3 2024-08-27T02:54:23.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.583+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.4 2024-08-27T02:54:23.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.583+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.5 2024-08-27T02:54:23.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.583+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.6 2024-08-27T02:54:23.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.583+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.7 2024-08-27T02:54:23.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.587+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.8 2024-08-27T02:54:23.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.587+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.9 2024-08-27T02:54:23.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.587+0000 7f27f58c29c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24.10 2024-08-27T02:54:23.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.587+0000 7f27f58c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:23.585 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.587+0000 7f27f58c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 2024-08-27T02:54:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f27f58c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f27f58c29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f27f58c29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f27f58c29c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24, ofs0, ns] 2024-08-27T02:54:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f26d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94520460011936 notifier 6717 bl.length()=899 2024-08-27T02:54:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f26d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 info.flags=0x17 2024-08-27T02:54:23.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f26d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 to cache LRU end 2024-08-27T02:54:23.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.591+0000 7f26d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:23.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.595+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_sources= new_sources= 2024-08-27T02:54:23.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.595+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential sources added=[] removed=[] 2024-08-27T02:54:23.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.595+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): orig_dests= new_dests= 2024-08-27T02:54:23.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.595+0000 7f27f58c29c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24]): potential dests added=[] removed=[] 2024-08-27T02:54:23.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.599+0000 7f27f58c29c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-08-27T02:54:23.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.603+0000 7f26a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:23.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.607+0000 7f27f58c29c0 20 remove_watcher() i=0 2024-08-27T02:54:23.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.607+0000 7f27f58c29c0 2 removed watcher, disabling cache 2024-08-27T02:54:23.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.611+0000 7f27f58c29c0 20 remove_watcher() i=1 2024-08-27T02:54:23.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.611+0000 7f27f58c29c0 20 remove_watcher() i=2 2024-08-27T02:54:23.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.615+0000 7f27f58c29c0 20 remove_watcher() i=3 2024-08-27T02:54:23.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.615+0000 7f27f58c29c0 20 remove_watcher() i=4 2024-08-27T02:54:23.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.615+0000 7f27f58c29c0 20 remove_watcher() i=5 2024-08-27T02:54:23.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.619+0000 7f27f58c29c0 20 remove_watcher() i=6 2024-08-27T02:54:23.617 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.619+0000 7f27f58c29c0 20 remove_watcher() i=7 2024-08-27T02:54:23.634 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-27T02:54:23.664 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:23.664 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:23.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.711+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.711+0000 7f060754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.711+0000 7f060754a9c0 20 realm 2024-08-27T02:54:23.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.711+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:23.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:23.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:23.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.715+0000 7f060754a9c0 20 searching for the correct realm 2024-08-27T02:54:23.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.723+0000 7f0605851640 0 -- 172.21.15.143:0/3749247969 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55b57e799c50 msgr2=0x55b57e79c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:23.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.727+0000 7f060484f640 0 -- 172.21.15.143:0/3749247969 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f06000f90d0 msgr2=0x7f0600106750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:54:23.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:23.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:23.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:23.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:23.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:23.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:23.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.735+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 zone default found 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 4 Realm: () 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 zonegroup default 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:23.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 started sync module instance, tier type = 2024-08-27T02:54:23.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.739+0000 7f060754a9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:23.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=0 2024-08-27T02:54:23.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=1 2024-08-27T02:54:23.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=2 2024-08-27T02:54:23.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=3 2024-08-27T02:54:23.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=4 2024-08-27T02:54:23.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=5 2024-08-27T02:54:23.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=6 2024-08-27T02:54:23.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 20 add_watcher() i=7 2024-08-27T02:54:23.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.755+0000 7f060754a9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:23.755 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f04bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:23.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:23.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:23.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 5 note: GC not initialized 2024-08-27T02:54:23.756 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f04ba7e4640 20 reqs_thread_entry: start 2024-08-27T02:54:23.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:23.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 Filter name: none 2024-08-27T02:54:23.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f042bfff640 20 reqs_thread_entry: start 2024-08-27T02:54:23.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:23.757 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:23.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:23.758 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.759+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.763+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:23.759 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.763+0000 7f060754a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:23.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.763+0000 7f060754a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:23.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.763+0000 7f060754a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:23.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.767+0000 7f04bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:23.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.771+0000 7f060754a9c0 20 remove_watcher() i=0 2024-08-27T02:54:23.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.771+0000 7f060754a9c0 2 removed watcher, disabling cache 2024-08-27T02:54:23.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.771+0000 7f060754a9c0 20 remove_watcher() i=1 2024-08-27T02:54:23.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.775+0000 7f060754a9c0 20 remove_watcher() i=2 2024-08-27T02:54:23.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.775+0000 7f060754a9c0 20 remove_watcher() i=3 2024-08-27T02:54:23.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.779+0000 7f060754a9c0 20 remove_watcher() i=4 2024-08-27T02:54:23.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.779+0000 7f060754a9c0 20 remove_watcher() i=5 2024-08-27T02:54:23.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.779+0000 7f060754a9c0 20 remove_watcher() i=6 2024-08-27T02:54:23.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:23.783+0000 7f060754a9c0 20 remove_watcher() i=7 2024-08-27T02:54:23.794 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:23.794 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:23.794 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:54:23.794 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:24.720 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-08-27T02:54:24.720 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:26.911 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-27T02:54:26.945 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:26.945 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:26.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.991+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:26.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.991+0000 7f90b22b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:26.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.991+0000 7f90b22b69c0 20 realm 2024-08-27T02:54:26.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.991+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:26.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.991+0000 7f90b22b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:26.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.991+0000 7f90b22b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:26.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.991+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:26.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.995+0000 7f90b22b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:26.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.995+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:26.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.995+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:26.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.995+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:26.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.995+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:26.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:26.995+0000 7f90b22b69c0 20 searching for the correct realm 2024-08-27T02:54:27.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.207+0000 7f90af5bb640 0 -- 172.21.15.143:0/4206603081 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f90a0041750 msgr2=0x7f90a0091a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:27.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.219+0000 7f90afdbc640 0 -- 172.21.15.143:0/4206603081 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f9098104760 msgr2=0x7f90980d1730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:54:27.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.435+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:27.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:27.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 zone default found 2024-08-27T02:54:27.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 4 Realm: () 2024-08-27T02:54:27.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:27.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:27.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:27.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 zonegroup default 2024-08-27T02:54:27.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 started sync module instance, tier type = 2024-08-27T02:54:27.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.439+0000 7f90b22b69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:27.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.463+0000 7f90b22b69c0 20 add_watcher() i=0 2024-08-27T02:54:27.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.463+0000 7f90b22b69c0 20 add_watcher() i=1 2024-08-27T02:54:27.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.463+0000 7f90b22b69c0 20 add_watcher() i=2 2024-08-27T02:54:27.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.463+0000 7f90b22b69c0 20 add_watcher() i=3 2024-08-27T02:54:27.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.463+0000 7f90b22b69c0 20 add_watcher() i=4 2024-08-27T02:54:27.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.463+0000 7f90b22b69c0 20 add_watcher() i=5 2024-08-27T02:54:27.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.463+0000 7f90b22b69c0 20 add_watcher() i=6 2024-08-27T02:54:27.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.467+0000 7f90b22b69c0 20 add_watcher() i=7 2024-08-27T02:54:27.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.467+0000 7f90b22b69c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:27.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f8f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:27.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f90b22b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:27.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f90b22b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:27.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f90b22b69c0 5 note: GC not initialized 2024-08-27T02:54:27.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f8f64fe1640 20 reqs_thread_entry: start 2024-08-27T02:54:27.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f90b22b69c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:27.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f90b22b69c0 20 Filter name: none 2024-08-27T02:54:27.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f8ede7fc640 20 reqs_thread_entry: start 2024-08-27T02:54:27.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.471+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:27.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:27.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:27.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:27.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:27.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.475+0000 7f90b22b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:27.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.483+0000 7f8f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:27.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.487+0000 7f90b22b69c0 20 remove_watcher() i=0 2024-08-27T02:54:27.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.487+0000 7f90b22b69c0 2 removed watcher, disabling cache 2024-08-27T02:54:27.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.491+0000 7f90b22b69c0 20 remove_watcher() i=1 2024-08-27T02:54:27.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.491+0000 7f90b22b69c0 20 remove_watcher() i=2 2024-08-27T02:54:27.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.495+0000 7f90b22b69c0 20 remove_watcher() i=3 2024-08-27T02:54:27.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.495+0000 7f90b22b69c0 20 remove_watcher() i=4 2024-08-27T02:54:27.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.499+0000 7f90b22b69c0 20 remove_watcher() i=5 2024-08-27T02:54:27.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.499+0000 7f90b22b69c0 20 remove_watcher() i=6 2024-08-27T02:54:27.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.503+0000 7f90b22b69c0 20 remove_watcher() i=7 2024-08-27T02:54:27.518 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:27.518 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:27.519 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:54:27.519 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:27.519 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-08-27T02:54:27.559 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:27.559 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:27.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.603+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 realm 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:27.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.607+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.611+0000 7fc5be99d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:27.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.611+0000 7fc5be99d9c0 20 searching for the correct realm 2024-08-27T02:54:27.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.615+0000 7fc5bbca2640 0 -- 172.21.15.143:0/3521886352 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x55fcf47bd690 msgr2=0x55fcf47bfb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:27.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.623+0000 7fc5bc4a3640 0 -- 172.21.15.143:0/3521886352 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fc5b0090c00 msgr2=0x7fc5b00656b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:27.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:27.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 zone default found 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 4 Realm: () 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 zonegroup default 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 started sync module instance, tier type = 2024-08-27T02:54:27.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.631+0000 7fc5be99d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:27.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.647+0000 7fc5be99d9c0 20 add_watcher() i=0 2024-08-27T02:54:27.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.647+0000 7fc5be99d9c0 20 add_watcher() i=1 2024-08-27T02:54:27.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.647+0000 7fc5be99d9c0 20 add_watcher() i=2 2024-08-27T02:54:27.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.647+0000 7fc5be99d9c0 20 add_watcher() i=3 2024-08-27T02:54:27.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.647+0000 7fc5be99d9c0 20 add_watcher() i=4 2024-08-27T02:54:27.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.647+0000 7fc5be99d9c0 20 add_watcher() i=5 2024-08-27T02:54:27.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.647+0000 7fc5be99d9c0 20 add_watcher() i=6 2024-08-27T02:54:27.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 20 add_watcher() i=7 2024-08-27T02:54:27.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:27.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc472fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:27.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:27.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:27.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 5 note: GC not initialized 2024-08-27T02:54:27.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc471fdb640 20 reqs_thread_entry: start 2024-08-27T02:54:27.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:27.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 20 Filter name: none 2024-08-27T02:54:27.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc3e37fe640 20 reqs_thread_entry: start 2024-08-27T02:54:27.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-08-27T02:54:27.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.651+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:27.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-08-27T02:54:27.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-08-27T02:54:27.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 : miss 2024-08-27T02:54:27.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:27.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 info.flags=0x17 2024-08-27T02:54:27.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 to cache LRU end 2024-08-27T02:54:27.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:54:27.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:27.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.655+0000 7fc5be99d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 2024-08-27T02:54:27.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 info.flags=0x17 2024-08-27T02:54:27.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 to cache LRU end 2024-08-27T02:54:27.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:27.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25, ofs0, ns] 2024-08-27T02:54:27.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc4937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94544921904112 notifier 6452 bl.length()=931 2024-08-27T02:54:27.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc4937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 info.flags=0x17 2024-08-27T02:54:27.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc4937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 to cache LRU end 2024-08-27T02:54:27.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc4937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:27.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): orig_sources= new_sources= 2024-08-27T02:54:27.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): potential sources added=[] removed=[] 2024-08-27T02:54:27.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): orig_dests= new_dests= 2024-08-27T02:54:27.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.667+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): potential dests added=[] removed=[] 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.0 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.0 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.1 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.1 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.2 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.2 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.3 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.3 2024-08-27T02:54:27.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.4 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.4 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.5 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.5 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.6 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.6 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.7 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.7 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.8 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.8 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.9 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.9 2024-08-27T02:54:27.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.10 2024-08-27T02:54:27.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.10 2024-08-27T02:54:27.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.11 2024-08-27T02:54:27.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1.11 2024-08-27T02:54:27.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.679+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.0 2024-08-27T02:54:27.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.683+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1 2024-08-27T02:54:27.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.683+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.2 2024-08-27T02:54:27.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.683+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.3 2024-08-27T02:54:27.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.683+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.4 2024-08-27T02:54:27.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.687+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.5 2024-08-27T02:54:27.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.687+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.6 2024-08-27T02:54:27.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.687+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.7 2024-08-27T02:54:27.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.687+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.8 2024-08-27T02:54:27.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.691+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.9 2024-08-27T02:54:27.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.691+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.10 2024-08-27T02:54:27.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc5be99d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:27.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc5be99d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 2024-08-27T02:54:27.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc5be99d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 info.flags=0x17 2024-08-27T02:54:27.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc5be99d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 to cache LRU end 2024-08-27T02:54:27.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc5be99d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:27.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc5be99d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25, ofs0, ns] 2024-08-27T02:54:27.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc492ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94544921904112 notifier 6452 bl.length()=931 2024-08-27T02:54:27.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.699+0000 7fc492ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 info.flags=0x17 2024-08-27T02:54:27.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.703+0000 7fc492ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 to cache LRU end 2024-08-27T02:54:27.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.703+0000 7fc492ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:27.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.703+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): orig_sources= new_sources= 2024-08-27T02:54:27.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.703+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): potential sources added=[] removed=[] 2024-08-27T02:54:27.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.703+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): orig_dests= new_dests= 2024-08-27T02:54:27.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.703+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): potential dests added=[] removed=[] 2024-08-27T02:54:27.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.707+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.0 2024-08-27T02:54:27.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.711+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.1 2024-08-27T02:54:27.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.711+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.2 2024-08-27T02:54:27.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.711+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.3 2024-08-27T02:54:27.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.711+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.4 2024-08-27T02:54:27.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.711+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.5 2024-08-27T02:54:27.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.715+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.6 2024-08-27T02:54:27.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.715+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.7 2024-08-27T02:54:27.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.715+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.8 2024-08-27T02:54:27.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.715+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.9 2024-08-27T02:54:27.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.715+0000 7fc5be99d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25.10 2024-08-27T02:54:27.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc5be99d9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-08-27T02:54:27.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc5be99d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:27.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc5be99d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc5be99d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 info.flags=0x17 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc5be99d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 to cache LRU end 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc5be99d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc5be99d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25, ofs0, ns] 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc492ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94544921904112 notifier 6452 bl.length()=899 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc492ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 info.flags=0x17 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc492ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 to cache LRU end 2024-08-27T02:54:27.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.719+0000 7fc492ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:27.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.723+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): orig_sources= new_sources= 2024-08-27T02:54:27.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.723+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): potential sources added=[] removed=[] 2024-08-27T02:54:27.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.723+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): orig_dests= new_dests= 2024-08-27T02:54:27.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.723+0000 7fc5be99d9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25]): potential dests added=[] removed=[] 2024-08-27T02:54:27.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.727+0000 7fc5be99d9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-08-27T02:54:27.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.731+0000 7fc472fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:27.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.735+0000 7fc5be99d9c0 20 remove_watcher() i=0 2024-08-27T02:54:27.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.735+0000 7fc5be99d9c0 2 removed watcher, disabling cache 2024-08-27T02:54:27.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.739+0000 7fc5be99d9c0 20 remove_watcher() i=1 2024-08-27T02:54:27.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.739+0000 7fc5be99d9c0 20 remove_watcher() i=2 2024-08-27T02:54:27.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.743+0000 7fc5be99d9c0 20 remove_watcher() i=3 2024-08-27T02:54:27.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.747+0000 7fc5be99d9c0 20 remove_watcher() i=4 2024-08-27T02:54:27.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.747+0000 7fc5be99d9c0 20 remove_watcher() i=5 2024-08-27T02:54:27.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.747+0000 7fc5be99d9c0 20 remove_watcher() i=6 2024-08-27T02:54:27.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.751+0000 7fc5be99d9c0 20 remove_watcher() i=7 2024-08-27T02:54:27.762 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-08-27T02:54:27.789 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:27.789 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:27.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.835+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.835+0000 7f4e437369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.835+0000 7f4e437369c0 20 realm 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.835+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.835 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:27.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:27.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.839+0000 7f4e437369c0 20 searching for the correct realm 2024-08-27T02:54:27.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.847+0000 7f4e41a3d640 0 -- 172.21.15.143:0/2496328244 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55a367ee1850 msgr2=0x55a367ee3cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:27.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.851+0000 7f4e40a3b640 0 -- 172.21.15.143:0/2496328244 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f4e3402c070 msgr2=0x7f4e34042400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:27.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:27.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:27.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:27.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:27.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:27.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:27.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 zone default found 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 4 Realm: () 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 zonegroup default 2024-08-27T02:54:27.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.859+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.863+0000 7f4e437369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.863+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.863+0000 7f4e437369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.863+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.863+0000 7f4e437369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:27.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.863+0000 7f4e437369c0 20 started sync module instance, tier type = 2024-08-27T02:54:27.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.863+0000 7f4e437369c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:27.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=0 2024-08-27T02:54:27.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=1 2024-08-27T02:54:27.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=2 2024-08-27T02:54:27.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=3 2024-08-27T02:54:27.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=4 2024-08-27T02:54:27.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=5 2024-08-27T02:54:27.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=6 2024-08-27T02:54:27.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 20 add_watcher() i=7 2024-08-27T02:54:27.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.879+0000 7f4e437369c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:27.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4cf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:27.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:27.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:27.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 5 note: GC not initialized 2024-08-27T02:54:27.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4cf67e4640 20 reqs_thread_entry: start 2024-08-27T02:54:27.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:27.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 Filter name: none 2024-08-27T02:54:27.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4c67fff640 20 reqs_thread_entry: start 2024-08-27T02:54:27.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:27.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:27.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:27.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:27.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.883+0000 7f4e437369c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:27.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.887+0000 7f4e437369c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:27.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.887+0000 7f4e437369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:27.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.887+0000 7f4cf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:27.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.895+0000 7f4e437369c0 20 remove_watcher() i=0 2024-08-27T02:54:27.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.895+0000 7f4e437369c0 2 removed watcher, disabling cache 2024-08-27T02:54:27.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.895+0000 7f4e437369c0 20 remove_watcher() i=1 2024-08-27T02:54:27.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.899+0000 7f4e437369c0 20 remove_watcher() i=2 2024-08-27T02:54:27.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.899+0000 7f4e437369c0 20 remove_watcher() i=3 2024-08-27T02:54:27.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.903+0000 7f4e437369c0 20 remove_watcher() i=4 2024-08-27T02:54:27.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.903+0000 7f4e437369c0 20 remove_watcher() i=5 2024-08-27T02:54:27.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.903+0000 7f4e437369c0 20 remove_watcher() i=6 2024-08-27T02:54:27.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:27.907+0000 7f4e437369c0 20 remove_watcher() i=7 2024-08-27T02:54:27.917 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:27.917 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:27.917 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25 num_objects: 20 size_kb: 1 num_shards: 12 2024-08-27T02:54:27.917 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:28.840 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-08-27T02:54:28.840 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.077 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-08-27T02:54:31.110 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:31.110 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:31.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.154+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 realm 2024-08-27T02:54:31.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:31.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:31.158 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.158+0000 7f28467aa9c0 20 searching for the correct realm 2024-08-27T02:54:31.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.166+0000 7f2844ab1640 0 -- 172.21.15.143:0/841910455 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f283802a030 msgr2=0x7f2838062250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.169 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.170+0000 7f28442b0640 0 -- 172.21.15.143:0/841910455 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f2838080220 msgr2=0x7f28380886d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.386+0000 7f28467aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:31.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.386+0000 7f28467aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:31.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.386+0000 7f28467aa9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:31.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.386+0000 7f28467aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:31.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.386+0000 7f28467aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:31.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.386+0000 7f28467aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:31.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.386+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:31.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 zone default found 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 4 Realm: () 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 zonegroup default 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.390+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.394+0000 7f28467aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.394+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.394+0000 7f28467aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.394+0000 7f28467aa9c0 20 started sync module instance, tier type = 2024-08-27T02:54:31.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.394+0000 7f28467aa9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:31.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=0 2024-08-27T02:54:31.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=1 2024-08-27T02:54:31.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=2 2024-08-27T02:54:31.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=3 2024-08-27T02:54:31.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=4 2024-08-27T02:54:31.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=5 2024-08-27T02:54:31.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=6 2024-08-27T02:54:31.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 20 add_watcher() i=7 2024-08-27T02:54:31.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.418+0000 7f28467aa9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:31.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.422+0000 7f26fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:31.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:31.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:31.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 5 note: GC not initialized 2024-08-27T02:54:31.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f26f9fdb640 20 reqs_thread_entry: start 2024-08-27T02:54:31.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:31.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 Filter name: none 2024-08-27T02:54:31.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f266b7fe640 20 reqs_thread_entry: start 2024-08-27T02:54:31.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:31.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:31.426 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:31.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:31.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.426+0000 7f28467aa9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.430+0000 7f28467aa9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:31.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.430+0000 7f28467aa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:31.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.430+0000 7f26fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:31.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.438+0000 7f28467aa9c0 20 remove_watcher() i=0 2024-08-27T02:54:31.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.438+0000 7f28467aa9c0 2 removed watcher, disabling cache 2024-08-27T02:54:31.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.438+0000 7f28467aa9c0 20 remove_watcher() i=1 2024-08-27T02:54:31.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.442+0000 7f28467aa9c0 20 remove_watcher() i=2 2024-08-27T02:54:31.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.442+0000 7f28467aa9c0 20 remove_watcher() i=3 2024-08-27T02:54:31.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.446+0000 7f28467aa9c0 20 remove_watcher() i=4 2024-08-27T02:54:31.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.446+0000 7f28467aa9c0 20 remove_watcher() i=5 2024-08-27T02:54:31.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.450+0000 7f28467aa9c0 20 remove_watcher() i=6 2024-08-27T02:54:31.448 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.450+0000 7f28467aa9c0 20 remove_watcher() i=7 2024-08-27T02:54:31.463 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.463 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:31.463 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:54:31.463 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.463 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-08-27T02:54:31.496 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:31.496 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:31.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.538+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 realm 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:31.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.542+0000 7fc7874139c0 20 searching for the correct realm 2024-08-27T02:54:31.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.550+0000 7fc784718640 0 -- 172.21.15.143:0/99020648 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc77408fcf0 msgr2=0x7fc77407e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.554+0000 7fc784f19640 0 -- 172.21.15.143:0/99020648 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x7fc77408fcf0 msgr2=0x7fc650085e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:31.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:31.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:31.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:31.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:31.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:31.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.773 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:31.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 zone default found 2024-08-27T02:54:31.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 4 Realm: () 2024-08-27T02:54:31.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:31.774 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:31.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:31.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 zonegroup default 2024-08-27T02:54:31.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.778+0000 7fc7874139c0 20 started sync module instance, tier type = 2024-08-27T02:54:31.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.778+0000 7fc7874139c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:31.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=0 2024-08-27T02:54:31.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=1 2024-08-27T02:54:31.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=2 2024-08-27T02:54:31.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=3 2024-08-27T02:54:31.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=4 2024-08-27T02:54:31.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=5 2024-08-27T02:54:31.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=6 2024-08-27T02:54:31.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.806+0000 7fc7874139c0 20 add_watcher() i=7 2024-08-27T02:54:31.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.806+0000 7fc7874139c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:31.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.810+0000 7fc63afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:31.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.810+0000 7fc7874139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:31.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.810+0000 7fc7874139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:31.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.810+0000 7fc7874139c0 5 note: GC not initialized 2024-08-27T02:54:31.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.810+0000 7fc639fe3640 20 reqs_thread_entry: start 2024-08-27T02:54:31.810 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.810+0000 7fc7874139c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:31.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.810+0000 7fc7874139c0 20 Filter name: none 2024-08-27T02:54:31.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc5ab7fe640 20 reqs_thread_entry: start 2024-08-27T02:54:31.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-27T02:54:31.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:31.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-27T02:54:31.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-27T02:54:31.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : miss 2024-08-27T02:54:31.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:31.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:54:31.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.814+0000 7fc7874139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:54:31.823 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:54:31.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366232 cookie 94014053075168 notifier 6831 bl.length()=931 2024-08-27T02:54:31.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:54:31.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:54:31.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:54:31.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:54:31.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:54:31.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:54:31.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:54:31.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:54:31.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:54:31.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:54:31.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:54:31.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:54:31.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:54:31.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:54:31.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:54:31.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:54:31.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:54:31.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:54:31.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:54:31.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.846+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:54:31.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.850+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:31.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.850+0000 7fc7874139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:54:31.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc7874139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc7874139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:54:31.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94014053075168 notifier 6831 bl.length()=931 2024-08-27T02:54:31.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:54:31.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:54:31.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:54:31.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:54:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:54:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:54:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:54:31.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:54:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:54:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:54:31.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:54:31.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:54:31.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:54:31.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:54:31.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.870+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:54:31.868 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7874139c0 time 2024-08-27T02:54:31.873505+0000 2024-08-27T02:54:31.868 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:54:31.869 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.869 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc78aced2eb] 2024-08-27T02:54:31.869 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.869 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc7874139c0 thread_name:radosgw-admin 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.870+0000 7fc7874139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7874139c0 time 2024-08-27T02:54:31.873505+0000 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc78aced2eb] 2024-08-27T02:54:31.870 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.871 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.871 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.871 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:54:31.871 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.871 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:54:31.871 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:54:31.871 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.876 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.876 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc789b6c520] 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc78aced345] 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.870+0000 7fc7874139c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc7874139c0 thread_name:radosgw-admin 2024-08-27T02:54:31.877 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc789b6c520] 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc78aced345] 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:54:31.878 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.401009s 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a164880 auth_method 0 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a163c70 auth_method 0 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.879 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a2d95c0 auth_method 0 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_done global_id 6497 payload 824 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:54:31.522+0000 7fc784718640 1 monclient: found mon.noname-c 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.880 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: dump: 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.881 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: dump: 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.882 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:54:31.522+0000 7fc672e0d640 4 set_mon_vals no callback set 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:54:31.522+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6497 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:54:31.522+0000 7fc7874139c0 1 librados: init done 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:54:31.526+0000 7fc67160a640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:54:31.526+0000 7fc67160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:54:31.526+0000 7fc67160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:54:31.526+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc66c070aa0 auth_method 0 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:54:31.526+0000 7fc78571a640 10 monclient: get_auth_request con 0x55815a30a340 auth_method 0 2024-08-27T02:54:31.883 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:54:31.526+0000 7fc784f19640 10 monclient: get_auth_request con 0x55815a321220 auth_method 0 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient: get_auth_request con 0x55815a3262b0 auth_method 0 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: build_initial_monmap 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:54:31.530+0000 7fc7874139c0 1 build_initial for_mkfs: 0 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: monmap: 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.884 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding auth protocol: cephx 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding auth protocol: cephx 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding auth protocol: cephx 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.885 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:54:31.530+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55815a32dc90 EEXIST 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: init 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding auth protocol: cephx 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding auth protocol: cephx 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding auth protocol: cephx 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.886 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:54:31.530+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:54:31.530+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55815a329340 EEXIST 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-c con 0x55815a351e40 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-a con 0x55815a351770 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-b con 0x55815a350150 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:54:31.887 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.410113s 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a351e40 auth_method 0 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a351770 auth_method 0 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.888 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a350150 auth_method 0 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_done global_id 6500 payload 824 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:54:31.530+0000 7fc784f19640 1 monclient: found mon.noname-c 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.889 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: dump: 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.890 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: dump: 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6500 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:54:31.530+0000 7fc785f1b640 4 set_mon_vals no callback set 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:54:31.534+0000 7fc66a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:54:31.534+0000 7fc66a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:54:31.534+0000 7fc66a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: get_monmap_and_config 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: build_initial_monmap 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:54:31.534+0000 7fc7874139c0 1 build_initial for_mkfs: 0 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc65c0709e0 auth_method 0 2024-08-27T02:54:31.892 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: monmap: 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding auth protocol: cephx 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding auth protocol: cephx 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding auth protocol: cephx 2024-08-27T02:54:31.893 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:54:31.534+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: init 2024-08-27T02:54:31.894 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding auth protocol: cephx 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding auth protocol: cephx 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding auth protocol: cephx 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.895 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:54:31.534+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:54:31.534+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command rotate-key cmddesc rotate-key hook 0x7ffc3ae2aea8 EEXIST 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-b con 0x55815a3a5c00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-a con 0x55815a3759e0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-c con 0x55815a3a1060 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.414419s 2024-08-27T02:54:31.896 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a3759e0 auth_method 0 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a3a1060 auth_method 0 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.897 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a3a5c00 auth_method 0 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_done global_id 6828 payload 274 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:54:31.534+0000 7fc784718640 1 monclient: found mon.noname-a 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: dump: 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.898 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.899 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: dump: 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.900 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6828 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: get_monmap_and_config success 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:54:31.534+0000 7fc7874139c0 4 set_mon_vals no callback set 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: shutdown 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: build_initial_monmap 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:54:31.534+0000 7fc7874139c0 1 build_initial for_mkfs: 0 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: monmap: 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.901 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding auth protocol: cephx 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding auth protocol: cephx 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding auth protocol: cephx 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.902 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:54:31.538+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: starting msgr at 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: starting objecter 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55815a3a1000 EEXIST 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: setting wanted keys 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: calling monclient init 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: init 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding auth protocol: cephx 2024-08-27T02:54:31.903 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding auth protocol: cephx 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding auth protocol: cephx 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.904 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:54:31.538+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:54:31.538+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55815a353da8 EEXIST 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-a con 0x55815a3759e0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-b con 0x55815a3a1060 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-c con 0x55815a3a5c00 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:54:31.905 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.416858s 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a3759e0 auth_method 0 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a3a5c00 auth_method 0 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.906 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a3a1060 auth_method 0 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_done global_id 6831 payload 824 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:54:31.538+0000 7fc784f19640 1 monclient: found mon.noname-a 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: dump: 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.907 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:54:31.908 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: dump: 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:54:31.538+0000 7fc65bfff640 4 set_mon_vals no callback set 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6831 2024-08-27T02:54:31.909 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: init done 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cr dump hook 0x55815a3a60b8 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:54:31.538+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:54:31.542+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc650070aa0 auth_method 0 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:54:31.542+0000 7fc78571a640 10 monclient: get_auth_request con 0x55815a3bf4e0 auth_method 0 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 realm 2024-08-27T02:54:31.910 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:54:31.542+0000 7fc7874139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:54:31.542+0000 7fc784f19640 10 monclient: get_auth_request con 0x55815a3c3780 auth_method 0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 searching for the correct realm 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:54:31.542+0000 7fc784718640 10 monclient: get_auth_request con 0x55815a3c8a40 auth_method 0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:54:31.546+0000 7fc78571a640 10 monclient: get_auth_request con 0x7fc778008050 auth_method 0 2024-08-27T02:54:31.911 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:54:31.546+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77c0c7040 auth_method 0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:54:31.546+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc77408fcf0 auth_method 0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:54:31.550+0000 7fc784718640 0 -- 172.21.15.143:0/99020648 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc77408fcf0 msgr2=0x7fc77407e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:54:31.550+0000 7fc65a7fc640 1 client.6831.objecter ms_handle_reset 0x7fc77408fcf0 session 0x7fc77406c6a0 osd.4 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:54:31.550+0000 7fc65a7fc640 10 monclient: _renew_subs 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:54:31.550+0000 7fc65a7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:54:31.550+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc650081140 auth_method 0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:54:31.550+0000 7fc78571a640 10 monclient: get_auth_request con 0x7fc77804bbc0 auth_method 0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:54:31.554+0000 7fc65a7fc640 1 client.6831.objecter ms_handle_reset 0x55815a3c3780 session 0x55815a3c3100 osd.5 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:54:31.554+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77408fcf0 auth_method 0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:54:31.554+0000 7fc784f19640 0 -- 172.21.15.143:0/99020648 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x7fc77408fcf0 msgr2=0x7fc650085e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:54:31.758+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77408fcf0 auth_method 0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:54:31.758+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77805c5f0 auth_method 0 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:31.912 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 zone default found 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:54:31.774+0000 7fc7874139c0 4 Realm: () 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:54:31.774+0000 7fc7874139c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:31.913 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:54:31.774+0000 7fc7874139c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:54:31.774+0000 7fc7874139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 zonegroup default 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 started sync module instance, tier type = 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=0 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=1 2024-08-27T02:54:31.914 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=2 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=3 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=4 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=5 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=6 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:54:31.806+0000 7fc7874139c0 20 add_watcher() i=7 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:54:31.806+0000 7fc7874139c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding auth protocol: cephx 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding auth protocol: cephx 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding auth protocol: cephx 2024-08-27T02:54:31.915 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:54:31.810+0000 7fc63afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:54:31.810+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.916 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache list hook 0x55815a39ece0 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache inspect hook 0x55815a39ece0 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache erase hook 0x55815a39ece0 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache zap hook 0x55815a39ece0 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 note: GC not initialized 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:54:31.810+0000 7fc639fe3640 20 reqs_thread_entry: start 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace show hook 0x7fc778062040 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace history hook 0x7fc778062040 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace active hook 0x7fc778062040 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace active_short hook 0x7fc778062040 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:31.917 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 Filter name: none 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:54:31.814+0000 7fc5ab7fe640 20 reqs_thread_entry: start 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : miss 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:54:31.918 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366232 cookie 94014053075168 notifier 6831 bl.length()=931 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:54:31.919 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:54:31.920 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:54:31.921 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:54:31.846+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:54:31.850+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:54:31.850+0000 7fc7874139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:54:31.922 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94014053075168 notifier 6831 bl.length()=931 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:54:31.923 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:54:31.870+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:54:31.870+0000 7fc7874139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7874139c0 time 2024-08-27T02:54:31.873505+0000 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc78aced2eb] 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.924 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:54:31.870+0000 7fc7874139c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc7874139c0 thread_name:radosgw-admin 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc789b6c520] 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc78aced345] 2024-08-27T02:54:31.925 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:54:31.926 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:54:31.927 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:54:31.928 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:54:31.929 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:54:31.930 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:54:31.931 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:54:31.932 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:54:31.933 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc5ab7fe640 / http_manager 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc639fe3640 / http_manager 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc63afe5640 / rgw_dt_lg_renew 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc65a7fc640 / ms_dispatch 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc65bfff640 / io_context_pool 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc66a7fc640 / ms_dispatch 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc67160a640 / ms_dispatch 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc672e0d640 / io_context_pool 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc784718640 / msgr-worker-2 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc784f19640 / msgr-worker-1 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc78571a640 / msgr-worker-0 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc785f1b640 / io_context_pool 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7874139c0 / radosgw-admin 2024-08-27T02:54:31.934 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.96249.log 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.401009s 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a164880 auth_method 0 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a163c70 auth_method 0 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.935 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:54:31.522+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a2d95c0 auth_method 0 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:54:31.522+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient(hunting): handle_auth_done global_id 6497 payload 824 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.936 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:54:31.522+0000 7fc784718640 1 monclient: found mon.noname-c 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:54:31.522+0000 7fc784718640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: dump: 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.937 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:54:31.522+0000 7fc67160a640 10 monclient: dump: 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:54:31.522+0000 7fc672e0d640 4 set_mon_vals no callback set 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:54:31.522+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6497 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:54:31.522+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:54:31.522+0000 7fc7874139c0 1 librados: init done 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:54:31.526+0000 7fc67160a640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:54:31.526+0000 7fc67160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:54:31.526+0000 7fc67160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:54:31.526+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc66c070aa0 auth_method 0 2024-08-27T02:54:31.939 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:54:31.526+0000 7fc78571a640 10 monclient: get_auth_request con 0x55815a30a340 auth_method 0 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:54:31.526+0000 7fc784f19640 10 monclient: get_auth_request con 0x55815a321220 auth_method 0 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient: get_auth_request con 0x55815a3262b0 auth_method 0 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: build_initial_monmap 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:54:31.530+0000 7fc7874139c0 1 build_initial for_mkfs: 0 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: monmap: 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:54:31.940 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding auth protocol: cephx 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding auth protocol: cephx 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding auth protocol: cephx 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.941 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: crc 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a32a240) adding con mode: secure 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:54:31.530+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55815a32dc90 EEXIST 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: init 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding auth protocol: cephx 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding auth protocol: cephx 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding auth protocol: cephx 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.942 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: crc 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 AuthRegistry(0x55815a3291f8) adding con mode: secure 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:54:31.530+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:54:31.530+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55815a329340 EEXIST 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:54:31.943 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-c con 0x55815a351e40 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-a con 0x55815a351770 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-b con 0x55815a350150 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.410113s 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a351e40 auth_method 0 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a351770 auth_method 0 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.944 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:54:31.530+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a350150 auth_method 0 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:54:31.530+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient(hunting): handle_auth_done global_id 6500 payload 824 2024-08-27T02:54:31.945 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:54:31.530+0000 7fc784f19640 1 monclient: found mon.noname-c 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:54:31.530+0000 7fc784f19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: dump: 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:54:31.530+0000 7fc66a7fc640 10 monclient: dump: 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.947 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:54:31.530+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6500 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:54:31.530+0000 7fc785f1b640 4 set_mon_vals no callback set 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:54:31.530+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:54:31.534+0000 7fc66a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:54:31.534+0000 7fc66a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:54:31.534+0000 7fc66a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: get_monmap_and_config 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: build_initial_monmap 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:54:31.534+0000 7fc7874139c0 1 build_initial for_mkfs: 0 2024-08-27T02:54:31.948 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc65c0709e0 auth_method 0 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: monmap: 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding auth protocol: cephx 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding auth protocol: cephx 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding auth protocol: cephx 2024-08-27T02:54:31.949 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: crc 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3717a0) adding con mode: secure 2024-08-27T02:54:31.950 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:54:31.534+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: init 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding auth protocol: cephx 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding auth protocol: cephx 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding auth protocol: cephx 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.951 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: crc 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2ad60) adding con mode: secure 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:54:31.534+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:54:31.534+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command rotate-key cmddesc rotate-key hook 0x7ffc3ae2aea8 EEXIST 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-b con 0x55815a3a5c00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-a con 0x55815a3759e0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-c con 0x55815a3a1060 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:54:31.952 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.414419s 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a3759e0 auth_method 0 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a3a1060 auth_method 0 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.953 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:54:31.534+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a3a5c00 auth_method 0 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:54:31.534+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient(hunting): handle_auth_done global_id 6828 payload 274 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:54:31.534+0000 7fc784718640 1 monclient: found mon.noname-a 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:54:31.534+0000 7fc784718640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: dump: 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.954 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:54:31.534+0000 7fc65bfff640 10 monclient: dump: 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6828 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: get_monmap_and_config success 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:54:31.534+0000 7fc7874139c0 4 set_mon_vals no callback set 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: shutdown 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: build_initial_monmap 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:54:31.534+0000 7fc7874139c0 1 build_initial for_mkfs: 0 2024-08-27T02:54:31.956 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:54:31.534+0000 7fc7874139c0 10 monclient: monmap: 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding auth protocol: cephx 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding auth protocol: cephx 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding auth protocol: cephx 2024-08-27T02:54:31.957 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: crc 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:54:31.534+0000 7fc7874139c0 5 AuthRegistry(0x55815a3767b0) adding con mode: secure 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:54:31.538+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: starting msgr at 2024-08-27T02:54:31.958 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: starting objecter 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command objecter_requests cmddesc objecter_requests hook 0x55815a3a1000 EEXIST 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: setting wanted keys 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: calling monclient init 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: init 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding auth protocol: cephx 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding auth protocol: cephx 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding auth protocol: cephx 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.959 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: crc 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 AuthRegistry(0x55815a353c60) adding con mode: secure 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:54:31.538+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:54:31.538+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command rotate-key cmddesc rotate-key hook 0x55815a353da8 EEXIST 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-a con 0x55815a3759e0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-b con 0x55815a3a1060 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): picked mon.noname-c con 0x55815a3a5c00 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:54:31.960 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient(hunting): authenticate will time out at 2404.416858s 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): get_auth_request con 0x55815a3759e0 auth_method 0 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): get_auth_request con 0x55815a3a5c00 auth_method 0 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.961 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:54:31.538+0000 7fc78571a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): get_auth_request con 0x55815a3a1060 auth_method 0 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:54:31.538+0000 7fc784718640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient(hunting): handle_auth_done global_id 6831 payload 824 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient: _finish_hunting 0 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:54:31.538+0000 7fc784f19640 1 monclient: found mon.noname-a 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:54:31.538+0000 7fc784f19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.962 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: dump: 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: _finish_auth 0 2024-08-27T02:54:31.963 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: _check_auth_tickets 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 10 monclient: dump: 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.964 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:54:31.538+0000 7fc65bfff640 4 set_mon_vals no callback set 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 monclient: authenticate success, global_id 6831 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _renew_subs 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:54:31.538+0000 7fc7874139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:54:31.538+0000 7fc7874139c0 1 librados: init done 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:54:31.538+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cr dump hook 0x55815a3a60b8 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:54:31.538+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:54:31.538+0000 7fc65a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:54:31.542+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc650070aa0 auth_method 0 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:54:31.542+0000 7fc78571a640 10 monclient: get_auth_request con 0x55815a3bf4e0 auth_method 0 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.965 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 realm 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:54:31.542+0000 7fc7874139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:54:31.542+0000 7fc784f19640 10 monclient: get_auth_request con 0x55815a3c3780 auth_method 0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:54:31.542+0000 7fc7874139c0 20 searching for the correct realm 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:54:31.542+0000 7fc784718640 10 monclient: get_auth_request con 0x55815a3c8a40 auth_method 0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:54:31.546+0000 7fc78571a640 10 monclient: get_auth_request con 0x7fc778008050 auth_method 0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:54:31.546+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77c0c7040 auth_method 0 2024-08-27T02:54:31.966 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:54:31.546+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc77408fcf0 auth_method 0 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:54:31.550+0000 7fc784718640 0 -- 172.21.15.143:0/99020648 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc77408fcf0 msgr2=0x7fc77407e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:54:31.550+0000 7fc65a7fc640 1 client.6831.objecter ms_handle_reset 0x7fc77408fcf0 session 0x7fc77406c6a0 osd.4 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:54:31.550+0000 7fc65a7fc640 10 monclient: _renew_subs 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:54:31.550+0000 7fc65a7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:54:31.550+0000 7fc784718640 10 monclient: get_auth_request con 0x7fc650081140 auth_method 0 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:54:31.550+0000 7fc78571a640 10 monclient: get_auth_request con 0x7fc77804bbc0 auth_method 0 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:54:31.554+0000 7fc65a7fc640 1 client.6831.objecter ms_handle_reset 0x55815a3c3780 session 0x55815a3c3100 osd.5 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:54:31.554+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77408fcf0 auth_method 0 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:54:31.554+0000 7fc784f19640 0 -- 172.21.15.143:0/99020648 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x7fc77408fcf0 msgr2=0x7fc650085e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:54:31.758+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77408fcf0 auth_method 0 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:54:31.758+0000 7fc784f19640 10 monclient: get_auth_request con 0x7fc77805c5f0 auth_method 0 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:31.967 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 zone default found 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:54:31.774+0000 7fc7874139c0 4 Realm: () 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:54:31.774+0000 7fc7874139c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:54:31.774+0000 7fc7874139c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:31.968 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:54:31.774+0000 7fc7874139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 zonegroup default 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:54:31.774+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 started sync module instance, tier type = 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:54:31.778+0000 7fc7874139c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=0 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=1 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=2 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=3 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=4 2024-08-27T02:54:31.969 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=5 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:54:31.802+0000 7fc7874139c0 20 add_watcher() i=6 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:54:31.806+0000 7fc7874139c0 20 add_watcher() i=7 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:54:31.806+0000 7fc7874139c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding auth protocol: cephx 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding auth protocol: cephx 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding auth protocol: cephx 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.970 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:54:31.810+0000 7fc63afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: crc 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 AuthRegistry(0x7ffc3ae2b240) adding con mode: secure 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:54:31.810+0000 7fc7874139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache list hook 0x55815a39ece0 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache inspect hook 0x55815a39ece0 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache erase hook 0x55815a39ece0 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command cache zap hook 0x55815a39ece0 2024-08-27T02:54:31.971 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 note: GC not initialized 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:54:31.810+0000 7fc639fe3640 20 reqs_thread_entry: start 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace show hook 0x7fc778062040 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace history hook 0x7fc778062040 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace active hook 0x7fc778062040 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:54:31.810+0000 7fc7874139c0 5 asok(0x55815a0cb280) register_command sync trace active_short hook 0x7fc778062040 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:54:31.810+0000 7fc7874139c0 20 Filter name: none 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:54:31.814+0000 7fc5ab7fe640 20 reqs_thread_entry: start 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-27T02:54:31.972 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : miss 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:54:31.814+0000 7fc7874139c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:54:31.814+0000 7fc7874139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.973 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:54:31.826+0000 7fc7874139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366232 cookie 94014053075168 notifier 6831 bl.length()=931 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:54:31.826+0000 7fc65bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:54:31.826+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:54:31.974 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:54:31.975 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:54:31.838+0000 7fc7874139c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:54:31.976 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:54:31.838+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:54:31.842+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:54:31.846+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:54:31.850+0000 7fc7874139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : hit (requested=0x17, cached=0x17) 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:54:31.850+0000 7fc7874139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:54:31.854+0000 7fc7874139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:54:31.977 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94014053075168 notifier 6831 bl.length()=931 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:54:31.854+0000 7fc65bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:54:31.858+0000 7fc7874139c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:54:31.862+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:54:31.978 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:54:31.866+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:54:31.870+0000 7fc7874139c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:54:31.870+0000 7fc7874139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7874139c0 time 2024-08-27T02:54:31.873505+0000 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc78aced2eb] 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.979 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:54:31.870+0000 7fc7874139c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc7874139c0 thread_name:radosgw-admin 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc789b6c520] 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:54:31.980 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc78aced345] 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc78aced49f] 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558158d4eb11] 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x558158d64437] 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc789b53d90] 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:54:31.981 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:54:31.982 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:54:31.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:54:31.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:54:31.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:54:31.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:54:31.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc5ab7fe640 / http_manager 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc639fe3640 / http_manager 2024-08-27T02:54:31.988 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc63afe5640 / rgw_dt_lg_renew 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc65a7fc640 / ms_dispatch 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc65bfff640 / io_context_pool 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc66a7fc640 / ms_dispatch 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc67160a640 / ms_dispatch 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc672e0d640 / io_context_pool 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc784718640 / msgr-worker-2 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc784f19640 / msgr-worker-1 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc78571a640 / msgr-worker-0 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc785f1b640 / io_context_pool 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7874139c0 / radosgw-admin 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:54:31.989 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:54:31.876096Z_c5626b82-5be1-4a6e-bcb4-029e64ae86e4/log 2024-08-27T02:54:31.990 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:54:31.992 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:54:31.992 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.954+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 realm 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.958+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.962+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.962+0000 7fa3f622c9c0 20 searching for the correct realm 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.966+0000 7fa3f3531640 0 -- 172.21.15.143:0/2259732451 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x55a8c989ddc0 msgr2=0x55a8c98a01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.970+0000 7fa3f3d32640 0 -- 172.21.15.143:0/2259732451 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fa3e80443d0 msgr2=0x7fa3e8044830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.978+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 zone default found 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 4 Realm: () 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 zonegroup default 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 started sync module instance, tier type = 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.982+0000 7fa3f622c9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=0 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=1 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=2 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=3 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=4 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=5 2024-08-27T02:54:31.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=6 2024-08-27T02:54:31.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 20 add_watcher() i=7 2024-08-27T02:54:31.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:31.998+0000 7fa3f622c9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:54:31.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:32.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:54:32.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:54:32.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 5 note: GC not initialized 2024-08-27T02:54:32.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa2a8fe1640 20 reqs_thread_entry: start 2024-08-27T02:54:32.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:54:32.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 Filter name: none 2024-08-27T02:54:32.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa2227fc640 20 reqs_thread_entry: start 2024-08-27T02:54:32.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:32.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:32.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:32.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:54:32.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:32.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:32.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:54:32.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:54:32.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:54:32.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.002+0000 7fa3f622c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:54:32.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.006+0000 7fa2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:54:32.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.010+0000 7fa3f622c9c0 20 remove_watcher() i=0 2024-08-27T02:54:32.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.010+0000 7fa3f622c9c0 2 removed watcher, disabling cache 2024-08-27T02:54:32.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.014+0000 7fa3f622c9c0 20 remove_watcher() i=1 2024-08-27T02:54:32.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.014+0000 7fa3f622c9c0 20 remove_watcher() i=2 2024-08-27T02:54:32.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.018+0000 7fa3f622c9c0 20 remove_watcher() i=3 2024-08-27T02:54:32.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.018+0000 7fa3f622c9c0 20 remove_watcher() i=4 2024-08-27T02:54:32.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.022+0000 7fa3f622c9c0 20 remove_watcher() i=5 2024-08-27T02:54:32.020 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.022+0000 7fa3f622c9c0 20 remove_watcher() i=6 2024-08-27T02:54:32.022 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:54:32.022+0000 7fa3f622c9c0 20 remove_watcher() i=7 2024-08-27T02:54:32.035 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:54:32.035 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:54:32.035 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:54:32.035 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:02.433 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:55:02.469 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:02.469 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:02.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.513+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 realm 2024-08-27T02:55:02.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:02.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:02.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:02.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.517+0000 7f5d92b749c0 20 searching for the correct realm 2024-08-27T02:55:02.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.525+0000 7f5d90e7b640 0 -- 172.21.15.143:0/37930523 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f5d8403d3d0 msgr2=0x7f5d8403d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:02.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.741+0000 7f5d9067a640 0 -- 172.21.15.143:0/37930523 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55efe2682bf0 msgr2=0x55efe2685000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:02.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:02.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:02.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:02.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:02.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:02.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:02.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:02.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.749+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 zone default found 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 4 Realm: () 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 zonegroup default 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 started sync module instance, tier type = 2024-08-27T02:55:02.754 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.753+0000 7f5d92b749c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:02.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.777+0000 7f5d92b749c0 20 add_watcher() i=0 2024-08-27T02:55:02.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.777+0000 7f5d92b749c0 20 add_watcher() i=1 2024-08-27T02:55:02.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.777+0000 7f5d92b749c0 20 add_watcher() i=2 2024-08-27T02:55:02.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.777+0000 7f5d92b749c0 20 add_watcher() i=3 2024-08-27T02:55:02.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.777+0000 7f5d92b749c0 20 add_watcher() i=4 2024-08-27T02:55:02.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.777+0000 7f5d92b749c0 20 add_watcher() i=5 2024-08-27T02:55:02.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.777+0000 7f5d92b749c0 20 add_watcher() i=6 2024-08-27T02:55:02.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.781+0000 7f5d92b749c0 20 add_watcher() i=7 2024-08-27T02:55:02.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.781+0000 7f5d92b749c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:02.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5c46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:02.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5d92b749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:02.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5d92b749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:02.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5d92b749c0 5 note: GC not initialized 2024-08-27T02:55:02.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5c45fdb640 20 reqs_thread_entry: start 2024-08-27T02:55:02.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5d92b749c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:02.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5d92b749c0 20 Filter name: none 2024-08-27T02:55:02.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5bb77fe640 20 reqs_thread_entry: start 2024-08-27T02:55:02.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5d92b749c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-08-27T02:55:02.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.785+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:55:02.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-08-27T02:55:02.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-08-27T02:55:02.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : miss 2024-08-27T02:55:02.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:55:02.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:55:02.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:55:02.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:02.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:02.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.789+0000 7f5d92b749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:55:02.798 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.797+0000 7f5d92b749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:55:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.797+0000 7f5d92b749c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:55:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.797+0000 7f5d92b749c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.797+0000 7f5d92b749c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:55:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5c677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366235 cookie 94488784072080 notifier 6542 bl.length()=931 2024-08-27T02:55:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5c677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:55:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5c677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:55:02.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5c677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:02.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:55:02.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:55:02.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:55:02.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.801+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:55:02.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:55:02.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.0 2024-08-27T02:55:02.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:55:02.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.1 2024-08-27T02:55:02.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:55:02.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.2 2024-08-27T02:55:02.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:55:02.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.3 2024-08-27T02:55:02.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:55:02.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.4 2024-08-27T02:55:02.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:55:02.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.5 2024-08-27T02:55:02.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.6 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.7 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.8 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.9 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.10 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1.11 2024-08-27T02:55:02.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:55:02.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:55:02.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:55:02.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:55:02.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.813+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:55:02.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.817+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:55:02.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.817+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:55:02.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.817+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:55:02.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.817+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:55:02.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.821+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:55:02.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.821+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:55:02.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.829+0000 7f5d92b749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:02.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.829+0000 7f5d92b749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:55:02.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.829+0000 7f5d92b749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:55:02.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.829+0000 7f5d92b749c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:55:02.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.829+0000 7f5d92b749c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:02.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.829+0000 7f5d92b749c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:55:02.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5c66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94488784072080 notifier 6542 bl.length()=931 2024-08-27T02:55:02.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5c66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:55:02.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5c66ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:55:02.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5c66ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:02.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:55:02.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:55:02.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:55:02.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.833+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:55:02.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.837+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.0 2024-08-27T02:55:02.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.837+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.1 2024-08-27T02:55:02.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.837+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.2 2024-08-27T02:55:02.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.841+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.3 2024-08-27T02:55:02.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.841+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.4 2024-08-27T02:55:02.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.841+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.5 2024-08-27T02:55:02.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.841+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.6 2024-08-27T02:55:02.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.841+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.7 2024-08-27T02:55:02.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.841+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.8 2024-08-27T02:55:02.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.841+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.9 2024-08-27T02:55:02.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5d92b749c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26.10 2024-08-27T02:55:02.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5d92b749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:02.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5d92b749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 2024-08-27T02:55:02.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5d92b749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:55:02.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5d92b749c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:55:02.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5d92b749c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:02.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5d92b749c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26, ofs0, ns] 2024-08-27T02:55:02.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5c66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366237 cookie 94488784072080 notifier 6542 bl.length()=899 2024-08-27T02:55:02.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5c66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 info.flags=0x17 2024-08-27T02:55:02.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5c66ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 to cache LRU end 2024-08-27T02:55:02.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.845+0000 7f5c66ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:02.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.849+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_sources= new_sources= 2024-08-27T02:55:02.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.849+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential sources added=[] removed=[] 2024-08-27T02:55:02.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.849+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): orig_dests= new_dests= 2024-08-27T02:55:02.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.849+0000 7f5d92b749c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26]): potential dests added=[] removed=[] 2024-08-27T02:55:02.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.853+0000 7f5d92b749c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-08-27T02:55:02.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.857+0000 7f5c46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:02.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.861+0000 7f5d92b749c0 20 remove_watcher() i=0 2024-08-27T02:55:02.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.861+0000 7f5d92b749c0 2 removed watcher, disabling cache 2024-08-27T02:55:02.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.861+0000 7f5d92b749c0 20 remove_watcher() i=1 2024-08-27T02:55:02.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.865+0000 7f5d92b749c0 20 remove_watcher() i=2 2024-08-27T02:55:02.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.869+0000 7f5d92b749c0 20 remove_watcher() i=3 2024-08-27T02:55:02.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.869+0000 7f5d92b749c0 20 remove_watcher() i=4 2024-08-27T02:55:02.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.873+0000 7f5d92b749c0 20 remove_watcher() i=5 2024-08-27T02:55:02.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.873+0000 7f5d92b749c0 20 remove_watcher() i=6 2024-08-27T02:55:02.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.873+0000 7f5d92b749c0 20 remove_watcher() i=7 2024-08-27T02:55:02.893 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-08-27T02:55:02.921 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:02.921 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:02.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.965+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.965+0000 7f112ee939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.965+0000 7f112ee939c0 20 realm 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.965+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.965+0000 7f112ee939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.965+0000 7f112ee939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.965+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.969+0000 7f112ee939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:02.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.969+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.969+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:02.968 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.969+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:02.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.969+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:02.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.969+0000 7f112ee939c0 20 searching for the correct realm 2024-08-27T02:55:02.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:02.977+0000 7f112d19a640 0 -- 172.21.15.143:0/919380359 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f1120133040 msgr2=0x7f1120103680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:03.194 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.193+0000 7f112c999640 0 -- 172.21.15.143:0/919380359 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55976a9ae450 msgr2=0x55976a9b0840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:03.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:03.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:03.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:03.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:03.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:03.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:03.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:03.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.201+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:03.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 zone default found 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 4 Realm: () 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 zonegroup default 2024-08-27T02:55:03.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:03.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:03.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:03.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 started sync module instance, tier type = 2024-08-27T02:55:03.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.205+0000 7f112ee939c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:03.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.229+0000 7f112ee939c0 20 add_watcher() i=0 2024-08-27T02:55:03.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.229+0000 7f112ee939c0 20 add_watcher() i=1 2024-08-27T02:55:03.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.229+0000 7f112ee939c0 20 add_watcher() i=2 2024-08-27T02:55:03.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.229+0000 7f112ee939c0 20 add_watcher() i=3 2024-08-27T02:55:03.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.229+0000 7f112ee939c0 20 add_watcher() i=4 2024-08-27T02:55:03.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.229+0000 7f112ee939c0 20 add_watcher() i=5 2024-08-27T02:55:03.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.229+0000 7f112ee939c0 20 add_watcher() i=6 2024-08-27T02:55:03.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.233+0000 7f112ee939c0 20 add_watcher() i=7 2024-08-27T02:55:03.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.233+0000 7f112ee939c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:03.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f0fe2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:03.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:03.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:03.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 5 note: GC not initialized 2024-08-27T02:55:03.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f0fe1fe3640 20 reqs_thread_entry: start 2024-08-27T02:55:03.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:03.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 20 Filter name: none 2024-08-27T02:55:03.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f0f537fe640 20 reqs_thread_entry: start 2024-08-27T02:55:03.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:55:03.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.237+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.241+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:55:03.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.241+0000 7f112ee939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:03.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.241+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.241+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:55:03.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.241+0000 7f112ee939c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:03.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.241+0000 7f112ee939c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:55:03.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.241+0000 7f112ee939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:03.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.245+0000 7f0fe2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:03.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.249+0000 7f112ee939c0 20 remove_watcher() i=0 2024-08-27T02:55:03.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.249+0000 7f112ee939c0 2 removed watcher, disabling cache 2024-08-27T02:55:03.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.253+0000 7f112ee939c0 20 remove_watcher() i=1 2024-08-27T02:55:03.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.253+0000 7f112ee939c0 20 remove_watcher() i=2 2024-08-27T02:55:03.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.257+0000 7f112ee939c0 20 remove_watcher() i=3 2024-08-27T02:55:03.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.261+0000 7f112ee939c0 20 remove_watcher() i=4 2024-08-27T02:55:03.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.261+0000 7f112ee939c0 20 remove_watcher() i=5 2024-08-27T02:55:03.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.265+0000 7f112ee939c0 20 remove_watcher() i=6 2024-08-27T02:55:03.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:03.265+0000 7f112ee939c0 20 remove_watcher() i=7 2024-08-27T02:55:03.289 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:03.289 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:03.289 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-commit-target-layout id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:55:03.289 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:04.225 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-08-27T02:55:04.225 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:06.437 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-08-27T02:55:06.471 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:06.472 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:06.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.717+0000 7f05b7bed640 0 --2- 172.21.15.143:0/1232222851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a220df5d30 0x55a220e11ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-27T02:55:06.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.721+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:06.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 realm 2024-08-27T02:55:06.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:06.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:06.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:06.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:06.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:06.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.725+0000 7f05ba8e89c0 20 searching for the correct realm 2024-08-27T02:55:06.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.729+0000 7f05b83ee640 0 -- 172.21.15.143:0/1232222851 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f05b0060620 msgr2=0x7f05b005f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:06.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.941+0000 7f05b8bef640 0 -- 172.21.15.143:0/1232222851 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f05ac0e3990 msgr2=0x7f05ac0e1430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:06.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:06.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:06.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:06.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:06.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.957+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:06.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:06.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 zone default found 2024-08-27T02:55:06.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 4 Realm: () 2024-08-27T02:55:06.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:06.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:06.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:06.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 zonegroup default 2024-08-27T02:55:06.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:06.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:06.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:06.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:06.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 started sync module instance, tier type = 2024-08-27T02:55:06.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.961+0000 7f05ba8e89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:06.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=0 2024-08-27T02:55:06.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=1 2024-08-27T02:55:06.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=2 2024-08-27T02:55:06.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=3 2024-08-27T02:55:06.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=4 2024-08-27T02:55:06.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=5 2024-08-27T02:55:06.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=6 2024-08-27T02:55:06.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 20 add_watcher() i=7 2024-08-27T02:55:06.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.993+0000 7f05ba8e89c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:06.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.997+0000 7f046e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:06.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.997+0000 7f05ba8e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:06.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:06.997+0000 7f05ba8e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:06.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 5 note: GC not initialized 2024-08-27T02:55:07.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f046d7e2640 20 reqs_thread_entry: start 2024-08-27T02:55:07.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:07.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 Filter name: none 2024-08-27T02:55:07.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f03deffd640 20 reqs_thread_entry: start 2024-08-27T02:55:07.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:07.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:07.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:07.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:07.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.001+0000 7f05ba8e89c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.005+0000 7f05ba8e89c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:07.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.005+0000 7f05ba8e89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:07.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.005+0000 7f046e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:07.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.013+0000 7f05ba8e89c0 20 remove_watcher() i=0 2024-08-27T02:55:07.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.013+0000 7f05ba8e89c0 2 removed watcher, disabling cache 2024-08-27T02:55:07.019 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.021+0000 7f05ba8e89c0 20 remove_watcher() i=1 2024-08-27T02:55:07.021 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.021+0000 7f05ba8e89c0 20 remove_watcher() i=2 2024-08-27T02:55:07.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.025+0000 7f05ba8e89c0 20 remove_watcher() i=3 2024-08-27T02:55:07.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.029+0000 7f05ba8e89c0 20 remove_watcher() i=4 2024-08-27T02:55:07.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.033+0000 7f05ba8e89c0 20 remove_watcher() i=5 2024-08-27T02:55:07.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.037+0000 7f05ba8e89c0 20 remove_watcher() i=6 2024-08-27T02:55:07.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.037+0000 7f05ba8e89c0 20 remove_watcher() i=7 2024-08-27T02:55:07.051 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:07.051 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:07.052 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-do-reshard id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:07.052 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:07.052 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-08-27T02:55:07.089 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:07.089 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:07.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 realm 2024-08-27T02:55:07.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:07.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.133+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.137+0000 7f5352b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:07.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.137+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.137+0000 7f5352b4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:07.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.137+0000 7f5352b4f9c0 20 searching for the correct realm 2024-08-27T02:55:07.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.145+0000 7f5350e56640 0 -- 172.21.15.143:0/59945636 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x559a9ba64e20 msgr2=0x559a9ba67290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:07.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.149+0000 7f534fe54640 0 -- 172.21.15.143:0/59945636 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f5340111970 msgr2=0x7f53400ff8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:07.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:07.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:07.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:07.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:07.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:07.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:07.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.157 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 zone default found 2024-08-27T02:55:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 4 Realm: () 2024-08-27T02:55:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:07.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:07.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:07.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 zonegroup default 2024-08-27T02:55:07.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 started sync module instance, tier type = 2024-08-27T02:55:07.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.157+0000 7f5352b4f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:07.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=0 2024-08-27T02:55:07.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=1 2024-08-27T02:55:07.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=2 2024-08-27T02:55:07.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=3 2024-08-27T02:55:07.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=4 2024-08-27T02:55:07.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=5 2024-08-27T02:55:07.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=6 2024-08-27T02:55:07.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 20 add_watcher() i=7 2024-08-27T02:55:07.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.177+0000 7f5352b4f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:07.179 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5206fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:07.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:07.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:07.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 5 note: GC not initialized 2024-08-27T02:55:07.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5205fdb640 20 reqs_thread_entry: start 2024-08-27T02:55:07.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:07.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 Filter name: none 2024-08-27T02:55:07.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f51777fe640 20 reqs_thread_entry: start 2024-08-27T02:55:07.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-08-27T02:55:07.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:07.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-08-27T02:55:07.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 : miss 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.181+0000 7f5352b4f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 2024-08-27T02:55:07.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f5352b4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f5352b4f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f5352b4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f5352b4f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27, ofs0, ns] 2024-08-27T02:55:07.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f52277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94122524748960 notifier 6924 bl.length()=911 2024-08-27T02:55:07.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f52277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f52277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.189+0000 7f52277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.193+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_sources= new_sources= 2024-08-27T02:55:07.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.193+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential sources added=[] removed=[] 2024-08-27T02:55:07.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.193+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_dests= new_dests= 2024-08-27T02:55:07.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.193+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential dests added=[] removed=[] 2024-08-27T02:55:07.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.201+0000 7f5352b4f9c0 -1 Injecting error=-5 at location=do_reshard 2024-08-27T02:55:07.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f5352b4f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:07.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f5352b4f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 2024-08-27T02:55:07.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f5352b4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f5352b4f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f5352b4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f5352b4f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27, ofs0, ns] 2024-08-27T02:55:07.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f52277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94122524748960 notifier 6924 bl.length()=879 2024-08-27T02:55:07.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f52277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f52277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.217+0000 7f52277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.221+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_sources= new_sources= 2024-08-27T02:55:07.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.221+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential sources added=[] removed=[] 2024-08-27T02:55:07.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.221+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_dests= new_dests= 2024-08-27T02:55:07.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.221+0000 7f5352b4f9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential dests added=[] removed=[] 2024-08-27T02:55:07.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.221+0000 7f5352b4f9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-08-27T02:55:07.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.221+0000 7f5206fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:07.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.225+0000 7f5352b4f9c0 20 remove_watcher() i=0 2024-08-27T02:55:07.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.225+0000 7f5352b4f9c0 2 removed watcher, disabling cache 2024-08-27T02:55:07.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.229+0000 7f5352b4f9c0 20 remove_watcher() i=1 2024-08-27T02:55:07.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.229+0000 7f5352b4f9c0 20 remove_watcher() i=2 2024-08-27T02:55:07.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.233+0000 7f5352b4f9c0 20 remove_watcher() i=3 2024-08-27T02:55:07.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.233+0000 7f5352b4f9c0 20 remove_watcher() i=4 2024-08-27T02:55:07.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.237+0000 7f5352b4f9c0 20 remove_watcher() i=5 2024-08-27T02:55:07.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.237+0000 7f5352b4f9c0 20 remove_watcher() i=6 2024-08-27T02:55:07.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.237+0000 7f5352b4f9c0 20 remove_watcher() i=7 2024-08-27T02:55:07.251 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-08-27T02:55:07.277 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:07.277 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:07.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.317+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 realm 2024-08-27T02:55:07.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:07.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:07.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:07.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.321+0000 7f851e2509c0 20 searching for the correct realm 2024-08-27T02:55:07.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.329+0000 7f851b555640 0 -- 172.21.15.143:0/1955766792 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f851401a040 msgr2=0x7f851405b260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:07.336 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.337+0000 7f851b555640 0 -- 172.21.15.143:0/1955766792 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f83e4081170 msgr2=0x7f83e40835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.343 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.341+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:07.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 zone default found 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 4 Realm: () 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 zonegroup default 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 started sync module instance, tier type = 2024-08-27T02:55:07.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.345+0000 7f851e2509c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=0 2024-08-27T02:55:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=1 2024-08-27T02:55:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=2 2024-08-27T02:55:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=3 2024-08-27T02:55:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=4 2024-08-27T02:55:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=5 2024-08-27T02:55:07.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=6 2024-08-27T02:55:07.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 20 add_watcher() i=7 2024-08-27T02:55:07.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.361+0000 7f851e2509c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:07.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f83d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 5 note: GC not initialized 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f83d0fe1640 20 reqs_thread_entry: start 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 Filter name: none 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f834a7fc640 20 reqs_thread_entry: start 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:07.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:07.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:07.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:07.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.365+0000 7f851e2509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:07.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.369+0000 7f83d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:07.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.373+0000 7f851e2509c0 20 remove_watcher() i=0 2024-08-27T02:55:07.373 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.373+0000 7f851e2509c0 2 removed watcher, disabling cache 2024-08-27T02:55:07.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.377+0000 7f851e2509c0 20 remove_watcher() i=1 2024-08-27T02:55:07.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.377+0000 7f851e2509c0 20 remove_watcher() i=2 2024-08-27T02:55:07.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.381+0000 7f851e2509c0 20 remove_watcher() i=3 2024-08-27T02:55:07.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.381+0000 7f851e2509c0 20 remove_watcher() i=4 2024-08-27T02:55:07.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.381+0000 7f851e2509c0 20 remove_watcher() i=5 2024-08-27T02:55:07.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.385+0000 7f851e2509c0 20 remove_watcher() i=6 2024-08-27T02:55:07.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.385+0000 7f851e2509c0 20 remove_watcher() i=7 2024-08-27T02:55:07.398 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:07.398 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:07.398 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-do-reshard id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:07.398 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:07.497 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:55:07.531 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:07.531 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:07.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.573+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 realm 2024-08-27T02:55:07.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:07.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:07.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:07.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.577+0000 7f35877349c0 20 searching for the correct realm 2024-08-27T02:55:07.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.585+0000 7f3584a39640 0 -- 172.21.15.143:0/3681998819 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x560eef223d70 msgr2=0x560eef226230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:07.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.589+0000 7f358523a640 0 -- 172.21.15.143:0/3681998819 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f357c0c4ba0 msgr2=0x7f357c001000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:07.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:07.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:07.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:07.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:07.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 zone default found 2024-08-27T02:55:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 4 Realm: () 2024-08-27T02:55:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:07.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 zonegroup default 2024-08-27T02:55:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.597+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.601+0000 7f35877349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.601+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.601+0000 7f35877349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.601+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.601+0000 7f35877349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.601+0000 7f35877349c0 20 started sync module instance, tier type = 2024-08-27T02:55:07.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.601+0000 7f35877349c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.613+0000 7f35877349c0 20 add_watcher() i=0 2024-08-27T02:55:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.613+0000 7f35877349c0 20 add_watcher() i=1 2024-08-27T02:55:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.613+0000 7f35877349c0 20 add_watcher() i=2 2024-08-27T02:55:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.613+0000 7f35877349c0 20 add_watcher() i=3 2024-08-27T02:55:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.613+0000 7f35877349c0 20 add_watcher() i=4 2024-08-27T02:55:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.613+0000 7f35877349c0 20 add_watcher() i=5 2024-08-27T02:55:07.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.613+0000 7f35877349c0 20 add_watcher() i=6 2024-08-27T02:55:07.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.617+0000 7f35877349c0 20 add_watcher() i=7 2024-08-27T02:55:07.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.617+0000 7f35877349c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:07.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.617+0000 7f343b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.617+0000 7f35877349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.617+0000 7f35877349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.617+0000 7f35877349c0 5 note: GC not initialized 2024-08-27T02:55:07.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f343a7e4640 20 reqs_thread_entry: start 2024-08-27T02:55:07.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:07.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 20 Filter name: none 2024-08-27T02:55:07.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f33abfff640 20 reqs_thread_entry: start 2024-08-27T02:55:07.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-08-27T02:55:07.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 : miss 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:07.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.621+0000 7f35877349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f35877349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f35877349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f35877349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f35877349c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27, ofs0, ns] 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f3457fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 94622141545392 notifier 6629 bl.length()=911 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f3457fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f3457fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.629+0000 7f3457fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.633+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_sources= new_sources= 2024-08-27T02:55:07.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.633+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential sources added=[] removed=[] 2024-08-27T02:55:07.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.633+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_dests= new_dests= 2024-08-27T02:55:07.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.633+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential dests added=[] removed=[] 2024-08-27T02:55:07.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.0 2024-08-27T02:55:07.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.0 2024-08-27T02:55:07.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.1 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.1 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.2 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.2 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.3 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.3 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.4 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.4 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.5 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.5 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.6 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.6 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.7 2024-08-27T02:55:07.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.7 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.8 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.8 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.9 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.9 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.10 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.10 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.11 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1.11 2024-08-27T02:55:07.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.0 2024-08-27T02:55:07.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1 2024-08-27T02:55:07.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.2 2024-08-27T02:55:07.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.645+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.3 2024-08-27T02:55:07.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.649+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.4 2024-08-27T02:55:07.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.649+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.5 2024-08-27T02:55:07.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.649+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.6 2024-08-27T02:55:07.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.653+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.7 2024-08-27T02:55:07.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.653+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.8 2024-08-27T02:55:07.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.653+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.9 2024-08-27T02:55:07.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.653+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.10 2024-08-27T02:55:07.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.661+0000 7f35877349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:07.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.661+0000 7f35877349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27, ofs0, ns] 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f3468ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94622141545392 notifier 6629 bl.length()=911 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f3468ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f3468ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f3468ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_sources= new_sources= 2024-08-27T02:55:07.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential sources added=[] removed=[] 2024-08-27T02:55:07.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_dests= new_dests= 2024-08-27T02:55:07.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.665+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential dests added=[] removed=[] 2024-08-27T02:55:07.673 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.673+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.0 2024-08-27T02:55:07.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.673+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.1 2024-08-27T02:55:07.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.673+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.2 2024-08-27T02:55:07.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.677+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.3 2024-08-27T02:55:07.676 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.677+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.4 2024-08-27T02:55:07.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.677+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.5 2024-08-27T02:55:07.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.677+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.6 2024-08-27T02:55:07.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.677+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.7 2024-08-27T02:55:07.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.677+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.8 2024-08-27T02:55:07.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.681+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.9 2024-08-27T02:55:07.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.681+0000 7f35877349c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27.10 2024-08-27T02:55:07.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.681+0000 7f35877349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:07.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.681+0000 7f35877349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 2024-08-27T02:55:07.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f35877349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f35877349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f35877349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f35877349c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27, ofs0, ns] 2024-08-27T02:55:07.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f3468ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94622141545392 notifier 6629 bl.length()=879 2024-08-27T02:55:07.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f3468ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 info.flags=0x17 2024-08-27T02:55:07.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f3468ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 to cache LRU end 2024-08-27T02:55:07.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.685+0000 7f3468ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:07.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.689+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_sources= new_sources= 2024-08-27T02:55:07.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.689+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential sources added=[] removed=[] 2024-08-27T02:55:07.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.689+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): orig_dests= new_dests= 2024-08-27T02:55:07.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.689+0000 7f35877349c0 20 handle_bi_update(): bucket=:error-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27]): potential dests added=[] removed=[] 2024-08-27T02:55:07.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.693+0000 7f35877349c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-08-27T02:55:07.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.697+0000 7f343b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:07.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.701+0000 7f35877349c0 20 remove_watcher() i=0 2024-08-27T02:55:07.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.701+0000 7f35877349c0 2 removed watcher, disabling cache 2024-08-27T02:55:07.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.701+0000 7f35877349c0 20 remove_watcher() i=1 2024-08-27T02:55:07.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.705+0000 7f35877349c0 20 remove_watcher() i=2 2024-08-27T02:55:07.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.705+0000 7f35877349c0 20 remove_watcher() i=3 2024-08-27T02:55:07.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.709+0000 7f35877349c0 20 remove_watcher() i=4 2024-08-27T02:55:07.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.709+0000 7f35877349c0 20 remove_watcher() i=5 2024-08-27T02:55:07.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.713+0000 7f35877349c0 20 remove_watcher() i=6 2024-08-27T02:55:07.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.713+0000 7f35877349c0 20 remove_watcher() i=7 2024-08-27T02:55:07.729 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-08-27T02:55:07.758 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:07.759 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:07.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.801+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 realm 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:07.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:07.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.805+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:07.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.809+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:07.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.809+0000 7f05110319c0 20 searching for the correct realm 2024-08-27T02:55:07.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:07.813+0000 7f050e336640 0 -- 172.21.15.143:0/2203106222 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f050007cc40 msgr2=0x7f050007b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:08.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.029+0000 7f050eb37640 0 -- 172.21.15.143:0/2203106222 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f05040dc410 msgr2=0x7f05040dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:08.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:08.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:08.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:08.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:08.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:08.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:08.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:08.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.245+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:08.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 zone default found 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 4 Realm: () 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 zonegroup default 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:08.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:08.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:08.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 started sync module instance, tier type = 2024-08-27T02:55:08.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.249+0000 7f05110319c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.273+0000 7f05110319c0 20 add_watcher() i=0 2024-08-27T02:55:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.273+0000 7f05110319c0 20 add_watcher() i=1 2024-08-27T02:55:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.273+0000 7f05110319c0 20 add_watcher() i=2 2024-08-27T02:55:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.273+0000 7f05110319c0 20 add_watcher() i=3 2024-08-27T02:55:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.273+0000 7f05110319c0 20 add_watcher() i=4 2024-08-27T02:55:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.273+0000 7f05110319c0 20 add_watcher() i=5 2024-08-27T02:55:08.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.273+0000 7f05110319c0 20 add_watcher() i=6 2024-08-27T02:55:08.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.277+0000 7f05110319c0 20 add_watcher() i=7 2024-08-27T02:55:08.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.277+0000 7f05110319c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:08.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f03c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:08.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f05110319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:08.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f05110319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:08.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f05110319c0 5 note: GC not initialized 2024-08-27T02:55:08.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f033ffff640 20 reqs_thread_entry: start 2024-08-27T02:55:08.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f05110319c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:08.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f05110319c0 20 Filter name: none 2024-08-27T02:55:08.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f033dffb640 20 reqs_thread_entry: start 2024-08-27T02:55:08.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.281+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:08.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:08.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:08.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:08.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:08.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:08.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.285+0000 7f05110319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:08.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.289+0000 7f03c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:08.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.293+0000 7f05110319c0 20 remove_watcher() i=0 2024-08-27T02:55:08.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.293+0000 7f05110319c0 2 removed watcher, disabling cache 2024-08-27T02:55:08.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.297+0000 7f05110319c0 20 remove_watcher() i=1 2024-08-27T02:55:08.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.297+0000 7f05110319c0 20 remove_watcher() i=2 2024-08-27T02:55:08.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.301+0000 7f05110319c0 20 remove_watcher() i=3 2024-08-27T02:55:08.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.301+0000 7f05110319c0 20 remove_watcher() i=4 2024-08-27T02:55:08.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.305+0000 7f05110319c0 20 remove_watcher() i=5 2024-08-27T02:55:08.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.305+0000 7f05110319c0 20 remove_watcher() i=6 2024-08-27T02:55:08.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:08.309+0000 7f05110319c0 20 remove_watcher() i=7 2024-08-27T02:55:08.322 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:08.322 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:08.322 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-do-reshard id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:55:08.322 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:09.240 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with abort at do_reshard 2024-08-27T02:55:09.240 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.406 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-08-27T02:55:11.439 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:11.439 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:11.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.481+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 realm 2024-08-27T02:55:11.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:11.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.485+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.489+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:11.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.489+0000 7f4d6aa9f9c0 20 searching for the correct realm 2024-08-27T02:55:11.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.493+0000 7f4d67da4640 0 -- 172.21.15.143:0/1137988554 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x55a6ef2b9b30 msgr2=0x7f4d580ff3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:11.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.501+0000 7f4d67da4640 0 -- 172.21.15.143:0/1137988554 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f4c30081140 msgr2=0x7f4c30083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:11.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:11.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:11.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:11.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:11.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:11.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:11.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 zone default found 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 4 Realm: () 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 zonegroup default 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 started sync module instance, tier type = 2024-08-27T02:55:11.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.509+0000 7f4d6aa9f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:11.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=0 2024-08-27T02:55:11.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=1 2024-08-27T02:55:11.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=2 2024-08-27T02:55:11.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=3 2024-08-27T02:55:11.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=4 2024-08-27T02:55:11.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=5 2024-08-27T02:55:11.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=6 2024-08-27T02:55:11.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 20 add_watcher() i=7 2024-08-27T02:55:11.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.525+0000 7f4d6aa9f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:11.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4c1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:11.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4d6aa9f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:11.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4d6aa9f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:11.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4d6aa9f9c0 5 note: GC not initialized 2024-08-27T02:55:11.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4c1dfdb640 20 reqs_thread_entry: start 2024-08-27T02:55:11.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4d6aa9f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4d6aa9f9c0 20 Filter name: none 2024-08-27T02:55:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4b8f7fe640 20 reqs_thread_entry: start 2024-08-27T02:55:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.529+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:11.531 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:11.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:11.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.533+0000 7f4d6aa9f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:11.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.537+0000 7f4c1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:11.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.541+0000 7f4d6aa9f9c0 20 remove_watcher() i=0 2024-08-27T02:55:11.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.541+0000 7f4d6aa9f9c0 2 removed watcher, disabling cache 2024-08-27T02:55:11.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.545+0000 7f4d6aa9f9c0 20 remove_watcher() i=1 2024-08-27T02:55:11.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.545+0000 7f4d6aa9f9c0 20 remove_watcher() i=2 2024-08-27T02:55:11.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.549+0000 7f4d6aa9f9c0 20 remove_watcher() i=3 2024-08-27T02:55:11.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.549+0000 7f4d6aa9f9c0 20 remove_watcher() i=4 2024-08-27T02:55:11.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.553+0000 7f4d6aa9f9c0 20 remove_watcher() i=5 2024-08-27T02:55:11.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.553+0000 7f4d6aa9f9c0 20 remove_watcher() i=6 2024-08-27T02:55:11.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.553+0000 7f4d6aa9f9c0 20 remove_watcher() i=7 2024-08-27T02:55:11.567 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.567 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:11.567 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-do-reshard id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:11.567 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.568 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-08-27T02:55:11.600 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:11.600 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:11.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.641+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 realm 2024-08-27T02:55:11.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.644 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:11.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:11.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 searching for the correct realm 2024-08-27T02:55:11.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.653+0000 7fb9c2418640 0 -- 172.21.15.143:0/4197560073 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb9b4008040 msgr2=0x7fb9b4085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:11.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.661+0000 7fb9c341a640 0 -- 172.21.15.143:0/4197560073 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fb9b80f2040 msgr2=0x7fb9b80f3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:11.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:11.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:11.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:11.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:11.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:11.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:11.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 zone default found 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 Realm: () 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 zonegroup default 2024-08-27T02:55:11.668 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.669 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 started sync module instance, tier type = 2024-08-27T02:55:11.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:11.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=0 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=1 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=2 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=3 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=4 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=5 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=6 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=7 2024-08-27T02:55:11.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.685+0000 7fb9c51139c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:11.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb8797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 note: GC not initialized 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb7f3fff640 20 reqs_thread_entry: start 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 Filter name: none 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb7f1ffb640 20 reqs_thread_entry: start 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-27T02:55:11.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:11.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-27T02:55:11.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-27T02:55:11.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 : miss 2024-08-27T02:55:11.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:11.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:11.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 2024-08-27T02:55:11.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28, ofs0, ns] 2024-08-27T02:55:11.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94777136202800 notifier 6677 bl.length()=911 2024-08-27T02:55:11.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_sources= new_sources= 2024-08-27T02:55:11.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential sources added=[] removed=[] 2024-08-27T02:55:11.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_dests= new_dests= 2024-08-27T02:55:11.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential dests added=[] removed=[] 2024-08-27T02:55:11.717 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9c51139c0 time 2024-08-27T02:55:11.723088+0000 2024-08-27T02:55:11.718 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9c89ed2eb] 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:55:11.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.717+0000 7fb9c51139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9c51139c0 time 2024-08-27T02:55:11.723088+0000 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9c89ed2eb] 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:55:11.720 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb9c51139c0 thread_name:radosgw-admin 2024-08-27T02:55:11.736 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.736 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9c786c520] 2024-08-27T02:55:11.736 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:11.736 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:11.736 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:11.736 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9c89ed345] 2024-08-27T02:55:11.736 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.721+0000 7fb9c51139c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb9c51139c0 thread_name:radosgw-admin 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9c786c520] 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:11.737 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9c89ed345] 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:55:11.738 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_done global_id 7011 payload 274 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:55:11.621+0000 7fb9c341a640 1 monclient: found mon.noname-a 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: dump: 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.739 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 7011 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 4 set_mon_vals no callback set 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: dump: 2024-08-27T02:55:11.740 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: shutdown 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 asok(0x563305592280) unregister_commands rotate-key 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.741 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding auth protocol: cephx 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding auth protocol: cephx 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding auth protocol: cephx 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.742 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: starting msgr at 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: starting objecter 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 asok(0x563305592280) register_command objecter_requests hook 0x5633057d1810 2024-08-27T02:55:11.743 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: setting wanted keys 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: calling monclient init 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding auth protocol: cephx 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding auth protocol: cephx 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding auth protocol: cephx 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.744 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key hook 0x56330579c058 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.745 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x56330564c1a0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x56330564c580 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x5633056e4f90 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.505066s 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x56330564c1a0 auth_method 0 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.746 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): get_auth_request con 0x56330564c580 auth_method 0 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): get_auth_request con 0x5633056e4f90 auth_method 0 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.747 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 7014 payload 824 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 1 monclient: found mon.noname-a 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: dump: 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.748 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: dump: 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.749 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 7014 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:55:11.625+0000 7fb8b0e09640 4 set_mon_vals no callback set 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: init done 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:55:11.625+0000 7fb8af606640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:55:11.625+0000 7fb8af606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.750 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:55:11.625+0000 7fb8af606640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:55:11.629+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb8a8070aa0 auth_method 0 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:55:11.629+0000 7fb9c341a640 10 monclient: get_auth_request con 0x5633057e4be0 auth_method 0 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:55:11.629+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x5633057e7dc0 auth_method 0 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:55:11.633+0000 7fb9c2418640 10 monclient: get_auth_request con 0x5633057ece50 auth_method 0 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.751 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding auth protocol: cephx 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding auth protocol: cephx 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding auth protocol: cephx 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.752 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 asok(0x563305592280) register_command objecter_requests cmddesc objecter_requests hook 0x5633057f44f0 EEXIST 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding auth protocol: cephx 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding auth protocol: cephx 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding auth protocol: cephx 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.753 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key cmddesc rotate-key hook 0x5633057efce0 EEXIST 2024-08-27T02:55:11.754 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x5633058186a0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x563305817fd0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x5633058169b0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.514354s 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x5633058186a0 auth_method 0 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.755 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): get_auth_request con 0x5633058169b0 auth_method 0 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 6671 payload 824 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.756 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 1 monclient: found mon.noname-c 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: dump: 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.757 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: dump: 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.758 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:55:11.633+0000 7fb9c3c1b640 4 set_mon_vals no callback set 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 6671 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:55:11.637+0000 7fb8ace01640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:55:11.637+0000 7fb8ace01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:55:11.637+0000 7fb8ace01640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.759 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: get_monmap_and_config 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.760 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding auth protocol: cephx 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding auth protocol: cephx 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding auth protocol: cephx 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.761 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb89c0709e0 auth_method 0 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding auth protocol: cephx 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding auth protocol: cephx 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding auth protocol: cephx 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.762 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key cmddesc rotate-key hook 0x7fffdbf75678 EEXIST 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x56330586c390 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x56330585d050 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x5633058677d0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.763 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.518365s 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x56330586c390 auth_method 0 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): get_auth_request con 0x56330585d050 auth_method 0 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.764 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 6674 payload 274 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 1 monclient: found mon.noname-c 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: dump: 2024-08-27T02:55:11.765 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 6674 2024-08-27T02:55:11.766 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 4 set_mon_vals no callback set 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: dump: 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.767 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: shutdown 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.768 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding auth protocol: cephx 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding auth protocol: cephx 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding auth protocol: cephx 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.769 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: starting msgr at 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: starting objecter 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 asok(0x563305592280) register_command objecter_requests cmddesc objecter_requests hook 0x563305867bd0 EEXIST 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: setting wanted keys 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: calling monclient init 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding auth protocol: cephx 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding auth protocol: cephx 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding auth protocol: cephx 2024-08-27T02:55:11.770 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.771 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key cmddesc rotate-key hook 0x56330581a608 EEXIST 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x56330585d050 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x5633058677d0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x56330586c390 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.772 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.520852s 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x56330585d050 auth_method 0 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): get_auth_request con 0x56330586c390 auth_method 0 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.773 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 6677 payload 824 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 1 monclient: found mon.noname-c 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: dump: 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.774 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: dump: 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.775 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 6677 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:55:11.641+0000 7fb8a67fc640 4 set_mon_vals no callback set 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: init done 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cr dump hook 0x563305864fe8 2024-08-27T02:55:11.776 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:55:11.645+0000 7fb9c341a640 10 monclient: get_auth_request con 0x5633058853b0 auth_method 0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:55:11.645+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb88c070ad0 auth_method 0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 realm 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.777 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:55:11.645+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x563305889650 auth_method 0 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 searching for the correct realm 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:55:11.645+0000 7fb9c2418640 10 monclient: get_auth_request con 0x56330588e920 auth_method 0 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:55:11.649+0000 7fb9c341a640 10 monclient: get_auth_request con 0x7fb9b80d3040 auth_method 0 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:55:11.649+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x7fb9bc024040 auth_method 0 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:55:11.649+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb9b4008040 auth_method 0 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:55:11.653+0000 7fb9c2418640 0 -- 172.21.15.143:0/4197560073 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb9b4008040 msgr2=0x7fb9b4085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:55:11.653+0000 7fb8a4ff9640 1 client.6677.objecter ms_handle_reset 0x7fb9b4008040 session 0x7fb9b407a070 osd.4 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:55:11.653+0000 7fb8a4ff9640 10 monclient: _renew_subs 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:55:11.653+0000 7fb8a4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.778 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:55:11.653+0000 7fb9c341a640 10 monclient: get_auth_request con 0x7fb9b80f2040 auth_method 0 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:55:11.653+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb88c0810f0 auth_method 0 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:55:11.657+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x7fb9b80f1be0 auth_method 0 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:55:11.661+0000 7fb9c341a640 0 -- 172.21.15.143:0/4197560073 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fb9b80f2040 msgr2=0x7fb9b80f3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:55:11.661+0000 7fb8a4ff9640 1 client.6677.objecter ms_handle_reset 0x7fb9b80f2040 session 0x7fb9b80e2e90 osd.6 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:55:11.661+0000 7fb9c341a640 10 monclient: get_auth_request con 0x7fb9b4008040 auth_method 0 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.779 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 zone default found 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 Realm: () 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 zonegroup default 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.780 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 started sync module instance, tier type = 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=0 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=1 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=2 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=3 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=4 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=5 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=6 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=7 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:11.781 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding auth protocol: cephx 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding auth protocol: cephx 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding auth protocol: cephx 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:55:11.689+0000 7fb8797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.782 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache list hook 0x563305859680 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache inspect hook 0x563305859680 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache erase hook 0x563305859680 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache zap hook 0x563305859680 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 note: GC not initialized 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:55:11.689+0000 7fb7f3fff640 20 reqs_thread_entry: start 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace show hook 0x7fb9b4074070 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace history hook 0x7fb9b4074070 2024-08-27T02:55:11.783 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace active hook 0x7fb9b4074070 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace active_short hook 0x7fb9b4074070 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 Filter name: none 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:55:11.689+0000 7fb7f1ffb640 20 reqs_thread_entry: start 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 : miss 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.784 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28, ofs0, ns] 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94777136202800 notifier 6677 bl.length()=911 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.785 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_sources= new_sources= 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential sources added=[] removed=[] 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_dests= new_dests= 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential dests added=[] removed=[] 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:55:11.717+0000 7fb9c51139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9c51139c0 time 2024-08-27T02:55:11.723088+0000 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9c89ed2eb] 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:55:11.786 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:55:11.721+0000 7fb9c51139c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb9c51139c0 thread_name:radosgw-admin 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9c786c520] 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9c89ed345] 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.787 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:55:11.788 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:55:11.789 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:55:11.790 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:55:11.791 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:55:11.792 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:55:11.793 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:55:11.794 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb7f1ffb640 / http_manager 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb7f3fff640 / http_manager 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8797e2640 / rgw_dt_lg_renew 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8a4ff9640 / ms_dispatch 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8a5ffb640 / io_context_pool 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8a67fc640 / io_context_pool 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8ace01640 / ms_dispatch 2024-08-27T02:55:11.795 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8af606640 / ms_dispatch 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8b0e09640 / io_context_pool 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c2418640 / msgr-worker-2 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c2c19640 / msgr-worker-1 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c341a640 / msgr-worker-0 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c3c1b640 / io_context_pool 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c51139c0 / radosgw-admin 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.102152.log 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.796 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient(hunting): handle_auth_done global_id 7011 payload 274 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:55:11.621+0000 7fb9c341a640 1 monclient: found mon.noname-a 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:55:11.621+0000 7fb9c341a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: dump: 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.797 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 7011 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 4 set_mon_vals no callback set 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.798 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:55:11.621+0000 7fb8b0e09640 10 monclient: dump: 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: shutdown 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 asok(0x563305592280) unregister_commands rotate-key 2024-08-27T02:55:11.799 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.800 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding auth protocol: cephx 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding auth protocol: cephx 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding auth protocol: cephx 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: crc 2024-08-27T02:55:11.801 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:55:11.621+0000 7fb9c51139c0 5 AuthRegistry(0x5633057c68b0) adding con mode: secure 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: starting msgr at 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: starting objecter 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 asok(0x563305592280) register_command objecter_requests hook 0x5633057d1810 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: setting wanted keys 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: calling monclient init 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding auth protocol: cephx 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding auth protocol: cephx 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding auth protocol: cephx 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.802 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: crc 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 AuthRegistry(0x56330579bf10) adding con mode: secure 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key hook 0x56330579c058 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.803 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x56330564c1a0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x56330564c580 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x5633056e4f90 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.505066s 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x56330564c1a0 auth_method 0 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.804 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): get_auth_request con 0x56330564c580 auth_method 0 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:55:11.625+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): get_auth_request con 0x5633056e4f90 auth_method 0 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:55:11.625+0000 7fb9c341a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.805 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 7014 payload 824 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 1 monclient: found mon.noname-a 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:55:11.625+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: dump: 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.806 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:55:11.625+0000 7fb8af606640 10 monclient: dump: 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.807 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 7014 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:55:11.625+0000 7fb8b0e09640 4 set_mon_vals no callback set 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:55:11.625+0000 7fb9c51139c0 1 librados: init done 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:55:11.625+0000 7fb8af606640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:11.808 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:55:11.625+0000 7fb8af606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:55:11.625+0000 7fb8af606640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:55:11.629+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb8a8070aa0 auth_method 0 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:55:11.629+0000 7fb9c341a640 10 monclient: get_auth_request con 0x5633057e4be0 auth_method 0 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:55:11.629+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x5633057e7dc0 auth_method 0 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:55:11.633+0000 7fb9c2418640 10 monclient: get_auth_request con 0x5633057ece50 auth_method 0 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.809 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding auth protocol: cephx 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding auth protocol: cephx 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding auth protocol: cephx 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.810 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: crc 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057f0b40) adding con mode: secure 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 asok(0x563305592280) register_command objecter_requests cmddesc objecter_requests hook 0x5633057f44f0 EEXIST 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding auth protocol: cephx 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding auth protocol: cephx 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding auth protocol: cephx 2024-08-27T02:55:11.811 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: crc 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 AuthRegistry(0x5633057efb98) adding con mode: secure 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.812 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key cmddesc rotate-key hook 0x5633057efce0 EEXIST 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x5633058186a0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x563305817fd0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x5633058169b0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.514354s 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x5633058186a0 auth_method 0 2024-08-27T02:55:11.813 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): get_auth_request con 0x5633058169b0 auth_method 0 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:55:11.633+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.814 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 6671 payload 824 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 1 monclient: found mon.noname-c 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:55:11.633+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: dump: 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.815 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:55:11.633+0000 7fb8ace01640 10 monclient: dump: 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.816 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:55:11.633+0000 7fb9c3c1b640 4 set_mon_vals no callback set 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 6671 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:55:11.633+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:55:11.637+0000 7fb8ace01640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:11.817 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:55:11.637+0000 7fb8ace01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:55:11.637+0000 7fb8ace01640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: get_monmap_and_config 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.818 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding auth protocol: cephx 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding auth protocol: cephx 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding auth protocol: cephx 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.819 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: crc 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x563305837e70) adding con mode: secure 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb89c0709e0 auth_method 0 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding auth protocol: cephx 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding auth protocol: cephx 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding auth protocol: cephx 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.820 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: crc 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75530) adding con mode: secure 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key cmddesc rotate-key hook 0x7fffdbf75678 EEXIST 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:55:11.821 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x56330586c390 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x56330585d050 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x5633058677d0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.518365s 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x56330586c390 auth_method 0 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): get_auth_request con 0x56330585d050 auth_method 0 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.822 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:55:11.637+0000 7fb9c2418640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 6674 payload 274 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 1 monclient: found mon.noname-c 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:55:11.637+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.823 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: dump: 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.824 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 6674 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 4 set_mon_vals no callback set 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:55:11.637+0000 7fb8a67fc640 10 monclient: dump: 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.825 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: shutdown 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: build_initial_monmap 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 10 monclient: monmap: 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.826 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding auth protocol: cephx 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding auth protocol: cephx 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding auth protocol: cephx 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.827 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: crc 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:55:11.637+0000 7fb9c51139c0 5 AuthRegistry(0x56330583bea0) adding con mode: secure 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: starting msgr at 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: starting objecter 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 asok(0x563305592280) register_command objecter_requests cmddesc objecter_requests hook 0x563305867bd0 EEXIST 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: setting wanted keys 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: calling monclient init 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: init 2024-08-27T02:55:11.828 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding auth protocol: cephx 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding auth protocol: cephx 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding auth protocol: cephx 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: crc 2024-08-27T02:55:11.829 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 AuthRegistry(0x56330581a4c0) adding con mode: secure 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 asok(0x563305592280) register_command rotate-key cmddesc rotate-key hook 0x56330581a608 EEXIST 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-c con 0x56330585d050 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-b con 0x5633058677d0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): picked mon.noname-a con 0x56330586c390 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:11.830 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient(hunting): authenticate will time out at 2444.520852s 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request con 0x56330585d050 auth_method 0 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): get_auth_request con 0x56330586c390 auth_method 0 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:11.831 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:55:11.641+0000 7fb9c341a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient(hunting): handle_auth_done global_id 6677 payload 824 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient: _finish_hunting 0 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 1 monclient: found mon.noname-c 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:55:11.641+0000 7fb9c2c19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: dump: 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.832 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: _finish_auth 0 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: _check_auth_tickets 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 10 monclient: dump: 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.833 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 monclient: authenticate success, global_id 6677 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:55:11.641+0000 7fb8a67fc640 4 set_mon_vals no callback set 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _renew_subs 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.834 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 1 librados: init done 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cr dump hook 0x563305864fe8 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:55:11.641+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:55:11.641+0000 7fb8a4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:55:11.645+0000 7fb9c341a640 10 monclient: get_auth_request con 0x5633058853b0 auth_method 0 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:55:11.645+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb88c070ad0 auth_method 0 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 realm 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.835 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:55:11.645+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x563305889650 auth_method 0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:55:11.645+0000 7fb9c51139c0 20 searching for the correct realm 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:55:11.645+0000 7fb9c2418640 10 monclient: get_auth_request con 0x56330588e920 auth_method 0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:55:11.649+0000 7fb9c341a640 10 monclient: get_auth_request con 0x7fb9b80d3040 auth_method 0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:55:11.649+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x7fb9bc024040 auth_method 0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:55:11.649+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb9b4008040 auth_method 0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:55:11.653+0000 7fb9c2418640 0 -- 172.21.15.143:0/4197560073 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb9b4008040 msgr2=0x7fb9b4085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:55:11.653+0000 7fb8a4ff9640 1 client.6677.objecter ms_handle_reset 0x7fb9b4008040 session 0x7fb9b407a070 osd.4 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:55:11.653+0000 7fb8a4ff9640 10 monclient: _renew_subs 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:55:11.653+0000 7fb8a4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:11.836 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:55:11.653+0000 7fb9c341a640 10 monclient: get_auth_request con 0x7fb9b80f2040 auth_method 0 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:55:11.653+0000 7fb9c2418640 10 monclient: get_auth_request con 0x7fb88c0810f0 auth_method 0 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:55:11.657+0000 7fb9c2c19640 10 monclient: get_auth_request con 0x7fb9b80f1be0 auth_method 0 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:55:11.661+0000 7fb9c341a640 0 -- 172.21.15.143:0/4197560073 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fb9b80f2040 msgr2=0x7fb9b80f3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:55:11.661+0000 7fb8a4ff9640 1 client.6677.objecter ms_handle_reset 0x7fb9b80f2040 session 0x7fb9b80e2e90 osd.6 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:55:11.661+0000 7fb9c341a640 10 monclient: get_auth_request con 0x7fb9b4008040 auth_method 0 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.837 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:55:11.665+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 zone default found 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 Realm: () 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 zonegroup default 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.838 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 started sync module instance, tier type = 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:55:11.669+0000 7fb9c51139c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=0 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=1 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=2 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=3 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=4 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=5 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=6 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 20 add_watcher() i=7 2024-08-27T02:55:11.839 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:55:11.685+0000 7fb9c51139c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding auth protocol: cephx 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding auth protocol: cephx 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding auth protocol: cephx 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:55:11.689+0000 7fb8797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:11.840 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: crc 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 AuthRegistry(0x7fffdbf75a10) adding con mode: secure 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache list hook 0x563305859680 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache inspect hook 0x563305859680 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache erase hook 0x563305859680 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command cache zap hook 0x563305859680 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 note: GC not initialized 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:55:11.689+0000 7fb7f3fff640 20 reqs_thread_entry: start 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace show hook 0x7fb9b4074070 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace history hook 0x7fb9b4074070 2024-08-27T02:55:11.841 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace active hook 0x7fb9b4074070 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 5 asok(0x563305592280) register_command sync trace active_short hook 0x7fb9b4074070 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 Filter name: none 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:55:11.689+0000 7fb7f1ffb640 20 reqs_thread_entry: start 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:55:11.689+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 : miss 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:11.842 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:55:11.693+0000 7fb9c51139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:55:11.705+0000 7fb9c51139c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28, ofs0, ns] 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94777136202800 notifier 6677 bl.length()=911 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:55:11.705+0000 7fb8a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:11.843 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_sources= new_sources= 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential sources added=[] removed=[] 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_dests= new_dests= 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:55:11.709+0000 7fb9c51139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential dests added=[] removed=[] 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:55:11.717+0000 7fb9c51139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9c51139c0 time 2024-08-27T02:55:11.723088+0000 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9c89ed2eb] 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.844 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:55:11.721+0000 7fb9c51139c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fb9c51139c0 thread_name:radosgw-admin 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9c786c520] 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9c89ed345] 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9c89ed49f] 2024-08-27T02:55:11.845 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563303044b11] 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56330305a1ca] 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9c7853d90] 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:55:11.846 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:55:11.847 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:55:11.848 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:55:11.849 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:55:11.850 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:55:11.851 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:55:11.852 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:55:11.852 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:55:11.852 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:55:11.852 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:55:11.852 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:55:11.852 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:55:11.852 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:55:11.854 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb7f1ffb640 / http_manager 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb7f3fff640 / http_manager 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8797e2640 / rgw_dt_lg_renew 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8a4ff9640 / ms_dispatch 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8a5ffb640 / io_context_pool 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8a67fc640 / io_context_pool 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8ace01640 / ms_dispatch 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8af606640 / ms_dispatch 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb8b0e09640 / io_context_pool 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c2418640 / msgr-worker-2 2024-08-27T02:55:11.855 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c2c19640 / msgr-worker-1 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c341a640 / msgr-worker-0 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c3c1b640 / io_context_pool 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr: 7fb9c51139c0 / radosgw-admin 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:55:11.725130Z_b88ad1d2-684e-4f04-bfb8-89d4c53c48d3/log 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:55:11.856 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-08-27T02:55:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 realm 2024-08-27T02:55:11.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.801+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.805+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.805+0000 7f3a7dd1a9c0 20 searching for the correct realm 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.809+0000 7f3a7c021640 0 -- 172.21.15.143:0/2609458441 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55a84043dd10 msgr2=0x55a840440180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.817+0000 7f3a7b01f640 0 -- 172.21.15.143:0/2609458441 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f3a6c007e30 msgr2=0x7f3a6c0ad9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:11.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.821+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 zone default found 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 4 Realm: () 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:11.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 zonegroup default 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 started sync module instance, tier type = 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.825+0000 7f3a7dd1a9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=0 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=1 2024-08-27T02:55:11.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=2 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=3 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=4 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=5 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=6 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 20 add_watcher() i=7 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.841+0000 7f3a7dd1a9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f39327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 5 note: GC not initialized 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f39317e2640 20 reqs_thread_entry: start 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 Filter name: none 2024-08-27T02:55:11.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f392a7fc640 20 reqs_thread_entry: start 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=441 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.845+0000 7f3a7dd1a9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.849+0000 7f3a7dd1a9c0 20 rados_obj.operate() r=0 bl.length=441 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.849+0000 7f3a7dd1a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.849+0000 7f39327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.853+0000 7f3a7dd1a9c0 20 remove_watcher() i=0 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.853+0000 7f3a7dd1a9c0 2 removed watcher, disabling cache 2024-08-27T02:55:11.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.857+0000 7f3a7dd1a9c0 20 remove_watcher() i=1 2024-08-27T02:55:11.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.857+0000 7f3a7dd1a9c0 20 remove_watcher() i=2 2024-08-27T02:55:11.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.861+0000 7f3a7dd1a9c0 20 remove_watcher() i=3 2024-08-27T02:55:11.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.861+0000 7f3a7dd1a9c0 20 remove_watcher() i=4 2024-08-27T02:55:11.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.861+0000 7f3a7dd1a9c0 20 remove_watcher() i=5 2024-08-27T02:55:11.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.865+0000 7f3a7dd1a9c0 20 remove_watcher() i=6 2024-08-27T02:55:11.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:11.865+0000 7f3a7dd1a9c0 20 remove_watcher() i=7 2024-08-27T02:55:11.877 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.877 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:11.877 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-do-reshard id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:11.877 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:11.980 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:55:12.017 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:12.017 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:12.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:12.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 realm 2024-08-27T02:55:12.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:12.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:12.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:12.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.061+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.065+0000 7f64d6f959c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:12.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.065+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.065+0000 7f64d6f959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:12.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.065+0000 7f64d6f959c0 20 searching for the correct realm 2024-08-27T02:55:12.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.069+0000 7f64d429a640 0 -- 172.21.15.143:0/1330417641 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f64c4004040 msgr2=0x7f64c4101120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:12.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.285+0000 7f64d4a9b640 0 -- 172.21.15.143:0/1330417641 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f64c0003100 msgr2=0x7f64bc068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:12.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:12.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:12.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:12.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:12.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:12.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:12.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.501+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:12.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:12.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 zone default found 2024-08-27T02:55:12.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 4 Realm: () 2024-08-27T02:55:12.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:12.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:12.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 zonegroup default 2024-08-27T02:55:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:12.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:12.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 started sync module instance, tier type = 2024-08-27T02:55:12.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.505+0000 7f64d6f959c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:12.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.537+0000 7f64d6f959c0 20 add_watcher() i=0 2024-08-27T02:55:12.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.537+0000 7f64d6f959c0 20 add_watcher() i=1 2024-08-27T02:55:12.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.537+0000 7f64d6f959c0 20 add_watcher() i=2 2024-08-27T02:55:12.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.537+0000 7f64d6f959c0 20 add_watcher() i=3 2024-08-27T02:55:12.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.537+0000 7f64d6f959c0 20 add_watcher() i=4 2024-08-27T02:55:12.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.537+0000 7f64d6f959c0 20 add_watcher() i=5 2024-08-27T02:55:12.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.537+0000 7f64d6f959c0 20 add_watcher() i=6 2024-08-27T02:55:12.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.541+0000 7f64d6f959c0 20 add_watcher() i=7 2024-08-27T02:55:12.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.541+0000 7f64d6f959c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:12.544 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.545+0000 7f638afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:12.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.545+0000 7f64d6f959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:12.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.545+0000 7f64d6f959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:12.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.545+0000 7f64d6f959c0 5 note: GC not initialized 2024-08-27T02:55:12.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.545+0000 7f6389fe3640 20 reqs_thread_entry: start 2024-08-27T02:55:12.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.545+0000 7f64d6f959c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:12.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 20 Filter name: none 2024-08-27T02:55:12.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f62fb7fe640 20 reqs_thread_entry: start 2024-08-27T02:55:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-27T02:55:12.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-27T02:55:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-27T02:55:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 : miss 2024-08-27T02:55:12.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 20 rados_obj.operate() r=0 bl.length=441 2024-08-27T02:55:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:12.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.549+0000 7f64d6f959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 2024-08-27T02:55:12.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.553+0000 7f64d6f959c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to be held by another RGW process; skipping for now 2024-08-27T02:55:12.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.553+0000 7f638afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:12.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.557+0000 7f64d6f959c0 20 remove_watcher() i=0 2024-08-27T02:55:12.559 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.557+0000 7f64d6f959c0 2 removed watcher, disabling cache 2024-08-27T02:55:12.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.561+0000 7f64d6f959c0 20 remove_watcher() i=1 2024-08-27T02:55:12.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.565+0000 7f64d6f959c0 20 remove_watcher() i=2 2024-08-27T02:55:12.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.565+0000 7f64d6f959c0 20 remove_watcher() i=3 2024-08-27T02:55:12.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.569+0000 7f64d6f959c0 20 remove_watcher() i=4 2024-08-27T02:55:12.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.569+0000 7f64d6f959c0 20 remove_watcher() i=5 2024-08-27T02:55:12.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.573+0000 7f64d6f959c0 20 remove_watcher() i=6 2024-08-27T02:55:12.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:12.573+0000 7f64d6f959c0 20 remove_watcher() i=7 2024-08-27T02:55:12.587 INFO:tasks.workunit.client.0.smithi143.stderr:waiting 30 seconds for reshard lock to expire... 2024-08-27T02:55:42.616 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:55:42.654 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:42.654 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:42.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.696+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 realm 2024-08-27T02:55:42.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:42.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:42.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.700+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.704+0000 7f99b697c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:42.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.704+0000 7f99b697c9c0 20 searching for the correct realm 2024-08-27T02:55:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.708+0000 7f99b3c81640 0 -- 172.21.15.143:0/1652563672 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f99a40c0070 msgr2=0x7f99a40ba880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:42.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.716+0000 7f99b3c81640 0 -- 172.21.15.143:0/1652563672 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f987c0810c0 msgr2=0x7f987c0834f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.720+0000 7f99b697c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.720+0000 7f99b697c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.720+0000 7f99b697c9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.720+0000 7f99b697c9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.720+0000 7f99b697c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.720+0000 7f99b697c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.720+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 zone default found 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 4 Realm: () 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 zonegroup default 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 started sync module instance, tier type = 2024-08-27T02:55:42.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.724+0000 7f99b697c9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:42.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=0 2024-08-27T02:55:42.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=1 2024-08-27T02:55:42.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=2 2024-08-27T02:55:42.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=3 2024-08-27T02:55:42.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=4 2024-08-27T02:55:42.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=5 2024-08-27T02:55:42.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=6 2024-08-27T02:55:42.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 20 add_watcher() i=7 2024-08-27T02:55:42.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.740+0000 7f99b697c9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:42.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f986afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:42.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:42.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:42.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 5 note: GC not initialized 2024-08-27T02:55:42.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f9869fdb640 20 reqs_thread_entry: start 2024-08-27T02:55:42.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:42.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 20 Filter name: none 2024-08-27T02:55:42.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f97db7fe640 20 reqs_thread_entry: start 2024-08-27T02:55:42.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-08-27T02:55:42.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:42.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-08-27T02:55:42.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-08-27T02:55:42.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 : miss 2024-08-27T02:55:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.744+0000 7f99b697c9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.748+0000 7f99b697c9c0 20 rados_obj.operate() r=0 bl.length=441 2024-08-27T02:55:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.748+0000 7f99b697c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.748+0000 7f99b697c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.748+0000 7f99b697c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.748+0000 7f99b697c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:42.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.748+0000 7f99b697c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 2024-08-27T02:55:42.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.748+0000 7f99b697c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:55:42.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.764+0000 7f99b697c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:42.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.764+0000 7f99b697c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:42.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.764+0000 7f99b697c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:42.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.764+0000 7f99b697c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28, ofs0, ns] 2024-08-27T02:55:42.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f988b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 93933708593488 notifier 6728 bl.length()=911 2024-08-27T02:55:42.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f988b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:42.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f988b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:42.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f988b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:42.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_sources= new_sources= 2024-08-27T02:55:42.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential sources added=[] removed=[] 2024-08-27T02:55:42.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_dests= new_dests= 2024-08-27T02:55:42.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.768+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential dests added=[] removed=[] 2024-08-27T02:55:42.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.0 2024-08-27T02:55:42.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.0 2024-08-27T02:55:42.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.1 2024-08-27T02:55:42.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.1 2024-08-27T02:55:42.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.2 2024-08-27T02:55:42.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.2 2024-08-27T02:55:42.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.3 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.3 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.4 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.4 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.5 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.5 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.6 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.6 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.7 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.7 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.8 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.8 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.9 2024-08-27T02:55:42.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.9 2024-08-27T02:55:42.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.10 2024-08-27T02:55:42.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.10 2024-08-27T02:55:42.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.11 2024-08-27T02:55:42.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2.11 2024-08-27T02:55:42.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.0 2024-08-27T02:55:42.786 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.1 2024-08-27T02:55:42.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.784+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2 2024-08-27T02:55:42.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.788+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.3 2024-08-27T02:55:42.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.788+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.4 2024-08-27T02:55:42.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.788+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.5 2024-08-27T02:55:42.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.788+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.6 2024-08-27T02:55:42.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.792+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.7 2024-08-27T02:55:42.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.792+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.8 2024-08-27T02:55:42.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.792+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.9 2024-08-27T02:55:42.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.792+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.10 2024-08-27T02:55:42.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.800+0000 7f99b697c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:42.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.800+0000 7f99b697c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 2024-08-27T02:55:42.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:42.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:42.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:42.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28, ofs0, ns] 2024-08-27T02:55:42.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f988affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 93933708593488 notifier 6728 bl.length()=911 2024-08-27T02:55:42.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f988affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:42.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f988affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:42.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f988affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:42.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_sources= new_sources= 2024-08-27T02:55:42.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential sources added=[] removed=[] 2024-08-27T02:55:42.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_dests= new_dests= 2024-08-27T02:55:42.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.804+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential dests added=[] removed=[] 2024-08-27T02:55:42.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.812+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.0 2024-08-27T02:55:42.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.812+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.1 2024-08-27T02:55:42.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.812+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.2 2024-08-27T02:55:42.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.812+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.3 2024-08-27T02:55:42.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.812+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.4 2024-08-27T02:55:42.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.5 2024-08-27T02:55:42.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.6 2024-08-27T02:55:42.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.7 2024-08-27T02:55:42.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.8 2024-08-27T02:55:42.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.9 2024-08-27T02:55:42.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28.10 2024-08-27T02:55:42.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:42.819 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.816+0000 7f99b697c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 2024-08-27T02:55:42.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f99b697c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:42.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f99b697c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:42.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f99b697c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:42.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f99b697c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28, ofs0, ns] 2024-08-27T02:55:42.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f988affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 93933708593488 notifier 6728 bl.length()=879 2024-08-27T02:55:42.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f988affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 info.flags=0x17 2024-08-27T02:55:42.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f988affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 to cache LRU end 2024-08-27T02:55:42.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.820+0000 7f988affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:42.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.824+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_sources= new_sources= 2024-08-27T02:55:42.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.824+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential sources added=[] removed=[] 2024-08-27T02:55:42.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.824+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): orig_dests= new_dests= 2024-08-27T02:55:42.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.824+0000 7f99b697c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28]): potential dests added=[] removed=[] 2024-08-27T02:55:42.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.828+0000 7f99b697c9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-08-27T02:55:42.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.832+0000 7f986afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:42.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.836+0000 7f99b697c9c0 20 remove_watcher() i=0 2024-08-27T02:55:42.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.836+0000 7f99b697c9c0 2 removed watcher, disabling cache 2024-08-27T02:55:42.840 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.840+0000 7f99b697c9c0 20 remove_watcher() i=1 2024-08-27T02:55:42.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.840+0000 7f99b697c9c0 20 remove_watcher() i=2 2024-08-27T02:55:42.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.844+0000 7f99b697c9c0 20 remove_watcher() i=3 2024-08-27T02:55:42.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.844+0000 7f99b697c9c0 20 remove_watcher() i=4 2024-08-27T02:55:42.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.848+0000 7f99b697c9c0 20 remove_watcher() i=5 2024-08-27T02:55:42.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.848+0000 7f99b697c9c0 20 remove_watcher() i=6 2024-08-27T02:55:42.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.848+0000 7f99b697c9c0 20 remove_watcher() i=7 2024-08-27T02:55:42.871 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-08-27T02:55:42.901 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:42.901 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:42.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.944+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 realm 2024-08-27T02:55:42.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:42.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.950 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:42.950 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.948+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.952+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:42.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.952+0000 7fb9f4c819c0 20 searching for the correct realm 2024-08-27T02:55:42.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.952+0000 7fb9f2787640 0 -- 172.21.15.143:0/1669344942 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7fb9ec008040 msgr2=0x7fb9ec05fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:42.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.960+0000 7fb9f2787640 0 -- 172.21.15.143:0/1669344942 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7fb8bc081170 msgr2=0x7fb8bc0835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:42.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:42.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:42.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:42.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:42.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:42.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:42.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:42.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 zone default found 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 4 Realm: () 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 zonegroup default 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:42.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 started sync module instance, tier type = 2024-08-27T02:55:42.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.972+0000 7fb9f4c819c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:42.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.988+0000 7fb9f4c819c0 20 add_watcher() i=0 2024-08-27T02:55:42.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.988+0000 7fb9f4c819c0 20 add_watcher() i=1 2024-08-27T02:55:42.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.988+0000 7fb9f4c819c0 20 add_watcher() i=2 2024-08-27T02:55:42.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.988+0000 7fb9f4c819c0 20 add_watcher() i=3 2024-08-27T02:55:42.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.988+0000 7fb9f4c819c0 20 add_watcher() i=4 2024-08-27T02:55:42.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.988+0000 7fb9f4c819c0 20 add_watcher() i=5 2024-08-27T02:55:42.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.988+0000 7fb9f4c819c0 20 add_watcher() i=6 2024-08-27T02:55:42.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 20 add_watcher() i=7 2024-08-27T02:55:42.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:42.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb8a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:42.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:42.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:42.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 5 note: GC not initialized 2024-08-27T02:55:42.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb8237fe640 20 reqs_thread_entry: start 2024-08-27T02:55:42.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:42.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 20 Filter name: none 2024-08-27T02:55:42.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb8217fa640 20 reqs_thread_entry: start 2024-08-27T02:55:42.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.992+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:42.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:42.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:42.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=187 2024-08-27T02:55:42.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:42.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 rados_obj.operate() r=0 bl.length=409 2024-08-27T02:55:42.998 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:42.996+0000 7fb9f4c819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:43.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.000+0000 7fb8a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:43.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.004+0000 7fb9f4c819c0 20 remove_watcher() i=0 2024-08-27T02:55:43.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.004+0000 7fb9f4c819c0 2 removed watcher, disabling cache 2024-08-27T02:55:43.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.008+0000 7fb9f4c819c0 20 remove_watcher() i=1 2024-08-27T02:55:43.010 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.008+0000 7fb9f4c819c0 20 remove_watcher() i=2 2024-08-27T02:55:43.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.012+0000 7fb9f4c819c0 20 remove_watcher() i=3 2024-08-27T02:55:43.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.012+0000 7fb9f4c819c0 20 remove_watcher() i=4 2024-08-27T02:55:43.015 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.016+0000 7fb9f4c819c0 20 remove_watcher() i=5 2024-08-27T02:55:43.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.016+0000 7fb9f4c819c0 20 remove_watcher() i=6 2024-08-27T02:55:43.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:43.016+0000 7fb9f4c819c0 20 remove_watcher() i=7 2024-08-27T02:55:43.032 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:43.032 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:43.032 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-do-reshard id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:55:43.032 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:43.937 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-08-27T02:55:43.937 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:46.125 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-08-27T02:55:46.157 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:46.157 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:46.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.200+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 realm 2024-08-27T02:55:46.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:46.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:46.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.204+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.208+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:46.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.208+0000 7f53567309c0 20 searching for the correct realm 2024-08-27T02:55:46.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.212+0000 7f5354a37640 0 -- 172.21.15.143:0/479741782 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f53480cf070 msgr2=0x7f53480bb0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:46.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.220+0000 7f5354236640 0 -- 172.21.15.143:0/479741782 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f534810bc20 msgr2=0x7f53480e0520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:46.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.436+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:46.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 zone default found 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 4 Realm: () 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 zonegroup default 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.440+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.444+0000 7f53567309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.444+0000 7f53567309c0 20 started sync module instance, tier type = 2024-08-27T02:55:46.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.444+0000 7f53567309c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:46.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.464+0000 7f53567309c0 20 add_watcher() i=0 2024-08-27T02:55:46.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.464+0000 7f53567309c0 20 add_watcher() i=1 2024-08-27T02:55:46.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.464+0000 7f53567309c0 20 add_watcher() i=2 2024-08-27T02:55:46.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.464+0000 7f53567309c0 20 add_watcher() i=3 2024-08-27T02:55:46.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.464+0000 7f53567309c0 20 add_watcher() i=4 2024-08-27T02:55:46.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.464+0000 7f53567309c0 20 add_watcher() i=5 2024-08-27T02:55:46.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.464+0000 7f53567309c0 20 add_watcher() i=6 2024-08-27T02:55:46.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.468+0000 7f53567309c0 20 add_watcher() i=7 2024-08-27T02:55:46.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.468+0000 7f53567309c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:46.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.472+0000 7f520afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:46.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.472+0000 7f53567309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:46.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.472+0000 7f53567309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:46.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.472+0000 7f53567309c0 5 note: GC not initialized 2024-08-27T02:55:46.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.472+0000 7f5209fdb640 20 reqs_thread_entry: start 2024-08-27T02:55:46.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.472+0000 7f53567309c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:46.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 Filter name: none 2024-08-27T02:55:46.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f517b7fe640 20 reqs_thread_entry: start 2024-08-27T02:55:46.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.476 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:46.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:46.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:46.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:46.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.476+0000 7f53567309c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.480+0000 7f53567309c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:46.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.480+0000 7f53567309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:46.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.480+0000 7f520afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:46.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.488+0000 7f53567309c0 20 remove_watcher() i=0 2024-08-27T02:55:46.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.488+0000 7f53567309c0 2 removed watcher, disabling cache 2024-08-27T02:55:46.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.488+0000 7f53567309c0 20 remove_watcher() i=1 2024-08-27T02:55:46.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.492+0000 7f53567309c0 20 remove_watcher() i=2 2024-08-27T02:55:46.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.492+0000 7f53567309c0 20 remove_watcher() i=3 2024-08-27T02:55:46.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.496+0000 7f53567309c0 20 remove_watcher() i=4 2024-08-27T02:55:46.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.496+0000 7f53567309c0 20 remove_watcher() i=5 2024-08-27T02:55:46.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.500+0000 7f53567309c0 20 remove_watcher() i=6 2024-08-27T02:55:46.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.500+0000 7f53567309c0 20 remove_watcher() i=7 2024-08-27T02:55:46.517 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:46.517 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:46.517 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-logrecord-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:46.517 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:46.517 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-08-27T02:55:46.555 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:46.555 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:46.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.596+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 realm 2024-08-27T02:55:46.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:46.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:46.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:46.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.600+0000 7f682c3849c0 20 searching for the correct realm 2024-08-27T02:55:46.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.608+0000 7f682a68b640 0 -- 172.21.15.143:0/4010980545 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x5634e52efd30 msgr2=0x5634e52f21f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:46.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.616+0000 7f6829689640 0 -- 172.21.15.143:0/4010980545 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f681c038040 msgr2=0x7f681c026920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.620+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:46.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:46.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 zone default found 2024-08-27T02:55:46.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 4 Realm: () 2024-08-27T02:55:46.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:46.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:46.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:46.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 zonegroup default 2024-08-27T02:55:46.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 started sync module instance, tier type = 2024-08-27T02:55:46.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.624+0000 7f682c3849c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:46.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=0 2024-08-27T02:55:46.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=1 2024-08-27T02:55:46.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=2 2024-08-27T02:55:46.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=3 2024-08-27T02:55:46.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=4 2024-08-27T02:55:46.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=5 2024-08-27T02:55:46.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=6 2024-08-27T02:55:46.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 20 add_watcher() i=7 2024-08-27T02:55:46.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.640+0000 7f682c3849c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:46.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f66dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 5 note: GC not initialized 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f66defe5640 20 reqs_thread_entry: start 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 20 Filter name: none 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f66dcfe1640 20 reqs_thread_entry: start 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-08-27T02:55:46.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:46.647 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 : miss 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.644+0000 7f682c3849c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.648+0000 7f682c3849c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.648+0000 7f682c3849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.648+0000 7f682c3849c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.648+0000 7f682c3849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.648+0000 7f682c3849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:46.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.648+0000 7f682c3849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 2024-08-27T02:55:46.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f682c3849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:46.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f682c3849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:46.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f682c3849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:46.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f682c3849c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29, ofs0, ns] 2024-08-27T02:55:46.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f670d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 94785183418288 notifier 7134 bl.length()=923 2024-08-27T02:55:46.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f670d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:46.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f670d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:46.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.656+0000 7f670d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:46.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.660+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_sources= new_sources= 2024-08-27T02:55:46.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.660+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential sources added=[] removed=[] 2024-08-27T02:55:46.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.660+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_dests= new_dests= 2024-08-27T02:55:46.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.660+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential dests added=[] removed=[] 2024-08-27T02:55:46.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.664+0000 7f682c3849c0 -1 Injecting error=-5 at location=logrecord_writes 2024-08-27T02:55:46.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.664+0000 7f682c3849c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-08-27T02:55:46.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f682c3849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:46.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f682c3849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 2024-08-27T02:55:46.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f682c3849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:46.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f682c3849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:46.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f682c3849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:46.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f682c3849c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29, ofs0, ns] 2024-08-27T02:55:46.678 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f670cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94785183418288 notifier 7134 bl.length()=891 2024-08-27T02:55:46.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f670cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:46.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f670cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:46.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.676+0000 7f670cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:46.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.680+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_sources= new_sources= 2024-08-27T02:55:46.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.680+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential sources added=[] removed=[] 2024-08-27T02:55:46.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.680+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_dests= new_dests= 2024-08-27T02:55:46.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.680+0000 7f682c3849c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential dests added=[] removed=[] 2024-08-27T02:55:46.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.684+0000 7f66dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:46.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.688+0000 7f682c3849c0 20 remove_watcher() i=0 2024-08-27T02:55:46.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.688+0000 7f682c3849c0 2 removed watcher, disabling cache 2024-08-27T02:55:46.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.688+0000 7f682c3849c0 20 remove_watcher() i=1 2024-08-27T02:55:46.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.692+0000 7f682c3849c0 20 remove_watcher() i=2 2024-08-27T02:55:46.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.696+0000 7f682c3849c0 20 remove_watcher() i=3 2024-08-27T02:55:46.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.696+0000 7f682c3849c0 20 remove_watcher() i=4 2024-08-27T02:55:46.698 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.696+0000 7f682c3849c0 20 remove_watcher() i=5 2024-08-27T02:55:46.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.700+0000 7f682c3849c0 20 remove_watcher() i=6 2024-08-27T02:55:46.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.700+0000 7f682c3849c0 20 remove_watcher() i=7 2024-08-27T02:55:46.715 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-08-27T02:55:46.743 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:46.743 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:46.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 realm 2024-08-27T02:55:46.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:46.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:46.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.788+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.792+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:46.791 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.792+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:46.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.792+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:46.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.792+0000 7fefa88229c0 20 searching for the correct realm 2024-08-27T02:55:46.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:46.796+0000 7fefa5b27640 0 -- 172.21.15.143:0/1724714075 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fef98091030 msgr2=0x7fef9809a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:47.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.012+0000 7fefa6328640 0 -- 172.21.15.143:0/1724714075 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fef9c0f7290 msgr2=0x7fef9c12e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:47.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.228+0000 7fefa88229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:47.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:47.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 zone default found 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 4 Realm: () 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 zonegroup default 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 started sync module instance, tier type = 2024-08-27T02:55:47.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.232+0000 7fefa88229c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:47.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.256+0000 7fefa88229c0 20 add_watcher() i=0 2024-08-27T02:55:47.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.256+0000 7fefa88229c0 20 add_watcher() i=1 2024-08-27T02:55:47.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.256+0000 7fefa88229c0 20 add_watcher() i=2 2024-08-27T02:55:47.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.256+0000 7fefa88229c0 20 add_watcher() i=3 2024-08-27T02:55:47.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.256+0000 7fefa88229c0 20 add_watcher() i=4 2024-08-27T02:55:47.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.256+0000 7fefa88229c0 20 add_watcher() i=5 2024-08-27T02:55:47.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.256+0000 7fefa88229c0 20 add_watcher() i=6 2024-08-27T02:55:47.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.260+0000 7fefa88229c0 20 add_watcher() i=7 2024-08-27T02:55:47.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.260+0000 7fefa88229c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:47.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.264+0000 7fee5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:47.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.264+0000 7fefa88229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:47.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.264+0000 7fefa88229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:47.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.264+0000 7fefa88229c0 5 note: GC not initialized 2024-08-27T02:55:47.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fedd77fe640 20 reqs_thread_entry: start 2024-08-27T02:55:47.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:47.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 Filter name: none 2024-08-27T02:55:47.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fedd57fa640 20 reqs_thread_entry: start 2024-08-27T02:55:47.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:47.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:47.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:47.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:47.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.268+0000 7fefa88229c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.272+0000 7fefa88229c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:47.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.272+0000 7fefa88229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:47.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.272+0000 7fee5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:47.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.280+0000 7fefa88229c0 20 remove_watcher() i=0 2024-08-27T02:55:47.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.280+0000 7fefa88229c0 2 removed watcher, disabling cache 2024-08-27T02:55:47.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.280+0000 7fefa88229c0 20 remove_watcher() i=1 2024-08-27T02:55:47.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.284+0000 7fefa88229c0 20 remove_watcher() i=2 2024-08-27T02:55:47.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.284+0000 7fefa88229c0 20 remove_watcher() i=3 2024-08-27T02:55:47.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.288+0000 7fefa88229c0 20 remove_watcher() i=4 2024-08-27T02:55:47.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.288+0000 7fefa88229c0 20 remove_watcher() i=5 2024-08-27T02:55:47.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.292+0000 7fefa88229c0 20 remove_watcher() i=6 2024-08-27T02:55:47.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.292+0000 7fefa88229c0 20 remove_watcher() i=7 2024-08-27T02:55:47.307 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:47.307 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:47.307 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-logrecord-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:47.307 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:47.413 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:55:47.448 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:47.449 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:47.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 realm 2024-08-27T02:55:47.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:47.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.492+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.496+0000 7f55211869c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:47.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.496+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.496+0000 7f55211869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:47.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.496+0000 7f55211869c0 20 searching for the correct realm 2024-08-27T02:55:47.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.504+0000 7f551e48b640 0 -- 172.21.15.143:0/3766183512 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f55100c4400 msgr2=0x7f55100c4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:47.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.508+0000 7f551e48b640 0 -- 172.21.15.143:0/3766183512 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f53e80810c0 msgr2=0x7f53e80834f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:47.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:47.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:47.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:47.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:47.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:47.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:47.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:47.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:47.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 zone default found 2024-08-27T02:55:47.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 4 Realm: () 2024-08-27T02:55:47.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:47.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:47.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:47.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 zonegroup default 2024-08-27T02:55:47.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.516+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.520+0000 7f55211869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.520+0000 7f55211869c0 20 started sync module instance, tier type = 2024-08-27T02:55:47.520 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.520+0000 7f55211869c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:47.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.532+0000 7f55211869c0 20 add_watcher() i=0 2024-08-27T02:55:47.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.532+0000 7f55211869c0 20 add_watcher() i=1 2024-08-27T02:55:47.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.532+0000 7f55211869c0 20 add_watcher() i=2 2024-08-27T02:55:47.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.532+0000 7f55211869c0 20 add_watcher() i=3 2024-08-27T02:55:47.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.532+0000 7f55211869c0 20 add_watcher() i=4 2024-08-27T02:55:47.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.532+0000 7f55211869c0 20 add_watcher() i=5 2024-08-27T02:55:47.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.532+0000 7f55211869c0 20 add_watcher() i=6 2024-08-27T02:55:47.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 20 add_watcher() i=7 2024-08-27T02:55:47.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:47.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f53d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 5 note: GC not initialized 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f53d4fe1640 20 reqs_thread_entry: start 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 20 Filter name: none 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f53cdffb640 20 reqs_thread_entry: start 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-08-27T02:55:47.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.536+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:47.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-08-27T02:55:47.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-08-27T02:55:47.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 : miss 2024-08-27T02:55:47.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:47.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:47.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:47.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:47.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:47.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.540+0000 7f55211869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f55211869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f55211869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f55211869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f55211869c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29, ofs0, ns] 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f54027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94082822742624 notifier 6815 bl.length()=923 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f54027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f54027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:47.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.548+0000 7f54027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.552+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_sources= new_sources= 2024-08-27T02:55:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.552+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential sources added=[] removed=[] 2024-08-27T02:55:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.552+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_dests= new_dests= 2024-08-27T02:55:47.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.552+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential dests added=[] removed=[] 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.0 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.0 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.1 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.1 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.2 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.2 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.3 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.3 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.4 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.4 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.5 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.5 2024-08-27T02:55:47.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.6 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.6 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.7 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.7 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.8 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.8 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.9 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.9 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.10 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.10 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.11 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1.11 2024-08-27T02:55:47.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.560+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.0 2024-08-27T02:55:47.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.564+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1 2024-08-27T02:55:47.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.564+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.2 2024-08-27T02:55:47.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.564+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.3 2024-08-27T02:55:47.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.564+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.4 2024-08-27T02:55:47.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.568+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.5 2024-08-27T02:55:47.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.568+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.6 2024-08-27T02:55:47.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.568+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.7 2024-08-27T02:55:47.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.568+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.8 2024-08-27T02:55:47.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.572+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.9 2024-08-27T02:55:47.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.572+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.10 2024-08-27T02:55:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.576+0000 7f55211869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:47.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.576+0000 7f55211869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 2024-08-27T02:55:47.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f55211869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:47.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f55211869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:47.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f55211869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:47.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f55211869c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29, ofs0, ns] 2024-08-27T02:55:47.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f5401ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94082822742624 notifier 6815 bl.length()=923 2024-08-27T02:55:47.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f5401ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:47.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f5401ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:47.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.580+0000 7f5401ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:47.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.584+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_sources= new_sources= 2024-08-27T02:55:47.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.584+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential sources added=[] removed=[] 2024-08-27T02:55:47.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.584+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_dests= new_dests= 2024-08-27T02:55:47.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.584+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential dests added=[] removed=[] 2024-08-27T02:55:47.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.592+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.0 2024-08-27T02:55:47.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.592+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.1 2024-08-27T02:55:47.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.592+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.2 2024-08-27T02:55:47.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.592+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.3 2024-08-27T02:55:47.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.596+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.4 2024-08-27T02:55:47.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.596+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.5 2024-08-27T02:55:47.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.596+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.6 2024-08-27T02:55:47.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.596+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.7 2024-08-27T02:55:47.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.596+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.8 2024-08-27T02:55:47.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.9 2024-08-27T02:55:47.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29.10 2024-08-27T02:55:47.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 : hit (requested=0x17, cached=0x17) 2024-08-27T02:55:47.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 2024-08-27T02:55:47.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:47.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:47.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:47.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.600+0000 7f55211869c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29, ofs0, ns] 2024-08-27T02:55:47.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f54027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366246 cookie 94082822742624 notifier 6815 bl.length()=891 2024-08-27T02:55:47.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f54027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 info.flags=0x17 2024-08-27T02:55:47.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f54027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 to cache LRU end 2024-08-27T02:55:47.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f54027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:47.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_sources= new_sources= 2024-08-27T02:55:47.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential sources added=[] removed=[] 2024-08-27T02:55:47.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): orig_dests= new_dests= 2024-08-27T02:55:47.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.604+0000 7f55211869c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29]): potential dests added=[] removed=[] 2024-08-27T02:55:47.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.612+0000 7f55211869c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-08-27T02:55:47.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.612+0000 7f53d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:47.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.620+0000 7f55211869c0 20 remove_watcher() i=0 2024-08-27T02:55:47.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.620+0000 7f55211869c0 2 removed watcher, disabling cache 2024-08-27T02:55:47.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.620+0000 7f55211869c0 20 remove_watcher() i=1 2024-08-27T02:55:47.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.624+0000 7f55211869c0 20 remove_watcher() i=2 2024-08-27T02:55:47.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.624+0000 7f55211869c0 20 remove_watcher() i=3 2024-08-27T02:55:47.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.628+0000 7f55211869c0 20 remove_watcher() i=4 2024-08-27T02:55:47.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.628+0000 7f55211869c0 20 remove_watcher() i=5 2024-08-27T02:55:47.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.628+0000 7f55211869c0 20 remove_watcher() i=6 2024-08-27T02:55:47.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.632+0000 7f55211869c0 20 remove_watcher() i=7 2024-08-27T02:55:47.646 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-08-27T02:55:47.676 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:47.676 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:47.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.716+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 realm 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:47.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:47.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.720+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:47.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.724+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:47.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.724+0000 7fb3922e09c0 20 searching for the correct realm 2024-08-27T02:55:47.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.932+0000 7fb3905e7640 0 -- 172.21.15.143:0/1845871864 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fb384052040 msgr2=0x7fb384052420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:47.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:47.944+0000 7fb38fde6640 0 -- 172.21.15.143:0/1845871864 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fb384052ba0 msgr2=0x7fb384046900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.160+0000 7fb3922e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.160+0000 7fb3922e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.160+0000 7fb3922e09c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.160+0000 7fb3922e09c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.160+0000 7fb3922e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.160+0000 7fb3922e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.160+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:48.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:48.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 zone default found 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 4 Realm: () 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 zonegroup default 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:48.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:48.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:48.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 started sync module instance, tier type = 2024-08-27T02:55:48.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.164+0000 7fb3922e09c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:48.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.188+0000 7fb3922e09c0 20 add_watcher() i=0 2024-08-27T02:55:48.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.188+0000 7fb3922e09c0 20 add_watcher() i=1 2024-08-27T02:55:48.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.188+0000 7fb3922e09c0 20 add_watcher() i=2 2024-08-27T02:55:48.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.188+0000 7fb3922e09c0 20 add_watcher() i=3 2024-08-27T02:55:48.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.188+0000 7fb3922e09c0 20 add_watcher() i=4 2024-08-27T02:55:48.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.188+0000 7fb3922e09c0 20 add_watcher() i=5 2024-08-27T02:55:48.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.188+0000 7fb3922e09c0 20 add_watcher() i=6 2024-08-27T02:55:48.194 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.192+0000 7fb3922e09c0 20 add_watcher() i=7 2024-08-27T02:55:48.194 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.192+0000 7fb3922e09c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:48.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.196+0000 7fb245fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:48.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.196+0000 7fb3922e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:48.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.196+0000 7fb3922e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:48.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.196+0000 7fb3922e09c0 5 note: GC not initialized 2024-08-27T02:55:48.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb244fe1640 20 reqs_thread_entry: start 2024-08-27T02:55:48.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:48.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 Filter name: none 2024-08-27T02:55:48.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb1be7fc640 20 reqs_thread_entry: start 2024-08-27T02:55:48.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:48.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:48.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:48.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:48.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.200+0000 7fb3922e09c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:48.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.204+0000 7fb3922e09c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:48.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.204+0000 7fb3922e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:48.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.204+0000 7fb245fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:48.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.212+0000 7fb3922e09c0 20 remove_watcher() i=0 2024-08-27T02:55:48.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.212+0000 7fb3922e09c0 2 removed watcher, disabling cache 2024-08-27T02:55:48.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.212+0000 7fb3922e09c0 20 remove_watcher() i=1 2024-08-27T02:55:48.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.216+0000 7fb3922e09c0 20 remove_watcher() i=2 2024-08-27T02:55:48.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.220+0000 7fb3922e09c0 20 remove_watcher() i=3 2024-08-27T02:55:48.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.220+0000 7fb3922e09c0 20 remove_watcher() i=4 2024-08-27T02:55:48.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.224+0000 7fb3922e09c0 20 remove_watcher() i=5 2024-08-27T02:55:48.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.224+0000 7fb3922e09c0 20 remove_watcher() i=6 2024-08-27T02:55:48.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:48.228+0000 7fb3922e09c0 20 remove_watcher() i=7 2024-08-27T02:55:48.243 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:48.243 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:48.243 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-logrecord-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:55:48.244 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:49.175 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-08-27T02:55:49.175 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:51.376 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-08-27T02:55:51.408 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:51.408 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:51.454 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.452+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 realm 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:51.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:51.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.456+0000 7f23ea51d9c0 20 searching for the correct realm 2024-08-27T02:55:51.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.460+0000 7f23e8023640 0 -- 172.21.15.143:0/890797126 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f23d8008050 msgr2=0x7f23d807eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:51.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.672+0000 7f23e8824640 0 -- 172.21.15.143:0/890797126 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f23dc0b8410 msgr2=0x7f23dc0b8830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:51.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.688+0000 7f23ea51d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:51.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.688+0000 7f23ea51d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:51.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.688+0000 7f23ea51d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:51.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.688+0000 7f23ea51d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:51.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.688+0000 7f23ea51d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:51.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.688+0000 7f23ea51d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:51.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.688+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:51.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:51.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 zone default found 2024-08-27T02:55:51.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 4 Realm: () 2024-08-27T02:55:51.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:51.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:51.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:51.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 zonegroup default 2024-08-27T02:55:51.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.692+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.696+0000 7f23ea51d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.696+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.696+0000 7f23ea51d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.696+0000 7f23ea51d9c0 20 started sync module instance, tier type = 2024-08-27T02:55:51.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.696+0000 7f23ea51d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:51.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.716+0000 7f23ea51d9c0 20 add_watcher() i=0 2024-08-27T02:55:51.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.716+0000 7f23ea51d9c0 20 add_watcher() i=1 2024-08-27T02:55:51.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.716+0000 7f23ea51d9c0 20 add_watcher() i=2 2024-08-27T02:55:51.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.716+0000 7f23ea51d9c0 20 add_watcher() i=3 2024-08-27T02:55:51.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.716+0000 7f23ea51d9c0 20 add_watcher() i=4 2024-08-27T02:55:51.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.716+0000 7f23ea51d9c0 20 add_watcher() i=5 2024-08-27T02:55:51.718 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.716+0000 7f23ea51d9c0 20 add_watcher() i=6 2024-08-27T02:55:51.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.720+0000 7f23ea51d9c0 20 add_watcher() i=7 2024-08-27T02:55:51.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.720+0000 7f23ea51d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:51.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f229efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:51.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f23ea51d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:51.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f23ea51d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:51.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f23ea51d9c0 5 note: GC not initialized 2024-08-27T02:55:51.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f229dfdb640 20 reqs_thread_entry: start 2024-08-27T02:55:51.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f23ea51d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:51.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f23ea51d9c0 20 Filter name: none 2024-08-27T02:55:51.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f220f7fe640 20 reqs_thread_entry: start 2024-08-27T02:55:51.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.724+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.728+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:51.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.728+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.728+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:51.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.728+0000 7f23ea51d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:51.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.728+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.728+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:51.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.728+0000 7f23ea51d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.732+0000 7f23ea51d9c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:51.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.732+0000 7f23ea51d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:51.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.736+0000 7f229efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:51.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.740+0000 7f23ea51d9c0 20 remove_watcher() i=0 2024-08-27T02:55:51.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.740+0000 7f23ea51d9c0 2 removed watcher, disabling cache 2024-08-27T02:55:51.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.740+0000 7f23ea51d9c0 20 remove_watcher() i=1 2024-08-27T02:55:51.745 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.744+0000 7f23ea51d9c0 20 remove_watcher() i=2 2024-08-27T02:55:51.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.744+0000 7f23ea51d9c0 20 remove_watcher() i=3 2024-08-27T02:55:51.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.748+0000 7f23ea51d9c0 20 remove_watcher() i=4 2024-08-27T02:55:51.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.748+0000 7f23ea51d9c0 20 remove_watcher() i=5 2024-08-27T02:55:51.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.752+0000 7f23ea51d9c0 20 remove_watcher() i=6 2024-08-27T02:55:51.753 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.752+0000 7f23ea51d9c0 20 remove_watcher() i=7 2024-08-27T02:55:51.770 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:51.770 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:51.770 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-logrecord-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:51.770 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:51.770 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-08-27T02:55:51.807 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:51.807 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:51.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.848+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 realm 2024-08-27T02:55:51.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:51.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:51.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:51.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:51.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:51.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.852+0000 7fee388d79c0 20 searching for the correct realm 2024-08-27T02:55:51.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:51.860+0000 7fee36bde640 0 -- 172.21.15.143:0/2931975444 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fee2406d050 msgr2=0x7fee2406d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:52.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.076+0000 7fee363dd640 0 -- 172.21.15.143:0/2931975444 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55d7622e81d0 msgr2=0x55d7622ea600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.085 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:52.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 zone default found 2024-08-27T02:55:52.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 4 Realm: () 2024-08-27T02:55:52.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:52.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:52.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:52.087 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 zonegroup default 2024-08-27T02:55:52.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.088+0000 7fee388d79c0 20 started sync module instance, tier type = 2024-08-27T02:55:52.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.088+0000 7fee388d79c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:52.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=0 2024-08-27T02:55:52.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=1 2024-08-27T02:55:52.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=2 2024-08-27T02:55:52.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=3 2024-08-27T02:55:52.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=4 2024-08-27T02:55:52.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=5 2024-08-27T02:55:52.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=6 2024-08-27T02:55:52.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=7 2024-08-27T02:55:52.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.112+0000 7fee388d79c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:52.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fece77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:52.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fee388d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:52.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fee388d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:52.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fee388d79c0 5 note: GC not initialized 2024-08-27T02:55:52.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fece67fc640 20 reqs_thread_entry: start 2024-08-27T02:55:52.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fee388d79c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:52.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fee388d79c0 20 Filter name: none 2024-08-27T02:55:52.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.116+0000 7fec57fff640 20 reqs_thread_entry: start 2024-08-27T02:55:52.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-08-27T02:55:52.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:52.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-08-27T02:55:52.120 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-08-27T02:55:52.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 : miss 2024-08-27T02:55:52.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:52.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:52.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.120+0000 7fee388d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 2024-08-27T02:55:52.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30, ofs0, ns] 2024-08-27T02:55:52.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94383553591232 notifier 6863 bl.length()=923 2024-08-27T02:55:52.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_sources= new_sources= 2024-08-27T02:55:52.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential sources added=[] removed=[] 2024-08-27T02:55:52.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_dests= new_dests= 2024-08-27T02:55:52.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential dests added=[] removed=[] 2024-08-27T02:55:52.141 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee388d79c0 time 2024-08-27T02:55:52.145928+0000 2024-08-27T02:55:52.141 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:52.142 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.142 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee3c1b12eb] 2024-08-27T02:55:52.142 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.142 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.142 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.142 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fee388d79c0 thread_name:radosgw-admin 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.140+0000 7fee388d79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee388d79c0 time 2024-08-27T02:55:52.145928+0000 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee3c1b12eb] 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.143 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.144 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.144 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:55:52.144 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.144 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:55:52.144 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:55:52.144 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.159 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee3b030520] 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee3c1b1345] 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:55:52.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.144+0000 7fee388d79c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fee388d79c0 thread_name:radosgw-admin 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee3b030520] 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee3c1b1345] 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.161 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): handle_auth_done global_id 6851 payload 274 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:55:51.828+0000 7fee363dd640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: dump: 2024-08-27T02:55:52.162 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6851 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.163 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: dump: 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:52.164 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:55:51.828+0000 7fee388d79c0 4 set_mon_vals no callback set 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: shutdown 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 asok(0x55d761ff0280) unregister_commands rotate-key 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.165 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding auth protocol: cephx 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding auth protocol: cephx 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding auth protocol: cephx 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.166 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:55:51.828+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: starting msgr at 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: starting objecter 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command objecter_requests hook 0x55d76208af20 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: setting wanted keys 2024-08-27T02:55:52.167 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: calling monclient init 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding auth protocol: cephx 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding auth protocol: cephx 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding auth protocol: cephx 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.168 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:55:51.828+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:55:51.828+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key hook 0x55d7621fb028 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d762088ee0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d762141280 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.169 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d762144a00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.711825s 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d762088ee0 auth_method 0 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): get_auth_request con 0x55d762141280 auth_method 0 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.170 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_done global_id 6854 payload 824 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:55:51.832+0000 7fee363dd640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.171 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: dump: 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.172 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: dump: 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:55:51.832+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6854 2024-08-27T02:55:52.173 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:55:51.832+0000 7fed23e0f640 4 set_mon_vals no callback set 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:55:51.832+0000 7fee388d79c0 1 librados: init done 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:55:51.832+0000 7fed2260c640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:55:51.832+0000 7fed2260c640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:55:51.832+0000 7fed2260c640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient: get_auth_request con 0x7fed1c070ad0 auth_method 0 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:55:51.832+0000 7fee36bde640 10 monclient: get_auth_request con 0x55d76223bbe0 auth_method 0 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:55:51.836+0000 7fee363dd640 10 monclient: get_auth_request con 0x55d762245860 auth_method 0 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:55:51.836+0000 7fee35bdc640 10 monclient: get_auth_request con 0x55d76224a8f0 auth_method 0 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:55:51.836+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.174 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:55:51.836+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:55:51.836+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding auth protocol: cephx 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding auth protocol: cephx 2024-08-27T02:55:52.175 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding auth protocol: cephx 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:55:51.840+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command objecter_requests cmddesc objecter_requests hook 0x55d762252290 EEXIST 2024-08-27T02:55:52.176 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding auth protocol: cephx 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding auth protocol: cephx 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding auth protocol: cephx 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:55:51.840+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.177 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:55:51.840+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key cmddesc rotate-key hook 0x55d76224d960 EEXIST 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d762276440 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d762275d70 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d762274750 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.721026s 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): get_auth_request con 0x55d762274750 auth_method 0 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.178 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): get_auth_request con 0x55d762275d70 auth_method 0 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d762276440 auth_method 0 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.179 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_done global_id 6857 payload 824 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:55:51.840+0000 7fee35bdc640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: dump: 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.180 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: dump: 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.181 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6857 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:55:51.840+0000 7fee373df640 4 set_mon_vals no callback set 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.182 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: get_monmap_and_config 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.183 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding auth protocol: cephx 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding auth protocol: cephx 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding auth protocol: cephx 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.184 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fed100709e0 auth_method 0 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding auth protocol: cephx 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding auth protocol: cephx 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding auth protocol: cephx 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.185 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key cmddesc rotate-key hook 0x7ffff9ffbc68 EEXIST 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d7622ca360 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d7622c5800 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d7622bbf70 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.186 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.725196s 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d7622ca360 auth_method 0 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request con 0x55d7622bbf70 auth_method 0 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.187 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_done global_id 7221 payload 274 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:55:51.844+0000 7fee363dd640 1 monclient: found mon.noname-a 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: dump: 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.188 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: dump: 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.189 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 monclient: authenticate success, global_id 7221 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:55:51.844+0000 7fee388d79c0 4 set_mon_vals no callback set 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: shutdown 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.190 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding auth protocol: cephx 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding auth protocol: cephx 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding auth protocol: cephx 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.191 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: starting msgr at 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: starting objecter 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command objecter_requests cmddesc objecter_requests hook 0x55d762274b70 EEXIST 2024-08-27T02:55:52.192 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: setting wanted keys 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: calling monclient init 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding auth protocol: cephx 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding auth protocol: cephx 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding auth protocol: cephx 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.193 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key cmddesc rotate-key hook 0x55d7622783a8 EEXIST 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d7622bbf70 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d7622c5800 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d7622ca360 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.194 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.727736s 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): get_auth_request con 0x55d7622c5800 auth_method 0 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request con 0x55d7622ca360 auth_method 0 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.195 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d7622bbf70 auth_method 0 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:55:51.848+0000 7fee36bde640 10 monclient(hunting): handle_auth_done global_id 6863 payload 824 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:55:51.848+0000 7fee36bde640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:55:51.848+0000 7fee36bde640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:55:51.848+0000 7fee36bde640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: dump: 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.196 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: dump: 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.197 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:55:51.848+0000 7fed197fa640 4 set_mon_vals no callback set 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:55:51.848+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6863 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:55:51.848+0000 7fee388d79c0 1 librados: init done 2024-08-27T02:55:52.198 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:55:51.848+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cr dump hook 0x55d7622ba398 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:55:51.848+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:55:51.848+0000 7fed077fe640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:55:51.848+0000 7fed077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:55:51.848+0000 7fed077fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:55:51.852+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fed00070ad0 auth_method 0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:55:51.852+0000 7fee35bdc640 10 monclient: get_auth_request con 0x55d7622e3fb0 auth_method 0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 realm 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:55:51.852+0000 7fee388d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.199 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:55:51.852+0000 7fee363dd640 10 monclient: get_auth_request con 0x55d7622e81d0 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 searching for the correct realm 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:55:51.852+0000 7fee35bdc640 10 monclient: get_auth_request con 0x55d7622ed480 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:55:51.856+0000 7fee36bde640 10 monclient: get_auth_request con 0x7fee24064560 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:55:51.856+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fee301303b0 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:55:51.856+0000 7fee35bdc640 10 monclient: get_auth_request con 0x7fee2802c060 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:55:51.860+0000 7fee36bde640 10 monclient: get_auth_request con 0x7fee2406d050 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:55:51.860+0000 7fee36bde640 0 -- 172.21.15.143:0/2931975444 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fee2406d050 msgr2=0x7fee2406d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:55:52.064+0000 7fee36bde640 10 monclient: get_auth_request con 0x7fee2406d050 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:55:52.068+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fee240626d0 auth_method 0 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:55:52.076+0000 7fee363dd640 0 -- 172.21.15.143:0/2931975444 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55d7622e81d0 msgr2=0x55d7622ea600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:52.200 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:55:52.076+0000 7fed077fe640 1 client.6863.objecter ms_handle_reset 0x55d7622e81d0 session 0x55d7622e7b50 osd.5 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:55:52.076+0000 7fed077fe640 10 monclient: _renew_subs 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:55:52.076+0000 7fed077fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:55:52.076+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fed00081170 auth_method 0 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:52.201 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 zone default found 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:55:52.084+0000 7fee388d79c0 4 Realm: () 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:55:52.084+0000 7fee388d79c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:55:52.084+0000 7fee388d79c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:55:52.084+0000 7fee388d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 zonegroup default 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 started sync module instance, tier type = 2024-08-27T02:55:52.202 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=0 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=1 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=2 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=3 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=4 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=5 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=6 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=7 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:55:52.112+0000 7fee388d79c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding auth protocol: cephx 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding auth protocol: cephx 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding auth protocol: cephx 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.203 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:55:52.116+0000 7fece77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:55:52.116+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache list hook 0x55d7622c2a60 2024-08-27T02:55:52.204 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache inspect hook 0x55d7622c2a60 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache erase hook 0x55d7622c2a60 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache zap hook 0x55d7622c2a60 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 note: GC not initialized 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:55:52.116+0000 7fece67fc640 20 reqs_thread_entry: start 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace show hook 0x7fee28067120 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace history hook 0x7fee28067120 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace active hook 0x7fee28067120 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace active_short hook 0x7fee28067120 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 Filter name: none 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:55:52.116+0000 7fec57fff640 20 reqs_thread_entry: start 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-08-27T02:55:52.205 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 : miss 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30, ofs0, ns] 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94383553591232 notifier 6863 bl.length()=923 2024-08-27T02:55:52.206 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_sources= new_sources= 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential sources added=[] removed=[] 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_dests= new_dests= 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential dests added=[] removed=[] 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:55:52.140+0000 7fee388d79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee388d79c0 time 2024-08-27T02:55:52.145928+0000 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee3c1b12eb] 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.207 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:55:52.144+0000 7fee388d79c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fee388d79c0 thread_name:radosgw-admin 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee3b030520] 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee3c1b1345] 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.208 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:55:52.209 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:55:52.210 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:55:52.211 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:55:52.212 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:55:52.213 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:55:52.214 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 7fec57fff640 / http_manager 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 7fece67fc640 / http_manager 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 7fece77fe640 / rgw_dt_lg_renew 2024-08-27T02:55:52.215 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed077fe640 / ms_dispatch 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed18ff9640 / io_context_pool 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed197fa640 / io_context_pool 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed1b7fe640 / ms_dispatch 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed2260c640 / ms_dispatch 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed23e0f640 / io_context_pool 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee35bdc640 / msgr-worker-2 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee363dd640 / msgr-worker-1 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee36bde640 / msgr-worker-0 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee373df640 / io_context_pool 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee388d79c0 / radosgw-admin 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.108642.log 2024-08-27T02:55:52.216 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): handle_auth_done global_id 6851 payload 274 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:55:51.828+0000 7fee363dd640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: dump: 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.217 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6851 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:55:51.828+0000 7fed23e0f640 10 monclient: dump: 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.218 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:55:51.828+0000 7fee388d79c0 4 set_mon_vals no callback set 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: shutdown 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 asok(0x55d761ff0280) unregister_commands rotate-key 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.219 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding auth protocol: cephx 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding auth protocol: cephx 2024-08-27T02:55:52.220 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding auth protocol: cephx 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: crc 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d762227d00) adding con mode: secure 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:55:51.828+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: starting msgr at 2024-08-27T02:55:52.221 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: starting objecter 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command objecter_requests hook 0x55d76208af20 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: setting wanted keys 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:55:51.828+0000 7fee388d79c0 1 librados: calling monclient init 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding auth protocol: cephx 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding auth protocol: cephx 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding auth protocol: cephx 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.222 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: crc 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 AuthRegistry(0x55d7621faee0) adding con mode: secure 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:55:51.828+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:55:51.828+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:55:51.828+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key hook 0x55d7621fb028 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d762088ee0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d762141280 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d762144a00 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.223 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:55:51.828+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.711825s 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d762088ee0 auth_method 0 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:55:51.828+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): get_auth_request con 0x55d762141280 auth_method 0 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:55:51.828+0000 7fee35bdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.224 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient(hunting): handle_auth_done global_id 6854 payload 824 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:55:51.832+0000 7fee363dd640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:55:51.832+0000 7fee363dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: dump: 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.225 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:55:51.832+0000 7fed2260c640 10 monclient: dump: 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.226 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:55:51.832+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6854 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:55:51.832+0000 7fed23e0f640 4 set_mon_vals no callback set 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:55:51.832+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:55:51.832+0000 7fee388d79c0 1 librados: init done 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:55:51.832+0000 7fed2260c640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:55:51.832+0000 7fed2260c640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.227 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:55:51.832+0000 7fed2260c640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:55:51.832+0000 7fee35bdc640 10 monclient: get_auth_request con 0x7fed1c070ad0 auth_method 0 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:55:51.832+0000 7fee36bde640 10 monclient: get_auth_request con 0x55d76223bbe0 auth_method 0 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:55:51.836+0000 7fee363dd640 10 monclient: get_auth_request con 0x55d762245860 auth_method 0 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:55:51.836+0000 7fee35bdc640 10 monclient: get_auth_request con 0x55d76224a8f0 auth_method 0 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:55:51.836+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:55:51.836+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:55:51.836+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.228 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding auth protocol: cephx 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding auth protocol: cephx 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding auth protocol: cephx 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.229 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: crc 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:55:51.836+0000 7fee388d79c0 5 AuthRegistry(0x55d76224e880) adding con mode: secure 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:55:51.840+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command objecter_requests cmddesc objecter_requests hook 0x55d762252290 EEXIST 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding auth protocol: cephx 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding auth protocol: cephx 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding auth protocol: cephx 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.230 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: crc 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 AuthRegistry(0x55d76224d818) adding con mode: secure 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:55:51.840+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:55:51.840+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key cmddesc rotate-key hook 0x55d76224d960 EEXIST 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d762276440 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d762275d70 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.231 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d762274750 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.721026s 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): get_auth_request con 0x55d762274750 auth_method 0 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): get_auth_request con 0x55d762275d70 auth_method 0 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.232 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:55:51.840+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d762276440 auth_method 0 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:55:51.840+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient(hunting): handle_auth_done global_id 6857 payload 824 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:55:51.840+0000 7fee35bdc640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:55:51.840+0000 7fee35bdc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.233 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: dump: 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.234 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 10 monclient: dump: 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.235 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:55:51.840+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6857 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:55:51.840+0000 7fee373df640 4 set_mon_vals no callback set 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:55:51.840+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:55:51.840+0000 7fed1b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: get_monmap_and_config 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.236 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding auth protocol: cephx 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding auth protocol: cephx 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding auth protocol: cephx 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.237 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: crc 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762295e50) adding con mode: secure 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fed100709e0 auth_method 0 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding auth protocol: cephx 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding auth protocol: cephx 2024-08-27T02:55:52.238 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding auth protocol: cephx 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: crc 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffbb20) adding con mode: secure 2024-08-27T02:55:52.239 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key cmddesc rotate-key hook 0x7ffff9ffbc68 EEXIST 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d7622ca360 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d7622c5800 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d7622bbf70 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.725196s 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d7622ca360 auth_method 0 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.240 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request con 0x55d7622bbf70 auth_method 0 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient(hunting): handle_auth_done global_id 7221 payload 274 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:55:51.844+0000 7fee363dd640 1 monclient: found mon.noname-a 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:55:51.844+0000 7fee363dd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:55:52.241 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: dump: 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.242 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:55:51.844+0000 7fed197fa640 10 monclient: dump: 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.243 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 monclient: authenticate success, global_id 7221 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: get_monmap_and_config success 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:55:51.844+0000 7fee388d79c0 4 set_mon_vals no callback set 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: shutdown 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: build_initial_monmap 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 build_initial for_mkfs: 0 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: monmap: 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.244 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding auth protocol: cephx 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding auth protocol: cephx 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding auth protocol: cephx 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.245 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: crc 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762299e40) adding con mode: secure 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: starting msgr at 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: starting objecter 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command objecter_requests cmddesc objecter_requests hook 0x55d762274b70 EEXIST 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: setting wanted keys 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:55:51.844+0000 7fee388d79c0 1 librados: calling monclient init 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: init 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding auth protocol: cephx 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding auth protocol: cephx 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding auth protocol: cephx 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.246 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: crc 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 AuthRegistry(0x55d762278260) adding con mode: secure 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:55:51.844+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:55:51.844+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command rotate-key cmddesc rotate-key hook 0x55d7622783a8 EEXIST 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _reopen_session rank -1 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:55:52.247 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-b con 0x55d7622bbf70 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-a con 0x55d7622c5800 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): picked mon.noname-c con 0x55d7622ca360 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): _renew_subs 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:55:51.844+0000 7fee388d79c0 10 monclient(hunting): authenticate will time out at 2484.727736s 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): get_auth_request con 0x55d7622c5800 auth_method 0 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request con 0x55d7622ca360 auth_method 0 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.248 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:55:51.844+0000 7fee35bdc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:55:51.844+0000 7fee36bde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): get_auth_request con 0x55d7622bbf70 auth_method 0 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:55:51.848+0000 7fee363dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:55:51.848+0000 7fee36bde640 10 monclient(hunting): handle_auth_done global_id 6863 payload 824 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:55:51.848+0000 7fee36bde640 10 monclient: _finish_hunting 0 2024-08-27T02:55:52.249 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:55:51.848+0000 7fee36bde640 1 monclient: found mon.noname-c 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:55:51.848+0000 7fee36bde640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: dump: 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.250 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: _finish_auth 0 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: _check_auth_tickets 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: handle_config config(0 keys) 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:55:51.848+0000 7fed077fe640 10 monclient: dump: 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:55:52.251 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:55:51.848+0000 7fed197fa640 4 set_mon_vals no callback set 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:55:51.848+0000 7fee388d79c0 5 monclient: authenticate success, global_id 6863 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _renew_subs 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:55:51.848+0000 7fee388d79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:55:51.848+0000 7fee388d79c0 1 librados: init done 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:55:51.848+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cr dump hook 0x55d7622ba398 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:55:51.848+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:55:51.848+0000 7fed077fe640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:55:51.848+0000 7fed077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.252 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:55:51.848+0000 7fed077fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:55:51.852+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fed00070ad0 auth_method 0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:55:51.852+0000 7fee35bdc640 10 monclient: get_auth_request con 0x55d7622e3fb0 auth_method 0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 realm 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:55:51.852+0000 7fee388d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:55:51.852+0000 7fee363dd640 10 monclient: get_auth_request con 0x55d7622e81d0 auth_method 0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.253 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:55:51.852+0000 7fee388d79c0 20 searching for the correct realm 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:55:51.852+0000 7fee35bdc640 10 monclient: get_auth_request con 0x55d7622ed480 auth_method 0 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:55:51.856+0000 7fee36bde640 10 monclient: get_auth_request con 0x7fee24064560 auth_method 0 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:55:51.856+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fee301303b0 auth_method 0 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:55:51.856+0000 7fee35bdc640 10 monclient: get_auth_request con 0x7fee2802c060 auth_method 0 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:55:51.860+0000 7fee36bde640 10 monclient: get_auth_request con 0x7fee2406d050 auth_method 0 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:55:51.860+0000 7fee36bde640 0 -- 172.21.15.143:0/2931975444 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fee2406d050 msgr2=0x7fee2406d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:55:52.064+0000 7fee36bde640 10 monclient: get_auth_request con 0x7fee2406d050 auth_method 0 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:55:52.068+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fee240626d0 auth_method 0 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:55:52.076+0000 7fee363dd640 0 -- 172.21.15.143:0/2931975444 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55d7622e81d0 msgr2=0x55d7622ea600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:55:52.076+0000 7fed077fe640 1 client.6863.objecter ms_handle_reset 0x55d7622e81d0 session 0x55d7622e7b50 osd.5 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:55:52.076+0000 7fed077fe640 10 monclient: _renew_subs 2024-08-27T02:55:52.254 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:55:52.076+0000 7fed077fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:55:52.076+0000 7fee363dd640 10 monclient: get_auth_request con 0x7fed00081170 auth_method 0 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 zone default found 2024-08-27T02:55:52.255 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:55:52.084+0000 7fee388d79c0 4 Realm: () 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:55:52.084+0000 7fee388d79c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:55:52.084+0000 7fee388d79c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:55:52.084+0000 7fee388d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 zonegroup default 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:55:52.084+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 started sync module instance, tier type = 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:55:52.088+0000 7fee388d79c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=0 2024-08-27T02:55:52.256 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=1 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=2 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=3 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=4 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=5 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=6 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:55:52.112+0000 7fee388d79c0 20 add_watcher() i=7 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:55:52.112+0000 7fee388d79c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding auth protocol: cephx 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding auth protocol: cephx 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding auth protocol: cephx 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.257 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: crc 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 AuthRegistry(0x7ffff9ffc000) adding con mode: secure 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:55:52.116+0000 7fece77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:55:52.116+0000 7fee388d79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache list hook 0x55d7622c2a60 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache inspect hook 0x55d7622c2a60 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache erase hook 0x55d7622c2a60 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command cache zap hook 0x55d7622c2a60 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 note: GC not initialized 2024-08-27T02:55:52.258 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:55:52.116+0000 7fece67fc640 20 reqs_thread_entry: start 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace show hook 0x7fee28067120 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace history hook 0x7fee28067120 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace active hook 0x7fee28067120 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:55:52.116+0000 7fee388d79c0 5 asok(0x55d761ff0280) register_command sync trace active_short hook 0x7fee28067120 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:55:52.116+0000 7fee388d79c0 20 Filter name: none 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:55:52.116+0000 7fec57fff640 20 reqs_thread_entry: start 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 : miss 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.259 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:55:52.120+0000 7fee388d79c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:55:52.120+0000 7fee388d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:55:52.132+0000 7fee388d79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30, ofs0, ns] 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94383553591232 notifier 6863 bl.length()=923 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.260 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:55:52.132+0000 7fed18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_sources= new_sources= 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential sources added=[] removed=[] 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_dests= new_dests= 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:55:52.132+0000 7fee388d79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential dests added=[] removed=[] 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:55:52.140+0000 7fee388d79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee388d79c0 time 2024-08-27T02:55:52.145928+0000 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee3c1b12eb] 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.261 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:55:52.144+0000 7fee388d79c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fee388d79c0 thread_name:radosgw-admin 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee3b030520] 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:55:52.262 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee3c1b1345] 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee3c1b149f] 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d76021ab11] 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55d760c77736] 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d76023015d] 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee3b017d90] 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:55:52.263 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:55:52.264 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:55:52.265 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:55:52.266 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:55:52.267 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:55:52.268 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 7fec57fff640 / http_manager 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 7fece67fc640 / http_manager 2024-08-27T02:55:52.269 INFO:tasks.workunit.client.0.smithi143.stderr: 7fece77fe640 / rgw_dt_lg_renew 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed077fe640 / ms_dispatch 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed18ff9640 / io_context_pool 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed197fa640 / io_context_pool 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed1b7fe640 / ms_dispatch 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed2260c640 / ms_dispatch 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fed23e0f640 / io_context_pool 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee35bdc640 / msgr-worker-2 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee363dd640 / msgr-worker-1 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee36bde640 / msgr-worker-0 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee373df640 / io_context_pool 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: 7fee388d79c0 / radosgw-admin 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:55:52.148543Z_2ae0e3ef-81b1-4378-b0fe-3e61eb3a7f18/log 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:55:52.270 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:55:52.271 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-08-27T02:55:52.271 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:52.271 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:52.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.408+0000 7fddb11fa640 0 --2- 172.21.15.143:0/1522308437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5598ae4aee40 0x5598ae61f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-27T02:55:52.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 realm 2024-08-27T02:55:52.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:52.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.432+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.436+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.436+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.436+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:52.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.436+0000 7fddb3ef59c0 20 searching for the correct realm 2024-08-27T02:55:52.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.440+0000 7fddb19fb640 0 -- 172.21.15.143:0/522158860 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7fddac004040 msgr2=0x7fddac0d5910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:52.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.448+0000 7fddb21fc640 0 -- 172.21.15.143:0/522158860 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fdda8062b00 msgr2=0x7fdda806b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:52.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:52.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:52.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.456+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:52.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 zone default found 2024-08-27T02:55:52.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 4 Realm: () 2024-08-27T02:55:52.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:52.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:52.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:52.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 zonegroup default 2024-08-27T02:55:52.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 started sync module instance, tier type = 2024-08-27T02:55:52.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.460+0000 7fddb3ef59c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.476+0000 7fddb3ef59c0 20 add_watcher() i=0 2024-08-27T02:55:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.476+0000 7fddb3ef59c0 20 add_watcher() i=1 2024-08-27T02:55:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.476+0000 7fddb3ef59c0 20 add_watcher() i=2 2024-08-27T02:55:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.476+0000 7fddb3ef59c0 20 add_watcher() i=3 2024-08-27T02:55:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.476+0000 7fddb3ef59c0 20 add_watcher() i=4 2024-08-27T02:55:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.476+0000 7fddb3ef59c0 20 add_watcher() i=5 2024-08-27T02:55:52.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.476+0000 7fddb3ef59c0 20 add_watcher() i=6 2024-08-27T02:55:52.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.480+0000 7fddb3ef59c0 20 add_watcher() i=7 2024-08-27T02:55:52.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.480+0000 7fddb3ef59c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:52.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fdc637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:52.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:52.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:52.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 5 note: GC not initialized 2024-08-27T02:55:52.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fdc627fc640 20 reqs_thread_entry: start 2024-08-27T02:55:52.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:52.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 20 Filter name: none 2024-08-27T02:55:52.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fdbd3fff640 20 reqs_thread_entry: start 2024-08-27T02:55:52.486 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:52.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.484+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.488+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=447 2024-08-27T02:55:52.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.488+0000 7fddb3ef59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:52.488 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.488+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.488+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:52.489 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.488+0000 7fddb3ef59c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.488+0000 7fddb3ef59c0 20 rados_obj.operate() r=0 bl.length=447 2024-08-27T02:55:52.490 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.488+0000 7fddb3ef59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:55:52.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.492+0000 7fdc637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:52.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.496+0000 7fddb3ef59c0 20 remove_watcher() i=0 2024-08-27T02:55:52.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.496+0000 7fddb3ef59c0 2 removed watcher, disabling cache 2024-08-27T02:55:52.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.500+0000 7fddb3ef59c0 20 remove_watcher() i=1 2024-08-27T02:55:52.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.500+0000 7fddb3ef59c0 20 remove_watcher() i=2 2024-08-27T02:55:52.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.504+0000 7fddb3ef59c0 20 remove_watcher() i=3 2024-08-27T02:55:52.507 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.504+0000 7fddb3ef59c0 20 remove_watcher() i=4 2024-08-27T02:55:52.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.508+0000 7fddb3ef59c0 20 remove_watcher() i=5 2024-08-27T02:55:52.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.508+0000 7fddb3ef59c0 20 remove_watcher() i=6 2024-08-27T02:55:52.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.508+0000 7fddb3ef59c0 20 remove_watcher() i=7 2024-08-27T02:55:52.526 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:55:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-logrecord-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:55:52.527 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:55:52.625 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:55:52.659 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:55:52.659 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:55:52.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.700+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 realm 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.704+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.708+0000 7ff188d8f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:55:52.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.708+0000 7ff188d8f9c0 20 searching for the correct realm 2024-08-27T02:55:52.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.712+0000 7ff187096640 0 -- 172.21.15.143:0/1145998544 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7ff17c091170 msgr2=0x7ff17c08a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:52.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.928+0000 7ff186895640 0 -- 172.21.15.143:0/1145998544 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55e6feb12870 msgr2=0x55e6feb14ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:55:52.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:55:52.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:55:52.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:55:52.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:55:52.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:55:52.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:55:52.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:55:52.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 zone default found 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 4 Realm: () 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 zonegroup default 2024-08-27T02:55:52.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.936+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.940+0000 7ff188d8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.940+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.940+0000 7ff188d8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.940+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.940+0000 7ff188d8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:55:52.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.940+0000 7ff188d8f9c0 20 started sync module instance, tier type = 2024-08-27T02:55:52.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.940+0000 7ff188d8f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:55:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=0 2024-08-27T02:55:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=1 2024-08-27T02:55:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=2 2024-08-27T02:55:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=3 2024-08-27T02:55:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=4 2024-08-27T02:55:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=5 2024-08-27T02:55:52.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=6 2024-08-27T02:55:52.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 20 add_watcher() i=7 2024-08-27T02:55:52.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.964+0000 7ff188d8f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:55:52.970 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.968+0000 7ff03dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:52.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:55:52.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:55:52.971 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 5 note: GC not initialized 2024-08-27T02:55:52.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff03cfe1640 20 reqs_thread_entry: start 2024-08-27T02:55:52.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:55:52.972 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 Filter name: none 2024-08-27T02:55:52.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff035ffb640 20 reqs_thread_entry: start 2024-08-27T02:55:52.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-08-27T02:55:52.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:55:52.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-08-27T02:55:52.973 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-08-27T02:55:52.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 : miss 2024-08-27T02:55:52.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:55:52.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-08-27T02:55:52.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:55:52.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:55:52.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:55:52.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:55:52.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.972+0000 7ff188d8f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 2024-08-27T02:55:52.976 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.976+0000 7ff188d8f9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to be held by another RGW process; skipping for now 2024-08-27T02:55:52.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.976+0000 7ff03dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:55:52.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.980+0000 7ff188d8f9c0 20 remove_watcher() i=0 2024-08-27T02:55:52.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.980+0000 7ff188d8f9c0 2 removed watcher, disabling cache 2024-08-27T02:55:52.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.984+0000 7ff188d8f9c0 20 remove_watcher() i=1 2024-08-27T02:55:52.987 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.984+0000 7ff188d8f9c0 20 remove_watcher() i=2 2024-08-27T02:55:52.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.988+0000 7ff188d8f9c0 20 remove_watcher() i=3 2024-08-27T02:55:52.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.988+0000 7ff188d8f9c0 20 remove_watcher() i=4 2024-08-27T02:55:52.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.992+0000 7ff188d8f9c0 20 remove_watcher() i=5 2024-08-27T02:55:52.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.992+0000 7ff188d8f9c0 20 remove_watcher() i=6 2024-08-27T02:55:52.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:55:52.996+0000 7ff188d8f9c0 20 remove_watcher() i=7 2024-08-27T02:55:53.012 INFO:tasks.workunit.client.0.smithi143.stderr:waiting 30 seconds for reshard lock to expire... 2024-08-27T02:56:23.021 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:56:23.057 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:23.057 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:23.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.103+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 realm 2024-08-27T02:56:23.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:23.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:23.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.107+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.111+0000 7f6bf99269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:23.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.111+0000 7f6bf99269c0 20 searching for the correct realm 2024-08-27T02:56:23.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.115+0000 7f6bf7c2d640 0 -- 172.21.15.143:0/3309135481 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x56487d1975e0 msgr2=0x56487d199a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:23.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.123+0000 7f6bf742c640 0 -- 172.21.15.143:0/3309135481 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f6bec070f90 msgr2=0x7f6bec0277e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:23.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.127+0000 7f6bf99269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:23.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.127+0000 7f6bf99269c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:23.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.127+0000 7f6bf99269c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:23.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.127+0000 7f6bf99269c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:23.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.127+0000 7f6bf99269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:23.127 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.127+0000 7f6bf99269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:23.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.127+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:23.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:23.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 zone default found 2024-08-27T02:56:23.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 4 Realm: () 2024-08-27T02:56:23.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:23.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:23.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:23.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 zonegroup default 2024-08-27T02:56:23.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 started sync module instance, tier type = 2024-08-27T02:56:23.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.131+0000 7f6bf99269c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:23.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.147+0000 7f6bf99269c0 20 add_watcher() i=0 2024-08-27T02:56:23.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.147+0000 7f6bf99269c0 20 add_watcher() i=1 2024-08-27T02:56:23.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.147+0000 7f6bf99269c0 20 add_watcher() i=2 2024-08-27T02:56:23.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.147+0000 7f6bf99269c0 20 add_watcher() i=3 2024-08-27T02:56:23.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.147+0000 7f6bf99269c0 20 add_watcher() i=4 2024-08-27T02:56:23.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.147+0000 7f6bf99269c0 20 add_watcher() i=5 2024-08-27T02:56:23.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.147+0000 7f6bf99269c0 20 add_watcher() i=6 2024-08-27T02:56:23.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6bf99269c0 20 add_watcher() i=7 2024-08-27T02:56:23.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6bf99269c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:23.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6aadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:23.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6bf99269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:23.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6bf99269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:23.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6bf99269c0 5 note: GC not initialized 2024-08-27T02:56:23.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6aacfe1640 20 reqs_thread_entry: start 2024-08-27T02:56:23.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.151+0000 7f6bf99269c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:23.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 20 Filter name: none 2024-08-27T02:56:23.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6a267fc640 20 reqs_thread_entry: start 2024-08-27T02:56:23.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-08-27T02:56:23.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:56:23.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-08-27T02:56:23.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-08-27T02:56:23.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 : miss 2024-08-27T02:56:23.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 20 rados_obj.operate() r=0 bl.length=447 2024-08-27T02:56:23.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:56:23.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:56:23.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:23.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:23.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 2024-08-27T02:56:23.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.155+0000 7f6bf99269c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30, ofs0, ns] 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6adaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 94869336516704 notifier 7281 bl.length()=923 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6adaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6adaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:56:23.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6adaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_sources= new_sources= 2024-08-27T02:56:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential sources added=[] removed=[] 2024-08-27T02:56:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_dests= new_dests= 2024-08-27T02:56:23.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.171+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential dests added=[] removed=[] 2024-08-27T02:56:23.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.0 2024-08-27T02:56:23.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.0 2024-08-27T02:56:23.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.1 2024-08-27T02:56:23.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.1 2024-08-27T02:56:23.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.2 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.2 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.3 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.3 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.4 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.4 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.5 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.5 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.6 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.6 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.7 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.7 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.8 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.8 2024-08-27T02:56:23.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.9 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.9 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.10 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.10 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.11 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2.11 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.183+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.0 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.187+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.1 2024-08-27T02:56:23.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.187+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2 2024-08-27T02:56:23.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.187+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.3 2024-08-27T02:56:23.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.187+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.4 2024-08-27T02:56:23.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.187+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.5 2024-08-27T02:56:23.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.187+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.6 2024-08-27T02:56:23.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.187+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.7 2024-08-27T02:56:23.188 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.191+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.8 2024-08-27T02:56:23.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.191+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.9 2024-08-27T02:56:23.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.195+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.10 2024-08-27T02:56:23.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.199+0000 7f6bf99269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 : hit (requested=0x17, cached=0x17) 2024-08-27T02:56:23.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.199+0000 7f6bf99269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 2024-08-27T02:56:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6bf99269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:56:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6bf99269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:56:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6bf99269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6bf99269c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30, ofs0, ns] 2024-08-27T02:56:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6ada7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366252 cookie 94869336516704 notifier 7281 bl.length()=923 2024-08-27T02:56:23.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6ada7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:56:23.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6ada7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:56:23.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.203+0000 7f6ada7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:23.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.207+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_sources= new_sources= 2024-08-27T02:56:23.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.207+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential sources added=[] removed=[] 2024-08-27T02:56:23.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.207+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_dests= new_dests= 2024-08-27T02:56:23.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.207+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential dests added=[] removed=[] 2024-08-27T02:56:23.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.211+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.0 2024-08-27T02:56:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.211+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.1 2024-08-27T02:56:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.211+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.2 2024-08-27T02:56:23.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.211+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.3 2024-08-27T02:56:23.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.215+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.4 2024-08-27T02:56:23.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.215+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.5 2024-08-27T02:56:23.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.215+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.6 2024-08-27T02:56:23.212 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.215+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.7 2024-08-27T02:56:23.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.215+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.8 2024-08-27T02:56:23.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.215+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.9 2024-08-27T02:56:23.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.215+0000 7f6bf99269c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30.10 2024-08-27T02:56:23.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6bf99269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 : hit (requested=0x17, cached=0x17) 2024-08-27T02:56:23.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6bf99269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 2024-08-27T02:56:23.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6bf99269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:56:23.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6bf99269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:56:23.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6bf99269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6bf99269c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30, ofs0, ns] 2024-08-27T02:56:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6ada7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 94869336516704 notifier 7281 bl.length()=891 2024-08-27T02:56:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6ada7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 info.flags=0x17 2024-08-27T02:56:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6ada7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 to cache LRU end 2024-08-27T02:56:23.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.219+0000 7f6ada7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:23.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.223+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_sources= new_sources= 2024-08-27T02:56:23.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.223+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential sources added=[] removed=[] 2024-08-27T02:56:23.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.223+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): orig_dests= new_dests= 2024-08-27T02:56:23.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.223+0000 7f6bf99269c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30]): potential dests added=[] removed=[] 2024-08-27T02:56:23.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.227+0000 7f6bf99269c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-08-27T02:56:23.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.231+0000 7f6aadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:23.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.235+0000 7f6bf99269c0 20 remove_watcher() i=0 2024-08-27T02:56:23.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.235+0000 7f6bf99269c0 2 removed watcher, disabling cache 2024-08-27T02:56:23.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.239+0000 7f6bf99269c0 20 remove_watcher() i=1 2024-08-27T02:56:23.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.239+0000 7f6bf99269c0 20 remove_watcher() i=2 2024-08-27T02:56:23.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.243+0000 7f6bf99269c0 20 remove_watcher() i=3 2024-08-27T02:56:23.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.243+0000 7f6bf99269c0 20 remove_watcher() i=4 2024-08-27T02:56:23.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.243+0000 7f6bf99269c0 20 remove_watcher() i=5 2024-08-27T02:56:23.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.247+0000 7f6bf99269c0 20 remove_watcher() i=6 2024-08-27T02:56:23.245 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.247+0000 7f6bf99269c0 20 remove_watcher() i=7 2024-08-27T02:56:23.261 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-08-27T02:56:23.288 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:23.288 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:23.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.331+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 realm 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.332 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:23.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:23.334 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.335+0000 7f2ef9ac19c0 20 searching for the correct realm 2024-08-27T02:56:23.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.547+0000 7f2ef7dc8640 0 -- 172.21.15.143:0/579852402 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x555df31abd10 msgr2=0x555df31ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:23.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.559+0000 7f2ef6dc6640 0 -- 172.21.15.143:0/579852402 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f2ee80f6bb0 msgr2=0x7f2ee80fe8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:23.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:23.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 zone default found 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 4 Realm: () 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 zonegroup default 2024-08-27T02:56:23.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.571+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.575+0000 7f2ef9ac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.575+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.575+0000 7f2ef9ac19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:23.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.575+0000 7f2ef9ac19c0 20 started sync module instance, tier type = 2024-08-27T02:56:23.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.575+0000 7f2ef9ac19c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:23.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=0 2024-08-27T02:56:23.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=1 2024-08-27T02:56:23.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=2 2024-08-27T02:56:23.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=3 2024-08-27T02:56:23.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=4 2024-08-27T02:56:23.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=5 2024-08-27T02:56:23.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=6 2024-08-27T02:56:23.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 20 add_watcher() i=7 2024-08-27T02:56:23.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.599+0000 7f2ef9ac19c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:23.601 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.603+0000 7f2dadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:23.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.603+0000 7f2ef9ac19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:23.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.603+0000 7f2ef9ac19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:23.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.603+0000 7f2ef9ac19c0 5 note: GC not initialized 2024-08-27T02:56:23.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.603+0000 7f2dacfe1640 20 reqs_thread_entry: start 2024-08-27T02:56:23.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.603+0000 7f2ef9ac19c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:23.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 Filter name: none 2024-08-27T02:56:23.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2d267fc640 20 reqs_thread_entry: start 2024-08-27T02:56:23.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:56:23.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:56:23.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:23.606 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=193 2024-08-27T02:56:23.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.607+0000 7f2ef9ac19c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:23.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.611+0000 7f2ef9ac19c0 20 rados_obj.operate() r=0 bl.length=415 2024-08-27T02:56:23.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.611+0000 7f2ef9ac19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:23.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.615+0000 7f2dadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:23.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.619+0000 7f2ef9ac19c0 20 remove_watcher() i=0 2024-08-27T02:56:23.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.619+0000 7f2ef9ac19c0 2 removed watcher, disabling cache 2024-08-27T02:56:23.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.619+0000 7f2ef9ac19c0 20 remove_watcher() i=1 2024-08-27T02:56:23.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.623+0000 7f2ef9ac19c0 20 remove_watcher() i=2 2024-08-27T02:56:23.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.623+0000 7f2ef9ac19c0 20 remove_watcher() i=3 2024-08-27T02:56:23.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.627+0000 7f2ef9ac19c0 20 remove_watcher() i=4 2024-08-27T02:56:23.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.627+0000 7f2ef9ac19c0 20 remove_watcher() i=5 2024-08-27T02:56:23.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.631+0000 7f2ef9ac19c0 20 remove_watcher() i=6 2024-08-27T02:56:23.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:23.631+0000 7f2ef9ac19c0 20 remove_watcher() i=7 2024-08-27T02:56:23.646 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:23.646 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:23.646 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-logrecord-writes id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:56:23.646 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:24.566 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-08-27T02:56:24.566 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:26.760 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-08-27T02:56:26.795 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:26.795 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:26.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:26.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 realm 2024-08-27T02:56:26.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:26.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:26.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:26.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.843+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.847+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:26.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.847+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.847+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:26.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.847+0000 7f47b0a8d9c0 20 searching for the correct realm 2024-08-27T02:56:26.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.851+0000 7f47aed94640 0 -- 172.21.15.143:0/3727738670 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x5569f22dd160 msgr2=0x5569f22df590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:26.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.859+0000 7f47a7fff640 0 -- 172.21.15.143:0/3727738670 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f47a0130c20 msgr2=0x7f47a011d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:26.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:26.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:26.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:26.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 zone default found 2024-08-27T02:56:26.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 4 Realm: () 2024-08-27T02:56:26.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:26.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:26.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:26.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 zonegroup default 2024-08-27T02:56:26.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:26.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:26.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:26.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 started sync module instance, tier type = 2024-08-27T02:56:26.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.867+0000 7f47b0a8d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:26.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=0 2024-08-27T02:56:26.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=1 2024-08-27T02:56:26.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=2 2024-08-27T02:56:26.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=3 2024-08-27T02:56:26.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=4 2024-08-27T02:56:26.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=5 2024-08-27T02:56:26.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=6 2024-08-27T02:56:26.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 20 add_watcher() i=7 2024-08-27T02:56:26.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f47b0a8d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:26.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.887+0000 7f4664fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 5 note: GC not initialized 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f45df7fe640 20 reqs_thread_entry: start 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 Filter name: none 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f45dd7fa640 20 reqs_thread_entry: start 2024-08-27T02:56:26.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:26.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:26.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:26.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.891+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.895+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:26.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.895+0000 7f47b0a8d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:26.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.895+0000 7f47b0a8d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:26.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.895+0000 7f47b0a8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:26.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.899+0000 7f4664fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:26.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.903+0000 7f47b0a8d9c0 20 remove_watcher() i=0 2024-08-27T02:56:26.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.903+0000 7f47b0a8d9c0 2 removed watcher, disabling cache 2024-08-27T02:56:26.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.903+0000 7f47b0a8d9c0 20 remove_watcher() i=1 2024-08-27T02:56:26.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.907+0000 7f47b0a8d9c0 20 remove_watcher() i=2 2024-08-27T02:56:26.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.907+0000 7f47b0a8d9c0 20 remove_watcher() i=3 2024-08-27T02:56:26.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.911+0000 7f47b0a8d9c0 20 remove_watcher() i=4 2024-08-27T02:56:26.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.911+0000 7f47b0a8d9c0 20 remove_watcher() i=5 2024-08-27T02:56:26.910 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.911+0000 7f47b0a8d9c0 20 remove_watcher() i=6 2024-08-27T02:56:26.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:26.915+0000 7f47b0a8d9c0 20 remove_watcher() i=7 2024-08-27T02:56:26.925 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:26.925 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:26.925 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:56:26.925 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:26.925 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-08-27T02:56:26.958 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:26.958 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:26.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 realm 2024-08-27T02:56:27.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:27.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.003+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.007+0000 7f68d62ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:27.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.007+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.007+0000 7f68d62ba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:27.004 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.007+0000 7f68d62ba9c0 20 searching for the correct realm 2024-08-27T02:56:27.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.015+0000 7f68d45c1640 0 -- 172.21.15.143:0/566093105 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f68c8008030 msgr2=0x7f68c8049940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:56:27.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.231+0000 7f68d3dc0640 0 -- 172.21.15.143:0/566093105 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55def136ba20 msgr2=0x55def136de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:27.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:27.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:27.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:27.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:27.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:27.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:27.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.239+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:27.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:27.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 zone default found 2024-08-27T02:56:27.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 4 Realm: () 2024-08-27T02:56:27.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:27.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:27.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:27.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 zonegroup default 2024-08-27T02:56:27.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.243+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.247+0000 7f68d62ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.247+0000 7f68d62ba9c0 20 started sync module instance, tier type = 2024-08-27T02:56:27.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.247+0000 7f68d62ba9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:27.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.267+0000 7f68d62ba9c0 20 add_watcher() i=0 2024-08-27T02:56:27.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.267+0000 7f68d62ba9c0 20 add_watcher() i=1 2024-08-27T02:56:27.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.267+0000 7f68d62ba9c0 20 add_watcher() i=2 2024-08-27T02:56:27.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.267+0000 7f68d62ba9c0 20 add_watcher() i=3 2024-08-27T02:56:27.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.267+0000 7f68d62ba9c0 20 add_watcher() i=4 2024-08-27T02:56:27.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.267+0000 7f68d62ba9c0 20 add_watcher() i=5 2024-08-27T02:56:27.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.267+0000 7f68d62ba9c0 20 add_watcher() i=6 2024-08-27T02:56:27.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.271+0000 7f68d62ba9c0 20 add_watcher() i=7 2024-08-27T02:56:27.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.271+0000 7f68d62ba9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:27.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.275+0000 7f6789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:27.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.275+0000 7f68d62ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:27.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.275+0000 7f68d62ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:27.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.275+0000 7f68d62ba9c0 5 note: GC not initialized 2024-08-27T02:56:27.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.275+0000 7f6788fe1640 20 reqs_thread_entry: start 2024-08-27T02:56:27.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:27.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 20 Filter name: none 2024-08-27T02:56:27.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f67027fc640 20 reqs_thread_entry: start 2024-08-27T02:56:27.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-08-27T02:56:27.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:27.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-08-27T02:56:27.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-08-27T02:56:27.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 : miss 2024-08-27T02:56:27.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:27.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:27.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:27.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:27.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:27.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.279+0000 7f68d62ba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 2024-08-27T02:56:27.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f68d62ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:27.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f68d62ba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:27.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f68d62ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:27.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f68d62ba9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31, ofs0, ns] 2024-08-27T02:56:27.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f67b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 94416018048528 notifier 6965 bl.length()=931 2024-08-27T02:56:27.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f67b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:27.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f67b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:27.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.291+0000 7f67b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:27.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.295+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_sources= new_sources= 2024-08-27T02:56:27.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.295+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential sources added=[] removed=[] 2024-08-27T02:56:27.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.295+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_dests= new_dests= 2024-08-27T02:56:27.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.295+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential dests added=[] removed=[] 2024-08-27T02:56:27.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.0 2024-08-27T02:56:27.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.0 2024-08-27T02:56:27.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.1 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.1 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.2 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.2 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.3 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.3 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.4 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.4 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.5 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.5 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.6 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.6 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.7 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.7 2024-08-27T02:56:27.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.8 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.8 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.9 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.9 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.10 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.10 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.11 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.11 2024-08-27T02:56:27.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.0 2024-08-27T02:56:27.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1 2024-08-27T02:56:27.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.2 2024-08-27T02:56:27.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.3 2024-08-27T02:56:27.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.307+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.4 2024-08-27T02:56:27.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.311+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.5 2024-08-27T02:56:27.308 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.311+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.6 2024-08-27T02:56:27.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.311+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.7 2024-08-27T02:56:27.311 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.315+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.8 2024-08-27T02:56:27.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.315+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.9 2024-08-27T02:56:27.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.315+0000 7f68d62ba9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.10 2024-08-27T02:56:27.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.323+0000 7f68d62ba9c0 -1 Injecting error=-5 at location=change_reshard_state 2024-08-27T02:56:27.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.323+0000 7f68d62ba9c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-08-27T02:56:27.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.343+0000 7f68d62ba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 : hit (requested=0x17, cached=0x17) 2024-08-27T02:56:27.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.343+0000 7f68d62ba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 2024-08-27T02:56:27.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:27.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:27.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:27.344 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31, ofs0, ns] 2024-08-27T02:56:27.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f67b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366258 cookie 94416018048528 notifier 6965 bl.length()=899 2024-08-27T02:56:27.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f67b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:27.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f67b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:27.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f67b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:27.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_sources= new_sources= 2024-08-27T02:56:27.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential sources added=[] removed=[] 2024-08-27T02:56:27.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_dests= new_dests= 2024-08-27T02:56:27.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential dests added=[] removed=[] 2024-08-27T02:56:27.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.347+0000 7f68d62ba9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-08-27T02:56:27.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.351+0000 7f6789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:27.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.359+0000 7f68d62ba9c0 20 remove_watcher() i=0 2024-08-27T02:56:27.356 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.359+0000 7f68d62ba9c0 2 removed watcher, disabling cache 2024-08-27T02:56:27.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.359+0000 7f68d62ba9c0 20 remove_watcher() i=1 2024-08-27T02:56:27.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.363+0000 7f68d62ba9c0 20 remove_watcher() i=2 2024-08-27T02:56:27.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.363+0000 7f68d62ba9c0 20 remove_watcher() i=3 2024-08-27T02:56:27.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.367+0000 7f68d62ba9c0 20 remove_watcher() i=4 2024-08-27T02:56:27.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.367+0000 7f68d62ba9c0 20 remove_watcher() i=5 2024-08-27T02:56:27.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.367+0000 7f68d62ba9c0 20 remove_watcher() i=6 2024-08-27T02:56:27.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.371+0000 7f68d62ba9c0 20 remove_watcher() i=7 2024-08-27T02:56:27.383 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-08-27T02:56:27.413 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:27.413 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:27.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.455+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 realm 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:27.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.459+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.463+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:27.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.463+0000 7f77c3b779c0 20 searching for the correct realm 2024-08-27T02:56:27.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.467+0000 7f77c0e7c640 0 -- 172.21.15.143:0/3787905980 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f77b40de070 msgr2=0x7f77b40df400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:27.472 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.475+0000 7f77c0e7c640 0 -- 172.21.15.143:0/3787905980 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f768c081140 msgr2=0x7f768c083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:27.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:27.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:27.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 zone default found 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 4 Realm: () 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 zonegroup default 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 started sync module instance, tier type = 2024-08-27T02:56:27.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.483+0000 7f77c3b779c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=0 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=1 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=2 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=3 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=4 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=5 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=6 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 20 add_watcher() i=7 2024-08-27T02:56:27.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.499+0000 7f77c3b779c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:27.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f76777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 5 note: GC not initialized 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f76767e4640 20 reqs_thread_entry: start 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 20 Filter name: none 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f75e7fff640 20 reqs_thread_entry: start 2024-08-27T02:56:27.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:27.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.503+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.507+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:27.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.507+0000 7f77c3b779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:27.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.507+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.507+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:27.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.507+0000 7f77c3b779c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.507+0000 7f77c3b779c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:27.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.507+0000 7f77c3b779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:27.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.511+0000 7f76777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:27.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.515+0000 7f77c3b779c0 20 remove_watcher() i=0 2024-08-27T02:56:27.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.515+0000 7f77c3b779c0 2 removed watcher, disabling cache 2024-08-27T02:56:27.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.519+0000 7f77c3b779c0 20 remove_watcher() i=1 2024-08-27T02:56:27.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.519+0000 7f77c3b779c0 20 remove_watcher() i=2 2024-08-27T02:56:27.519 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.523+0000 7f77c3b779c0 20 remove_watcher() i=3 2024-08-27T02:56:27.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.523+0000 7f77c3b779c0 20 remove_watcher() i=4 2024-08-27T02:56:27.522 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.523+0000 7f77c3b779c0 20 remove_watcher() i=5 2024-08-27T02:56:27.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.527+0000 7f77c3b779c0 20 remove_watcher() i=6 2024-08-27T02:56:27.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.527+0000 7f77c3b779c0 20 remove_watcher() i=7 2024-08-27T02:56:27.538 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:27.538 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:27.538 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:56:27.538 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:27.641 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:56:27.677 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:27.677 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:27.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 realm 2024-08-27T02:56:27.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:27.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:27.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.935+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.939+0000 7fb70f8cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:27.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.939+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:27.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.939+0000 7fb70f8cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:27.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.939+0000 7fb70f8cd9c0 20 searching for the correct realm 2024-08-27T02:56:27.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:27.939+0000 7fb70dbd4640 0 -- 172.21.15.143:0/1555936697 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fb6f8024070 msgr2=0x7fb6f807b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:28.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.555+0000 7fb70dbd4640 0 -- 172.21.15.143:0/1555936697 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fb6f807dc70 msgr2=0x7fb6f8019040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:28.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:28.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:28.778 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 zone default found 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 4 Realm: () 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 zonegroup default 2024-08-27T02:56:28.779 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.779+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.783+0000 7fb70f8cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:28.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.783+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.780 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.783+0000 7fb70f8cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:28.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.783+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.783+0000 7fb70f8cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:28.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.783+0000 7fb70f8cd9c0 20 started sync module instance, tier type = 2024-08-27T02:56:28.781 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.783+0000 7fb70f8cd9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:28.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.807+0000 7fb70f8cd9c0 20 add_watcher() i=0 2024-08-27T02:56:28.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.807+0000 7fb70f8cd9c0 20 add_watcher() i=1 2024-08-27T02:56:28.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.807+0000 7fb70f8cd9c0 20 add_watcher() i=2 2024-08-27T02:56:28.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.807+0000 7fb70f8cd9c0 20 add_watcher() i=3 2024-08-27T02:56:28.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.807+0000 7fb70f8cd9c0 20 add_watcher() i=4 2024-08-27T02:56:28.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.807+0000 7fb70f8cd9c0 20 add_watcher() i=5 2024-08-27T02:56:28.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.807+0000 7fb70f8cd9c0 20 add_watcher() i=6 2024-08-27T02:56:28.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.811+0000 7fb70f8cd9c0 20 add_watcher() i=7 2024-08-27T02:56:28.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.811+0000 7fb70f8cd9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:28.812 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb5c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:28.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb70f8cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:28.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb70f8cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:28.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb70f8cd9c0 5 note: GC not initialized 2024-08-27T02:56:28.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb5c27e4640 20 reqs_thread_entry: start 2024-08-27T02:56:28.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb70f8cd9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:28.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb70f8cd9c0 20 Filter name: none 2024-08-27T02:56:28.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb533fff640 20 reqs_thread_entry: start 2024-08-27T02:56:28.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb70f8cd9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-08-27T02:56:28.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.815+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:28.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-08-27T02:56:28.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-08-27T02:56:28.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 : miss 2024-08-27T02:56:28.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:28.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:28.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:28.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:28.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:28.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:28.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.819+0000 7fb70f8cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 2024-08-27T02:56:28.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb70f8cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:28.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb70f8cd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:28.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb70f8cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:28.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb70f8cd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31, ofs0, ns] 2024-08-27T02:56:28.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb5f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366259 cookie 94562085101760 notifier 7374 bl.length()=931 2024-08-27T02:56:28.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb5f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:28.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb5f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:28.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.827+0000 7fb5f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:28.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.831+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_sources= new_sources= 2024-08-27T02:56:28.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.831+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential sources added=[] removed=[] 2024-08-27T02:56:28.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.831+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_dests= new_dests= 2024-08-27T02:56:28.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.831+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential dests added=[] removed=[] 2024-08-27T02:56:28.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.0 2024-08-27T02:56:28.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.0 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.1 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.1 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.2 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.2 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.3 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.3 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.4 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.4 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.5 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.5 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.6 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.6 2024-08-27T02:56:28.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.7 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.7 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.8 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.8 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.9 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.9 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.10 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.10 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.11 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1.11 2024-08-27T02:56:28.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.0 2024-08-27T02:56:28.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.843+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1 2024-08-27T02:56:28.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.847+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.2 2024-08-27T02:56:28.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.847+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.3 2024-08-27T02:56:28.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.847+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.4 2024-08-27T02:56:28.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.847+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.5 2024-08-27T02:56:28.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.851+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.6 2024-08-27T02:56:28.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.851+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.7 2024-08-27T02:56:28.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.851+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.8 2024-08-27T02:56:28.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.855+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.9 2024-08-27T02:56:28.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.855+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.10 2024-08-27T02:56:28.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.859+0000 7fb70f8cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 : hit (requested=0x17, cached=0x17) 2024-08-27T02:56:28.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.859+0000 7fb70f8cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 2024-08-27T02:56:28.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb70f8cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:28.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb70f8cd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:28.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb70f8cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:28.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb70f8cd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31, ofs0, ns] 2024-08-27T02:56:28.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb5f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366260 cookie 94562085101760 notifier 7374 bl.length()=931 2024-08-27T02:56:28.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb5f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:28.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb5f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:28.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.863+0000 7fb5f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:28.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.867+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_sources= new_sources= 2024-08-27T02:56:28.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.867+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential sources added=[] removed=[] 2024-08-27T02:56:28.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.867+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_dests= new_dests= 2024-08-27T02:56:28.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.867+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential dests added=[] removed=[] 2024-08-27T02:56:28.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.871+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.0 2024-08-27T02:56:28.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.871+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.1 2024-08-27T02:56:28.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.875+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.2 2024-08-27T02:56:28.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.875+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.3 2024-08-27T02:56:28.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.875+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.4 2024-08-27T02:56:28.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.875+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.5 2024-08-27T02:56:28.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.875+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.6 2024-08-27T02:56:28.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.875+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.7 2024-08-27T02:56:28.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.879+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.8 2024-08-27T02:56:28.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.879+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.9 2024-08-27T02:56:28.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.879+0000 7fb70f8cd9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31.10 2024-08-27T02:56:28.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.879+0000 7fb70f8cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 : hit (requested=0x17, cached=0x17) 2024-08-27T02:56:28.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.879+0000 7fb70f8cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 2024-08-27T02:56:28.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:28.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:28.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:28.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31, ofs0, ns] 2024-08-27T02:56:28.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb5dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 94562085101760 notifier 7374 bl.length()=899 2024-08-27T02:56:28.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb5dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 info.flags=0x17 2024-08-27T02:56:28.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb5dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 to cache LRU end 2024-08-27T02:56:28.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb5dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:28.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_sources= new_sources= 2024-08-27T02:56:28.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential sources added=[] removed=[] 2024-08-27T02:56:28.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): orig_dests= new_dests= 2024-08-27T02:56:28.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.883+0000 7fb70f8cd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31]): potential dests added=[] removed=[] 2024-08-27T02:56:28.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.891+0000 7fb70f8cd9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-08-27T02:56:28.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.895+0000 7fb5c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:28.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.903+0000 7fb70f8cd9c0 20 remove_watcher() i=0 2024-08-27T02:56:28.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.903+0000 7fb70f8cd9c0 2 removed watcher, disabling cache 2024-08-27T02:56:28.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.903+0000 7fb70f8cd9c0 20 remove_watcher() i=1 2024-08-27T02:56:28.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.907+0000 7fb70f8cd9c0 20 remove_watcher() i=2 2024-08-27T02:56:28.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.907+0000 7fb70f8cd9c0 20 remove_watcher() i=3 2024-08-27T02:56:28.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.911+0000 7fb70f8cd9c0 20 remove_watcher() i=4 2024-08-27T02:56:28.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.911+0000 7fb70f8cd9c0 20 remove_watcher() i=5 2024-08-27T02:56:28.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.915+0000 7fb70f8cd9c0 20 remove_watcher() i=6 2024-08-27T02:56:28.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:28.915+0000 7fb70f8cd9c0 20 remove_watcher() i=7 2024-08-27T02:56:28.929 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-08-27T02:56:28.959 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:28.959 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:29.003 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:29.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 realm 2024-08-27T02:56:29.005 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:29.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:29.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:29.006 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.007+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.011+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:29.007 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.011+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.011+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:29.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.011+0000 7f2e84ade9c0 20 searching for the correct realm 2024-08-27T02:56:29.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.015+0000 7f2e825e4640 0 -- 172.21.15.143:0/2011697121 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f2e7402f040 msgr2=0x7f2e7402f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:29.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.019+0000 7f2e82de5640 0 -- 172.21.15.143:0/2011697121 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f2e78117bd0 msgr2=0x7f2e78101170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:29.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:29.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:29.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:29.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:29.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:29.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:29.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:29.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 zone default found 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 4 Realm: () 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 zonegroup default 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.030 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:29.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:29.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:29.031 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 started sync module instance, tier type = 2024-08-27T02:56:29.032 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.031+0000 7f2e84ade9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:29.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.047+0000 7f2e84ade9c0 20 add_watcher() i=0 2024-08-27T02:56:29.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.047+0000 7f2e84ade9c0 20 add_watcher() i=1 2024-08-27T02:56:29.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.047+0000 7f2e84ade9c0 20 add_watcher() i=2 2024-08-27T02:56:29.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.047+0000 7f2e84ade9c0 20 add_watcher() i=3 2024-08-27T02:56:29.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.047+0000 7f2e84ade9c0 20 add_watcher() i=4 2024-08-27T02:56:29.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.047+0000 7f2e84ade9c0 20 add_watcher() i=5 2024-08-27T02:56:29.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.047+0000 7f2e84ade9c0 20 add_watcher() i=6 2024-08-27T02:56:29.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.051+0000 7f2e84ade9c0 20 add_watcher() i=7 2024-08-27T02:56:29.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.051+0000 7f2e84ade9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:29.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.051+0000 7f2d38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:29.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:29.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:29.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 5 note: GC not initialized 2024-08-27T02:56:29.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2cb37fe640 20 reqs_thread_entry: start 2024-08-27T02:56:29.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:29.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 Filter name: none 2024-08-27T02:56:29.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2cb17fa640 20 reqs_thread_entry: start 2024-08-27T02:56:29.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:29.053 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:29.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:29.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.055+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.059+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:29.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.059+0000 7f2e84ade9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:29.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.059+0000 7f2e84ade9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:29.056 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.059+0000 7f2e84ade9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:29.059 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.059+0000 7f2d38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:29.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.067+0000 7f2e84ade9c0 20 remove_watcher() i=0 2024-08-27T02:56:29.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.067+0000 7f2e84ade9c0 2 removed watcher, disabling cache 2024-08-27T02:56:29.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.067+0000 7f2e84ade9c0 20 remove_watcher() i=1 2024-08-27T02:56:29.067 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.071+0000 7f2e84ade9c0 20 remove_watcher() i=2 2024-08-27T02:56:29.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.071+0000 7f2e84ade9c0 20 remove_watcher() i=3 2024-08-27T02:56:29.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.075+0000 7f2e84ade9c0 20 remove_watcher() i=4 2024-08-27T02:56:29.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.075+0000 7f2e84ade9c0 20 remove_watcher() i=5 2024-08-27T02:56:29.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.075+0000 7f2e84ade9c0 20 remove_watcher() i=6 2024-08-27T02:56:29.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:29.075+0000 7f2e84ade9c0 20 remove_watcher() i=7 2024-08-27T02:56:29.088 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:29.088 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:29.089 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:56:29.089 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:29.987 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-08-27T02:56:29.987 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-08-27T02:56:32.221 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:32.222 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:32.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.267+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 realm 2024-08-27T02:56:32.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:32.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:32.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.271+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.275+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:32.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.275+0000 7f4ad39419c0 20 searching for the correct realm 2024-08-27T02:56:32.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.279+0000 7f4ad0c46640 0 -- 172.21.15.143:0/840773310 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x5639946ecac0 msgr2=0x5639946eeeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:32.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.287+0000 7f4ad1447640 0 -- 172.21.15.143:0/840773310 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f4abc0168b0 msgr2=0x7f4abc0073b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:32.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:32.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:32.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:32.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:32.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:32.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:32.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:32.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 zone default found 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 4 Realm: () 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 zonegroup default 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.295+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.299+0000 7f4ad39419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.299+0000 7f4ad39419c0 20 started sync module instance, tier type = 2024-08-27T02:56:32.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.299+0000 7f4ad39419c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:32.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=0 2024-08-27T02:56:32.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=1 2024-08-27T02:56:32.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=2 2024-08-27T02:56:32.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=3 2024-08-27T02:56:32.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=4 2024-08-27T02:56:32.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=5 2024-08-27T02:56:32.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=6 2024-08-27T02:56:32.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 20 add_watcher() i=7 2024-08-27T02:56:32.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.315+0000 7f4ad39419c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:32.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f49877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 5 note: GC not initialized 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f49867e4640 20 reqs_thread_entry: start 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 20 Filter name: none 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f48f7fff640 20 reqs_thread_entry: start 2024-08-27T02:56:32.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:32.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.319+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.323+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:32.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.323+0000 7f4ad39419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:32.319 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.323+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.323+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:32.320 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.323+0000 7f4ad39419c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.323+0000 7f4ad39419c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:32.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.323+0000 7f4ad39419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:32.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.327+0000 7f49877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:32.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.331+0000 7f4ad39419c0 20 remove_watcher() i=0 2024-08-27T02:56:32.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.331+0000 7f4ad39419c0 2 removed watcher, disabling cache 2024-08-27T02:56:32.331 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.335+0000 7f4ad39419c0 20 remove_watcher() i=1 2024-08-27T02:56:32.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.335+0000 7f4ad39419c0 20 remove_watcher() i=2 2024-08-27T02:56:32.335 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.335+0000 7f4ad39419c0 20 remove_watcher() i=3 2024-08-27T02:56:32.337 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.339+0000 7f4ad39419c0 20 remove_watcher() i=4 2024-08-27T02:56:32.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.339+0000 7f4ad39419c0 20 remove_watcher() i=5 2024-08-27T02:56:32.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.343+0000 7f4ad39419c0 20 remove_watcher() i=6 2024-08-27T02:56:32.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.343+0000 7f4ad39419c0 20 remove_watcher() i=7 2024-08-27T02:56:32.355 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:32.355 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:32.355 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:56:32.355 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:32.356 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-08-27T02:56:32.390 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:32.390 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:32.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.435+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 realm 2024-08-27T02:56:32.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:32.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:32.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:32.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.439+0000 7fac071639c0 20 searching for the correct realm 2024-08-27T02:56:32.443 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.443+0000 7fac04468640 0 -- 172.21.15.143:0/1758550275 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x56301e0c9f80 msgr2=0x56301e0cc440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:32.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.451+0000 7fac04c69640 0 -- 172.21.15.143:0/1758550275 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fabec096540 msgr2=0x7fabec0999d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:32.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:32.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:32.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:32.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:32.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:32.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 zone default found 2024-08-27T02:56:32.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 4 Realm: () 2024-08-27T02:56:32.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:32.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:32.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:32.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 zonegroup default 2024-08-27T02:56:32.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.459+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.463+0000 7fac071639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.463+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.463+0000 7fac071639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.463+0000 7fac071639c0 20 started sync module instance, tier type = 2024-08-27T02:56:32.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.463+0000 7fac071639c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:32.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.475+0000 7fac071639c0 20 add_watcher() i=0 2024-08-27T02:56:32.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.475+0000 7fac071639c0 20 add_watcher() i=1 2024-08-27T02:56:32.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.475+0000 7fac071639c0 20 add_watcher() i=2 2024-08-27T02:56:32.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.475+0000 7fac071639c0 20 add_watcher() i=3 2024-08-27T02:56:32.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.475+0000 7fac071639c0 20 add_watcher() i=4 2024-08-27T02:56:32.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.475+0000 7fac071639c0 20 add_watcher() i=5 2024-08-27T02:56:32.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.475+0000 7fac071639c0 20 add_watcher() i=6 2024-08-27T02:56:32.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7fac071639c0 20 add_watcher() i=7 2024-08-27T02:56:32.476 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7fac071639c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:32.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7faabb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:32.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7fac071639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:32.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7fac071639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:32.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7fac071639c0 5 note: GC not initialized 2024-08-27T02:56:32.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7faaba7e4640 20 reqs_thread_entry: start 2024-08-27T02:56:32.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7fac071639c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:32.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.479+0000 7fac071639c0 20 Filter name: none 2024-08-27T02:56:32.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7faab37fe640 20 reqs_thread_entry: start 2024-08-27T02:56:32.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-08-27T02:56:32.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:32.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-08-27T02:56:32.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-08-27T02:56:32.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 : miss 2024-08-27T02:56:32.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:32.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 info.flags=0x17 2024-08-27T02:56:32.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 to cache LRU end 2024-08-27T02:56:32.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:32.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:32.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.483+0000 7fac071639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 2024-08-27T02:56:32.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7fac071639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 info.flags=0x17 2024-08-27T02:56:32.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7fac071639c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 to cache LRU end 2024-08-27T02:56:32.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7fac071639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:32.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7fac071639c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32, ofs0, ns] 2024-08-27T02:56:32.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7faadb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94764662586320 notifier 7052 bl.length()=931 2024-08-27T02:56:32.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7faadb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 info.flags=0x17 2024-08-27T02:56:32.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7faadb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 to cache LRU end 2024-08-27T02:56:32.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.495+0000 7faadb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:32.495 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.499+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): orig_sources= new_sources= 2024-08-27T02:56:32.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.499+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): potential sources added=[] removed=[] 2024-08-27T02:56:32.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.499+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): orig_dests= new_dests= 2024-08-27T02:56:32.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.499+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): potential dests added=[] removed=[] 2024-08-27T02:56:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.0 2024-08-27T02:56:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.0 2024-08-27T02:56:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.1 2024-08-27T02:56:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.1 2024-08-27T02:56:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.2 2024-08-27T02:56:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.2 2024-08-27T02:56:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.3 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.3 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.4 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.4 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.5 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.5 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.6 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.6 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.7 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.7 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.8 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.8 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.9 2024-08-27T02:56:32.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.9 2024-08-27T02:56:32.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.10 2024-08-27T02:56:32.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.10 2024-08-27T02:56:32.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.11 2024-08-27T02:56:32.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1.11 2024-08-27T02:56:32.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.0 2024-08-27T02:56:32.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1 2024-08-27T02:56:32.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.2 2024-08-27T02:56:32.511 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.511+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.3 2024-08-27T02:56:32.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.515+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.4 2024-08-27T02:56:32.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.515+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.5 2024-08-27T02:56:32.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.515+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.6 2024-08-27T02:56:32.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.515+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.7 2024-08-27T02:56:32.515 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.515+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.8 2024-08-27T02:56:32.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.519+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.9 2024-08-27T02:56:32.517 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.519+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.10 2024-08-27T02:56:32.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.527+0000 7fac071639c0 -1 Injecting error=-125 at location=change_reshard_state 2024-08-27T02:56:32.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.527+0000 7fac071639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 : hit (requested=0x17, cached=0x17) 2024-08-27T02:56:32.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.527+0000 7fac071639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 2024-08-27T02:56:32.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.527+0000 7fac071639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 info.flags=0x17 2024-08-27T02:56:32.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.527+0000 7fac071639c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 to cache LRU end 2024-08-27T02:56:32.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.527+0000 7fac071639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:32.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.527+0000 7fac071639c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32, ofs0, ns] 2024-08-27T02:56:32.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7faadb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366265 cookie 94764662586320 notifier 7052 bl.length()=931 2024-08-27T02:56:32.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7faadb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 info.flags=0x17 2024-08-27T02:56:32.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7faadb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 to cache LRU end 2024-08-27T02:56:32.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7faadb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:32.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): orig_sources= new_sources= 2024-08-27T02:56:32.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): potential sources added=[] removed=[] 2024-08-27T02:56:32.529 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): orig_dests= new_dests= 2024-08-27T02:56:32.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.531+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): potential dests added=[] removed=[] 2024-08-27T02:56:32.535 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.539+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.0 2024-08-27T02:56:32.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.539+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.1 2024-08-27T02:56:32.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.539+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.2 2024-08-27T02:56:32.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.539+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.3 2024-08-27T02:56:32.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.539+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.4 2024-08-27T02:56:32.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.543+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.5 2024-08-27T02:56:32.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.543+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.6 2024-08-27T02:56:32.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.543+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.7 2024-08-27T02:56:32.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.543+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.8 2024-08-27T02:56:32.541 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.543+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.9 2024-08-27T02:56:32.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.543+0000 7fac071639c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32.10 2024-08-27T02:56:32.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7fac071639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 : hit (requested=0x17, cached=0x17) 2024-08-27T02:56:32.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7fac071639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 2024-08-27T02:56:32.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7fac071639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 info.flags=0x17 2024-08-27T02:56:32.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7fac071639c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 to cache LRU end 2024-08-27T02:56:32.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7fac071639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:32.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7fac071639c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32, ofs0, ns] 2024-08-27T02:56:32.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7faadbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366266 cookie 94764662586320 notifier 7052 bl.length()=899 2024-08-27T02:56:32.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7faadbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 info.flags=0x17 2024-08-27T02:56:32.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7faadbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 to cache LRU end 2024-08-27T02:56:32.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.547+0000 7faadbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:32.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.551+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): orig_sources= new_sources= 2024-08-27T02:56:32.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.551+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): potential sources added=[] removed=[] 2024-08-27T02:56:32.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.551+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): orig_dests= new_dests= 2024-08-27T02:56:32.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.551+0000 7fac071639c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32]): potential dests added=[] removed=[] 2024-08-27T02:56:32.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.555+0000 7fac071639c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-08-27T02:56:32.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.559+0000 7faabb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:32.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.563+0000 7fac071639c0 20 remove_watcher() i=0 2024-08-27T02:56:32.561 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.563+0000 7fac071639c0 2 removed watcher, disabling cache 2024-08-27T02:56:32.563 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.567+0000 7fac071639c0 20 remove_watcher() i=1 2024-08-27T02:56:32.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.567+0000 7fac071639c0 20 remove_watcher() i=2 2024-08-27T02:56:32.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.571+0000 7fac071639c0 20 remove_watcher() i=3 2024-08-27T02:56:32.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.571+0000 7fac071639c0 20 remove_watcher() i=4 2024-08-27T02:56:32.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.575+0000 7fac071639c0 20 remove_watcher() i=5 2024-08-27T02:56:32.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.575+0000 7fac071639c0 20 remove_watcher() i=6 2024-08-27T02:56:32.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.575+0000 7fac071639c0 20 remove_watcher() i=7 2024-08-27T02:56:32.589 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-08-27T02:56:32.619 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:32.619 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:32.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.663+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 realm 2024-08-27T02:56:32.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:32.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:32.666 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.667+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.671+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:32.667 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.671+0000 7f13d7d829c0 20 searching for the correct realm 2024-08-27T02:56:32.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.675+0000 7f13d6089640 0 -- 172.21.15.143:0/2585413914 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f13cc003bc0 msgr2=0x7f13cc0fda70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:32.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.891+0000 7f13d5888640 0 -- 172.21.15.143:0/2585413914 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55a7ae5a2bb0 msgr2=0x55a7ae5a5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:32.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:32.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:32.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:32.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:32.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:32.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:32.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.899+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:32.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 zone default found 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 4 Realm: () 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 zonegroup default 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:32.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 started sync module instance, tier type = 2024-08-27T02:56:32.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.903+0000 7f13d7d829c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:32.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.927+0000 7f13d7d829c0 20 add_watcher() i=0 2024-08-27T02:56:32.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.927+0000 7f13d7d829c0 20 add_watcher() i=1 2024-08-27T02:56:32.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.927+0000 7f13d7d829c0 20 add_watcher() i=2 2024-08-27T02:56:32.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.927+0000 7f13d7d829c0 20 add_watcher() i=3 2024-08-27T02:56:32.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.927+0000 7f13d7d829c0 20 add_watcher() i=4 2024-08-27T02:56:32.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.927+0000 7f13d7d829c0 20 add_watcher() i=5 2024-08-27T02:56:32.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.927+0000 7f13d7d829c0 20 add_watcher() i=6 2024-08-27T02:56:32.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.931+0000 7f13d7d829c0 20 add_watcher() i=7 2024-08-27T02:56:32.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.931+0000 7f13d7d829c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:32.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f12877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:32.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f13d7d829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:32.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f13d7d829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:32.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f13d7d829c0 5 note: GC not initialized 2024-08-27T02:56:32.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f12867fc640 20 reqs_thread_entry: start 2024-08-27T02:56:32.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f13d7d829c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:32.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f13d7d829c0 20 Filter name: none 2024-08-27T02:56:32.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f11f7fff640 20 reqs_thread_entry: start 2024-08-27T02:56:32.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.935+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.939+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:32.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.939+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.939+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:32.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.939+0000 7f13d7d829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:32.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.939+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.939+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:32.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.939+0000 7f13d7d829c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:32.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.943+0000 7f13d7d829c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:32.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.943+0000 7f13d7d829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:32.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.943+0000 7f12877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:32.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.951+0000 7f13d7d829c0 20 remove_watcher() i=0 2024-08-27T02:56:32.947 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.951+0000 7f13d7d829c0 2 removed watcher, disabling cache 2024-08-27T02:56:32.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.951+0000 7f13d7d829c0 20 remove_watcher() i=1 2024-08-27T02:56:32.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.955+0000 7f13d7d829c0 20 remove_watcher() i=2 2024-08-27T02:56:32.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.955+0000 7f13d7d829c0 20 remove_watcher() i=3 2024-08-27T02:56:32.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.959+0000 7f13d7d829c0 20 remove_watcher() i=4 2024-08-27T02:56:32.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.959+0000 7f13d7d829c0 20 remove_watcher() i=5 2024-08-27T02:56:32.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.963+0000 7f13d7d829c0 20 remove_watcher() i=6 2024-08-27T02:56:32.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:32.963+0000 7f13d7d829c0 20 remove_watcher() i=7 2024-08-27T02:56:32.978 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:32.978 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:32.978 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: error-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-08-27T02:56:32.978 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:33.944 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-08-27T02:56:33.944 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.154 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-08-27T02:56:36.186 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:36.186 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:36.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 realm 2024-08-27T02:56:36.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:36.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.235+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.239+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:36.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.239+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.239+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:36.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.239+0000 7f43295bd9c0 20 searching for the correct realm 2024-08-27T02:56:36.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.239+0000 7f43270c3640 0 -- 172.21.15.143:0/3518245648 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f4310003cc0 msgr2=0x7f4318061ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:36.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.451+0000 7f43278c4640 0 -- 172.21.15.143:0/3518245648 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f431c039070 msgr2=0x7f431c022910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:36.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:36.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:36.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:36.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:36.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:36.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:36.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.467+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:36.467 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:36.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 zone default found 2024-08-27T02:56:36.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 4 Realm: () 2024-08-27T02:56:36.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:36.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:36.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:36.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 zonegroup default 2024-08-27T02:56:36.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 started sync module instance, tier type = 2024-08-27T02:56:36.470 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.471+0000 7f43295bd9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:36.493 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.495+0000 7f43295bd9c0 20 add_watcher() i=0 2024-08-27T02:56:36.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.495+0000 7f43295bd9c0 20 add_watcher() i=1 2024-08-27T02:56:36.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.495+0000 7f43295bd9c0 20 add_watcher() i=2 2024-08-27T02:56:36.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.495+0000 7f43295bd9c0 20 add_watcher() i=3 2024-08-27T02:56:36.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.495+0000 7f43295bd9c0 20 add_watcher() i=4 2024-08-27T02:56:36.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.495+0000 7f43295bd9c0 20 add_watcher() i=5 2024-08-27T02:56:36.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.495+0000 7f43295bd9c0 20 add_watcher() i=6 2024-08-27T02:56:36.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.499+0000 7f43295bd9c0 20 add_watcher() i=7 2024-08-27T02:56:36.496 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.499+0000 7f43295bd9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:36.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f41ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:36.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:36.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:36.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 5 note: GC not initialized 2024-08-27T02:56:36.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f41dcfe1640 20 reqs_thread_entry: start 2024-08-27T02:56:36.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:36.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 20 Filter name: none 2024-08-27T02:56:36.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f41567fc640 20 reqs_thread_entry: start 2024-08-27T02:56:36.502 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:36.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.503+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.507+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:36.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.507+0000 7f43295bd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:36.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.507+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.507+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:36.505 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.507+0000 7f43295bd9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.507+0000 7f43295bd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:36.506 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.507+0000 7f43295bd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:36.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.511+0000 7f41ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:36.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.515+0000 7f43295bd9c0 20 remove_watcher() i=0 2024-08-27T02:56:36.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.515+0000 7f43295bd9c0 2 removed watcher, disabling cache 2024-08-27T02:56:36.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.519+0000 7f43295bd9c0 20 remove_watcher() i=1 2024-08-27T02:56:36.518 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.519+0000 7f43295bd9c0 20 remove_watcher() i=2 2024-08-27T02:56:36.521 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.523+0000 7f43295bd9c0 20 remove_watcher() i=3 2024-08-27T02:56:36.523 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.527+0000 7f43295bd9c0 20 remove_watcher() i=4 2024-08-27T02:56:36.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.527+0000 7f43295bd9c0 20 remove_watcher() i=5 2024-08-27T02:56:36.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.527+0000 7f43295bd9c0 20 remove_watcher() i=6 2024-08-27T02:56:36.528 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.531+0000 7f43295bd9c0 20 remove_watcher() i=7 2024-08-27T02:56:36.542 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.542 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:36.543 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:56:36.543 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.543 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-08-27T02:56:36.581 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:36.581 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:36.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.627+0000 7f9111f939c0 20 realm 2024-08-27T02:56:36.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:36.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:36.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:36.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.631+0000 7f9111f939c0 20 searching for the correct realm 2024-08-27T02:56:36.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.639+0000 7f911029a640 0 -- 172.21.15.143:0/1487088904 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f91040ee040 msgr2=0x7f91040ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:36.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.855+0000 7f910fa99640 0 -- 172.21.15.143:0/1487088904 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55ee89a18eb0 msgr2=0x55ee89a1b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:36.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:36.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:36.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:36.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:36.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:36.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:36.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:36.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:36.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 zone default found 2024-08-27T02:56:36.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 4 Realm: () 2024-08-27T02:56:36.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:36.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:36.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:36.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 zonegroup default 2024-08-27T02:56:36.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 started sync module instance, tier type = 2024-08-27T02:56:36.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.867+0000 7f9111f939c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:36.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=0 2024-08-27T02:56:36.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=1 2024-08-27T02:56:36.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=2 2024-08-27T02:56:36.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=3 2024-08-27T02:56:36.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=4 2024-08-27T02:56:36.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=5 2024-08-27T02:56:36.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=6 2024-08-27T02:56:36.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.895+0000 7f9111f939c0 20 add_watcher() i=7 2024-08-27T02:56:36.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.895+0000 7f9111f939c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:36.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f8fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:36.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:36.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:36.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f9111f939c0 5 note: GC not initialized 2024-08-27T02:56:36.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f8fc4fe1640 20 reqs_thread_entry: start 2024-08-27T02:56:36.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f9111f939c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:36.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f9111f939c0 20 Filter name: none 2024-08-27T02:56:36.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f8f3e7fc640 20 reqs_thread_entry: start 2024-08-27T02:56:36.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f9111f939c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-08-27T02:56:36.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:36.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-08-27T02:56:36.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-08-27T02:56:36.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 : miss 2024-08-27T02:56:36.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:36.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:36.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:36.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:36.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:36.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.903+0000 7f9111f939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 2024-08-27T02:56:36.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:36.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f9111f939c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:36.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f9111f939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:36.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f9111f939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33, ofs0, ns] 2024-08-27T02:56:36.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366270 cookie 94482999689536 notifier 7482 bl.length()=931 2024-08-27T02:56:36.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:36.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:36.914 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:36.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_sources= new_sources= 2024-08-27T02:56:36.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential sources added=[] removed=[] 2024-08-27T02:56:36.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_dests= new_dests= 2024-08-27T02:56:36.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential dests added=[] removed=[] 2024-08-27T02:56:36.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.0 2024-08-27T02:56:36.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.0 2024-08-27T02:56:36.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.1 2024-08-27T02:56:36.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.1 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.2 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.2 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.3 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.3 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.4 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.4 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.5 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.5 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.6 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.6 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.7 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.7 2024-08-27T02:56:36.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.8 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.8 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.9 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.9 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.10 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.10 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.11 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.11 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.0 2024-08-27T02:56:36.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1 2024-08-27T02:56:36.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2 2024-08-27T02:56:36.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.3 2024-08-27T02:56:36.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.4 2024-08-27T02:56:36.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.5 2024-08-27T02:56:36.937 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.6 2024-08-27T02:56:36.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.7 2024-08-27T02:56:36.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.8 2024-08-27T02:56:36.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.9 2024-08-27T02:56:36.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.10 2024-08-27T02:56:36.948 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9111f939c0 time 2024-08-27T02:56:36.953817+0000 2024-08-27T02:56:36.949 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:56:36.950 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:36.950 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f911586d2eb] 2024-08-27T02:56:36.950 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:36.950 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:36.950 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:36.950 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:36.950 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f9111f939c0 thread_name:radosgw-admin 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.951+0000 7f9111f939c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9111f939c0 time 2024-08-27T02:56:36.953817+0000 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f911586d2eb] 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:36.951 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:36.952 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:36.952 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:56:36.952 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:36.952 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:56:36.952 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:56:36.952 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.958 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f91146ec520] 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f911586d345] 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:56:36.959 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:36.955+0000 7f9111f939c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f9111f939c0 thread_name:radosgw-admin 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f91146ec520] 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f911586d345] 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:36.960 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: secure 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: secure 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: secure 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:56:36.607+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.961 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: starting msgr at 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: starting objecter 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command objecter_requests hook 0x55ee89957f00 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: setting wanted keys 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: calling monclient init 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding auth protocol: cephx 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding auth protocol: cephx 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding auth protocol: cephx 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:36.962 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:56:36.607+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:56:36.607+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key hook 0x55ee8992bbe8 2024-08-27T02:56:36.963 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee897e3c20 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee897ead40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee89958c30 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.486437s 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): get_auth_request con 0x55ee897e3c20 auth_method 0 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.964 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): get_auth_request con 0x55ee89958c30 auth_method 0 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_done global_id 7473 payload 824 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient: _finish_hunting 0 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:56:36.607+0000 7f910fa99640 1 monclient: found mon.noname-a 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.965 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:56:36.607+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee897ead40 auth_method 0 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: dump: 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.966 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: _finish_auth 0 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: _check_auth_tickets 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: dump: 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.967 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7473 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:56:36.607+0000 7f8ffde0b640 4 set_mon_vals no callback set 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: init done 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:56:36.611+0000 7f8ff7fff640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:56:36.968 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:56:36.611+0000 7f8ff7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:56:36.611+0000 7f8ff7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:56:36.611+0000 7f910f298640 10 monclient: get_auth_request con 0x7f8ff8070aa0 auth_method 0 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:56:36.611+0000 7f911029a640 10 monclient: get_auth_request con 0x55ee899570e0 auth_method 0 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:56:36.611+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee89976ae0 auth_method 0 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:56:36.615+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee8997a260 auth_method 0 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:56:36.615+0000 7f9111f939c0 10 monclient: build_initial_monmap 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:56:36.615+0000 7f9111f939c0 1 build_initial for_mkfs: 0 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:56:36.615+0000 7f9111f939c0 10 monclient: monmap: 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:56:36.969 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding auth protocol: cephx 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding auth protocol: cephx 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding auth protocol: cephx 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:36.970 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:56:36.615+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command objecter_requests cmddesc objecter_requests hook 0x55ee899830a0 EEXIST 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:56:36.615+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding auth protocol: cephx 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding auth protocol: cephx 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding auth protocol: cephx 2024-08-27T02:56:36.971 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:56:36.615+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:56:36.619+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.972 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key cmddesc rotate-key hook 0x55ee8997e7a0 EEXIST 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee899a7250 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee899a6b80 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee899a5560 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.496129s 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): get_auth_request con 0x55ee899a7250 auth_method 0 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.973 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): get_auth_request con 0x55ee899a6b80 auth_method 0 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_done global_id 7476 payload 824 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient: _finish_hunting 0 2024-08-27T02:56:36.974 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:56:36.619+0000 7f910fa99640 1 monclient: found mon.noname-a 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: dump: 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.975 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: _finish_auth 0 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: _check_auth_tickets 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: dump: 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.976 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:56:36.619+0000 7f9110a9b640 4 set_mon_vals no callback set 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7476 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: get_monmap_and_config 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: build_initial_monmap 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:56:36.619+0000 7f9111f939c0 1 build_initial for_mkfs: 0 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: monmap: 2024-08-27T02:56:36.977 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding auth protocol: cephx 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding auth protocol: cephx 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding auth protocol: cephx 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:36.978 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient: get_auth_request con 0x7f8fe80709e0 auth_method 0 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:56:36.619+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.979 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding auth protocol: cephx 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding auth protocol: cephx 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding auth protocol: cephx 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:36.980 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key cmddesc rotate-key hook 0x7ffc793f35b8 EEXIST 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee899ca450 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee899ca830 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee899f4ea0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:36.981 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.500547s 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request con 0x55ee899ca830 auth_method 0 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request con 0x55ee899f4ea0 auth_method 0 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.982 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_done global_id 7479 payload 274 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _finish_hunting 0 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:56:36.623+0000 7f911029a640 1 monclient: found mon.noname-a 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:56:36.623+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee899ca450 auth_method 0 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: dump: 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.983 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: _finish_auth 0 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: _check_auth_tickets 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7479 2024-08-27T02:56:36.984 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: get_monmap_and_config success 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:56:36.623+0000 7f9111f939c0 4 set_mon_vals no callback set 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: dump: 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.985 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: shutdown 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: build_initial_monmap 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 build_initial for_mkfs: 0 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: monmap: 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:56:36.986 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding auth protocol: cephx 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding auth protocol: cephx 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding auth protocol: cephx 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:36.987 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: starting msgr at 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: starting objecter 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command objecter_requests cmddesc objecter_requests hook 0x55ee899eda20 EEXIST 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: setting wanted keys 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: calling monclient init 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding auth protocol: cephx 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding auth protocol: cephx 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding auth protocol: cephx 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:36.988 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key cmddesc rotate-key hook 0x55ee899a91b8 EEXIST 2024-08-27T02:56:36.989 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee899ca450 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee899f4ea0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee899f0470 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.503213s 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request con 0x55ee899f0470 auth_method 0 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.990 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request con 0x55ee899f4ea0 auth_method 0 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_done global_id 7482 payload 824 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _finish_hunting 0 2024-08-27T02:56:36.991 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:56:36.623+0000 7f911029a640 1 monclient: found mon.noname-a 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:56:36.623+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee899ca450 auth_method 0 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: dump: 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.992 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: _finish_auth 0 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: _check_auth_tickets 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: dump: 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:36.993 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:56:36.627+0000 7f8feeffd640 4 set_mon_vals no callback set 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:56:36.627+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7482 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:56:36.627+0000 7f9111f939c0 1 librados: init done 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:56:36.627+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cr dump hook 0x7f910800e578 2024-08-27T02:56:36.994 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:56:36.627+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee89a14ce0 auth_method 0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:56:36.627+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f8fd8070aa0 auth_method 0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 realm 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:56:36.631+0000 7f9111f939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.995 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:56:36.631+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee89a18eb0 auth_method 0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 searching for the correct realm 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:56:36.631+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee89a1e160 auth_method 0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:56:36.635+0000 7f911029a640 10 monclient: get_auth_request con 0x7f91040d03f0 auth_method 0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:56:36.635+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f910801e070 auth_method 0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:56:36.635+0000 7f910f298640 10 monclient: get_auth_request con 0x7f9100062040 auth_method 0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:56:36.639+0000 7f911029a640 0 -- 172.21.15.143:0/1487088904 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f91040ee040 msgr2=0x7f91040ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:56:36.843+0000 7f911029a640 10 monclient: get_auth_request con 0x7f91040ee040 auth_method 0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:56:36.851+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f91040b78e0 auth_method 0 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:56:36.855+0000 7f910fa99640 0 -- 172.21.15.143:0/1487088904 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55ee89a18eb0 msgr2=0x55ee89a1b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:56:36.855+0000 7f8fed7fa640 1 client.7482.objecter ms_handle_reset 0x55ee89a18eb0 session 0x55ee89a18830 osd.5 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:56:36.855+0000 7f8fed7fa640 10 monclient: _renew_subs 2024-08-27T02:56:36.996 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:56:36.855+0000 7f8fed7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:56:36.855+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f8fd8081140 auth_method 0 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 zone default found 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:56:36.867+0000 7f9111f939c0 4 Realm: () 2024-08-27T02:56:36.997 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:56:36.867+0000 7f9111f939c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:56:36.867+0000 7f9111f939c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:56:36.867+0000 7f9111f939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 zonegroup default 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 started sync module instance, tier type = 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=0 2024-08-27T02:56:36.998 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=1 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=2 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=3 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=4 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=5 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=6 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:56:36.895+0000 7f9111f939c0 20 add_watcher() i=7 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:56:36.895+0000 7f9111f939c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding auth protocol: cephx 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding auth protocol: cephx 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding auth protocol: cephx 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:36.999 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:56:36.899+0000 7f8fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:56:36.899+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache list hook 0x55ee899cc6f0 2024-08-27T02:56:37.000 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache inspect hook 0x55ee899cc6f0 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache erase hook 0x55ee899cc6f0 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache zap hook 0x55ee899cc6f0 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 note: GC not initialized 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:56:36.899+0000 7f8fc4fe1640 20 reqs_thread_entry: start 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace show hook 0x7f910800e480 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace history hook 0x7f910800e480 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace active hook 0x7f910800e480 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace active_short hook 0x7f910800e480 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 Filter name: none 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:56:36.899+0000 7f8f3e7fc640 20 reqs_thread_entry: start 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:56:36.899+0000 7f9111f939c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.001 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 : miss 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:37.002 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33, ofs0, ns] 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366270 cookie 94482999689536 notifier 7482 bl.length()=931 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_sources= new_sources= 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential sources added=[] removed=[] 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_dests= new_dests= 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential dests added=[] removed=[] 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.0 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.0 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.1 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.1 2024-08-27T02:56:37.003 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.2 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.2 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.3 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.3 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.4 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.4 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.5 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.5 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.6 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.6 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.7 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.7 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.8 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.8 2024-08-27T02:56:37.004 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.9 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.9 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.10 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.10 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.11 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.11 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.0 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.3 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.4 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.5 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.6 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.7 2024-08-27T02:56:37.005 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.8 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.9 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.10 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:56:36.951+0000 7f9111f939c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9111f939c0 time 2024-08-27T02:56:36.953817+0000 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f911586d2eb] 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:37.006 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:56:36.955+0000 7f9111f939c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f9111f939c0 thread_name:radosgw-admin 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f91146ec520] 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f911586d345] 2024-08-27T02:56:37.007 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:56:37.008 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:56:37.009 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:56:37.010 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:56:37.011 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:56:37.012 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:56:37.013 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:56:37.014 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8f3e7fc640 / http_manager 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8fc4fe1640 / http_manager 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8fc5fe3640 / rgw_dt_lg_renew 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8fed7fa640 / ms_dispatch 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8feeffd640 / io_context_pool 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8ff57fa640 / ms_dispatch 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8ff7fff640 / ms_dispatch 2024-08-27T02:56:37.015 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8ffde0b640 / io_context_pool 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: 7f910f298640 / msgr-worker-2 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: 7f910fa99640 / msgr-worker-1 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: 7f911029a640 / msgr-worker-0 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: 7f9110a9b640 / io_context_pool 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: 7f9111f939c0 / radosgw-admin 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.116902.log 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: secure 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:37.016 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: secure 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: crc 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992d890) adding con mode: secure 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:56:36.607+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: starting msgr at 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: starting objecter 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command objecter_requests hook 0x55ee89957f00 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: setting wanted keys 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: calling monclient init 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding auth protocol: cephx 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding auth protocol: cephx 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding auth protocol: cephx 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:37.017 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: crc 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 AuthRegistry(0x55ee8992baa0) adding con mode: secure 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:56:36.607+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:56:36.607+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key hook 0x55ee8992bbe8 2024-08-27T02:56:37.018 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee897e3c20 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee897ead40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee89958c30 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.486437s 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): get_auth_request con 0x55ee897e3c20 auth_method 0 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.019 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): get_auth_request con 0x55ee89958c30 auth_method 0 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:56:36.607+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient(hunting): handle_auth_done global_id 7473 payload 824 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient: _finish_hunting 0 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:56:36.607+0000 7f910fa99640 1 monclient: found mon.noname-a 2024-08-27T02:56:37.020 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:56:36.607+0000 7f910fa99640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:56:36.607+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee897ead40 auth_method 0 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: dump: 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.021 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: _finish_auth 0 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: _check_auth_tickets 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:56:36.607+0000 7f8ff7fff640 10 monclient: dump: 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.022 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:56:36.607+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7473 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:56:36.607+0000 7f8ffde0b640 4 set_mon_vals no callback set 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:56:36.607+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:56:36.607+0000 7f9111f939c0 1 librados: init done 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:56:36.611+0000 7f8ff7fff640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:56:36.611+0000 7f8ff7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:56:36.611+0000 7f8ff7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:56:36.611+0000 7f910f298640 10 monclient: get_auth_request con 0x7f8ff8070aa0 auth_method 0 2024-08-27T02:56:37.023 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:56:36.611+0000 7f911029a640 10 monclient: get_auth_request con 0x55ee899570e0 auth_method 0 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:56:36.611+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee89976ae0 auth_method 0 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:56:36.615+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee8997a260 auth_method 0 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:56:36.615+0000 7f9111f939c0 10 monclient: build_initial_monmap 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:56:36.615+0000 7f9111f939c0 1 build_initial for_mkfs: 0 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:56:36.615+0000 7f9111f939c0 10 monclient: monmap: 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:56:37.024 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding auth protocol: cephx 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding auth protocol: cephx 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding auth protocol: cephx 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:37.025 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: crc 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997f760) adding con mode: secure 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:56:36.615+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command objecter_requests cmddesc objecter_requests hook 0x55ee899830a0 EEXIST 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:56:36.615+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding auth protocol: cephx 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding auth protocol: cephx 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding auth protocol: cephx 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:37.026 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: crc 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:56:36.615+0000 7f9111f939c0 5 AuthRegistry(0x55ee8997e658) adding con mode: secure 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:56:36.615+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:56:36.619+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key cmddesc rotate-key hook 0x55ee8997e7a0 EEXIST 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:56:37.027 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee899a7250 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee899a6b80 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee899a5560 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.496129s 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): get_auth_request con 0x55ee899a7250 auth_method 0 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): get_auth_request con 0x55ee899a6b80 auth_method 0 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.028 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient(hunting): handle_auth_done global_id 7476 payload 824 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient: _finish_hunting 0 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:56:36.619+0000 7f910fa99640 1 monclient: found mon.noname-a 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:56:36.619+0000 7f910fa99640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:37.029 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: dump: 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: _finish_auth 0 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: _check_auth_tickets 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:37.030 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 10 monclient: dump: 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.031 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:56:36.619+0000 7f9110a9b640 4 set_mon_vals no callback set 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7476 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:56:36.619+0000 7f8ff57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: get_monmap_and_config 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: build_initial_monmap 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:56:36.619+0000 7f9111f939c0 1 build_initial for_mkfs: 0 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: monmap: 2024-08-27T02:56:37.032 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding auth protocol: cephx 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding auth protocol: cephx 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding auth protocol: cephx 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:37.033 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: crc 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x55ee899c65b0) adding con mode: secure 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:56:36.619+0000 7f910f298640 10 monclient: get_auth_request con 0x7f8fe80709e0 auth_method 0 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:56:36.619+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.034 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:56:36.619+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding auth protocol: cephx 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding auth protocol: cephx 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding auth protocol: cephx 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:37.035 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: crc 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:56:36.619+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3470) adding con mode: secure 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key cmddesc rotate-key hook 0x7ffc793f35b8 EEXIST 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee899ca450 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee899ca830 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee899f4ea0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.036 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.500547s 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request con 0x55ee899ca830 auth_method 0 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request con 0x55ee899f4ea0 auth_method 0 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.037 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_done global_id 7479 payload 274 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _finish_hunting 0 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:56:36.623+0000 7f911029a640 1 monclient: found mon.noname-a 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:56:36.623+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee899ca450 auth_method 0 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: dump: 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.038 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: _finish_auth 0 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: _check_auth_tickets 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7479 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: get_monmap_and_config success 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:56:36.623+0000 7f9111f939c0 4 set_mon_vals no callback set 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.039 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:56:36.623+0000 7f8feeffd640 10 monclient: dump: 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: shutdown 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: build_initial_monmap 2024-08-27T02:56:37.040 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 build_initial for_mkfs: 0 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: monmap: 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding auth protocol: cephx 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding auth protocol: cephx 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding auth protocol: cephx 2024-08-27T02:56:37.041 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: crc 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899cb650) adding con mode: secure 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.042 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: starting msgr at 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: starting objecter 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command objecter_requests cmddesc objecter_requests hook 0x55ee899eda20 EEXIST 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: setting wanted keys 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:56:36.623+0000 7f9111f939c0 1 librados: calling monclient init 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: init 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding auth protocol: cephx 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding auth protocol: cephx 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding auth protocol: cephx 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:37.043 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: crc 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 AuthRegistry(0x55ee899a9070) adding con mode: secure 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:56:36.623+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:56:36.623+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command rotate-key cmddesc rotate-key hook 0x55ee899a91b8 EEXIST 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _reopen_session rank -1 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:56:37.044 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-b con 0x55ee899ca450 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-c con 0x55ee899f4ea0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): picked mon.noname-a con 0x55ee899f0470 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): _renew_subs 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:56:36.623+0000 7f9111f939c0 10 monclient(hunting): authenticate will time out at 2529.503213s 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request con 0x55ee899f0470 auth_method 0 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request con 0x55ee899f4ea0 auth_method 0 2024-08-27T02:56:37.045 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:56:36.623+0000 7f910f298640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient(hunting): handle_auth_done global_id 7482 payload 824 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _finish_hunting 0 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:56:36.623+0000 7f911029a640 1 monclient: found mon.noname-a 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:56:36.623+0000 7f911029a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.046 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:56:36.623+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee899ca450 auth_method 0 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: dump: 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.047 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: _finish_auth 0 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: _check_auth_tickets 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 10 monclient: dump: 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:56:37.048 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:56:36.627+0000 7f8feeffd640 4 set_mon_vals no callback set 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:56:36.627+0000 7f9111f939c0 5 monclient: authenticate success, global_id 7482 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _renew_subs 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:56:36.627+0000 7f9111f939c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:56:36.627+0000 7f9111f939c0 1 librados: init done 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:56:36.627+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cr dump hook 0x7f910800e578 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:37.049 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:56:36.627+0000 7f8fed7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:56:36.627+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee89a14ce0 auth_method 0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:56:36.627+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f8fd8070aa0 auth_method 0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 realm 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:56:36.627+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:56:36.631+0000 7f9111f939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:56:36.631+0000 7f910fa99640 10 monclient: get_auth_request con 0x55ee89a18eb0 auth_method 0 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:37.050 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:56:36.631+0000 7f9111f939c0 20 searching for the correct realm 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:56:36.631+0000 7f910f298640 10 monclient: get_auth_request con 0x55ee89a1e160 auth_method 0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:56:36.635+0000 7f911029a640 10 monclient: get_auth_request con 0x7f91040d03f0 auth_method 0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:56:36.635+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f910801e070 auth_method 0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:56:36.635+0000 7f910f298640 10 monclient: get_auth_request con 0x7f9100062040 auth_method 0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:56:36.639+0000 7f911029a640 0 -- 172.21.15.143:0/1487088904 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f91040ee040 msgr2=0x7f91040ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:56:36.843+0000 7f911029a640 10 monclient: get_auth_request con 0x7f91040ee040 auth_method 0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:56:36.851+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f91040b78e0 auth_method 0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:56:36.855+0000 7f910fa99640 0 -- 172.21.15.143:0/1487088904 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55ee89a18eb0 msgr2=0x55ee89a1b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:56:36.855+0000 7f8fed7fa640 1 client.7482.objecter ms_handle_reset 0x55ee89a18eb0 session 0x55ee89a18830 osd.5 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:56:36.855+0000 7f8fed7fa640 10 monclient: _renew_subs 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:56:36.855+0000 7f8fed7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:56:37.051 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:56:36.855+0000 7f910fa99640 10 monclient: get_auth_request con 0x7f8fd8081140 auth_method 0 2024-08-27T02:56:37.052 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:37.052 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:37.052 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:37.052 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:37.053 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:56:36.863+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 zone default found 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:56:36.867+0000 7f9111f939c0 4 Realm: () 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:56:36.867+0000 7f9111f939c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:56:36.867+0000 7f9111f939c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:56:36.867+0000 7f9111f939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:37.054 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 zonegroup default 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 started sync module instance, tier type = 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:56:36.867+0000 7f9111f939c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=0 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=1 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=2 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=3 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=4 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=5 2024-08-27T02:56:37.055 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:56:36.891+0000 7f9111f939c0 20 add_watcher() i=6 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:56:36.895+0000 7f9111f939c0 20 add_watcher() i=7 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:56:36.895+0000 7f9111f939c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding auth protocol: cephx 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding auth protocol: cephx 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding auth protocol: cephx 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.056 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: crc 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 AuthRegistry(0x7ffc793f3950) adding con mode: secure 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:56:36.899+0000 7f8fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:56:36.899+0000 7f9111f939c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache list hook 0x55ee899cc6f0 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache inspect hook 0x55ee899cc6f0 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache erase hook 0x55ee899cc6f0 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command cache zap hook 0x55ee899cc6f0 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 note: GC not initialized 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:56:36.899+0000 7f8fc4fe1640 20 reqs_thread_entry: start 2024-08-27T02:56:37.057 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace show hook 0x7f910800e480 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace history hook 0x7f910800e480 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace active hook 0x7f910800e480 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:56:36.899+0000 7f9111f939c0 5 asok(0x55ee89720280) register_command sync trace active_short hook 0x7f910800e480 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 Filter name: none 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:56:36.899+0000 7f8f3e7fc640 20 reqs_thread_entry: start 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:56:36.899+0000 7f9111f939c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:56:36.899+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 : miss 2024-08-27T02:56:37.058 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:56:36.903+0000 7f9111f939c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:56:36.903+0000 7f9111f939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:56:36.915+0000 7f9111f939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33, ofs0, ns] 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366270 cookie 94482999689536 notifier 7482 bl.length()=931 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:37.059 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:56:36.915+0000 7f8feeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_sources= new_sources= 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential sources added=[] removed=[] 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_dests= new_dests= 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:56:36.919+0000 7f9111f939c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential dests added=[] removed=[] 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.0 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.0 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.1 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.1 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.2 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.2 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.3 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.3 2024-08-27T02:56:37.060 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.4 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.4 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.5 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.5 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.6 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.6 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.7 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.7 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.8 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.8 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.9 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.9 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.10 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.10 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:56:36.931+0000 7f9111f939c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.11 2024-08-27T02:56:37.061 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1.11 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:56:36.931+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.0 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.3 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:56:36.935+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.4 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.5 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.6 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:56:36.939+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.7 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.8 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.9 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:56:36.943+0000 7f9111f939c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.10 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:56:36.951+0000 7f9111f939c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9111f939c0 time 2024-08-27T02:56:36.953817+0000 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:56:37.062 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f911586d2eb] 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:56:36.955+0000 7f9111f939c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f9111f939c0 thread_name:radosgw-admin 2024-08-27T02:56:37.063 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f91146ec520] 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f911586d345] 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f911586d49f] 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee885e9b11] 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ee885fe4c1] 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee885ffb14] 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f91146d3d90] 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:56:37.064 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:56:37.065 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:56:37.066 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:56:37.067 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:56:37.068 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:56:37.069 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:56:37.070 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8f3e7fc640 / http_manager 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8fc4fe1640 / http_manager 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8fc5fe3640 / rgw_dt_lg_renew 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8fed7fa640 / ms_dispatch 2024-08-27T02:56:37.071 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8feeffd640 / io_context_pool 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8ff57fa640 / ms_dispatch 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8ff7fff640 / ms_dispatch 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f8ffde0b640 / io_context_pool 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f910f298640 / msgr-worker-2 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f910fa99640 / msgr-worker-1 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f911029a640 / msgr-worker-0 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f9110a9b640 / io_context_pool 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: 7f9111f939c0 / radosgw-admin 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:56:36.956484Z_22227c90-0b08-4348-b8b8-8e34e1e9cf55/log 2024-08-27T02:56:37.072 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:56:37.075 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:56:37.075 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-08-27T02:56:37.075 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:37.075 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:37.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 realm 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.035+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.039+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.039+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.039+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.039+0000 7f3d0a5da9c0 20 searching for the correct realm 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.047+0000 7f3d078df640 0 -- 172.21.15.143:0/2294244006 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f3d0012cb30 msgr2=0x7f3d0010aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.051+0000 7f3d088e1640 0 -- 172.21.15.143:0/2294244006 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f3cf004b940 msgr2=0x7f3cf000f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:37.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 zone default found 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 4 Realm: () 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:37.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 zonegroup default 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.059+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.063+0000 7f3d0a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.063+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.063+0000 7f3d0a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.063+0000 7f3d0a5da9c0 20 started sync module instance, tier type = 2024-08-27T02:56:37.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.063+0000 7f3d0a5da9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=0 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=1 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=2 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=3 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=4 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=5 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=6 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 20 add_watcher() i=7 2024-08-27T02:56:37.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.079+0000 7f3d0a5da9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:37.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3bbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 5 note: GC not initialized 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3bbdfdb640 20 reqs_thread_entry: start 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 Filter name: none 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3b2f7fe640 20 reqs_thread_entry: start 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:37.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:56:37.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:37.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:37.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.083+0000 7f3d0a5da9c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.087+0000 7f3d0a5da9c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:56:37.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.087+0000 7f3d0a5da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:56:37.086 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.087+0000 7f3bbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:37.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.095+0000 7f3d0a5da9c0 20 remove_watcher() i=0 2024-08-27T02:56:37.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.095+0000 7f3d0a5da9c0 2 removed watcher, disabling cache 2024-08-27T02:56:37.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.095+0000 7f3d0a5da9c0 20 remove_watcher() i=1 2024-08-27T02:56:37.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.099+0000 7f3d0a5da9c0 20 remove_watcher() i=2 2024-08-27T02:56:37.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.099+0000 7f3d0a5da9c0 20 remove_watcher() i=3 2024-08-27T02:56:37.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.103+0000 7f3d0a5da9c0 20 remove_watcher() i=4 2024-08-27T02:56:37.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.103+0000 7f3d0a5da9c0 20 remove_watcher() i=5 2024-08-27T02:56:37.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.103+0000 7f3d0a5da9c0 20 remove_watcher() i=6 2024-08-27T02:56:37.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.107+0000 7f3d0a5da9c0 20 remove_watcher() i=7 2024-08-27T02:56:37.117 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.117 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:56:37.117 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-08-27T02:56:37.117 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:56:37.221 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:56:37.257 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:56:37.257 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:56:37.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 realm 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.303+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.307+0000 7f2c353459c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:37.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.307+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.307+0000 7f2c353459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:56:37.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.307+0000 7f2c353459c0 20 searching for the correct realm 2024-08-27T02:56:37.313 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.315+0000 7f2c3364c640 0 -- 172.21.15.143:0/1980558607 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f2c1c0c0070 msgr2=0x7f2c1c10d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:37.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.527+0000 7f2c3364c640 0 -- 172.21.15.143:0/1980558607 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f2c1c0c0070 msgr2=0x7f2c1c10d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:56:37.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:56:37.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:56:37.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:56:37.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:56:37.536 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:56:37.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:56:37.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.537 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:56:37.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:56:37.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 zone default found 2024-08-27T02:56:37.538 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 4 Realm: () 2024-08-27T02:56:37.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:56:37.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:56:37.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:56:37.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 zonegroup default 2024-08-27T02:56:37.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.539 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.539+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.543+0000 7f2c353459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.543+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.543+0000 7f2c353459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:56:37.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.543+0000 7f2c353459c0 20 started sync module instance, tier type = 2024-08-27T02:56:37.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.543+0000 7f2c353459c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:56:37.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.567+0000 7f2c353459c0 20 add_watcher() i=0 2024-08-27T02:56:37.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.567+0000 7f2c353459c0 20 add_watcher() i=1 2024-08-27T02:56:37.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.567+0000 7f2c353459c0 20 add_watcher() i=2 2024-08-27T02:56:37.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.567+0000 7f2c353459c0 20 add_watcher() i=3 2024-08-27T02:56:37.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.567+0000 7f2c353459c0 20 add_watcher() i=4 2024-08-27T02:56:37.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.567+0000 7f2c353459c0 20 add_watcher() i=5 2024-08-27T02:56:37.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.571+0000 7f2c353459c0 20 add_watcher() i=6 2024-08-27T02:56:37.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.571+0000 7f2c353459c0 20 add_watcher() i=7 2024-08-27T02:56:37.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.571+0000 7f2c353459c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:56:37.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.575+0000 7f2ae97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:37.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.575+0000 7f2c353459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:56:37.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.575+0000 7f2c353459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:56:37.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.575+0000 7f2c353459c0 5 note: GC not initialized 2024-08-27T02:56:37.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.575+0000 7f2a63fff640 20 reqs_thread_entry: start 2024-08-27T02:56:37.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 20 init_complete bucket index max shards: 11 2024-08-27T02:56:37.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 20 Filter name: none 2024-08-27T02:56:37.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2a61ffb640 20 reqs_thread_entry: start 2024-08-27T02:56:37.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-08-27T02:56:37.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:56:37.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-08-27T02:56:37.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-08-27T02:56:37.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 : miss 2024-08-27T02:56:37.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 20 rados->read ofs=0 len=0 2024-08-27T02:56:37.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:56:37.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:56:37.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:56:37.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:56:37.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:56:37.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.579+0000 7f2c353459c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 2024-08-27T02:56:37.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.583+0000 7f2c353459c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to be held by another RGW process; skipping for now 2024-08-27T02:56:37.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.583+0000 7f2ae97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:56:37.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.587+0000 7f2c353459c0 20 remove_watcher() i=0 2024-08-27T02:56:37.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.587+0000 7f2c353459c0 2 removed watcher, disabling cache 2024-08-27T02:56:37.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.591+0000 7f2c353459c0 20 remove_watcher() i=1 2024-08-27T02:56:37.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.591+0000 7f2c353459c0 20 remove_watcher() i=2 2024-08-27T02:56:37.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.595+0000 7f2c353459c0 20 remove_watcher() i=3 2024-08-27T02:56:37.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.599+0000 7f2c353459c0 20 remove_watcher() i=4 2024-08-27T02:56:37.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.599+0000 7f2c353459c0 20 remove_watcher() i=5 2024-08-27T02:56:37.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.599+0000 7f2c353459c0 20 remove_watcher() i=6 2024-08-27T02:56:37.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:56:37.603+0000 7f2c353459c0 20 remove_watcher() i=7 2024-08-27T02:56:37.623 INFO:tasks.workunit.client.0.smithi143.stderr:waiting 30 seconds for reshard lock to expire... 2024-08-27T02:57:07.654 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-08-27T02:57:07.691 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:07.691 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:07.735 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.737 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 realm 2024-08-27T02:57:07.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:07.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.738 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.738+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.742+0000 7fb7567ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:07.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.742+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.742+0000 7fb7567ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:07.740 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.742+0000 7fb7567ee9c0 20 searching for the correct realm 2024-08-27T02:57:07.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.746+0000 7fb753af3640 0 -- 172.21.15.143:0/2816808889 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55731c708560 msgr2=0x55731c70aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:07.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.754+0000 7fb7542f4640 0 -- 172.21.15.143:0/2816808889 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fb74802e400 msgr2=0x7fb74802e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:07.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.761 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 zone default found 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 4 Realm: () 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 zonegroup default 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.762 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 started sync module instance, tier type = 2024-08-27T02:57:07.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.762+0000 7fb7567ee9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:07.789 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=0 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=1 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=2 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=3 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=4 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=5 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=6 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 20 add_watcher() i=7 2024-08-27T02:57:07.790 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.790+0000 7fb7567ee9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:07.793 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb60afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:07.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb7567ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:07.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb7567ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:07.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb7567ee9c0 5 note: GC not initialized 2024-08-27T02:57:07.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb609fdb640 20 reqs_thread_entry: start 2024-08-27T02:57:07.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb7567ee9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:07.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb7567ee9c0 20 Filter name: none 2024-08-27T02:57:07.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb57b7fe640 20 reqs_thread_entry: start 2024-08-27T02:57:07.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb7567ee9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-08-27T02:57:07.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.794+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:57:07.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-08-27T02:57:07.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-08-27T02:57:07.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 : miss 2024-08-27T02:57:07.796 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 20 rados_obj.operate() r=0 bl.length=451 2024-08-27T02:57:07.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:57:07.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:57:07.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:07.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:57:07.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.798+0000 7fb7567ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 2024-08-27T02:57:07.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.802+0000 7fb7567ee9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:57:07.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb7567ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:57:07.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb7567ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:57:07.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb7567ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:57:07.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb7567ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33, ofs0, ns] 2024-08-27T02:57:07.814 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb62affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366271 cookie 93952886801504 notifier 7533 bl.length()=931 2024-08-27T02:57:07.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb62affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:57:07.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb62affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:57:07.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.814+0000 7fb62affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:57:07.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.818+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_sources= new_sources= 2024-08-27T02:57:07.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.818+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential sources added=[] removed=[] 2024-08-27T02:57:07.816 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.818+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_dests= new_dests= 2024-08-27T02:57:07.817 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.818+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential dests added=[] removed=[] 2024-08-27T02:57:07.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.0 2024-08-27T02:57:07.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.0 2024-08-27T02:57:07.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.1 2024-08-27T02:57:07.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.1 2024-08-27T02:57:07.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.2 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.2 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.3 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.3 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.4 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.4 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.5 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.5 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.6 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.6 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.7 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.7 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.8 2024-08-27T02:57:07.830 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.8 2024-08-27T02:57:07.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.9 2024-08-27T02:57:07.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.9 2024-08-27T02:57:07.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.10 2024-08-27T02:57:07.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.10 2024-08-27T02:57:07.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.11 2024-08-27T02:57:07.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2.11 2024-08-27T02:57:07.831 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.0 2024-08-27T02:57:07.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1 2024-08-27T02:57:07.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.830+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2 2024-08-27T02:57:07.832 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.834+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.3 2024-08-27T02:57:07.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.834+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.4 2024-08-27T02:57:07.833 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.834+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.5 2024-08-27T02:57:07.834 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.834+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.6 2024-08-27T02:57:07.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.838+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.7 2024-08-27T02:57:07.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.838+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.8 2024-08-27T02:57:07.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.838+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.9 2024-08-27T02:57:07.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.842+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.10 2024-08-27T02:57:07.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.846+0000 7fb7567ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 : hit (requested=0x17, cached=0x17) 2024-08-27T02:57:07.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.846+0000 7fb7567ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 2024-08-27T02:57:07.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb7567ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:57:07.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb7567ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:57:07.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb7567ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:57:07.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb7567ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33, ofs0, ns] 2024-08-27T02:57:07.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb62b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366272 cookie 93952886801504 notifier 7533 bl.length()=931 2024-08-27T02:57:07.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb62b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:57:07.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb62b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:57:07.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.850+0000 7fb62b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:57:07.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.854+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_sources= new_sources= 2024-08-27T02:57:07.851 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.854+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential sources added=[] removed=[] 2024-08-27T02:57:07.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.854+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_dests= new_dests= 2024-08-27T02:57:07.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.854+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential dests added=[] removed=[] 2024-08-27T02:57:07.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.858+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.0 2024-08-27T02:57:07.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.858+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.1 2024-08-27T02:57:07.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.858+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.2 2024-08-27T02:57:07.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.862+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.3 2024-08-27T02:57:07.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.862+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.4 2024-08-27T02:57:07.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.862+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.5 2024-08-27T02:57:07.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.862+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.6 2024-08-27T02:57:07.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.862+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.7 2024-08-27T02:57:07.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.866+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.8 2024-08-27T02:57:07.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.866+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.9 2024-08-27T02:57:07.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.866+0000 7fb7567ee9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33.10 2024-08-27T02:57:07.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.866+0000 7fb7567ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 : hit (requested=0x17, cached=0x17) 2024-08-27T02:57:07.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.866+0000 7fb7567ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb7567ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb7567ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb7567ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb7567ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33, ofs0, ns] 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb62affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366273 cookie 93952886801504 notifier 7533 bl.length()=899 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb62affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 info.flags=0x17 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb62affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 to cache LRU end 2024-08-27T02:57:07.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.870+0000 7fb62affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-08-27T02:57:07.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.874+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_sources= new_sources= 2024-08-27T02:57:07.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.874+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential sources added=[] removed=[] 2024-08-27T02:57:07.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.874+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): orig_dests= new_dests= 2024-08-27T02:57:07.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.874+0000 7fb7567ee9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33]): potential dests added=[] removed=[] 2024-08-27T02:57:07.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.878+0000 7fb7567ee9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-08-27T02:57:07.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.882+0000 7fb60afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:07.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.886+0000 7fb7567ee9c0 20 remove_watcher() i=0 2024-08-27T02:57:07.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.886+0000 7fb7567ee9c0 2 removed watcher, disabling cache 2024-08-27T02:57:07.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.890+0000 7fb7567ee9c0 20 remove_watcher() i=1 2024-08-27T02:57:07.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.890+0000 7fb7567ee9c0 20 remove_watcher() i=2 2024-08-27T02:57:07.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.894+0000 7fb7567ee9c0 20 remove_watcher() i=3 2024-08-27T02:57:07.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.894+0000 7fb7567ee9c0 20 remove_watcher() i=4 2024-08-27T02:57:07.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.898+0000 7fb7567ee9c0 20 remove_watcher() i=5 2024-08-27T02:57:07.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.898+0000 7fb7567ee9c0 20 remove_watcher() i=6 2024-08-27T02:57:07.899 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.902+0000 7fb7567ee9c0 20 remove_watcher() i=7 2024-08-27T02:57:07.917 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-08-27T02:57:07.947 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:07.948 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:07.990 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.990+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 realm 2024-08-27T02:57:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:07.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:07.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.994+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:07.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.998+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:07.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:07.998+0000 7f874bb8f9c0 20 searching for the correct realm 2024-08-27T02:57:08.002 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.002+0000 7f8749e96640 0 -- 172.21.15.143:0/2536972384 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f874001f040 msgr2=0x7f8740014900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:08.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.218+0000 7f8749695640 0 -- 172.21.15.143:0/2536972384 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x5622557567b0 msgr2=0x562255758ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:08.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:08.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:08.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:08.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:08.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:08.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:08.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:08.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:08.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.226+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 zone default found 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 4 Realm: () 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 zonegroup default 2024-08-27T02:57:08.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:08.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:08.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:08.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 started sync module instance, tier type = 2024-08-27T02:57:08.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.230+0000 7f874bb8f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.254+0000 7f874bb8f9c0 20 add_watcher() i=0 2024-08-27T02:57:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.254+0000 7f874bb8f9c0 20 add_watcher() i=1 2024-08-27T02:57:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.254+0000 7f874bb8f9c0 20 add_watcher() i=2 2024-08-27T02:57:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.254+0000 7f874bb8f9c0 20 add_watcher() i=3 2024-08-27T02:57:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.254+0000 7f874bb8f9c0 20 add_watcher() i=4 2024-08-27T02:57:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.254+0000 7f874bb8f9c0 20 add_watcher() i=5 2024-08-27T02:57:08.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.254+0000 7f874bb8f9c0 20 add_watcher() i=6 2024-08-27T02:57:08.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.258+0000 7f874bb8f9c0 20 add_watcher() i=7 2024-08-27T02:57:08.256 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.258+0000 7f874bb8f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:08.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f85ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:08.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:08.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:08.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 5 note: GC not initialized 2024-08-27T02:57:08.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f85fe7e4640 20 reqs_thread_entry: start 2024-08-27T02:57:08.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:08.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 20 Filter name: none 2024-08-27T02:57:08.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f856ffff640 20 reqs_thread_entry: start 2024-08-27T02:57:08.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:57:08.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.262+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.266+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:57:08.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.266+0000 7f874bb8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:08.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.266+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.266+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-08-27T02:57:08.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.266+0000 7f874bb8f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:08.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.266+0000 7f874bb8f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-08-27T02:57:08.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.266+0000 7f874bb8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:08.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.270+0000 7f85ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:08.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.274+0000 7f874bb8f9c0 20 remove_watcher() i=0 2024-08-27T02:57:08.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.274+0000 7f874bb8f9c0 2 removed watcher, disabling cache 2024-08-27T02:57:08.277 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.278+0000 7f874bb8f9c0 20 remove_watcher() i=1 2024-08-27T02:57:08.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.282+0000 7f874bb8f9c0 20 remove_watcher() i=2 2024-08-27T02:57:08.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.282+0000 7f874bb8f9c0 20 remove_watcher() i=3 2024-08-27T02:57:08.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.286+0000 7f874bb8f9c0 20 remove_watcher() i=4 2024-08-27T02:57:08.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.286+0000 7f874bb8f9c0 20 remove_watcher() i=5 2024-08-27T02:57:08.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.286+0000 7f874bb8f9c0 20 remove_watcher() i=6 2024-08-27T02:57:08.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:08.290+0000 7f874bb8f9c0 20 remove_watcher() i=7 2024-08-27T02:57:08.303 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:08.304 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:57:08.304 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: abort-at-change-reshard-state id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-08-27T02:57:08.304 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:09.232 INFO:tasks.workunit.client.0.smithi143.stderr: test: logrecord could be stopped after reshard failed 2024-08-27T02:57:09.232 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:57:09.265 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:09.265 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:09.310 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.310+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 realm 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:09.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.314+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.318+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:09.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.318+0000 7fe9f4ed99c0 20 searching for the correct realm 2024-08-27T02:57:09.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.318+0000 7fe9f29df640 0 -- 172.21.15.143:0/83170906 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7fe9ec0b8040 msgr2=0x7fe9ec0f8b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:57:09.530 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.530+0000 7fe9f31e0640 0 -- 172.21.15.143:0/83170906 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fe9e805ba00 msgr2=0x7fe9e8076130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:09.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:09.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:09.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:09.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:09.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:09.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:09.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.546+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:09.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:09.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 zone default found 2024-08-27T02:57:09.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 4 Realm: () 2024-08-27T02:57:09.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:09.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:09.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:09.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 zonegroup default 2024-08-27T02:57:09.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 started sync module instance, tier type = 2024-08-27T02:57:09.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.550+0000 7fe9f4ed99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:09.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.570+0000 7fe9f4ed99c0 20 add_watcher() i=0 2024-08-27T02:57:09.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.570+0000 7fe9f4ed99c0 20 add_watcher() i=1 2024-08-27T02:57:09.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.570+0000 7fe9f4ed99c0 20 add_watcher() i=2 2024-08-27T02:57:09.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.570+0000 7fe9f4ed99c0 20 add_watcher() i=3 2024-08-27T02:57:09.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.570+0000 7fe9f4ed99c0 20 add_watcher() i=4 2024-08-27T02:57:09.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.570+0000 7fe9f4ed99c0 20 add_watcher() i=5 2024-08-27T02:57:09.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.570+0000 7fe9f4ed99c0 20 add_watcher() i=6 2024-08-27T02:57:09.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.574+0000 7fe9f4ed99c0 20 add_watcher() i=7 2024-08-27T02:57:09.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.574+0000 7fe9f4ed99c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:09.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe8a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:09.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe9f4ed99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:09.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe9f4ed99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:09.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe9f4ed99c0 5 note: GC not initialized 2024-08-27T02:57:09.578 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe823fff640 20 reqs_thread_entry: start 2024-08-27T02:57:09.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe9f4ed99c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:09.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe9f4ed99c0 20 Filter name: none 2024-08-27T02:57:09.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe821ffb640 20 reqs_thread_entry: start 2024-08-27T02:57:09.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.578+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:09.579 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:09.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:09.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.580 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:09.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:09.581 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.582+0000 7fe9f4ed99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:09.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.586+0000 7fe8a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:09.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.590+0000 7fe9f4ed99c0 20 remove_watcher() i=0 2024-08-27T02:57:09.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.590+0000 7fe9f4ed99c0 2 removed watcher, disabling cache 2024-08-27T02:57:09.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.590+0000 7fe9f4ed99c0 20 remove_watcher() i=1 2024-08-27T02:57:09.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.594+0000 7fe9f4ed99c0 20 remove_watcher() i=2 2024-08-27T02:57:09.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.594+0000 7fe9f4ed99c0 20 remove_watcher() i=3 2024-08-27T02:57:09.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.598+0000 7fe9f4ed99c0 20 remove_watcher() i=4 2024-08-27T02:57:09.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.598+0000 7fe9f4ed99c0 20 remove_watcher() i=5 2024-08-27T02:57:09.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.602+0000 7fe9f4ed99c0 20 remove_watcher() i=6 2024-08-27T02:57:09.602 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.602+0000 7fe9f4ed99c0 20 remove_watcher() i=7 2024-08-27T02:57:09.618 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:09.618 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:57:09.618 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-08-27T02:57:09.618 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:09.618 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:57:09.645 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:09.645 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:09.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.690+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.690+0000 7f929f1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.690+0000 7f929f1f29c0 20 realm 2024-08-27T02:57:09.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.690+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.690+0000 7f929f1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.690+0000 7f929f1f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:09.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.690+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.691 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.694+0000 7f929f1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.694+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.694+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:09.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.694+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.694+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:09.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.694+0000 7f929f1f29c0 20 searching for the correct realm 2024-08-27T02:57:09.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.702+0000 7f929d4f9640 0 -- 172.21.15.143:0/823039328 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f92900c2060 msgr2=0x7f92900f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:09.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.918+0000 7f929ccf8640 0 -- 172.21.15.143:0/823039328 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55880a34d260 msgr2=0x55880a34f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:09.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:09.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:09.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:09.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:09.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:09.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:09.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:09.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.926+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 zone default found 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 4 Realm: () 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 zonegroup default 2024-08-27T02:57:09.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:09.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 started sync module instance, tier type = 2024-08-27T02:57:09.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.930+0000 7f929f1f29c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:09.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.954+0000 7f929f1f29c0 20 add_watcher() i=0 2024-08-27T02:57:09.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.954+0000 7f929f1f29c0 20 add_watcher() i=1 2024-08-27T02:57:09.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.954+0000 7f929f1f29c0 20 add_watcher() i=2 2024-08-27T02:57:09.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.954+0000 7f929f1f29c0 20 add_watcher() i=3 2024-08-27T02:57:09.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.954+0000 7f929f1f29c0 20 add_watcher() i=4 2024-08-27T02:57:09.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.954+0000 7f929f1f29c0 20 add_watcher() i=5 2024-08-27T02:57:09.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.954+0000 7f929f1f29c0 20 add_watcher() i=6 2024-08-27T02:57:09.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.958+0000 7f929f1f29c0 20 add_watcher() i=7 2024-08-27T02:57:09.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.958+0000 7f929f1f29c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:09.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f9152fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:09.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f929f1f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:09.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f929f1f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:09.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f929f1f29c0 5 note: GC not initialized 2024-08-27T02:57:09.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f9151fe3640 20 reqs_thread_entry: start 2024-08-27T02:57:09.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f929f1f29c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:09.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f929f1f29c0 20 Filter name: none 2024-08-27T02:57:09.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f90c37fe640 20 reqs_thread_entry: start 2024-08-27T02:57:09.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.962+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:09.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:09.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:09.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:09.964 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:09.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:09.965 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.966+0000 7f929f1f29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:09.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.970+0000 7f9152fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:09.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.974+0000 7f929f1f29c0 20 remove_watcher() i=0 2024-08-27T02:57:09.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.974+0000 7f929f1f29c0 2 removed watcher, disabling cache 2024-08-27T02:57:09.977 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.978+0000 7f929f1f29c0 20 remove_watcher() i=1 2024-08-27T02:57:09.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.978+0000 7f929f1f29c0 20 remove_watcher() i=2 2024-08-27T02:57:09.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.982+0000 7f929f1f29c0 20 remove_watcher() i=3 2024-08-27T02:57:09.983 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.986+0000 7f929f1f29c0 20 remove_watcher() i=4 2024-08-27T02:57:09.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.986+0000 7f929f1f29c0 20 remove_watcher() i=5 2024-08-27T02:57:09.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.986+0000 7f929f1f29c0 20 remove_watcher() i=6 2024-08-27T02:57:09.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:09.990+0000 7f929f1f29c0 20 remove_watcher() i=7 2024-08-27T02:57:10.003 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-08-27T02:57:10.035 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:10.035 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:10.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 realm 2024-08-27T02:57:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.079 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:10.081 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 searching for the correct realm 2024-08-27T02:57:10.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.090+0000 7f5968bf2640 0 -- 172.21.15.143:0/1107827246 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f595c03e070 msgr2=0x7f595c040920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.094+0000 7f5969bf4640 0 -- 172.21.15.143:0/1107827246 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f595404a150 msgr2=0x7f59540907c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:10.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:10.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:10.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:10.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:10.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:10.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 zone default found 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 Realm: () 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 zonegroup default 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 started sync module instance, tier type = 2024-08-27T02:57:10.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=0 2024-08-27T02:57:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=1 2024-08-27T02:57:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=2 2024-08-27T02:57:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=3 2024-08-27T02:57:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=4 2024-08-27T02:57:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=5 2024-08-27T02:57:10.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=6 2024-08-27T02:57:10.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 add_watcher() i=7 2024-08-27T02:57:10.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:10.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f581ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:10.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:10.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:10.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 note: GC not initialized 2024-08-27T02:57:10.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f581efe5640 20 reqs_thread_entry: start 2024-08-27T02:57:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 Filter name: none 2024-08-27T02:57:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f581cfe1640 20 reqs_thread_entry: start 2024-08-27T02:57:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:10.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:10.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.125 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:57:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94827298201920 notifier 7214 bl.length()=827 2024-08-27T02:57:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:57:10.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:57:10.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:57:10.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:57:10.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.1 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.1 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.2 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.2 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.3 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.3 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.4 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.4 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.5 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.5 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.6 2024-08-27T02:57:10.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.6 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.7 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.7 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.8 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.8 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.9 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.9 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.10 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.10 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.11 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.11 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.12 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.12 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.13 2024-08-27T02:57:10.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.13 2024-08-27T02:57:10.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.158 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f596b8ed9c0 time 2024-08-27T02:57:10.163670+0000 2024-08-27T02:57:10.158 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:10.159 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f596f1c72eb] 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:57:10.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.162+0000 7f596b8ed9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f596b8ed9c0 time 2024-08-27T02:57:10.163670+0000 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f596f1c72eb] 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.161 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:57:10.162 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.162 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:57:10.162 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:57:10.162 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.162 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:57:10.162 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f596b8ed9c0 thread_name:radosgw-admin 2024-08-27T02:57:10.176 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f596e046520] 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f596f1c7345] 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.177 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.162+0000 7f596b8ed9c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f596b8ed9c0 thread_name:radosgw-admin 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f596e046520] 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f596f1c7345] 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.178 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: crc 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: secure 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: crc 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: secure 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: crc 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: secure 2024-08-27T02:57:10.179 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key hook 0x563eb35d0068 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb351c330 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb351c710 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb351cb20 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.940416s 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): get_auth_request con 0x563eb351c710 auth_method 0 2024-08-27T02:57:10.180 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): get_auth_request con 0x563eb351c330 auth_method 0 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_done global_id 7596 payload 824 2024-08-27T02:57:10.181 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:57:10.062+0000 7f5968bf2640 1 monclient: found mon.noname-a 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: dump: 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.182 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: dump: 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.183 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:57:10.062+0000 7f5857606640 4 set_mon_vals no callback set 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7596 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 1 librados: init done 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:57:10.062+0000 7f5855e03640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:57:10.062+0000 7f5855e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.184 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:57:10.062+0000 7f5855e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:57:10.066+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5850070ad0 auth_method 0 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:57:10.066+0000 7f5969bf4640 10 monclient: get_auth_request con 0x563eb35f6020 auth_method 0 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:57:10.066+0000 7f59693f3640 10 monclient: get_auth_request con 0x563eb361a650 auth_method 0 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:57:10.066+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb361fbc0 auth_method 0 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: build_initial_monmap 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: monmap: 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.185 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding auth protocol: cephx 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding auth protocol: cephx 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding auth protocol: cephx 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.186 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command objecter_requests cmddesc objecter_requests hook 0x563eb3627620 EEXIST 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: init 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding auth protocol: cephx 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding auth protocol: cephx 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding auth protocol: cephx 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.187 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.188 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key cmddesc rotate-key hook 0x563eb3622d00 EEXIST 2024-08-27T02:57:10.190 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.190 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:57:10.190 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb364b7d0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.190 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb364b100 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.190 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb3649ae0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.190 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.190 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.949521s 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): get_auth_request con 0x563eb3649ae0 auth_method 0 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): get_auth_request con 0x563eb364b100 auth_method 0 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.191 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): get_auth_request con 0x563eb364b7d0 auth_method 0 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_done global_id 7599 payload 824 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:57:10.070+0000 7f5969bf4640 1 monclient: found mon.noname-a 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.192 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: dump: 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.193 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7599 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:57:10.070+0000 7f596a3f5640 4 set_mon_vals no callback set 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: dump: 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.194 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:57:10.074+0000 7f584effd640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:57:10.074+0000 7f584effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:57:10.074+0000 7f584effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: get_monmap_and_config 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: build_initial_monmap 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: monmap: 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:10.195 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding auth protocol: cephx 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding auth protocol: cephx 2024-08-27T02:57:10.196 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding auth protocol: cephx 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:57:10.074+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5844070b80 auth_method 0 2024-08-27T02:57:10.197 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: init 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding auth protocol: cephx 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding auth protocol: cephx 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding auth protocol: cephx 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.198 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key cmddesc rotate-key hook 0x7ffec56d9cb8 EEXIST 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb369f1b0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb36701d0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb369ab50 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.199 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.953569s 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): get_auth_request con 0x563eb36701d0 auth_method 0 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): get_auth_request con 0x563eb369ab50 auth_method 0 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.200 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_done global_id 7211 payload 274 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:57:10.074+0000 7f5968bf2640 1 monclient: found mon.noname-c 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: dump: 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.201 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: dump: 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.202 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7211 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: get_monmap_and_config success 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 4 set_mon_vals no callback set 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: shutdown 2024-08-27T02:57:10.203 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: build_initial_monmap 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: monmap: 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding auth protocol: cephx 2024-08-27T02:57:10.204 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding auth protocol: cephx 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding auth protocol: cephx 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.205 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: starting msgr at 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: starting objecter 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command objecter_requests cmddesc objecter_requests hook 0x563eb366aa90 EEXIST 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: setting wanted keys 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: calling monclient init 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: init 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding auth protocol: cephx 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding auth protocol: cephx 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding auth protocol: cephx 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.206 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key cmddesc rotate-key hook 0x563eb364d738 EEXIST 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:57:10.207 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb369ab50 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb369f1b0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb369e570 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.956062s 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): get_auth_request con 0x563eb369ab50 auth_method 0 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): get_auth_request con 0x563eb369e570 auth_method 0 2024-08-27T02:57:10.208 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_done global_id 7214 payload 824 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:57:10.078+0000 7f5969bf4640 1 monclient: found mon.noname-c 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:57:10.078+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb369f1b0 auth_method 0 2024-08-27T02:57:10.209 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: dump: 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.210 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7214 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: dump: 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.211 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:57:10.078+0000 7f584cff9640 4 set_mon_vals no callback set 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 1 librados: init done 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cr dump hook 0x563eb36903c8 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:57:10.078+0000 7f583affd640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:57:10.078+0000 7f583affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:57:10.078+0000 7f583affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.212 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:57:10.078+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb36b8990 auth_method 0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5834070ad0 auth_method 0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 realm 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:57:10.082+0000 7f59693f3640 10 monclient: get_auth_request con 0x563eb36bcbc0 auth_method 0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:10.213 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 searching for the correct realm 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:57:10.082+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb36c1e80 auth_method 0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:57:10.082+0000 7f5969bf4640 10 monclient: get_auth_request con 0x7f595405bd80 auth_method 0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:57:10.086+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5964128040 auth_method 0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:57:10.086+0000 7f5968bf2640 10 monclient: get_auth_request con 0x7f595c03e070 auth_method 0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:57:10.090+0000 7f5968bf2640 0 -- 172.21.15.143:0/1107827246 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f595c03e070 msgr2=0x7f595c040920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:57:10.090+0000 7f583affd640 1 client.7214.objecter ms_handle_reset 0x7f595c03e070 session 0x7f595c029050 osd.4 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:57:10.090+0000 7f583affd640 10 monclient: _renew_subs 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:57:10.090+0000 7f583affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:57:10.090+0000 7f5969bf4640 10 monclient: get_auth_request con 0x7f595404a150 auth_method 0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:57:10.090+0000 7f5968bf2640 10 monclient: get_auth_request con 0x7f5834081170 auth_method 0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:57:10.094+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f59540176f0 auth_method 0 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:57:10.094+0000 7f5969bf4640 0 -- 172.21.15.143:0/1107827246 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f595404a150 msgr2=0x7f59540907c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.214 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:57:10.094+0000 7f583affd640 1 client.7214.objecter ms_handle_reset 0x7f595404a150 session 0x7f5954073e80 osd.6 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:57:10.094+0000 7f5969bf4640 10 monclient: get_auth_request con 0x7f595c03e070 auth_method 0 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:10.215 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 zone default found 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 Realm: () 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 zonegroup default 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 started sync module instance, tier type = 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:10.216 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=0 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=1 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=2 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=3 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=4 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=5 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=6 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 add_watcher() i=7 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding auth protocol: cephx 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding auth protocol: cephx 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding auth protocol: cephx 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.217 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:57:10.122+0000 7f581ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:10.218 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache list hook 0x563eb369e4a0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache inspect hook 0x563eb369e4a0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache erase hook 0x563eb369e4a0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache zap hook 0x563eb369e4a0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 note: GC not initialized 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:57:10.122+0000 7f581efe5640 20 reqs_thread_entry: start 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace show hook 0x7f595405d0b0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace history hook 0x7f595405d0b0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace active hook 0x7f595405d0b0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace active_short hook 0x7f595405d0b0 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 Filter name: none 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:57:10.122+0000 7f581cfe1640 20 reqs_thread_entry: start 2024-08-27T02:57:10.219 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.220 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94827298201920 notifier 7214 bl.length()=827 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.1 2024-08-27T02:57:10.221 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.1 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.2 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.2 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.3 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.3 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.4 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.4 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.5 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.5 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.6 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.6 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.7 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.7 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.8 2024-08-27T02:57:10.222 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.8 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.9 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.9 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.10 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.10 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.11 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.11 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.12 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.12 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.13 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.13 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.223 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.224 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:57:10.162+0000 7f596b8ed9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f596b8ed9c0 time 2024-08-27T02:57:10.163670+0000 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f596f1c72eb] 2024-08-27T02:57:10.225 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:57:10.162+0000 7f596b8ed9c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f596b8ed9c0 thread_name:radosgw-admin 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.226 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f596e046520] 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f596f1c7345] 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:57:10.227 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:57:10.228 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:57:10.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:57:10.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:57:10.231 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:57:10.232 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:57:10.233 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 7f581cfe1640 / http_manager 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 7f581efe5640 / http_manager 2024-08-27T02:57:10.234 INFO:tasks.workunit.client.0.smithi143.stderr: 7f581ffe7640 / rgw_dt_lg_renew 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f583affd640 / ms_dispatch 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f584cff9640 / io_context_pool 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f584effd640 / ms_dispatch 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5855e03640 / ms_dispatch 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5857606640 / io_context_pool 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5968bf2640 / msgr-worker-2 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59693f3640 / msgr-worker-1 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5969bf4640 / msgr-worker-0 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f596a3f5640 / io_context_pool 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: 7f596b8ed9c0 / radosgw-admin 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:57:10.235 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.121033.log 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: crc 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: secure 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: crc 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: secure 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: crc 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:57:10.058+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb35cff20) adding con mode: secure 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key hook 0x563eb35d0068 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:57:10.236 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb351c330 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb351c710 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb351cb20 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.940416s 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): get_auth_request con 0x563eb351c710 auth_method 0 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): get_auth_request con 0x563eb351c330 auth_method 0 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.237 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:57:10.062+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient(hunting): handle_auth_done global_id 7596 payload 824 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:57:10.062+0000 7f5968bf2640 1 monclient: found mon.noname-a 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:57:10.062+0000 7f5968bf2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:57:10.238 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: dump: 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.239 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:57:10.062+0000 7f5855e03640 10 monclient: dump: 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.240 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:57:10.062+0000 7f5857606640 4 set_mon_vals no callback set 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7596 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:57:10.062+0000 7f596b8ed9c0 1 librados: init done 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:57:10.062+0000 7f5855e03640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:57:10.062+0000 7f5855e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:57:10.062+0000 7f5855e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:57:10.066+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5850070ad0 auth_method 0 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:57:10.066+0000 7f5969bf4640 10 monclient: get_auth_request con 0x563eb35f6020 auth_method 0 2024-08-27T02:57:10.241 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:57:10.066+0000 7f59693f3640 10 monclient: get_auth_request con 0x563eb361a650 auth_method 0 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:57:10.066+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb361fbc0 auth_method 0 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: build_initial_monmap 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: monmap: 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:10.242 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding auth protocol: cephx 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding auth protocol: cephx 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding auth protocol: cephx 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.243 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: crc 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3623bb0) adding con mode: secure 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command objecter_requests cmddesc objecter_requests hook 0x563eb3627620 EEXIST 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: init 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding auth protocol: cephx 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding auth protocol: cephx 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding auth protocol: cephx 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.244 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: crc 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb3622bb8) adding con mode: secure 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key cmddesc rotate-key hook 0x563eb3622d00 EEXIST 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb364b7d0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb364b100 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.245 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb3649ae0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.949521s 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): get_auth_request con 0x563eb3649ae0 auth_method 0 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): get_auth_request con 0x563eb364b100 auth_method 0 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.246 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:57:10.070+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): get_auth_request con 0x563eb364b7d0 auth_method 0 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:57:10.070+0000 7f59693f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient(hunting): handle_auth_done global_id 7599 payload 824 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:57:10.070+0000 7f5969bf4640 1 monclient: found mon.noname-a 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:57:10.070+0000 7f5969bf4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.247 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: dump: 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.248 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7599 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:57:10.070+0000 7f596a3f5640 4 set_mon_vals no callback set 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:57:10.070+0000 7f584effd640 10 monclient: dump: 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.249 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:57:10.070+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:57:10.074+0000 7f584effd640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:57:10.074+0000 7f584effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:57:10.074+0000 7f584effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: get_monmap_and_config 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: build_initial_monmap 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: monmap: 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:10.250 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding auth protocol: cephx 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding auth protocol: cephx 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding auth protocol: cephx 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.251 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: crc 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb366ada0) adding con mode: secure 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:57:10.074+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5844070b80 auth_method 0 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: init 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding auth protocol: cephx 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding auth protocol: cephx 2024-08-27T02:57:10.252 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding auth protocol: cephx 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: crc 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56d9b70) adding con mode: secure 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.253 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key cmddesc rotate-key hook 0x7ffec56d9cb8 EEXIST 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb369f1b0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb36701d0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb369ab50 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.953569s 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): get_auth_request con 0x563eb36701d0 auth_method 0 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.254 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): get_auth_request con 0x563eb369ab50 auth_method 0 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:57:10.074+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient(hunting): handle_auth_done global_id 7211 payload 274 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.255 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:57:10.074+0000 7f5968bf2640 1 monclient: found mon.noname-c 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:57:10.074+0000 7f5968bf2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: dump: 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.256 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:57:10.074+0000 7f584cff9640 10 monclient: dump: 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.257 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7211 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: get_monmap_and_config success 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 4 set_mon_vals no callback set 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: shutdown 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: build_initial_monmap 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: monmap: 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.258 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding auth protocol: cephx 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding auth protocol: cephx 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding auth protocol: cephx 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.259 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: crc 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb368fbf0) adding con mode: secure 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: starting msgr at 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: starting objecter 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command objecter_requests cmddesc objecter_requests hook 0x563eb366aa90 EEXIST 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: setting wanted keys 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 1 librados: calling monclient init 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: init 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding auth protocol: cephx 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding auth protocol: cephx 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding auth protocol: cephx 2024-08-27T02:57:10.260 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: crc 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 AuthRegistry(0x563eb364d5f0) adding con mode: secure 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.261 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command rotate-key cmddesc rotate-key hook 0x563eb364d738 EEXIST 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:57:10.074+0000 7f596b8ed9c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-a con 0x563eb369ab50 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-b con 0x563eb369f1b0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): picked mon.noname-c con 0x563eb369e570 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient(hunting): authenticate will time out at 2562.956062s 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): get_auth_request con 0x563eb369ab50 auth_method 0 2024-08-27T02:57:10.262 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): get_auth_request con 0x563eb369e570 auth_method 0 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient(hunting): handle_auth_done global_id 7214 payload 824 2024-08-27T02:57:10.263 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient: _finish_hunting 0 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:57:10.078+0000 7f5969bf4640 1 monclient: found mon.noname-c 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:57:10.078+0000 7f5969bf4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:57:10.078+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb369f1b0 auth_method 0 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: dump: 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.264 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: _finish_auth 0 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: _check_auth_tickets 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 5 monclient: authenticate success, global_id 7214 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:57:10.078+0000 7f583affd640 10 monclient: dump: 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:10.265 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:57:10.078+0000 7f584cff9640 4 set_mon_vals no callback set 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _renew_subs 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 1 librados: init done 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cr dump hook 0x563eb36903c8 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:57:10.078+0000 7f583affd640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:57:10.078+0000 7f583affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.266 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:57:10.078+0000 7f583affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:57:10.078+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb36b8990 auth_method 0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:57:10.078+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5834070ad0 auth_method 0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 realm 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:57:10.078+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:57:10.082+0000 7f59693f3640 10 monclient: get_auth_request con 0x563eb36bcbc0 auth_method 0 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.267 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:57:10.082+0000 7f596b8ed9c0 20 searching for the correct realm 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:57:10.082+0000 7f5968bf2640 10 monclient: get_auth_request con 0x563eb36c1e80 auth_method 0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:57:10.082+0000 7f5969bf4640 10 monclient: get_auth_request con 0x7f595405bd80 auth_method 0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:57:10.086+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f5964128040 auth_method 0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:57:10.086+0000 7f5968bf2640 10 monclient: get_auth_request con 0x7f595c03e070 auth_method 0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:57:10.090+0000 7f5968bf2640 0 -- 172.21.15.143:0/1107827246 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f595c03e070 msgr2=0x7f595c040920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:57:10.090+0000 7f583affd640 1 client.7214.objecter ms_handle_reset 0x7f595c03e070 session 0x7f595c029050 osd.4 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:57:10.090+0000 7f583affd640 10 monclient: _renew_subs 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:57:10.090+0000 7f583affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:57:10.090+0000 7f5969bf4640 10 monclient: get_auth_request con 0x7f595404a150 auth_method 0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:57:10.090+0000 7f5968bf2640 10 monclient: get_auth_request con 0x7f5834081170 auth_method 0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:57:10.094+0000 7f59693f3640 10 monclient: get_auth_request con 0x7f59540176f0 auth_method 0 2024-08-27T02:57:10.268 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:57:10.094+0000 7f5969bf4640 0 -- 172.21.15.143:0/1107827246 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f595404a150 msgr2=0x7f59540907c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:57:10.094+0000 7f583affd640 1 client.7214.objecter ms_handle_reset 0x7f595404a150 session 0x7f5954073e80 osd.6 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:57:10.094+0000 7f5969bf4640 10 monclient: get_auth_request con 0x7f595c03e070 auth_method 0 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.269 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 zone default found 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 Realm: () 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 zonegroup default 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.270 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 started sync module instance, tier type = 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:57:10.102+0000 7f596b8ed9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=0 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=1 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=2 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=3 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=4 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=5 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:57:10.118+0000 7f596b8ed9c0 20 add_watcher() i=6 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 add_watcher() i=7 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding auth protocol: cephx 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding auth protocol: cephx 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding auth protocol: cephx 2024-08-27T02:57:10.271 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:57:10.122+0000 7f581ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: crc 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 AuthRegistry(0x7ffec56da050) adding con mode: secure 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:10.272 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache list hook 0x563eb369e4a0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache inspect hook 0x563eb369e4a0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache erase hook 0x563eb369e4a0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command cache zap hook 0x563eb369e4a0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 note: GC not initialized 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:57:10.122+0000 7f581efe5640 20 reqs_thread_entry: start 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace show hook 0x7f595405d0b0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace history hook 0x7f595405d0b0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace active hook 0x7f595405d0b0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 5 asok(0x563eb33c5280) register_command sync trace active_short hook 0x7f595405d0b0 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 Filter name: none 2024-08-27T02:57:10.273 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:57:10.122+0000 7f581cfe1640 20 reqs_thread_entry: start 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:57:10.122+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:57:10.126+0000 7f596b8ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:10.274 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94827298201920 notifier 7214 bl.length()=827 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:57:10.138+0000 7f584cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:57:10.138+0000 7f596b8ed9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:57:10.275 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.1 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.1 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.2 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.2 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.3 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.3 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.4 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.4 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.5 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.5 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.6 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.6 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.7 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.7 2024-08-27T02:57:10.276 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.8 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.8 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.9 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.9 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.10 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.10 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.11 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.11 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.12 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.12 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.13 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.13 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.277 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:57:10.150+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.278 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:57:10.154+0000 7f596b8ed9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:57:10.162+0000 7f596b8ed9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f596b8ed9c0 time 2024-08-27T02:57:10.163670+0000 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f596f1c72eb] 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.279 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:57:10.162+0000 7f596b8ed9c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f596b8ed9c0 thread_name:radosgw-admin 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f596e046520] 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:10.280 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f596f1c7345] 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f596f1c749f] 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563eb1561b11] 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x563eb15764c1] 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563eb1577b14] 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f596e02dd90] 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:57:10.281 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:57:10.282 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:57:10.283 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:57:10.284 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:57:10.285 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:57:10.286 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:57:10.287 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f581cfe1640 / http_manager 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f581efe5640 / http_manager 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f581ffe7640 / rgw_dt_lg_renew 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f583affd640 / ms_dispatch 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f584cff9640 / io_context_pool 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f584effd640 / ms_dispatch 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5855e03640 / ms_dispatch 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5857606640 / io_context_pool 2024-08-27T02:57:10.288 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5968bf2640 / msgr-worker-2 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59693f3640 / msgr-worker-1 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr: 7f5969bf4640 / msgr-worker-0 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr: 7f596a3f5640 / io_context_pool 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr: 7f596b8ed9c0 / radosgw-admin 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:57:10.166035Z_b5e18d39-26a3-4d8f-bfad-aaab6cab9679/log 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:57:10.289 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:57:10.293 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:10.293 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:10.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.238+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 realm 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.242+0000 7fb0ec9189c0 20 searching for the correct realm 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.250+0000 7fb0e9c1d640 0 -- 172.21.15.143:0/2900331874 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb0dc027040 msgr2=0x7fb0dc09b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.254+0000 7fb0e9c1d640 0 -- 172.21.15.143:0/2900331874 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fafb4081170 msgr2=0x7fafb40835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 zone default found 2024-08-27T02:57:10.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 4 Realm: () 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 zonegroup default 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.262+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.266+0000 7fb0ec9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.266+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.266+0000 7fb0ec9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.266+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.266+0000 7fb0ec9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.266+0000 7fb0ec9189c0 20 started sync module instance, tier type = 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.266+0000 7fb0ec9189c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=0 2024-08-27T02:57:10.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=1 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=2 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=3 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=4 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=5 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=6 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 20 add_watcher() i=7 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.282+0000 7fb0ec9189c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fafa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 5 note: GC not initialized 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7faf1b7fe640 20 reqs_thread_entry: start 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:10.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 Filter name: none 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7faf197fa640 20 reqs_thread_entry: start 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.286+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.290+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.290+0000 7fb0ec9189c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.290+0000 7fb0ec9189c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.290+0000 7fb0ec9189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:10.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.290+0000 7fafa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:10.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.298+0000 7fb0ec9189c0 20 remove_watcher() i=0 2024-08-27T02:57:10.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.298+0000 7fb0ec9189c0 2 removed watcher, disabling cache 2024-08-27T02:57:10.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.298+0000 7fb0ec9189c0 20 remove_watcher() i=1 2024-08-27T02:57:10.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.302+0000 7fb0ec9189c0 20 remove_watcher() i=2 2024-08-27T02:57:10.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.302+0000 7fb0ec9189c0 20 remove_watcher() i=3 2024-08-27T02:57:10.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.306+0000 7fb0ec9189c0 20 remove_watcher() i=4 2024-08-27T02:57:10.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.306+0000 7fb0ec9189c0 20 remove_watcher() i=5 2024-08-27T02:57:10.306 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.306+0000 7fb0ec9189c0 20 remove_watcher() i=6 2024-08-27T02:57:10.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.310+0000 7fb0ec9189c0 20 remove_watcher() i=7 2024-08-27T02:57:10.365 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-08-27T02:57:10.391 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:10.391 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:10.431 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 realm 2024-08-27T02:57:10.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:10.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.434 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.434+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.438+0000 7fc776de99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.438+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.438+0000 7fc776de99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:10.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.438+0000 7fc776de99c0 20 searching for the correct realm 2024-08-27T02:57:10.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.442+0000 7fc7750f0640 0 -- 172.21.15.143:0/2850196185 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x7fc640081140 msgr2=0x7fc640083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:57:10.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.450+0000 7fc7748ef640 0 -- 172.21.15.143:0/2850196185 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fc768016b00 msgr2=0x7fc76808ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:10.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:10.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:10.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:10.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:10.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:10.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:10.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 zone default found 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 4 Realm: () 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:10.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 zonegroup default 2024-08-27T02:57:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.458+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.462+0000 7fc776de99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:10.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.462+0000 7fc776de99c0 20 started sync module instance, tier type = 2024-08-27T02:57:10.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.462+0000 7fc776de99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.474+0000 7fc776de99c0 20 add_watcher() i=0 2024-08-27T02:57:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.474+0000 7fc776de99c0 20 add_watcher() i=1 2024-08-27T02:57:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.474+0000 7fc776de99c0 20 add_watcher() i=2 2024-08-27T02:57:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.474+0000 7fc776de99c0 20 add_watcher() i=3 2024-08-27T02:57:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.474+0000 7fc776de99c0 20 add_watcher() i=4 2024-08-27T02:57:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.474+0000 7fc776de99c0 20 add_watcher() i=5 2024-08-27T02:57:10.474 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.474+0000 7fc776de99c0 20 add_watcher() i=6 2024-08-27T02:57:10.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 20 add_watcher() i=7 2024-08-27T02:57:10.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:10.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc62afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:10.478 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 5 note: GC not initialized 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc629fe3640 20 reqs_thread_entry: start 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 20 Filter name: none 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc59b7fe640 20 reqs_thread_entry: start 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:10.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.478+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:10.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:10.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:10.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:10.480 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:10.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:10.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:10.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.482+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:10.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:10.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:10.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:10.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.484 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.486+0000 7fc776de99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:10.487 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.490+0000 7fc62afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:10.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.494+0000 7fc776de99c0 20 remove_watcher() i=0 2024-08-27T02:57:10.492 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.494+0000 7fc776de99c0 2 removed watcher, disabling cache 2024-08-27T02:57:10.494 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.494+0000 7fc776de99c0 20 remove_watcher() i=1 2024-08-27T02:57:10.497 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.498+0000 7fc776de99c0 20 remove_watcher() i=2 2024-08-27T02:57:10.499 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.498+0000 7fc776de99c0 20 remove_watcher() i=3 2024-08-27T02:57:10.500 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.502+0000 7fc776de99c0 20 remove_watcher() i=4 2024-08-27T02:57:10.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.502+0000 7fc776de99c0 20 remove_watcher() i=5 2024-08-27T02:57:10.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.502+0000 7fc776de99c0 20 remove_watcher() i=6 2024-08-27T02:57:10.504 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:10.506+0000 7fc776de99c0 20 remove_watcher() i=7 2024-08-27T02:57:40.532 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:57:40.565 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:40.565 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:40.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.609+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 realm 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:40.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:40.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.613+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.617+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:40.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.617+0000 7fb29f77e9c0 20 searching for the correct realm 2024-08-27T02:57:40.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.621+0000 7fb29da85640 0 -- 172.21.15.143:0/2410772339 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fb2940c83d0 msgr2=0x7fb2940c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:40.838 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.837+0000 7fb29d284640 0 -- 172.21.15.143:0/2410772339 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x5570ba4eb870 msgr2=0x5570ba4edc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:40.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:40.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:40.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:40.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:40.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:40.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:40.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:40.846 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:40.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.845+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.847 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 zone default found 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 4 Realm: () 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 zonegroup default 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:40.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:40.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:40.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 started sync module instance, tier type = 2024-08-27T02:57:40.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.849+0000 7fb29f77e9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:40.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.869+0000 7fb29f77e9c0 20 add_watcher() i=0 2024-08-27T02:57:40.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.869+0000 7fb29f77e9c0 20 add_watcher() i=1 2024-08-27T02:57:40.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.869+0000 7fb29f77e9c0 20 add_watcher() i=2 2024-08-27T02:57:40.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.869+0000 7fb29f77e9c0 20 add_watcher() i=3 2024-08-27T02:57:40.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.869+0000 7fb29f77e9c0 20 add_watcher() i=4 2024-08-27T02:57:40.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.869+0000 7fb29f77e9c0 20 add_watcher() i=5 2024-08-27T02:57:40.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.873+0000 7fb29f77e9c0 20 add_watcher() i=6 2024-08-27T02:57:40.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.873+0000 7fb29f77e9c0 20 add_watcher() i=7 2024-08-27T02:57:40.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.873+0000 7fb29f77e9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:40.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb1537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:40.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb29f77e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:40.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb29f77e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:40.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb29f77e9c0 5 note: GC not initialized 2024-08-27T02:57:40.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb1527e4640 20 reqs_thread_entry: start 2024-08-27T02:57:40.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb29f77e9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:40.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb29f77e9c0 20 Filter name: none 2024-08-27T02:57:40.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb0c3fff640 20 reqs_thread_entry: start 2024-08-27T02:57:40.879 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.877+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:40.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:40.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:40.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:40.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:40.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:40.882 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.881+0000 7fb29f77e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:40.885 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.885+0000 7fb1537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:40.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.889+0000 7fb29f77e9c0 20 remove_watcher() i=0 2024-08-27T02:57:40.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.889+0000 7fb29f77e9c0 2 removed watcher, disabling cache 2024-08-27T02:57:40.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.893+0000 7fb29f77e9c0 20 remove_watcher() i=1 2024-08-27T02:57:40.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.897+0000 7fb29f77e9c0 20 remove_watcher() i=2 2024-08-27T02:57:40.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.897+0000 7fb29f77e9c0 20 remove_watcher() i=3 2024-08-27T02:57:40.900 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.901+0000 7fb29f77e9c0 20 remove_watcher() i=4 2024-08-27T02:57:40.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.901+0000 7fb29f77e9c0 20 remove_watcher() i=5 2024-08-27T02:57:40.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.905+0000 7fb29f77e9c0 20 remove_watcher() i=6 2024-08-27T02:57:40.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:40.905+0000 7fb29f77e9c0 20 remove_watcher() i=7 2024-08-27T02:57:41.101 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-08-27T02:57:41.131 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:41.131 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:41.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.173+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 realm 2024-08-27T02:57:41.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:41.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:41.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.177 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:41.178 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.177+0000 7f61213e99c0 20 searching for the correct realm 2024-08-27T02:57:41.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.185+0000 7f611f6f0640 0 -- 172.21.15.143:0/831391852 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55665f706150 msgr2=0x55665f7085b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:41.189 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.189+0000 7f611e6ee640 0 -- 172.21.15.143:0/831391852 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f6110046070 msgr2=0x7f6110037950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:41.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:41.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:41.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:41.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:41.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:41.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:41.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 zone default found 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 4 Realm: () 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:41.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:41.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 zonegroup default 2024-08-27T02:57:41.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 started sync module instance, tier type = 2024-08-27T02:57:41.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.197+0000 7f61213e99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:41.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=0 2024-08-27T02:57:41.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=1 2024-08-27T02:57:41.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=2 2024-08-27T02:57:41.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=3 2024-08-27T02:57:41.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=4 2024-08-27T02:57:41.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=5 2024-08-27T02:57:41.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=6 2024-08-27T02:57:41.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 20 add_watcher() i=7 2024-08-27T02:57:41.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.213+0000 7f61213e99c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:41.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f5fd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 5 note: GC not initialized 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f5f4ffff640 20 reqs_thread_entry: start 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 20 Filter name: none 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f5f4dffb640 20 reqs_thread_entry: start 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:41.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.217+0000 7f61213e99c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:41.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:41.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:41.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:41.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:41.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:41.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:41.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:41.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:41.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:41.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:41.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:41.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:41.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:41.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:41.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.221+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:41.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:41.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:41.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:41.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:41.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:41.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:41.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:41.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f61213e99c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:41.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.225+0000 7f5fd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:41.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.229+0000 7f61213e99c0 20 remove_watcher() i=0 2024-08-27T02:57:41.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.229+0000 7f61213e99c0 2 removed watcher, disabling cache 2024-08-27T02:57:41.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.233+0000 7f61213e99c0 20 remove_watcher() i=1 2024-08-27T02:57:41.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.233+0000 7f61213e99c0 20 remove_watcher() i=2 2024-08-27T02:57:41.236 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.237+0000 7f61213e99c0 20 remove_watcher() i=3 2024-08-27T02:57:41.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.237+0000 7f61213e99c0 20 remove_watcher() i=4 2024-08-27T02:57:41.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.241+0000 7f61213e99c0 20 remove_watcher() i=5 2024-08-27T02:57:41.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.241+0000 7f61213e99c0 20 remove_watcher() i=6 2024-08-27T02:57:41.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.241+0000 7f61213e99c0 20 remove_watcher() i=7 2024-08-27T02:57:41.255 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:57:41.281 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:41.282 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:41.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.321+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 realm 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.325 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:41.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.325+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.329+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:41.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.329+0000 7fcf5c9579c0 20 searching for the correct realm 2024-08-27T02:57:41.333 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.333+0000 7fcf59c5c640 0 -- 172.21.15.143:0/3030345889 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fcf54035070 msgr2=0x7fcf5404ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:41.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.337+0000 7fcf59c5c640 0 -- 172.21.15.143:0/3030345889 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fce24081140 msgr2=0x7fce24083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:41.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:41.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:41.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:41.345 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:41.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:41.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:41.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 zone default found 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 4 Realm: () 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:41.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:41.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 zonegroup default 2024-08-27T02:57:41.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.345+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.349+0000 7fcf5c9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.349+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.349+0000 7fcf5c9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.349+0000 7fcf5c9579c0 20 started sync module instance, tier type = 2024-08-27T02:57:41.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.349+0000 7fcf5c9579c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:41.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.361+0000 7fcf5c9579c0 20 add_watcher() i=0 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.361+0000 7fcf5c9579c0 20 add_watcher() i=1 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.361+0000 7fcf5c9579c0 20 add_watcher() i=2 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.361+0000 7fcf5c9579c0 20 add_watcher() i=3 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.361+0000 7fcf5c9579c0 20 add_watcher() i=4 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.361+0000 7fcf5c9579c0 20 add_watcher() i=5 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.361+0000 7fcf5c9579c0 20 add_watcher() i=6 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 20 add_watcher() i=7 2024-08-27T02:57:41.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:41.366 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fce10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 5 note: GC not initialized 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcd8b7fe640 20 reqs_thread_entry: start 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 20 Filter name: none 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcd897fa640 20 reqs_thread_entry: start 2024-08-27T02:57:41.367 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.365+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:41.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:41.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:41.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:41.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:41.369 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.369+0000 7fcf5c9579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:41.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.373+0000 7fce10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:41.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.377+0000 7fcf5c9579c0 20 remove_watcher() i=0 2024-08-27T02:57:41.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.377+0000 7fcf5c9579c0 2 removed watcher, disabling cache 2024-08-27T02:57:41.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.377+0000 7fcf5c9579c0 20 remove_watcher() i=1 2024-08-27T02:57:41.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.381+0000 7fcf5c9579c0 20 remove_watcher() i=2 2024-08-27T02:57:41.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.381+0000 7fcf5c9579c0 20 remove_watcher() i=3 2024-08-27T02:57:41.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.385+0000 7fcf5c9579c0 20 remove_watcher() i=4 2024-08-27T02:57:41.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.385+0000 7fcf5c9579c0 20 remove_watcher() i=5 2024-08-27T02:57:41.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.385+0000 7fcf5c9579c0 20 remove_watcher() i=6 2024-08-27T02:57:41.387 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.389+0000 7fcf5c9579c0 20 remove_watcher() i=7 2024-08-27T02:57:41.398 INFO:tasks.workunit.client.0.smithi143.stderr: test: duplicated entries should be purged before reshard 2024-08-27T02:57:41.398 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:57:41.421 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:41.421 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:41.458 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.457+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 realm 2024-08-27T02:57:41.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:41.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:41.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:41.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.461+0000 7fe28ed909c0 20 searching for the correct realm 2024-08-27T02:57:41.469 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.469+0000 7fe28d097640 0 -- 172.21.15.143:0/2321141904 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fe2780732a0 msgr2=0x7fe27805c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:57:41.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.685+0000 7fe28c896640 0 -- 172.21.15.143:0/2321141904 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x557225a4cd70 msgr2=0x557225a4f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:41.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:41.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:41.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:41.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:41.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:41.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:41.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:41.693 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 zone default found 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 4 Realm: () 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 zonegroup default 2024-08-27T02:57:41.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.693+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.697+0000 7fe28ed909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.697+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.697+0000 7fe28ed909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.697+0000 7fe28ed909c0 20 started sync module instance, tier type = 2024-08-27T02:57:41.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.697+0000 7fe28ed909c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:41.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.717+0000 7fe28ed909c0 20 add_watcher() i=0 2024-08-27T02:57:41.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.717+0000 7fe28ed909c0 20 add_watcher() i=1 2024-08-27T02:57:41.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.717+0000 7fe28ed909c0 20 add_watcher() i=2 2024-08-27T02:57:41.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.717+0000 7fe28ed909c0 20 add_watcher() i=3 2024-08-27T02:57:41.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.717+0000 7fe28ed909c0 20 add_watcher() i=4 2024-08-27T02:57:41.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.717+0000 7fe28ed909c0 20 add_watcher() i=5 2024-08-27T02:57:41.717 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.717+0000 7fe28ed909c0 20 add_watcher() i=6 2024-08-27T02:57:41.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.721+0000 7fe28ed909c0 20 add_watcher() i=7 2024-08-27T02:57:41.719 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.721+0000 7fe28ed909c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:41.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe142fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:41.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:41.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:41.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 5 note: GC not initialized 2024-08-27T02:57:41.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe141fe3640 20 reqs_thread_entry: start 2024-08-27T02:57:41.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:41.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 Filter name: none 2024-08-27T02:57:41.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe0b37fe640 20 reqs_thread_entry: start 2024-08-27T02:57:41.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:41.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:41.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:41.727 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.725+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.729+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:41.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.729+0000 7fe28ed909c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.729+0000 7fe28ed909c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:41.729 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.729+0000 7fe28ed909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:41.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.733+0000 7fe142fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:41.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.737+0000 7fe28ed909c0 20 remove_watcher() i=0 2024-08-27T02:57:41.736 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.737+0000 7fe28ed909c0 2 removed watcher, disabling cache 2024-08-27T02:57:41.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.741+0000 7fe28ed909c0 20 remove_watcher() i=1 2024-08-27T02:57:41.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.741+0000 7fe28ed909c0 20 remove_watcher() i=2 2024-08-27T02:57:41.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.745+0000 7fe28ed909c0 20 remove_watcher() i=3 2024-08-27T02:57:41.746 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.745+0000 7fe28ed909c0 20 remove_watcher() i=4 2024-08-27T02:57:41.747 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.749+0000 7fe28ed909c0 20 remove_watcher() i=5 2024-08-27T02:57:41.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.749+0000 7fe28ed909c0 20 remove_watcher() i=6 2024-08-27T02:57:41.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.749+0000 7fe28ed909c0 20 remove_watcher() i=7 2024-08-27T02:57:41.763 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:41.763 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:57:41.763 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-08-27T02:57:41.764 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:41.764 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-08-27T02:57:41.795 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:41.795 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:41.837 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.839 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 realm 2024-08-27T02:57:41.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.837+0000 7f59e0f029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:41.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:41.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:41.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:41.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:41.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 searching for the correct realm 2024-08-27T02:57:41.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:41.849+0000 7f59df209640 0 -- 172.21.15.143:0/3729170685 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f59d4114bc0 msgr2=0x7f59d412b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.065+0000 7f59dea08640 0 -- 172.21.15.143:0/3729170685 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55f08cf39a90 msgr2=0x55f08cf3bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:42.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:42.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:42.072 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:42.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:42.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:42.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:42.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 zone default found 2024-08-27T02:57:42.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 Realm: () 2024-08-27T02:57:42.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:42.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:42.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:42.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 zonegroup default 2024-08-27T02:57:42.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.075 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 started sync module instance, tier type = 2024-08-27T02:57:42.077 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:42.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=0 2024-08-27T02:57:42.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=1 2024-08-27T02:57:42.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=2 2024-08-27T02:57:42.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=3 2024-08-27T02:57:42.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=4 2024-08-27T02:57:42.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=5 2024-08-27T02:57:42.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=6 2024-08-27T02:57:42.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.101+0000 7f59e0f029c0 20 add_watcher() i=7 2024-08-27T02:57:42.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.101+0000 7f59e0f029c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:42.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.105+0000 7f58957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:42.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.105+0000 7f59e0f029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:42.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.105+0000 7f59e0f029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:42.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 note: GC not initialized 2024-08-27T02:57:42.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.105+0000 7f580ffff640 20 reqs_thread_entry: start 2024-08-27T02:57:42.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:42.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 Filter name: none 2024-08-27T02:57:42.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f580dffb640 20 reqs_thread_entry: start 2024-08-27T02:57:42.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:42.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:42.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:42.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:42.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:42.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:42.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:42.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:42.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:57:42.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94491645338080 notifier 7328 bl.length()=827 2024-08-27T02:57:42.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.122 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.123 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:57:42.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:57:42.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:57:42.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:57:42.135 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59e0f029c0 time 2024-08-27T02:57:42.140108+0000 2024-08-27T02:57:42.135 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f59e47dc2eb] 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.137+0000 7f59e0f029c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59e0f029c0 time 2024-08-27T02:57:42.140108+0000 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:42.136 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f59e47dc2eb] 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:57:42.137 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f59e0f029c0 thread_name:radosgw-admin 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f59e365b520] 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f59e47dc345] 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.150 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.137+0000 7f59e0f029c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f59e0f029c0 thread_name:radosgw-admin 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f59e365b520] 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f59e47dc345] 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.151 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:57:41.817+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:57:41.817+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:57:41.817+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.152 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_done global_id 7316 payload 274 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:57:41.817+0000 7f59de207640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: dump: 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.153 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7316 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: dump: 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.154 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: get_monmap_and_config success 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 4 set_mon_vals no callback set 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: shutdown 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 asok(0x55f08cc41280) unregister_commands rotate-key 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.155 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding auth protocol: cephx 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding auth protocol: cephx 2024-08-27T02:57:42.156 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding auth protocol: cephx 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.157 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: starting msgr at 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: starting objecter 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command objecter_requests hook 0x55f08ce4f010 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: setting wanted keys 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: calling monclient init 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding auth protocol: cephx 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding auth protocol: cephx 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding auth protocol: cephx 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.158 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key hook 0x55f08ce4b8f8 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08ccfb1a0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08cd93f90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.159 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08ce77e60 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.699926s 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): get_auth_request con 0x55f08ccfb1a0 auth_method 0 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08cd93f90 auth_method 0 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.160 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_done global_id 7319 payload 824 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:57:41.821+0000 7f59dea08640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: dump: 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.161 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: dump: 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.162 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:57:41.821+0000 7f58cce09640 4 set_mon_vals no callback set 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7319 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.163 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 1 librados: init done 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:57:41.821+0000 7f58cb606640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:57:41.821+0000 7f58cb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:57:41.821+0000 7f58cb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:57:41.821+0000 7f59df209640 10 monclient: get_auth_request con 0x55f08ce937c0 auth_method 0 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient: get_auth_request con 0x7f58c4070ad0 auth_method 0 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:57:41.825+0000 7f59dea08640 10 monclient: get_auth_request con 0x55f08ce969a0 auth_method 0 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:57:41.825+0000 7f59de207640 10 monclient: get_auth_request con 0x55f08ce9ba30 auth_method 0 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:57:41.825+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:57:41.825+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:57:41.825+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.164 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding auth protocol: cephx 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding auth protocol: cephx 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding auth protocol: cephx 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.165 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command objecter_requests cmddesc objecter_requests hook 0x55f08cea3170 EEXIST 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding auth protocol: cephx 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding auth protocol: cephx 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding auth protocol: cephx 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.166 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key cmddesc rotate-key hook 0x55f08ce9e8c0 EEXIST 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08cec7320 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08cec6c50 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.167 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08cec5630 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.709131s 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08cec6c50 auth_method 0 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): get_auth_request con 0x55f08cec7320 auth_method 0 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.168 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_done global_id 7322 payload 824 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:57:41.829+0000 7f59de207640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: dump: 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.169 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: dump: 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.170 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:57:41.829+0000 7f59dfa0a640 4 set_mon_vals no callback set 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7322 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.171 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:57:41.833+0000 7f58c8e01640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:57:41.833+0000 7f58c8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:57:41.833+0000 7f58c8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: get_monmap_and_config 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.172 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding auth protocol: cephx 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding auth protocol: cephx 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding auth protocol: cephx 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.173 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:57:41.833+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f58b80709e0 auth_method 0 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding auth protocol: cephx 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding auth protocol: cephx 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding auth protocol: cephx 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.174 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key cmddesc rotate-key hook 0x7fffcd7ef988 EEXIST 2024-08-27T02:57:42.175 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08ceeaa90 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08cf1b070 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08cee8210 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.713596s 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08cf1b070 auth_method 0 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.176 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): get_auth_request con 0x55f08cee8210 auth_method 0 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_done global_id 7325 payload 274 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:57:41.833+0000 7f59de207640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.177 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: dump: 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7325 2024-08-27T02:57:42.178 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: get_monmap_and_config success 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 4 set_mon_vals no callback set 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: dump: 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.179 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: shutdown 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding auth protocol: cephx 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding auth protocol: cephx 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding auth protocol: cephx 2024-08-27T02:57:42.180 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: starting msgr at 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: starting objecter 2024-08-27T02:57:42.181 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command objecter_requests cmddesc objecter_requests hook 0x55f08ce80600 EEXIST 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: setting wanted keys 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: calling monclient init 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding auth protocol: cephx 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding auth protocol: cephx 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding auth protocol: cephx 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.182 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key cmddesc rotate-key hook 0x55f08cec9288 EEXIST 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08cee8210 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08ceeaa90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08cf1b070 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.183 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.716060s 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): get_auth_request con 0x55f08cf1b070 auth_method 0 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08ceeaa90 auth_method 0 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.184 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_done global_id 7328 payload 824 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:57:41.837+0000 7f59df209640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: dump: 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.185 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: dump: 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.186 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7328 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:57:41.837+0000 7f58c27fc640 4 set_mon_vals no callback set 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 1 librados: init done 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cr dump hook 0x55f08cf0c0d8 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.187 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient: get_auth_request con 0x55f08cf35830 auth_method 0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:57:41.837+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f58a8070ad0 auth_method 0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 realm 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:57:41.841+0000 7f59dea08640 10 monclient: get_auth_request con 0x55f08cf39a90 auth_method 0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 searching for the correct realm 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:57:41.841+0000 7f59de207640 10 monclient: get_auth_request con 0x55f08cf3ed10 auth_method 0 2024-08-27T02:57:42.188 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:57:41.841+0000 7f59df209640 10 monclient: get_auth_request con 0x55f08ccfb580 auth_method 0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:57:41.845+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f59d8095040 auth_method 0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:57:41.845+0000 7f59de207640 10 monclient: get_auth_request con 0x7f59d0018070 auth_method 0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:57:41.849+0000 7f59df209640 10 monclient: get_auth_request con 0x7f59d4114bc0 auth_method 0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:57:41.849+0000 7f59df209640 0 -- 172.21.15.143:0/3729170685 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f59d4114bc0 msgr2=0x7f59d412b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:57:42.053+0000 7f59df209640 10 monclient: get_auth_request con 0x7f59d4114bc0 auth_method 0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:57:42.061+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f59d40aa8e0 auth_method 0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:57:42.065+0000 7f59dea08640 0 -- 172.21.15.143:0/3729170685 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55f08cf39a90 msgr2=0x55f08cf3bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:57:42.065+0000 7f58c0ff9640 1 client.7328.objecter ms_handle_reset 0x55f08cf39a90 session 0x55f08cf39410 osd.5 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:57:42.065+0000 7f58c0ff9640 10 monclient: _renew_subs 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:57:42.065+0000 7f58c0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:57:42.065+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f58a8081170 auth_method 0 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:42.189 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 zone default found 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 Realm: () 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:42.190 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 zonegroup default 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 started sync module instance, tier type = 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=0 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=1 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=2 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=3 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=4 2024-08-27T02:57:42.191 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=5 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=6 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:57:42.101+0000 7f59e0f029c0 20 add_watcher() i=7 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:57:42.101+0000 7f59e0f029c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding auth protocol: cephx 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding auth protocol: cephx 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding auth protocol: cephx 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.192 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:57:42.105+0000 7f58957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache list hook 0x55f08cf0c3a0 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache inspect hook 0x55f08cf0c3a0 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache erase hook 0x55f08cf0c3a0 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache zap hook 0x55f08cf0c3a0 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 note: GC not initialized 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:57:42.105+0000 7f580ffff640 20 reqs_thread_entry: start 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace show hook 0x7f59d00013d0 2024-08-27T02:57:42.193 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace history hook 0x7f59d00013d0 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace active hook 0x7f59d00013d0 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace active_short hook 0x7f59d00013d0 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 Filter name: none 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:57:42.109+0000 7f580dffb640 20 reqs_thread_entry: start 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.194 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94491645338080 notifier 7328 bl.length()=827 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:57:42.195 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:57:42.137+0000 7f59e0f029c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59e0f029c0 time 2024-08-27T02:57:42.140108+0000 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f59e47dc2eb] 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.196 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:57:42.137+0000 7f59e0f029c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f59e0f029c0 thread_name:radosgw-admin 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f59e365b520] 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f59e47dc345] 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:57:42.197 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:57:42.198 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:57:42.199 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:57:42.200 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:57:42.201 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:57:42.202 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:57:42.203 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f580dffb640 / http_manager 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f580ffff640 / http_manager 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58957e2640 / rgw_dt_lg_renew 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58c0ff9640 / ms_dispatch 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58c27fc640 / io_context_pool 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58c8e01640 / ms_dispatch 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58cb606640 / ms_dispatch 2024-08-27T02:57:42.204 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58cce09640 / io_context_pool 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59de207640 / msgr-worker-2 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59dea08640 / msgr-worker-1 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59df209640 / msgr-worker-0 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59dfa0a640 / io_context_pool 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59e0f029c0 / radosgw-admin 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.125163.log 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:57:41.817+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:57:41.817+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.205 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:57:41.817+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient(hunting): handle_auth_done global_id 7316 payload 274 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:57:41.817+0000 7f59de207640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:57:41.817+0000 7f59de207640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: dump: 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.206 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7316 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:57:41.817+0000 7f58cce09640 10 monclient: dump: 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.207 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: get_monmap_and_config success 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 4 set_mon_vals no callback set 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: shutdown 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 asok(0x55f08cc41280) unregister_commands rotate-key 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.208 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding auth protocol: cephx 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding auth protocol: cephx 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding auth protocol: cephx 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.209 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: crc 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce50cb0) adding con mode: secure 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: starting msgr at 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: starting objecter 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command objecter_requests hook 0x55f08ce4f010 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: setting wanted keys 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 1 librados: calling monclient init 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding auth protocol: cephx 2024-08-27T02:57:42.210 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding auth protocol: cephx 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding auth protocol: cephx 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: crc 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce4b7b0) adding con mode: secure 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.211 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key hook 0x55f08ce4b8f8 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08ccfb1a0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08cd93f90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08ce77e60 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:57:41.817+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.699926s 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): get_auth_request con 0x55f08ccfb1a0 auth_method 0 2024-08-27T02:57:42.212 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08cd93f90 auth_method 0 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient(hunting): handle_auth_done global_id 7319 payload 824 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.213 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:57:41.821+0000 7f59dea08640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:57:41.821+0000 7f59dea08640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: dump: 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.214 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:57:41.821+0000 7f58cb606640 10 monclient: dump: 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.215 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:57:41.821+0000 7f58cce09640 4 set_mon_vals no callback set 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7319 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:57:41.821+0000 7f59e0f029c0 1 librados: init done 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:57:41.821+0000 7f58cb606640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:57:41.821+0000 7f58cb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:57:41.821+0000 7f58cb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:57:41.821+0000 7f59df209640 10 monclient: get_auth_request con 0x55f08ce937c0 auth_method 0 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:57:41.821+0000 7f59de207640 10 monclient: get_auth_request con 0x7f58c4070ad0 auth_method 0 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:57:41.825+0000 7f59dea08640 10 monclient: get_auth_request con 0x55f08ce969a0 auth_method 0 2024-08-27T02:57:42.216 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:57:41.825+0000 7f59de207640 10 monclient: get_auth_request con 0x55f08ce9ba30 auth_method 0 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:57:41.825+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:57:41.825+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:57:41.825+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.217 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding auth protocol: cephx 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding auth protocol: cephx 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding auth protocol: cephx 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: crc 2024-08-27T02:57:42.218 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9f720) adding con mode: secure 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command objecter_requests cmddesc objecter_requests hook 0x55f08cea3170 EEXIST 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding auth protocol: cephx 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding auth protocol: cephx 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding auth protocol: cephx 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.219 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: crc 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ce9e778) adding con mode: secure 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key cmddesc rotate-key hook 0x55f08ce9e8c0 EEXIST 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08cec7320 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08cec6c50 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08cec5630 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.220 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.709131s 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08cec6c50 auth_method 0 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): get_auth_request con 0x55f08cec7320 auth_method 0 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.221 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:57:41.829+0000 7f59dea08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient(hunting): handle_auth_done global_id 7322 payload 824 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:57:41.829+0000 7f59de207640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:57:41.829+0000 7f59de207640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.222 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: dump: 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.223 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:57:41.829+0000 7f58c8e01640 10 monclient: dump: 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:57:41.829+0000 7f59dfa0a640 4 set_mon_vals no callback set 2024-08-27T02:57:42.224 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7322 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:57:41.829+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:57:41.833+0000 7f58c8e01640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:57:41.833+0000 7f58c8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:57:41.833+0000 7f58c8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: get_monmap_and_config 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.225 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding auth protocol: cephx 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding auth protocol: cephx 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding auth protocol: cephx 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.226 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: crc 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cee6990) adding con mode: secure 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:57:41.833+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f58b80709e0 auth_method 0 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding auth protocol: cephx 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding auth protocol: cephx 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding auth protocol: cephx 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.227 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: crc 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7ef840) adding con mode: secure 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key cmddesc rotate-key hook 0x7fffcd7ef988 EEXIST 2024-08-27T02:57:42.228 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08ceeaa90 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08cf1b070 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08cee8210 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.713596s 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08cf1b070 auth_method 0 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): get_auth_request con 0x55f08cee8210 auth_method 0 2024-08-27T02:57:42.229 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:57:41.833+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.230 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient(hunting): handle_auth_done global_id 7325 payload 274 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:57:41.833+0000 7f59de207640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:57:41.833+0000 7f59de207640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: dump: 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.231 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7325 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: get_monmap_and_config success 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 4 set_mon_vals no callback set 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:57:41.833+0000 7f58c27fc640 10 monclient: dump: 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.232 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: shutdown 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: build_initial_monmap 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 build_initial for_mkfs: 0 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: monmap: 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:57:42.233 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding auth protocol: cephx 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding auth protocol: cephx 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding auth protocol: cephx 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.234 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: crc 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08ceeba40) adding con mode: secure 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: starting msgr at 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: starting objecter 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command objecter_requests cmddesc objecter_requests hook 0x55f08ce80600 EEXIST 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: setting wanted keys 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 1 librados: calling monclient init 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: init 2024-08-27T02:57:42.235 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding auth protocol: cephx 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding auth protocol: cephx 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding auth protocol: cephx 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: crc 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 AuthRegistry(0x55f08cec9140) adding con mode: secure 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.236 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command rotate-key cmddesc rotate-key hook 0x55f08cec9288 EEXIST 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _reopen_session rank -1 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:57:41.833+0000 7f59e0f029c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-b con 0x55f08cee8210 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-a con 0x55f08ceeaa90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): picked mon.noname-c con 0x55f08cf1b070 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): _renew_subs 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient(hunting): authenticate will time out at 2594.716060s 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): get_auth_request con 0x55f08cf1b070 auth_method 0 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.237 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): get_auth_request con 0x55f08ceeaa90 auth_method 0 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient(hunting): handle_auth_done global_id 7328 payload 824 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient: _finish_hunting 0 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:57:41.837+0000 7f59df209640 1 monclient: found mon.noname-c 2024-08-27T02:57:42.238 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:57:41.837+0000 7f59df209640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: dump: 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.239 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: _finish_auth 0 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: _check_auth_tickets 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: handle_config config(0 keys) 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 10 monclient: dump: 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:57:42.240 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 5 monclient: authenticate success, global_id 7328 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:57:41.837+0000 7f58c27fc640 4 set_mon_vals no callback set 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _renew_subs 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 1 librados: init done 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cr dump hook 0x55f08cf0c0d8 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:57:41.837+0000 7f58c0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:57:42.241 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:57:41.837+0000 7f59de207640 10 monclient: get_auth_request con 0x55f08cf35830 auth_method 0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:57:41.837+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f58a8070ad0 auth_method 0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 realm 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:57:41.837+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:57:41.841+0000 7f59dea08640 10 monclient: get_auth_request con 0x55f08cf39a90 auth_method 0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.242 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:57:41.841+0000 7f59e0f029c0 20 searching for the correct realm 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:57:41.841+0000 7f59de207640 10 monclient: get_auth_request con 0x55f08cf3ed10 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:57:41.841+0000 7f59df209640 10 monclient: get_auth_request con 0x55f08ccfb580 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:57:41.845+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f59d8095040 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:57:41.845+0000 7f59de207640 10 monclient: get_auth_request con 0x7f59d0018070 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:57:41.849+0000 7f59df209640 10 monclient: get_auth_request con 0x7f59d4114bc0 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:57:41.849+0000 7f59df209640 0 -- 172.21.15.143:0/3729170685 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f59d4114bc0 msgr2=0x7f59d412b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:57:42.053+0000 7f59df209640 10 monclient: get_auth_request con 0x7f59d4114bc0 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:57:42.061+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f59d40aa8e0 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:57:42.065+0000 7f59dea08640 0 -- 172.21.15.143:0/3729170685 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55f08cf39a90 msgr2=0x55f08cf3bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:57:42.065+0000 7f58c0ff9640 1 client.7328.objecter ms_handle_reset 0x55f08cf39a90 session 0x55f08cf39410 osd.5 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:57:42.065+0000 7f58c0ff9640 10 monclient: _renew_subs 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:57:42.065+0000 7f58c0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:57:42.065+0000 7f59dea08640 10 monclient: get_auth_request con 0x7f58a8081170 auth_method 0 2024-08-27T02:57:42.243 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 zone default found 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 Realm: () 2024-08-27T02:57:42.244 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 zonegroup default 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:57:42.073+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 started sync module instance, tier type = 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:57:42.077+0000 7f59e0f029c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=0 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=1 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=2 2024-08-27T02:57:42.245 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=3 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=4 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=5 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:57:42.097+0000 7f59e0f029c0 20 add_watcher() i=6 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:57:42.101+0000 7f59e0f029c0 20 add_watcher() i=7 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:57:42.101+0000 7f59e0f029c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding auth protocol: cephx 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding auth protocol: cephx 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding auth protocol: cephx 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.246 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: crc 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 AuthRegistry(0x7fffcd7efd20) adding con mode: secure 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:57:42.105+0000 7f58957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache list hook 0x55f08cf0c3a0 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache inspect hook 0x55f08cf0c3a0 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache erase hook 0x55f08cf0c3a0 2024-08-27T02:57:42.247 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command cache zap hook 0x55f08cf0c3a0 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:57:42.105+0000 7f59e0f029c0 5 note: GC not initialized 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:57:42.105+0000 7f580ffff640 20 reqs_thread_entry: start 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace show hook 0x7f59d00013d0 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace history hook 0x7f59d00013d0 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace active hook 0x7f59d00013d0 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 5 asok(0x55f08cc41280) register_command sync trace active_short hook 0x7f59d00013d0 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 Filter name: none 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:57:42.109+0000 7f580dffb640 20 reqs_thread_entry: start 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:42.248 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:57:42.109+0000 7f59e0f029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:57:42.121+0000 7f59e0f029c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94491645338080 notifier 7328 bl.length()=827 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.249 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:57:42.121+0000 7f58c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:57:42.125+0000 7f59e0f029c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:57:42.137+0000 7f59e0f029c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f59e0f029c0 time 2024-08-27T02:57:42.140108+0000 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f59e47dc2eb] 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:57:42.250 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:57:42.137+0000 7f59e0f029c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7f59e0f029c0 thread_name:radosgw-admin 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f59e365b520] 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f59e47dc345] 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f59e47dc49f] 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f08b3d5b11] 2024-08-27T02:57:42.251 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f08b3eb1ca] 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f59e3642d90] 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:57:42.252 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:57:42.253 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:57:42.254 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:57:42.255 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:57:42.256 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:57:42.257 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 7f580dffb640 / http_manager 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 7f580ffff640 / http_manager 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58957e2640 / rgw_dt_lg_renew 2024-08-27T02:57:42.258 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58c0ff9640 / ms_dispatch 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58c27fc640 / io_context_pool 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58c8e01640 / ms_dispatch 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58cb606640 / ms_dispatch 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f58cce09640 / io_context_pool 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59de207640 / msgr-worker-2 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59dea08640 / msgr-worker-1 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59df209640 / msgr-worker-0 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59dfa0a640 / io_context_pool 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: 7f59e0f029c0 / radosgw-admin 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:57:42.142237Z_4003e2e8-d340-4114-84f2-67007ce71b22/log 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:57:42.259 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:57:42.262 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.217+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 realm 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.221+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.263 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.225+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.225+0000 7f796be829c0 20 searching for the correct realm 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.229+0000 7f796a189640 0 -- 172.21.15.143:0/983848520 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x561b8385c150 msgr2=0x561b8385e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.237+0000 7f7969187640 0 -- 172.21.15.143:0/983848520 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f795c0650d0 msgr2=0x7f795c083130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.241+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.264 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 zone default found 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 4 Realm: () 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 zonegroup default 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 started sync module instance, tier type = 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.245+0000 7f796be829c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=0 2024-08-27T02:57:42.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=1 2024-08-27T02:57:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=2 2024-08-27T02:57:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=3 2024-08-27T02:57:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=4 2024-08-27T02:57:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=5 2024-08-27T02:57:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=6 2024-08-27T02:57:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 20 add_watcher() i=7 2024-08-27T02:57:42.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.261+0000 7f796be829c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:42.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f781b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:42.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f796be829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:42.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f796be829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:42.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f796be829c0 5 note: GC not initialized 2024-08-27T02:57:42.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f781a7fc640 20 reqs_thread_entry: start 2024-08-27T02:57:42.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f796be829c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:42.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f796be829c0 20 Filter name: none 2024-08-27T02:57:42.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f778bfff640 20 reqs_thread_entry: start 2024-08-27T02:57:42.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.265+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:42.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:42.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:42.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:42.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:42.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.269+0000 7f796be829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:57:42.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.273+0000 7f781b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:42.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.277+0000 7f796be829c0 20 remove_watcher() i=0 2024-08-27T02:57:42.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.277+0000 7f796be829c0 2 removed watcher, disabling cache 2024-08-27T02:57:42.278 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.277+0000 7f796be829c0 20 remove_watcher() i=1 2024-08-27T02:57:42.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.281+0000 7f796be829c0 20 remove_watcher() i=2 2024-08-27T02:57:42.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.281+0000 7f796be829c0 20 remove_watcher() i=3 2024-08-27T02:57:42.284 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.285+0000 7f796be829c0 20 remove_watcher() i=4 2024-08-27T02:57:42.285 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.285+0000 7f796be829c0 20 remove_watcher() i=5 2024-08-27T02:57:42.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.285+0000 7f796be829c0 20 remove_watcher() i=6 2024-08-27T02:57:42.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.289+0000 7f796be829c0 20 remove_watcher() i=7 2024-08-27T02:57:42.344 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-08-27T02:57:42.370 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:57:42.370 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:57:42.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 realm 2024-08-27T02:57:42.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:57:42.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.413+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.417+0000 7f6af7ab89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.417+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.417+0000 7f6af7ab89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:57:42.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.417+0000 7f6af7ab89c0 20 searching for the correct realm 2024-08-27T02:57:42.423 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.425+0000 7f6af5dbf640 0 -- 172.21.15.143:0/985917220 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f6aec063340 msgr2=0x7f6aec065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.641+0000 7f6af55be640 0 -- 172.21.15.143:0/985917220 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55fa206e5160 msgr2=0x55fa206e7620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:57:42.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:57:42.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:57:42.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:57:42.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:57:42.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:57:42.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:57:42.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:57:42.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.649+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:57:42.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 zone default found 2024-08-27T02:57:42.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 4 Realm: () 2024-08-27T02:57:42.651 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 zonegroup default 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:57:42.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 started sync module instance, tier type = 2024-08-27T02:57:42.653 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.653+0000 7f6af7ab89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:57:42.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.673+0000 7f6af7ab89c0 20 add_watcher() i=0 2024-08-27T02:57:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.673+0000 7f6af7ab89c0 20 add_watcher() i=1 2024-08-27T02:57:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.673+0000 7f6af7ab89c0 20 add_watcher() i=2 2024-08-27T02:57:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.673+0000 7f6af7ab89c0 20 add_watcher() i=3 2024-08-27T02:57:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.673+0000 7f6af7ab89c0 20 add_watcher() i=4 2024-08-27T02:57:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.673+0000 7f6af7ab89c0 20 add_watcher() i=5 2024-08-27T02:57:42.675 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.673+0000 7f6af7ab89c0 20 add_watcher() i=6 2024-08-27T02:57:42.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.677+0000 7f6af7ab89c0 20 add_watcher() i=7 2024-08-27T02:57:42.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.677+0000 7f6af7ab89c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:57:42.680 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f69abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:42.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f6af7ab89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:57:42.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f6af7ab89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:57:42.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f6af7ab89c0 5 note: GC not initialized 2024-08-27T02:57:42.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f69aafe5640 20 reqs_thread_entry: start 2024-08-27T02:57:42.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f6af7ab89c0 20 init_complete bucket index max shards: 11 2024-08-27T02:57:42.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f6af7ab89c0 20 Filter name: none 2024-08-27T02:57:42.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f69a8fe1640 20 reqs_thread_entry: start 2024-08-27T02:57:42.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f6af7ab89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:57:42.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.681+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:57:42.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:57:42.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:57:42.683 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:57:42.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 rados->read ofs=0 len=0 2024-08-27T02:57:42.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:42.685 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:57:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:57:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:57:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:42.686 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.685+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:57:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:57:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:42.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:57:42.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:42.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:57:42.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:42.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:57:42.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:42.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:57:42.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:42.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:57:42.689 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:42.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:57:42.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:42.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.689+0000 7f6af7ab89c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:57:42.692 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.693+0000 7f69abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:57:42.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.697+0000 7f6af7ab89c0 20 remove_watcher() i=0 2024-08-27T02:57:42.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.697+0000 7f6af7ab89c0 2 removed watcher, disabling cache 2024-08-27T02:57:42.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.701+0000 7f6af7ab89c0 20 remove_watcher() i=1 2024-08-27T02:57:42.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.701+0000 7f6af7ab89c0 20 remove_watcher() i=2 2024-08-27T02:57:42.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.705+0000 7f6af7ab89c0 20 remove_watcher() i=3 2024-08-27T02:57:42.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.705+0000 7f6af7ab89c0 20 remove_watcher() i=4 2024-08-27T02:57:42.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.709+0000 7f6af7ab89c0 20 remove_watcher() i=5 2024-08-27T02:57:42.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.709+0000 7f6af7ab89c0 20 remove_watcher() i=6 2024-08-27T02:57:42.712 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:57:42.713+0000 7f6af7ab89c0 20 remove_watcher() i=7 2024-08-27T02:58:12.756 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-08-27T02:58:12.796 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:58:12.797 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:58:12.841 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 realm 2024-08-27T02:58:12.842 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:12.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.843 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:12.844 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:12.845 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 searching for the correct realm 2024-08-27T02:58:12.852 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.853+0000 7fc9133c8640 0 -- 172.21.15.143:0/809438743 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc90406d560 msgr2=0x7fc904001740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:12.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.857+0000 7fc9133c8640 0 -- 172.21.15.143:0/809438743 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc7dc081170 msgr2=0x7fc7dc0835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:12.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:12.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:12.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:12.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:12.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:12.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:12.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:12.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:12.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 zone default found 2024-08-27T02:58:12.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 Realm: () 2024-08-27T02:58:12.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:12.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:12.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:12.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 zonegroup default 2024-08-27T02:58:12.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 started sync module instance, tier type = 2024-08-27T02:58:12.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:12.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=0 2024-08-27T02:58:12.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=1 2024-08-27T02:58:12.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=2 2024-08-27T02:58:12.883 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=3 2024-08-27T02:58:12.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=4 2024-08-27T02:58:12.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=5 2024-08-27T02:58:12.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=6 2024-08-27T02:58:12.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=7 2024-08-27T02:58:12.884 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.885+0000 7fc9160c39c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:12.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:12.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:12.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:12.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 note: GC not initialized 2024-08-27T02:58:12.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc7c8fe1640 20 reqs_thread_entry: start 2024-08-27T02:58:12.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:12.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 Filter name: none 2024-08-27T02:58:12.888 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc7427fc640 20 reqs_thread_entry: start 2024-08-27T02:58:12.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:12.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:12.889 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:12.890 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:12.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.893+0000 7fc9160c39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:58:12.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:12.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:12.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:12.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:58:12.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94232306693008 notifier 7788 bl.length()=827 2024-08-27T02:58:12.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:12.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:12.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:12.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:58:12.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:58:12.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:58:12.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:58:12.913 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9160c39c0 time 2024-08-27T02:58:12.919026+0000 2024-08-27T02:58:12.913 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc91999d2eb] 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:58:12.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.913+0000 7fc9160c39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9160c39c0 time 2024-08-27T02:58:12.919026+0000 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc91999d2eb] 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.916 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:58:12.917 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc9160c39c0 thread_name:radosgw-admin 2024-08-27T02:58:12.932 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:12.932 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc91881c520] 2024-08-27T02:58:12.932 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc91999d345] 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.917+0000 7fc9160c39c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:58:12.933 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc9160c39c0 thread_name:radosgw-admin 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc91881c520] 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc91999d345] 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:58:12.934 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:58:12.821+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:58:12.821+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:58:12.821+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_done global_id 7370 payload 274 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _finish_hunting 0 2024-08-27T02:58:12.935 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:58:12.821+0000 7fc913bc9640 1 monclient: found mon.noname-c 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: dump: 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.936 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: _finish_auth 0 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: _check_auth_tickets 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7370 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 4 set_mon_vals no callback set 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: dump: 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.937 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: shutdown 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 asok(0x55b42afa6280) unregister_commands rotate-key 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:12.938 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding auth protocol: cephx 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding auth protocol: cephx 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding auth protocol: cephx 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.939 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: starting msgr at 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: starting objecter 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command objecter_requests hook 0x55b42b1e5370 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: setting wanted keys 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: calling monclient init 2024-08-27T02:58:12.940 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding auth protocol: cephx 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding auth protocol: cephx 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding auth protocol: cephx 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.941 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key hook 0x55b42b1b16b8 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b069c20 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b070d40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b1b7ab0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.942 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.702899s 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): get_auth_request con 0x55b42b069c20 auth_method 0 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b1b7ab0 auth_method 0 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.943 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_done global_id 7373 payload 824 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _finish_hunting 0 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:58:12.821+0000 7fc913bc9640 1 monclient: found mon.noname-c 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: dump: 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.944 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: _finish_auth 0 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: _check_auth_tickets 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: dump: 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.945 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:58:12.821+0000 7fc801e0b640 4 set_mon_vals no callback set 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7373 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 1 librados: init done 2024-08-27T02:58:12.946 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:58:12.825+0000 7fc7fbfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:58:12.825+0000 7fc7fbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:58:12.825+0000 7fc7fbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:58:12.825+0000 7fc9143ca640 10 monclient: get_auth_request con 0x55b42b1f94c0 auth_method 0 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:58:12.825+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc7fc070aa0 auth_method 0 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:58:12.825+0000 7fc913bc9640 10 monclient: get_auth_request con 0x55b42b1fc6a0 auth_method 0 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:58:12.829+0000 7fc9133c8640 10 monclient: get_auth_request con 0x55b42b201730 auth_method 0 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:12.947 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding auth protocol: cephx 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding auth protocol: cephx 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding auth protocol: cephx 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:12.948 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command objecter_requests cmddesc objecter_requests hook 0x55b42b208df0 EEXIST 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding auth protocol: cephx 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding auth protocol: cephx 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding auth protocol: cephx 2024-08-27T02:58:12.949 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.950 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key cmddesc rotate-key hook 0x55b42b2045c0 EEXIST 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b22cfa0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b22c8d0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b22b2b0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.712542s 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): get_auth_request con 0x55b42b22c8d0 auth_method 0 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.951 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b22b2b0 auth_method 0 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_done global_id 7376 payload 824 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient: _finish_hunting 0 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:58:12.833+0000 7fc9133c8640 1 monclient: found mon.noname-c 2024-08-27T02:58:12.952 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: dump: 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: _finish_auth 0 2024-08-27T02:58:12.953 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: _check_auth_tickets 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: dump: 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.954 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7376 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:58:12.833+0000 7fc914bcb640 4 set_mon_vals no callback set 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: get_monmap_and_config 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:12.955 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding auth protocol: cephx 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding auth protocol: cephx 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding auth protocol: cephx 2024-08-27T02:58:12.956 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:58:12.833+0000 7fc913bc9640 10 monclient: get_auth_request con 0x7fc7ec0709e0 auth_method 0 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:12.957 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding auth protocol: cephx 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding auth protocol: cephx 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding auth protocol: cephx 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:12.958 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key cmddesc rotate-key hook 0x7fffd7d93e88 EEXIST 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b280ea0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b250ca0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b27c270 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:12.959 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.717006s 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request con 0x55b42b280ea0 auth_method 0 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b27c270 auth_method 0 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.960 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_done global_id 7379 payload 274 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient: _finish_hunting 0 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:58:12.837+0000 7fc9143ca640 1 monclient: found mon.noname-c 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: dump: 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.961 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: _finish_auth 0 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: _check_auth_tickets 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: dump: 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.962 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7379 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 4 set_mon_vals no callback set 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: shutdown 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:12.963 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding auth protocol: cephx 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding auth protocol: cephx 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding auth protocol: cephx 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:12.964 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: starting msgr at 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: starting objecter 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command objecter_requests cmddesc objecter_requests hook 0x55b42b24ed50 EEXIST 2024-08-27T02:58:12.965 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: setting wanted keys 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: calling monclient init 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding auth protocol: cephx 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding auth protocol: cephx 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding auth protocol: cephx 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:12.966 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key cmddesc rotate-key hook 0x55b42b22ef08 EEXIST 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b250ca0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b27c270 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b280ea0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:12.967 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.719663s 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request con 0x55b42b250ca0 auth_method 0 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b280ea0 auth_method 0 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.968 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:58:12.841+0000 7fc913bc9640 10 monclient(hunting): handle_auth_done global_id 7788 payload 824 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:58:12.841+0000 7fc913bc9640 10 monclient: _finish_hunting 0 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:58:12.841+0000 7fc913bc9640 1 monclient: found mon.noname-a 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:58:12.841+0000 7fc913bc9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:58:12.841+0000 7fc9133c8640 10 monclient: get_auth_request con 0x55b42b27c270 auth_method 0 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: dump: 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.969 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: _finish_auth 0 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: _check_auth_tickets 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:12.970 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: dump: 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7788 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:58:12.841+0000 7fc7f2ffd640 4 set_mon_vals no callback set 2024-08-27T02:58:12.971 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 1 librados: init done 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cr dump hook 0x55b42b26dfb8 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:58:12.841+0000 7fc9143ca640 10 monclient: get_auth_request con 0x55b42b29a970 auth_method 0 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:58:12.841+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc7dc070ad0 auth_method 0 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 realm 2024-08-27T02:58:12.972 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:58:12.845+0000 7fc913bc9640 10 monclient: get_auth_request con 0x55b42b29ec30 auth_method 0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 searching for the correct realm 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:58:12.845+0000 7fc9133c8640 10 monclient: get_auth_request con 0x55b42b2a3ef0 auth_method 0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:58:12.845+0000 7fc9143ca640 10 monclient: get_auth_request con 0x7fc908107990 auth_method 0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:58:12.849+0000 7fc913bc9640 10 monclient: get_auth_request con 0x7fc90c02a440 auth_method 0 2024-08-27T02:58:12.973 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:58:12.849+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc90406d560 auth_method 0 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:58:12.853+0000 7fc9133c8640 0 -- 172.21.15.143:0/809438743 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc90406d560 msgr2=0x7fc904001740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:58:12.853+0000 7fc7f17fa640 1 client.7788.objecter ms_handle_reset 0x7fc90406d560 session 0x7fc904087070 osd.4 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:58:12.853+0000 7fc7f17fa640 10 monclient: _renew_subs 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:58:12.853+0000 7fc7f17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:58:12.853+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc7dc081170 auth_method 0 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:58:12.853+0000 7fc9143ca640 10 monclient: get_auth_request con 0x7fc9080b8b10 auth_method 0 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:58:12.857+0000 7fc913bc9640 10 monclient: get_auth_request con 0x7fc908107040 auth_method 0 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:58:12.857+0000 7fc9133c8640 0 -- 172.21.15.143:0/809438743 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc7dc081170 msgr2=0x7fc7dc0835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:58:12.857+0000 7fc7f17fa640 1 client.7788.objecter ms_handle_reset 0x7fc7dc081170 session 0x7fc904087070 osd.4 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:58:12.857+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc90406d560 auth_method 0 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:12.974 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 zone default found 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 Realm: () 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:12.975 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 zonegroup default 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 started sync module instance, tier type = 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=0 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=1 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=2 2024-08-27T02:58:12.976 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=3 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=4 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=5 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=6 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=7 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding auth protocol: cephx 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding auth protocol: cephx 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding auth protocol: cephx 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:12.977 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:58:12.889+0000 7fc7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache list hook 0x55b42b24de20 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache inspect hook 0x55b42b24de20 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache erase hook 0x55b42b24de20 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache zap hook 0x55b42b24de20 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 note: GC not initialized 2024-08-27T02:58:12.978 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:58:12.889+0000 7fc7c8fe1640 20 reqs_thread_entry: start 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace show hook 0x7fc90c00e910 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace history hook 0x7fc90c00e910 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace active hook 0x7fc90c00e910 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace active_short hook 0x7fc90c00e910 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 Filter name: none 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:58:12.889+0000 7fc7427fc640 20 reqs_thread_entry: start 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:12.979 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:58:12.893+0000 7fc9160c39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94232306693008 notifier 7788 bl.length()=827 2024-08-27T02:58:12.980 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:58:12.913+0000 7fc9160c39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9160c39c0 time 2024-08-27T02:58:12.919026+0000 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc91999d2eb] 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:12.981 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:58:12.917+0000 7fc9160c39c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc9160c39c0 thread_name:radosgw-admin 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc91881c520] 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:12.982 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc91999d345] 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:58:12.983 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:58:12.984 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:58:12.985 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:58:12.986 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:58:12.987 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:58:12.988 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:58:12.989 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7427fc640 / http_manager 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7c8fe1640 / http_manager 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7c9fe3640 / rgw_dt_lg_renew 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f17fa640 / ms_dispatch 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f27fc640 / io_context_pool 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f2ffd640 / io_context_pool 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f97fa640 / ms_dispatch 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7fbfff640 / ms_dispatch 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc801e0b640 / io_context_pool 2024-08-27T02:58:12.990 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc9133c8640 / msgr-worker-2 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc913bc9640 / msgr-worker-1 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc9143ca640 / msgr-worker-0 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc914bcb640 / io_context_pool 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc9160c39c0 / radosgw-admin 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.126934.log 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:58:12.821+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:12.991 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:58:12.821+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:58:12.821+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_done global_id 7370 payload 274 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _finish_hunting 0 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:58:12.821+0000 7fc913bc9640 1 monclient: found mon.noname-c 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: dump: 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.992 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: _finish_auth 0 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: _check_auth_tickets 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7370 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 4 set_mon_vals no callback set 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:12.993 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:58:12.821+0000 7fc801e0b640 10 monclient: dump: 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: shutdown 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 asok(0x55b42afa6280) unregister_commands rotate-key 2024-08-27T02:58:12.994 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding auth protocol: cephx 2024-08-27T02:58:12.995 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding auth protocol: cephx 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding auth protocol: cephx 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: crc 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b6ac0) adding con mode: secure 2024-08-27T02:58:12.996 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: starting msgr at 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: starting objecter 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command objecter_requests hook 0x55b42b1e5370 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: setting wanted keys 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 1 librados: calling monclient init 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding auth protocol: cephx 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding auth protocol: cephx 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding auth protocol: cephx 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.997 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: crc 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b1b1570) adding con mode: secure 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key hook 0x55b42b1b16b8 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-08-27T02:58:12.998 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b069c20 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b070d40 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b1b7ab0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:58:12.821+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.702899s 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): get_auth_request con 0x55b42b069c20 auth_method 0 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b1b7ab0 auth_method 0 2024-08-27T02:58:12.999 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:58:12.821+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient(hunting): handle_auth_done global_id 7373 payload 824 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _finish_hunting 0 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:58:12.821+0000 7fc913bc9640 1 monclient: found mon.noname-c 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:58:12.821+0000 7fc913bc9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.000 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: dump: 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: _finish_auth 0 2024-08-27T02:58:13.001 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: _check_auth_tickets 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:58:12.821+0000 7fc7fbfff640 10 monclient: dump: 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.002 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:58:12.821+0000 7fc801e0b640 4 set_mon_vals no callback set 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7373 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:58:12.825+0000 7fc9160c39c0 1 librados: init done 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:58:12.825+0000 7fc7fbfff640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:58:12.825+0000 7fc7fbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:58:12.825+0000 7fc7fbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:58:12.825+0000 7fc9143ca640 10 monclient: get_auth_request con 0x55b42b1f94c0 auth_method 0 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:58:12.825+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc7fc070aa0 auth_method 0 2024-08-27T02:58:13.003 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:58:12.825+0000 7fc913bc9640 10 monclient: get_auth_request con 0x55b42b1fc6a0 auth_method 0 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:58:12.829+0000 7fc9133c8640 10 monclient: get_auth_request con 0x55b42b201730 auth_method 0 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding auth protocol: cephx 2024-08-27T02:58:13.004 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding auth protocol: cephx 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding auth protocol: cephx 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: crc 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b205420) adding con mode: secure 2024-08-27T02:58:13.005 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command objecter_requests cmddesc objecter_requests hook 0x55b42b208df0 EEXIST 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding auth protocol: cephx 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding auth protocol: cephx 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding auth protocol: cephx 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:13.006 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: crc 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:58:12.829+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b204478) adding con mode: secure 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key cmddesc rotate-key hook 0x55b42b2045c0 EEXIST 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b22cfa0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b22c8d0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b22b2b0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:13.007 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.712542s 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): get_auth_request con 0x55b42b22c8d0 auth_method 0 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b22b2b0 auth_method 0 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.008 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:58:12.833+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient(hunting): handle_auth_done global_id 7376 payload 824 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient: _finish_hunting 0 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:58:12.833+0000 7fc9133c8640 1 monclient: found mon.noname-c 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:58:12.833+0000 7fc9133c8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: dump: 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.009 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: _finish_auth 0 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: _check_auth_tickets 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 10 monclient: dump: 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.010 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7376 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:58:12.833+0000 7fc914bcb640 4 set_mon_vals no callback set 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:13.011 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.143:3301/0 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:58:12.833+0000 7fc7f97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: get_monmap_and_config 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:13.012 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding auth protocol: cephx 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding auth protocol: cephx 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding auth protocol: cephx 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:13.013 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: crc 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:58:12.833+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b24c960) adding con mode: secure 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:58:12.833+0000 7fc913bc9640 10 monclient: get_auth_request con 0x7fc7ec0709e0 auth_method 0 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding auth protocol: cephx 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding auth protocol: cephx 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding auth protocol: cephx 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:13.014 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: crc 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d93d40) adding con mode: secure 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key cmddesc rotate-key hook 0x7fffd7d93e88 EEXIST 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b280ea0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:13.015 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b250ca0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b27c270 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.717006s 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request con 0x55b42b280ea0 auth_method 0 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b27c270 auth_method 0 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:13.016 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_done global_id 7379 payload 274 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient: _finish_hunting 0 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:58:12.837+0000 7fc9143ca640 1 monclient: found mon.noname-c 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: dump: 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.017 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: _finish_auth 0 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: _check_auth_tickets 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:58:12.837+0000 7fc7f2ffd640 10 monclient: dump: 2024-08-27T02:58:13.018 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7379 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 4 set_mon_vals no callback set 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: shutdown 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: build_initial_monmap 2024-08-27T02:58:13.019 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: monmap: 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding auth protocol: cephx 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding auth protocol: cephx 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding auth protocol: cephx 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:13.020 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: crc 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b27c750) adding con mode: secure 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: starting msgr at 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: starting objecter 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command objecter_requests cmddesc objecter_requests hook 0x55b42b24ed50 EEXIST 2024-08-27T02:58:13.021 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: setting wanted keys 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 1 librados: calling monclient init 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: init 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding auth protocol: cephx 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding auth protocol: cephx 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding auth protocol: cephx 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:13.022 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: crc 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 AuthRegistry(0x55b42b22edc0) adding con mode: secure 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command rotate-key cmddesc rotate-key hook 0x55b42b22ef08 EEXIST 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-a con 0x55b42b250ca0 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-b con 0x55b42b27c270 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): picked mon.noname-c con 0x55b42b280ea0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:13.023 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:58:12.837+0000 7fc9160c39c0 10 monclient(hunting): authenticate will time out at 2625.719663s 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request con 0x55b42b250ca0 auth_method 0 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request con 0x55b42b280ea0 auth_method 0 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:58:12.837+0000 7fc913bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:13.024 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:58:12.837+0000 7fc9143ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:58:12.841+0000 7fc913bc9640 10 monclient(hunting): handle_auth_done global_id 7788 payload 824 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:58:12.841+0000 7fc913bc9640 10 monclient: _finish_hunting 0 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:58:12.841+0000 7fc913bc9640 1 monclient: found mon.noname-a 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:58:12.841+0000 7fc913bc9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:58:12.841+0000 7fc9133c8640 10 monclient: get_auth_request con 0x55b42b27c270 auth_method 0 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: dump: 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.025 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: _finish_auth 0 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: _check_auth_tickets 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 10 monclient: dump: 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:13.026 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 5 monclient: authenticate success, global_id 7788 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:58:12.841+0000 7fc7f2ffd640 4 set_mon_vals no callback set 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _renew_subs 2024-08-27T02:58:13.027 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 1 librados: init done 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cr dump hook 0x55b42b26dfb8 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:58:12.841+0000 7fc7f17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:58:12.841+0000 7fc9143ca640 10 monclient: get_auth_request con 0x55b42b29a970 auth_method 0 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:58:12.841+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc7dc070ad0 auth_method 0 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 realm 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:13.028 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:58:12.841+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:58:12.845+0000 7fc913bc9640 10 monclient: get_auth_request con 0x55b42b29ec30 auth_method 0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:58:12.845+0000 7fc9160c39c0 20 searching for the correct realm 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:58:12.845+0000 7fc9133c8640 10 monclient: get_auth_request con 0x55b42b2a3ef0 auth_method 0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:58:12.845+0000 7fc9143ca640 10 monclient: get_auth_request con 0x7fc908107990 auth_method 0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:58:12.849+0000 7fc913bc9640 10 monclient: get_auth_request con 0x7fc90c02a440 auth_method 0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:58:12.849+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc90406d560 auth_method 0 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:58:12.853+0000 7fc9133c8640 0 -- 172.21.15.143:0/809438743 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc90406d560 msgr2=0x7fc904001740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:58:12.853+0000 7fc7f17fa640 1 client.7788.objecter ms_handle_reset 0x7fc90406d560 session 0x7fc904087070 osd.4 2024-08-27T02:58:13.029 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:58:12.853+0000 7fc7f17fa640 10 monclient: _renew_subs 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:58:12.853+0000 7fc7f17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:58:12.853+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc7dc081170 auth_method 0 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:58:12.853+0000 7fc9143ca640 10 monclient: get_auth_request con 0x7fc9080b8b10 auth_method 0 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:58:12.857+0000 7fc913bc9640 10 monclient: get_auth_request con 0x7fc908107040 auth_method 0 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:58:12.857+0000 7fc9133c8640 0 -- 172.21.15.143:0/809438743 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc7dc081170 msgr2=0x7fc7dc0835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:58:12.857+0000 7fc7f17fa640 1 client.7788.objecter ms_handle_reset 0x7fc7dc081170 session 0x7fc904087070 osd.4 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:58:12.857+0000 7fc9133c8640 10 monclient: get_auth_request con 0x7fc90406d560 auth_method 0 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:13.030 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:58:12.865+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 zone default found 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 Realm: () 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 zonegroup default 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.031 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 started sync module instance, tier type = 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:58:12.869+0000 7fc9160c39c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=0 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=1 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=2 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=3 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=4 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=5 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=6 2024-08-27T02:58:13.032 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 20 add_watcher() i=7 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:58:12.885+0000 7fc9160c39c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding auth protocol: cephx 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding auth protocol: cephx 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding auth protocol: cephx 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:58:12.889+0000 7fc7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:13.033 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: crc 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 AuthRegistry(0x7fffd7d94220) adding con mode: secure 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache list hook 0x55b42b24de20 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache inspect hook 0x55b42b24de20 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache erase hook 0x55b42b24de20 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command cache zap hook 0x55b42b24de20 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 note: GC not initialized 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:58:12.889+0000 7fc7c8fe1640 20 reqs_thread_entry: start 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace show hook 0x7fc90c00e910 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace history hook 0x7fc90c00e910 2024-08-27T02:58:13.034 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace active hook 0x7fc90c00e910 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 5 asok(0x55b42afa6280) register_command sync trace active_short hook 0x7fc90c00e910 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 Filter name: none 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:58:12.889+0000 7fc7427fc640 20 reqs_thread_entry: start 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:13.035 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:58:12.889+0000 7fc9160c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:58:12.893+0000 7fc9160c39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94232306693008 notifier 7788 bl.length()=827 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:13.036 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:58:12.909+0000 7fc7f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:58:12.909+0000 7fc9160c39c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:58:12.913+0000 7fc9160c39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9160c39c0 time 2024-08-27T02:58:12.919026+0000 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc91999d2eb] 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: 4: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:13.037 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 6: main() 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 8: __libc_start_main() 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 9: _start() 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:58:12.917+0000 7fc9160c39c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7fc9160c39c0 thread_name:radosgw-admin 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc91881c520] 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:13.038 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc91999d345] 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc91999d49f] 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b428316b11] 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 8: radosgw-admin(+0x1420736) [0x55b428d73736] 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b42832c15d] 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 10: main() 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc918803d90] 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 12: __libc_start_main() 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 13: _start() 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:58:13.039 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:58:13.040 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:58:13.041 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:58:13.042 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:58:13.043 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:58:13.044 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:58:13.045 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7427fc640 / http_manager 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7c8fe1640 / http_manager 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7c9fe3640 / rgw_dt_lg_renew 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f17fa640 / ms_dispatch 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f27fc640 / io_context_pool 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f2ffd640 / io_context_pool 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7f97fa640 / ms_dispatch 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc7fbfff640 / ms_dispatch 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc801e0b640 / io_context_pool 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc9133c8640 / msgr-worker-2 2024-08-27T02:58:13.046 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc913bc9640 / msgr-worker-1 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc9143ca640 / msgr-worker-0 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc914bcb640 / io_context_pool 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr: 7fc9160c39c0 / radosgw-admin 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:58:12.921528Z_d24b2415-65c4-4bf7-9dc2-ca90f2c12687/log 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:58:13.047 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-08-27T02:58:13.048 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.993+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 realm 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:12.997+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.001+0000 7f7acc1859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:13.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.001+0000 7f7acc1859c0 20 searching for the correct realm 2024-08-27T02:58:13.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.005+0000 7f7aca48c640 0 -- 172.21.15.143:0/2424555388 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f7ac0008040 msgr2=0x7f7ac0040900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:13.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.221+0000 7f7ac9c8b640 0 -- 172.21.15.143:0/2424555388 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55bd9c3ef900 msgr2=0x55bd9c3f1d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:13.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:13.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:13.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:13.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:13.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:13.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:13.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.229+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:13.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 zone default found 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 4 Realm: () 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 zonegroup default 2024-08-27T02:58:13.232 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:13.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 started sync module instance, tier type = 2024-08-27T02:58:13.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.233+0000 7f7acc1859c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:13.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.257+0000 7f7acc1859c0 20 add_watcher() i=0 2024-08-27T02:58:13.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.257+0000 7f7acc1859c0 20 add_watcher() i=1 2024-08-27T02:58:13.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.257+0000 7f7acc1859c0 20 add_watcher() i=2 2024-08-27T02:58:13.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.257+0000 7f7acc1859c0 20 add_watcher() i=3 2024-08-27T02:58:13.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.257+0000 7f7acc1859c0 20 add_watcher() i=4 2024-08-27T02:58:13.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.257+0000 7f7acc1859c0 20 add_watcher() i=5 2024-08-27T02:58:13.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.257+0000 7f7acc1859c0 20 add_watcher() i=6 2024-08-27T02:58:13.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.261+0000 7f7acc1859c0 20 add_watcher() i=7 2024-08-27T02:58:13.261 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.261+0000 7f7acc1859c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:13.265 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.265+0000 7f797b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:13.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.265+0000 7f7acc1859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:13.266 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.265+0000 7f7acc1859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:13.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.265+0000 7f7acc1859c0 5 note: GC not initialized 2024-08-27T02:58:13.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f797a7fc640 20 reqs_thread_entry: start 2024-08-27T02:58:13.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:13.267 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 Filter name: none 2024-08-27T02:58:13.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f78ebfff640 20 reqs_thread_entry: start 2024-08-27T02:58:13.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:13.268 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:13.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:13.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:13.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:13.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:13.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:13.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:13.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:13.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:13.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:13.270 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:13.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:58:13.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:58:13.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:58:13.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.269+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:58:13.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:58:13.271 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:58:13.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:58:13.272 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:58:13.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:58:13.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:58:13.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:58:13.273 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:58:13.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:58:13.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:58:13.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:58:13.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:58:13.274 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:58:13.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.273+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:58:13.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:58:13.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:58:13.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:58:13.275 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:58:13.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:58:13.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:58:13.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:58:13.276 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f7acc1859c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:58:13.279 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.277+0000 7f797b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:13.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.285+0000 7f7acc1859c0 20 remove_watcher() i=0 2024-08-27T02:58:13.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.285+0000 7f7acc1859c0 2 removed watcher, disabling cache 2024-08-27T02:58:13.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.285+0000 7f7acc1859c0 20 remove_watcher() i=1 2024-08-27T02:58:13.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.289+0000 7f7acc1859c0 20 remove_watcher() i=2 2024-08-27T02:58:13.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.289+0000 7f7acc1859c0 20 remove_watcher() i=3 2024-08-27T02:58:13.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.293+0000 7f7acc1859c0 20 remove_watcher() i=4 2024-08-27T02:58:13.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.293+0000 7f7acc1859c0 20 remove_watcher() i=5 2024-08-27T02:58:13.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.297+0000 7f7acc1859c0 20 remove_watcher() i=6 2024-08-27T02:58:13.297 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:13.297+0000 7f7acc1859c0 20 remove_watcher() i=7 2024-08-27T02:58:13.312 INFO:tasks.workunit.client.0.smithi143.stderr: test: duplicated entries can be purged manually 2024-08-27T02:58:43.344 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:58:43.377 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:58:43.377 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:58:43.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.420+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:43.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 20 realm 2024-08-27T02:58:43.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:43.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:43.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:43.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.624+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.628+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:43.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.628+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.628+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:43.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.628+0000 7f7ea56779c0 20 searching for the correct realm 2024-08-27T02:58:43.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.636+0000 7f7ea397e640 0 -- 172.21.15.143:0/1904432010 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f7e8c02c040 msgr2=0x7f7e8c02d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:58:43.648 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.648+0000 7f7ea317d640 0 -- 172.21.15.143:0/1904432010 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f7e8c039450 msgr2=0x7f7e8c0398d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:58:43.866 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.864+0000 7f7ea56779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.864+0000 7f7ea56779c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.864+0000 7f7ea56779c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.864+0000 7f7ea56779c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.864+0000 7f7ea56779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.864+0000 7f7ea56779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.864+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:43.867 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:43.868 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 zone default found 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 4 Realm: () 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 zonegroup default 2024-08-27T02:58:43.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:43.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:43.870 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.868+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.872+0000 7f7ea56779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:43.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.872+0000 7f7ea56779c0 20 started sync module instance, tier type = 2024-08-27T02:58:43.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.872+0000 7f7ea56779c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:43.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.892+0000 7f7ea56779c0 20 add_watcher() i=0 2024-08-27T02:58:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.892+0000 7f7ea56779c0 20 add_watcher() i=1 2024-08-27T02:58:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.892+0000 7f7ea56779c0 20 add_watcher() i=2 2024-08-27T02:58:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.892+0000 7f7ea56779c0 20 add_watcher() i=3 2024-08-27T02:58:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.892+0000 7f7ea56779c0 20 add_watcher() i=4 2024-08-27T02:58:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.892+0000 7f7ea56779c0 20 add_watcher() i=5 2024-08-27T02:58:43.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.892+0000 7f7ea56779c0 20 add_watcher() i=6 2024-08-27T02:58:43.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.896+0000 7f7ea56779c0 20 add_watcher() i=7 2024-08-27T02:58:43.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.896+0000 7f7ea56779c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:43.901 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.900+0000 7f7d59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:43.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.900+0000 7f7ea56779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:43.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.900+0000 7f7ea56779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:43.902 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.900+0000 7f7ea56779c0 5 note: GC not initialized 2024-08-27T02:58:43.903 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7d58fe1640 20 reqs_thread_entry: start 2024-08-27T02:58:43.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:43.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 Filter name: none 2024-08-27T02:58:43.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7cd27fc640 20 reqs_thread_entry: start 2024-08-27T02:58:43.904 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:43.905 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:43.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:58:43.906 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.904+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.908+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:43.907 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.908+0000 7f7ea56779c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:43.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.908+0000 7f7ea56779c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:43.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.908+0000 7f7ea56779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:58:43.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.912+0000 7f7d59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:43.916 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.916+0000 7f7ea56779c0 20 remove_watcher() i=0 2024-08-27T02:58:43.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.916+0000 7f7ea56779c0 2 removed watcher, disabling cache 2024-08-27T02:58:43.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.920+0000 7f7ea56779c0 20 remove_watcher() i=1 2024-08-27T02:58:43.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.920+0000 7f7ea56779c0 20 remove_watcher() i=2 2024-08-27T02:58:43.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.924+0000 7f7ea56779c0 20 remove_watcher() i=3 2024-08-27T02:58:43.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.924+0000 7f7ea56779c0 20 remove_watcher() i=4 2024-08-27T02:58:43.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.928+0000 7f7ea56779c0 20 remove_watcher() i=5 2024-08-27T02:58:43.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.928+0000 7f7ea56779c0 20 remove_watcher() i=6 2024-08-27T02:58:43.930 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:43.928+0000 7f7ea56779c0 20 remove_watcher() i=7 2024-08-27T02:58:43.946 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:43.946 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:58:43.946 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-08-27T02:58:43.946 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:43.947 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-08-27T02:58:43.979 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:58:43.979 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:58:44.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 realm 2024-08-27T02:58:44.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:44.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:44.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 searching for the correct realm 2024-08-27T02:58:44.035 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.036+0000 7ff7c3bdd640 0 -- 172.21.15.143:0/194423804 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff7b40d9070 msgr2=0x7ff7b4136a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:44.041 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.040+0000 7ff7c4bdf640 0 -- 172.21.15.143:0/194423804 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7ff7b8091830 msgr2=0x7ff7b8061120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 zone default found 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 Realm: () 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 zonegroup default 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 started sync module instance, tier type = 2024-08-27T02:58:44.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:44.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=0 2024-08-27T02:58:44.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=1 2024-08-27T02:58:44.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=2 2024-08-27T02:58:44.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=3 2024-08-27T02:58:44.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=4 2024-08-27T02:58:44.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=5 2024-08-27T02:58:44.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=6 2024-08-27T02:58:44.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=7 2024-08-27T02:58:44.065 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.064+0000 7ff7c68d89c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:44.068 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff67b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:44.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:44.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:44.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 note: GC not initialized 2024-08-27T02:58:44.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff67a7dc640 20 reqs_thread_entry: start 2024-08-27T02:58:44.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:44.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 Filter name: none 2024-08-27T02:58:44.069 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff6737fe640 20 reqs_thread_entry: start 2024-08-27T02:58:44.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:44.070 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.072+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:44.073 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:58:44.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:58:44.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94373438679632 notifier 7842 bl.length()=827 2024-08-27T02:58:44.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:58:44.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:58:44.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:58:44.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:58:44.098 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7c68d89c0 time 2024-08-27T02:58:44.103768+0000 2024-08-27T02:58:44.098 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:44.099 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.099 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7ca1b22eb] 2024-08-27T02:58:44.099 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.099 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.099 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.099 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:58:44.099 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.100+0000 7ff7c68d89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7c68d89c0 time 2024-08-27T02:58:44.103768+0000 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7ca1b22eb] 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.100 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:58:44.101 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:58:44.101 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.101 INFO:tasks.workunit.client.0.smithi143.stderr:*** Caught signal (Aborted) ** 2024-08-27T02:58:44.101 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7ff7c68d89c0 thread_name:radosgw-admin 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7c9031520] 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7ca1b2345] 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.117 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.100+0000 7ff7c68d89c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7ff7c68d89c0 thread_name:radosgw-admin 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7c9031520] 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:44.118 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7ca1b2345] 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:58:44.119 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:58:44.000+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_done global_id 7830 payload 274 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: dump: 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.120 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: dump: 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.121 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7830 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 4 set_mon_vals no callback set 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 10 monclient: shutdown 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 5 asok(0x55d507196280) unregister_commands rotate-key 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.122 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding auth protocol: cephx 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding auth protocol: cephx 2024-08-27T02:58:44.123 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding auth protocol: cephx 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.124 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: starting msgr at 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: starting objecter 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command objecter_requests hook 0x55d5073a7540 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: setting wanted keys 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: calling monclient init 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding auth protocol: cephx 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding auth protocol: cephx 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding auth protocol: cephx 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.125 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key hook 0x55d5073a33b8 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:58:44.126 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d50725fe80 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d5072ec010 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d5072ec3f0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.885200s 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d5072ec010 auth_method 0 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request con 0x55d5072ec3f0 auth_method 0 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.127 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_done global_id 7833 payload 824 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:58:44.004+0000 7ff7c43de640 10 monclient: get_auth_request con 0x55d50725fe80 auth_method 0 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.128 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: dump: 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.129 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: dump: 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7833 2024-08-27T02:58:44.130 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:58:44.004+0000 7ff6b260c640 4 set_mon_vals no callback set 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: init done 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:58:44.008+0000 7ff6b0e09640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:58:44.008+0000 7ff6b0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:58:44.008+0000 7ff6b0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:58:44.008+0000 7ff7c43de640 10 monclient: get_auth_request con 0x7ff6ac070ad0 auth_method 0 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:58:44.008+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x55d5073ceba0 auth_method 0 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:58:44.008+0000 7ff7c43de640 10 monclient: get_auth_request con 0x55d5073edca0 auth_method 0 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x55d5073f1500 auth_method 0 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.131 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding auth protocol: cephx 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding auth protocol: cephx 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding auth protocol: cephx 2024-08-27T02:58:44.132 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command objecter_requests cmddesc objecter_requests hook 0x55d5073fa8e0 EEXIST 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.133 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding auth protocol: cephx 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding auth protocol: cephx 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding auth protocol: cephx 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.134 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key cmddesc rotate-key hook 0x55d5073f5f90 EEXIST 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d50741ea90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d50741e3c0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d50741cda0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.894573s 2024-08-27T02:58:44.135 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): get_auth_request con 0x55d50741ea90 auth_method 0 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d50741e3c0 auth_method 0 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.136 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request con 0x55d50741cda0 auth_method 0 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_done global_id 7836 payload 824 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:58:44.012+0000 7ff7c43de640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: dump: 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.137 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: dump: 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.138 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:58:44.012+0000 7ff7c53e0640 4 set_mon_vals no callback set 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7836 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:58:44.016+0000 7ff6a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:44.139 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:58:44.016+0000 7ff6a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:58:44.016+0000 7ff6a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: get_monmap_and_config 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.140 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding auth protocol: cephx 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding auth protocol: cephx 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding auth protocol: cephx 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff69c0709e0 auth_method 0 2024-08-27T02:58:44.141 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding auth protocol: cephx 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding auth protocol: cephx 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding auth protocol: cephx 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.142 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key cmddesc rotate-key hook 0x7fff006edc38 EEXIST 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d5074728e0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d507442790 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d507443930 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.143 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.899388s 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): get_auth_request con 0x55d5074728e0 auth_method 0 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d507442790 auth_method 0 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.144 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_done global_id 7433 payload 274 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:58:44.016+0000 7ff7c43de640 1 monclient: found mon.noname-c 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: dump: 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.145 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: dump: 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.146 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7433 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 4 set_mon_vals no callback set 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: shutdown 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.147 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding auth protocol: cephx 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding auth protocol: cephx 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding auth protocol: cephx 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.148 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: starting msgr at 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: starting objecter 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command objecter_requests cmddesc objecter_requests hook 0x55d507441d40 EEXIST 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: setting wanted keys 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: calling monclient init 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding auth protocol: cephx 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding auth protocol: cephx 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding auth protocol: cephx 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.149 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key cmddesc rotate-key hook 0x55d5074209f8 EEXIST 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:58:44.150 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d507442790 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d507443930 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d5074728e0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.901907s 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): get_auth_request con 0x55d507442790 auth_method 0 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d507443930 auth_method 0 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.151 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_done global_id 7842 payload 824 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:58:44.020+0000 7ff7c43de640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.152 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: dump: 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.153 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: dump: 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.154 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 4 set_mon_vals no callback set 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7842 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: init done 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cr dump hook 0x55d5074683b8 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:58:44.024+0000 7ff699ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:58:44.024+0000 7ff699ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:58:44.024+0000 7ff699ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:58:44.024+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff68c070aa0 auth_method 0 2024-08-27T02:58:44.155 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:58:44.024+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x55d50748b990 auth_method 0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 realm 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:58:44.024+0000 7ff7c43de640 10 monclient: get_auth_request con 0x55d50748fcf0 auth_method 0 2024-08-27T02:58:44.156 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 searching for the correct realm 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:58:44.028+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x55d507494ed0 auth_method 0 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:58:44.028+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x7ff7b8086070 auth_method 0 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:58:44.032+0000 7ff7c43de640 10 monclient: get_auth_request con 0x7ff7bc017070 auth_method 0 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:58:44.032+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff7b40d9070 auth_method 0 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:58:44.036+0000 7ff7c3bdd640 0 -- 172.21.15.143:0/194423804 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff7b40d9070 msgr2=0x7ff7b4136a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:58:44.036+0000 7ff699ffb640 1 client.7842.objecter ms_handle_reset 0x7ff7b40d9070 session 0x7ff7b411fe90 osd.4 2024-08-27T02:58:44.157 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:58:44.036+0000 7ff699ffb640 10 monclient: _renew_subs 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:58:44.036+0000 7ff699ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:58:44.036+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x7ff7b8091830 auth_method 0 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:58:44.036+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff68c081140 auth_method 0 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:58:44.040+0000 7ff7c43de640 10 monclient: get_auth_request con 0x7ff7b805daa0 auth_method 0 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:58:44.040+0000 7ff7c4bdf640 0 -- 172.21.15.143:0/194423804 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7ff7b8091830 msgr2=0x7ff7b8061120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:58:44.040+0000 7ff699ffb640 1 client.7842.objecter ms_handle_reset 0x7ff7b8091830 session 0x7ff7b8011040 osd.6 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:58:44.040+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x7ff7b40d9070 auth_method 0 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:44.158 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 zone default found 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 Realm: () 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 zonegroup default 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.159 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 started sync module instance, tier type = 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=0 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=1 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=2 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=3 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=4 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=5 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=6 2024-08-27T02:58:44.160 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=7 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding auth protocol: cephx 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding auth protocol: cephx 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding auth protocol: cephx 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:58:44.068+0000 7ff67b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.161 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache list hook 0x55d507469010 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache inspect hook 0x55d507469010 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache erase hook 0x55d507469010 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache zap hook 0x55d507469010 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 note: GC not initialized 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:58:44.068+0000 7ff67a7dc640 20 reqs_thread_entry: start 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace show hook 0x7ff7bc004ab0 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace history hook 0x7ff7bc004ab0 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace active hook 0x7ff7bc004ab0 2024-08-27T02:58:44.162 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace active_short hook 0x7ff7bc004ab0 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 Filter name: none 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:58:44.068+0000 7ff6737fe640 20 reqs_thread_entry: start 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.163 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94373438679632 notifier 7842 bl.length()=827 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.164 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.165 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.165 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:58:44.100+0000 7ff7c68d89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7c68d89c0 time 2024-08-27T02:58:44.103768+0000 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7ca1b22eb] 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.166 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:58:44.100+0000 7ff7c68d89c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7ff7c68d89c0 thread_name:radosgw-admin 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7c9031520] 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7ca1b2345] 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:58:44.167 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:58:44.168 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:58:44.169 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:58:44.170 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:58:44.171 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:58:44.172 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:58:44.173 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:58:44.174 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6737fe640 / http_manager 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff67a7dc640 / http_manager 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff67b7de640 / rgw_dt_lg_renew 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff699ffb640 / ms_dispatch 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff69affd640 / io_context_pool 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff69b7fe640 / io_context_pool 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6a9ffb640 / ms_dispatch 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6b0e09640 / ms_dispatch 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6b260c640 / io_context_pool 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c3bdd640 / msgr-worker-2 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c43de640 / msgr-worker-1 2024-08-27T02:58:44.175 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c4bdf640 / msgr-worker-0 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c53e0640 / io_context_pool 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c68d89c0 / radosgw-admin 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/log/ceph/ceph-client.admin.128704.log 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr:--- begin dump of recent events --- 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -499> 2024-08-27T02:58:44.000+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -498> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_done global_id 7830 payload 274 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -497> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -496> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -495> 2024-08-27T02:58:44.000+0000 7ff7c4bdf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -494> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -493> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.176 INFO:tasks.workunit.client.0.smithi143.stderr: -492> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: dump: 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr: -491> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr: -490> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr: -489> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr: -488> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.177 INFO:tasks.workunit.client.0.smithi143.stderr: -487> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr: -486> 2024-08-27T02:58:44.000+0000 7ff6b260c640 10 monclient: dump: 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr: -485> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7830 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr: -484> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:44.178 INFO:tasks.workunit.client.0.smithi143.stderr: -483> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 4 set_mon_vals no callback set 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr: -482> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 10 monclient: shutdown 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr: -481> 2024-08-27T02:58:44.000+0000 7ff7c68d89c0 5 asok(0x55d507196280) unregister_commands rotate-key 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr: -480> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr: -479> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr: -478> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.179 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -477> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding auth protocol: cephx 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -476> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding auth protocol: cephx 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -475> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding auth protocol: cephx 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -474> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -473> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -472> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -471> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -470> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -469> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -468> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -467> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -466> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -465> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.180 INFO:tasks.workunit.client.0.smithi143.stderr: -464> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: crc 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -463> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073cc7e0) adding con mode: secure 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -462> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -461> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: starting msgr at 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -460> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: starting objecter 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -459> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command objecter_requests hook 0x55d5073a7540 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -458> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: setting wanted keys 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -457> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: calling monclient init 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -456> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -455> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding auth protocol: cephx 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -454> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding auth protocol: cephx 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -453> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding auth protocol: cephx 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -452> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -451> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.181 INFO:tasks.workunit.client.0.smithi143.stderr: -450> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -449> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -448> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -447> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -446> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -445> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -444> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -443> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -442> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: crc 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -441> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073a3270) adding con mode: secure 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -440> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.182 INFO:tasks.workunit.client.0.smithi143.stderr: -439> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -438> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key hook 0x55d5073a33b8 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -437> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -436> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -435> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d50725fe80 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -434> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d5072ec010 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -433> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d5072ec3f0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -432> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -431> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -430> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -429> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -428> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.885200s 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -427> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d5072ec010 auth_method 0 2024-08-27T02:58:44.183 INFO:tasks.workunit.client.0.smithi143.stderr: -426> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -425> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -424> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -423> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request con 0x55d5072ec3f0 auth_method 0 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -422> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -421> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -420> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -419> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -418> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -417> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -416> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -415> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -414> 2024-08-27T02:58:44.004+0000 7ff7c4bdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.184 INFO:tasks.workunit.client.0.smithi143.stderr: -413> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_done global_id 7833 payload 824 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr: -412> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr: -411> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr: -410> 2024-08-27T02:58:44.004+0000 7ff7c3bdd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr: -409> 2024-08-27T02:58:44.004+0000 7ff7c43de640 10 monclient: get_auth_request con 0x55d50725fe80 auth_method 0 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr: -408> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr: -407> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr: -406> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: dump: 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.185 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr: -405> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr: -404> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr: -403> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr: -402> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr: -401> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr: -400> 2024-08-27T02:58:44.004+0000 7ff6b0e09640 10 monclient: dump: 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.186 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -399> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7833 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -398> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -397> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -396> 2024-08-27T02:58:44.004+0000 7ff6b260c640 4 set_mon_vals no callback set 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -395> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -394> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -393> 2024-08-27T02:58:44.004+0000 7ff7c68d89c0 1 librados: init done 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -392> 2024-08-27T02:58:44.008+0000 7ff6b0e09640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:44.187 INFO:tasks.workunit.client.0.smithi143.stderr: -391> 2024-08-27T02:58:44.008+0000 7ff6b0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -390> 2024-08-27T02:58:44.008+0000 7ff6b0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -389> 2024-08-27T02:58:44.008+0000 7ff7c43de640 10 monclient: get_auth_request con 0x7ff6ac070ad0 auth_method 0 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -388> 2024-08-27T02:58:44.008+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x55d5073ceba0 auth_method 0 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -387> 2024-08-27T02:58:44.008+0000 7ff7c43de640 10 monclient: get_auth_request con 0x55d5073edca0 auth_method 0 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -386> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x55d5073f1500 auth_method 0 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -385> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -384> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr: -383> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.188 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -382> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding auth protocol: cephx 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -381> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding auth protocol: cephx 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -380> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding auth protocol: cephx 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -379> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -378> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -377> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -376> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -375> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -374> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -373> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -372> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -371> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.189 INFO:tasks.workunit.client.0.smithi143.stderr: -370> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -369> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: crc 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -368> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f6eb0) adding con mode: secure 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -367> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -366> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command objecter_requests cmddesc objecter_requests hook 0x55d5073fa8e0 EEXIST 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -365> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -364> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding auth protocol: cephx 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -363> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding auth protocol: cephx 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -362> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding auth protocol: cephx 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -361> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -360> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -359> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -358> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.190 INFO:tasks.workunit.client.0.smithi143.stderr: -357> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -356> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -355> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -354> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -353> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -352> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -351> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: crc 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -350> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5073f5e48) adding con mode: secure 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -349> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -348> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -347> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key cmddesc rotate-key hook 0x55d5073f5f90 EEXIST 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -346> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.191 INFO:tasks.workunit.client.0.smithi143.stderr: -345> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -344> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d50741ea90 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -343> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d50741e3c0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -342> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d50741cda0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -341> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -340> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -339> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -338> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -337> 2024-08-27T02:58:44.012+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.894573s 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -336> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): get_auth_request con 0x55d50741ea90 auth_method 0 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -335> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -334> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -333> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -332> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d50741e3c0 auth_method 0 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -331> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.192 INFO:tasks.workunit.client.0.smithi143.stderr: -330> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -329> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -328> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -327> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -326> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -325> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -324> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -323> 2024-08-27T02:58:44.012+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -322> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request con 0x55d50741cda0 auth_method 0 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -321> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -320> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -319> 2024-08-27T02:58:44.012+0000 7ff7c4bdf640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -318> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient(hunting): handle_auth_done global_id 7836 payload 824 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -317> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.193 INFO:tasks.workunit.client.0.smithi143.stderr: -316> 2024-08-27T02:58:44.012+0000 7ff7c43de640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr: -315> 2024-08-27T02:58:44.012+0000 7ff7c43de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr: -314> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr: -313> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr: -312> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: dump: 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.194 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr: -311> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr: -310> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr: -309> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr: -308> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr: -307> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr: -306> 2024-08-27T02:58:44.012+0000 7ff6a9ffb640 10 monclient: dump: 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.195 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -305> 2024-08-27T02:58:44.012+0000 7ff7c53e0640 4 set_mon_vals no callback set 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -304> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7836 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -303> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -302> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -301> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -300> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -299> 2024-08-27T02:58:44.016+0000 7ff6a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -298> 2024-08-27T02:58:44.016+0000 7ff6a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -297> 2024-08-27T02:58:44.016+0000 7ff6a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -296> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: get_monmap_and_config 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -295> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -294> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.196 INFO:tasks.workunit.client.0.smithi143.stderr: -293> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr: -292> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding auth protocol: cephx 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr: -291> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding auth protocol: cephx 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr: -290> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding auth protocol: cephx 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr: -289> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.197 INFO:tasks.workunit.client.0.smithi143.stderr: -288> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -287> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -286> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -285> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -284> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -283> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -282> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -281> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -280> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -279> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: crc 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -278> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50743e3e0) adding con mode: secure 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -277> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff69c0709e0 auth_method 0 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -276> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -275> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.198 INFO:tasks.workunit.client.0.smithi143.stderr: -274> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding auth protocol: cephx 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -273> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding auth protocol: cephx 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -272> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding auth protocol: cephx 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -271> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -270> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -269> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -268> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -267> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -266> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -265> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -264> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -263> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -262> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -261> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: crc 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -260> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edaf0) adding con mode: secure 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -259> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.199 INFO:tasks.workunit.client.0.smithi143.stderr: -258> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -257> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key cmddesc rotate-key hook 0x7fff006edc38 EEXIST 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -256> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -255> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -254> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d5074728e0 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -253> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d507442790 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -252> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d507443930 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -251> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -250> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -249> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -248> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -247> 2024-08-27T02:58:44.016+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.899388s 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -246> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): get_auth_request con 0x55d5074728e0 auth_method 0 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -245> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -244> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -243> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.200 INFO:tasks.workunit.client.0.smithi143.stderr: -242> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d507442790 auth_method 0 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -241> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -240> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -239> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -238> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -237> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -236> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -235> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -234> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -233> 2024-08-27T02:58:44.016+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -232> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient(hunting): handle_auth_done global_id 7433 payload 274 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -231> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -230> 2024-08-27T02:58:44.016+0000 7ff7c43de640 1 monclient: found mon.noname-c 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -229> 2024-08-27T02:58:44.016+0000 7ff7c43de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.143:3301/0 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -228> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.201 INFO:tasks.workunit.client.0.smithi143.stderr: -227> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr: -226> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: dump: 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr: -225> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.202 INFO:tasks.workunit.client.0.smithi143.stderr: -224> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr: -223> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr: -222> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr: -221> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr: -220> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 10 monclient: dump: 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.203 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: -219> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7433 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: -218> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: get_monmap_and_config success 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: -217> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 4 set_mon_vals no callback set 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: -216> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: shutdown 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: -215> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: build_initial_monmap 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: -214> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 build_initial for_mkfs: 0 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr: -213> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: monmap: 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 0 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 0.000000 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr:created 0.000000 2024-08-27T02:58:44.204 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 0 (unknown) 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.noname-a 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.noname-b 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.noname-c 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -212> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding auth protocol: cephx 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -211> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding auth protocol: cephx 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -210> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding auth protocol: cephx 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -209> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -208> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -207> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -206> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.205 INFO:tasks.workunit.client.0.smithi143.stderr: -205> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -204> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -203> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -202> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -201> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -200> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -199> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: crc 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -198> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d50746dcf0) adding con mode: secure 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -197> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -196> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: starting msgr at 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -195> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: starting objecter 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -194> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command objecter_requests cmddesc objecter_requests hook 0x55d507441d40 EEXIST 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -193> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: setting wanted keys 2024-08-27T02:58:44.206 INFO:tasks.workunit.client.0.smithi143.stderr: -192> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: calling monclient init 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -191> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: init 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -190> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding auth protocol: cephx 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -189> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding auth protocol: cephx 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -188> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding auth protocol: cephx 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -187> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -186> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -185> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -184> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -183> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -182> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -181> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -180> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.207 INFO:tasks.workunit.client.0.smithi143.stderr: -179> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -178> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -177> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: crc 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -176> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 AuthRegistry(0x55d5074208b0) adding con mode: secure 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -175> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -174> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -173> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command rotate-key cmddesc rotate-key hook 0x55d5074209f8 EEXIST 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -172> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _reopen_session rank -1 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -171> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -170> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-a con 0x55d507442790 addr [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -169> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-c con 0x55d507443930 addr [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -168> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): picked mon.noname-b con 0x55d5074728e0 addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -167> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.208 INFO:tasks.workunit.client.0.smithi143.stderr: -166> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -165> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): start opening mon connection 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -164> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): _renew_subs 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -163> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient(hunting): authenticate will time out at 2656.901907s 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -162> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): get_auth_request con 0x55d507442790 auth_method 0 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -161> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -160> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -159> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -158> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request con 0x55d507443930 auth_method 0 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -157> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -156> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth method 2 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -155> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): _init_auth creating new auth 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -154> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -153> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.209 INFO:tasks.workunit.client.0.smithi143.stderr: -152> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -151> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -150> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -149> 2024-08-27T02:58:44.020+0000 7ff7c3bdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -148> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient(hunting): handle_auth_done global_id 7842 payload 824 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -147> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient: _finish_hunting 0 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -146> 2024-08-27T02:58:44.020+0000 7ff7c43de640 1 monclient: found mon.noname-a 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -145> 2024-08-27T02:58:44.020+0000 7ff7c43de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -144> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -143> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr: -142> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: dump: 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.210 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr: -141> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: _finish_auth 0 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr: -140> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: _check_auth_tickets 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr: -139> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: handle_config config(0 keys) 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr: -138> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr: -137> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-27T02:58:44.211 INFO:tasks.workunit.client.0.smithi143.stderr: -136> 2024-08-27T02:58:44.020+0000 7ff699ffb640 10 monclient: dump: 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:epoch 1 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:fsid 2bd9f312-2905-4c35-8bed-4bbae91a1fc0 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:last_changed 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:created 2024-08-27T02:29:52.643584+0000 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:min_mon_release 19 (squid) 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:election_strategy: 1 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr: -135> 2024-08-27T02:58:44.020+0000 7ff69b7fe640 4 set_mon_vals no callback set 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr: -134> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 monclient: authenticate success, global_id 7842 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr: -133> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr: -132> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.212 INFO:tasks.workunit.client.0.smithi143.stderr: -131> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _renew_subs 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -130> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -129> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 1 librados: init done 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -128> 2024-08-27T02:58:44.020+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cr dump hook 0x55d5074683b8 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -127> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -126> 2024-08-27T02:58:44.024+0000 7ff699ffb640 4 mgrc handle_mgr_map Got map version 5 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -125> 2024-08-27T02:58:44.024+0000 7ff699ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -124> 2024-08-27T02:58:44.024+0000 7ff699ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.181:6832/3883673734,v1:172.21.15.181:6833/3883673734] 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -123> 2024-08-27T02:58:44.024+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff68c070aa0 auth_method 0 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -122> 2024-08-27T02:58:44.024+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x55d50748b990 auth_method 0 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -121> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -120> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 realm 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -119> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.213 INFO:tasks.workunit.client.0.smithi143.stderr: -118> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -117> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -116> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -115> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -114> 2024-08-27T02:58:44.024+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -113> 2024-08-27T02:58:44.024+0000 7ff7c43de640 10 monclient: get_auth_request con 0x55d50748fcf0 auth_method 0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -112> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -111> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -110> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -109> 2024-08-27T02:58:44.028+0000 7ff7c68d89c0 20 searching for the correct realm 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -108> 2024-08-27T02:58:44.028+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x55d507494ed0 auth_method 0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -107> 2024-08-27T02:58:44.028+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x7ff7b8086070 auth_method 0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -106> 2024-08-27T02:58:44.032+0000 7ff7c43de640 10 monclient: get_auth_request con 0x7ff7bc017070 auth_method 0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -105> 2024-08-27T02:58:44.032+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff7b40d9070 auth_method 0 2024-08-27T02:58:44.214 INFO:tasks.workunit.client.0.smithi143.stderr: -104> 2024-08-27T02:58:44.036+0000 7ff7c3bdd640 0 -- 172.21.15.143:0/194423804 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff7b40d9070 msgr2=0x7ff7b4136a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -103> 2024-08-27T02:58:44.036+0000 7ff699ffb640 1 client.7842.objecter ms_handle_reset 0x7ff7b40d9070 session 0x7ff7b411fe90 osd.4 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -102> 2024-08-27T02:58:44.036+0000 7ff699ffb640 10 monclient: _renew_subs 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -101> 2024-08-27T02:58:44.036+0000 7ff699ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.143:3300/0 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -100> 2024-08-27T02:58:44.036+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x7ff7b8091830 auth_method 0 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -99> 2024-08-27T02:58:44.036+0000 7ff7c3bdd640 10 monclient: get_auth_request con 0x7ff68c081140 auth_method 0 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -98> 2024-08-27T02:58:44.040+0000 7ff7c43de640 10 monclient: get_auth_request con 0x7ff7b805daa0 auth_method 0 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -97> 2024-08-27T02:58:44.040+0000 7ff7c4bdf640 0 -- 172.21.15.143:0/194423804 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7ff7b8091830 msgr2=0x7ff7b8061120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -96> 2024-08-27T02:58:44.040+0000 7ff699ffb640 1 client.7842.objecter ms_handle_reset 0x7ff7b8091830 session 0x7ff7b8011040 osd.6 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -95> 2024-08-27T02:58:44.040+0000 7ff7c4bdf640 10 monclient: get_auth_request con 0x7ff7b40d9070 auth_method 0 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -94> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -93> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -92> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:44.215 INFO:tasks.workunit.client.0.smithi143.stderr: -91> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -90> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -89> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -88> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -87> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -86> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -85> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -84> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -83> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -82> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 zone default found 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -81> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 Realm: () 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -80> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -79> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -78> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -77> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 zonegroup default 2024-08-27T02:58:44.216 INFO:tasks.workunit.client.0.smithi143.stderr: -76> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -75> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -74> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -73> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -72> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -71> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -70> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 started sync module instance, tier type = 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -69> 2024-08-27T02:58:44.048+0000 7ff7c68d89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -68> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=0 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -67> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=1 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -66> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=2 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -65> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=3 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -64> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=4 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -63> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=5 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -62> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=6 2024-08-27T02:58:44.217 INFO:tasks.workunit.client.0.smithi143.stderr: -61> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 20 add_watcher() i=7 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -60> 2024-08-27T02:58:44.064+0000 7ff7c68d89c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -59> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding auth protocol: cephx 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -58> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding auth protocol: cephx 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -57> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding auth protocol: cephx 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -56> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -55> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -54> 2024-08-27T02:58:44.068+0000 7ff67b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -53> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -52> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -51> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -50> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -49> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -48> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.218 INFO:tasks.workunit.client.0.smithi143.stderr: -47> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -46> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -45> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: crc 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -44> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 AuthRegistry(0x7fff006edfd0) adding con mode: secure 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -43> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -42> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -41> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -40> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache list hook 0x55d507469010 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -39> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache inspect hook 0x55d507469010 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -38> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache erase hook 0x55d507469010 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -37> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command cache zap hook 0x55d507469010 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -36> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 note: GC not initialized 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -35> 2024-08-27T02:58:44.068+0000 7ff67a7dc640 20 reqs_thread_entry: start 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -34> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace show hook 0x7ff7bc004ab0 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -33> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace history hook 0x7ff7bc004ab0 2024-08-27T02:58:44.219 INFO:tasks.workunit.client.0.smithi143.stderr: -32> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace active hook 0x7ff7bc004ab0 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -31> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 5 asok(0x55d507196280) register_command sync trace active_short hook 0x7ff7bc004ab0 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -30> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -29> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 Filter name: none 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -28> 2024-08-27T02:58:44.068+0000 7ff6737fe640 20 reqs_thread_entry: start 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -27> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -26> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -25> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -24> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -23> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -22> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -21> 2024-08-27T02:58:44.068+0000 7ff7c68d89c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -20> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -19> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -18> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.220 INFO:tasks.workunit.client.0.smithi143.stderr: -17> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -16> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -15> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -14> 2024-08-27T02:58:44.072+0000 7ff7c68d89c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -13> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -12> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -11> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -10> 2024-08-27T02:58:44.088+0000 7ff7c68d89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -9> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94373438679632 notifier 7842 bl.length()=827 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -8> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -7> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -6> 2024-08-27T02:58:44.088+0000 7ff69affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:44.221 INFO:tasks.workunit.client.0.smithi143.stderr: -5> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: -4> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: -3> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: -2> 2024-08-27T02:58:44.092+0000 7ff7c68d89c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: -1> 2024-08-27T02:58:44.100+0000 7ff7c68d89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7c68d89c0 time 2024-08-27T02:58:44.103768+0000 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7ca1b22eb] 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.222 INFO:tasks.workunit.client.0.smithi143.stderr: 5: main() 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 7: __libc_start_main() 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 8: _start() 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 0> 2024-08-27T02:58:44.100+0000 7ff7c68d89c0 -1 *** Caught signal (Aborted) ** 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: in thread 7ff7c68d89c0 thread_name:radosgw-admin 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: ceph version 19.3.0-4504-gd17b2285 (d17b22856a85d7d49d47be692c778d4419f41641) squid (dev) 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7c9031520] 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 2: pthread_kill() 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 3: raise() 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 4: abort() 2024-08-27T02:58:44.223 INFO:tasks.workunit.client.0.smithi143.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7ca1b2345] 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7ca1b249f] 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d504419b11] 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d50442f1ca] 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 9: main() 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7c9018d90] 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 11: __libc_start_main() 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 12: _start() 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr:--- logging levels --- 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 none 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 lockdep 2024-08-27T02:58:44.224 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 context 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 crush 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_balancer 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_locker 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_log_expire 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mds_migrator 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 3/ 5 mds_quiesce 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 buffer 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 timer 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 filer 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 striper 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 1 objecter 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rados 2024-08-27T02:58:44.225 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_mirror 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_replay 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 rbd_pwl 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 journaler 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objectcacher 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 immutable_obj_cache 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 client 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 osd 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 optracker 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 objclass 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 filestore 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 journal 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 ms 2024-08-27T02:58:44.226 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mon 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 0/10 monc 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 paxos 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 tp 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 auth 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 crypto 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 finisher 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 reserver 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 heartbeatmap 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 perfcounter 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_sync 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_datacache 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_access 2024-08-27T02:58:44.227 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_dbstore 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_flight 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 rgw_lifecycle 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 20/20 rgw_notification 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 javaclient 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 asok 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 1 throttle 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 0 refs 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 compressor 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluestore 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 bluefs 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 3 bdev 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 kstore 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 4/ 5 rocksdb 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 fuse 2024-08-27T02:58:44.228 INFO:tasks.workunit.client.0.smithi143.stderr: 2/ 5 mgr 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mgrc 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 dpdk 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 eventtrace 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 prioritycache 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 test 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephfs_mirror 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cephsqlite 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 crimson_interrupt 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_onode 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_odata 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_omap 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_tm 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_t 2024-08-27T02:58:44.229 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cleaner 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_epm 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_lba 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_fixedkv_tree 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_cache 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_journal 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_device 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 seastore_backref 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 alienstore 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 mclock 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 cyanstore 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 ceph_exporter 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 memstore 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 1/ 5 trace 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: 0/ 5 ceph_dedup 2024-08-27T02:58:44.230 INFO:tasks.workunit.client.0.smithi143.stderr: -2/-2 (syslog threshold) 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 99/99 (stderr threshold) 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr:--- pthread ID / name mapping for recent threads --- 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6737fe640 / http_manager 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff67a7dc640 / http_manager 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff67b7de640 / rgw_dt_lg_renew 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff699ffb640 / ms_dispatch 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff69affd640 / io_context_pool 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff69b7fe640 / io_context_pool 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6a9ffb640 / ms_dispatch 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6b0e09640 / ms_dispatch 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff6b260c640 / io_context_pool 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c3bdd640 / msgr-worker-2 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c43de640 / msgr-worker-1 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c4bdf640 / msgr-worker-0 2024-08-27T02:58:44.231 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c53e0640 / io_context_pool 2024-08-27T02:58:44.232 INFO:tasks.workunit.client.0.smithi143.stderr: 7ff7c68d89c0 / radosgw-admin 2024-08-27T02:58:44.232 INFO:tasks.workunit.client.0.smithi143.stderr: max_recent 500 2024-08-27T02:58:44.232 INFO:tasks.workunit.client.0.smithi143.stderr: max_new 1000 2024-08-27T02:58:44.232 INFO:tasks.workunit.client.0.smithi143.stderr: log_file /var/lib/ceph/crash/2024-08-27T02:58:44.105985Z_936e8fbf-acf5-4d01-bab8-f37695b86c82/log 2024-08-27T02:58:44.232 INFO:tasks.workunit.client.0.smithi143.stderr:--- end dump of recent events --- 2024-08-27T02:58:44.232 INFO:tasks.workunit.client.0.smithi143.stderr:Aborted 2024-08-27T02:58:44.232 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:58:44.233 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:58:44.233 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:58:44.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 realm 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.180+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.184+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.184+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.184+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.184+0000 7f04702ad9c0 20 searching for the correct realm 2024-08-27T02:58:44.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.184+0000 7f046e5b4640 0 -- 172.21.15.143:0/2559875976 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f04640c9070 msgr2=0x7f0464111a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:58:44.396 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.396+0000 7f046e5b4640 0 -- 172.21.15.143:0/2559875976 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f04640b6070 msgr2=0x7f046412a850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:44.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:44.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:44.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:44.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:44.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:44.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:44.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.620+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:44.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 zone default found 2024-08-27T02:58:44.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 4 Realm: () 2024-08-27T02:58:44.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:44.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:44.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:44.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 zonegroup default 2024-08-27T02:58:44.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.624 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 started sync module instance, tier type = 2024-08-27T02:58:44.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.624+0000 7f04702ad9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:44.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.648+0000 7f04702ad9c0 20 add_watcher() i=0 2024-08-27T02:58:44.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.648+0000 7f04702ad9c0 20 add_watcher() i=1 2024-08-27T02:58:44.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.648+0000 7f04702ad9c0 20 add_watcher() i=2 2024-08-27T02:58:44.649 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.648+0000 7f04702ad9c0 20 add_watcher() i=3 2024-08-27T02:58:44.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.648+0000 7f04702ad9c0 20 add_watcher() i=4 2024-08-27T02:58:44.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.648+0000 7f04702ad9c0 20 add_watcher() i=5 2024-08-27T02:58:44.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.648+0000 7f04702ad9c0 20 add_watcher() i=6 2024-08-27T02:58:44.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.652+0000 7f04702ad9c0 20 add_watcher() i=7 2024-08-27T02:58:44.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.652+0000 7f04702ad9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:44.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f031f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:44.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f04702ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:44.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f04702ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:44.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f04702ad9c0 5 note: GC not initialized 2024-08-27T02:58:44.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f031e7fc640 20 reqs_thread_entry: start 2024-08-27T02:58:44.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f04702ad9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:44.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f04702ad9c0 20 Filter name: none 2024-08-27T02:58:44.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f028ffff640 20 reqs_thread_entry: start 2024-08-27T02:58:44.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.656+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:44.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:44.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:58:44.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:44.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:44.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.660+0000 7f04702ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:58:44.665 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.664+0000 7f031f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:44.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.668+0000 7f04702ad9c0 20 remove_watcher() i=0 2024-08-27T02:58:44.670 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.668+0000 7f04702ad9c0 2 removed watcher, disabling cache 2024-08-27T02:58:44.672 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.672+0000 7f04702ad9c0 20 remove_watcher() i=1 2024-08-27T02:58:44.674 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.672+0000 7f04702ad9c0 20 remove_watcher() i=2 2024-08-27T02:58:44.677 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.676+0000 7f04702ad9c0 20 remove_watcher() i=3 2024-08-27T02:58:44.679 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.680+0000 7f04702ad9c0 20 remove_watcher() i=4 2024-08-27T02:58:44.681 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.680+0000 7f04702ad9c0 20 remove_watcher() i=5 2024-08-27T02:58:44.682 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.680+0000 7f04702ad9c0 20 remove_watcher() i=6 2024-08-27T02:58:44.684 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.684+0000 7f04702ad9c0 20 remove_watcher() i=7 2024-08-27T02:58:44.753 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-08-27T02:58:44.782 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:58:44.782 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:58:44.825 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.824+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 realm 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:44.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:44.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:44.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:58:44.829 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.828+0000 7f6d836ca9c0 20 searching for the correct realm 2024-08-27T02:58:44.836 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:44.836+0000 7f6d819d1640 0 -- 172.21.15.143:0/4120470825 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f6d6c0e3040 msgr2=0x7f6d6c0e2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:58:45.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.052+0000 7f6d811d0640 0 -- 172.21.15.143:0/4120470825 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55ecea7daec0 msgr2=0x55ecea7dd2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:58:45.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:58:45.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:58:45.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:58:45.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:58:45.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:58:45.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:58:45.060 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:45.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:58:45.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.061 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 zone default found 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 4 Realm: () 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 zonegroup default 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:45.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.060+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.064+0000 7f6d836ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:45.063 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.064+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.064+0000 7f6d836ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:58:45.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.064+0000 7f6d836ca9c0 20 started sync module instance, tier type = 2024-08-27T02:58:45.064 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.064+0000 7f6d836ca9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:58:45.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.088+0000 7f6d836ca9c0 20 add_watcher() i=0 2024-08-27T02:58:45.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.088+0000 7f6d836ca9c0 20 add_watcher() i=1 2024-08-27T02:58:45.088 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.088+0000 7f6d836ca9c0 20 add_watcher() i=2 2024-08-27T02:58:45.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.088+0000 7f6d836ca9c0 20 add_watcher() i=3 2024-08-27T02:58:45.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.088+0000 7f6d836ca9c0 20 add_watcher() i=4 2024-08-27T02:58:45.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.088+0000 7f6d836ca9c0 20 add_watcher() i=5 2024-08-27T02:58:45.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.088+0000 7f6d836ca9c0 20 add_watcher() i=6 2024-08-27T02:58:45.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.092+0000 7f6d836ca9c0 20 add_watcher() i=7 2024-08-27T02:58:45.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.092+0000 7f6d836ca9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:58:45.095 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:45.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:58:45.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:58:45.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 5 note: GC not initialized 2024-08-27T02:58:45.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6c367e4640 20 reqs_thread_entry: start 2024-08-27T02:58:45.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:58:45.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 20 Filter name: none 2024-08-27T02:58:45.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6ba7fff640 20 reqs_thread_entry: start 2024-08-27T02:58:45.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:58:45.097 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:58:45.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.096+0000 7f6d836ca9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:58:45.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:58:45.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:58:45.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 20 rados->read ofs=0 len=0 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:58:45.100 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:58:45.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:58:45.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:58:45.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:58:45.101 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:58:45.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:58:45.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:58:45.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:58:45.102 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.100+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:58:45.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:58:45.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:58:45.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:58:45.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:58:45.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:58:45.104 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:58:45.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:58:45.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:58:45.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:58:45.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:58:45.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:58:45.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:58:45.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:58:45.106 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.104+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:58:45.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.108+0000 7f6d836ca9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:58:45.107 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.108+0000 7f6d836ca9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:58:45.109 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.108+0000 7f6c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:58:45.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.116+0000 7f6d836ca9c0 20 remove_watcher() i=0 2024-08-27T02:58:45.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.116+0000 7f6d836ca9c0 2 removed watcher, disabling cache 2024-08-27T02:58:45.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.116+0000 7f6d836ca9c0 20 remove_watcher() i=1 2024-08-27T02:58:45.119 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.120+0000 7f6d836ca9c0 20 remove_watcher() i=2 2024-08-27T02:58:45.121 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.120+0000 7f6d836ca9c0 20 remove_watcher() i=3 2024-08-27T02:58:45.124 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.124+0000 7f6d836ca9c0 20 remove_watcher() i=4 2024-08-27T02:58:45.126 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.124+0000 7f6d836ca9c0 20 remove_watcher() i=5 2024-08-27T02:58:45.128 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.128+0000 7f6d836ca9c0 20 remove_watcher() i=6 2024-08-27T02:58:45.129 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:58:45.128+0000 7f6d836ca9c0 20 remove_watcher() i=7 2024-08-27T02:59:15.176 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-08-27T02:59:15.209 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:15.209 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:15.255 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 realm 2024-08-27T02:59:15.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:15.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.258 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.259+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.263+0000 7f4cc8ec99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.263+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.263+0000 7f4cc8ec99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:15.260 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.263+0000 7f4cc8ec99c0 20 searching for the correct realm 2024-08-27T02:59:15.262 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.267+0000 7f4cc69cf640 0 -- 172.21.15.143:0/1632428968 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f4cc001a040 msgr2=0x7f4cc0019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:59:15.269 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.271+0000 7f4cc71d0640 0 -- 172.21.15.143:0/1632428968 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f4cbc015070 msgr2=0x7f4cbc05d5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.281 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 zone default found 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 4 Realm: () 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 zonegroup default 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.283+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.287+0000 7f4cc8ec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.287+0000 7f4cc8ec99c0 20 started sync module instance, tier type = 2024-08-27T02:59:15.283 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.287+0000 7f4cc8ec99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:15.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.299+0000 7f4cc8ec99c0 20 add_watcher() i=0 2024-08-27T02:59:15.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.299+0000 7f4cc8ec99c0 20 add_watcher() i=1 2024-08-27T02:59:15.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.299+0000 7f4cc8ec99c0 20 add_watcher() i=2 2024-08-27T02:59:15.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.299+0000 7f4cc8ec99c0 20 add_watcher() i=3 2024-08-27T02:59:15.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.299+0000 7f4cc8ec99c0 20 add_watcher() i=4 2024-08-27T02:59:15.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.299+0000 7f4cc8ec99c0 20 add_watcher() i=5 2024-08-27T02:59:15.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.299+0000 7f4cc8ec99c0 20 add_watcher() i=6 2024-08-27T02:59:15.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.303+0000 7f4cc8ec99c0 20 add_watcher() i=7 2024-08-27T02:59:15.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.303+0000 7f4cc8ec99c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:15.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.303+0000 7f4b7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:15.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.303+0000 7f4cc8ec99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:15.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.303+0000 7f4cc8ec99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:15.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.303+0000 7f4cc8ec99c0 5 note: GC not initialized 2024-08-27T02:59:15.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4af7fff640 20 reqs_thread_entry: start 2024-08-27T02:59:15.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:15.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 20 Filter name: none 2024-08-27T02:59:15.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4af5ffb640 20 reqs_thread_entry: start 2024-08-27T02:59:15.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:59:15.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:15.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:59:15.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:15.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.307+0000 7f4cc8ec99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:59:15.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.315+0000 7f4b7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:15.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.319+0000 7f4cc8ec99c0 20 remove_watcher() i=0 2024-08-27T02:59:15.316 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.319+0000 7f4cc8ec99c0 2 removed watcher, disabling cache 2024-08-27T02:59:15.318 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.323+0000 7f4cc8ec99c0 20 remove_watcher() i=1 2024-08-27T02:59:15.321 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.323+0000 7f4cc8ec99c0 20 remove_watcher() i=2 2024-08-27T02:59:15.323 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.327+0000 7f4cc8ec99c0 20 remove_watcher() i=3 2024-08-27T02:59:15.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.327+0000 7f4cc8ec99c0 20 remove_watcher() i=4 2024-08-27T02:59:15.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.327+0000 7f4cc8ec99c0 20 remove_watcher() i=5 2024-08-27T02:59:15.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.331+0000 7f4cc8ec99c0 20 remove_watcher() i=6 2024-08-27T02:59:15.328 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.331+0000 7f4cc8ec99c0 20 remove_watcher() i=7 2024-08-27T02:59:15.342 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-08-27T02:59:15.369 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:15.369 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:15.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 realm 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.415+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.419+0000 7fbce194f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.419+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.419+0000 7fbce194f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:15.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.419+0000 7fbce194f9c0 20 searching for the correct realm 2024-08-27T02:59:15.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.423+0000 7fbcdec54640 0 -- 172.21.15.143:0/2346701019 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x56278c483330 msgr2=0x56278c4857f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:59:15.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.431+0000 7fbcdf455640 0 -- 172.21.15.143:0/2346701019 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fbcc8072240 msgr2=0x7fbcc8059260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:15.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:15.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:15.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:15.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:15.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:15.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:15.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 zone default found 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 4 Realm: () 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 zonegroup default 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.439+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.443+0000 7fbce194f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.439 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.443+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.443+0000 7fbce194f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.443+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.443+0000 7fbce194f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.443+0000 7fbce194f9c0 20 started sync module instance, tier type = 2024-08-27T02:59:15.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.443+0000 7fbce194f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:15.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=0 2024-08-27T02:59:15.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=1 2024-08-27T02:59:15.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=2 2024-08-27T02:59:15.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=3 2024-08-27T02:59:15.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=4 2024-08-27T02:59:15.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=5 2024-08-27T02:59:15.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=6 2024-08-27T02:59:15.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 20 add_watcher() i=7 2024-08-27T02:59:15.456 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.459+0000 7fbce194f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:15.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbb95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:15.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:15.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:15.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 5 note: GC not initialized 2024-08-27T02:59:15.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbb94fe1640 20 reqs_thread_entry: start 2024-08-27T02:59:15.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:15.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 Filter name: none 2024-08-27T02:59:15.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbb0e7fc640 20 reqs_thread_entry: start 2024-08-27T02:59:15.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:59:15.461 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:59:15.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:15.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:59:15.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:15.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:15.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:15.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:15.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:15.463 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.463+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:15.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:15.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:15.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:15.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:15.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:15.464 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:15.465 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:15.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:15.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:15.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:15.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:15.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:15.466 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.467+0000 7fbce194f9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:15.468 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.471+0000 7fbb95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:15.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.475+0000 7fbce194f9c0 20 remove_watcher() i=0 2024-08-27T02:59:15.473 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.475+0000 7fbce194f9c0 2 removed watcher, disabling cache 2024-08-27T02:59:15.475 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.479+0000 7fbce194f9c0 20 remove_watcher() i=1 2024-08-27T02:59:15.477 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.479+0000 7fbce194f9c0 20 remove_watcher() i=2 2024-08-27T02:59:15.479 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.483+0000 7fbce194f9c0 20 remove_watcher() i=3 2024-08-27T02:59:15.481 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.483+0000 7fbce194f9c0 20 remove_watcher() i=4 2024-08-27T02:59:15.482 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.483+0000 7fbce194f9c0 20 remove_watcher() i=5 2024-08-27T02:59:15.483 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.487+0000 7fbce194f9c0 20 remove_watcher() i=6 2024-08-27T02:59:15.485 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.487+0000 7fbce194f9c0 20 remove_watcher() i=7 2024-08-27T02:59:15.498 INFO:tasks.workunit.client.0.smithi143.stderr:check reshard logrecord successfully 2024-08-27T02:59:15.498 INFO:tasks.workunit.client.0.smithi143.stderr: test: reshard versioned bucket 2024-08-27T02:59:15.498 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket myver 2024-08-27T02:59:15.524 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:15.525 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:15.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.567+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 realm 2024-08-27T02:59:15.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.568 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:15.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.571+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.575+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:15.571 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.575+0000 7f7561cd89c0 20 searching for the correct realm 2024-08-27T02:59:15.577 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.579+0000 7f755efdd640 0 -- 172.21.15.143:0/3545271454 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f75500f0050 msgr2=0x7f75500cb460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:15.583 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.587+0000 7f755efdd640 0 -- 172.21.15.143:0/3545271454 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f7428081140 msgr2=0x7f7428083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.590 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.591+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 zone default found 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 4 Realm: () 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:15.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 zonegroup default 2024-08-27T02:59:15.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 started sync module instance, tier type = 2024-08-27T02:59:15.593 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.595+0000 7f7561cd89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:15.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=0 2024-08-27T02:59:15.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=1 2024-08-27T02:59:15.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=2 2024-08-27T02:59:15.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=3 2024-08-27T02:59:15.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=4 2024-08-27T02:59:15.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=5 2024-08-27T02:59:15.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=6 2024-08-27T02:59:15.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 20 add_watcher() i=7 2024-08-27T02:59:15.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.611+0000 7f7561cd89c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:15.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 5 note: GC not initialized 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7414fe1640 20 reqs_thread_entry: start 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 Filter name: none 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f738e7fc640 20 reqs_thread_entry: start 2024-08-27T02:59:15.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:15.613 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:15.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:15.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:15.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.615+0000 7f7561cd89c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.619+0000 7f7561cd89c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:15.615 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.619+0000 7f7561cd89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:15.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.619+0000 7f7415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:15.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.627+0000 7f7561cd89c0 20 remove_watcher() i=0 2024-08-27T02:59:15.623 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.627+0000 7f7561cd89c0 2 removed watcher, disabling cache 2024-08-27T02:59:15.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.627+0000 7f7561cd89c0 20 remove_watcher() i=1 2024-08-27T02:59:15.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.631+0000 7f7561cd89c0 20 remove_watcher() i=2 2024-08-27T02:59:15.628 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.631+0000 7f7561cd89c0 20 remove_watcher() i=3 2024-08-27T02:59:15.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.631+0000 7f7561cd89c0 20 remove_watcher() i=4 2024-08-27T02:59:15.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.635+0000 7f7561cd89c0 20 remove_watcher() i=5 2024-08-27T02:59:15.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.635+0000 7f7561cd89c0 20 remove_watcher() i=6 2024-08-27T02:59:15.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.635+0000 7f7561cd89c0 20 remove_watcher() i=7 2024-08-27T02:59:15.647 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:15.647 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:59:15.648 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: myver id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-08-27T02:59:15.648 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:15.648 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-08-27T02:59:15.677 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:15.677 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:15.720 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 realm 2024-08-27T02:59:15.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.722 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:15.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.723+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.727+0000 7f731d2609c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.724 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.727+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.727+0000 7f731d2609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:15.725 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.727+0000 7f731d2609c0 20 searching for the correct realm 2024-08-27T02:59:15.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.735+0000 7f731b567640 0 -- 172.21.15.143:0/2863108376 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f73100c94b0 msgr2=0x7f73100c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:59:15.949 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.951+0000 7f731ad66640 0 -- 172.21.15.143:0/2863108376 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55e296a5b250 msgr2=0x55e296a5d680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:15.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:15.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:15.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:15.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:15.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:15.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:15.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:15.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.959+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 zone default found 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 4 Realm: () 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 zonegroup default 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:15.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 started sync module instance, tier type = 2024-08-27T02:59:15.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.963+0000 7f731d2609c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:15.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.987+0000 7f731d2609c0 20 add_watcher() i=0 2024-08-27T02:59:15.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.987+0000 7f731d2609c0 20 add_watcher() i=1 2024-08-27T02:59:15.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.987+0000 7f731d2609c0 20 add_watcher() i=2 2024-08-27T02:59:15.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.987+0000 7f731d2609c0 20 add_watcher() i=3 2024-08-27T02:59:15.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.987+0000 7f731d2609c0 20 add_watcher() i=4 2024-08-27T02:59:15.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.987+0000 7f731d2609c0 20 add_watcher() i=5 2024-08-27T02:59:15.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.987+0000 7f731d2609c0 20 add_watcher() i=6 2024-08-27T02:59:15.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.991+0000 7f731d2609c0 20 add_watcher() i=7 2024-08-27T02:59:15.988 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.991+0000 7f731d2609c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:15.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f71d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:15.992 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:15.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:15.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 5 note: GC not initialized 2024-08-27T02:59:15.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f714bfff640 20 reqs_thread_entry: start 2024-08-27T02:59:15.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:15.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 20 Filter name: none 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f7149ffb640 20 reqs_thread_entry: start 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : miss 2024-08-27T02:59:15.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.995+0000 7f731d2609c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:15.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.999+0000 7f731d2609c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:15.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.999+0000 7f731d2609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:15.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.999+0000 7f731d2609c0 10 adding default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:15.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.999+0000 7f731d2609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:59:15.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.999+0000 7f731d2609c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:15.996 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:15.999+0000 7f731d2609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:16.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f731d2609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:16.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f731d2609c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:16.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f731d2609c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:16.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f731d2609c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:16.008 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f71fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94431678462688 notifier 7532 bl.length()=821 2024-08-27T02:59:16.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f71fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:16.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f71fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:16.009 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.011+0000 7f71fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:16.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.015+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:16.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.015+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:16.011 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.015+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:16.012 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.015+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.0 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.0 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.1 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.1 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.2 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.2 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.3 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.3 2024-08-27T02:59:16.023 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.4 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.4 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.5 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.5 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.6 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.6 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.7 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.7 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.8 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.8 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.9 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.9 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.10 2024-08-27T02:59:16.024 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.10 2024-08-27T02:59:16.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.11 2024-08-27T02:59:16.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.11 2024-08-27T02:59:16.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.0 2024-08-27T02:59:16.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1 2024-08-27T02:59:16.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2 2024-08-27T02:59:16.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3 2024-08-27T02:59:16.026 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.027+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.4 2024-08-27T02:59:16.027 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.031+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.5 2024-08-27T02:59:16.028 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.031+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.6 2024-08-27T02:59:16.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.031+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.7 2024-08-27T02:59:16.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.031+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.8 2024-08-27T02:59:16.029 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.031+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.9 2024-08-27T02:59:16.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.035+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.10 2024-08-27T02:59:16.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.035+0000 7f731d2609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:16.033 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.035+0000 7f731d2609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:16.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:16.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:16.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:16.036 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:16.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f71fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94431678462688 notifier 7532 bl.length()=821 2024-08-27T02:59:16.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f71fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:16.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f71fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:16.037 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f71fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:16.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:16.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:16.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:16.038 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.039+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:16.043 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.047+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.0 2024-08-27T02:59:16.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.047+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1 2024-08-27T02:59:16.044 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.047+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2 2024-08-27T02:59:16.045 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.047+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3 2024-08-27T02:59:16.046 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.047+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.4 2024-08-27T02:59:16.047 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.051+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.5 2024-08-27T02:59:16.048 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.051+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.6 2024-08-27T02:59:16.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.051+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.7 2024-08-27T02:59:16.049 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.051+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.8 2024-08-27T02:59:16.050 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.051+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.9 2024-08-27T02:59:16.051 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.055+0000 7f731d2609c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.10 2024-08-27T02:59:16.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.055+0000 7f731d2609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:16.052 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.055+0000 7f731d2609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:16.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.055+0000 7f731d2609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:16.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.055+0000 7f731d2609c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:16.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.055+0000 7f731d2609c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:16.054 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.055+0000 7f731d2609c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:16.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f71fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94431678462688 notifier 7532 bl.length()=789 2024-08-27T02:59:16.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f71fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:16.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f71fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:16.055 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f71fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:16.057 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:16.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:16.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:16.058 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.059+0000 7f731d2609c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:16.062 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.063+0000 7f731d2609c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-08-27T02:59:16.066 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.067+0000 7f71d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:16.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.075+0000 7f731d2609c0 20 remove_watcher() i=0 2024-08-27T02:59:16.071 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.075+0000 7f731d2609c0 2 removed watcher, disabling cache 2024-08-27T02:59:16.074 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.075+0000 7f731d2609c0 20 remove_watcher() i=1 2024-08-27T02:59:16.076 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.079+0000 7f731d2609c0 20 remove_watcher() i=2 2024-08-27T02:59:16.078 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.079+0000 7f731d2609c0 20 remove_watcher() i=3 2024-08-27T02:59:16.080 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.083+0000 7f731d2609c0 20 remove_watcher() i=4 2024-08-27T02:59:16.082 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.083+0000 7f731d2609c0 20 remove_watcher() i=5 2024-08-27T02:59:16.083 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.087+0000 7f731d2609c0 20 remove_watcher() i=6 2024-08-27T02:59:16.084 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.087+0000 7f731d2609c0 20 remove_watcher() i=7 2024-08-27T02:59:16.102 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket myver 2024-08-27T02:59:16.131 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:16.131 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:16.371 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.375+0000 7fc7b7b7f640 0 --2- 172.21.15.143:0/1469085799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558445e53780 0x558445e53c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-27T02:59:16.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.387+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:16.388 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 20 realm 2024-08-27T02:59:16.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:16.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:16.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:16.389 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.391+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.395+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:16.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.395+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.395+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:16.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.395+0000 7fc7b98789c0 20 searching for the correct realm 2024-08-27T02:59:16.392 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.395+0000 7fc7b6b7d640 0 -- 172.21.15.143:0/2426149458 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x558445ec4d00 msgr2=0x558445ec70f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:16.398 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.399+0000 7fc7b6b7d640 0 -- 172.21.15.143:0/2426149458 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x7fc680081170 msgr2=0x7fc6800835a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:16.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.414 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 zone default found 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 4 Realm: () 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 zonegroup default 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:16.415 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.415+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.419+0000 7fc7b98789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:16.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.419+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.419+0000 7fc7b98789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:16.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.419+0000 7fc7b98789c0 20 started sync module instance, tier type = 2024-08-27T02:59:16.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.419+0000 7fc7b98789c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:16.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=0 2024-08-27T02:59:16.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=1 2024-08-27T02:59:16.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=2 2024-08-27T02:59:16.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=3 2024-08-27T02:59:16.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=4 2024-08-27T02:59:16.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=5 2024-08-27T02:59:16.432 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=6 2024-08-27T02:59:16.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 20 add_watcher() i=7 2024-08-27T02:59:16.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.435+0000 7fc7b98789c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc66dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:16.436 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 5 note: GC not initialized 2024-08-27T02:59:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc66cfe1640 20 reqs_thread_entry: start 2024-08-27T02:59:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:16.437 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 20 Filter name: none 2024-08-27T02:59:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc5e67fc640 20 reqs_thread_entry: start 2024-08-27T02:59:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:16.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.439+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.443+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.443+0000 7fc7b98789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.443+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.443+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:16.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.443+0000 7fc7b98789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:16.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.443+0000 7fc7b98789c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:16.441 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.443+0000 7fc7b98789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:16.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.447+0000 7fc66dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:16.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.451+0000 7fc7b98789c0 20 remove_watcher() i=0 2024-08-27T02:59:16.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.451+0000 7fc7b98789c0 2 removed watcher, disabling cache 2024-08-27T02:59:16.451 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.455+0000 7fc7b98789c0 20 remove_watcher() i=1 2024-08-27T02:59:16.453 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.455+0000 7fc7b98789c0 20 remove_watcher() i=2 2024-08-27T02:59:16.455 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.459+0000 7fc7b98789c0 20 remove_watcher() i=3 2024-08-27T02:59:16.457 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.459+0000 7fc7b98789c0 20 remove_watcher() i=4 2024-08-27T02:59:16.459 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.463+0000 7fc7b98789c0 20 remove_watcher() i=5 2024-08-27T02:59:16.460 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.463+0000 7fc7b98789c0 20 remove_watcher() i=6 2024-08-27T02:59:16.462 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:16.463+0000 7fc7b98789c0 20 remove_watcher() i=7 2024-08-27T02:59:16.477 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:16.477 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:59:16.477 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: myver id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-08-27T02:59:16.477 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:16.587 INFO:tasks.workunit.client.0.smithi143.stderr: test: reshard removes olh entries with empty name 2024-08-27T02:59:17.430 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-08-27T02:59:17.463 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:17.463 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:17.509 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.511+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 realm 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:17.512 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:17.513 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:17.514 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.515+0000 7f1fc9f569c0 20 searching for the correct realm 2024-08-27T02:59:17.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.519+0000 7f1fc7a5c640 0 -- 172.21.15.143:0/592748706 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f1fc0077020 msgr2=0x7f1fc00882b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:17.731 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.735+0000 7f1fc825d640 0 -- 172.21.15.143:0/592748706 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f1fb00c4400 msgr2=0x7f1fb00c4840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:17.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:17.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:17.749 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 zone default found 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 4 Realm: () 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 zonegroup default 2024-08-27T02:59:17.750 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:17.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.751+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.751 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.755+0000 7f1fc9f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:17.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.755+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.755+0000 7f1fc9f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:17.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.755+0000 7f1fc9f569c0 20 started sync module instance, tier type = 2024-08-27T02:59:17.752 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.755+0000 7f1fc9f569c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:17.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=0 2024-08-27T02:59:17.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=1 2024-08-27T02:59:17.775 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=2 2024-08-27T02:59:17.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=3 2024-08-27T02:59:17.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=4 2024-08-27T02:59:17.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=5 2024-08-27T02:59:17.776 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=6 2024-08-27T02:59:17.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 20 add_watcher() i=7 2024-08-27T02:59:17.777 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.779+0000 7f1fc9f569c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:17.782 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.783+0000 7f1e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:17.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:17.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:17.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 5 note: GC not initialized 2024-08-27T02:59:17.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1e7cfe1640 20 reqs_thread_entry: start 2024-08-27T02:59:17.783 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:17.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 Filter name: none 2024-08-27T02:59:17.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1df67fc640 20 reqs_thread_entry: start 2024-08-27T02:59:17.784 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:17.785 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.787+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:59:17.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.791+0000 7f1fc9f569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:17.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.791+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.791+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:17.787 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.791+0000 7f1fc9f569c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:17.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.791+0000 7f1fc9f569c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:59:17.788 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.791+0000 7f1fc9f569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:17.792 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.795+0000 7f1e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:17.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.799+0000 7f1fc9f569c0 20 remove_watcher() i=0 2024-08-27T02:59:17.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.799+0000 7f1fc9f569c0 2 removed watcher, disabling cache 2024-08-27T02:59:17.799 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.803+0000 7f1fc9f569c0 20 remove_watcher() i=1 2024-08-27T02:59:17.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.803+0000 7f1fc9f569c0 20 remove_watcher() i=2 2024-08-27T02:59:17.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.807+0000 7f1fc9f569c0 20 remove_watcher() i=3 2024-08-27T02:59:17.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.811+0000 7f1fc9f569c0 20 remove_watcher() i=4 2024-08-27T02:59:17.808 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.811+0000 7f1fc9f569c0 20 remove_watcher() i=5 2024-08-27T02:59:17.809 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.811+0000 7f1fc9f569c0 20 remove_watcher() i=6 2024-08-27T02:59:17.811 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:17.815+0000 7f1fc9f569c0 20 remove_watcher() i=7 2024-08-27T02:59:17.828 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:17.828 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:59:17.828 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: a-bucket id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-08-27T02:59:17.828 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:17.828 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-08-27T02:59:17.857 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:17.857 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:18.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.110 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 realm 2024-08-27T02:59:18.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:18.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.111 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.111+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.115+0000 7f1986c5b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:18.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.115+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.115+0000 7f1986c5b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:18.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.115+0000 7f1986c5b9c0 20 searching for the correct realm 2024-08-27T02:59:18.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.119+0000 7f1983f60640 0 -- 172.21.15.143:0/3382894698 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f197403c070 msgr2=0x7f1974003970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:18.126 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.127+0000 7f1984761640 0 -- 172.21.15.143:0/3382894698 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f197805a920 msgr2=0x7f197807d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:59:18.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.347+0000 7f1986c5b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:18.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.347+0000 7f1986c5b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:18.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.347+0000 7f1986c5b9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:18.346 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.347+0000 7f1986c5b9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:18.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.347+0000 7f1986c5b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:18.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.347+0000 7f1986c5b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:18.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.347+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.347 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:18.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 zone default found 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 4 Realm: () 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 zonegroup default 2024-08-27T02:59:18.349 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.350 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.351+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.355+0000 7f1986c5b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.355+0000 7f1986c5b9c0 20 started sync module instance, tier type = 2024-08-27T02:59:18.351 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.355+0000 7f1986c5b9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:18.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.375+0000 7f1986c5b9c0 20 add_watcher() i=0 2024-08-27T02:59:18.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.375+0000 7f1986c5b9c0 20 add_watcher() i=1 2024-08-27T02:59:18.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.375+0000 7f1986c5b9c0 20 add_watcher() i=2 2024-08-27T02:59:18.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.375+0000 7f1986c5b9c0 20 add_watcher() i=3 2024-08-27T02:59:18.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.375+0000 7f1986c5b9c0 20 add_watcher() i=4 2024-08-27T02:59:18.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.375+0000 7f1986c5b9c0 20 add_watcher() i=5 2024-08-27T02:59:18.375 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.375+0000 7f1986c5b9c0 20 add_watcher() i=6 2024-08-27T02:59:18.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.379+0000 7f1986c5b9c0 20 add_watcher() i=7 2024-08-27T02:59:18.377 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.379+0000 7f1986c5b9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:18.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.383+0000 7f183afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:18.381 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.383+0000 7f1986c5b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:18.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.383+0000 7f1986c5b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:18.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.383+0000 7f1986c5b9c0 5 note: GC not initialized 2024-08-27T02:59:18.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.383+0000 7f1839fdb640 20 reqs_thread_entry: start 2024-08-27T02:59:18.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.383+0000 7f1986c5b9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:18.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.383+0000 7f1986c5b9c0 20 Filter name: none 2024-08-27T02:59:18.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.387+0000 7f17ab7fe640 20 reqs_thread_entry: start 2024-08-27T02:59:18.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.387+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.387+0000 7f1986c5b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:18.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.387+0000 7f1986c5b9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.387+0000 7f1986c5b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:59:18.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.387+0000 7f1986c5b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:18.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.387+0000 7f183afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:18.390 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.395+0000 7f1986c5b9c0 20 remove_watcher() i=0 2024-08-27T02:59:18.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.395+0000 7f1986c5b9c0 2 removed watcher, disabling cache 2024-08-27T02:59:18.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.395+0000 7f1986c5b9c0 20 remove_watcher() i=1 2024-08-27T02:59:18.395 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.399+0000 7f1986c5b9c0 20 remove_watcher() i=2 2024-08-27T02:59:18.397 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.399+0000 7f1986c5b9c0 20 remove_watcher() i=3 2024-08-27T02:59:18.399 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.403+0000 7f1986c5b9c0 20 remove_watcher() i=4 2024-08-27T02:59:18.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.403+0000 7f1986c5b9c0 20 remove_watcher() i=5 2024-08-27T02:59:18.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.403+0000 7f1986c5b9c0 20 remove_watcher() i=6 2024-08-27T02:59:18.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.407+0000 7f1986c5b9c0 20 remove_watcher() i=7 2024-08-27T02:59:18.418 INFO:tasks.workunit.client.0.smithi143.stderr:rados -p default.rgw.buckets.index setomapval .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-08-27T02:59:18.446 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:18.446 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:18.466 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket a-bucket 2024-08-27T02:59:18.492 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:18.492 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:18.739 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 realm 2024-08-27T02:59:18.741 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:18.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:18.742 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.743+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.747+0000 7f1d386499c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:18.743 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.747+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:18.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.747+0000 7f1d386499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:18.744 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.747+0000 7f1d386499c0 20 searching for the correct realm 2024-08-27T02:59:18.748 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.751+0000 7f1d3594e640 0 -- 172.21.15.143:0/1296866390 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f1d280abbb0 msgr2=0x7f1d280ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:18.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:18.967+0000 7f1d3614f640 0 -- 172.21.15.143:0/1296866390 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f1d2c063ba0 msgr2=0x7f1d2c085130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:19.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:19.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:19.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:19.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:19.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:19.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:19.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:19.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.183+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:19.183 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 zone default found 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 4 Realm: () 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 zonegroup default 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 started sync module instance, tier type = 2024-08-27T02:59:19.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.187+0000 7f1d386499c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:19.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.211+0000 7f1d386499c0 20 add_watcher() i=0 2024-08-27T02:59:19.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.211+0000 7f1d386499c0 20 add_watcher() i=1 2024-08-27T02:59:19.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.211+0000 7f1d386499c0 20 add_watcher() i=2 2024-08-27T02:59:19.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.211+0000 7f1d386499c0 20 add_watcher() i=3 2024-08-27T02:59:19.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.211+0000 7f1d386499c0 20 add_watcher() i=4 2024-08-27T02:59:19.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.211+0000 7f1d386499c0 20 add_watcher() i=5 2024-08-27T02:59:19.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.211+0000 7f1d386499c0 20 add_watcher() i=6 2024-08-27T02:59:19.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.215+0000 7f1d386499c0 20 add_watcher() i=7 2024-08-27T02:59:19.211 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.215+0000 7f1d386499c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:19.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1becfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:19.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:19.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 5 note: GC not initialized 2024-08-27T02:59:19.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1b677fe640 20 reqs_thread_entry: start 2024-08-27T02:59:19.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:19.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 Filter name: none 2024-08-27T02:59:19.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1b657fa640 20 reqs_thread_entry: start 2024-08-27T02:59:19.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:19.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:59:19.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:19.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-08-27T02:59:19.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 INFO: main: starting shard=0 2024-08-27T02:59:19.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:19.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.219+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:19.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:59:19.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: starting shard=1 2024-08-27T02:59:19.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:19.219 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:19.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: starting shard=2 2024-08-27T02:59:19.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:19.220 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:19.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: starting shard=3 2024-08-27T02:59:19.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:19.221 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:19.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: starting shard=4 2024-08-27T02:59:19.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:19.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:19.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 INFO: main: starting shard=5 2024-08-27T02:59:19.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:19.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.223+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:19.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: starting shard=6 2024-08-27T02:59:19.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:19.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:19.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: starting shard=7 2024-08-27T02:59:19.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:19.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:19.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: starting shard=8 2024-08-27T02:59:19.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:19.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:19.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: starting shard=9 2024-08-27T02:59:19.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:19.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:19.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: starting shard=10 2024-08-27T02:59:19.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:19.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:19.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: starting shard=11 2024-08-27T02:59:19.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:19.226 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:19.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 INFO: main: starting shard=12 2024-08-27T02:59:19.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:19.227 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.227+0000 7f1d386499c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:19.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.231+0000 7f1d386499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.228 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.231+0000 7f1d386499c0 20 INFO: main: done 2024-08-27T02:59:19.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.231+0000 7f1becfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.235+0000 7f1d386499c0 20 remove_watcher() i=0 2024-08-27T02:59:19.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.235+0000 7f1d386499c0 2 removed watcher, disabling cache 2024-08-27T02:59:19.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.239+0000 7f1d386499c0 20 remove_watcher() i=1 2024-08-27T02:59:19.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.243+0000 7f1d386499c0 20 remove_watcher() i=2 2024-08-27T02:59:19.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.243+0000 7f1d386499c0 20 remove_watcher() i=3 2024-08-27T02:59:19.243 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.247+0000 7f1d386499c0 20 remove_watcher() i=4 2024-08-27T02:59:19.244 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.247+0000 7f1d386499c0 20 remove_watcher() i=5 2024-08-27T02:59:19.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.247+0000 7f1d386499c0 20 remove_watcher() i=6 2024-08-27T02:59:19.247 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.251+0000 7f1d386499c0 20 remove_watcher() i=7 2024-08-27T02:59:19.264 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-08-27T02:59:19.295 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:19.295 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:19.338 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.339+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 realm 2024-08-27T02:59:19.339 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:19.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.340 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:19.341 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:19.342 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.343+0000 7fa0fda5d9c0 20 searching for the correct realm 2024-08-27T02:59:19.348 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.351+0000 7fa0fad62640 0 -- 172.21.15.143:0/3757673167 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55c72e7c7e30 msgr2=0x55c72e7ca2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:19.354 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.355+0000 7fa0fb563640 0 -- 172.21.15.143:0/3757673167 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fa0f0051920 msgr2=0x7fa0f0031400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:19.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:19.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:19.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:19.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:19.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:19.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:19.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:19.363 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 zone default found 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 4 Realm: () 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 zonegroup default 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.363+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.367+0000 7fa0fda5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.367+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.367+0000 7fa0fda5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.364 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.367+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.367+0000 7fa0fda5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.367+0000 7fa0fda5d9c0 20 started sync module instance, tier type = 2024-08-27T02:59:19.365 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.367+0000 7fa0fda5d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:19.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=0 2024-08-27T02:59:19.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=1 2024-08-27T02:59:19.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=2 2024-08-27T02:59:19.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=3 2024-08-27T02:59:19.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=4 2024-08-27T02:59:19.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=5 2024-08-27T02:59:19.379 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=6 2024-08-27T02:59:19.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 20 add_watcher() i=7 2024-08-27T02:59:19.380 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7fa0fda5d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:19.382 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.383+0000 7f9fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:19.383 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:19.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 5 note: GC not initialized 2024-08-27T02:59:19.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7f9fb0fe1640 20 reqs_thread_entry: start 2024-08-27T02:59:19.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:19.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 Filter name: none 2024-08-27T02:59:19.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7f9f2a7fc640 20 reqs_thread_entry: start 2024-08-27T02:59:19.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-08-27T02:59:19.384 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : miss 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:19.385 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:59:19.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:19.386 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.387+0000 7fa0fda5d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7f9fde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366282 cookie 94313966831136 notifier 8064 bl.length()=827 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7f9fde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7f9fde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:19.391 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7f9fde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:19.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:59:19.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:59:19.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:59:19.393 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.395+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:59:19.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:59:19.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:59:19.400 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:19.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:19.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-08-27T02:59:19.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:19.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:19.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:19.401 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.403+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:19.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:19.402 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:19.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:19.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:19.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:19.403 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:19.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:19.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:19.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:19.404 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:19.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:19.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:19.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:19.405 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:19.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:19.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:19.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:19.406 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.407+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:19.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:19.407 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:19.408 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:19.408 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:59:19.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:19.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:19.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:19.410 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.411+0000 7fa0fda5d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:59:19.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7f9fdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366283 cookie 94313966831136 notifier 8064 bl.length()=827 2024-08-27T02:59:19.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7f9fdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:19.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7f9fdeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:19.411 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7f9fdeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:19.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:59:19.412 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:59:19.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:59:19.413 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.415+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:59:19.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:19.416 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.0 2024-08-27T02:59:19.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:19.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.1 2024-08-27T02:59:19.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:19.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.2 2024-08-27T02:59:19.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:19.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.3 2024-08-27T02:59:19.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:19.418 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.419+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.4 2024-08-27T02:59:19.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:19.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.5 2024-08-27T02:59:19.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:19.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.6 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.7 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.8 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.9 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:19.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.10 2024-08-27T02:59:19.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:19.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.11 2024-08-27T02:59:19.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:19.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.2.12 2024-08-27T02:59:19.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:19.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.423+0000 7fa0fda5d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 2024-08-27T02:59:19.424 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7fa0fda5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:19.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7fa0fda5d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:19.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7fa0fda5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:19.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7fa0fda5d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17, ofs0, ns] 2024-08-27T02:59:19.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7f9fde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366284 cookie 94313966831136 notifier 8064 bl.length()=795 2024-08-27T02:59:19.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7f9fde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 info.flags=0x17 2024-08-27T02:59:19.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7f9fde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17 to cache LRU end 2024-08-27T02:59:19.425 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.427+0000 7f9fde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:19.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.431+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_sources= new_sources= 2024-08-27T02:59:19.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.431+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential sources added=[] removed=[] 2024-08-27T02:59:19.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.431+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): orig_dests= new_dests= 2024-08-27T02:59:19.427 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.431+0000 7fa0fda5d9c0 20 handle_bi_update(): bucket=:a-bucket[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17]): potential dests added=[] removed=[] 2024-08-27T02:59:19.430 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.431+0000 7fa0fda5d9c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-08-27T02:59:19.433 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.435+0000 7f9fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.439+0000 7fa0fda5d9c0 20 remove_watcher() i=0 2024-08-27T02:59:19.438 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.439+0000 7fa0fda5d9c0 2 removed watcher, disabling cache 2024-08-27T02:59:19.440 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.443+0000 7fa0fda5d9c0 20 remove_watcher() i=1 2024-08-27T02:59:19.442 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.443+0000 7fa0fda5d9c0 20 remove_watcher() i=2 2024-08-27T02:59:19.444 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.447+0000 7fa0fda5d9c0 20 remove_watcher() i=3 2024-08-27T02:59:19.446 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.447+0000 7fa0fda5d9c0 20 remove_watcher() i=4 2024-08-27T02:59:19.447 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.451+0000 7fa0fda5d9c0 20 remove_watcher() i=5 2024-08-27T02:59:19.449 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.451+0000 7fa0fda5d9c0 20 remove_watcher() i=6 2024-08-27T02:59:19.450 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.451+0000 7fa0fda5d9c0 20 remove_watcher() i=7 2024-08-27T02:59:19.463 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket a-bucket 2024-08-27T02:59:19.491 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:19.491 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:19.532 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.533 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 realm 2024-08-27T02:59:19.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:19.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.534 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.535+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.539+0000 7fb61a1d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:19.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.539+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.539+0000 7fb61a1d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:19.540 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.539+0000 7fb61a1d59c0 20 searching for the correct realm 2024-08-27T02:59:19.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.547+0000 7fb6184dc640 0 -- 172.21.15.143:0/2179071217 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fb60c046040 msgr2=0x7fb60c047940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:19.760 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.763+0000 7fb617cdb640 0 -- 172.21.15.143:0/2179071217 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x5643f0a77a50 msgr2=0x5643f0a79f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:19.767 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.768 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:19.769 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 zone default found 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 4 Realm: () 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 zonegroup default 2024-08-27T02:59:19.770 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.771+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.775+0000 7fb61a1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.771 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.775+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.775+0000 7fb61a1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.775+0000 7fb61a1d59c0 20 started sync module instance, tier type = 2024-08-27T02:59:19.772 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.775+0000 7fb61a1d59c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:19.794 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.795+0000 7fb61a1d59c0 20 add_watcher() i=0 2024-08-27T02:59:19.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.795+0000 7fb61a1d59c0 20 add_watcher() i=1 2024-08-27T02:59:19.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.795+0000 7fb61a1d59c0 20 add_watcher() i=2 2024-08-27T02:59:19.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.795+0000 7fb61a1d59c0 20 add_watcher() i=3 2024-08-27T02:59:19.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.795+0000 7fb61a1d59c0 20 add_watcher() i=4 2024-08-27T02:59:19.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.795+0000 7fb61a1d59c0 20 add_watcher() i=5 2024-08-27T02:59:19.795 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.795+0000 7fb61a1d59c0 20 add_watcher() i=6 2024-08-27T02:59:19.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.799+0000 7fb61a1d59c0 20 add_watcher() i=7 2024-08-27T02:59:19.797 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.799+0000 7fb61a1d59c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:19.801 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.803+0000 7fb4cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.803+0000 7fb61a1d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:19.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.803+0000 7fb61a1d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:19.802 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.803+0000 7fb61a1d59c0 5 note: GC not initialized 2024-08-27T02:59:19.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.803+0000 7fb4ccfe1640 20 reqs_thread_entry: start 2024-08-27T02:59:19.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:19.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 Filter name: none 2024-08-27T02:59:19.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb4467fc640 20 reqs_thread_entry: start 2024-08-27T02:59:19.803 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 rados_obj.operate() r=0 bl.length=176 2024-08-27T02:59:19.804 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 rados_obj.operate() r=0 bl.length=398 2024-08-27T02:59:19.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:19.805 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-08-27T02:59:19.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 INFO: main: starting shard=0 2024-08-27T02:59:19.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:59:19.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17.3.0 2024-08-27T02:59:19.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:19.806 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.807+0000 7fb61a1d59c0 20 INFO: main: done 2024-08-27T02:59:19.807 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.811+0000 7fb4cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.815+0000 7fb61a1d59c0 20 remove_watcher() i=0 2024-08-27T02:59:19.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.815+0000 7fb61a1d59c0 2 removed watcher, disabling cache 2024-08-27T02:59:19.815 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.819+0000 7fb61a1d59c0 20 remove_watcher() i=1 2024-08-27T02:59:19.818 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.819+0000 7fb61a1d59c0 20 remove_watcher() i=2 2024-08-27T02:59:19.820 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.823+0000 7fb61a1d59c0 20 remove_watcher() i=3 2024-08-27T02:59:19.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.823+0000 7fb61a1d59c0 20 remove_watcher() i=4 2024-08-27T02:59:19.824 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.827+0000 7fb61a1d59c0 20 remove_watcher() i=5 2024-08-27T02:59:19.826 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.827+0000 7fb61a1d59c0 20 remove_watcher() i=6 2024-08-27T02:59:19.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.831+0000 7fb61a1d59c0 20 remove_watcher() i=7 2024-08-27T02:59:19.848 INFO:tasks.workunit.client.0.smithi143.stderr: test: PUT succeeds during reshard 2024-08-27T02:59:19.849 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket myver 2024-08-27T02:59:19.877 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:19.877 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:19.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 realm 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.927+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.931+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:19.928 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.931+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.931+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:19.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.931+0000 7f6ac8a229c0 20 searching for the correct realm 2024-08-27T02:59:19.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.935+0000 7f6ac6528640 0 -- 172.21.15.143:0/1603127687 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7f6ab0003cc0 msgr2=0x7f6ac0016400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:19.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.943+0000 7f6ac6d29640 0 -- 172.21.15.143:0/1603127687 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f6abc039020 msgr2=0x7f6abc06fa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:19.951 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 zone default found 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 4 Realm: () 2024-08-27T02:59:19.952 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 zonegroup default 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.951+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.955+0000 7f6ac8a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.955+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.955+0000 7f6ac8a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.955+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.953 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.955+0000 7f6ac8a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:19.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.955+0000 7f6ac8a229c0 20 started sync module instance, tier type = 2024-08-27T02:59:19.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.955+0000 7f6ac8a229c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:19.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.975+0000 7f6ac8a229c0 20 add_watcher() i=0 2024-08-27T02:59:19.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.975+0000 7f6ac8a229c0 20 add_watcher() i=1 2024-08-27T02:59:19.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.975+0000 7f6ac8a229c0 20 add_watcher() i=2 2024-08-27T02:59:19.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.975+0000 7f6ac8a229c0 20 add_watcher() i=3 2024-08-27T02:59:19.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.975+0000 7f6ac8a229c0 20 add_watcher() i=4 2024-08-27T02:59:19.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.975+0000 7f6ac8a229c0 20 add_watcher() i=5 2024-08-27T02:59:19.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.975+0000 7f6ac8a229c0 20 add_watcher() i=6 2024-08-27T02:59:19.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.979+0000 7f6ac8a229c0 20 add_watcher() i=7 2024-08-27T02:59:19.975 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.979+0000 7f6ac8a229c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:19.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.979+0000 7f697cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.979+0000 7f6ac8a229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:19.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.979+0000 7f6ac8a229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:19.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.979+0000 7f6ac8a229c0 5 note: GC not initialized 2024-08-27T02:59:19.979 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.979+0000 7f68f77fe640 20 reqs_thread_entry: start 2024-08-27T02:59:19.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:19.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 Filter name: none 2024-08-27T02:59:19.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f68f57fa640 20 reqs_thread_entry: start 2024-08-27T02:59:19.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:19.980 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:19.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:19.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:19.981 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:19.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:19.982 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.983+0000 7f6ac8a229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:19.985 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.987+0000 7f697cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:19.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.991+0000 7f6ac8a229c0 20 remove_watcher() i=0 2024-08-27T02:59:19.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.991+0000 7f6ac8a229c0 2 removed watcher, disabling cache 2024-08-27T02:59:19.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.995+0000 7f6ac8a229c0 20 remove_watcher() i=1 2024-08-27T02:59:19.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.995+0000 7f6ac8a229c0 20 remove_watcher() i=2 2024-08-27T02:59:19.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.999+0000 7f6ac8a229c0 20 remove_watcher() i=3 2024-08-27T02:59:19.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:19.999+0000 7f6ac8a229c0 20 remove_watcher() i=4 2024-08-27T02:59:19.999 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.003+0000 7f6ac8a229c0 20 remove_watcher() i=5 2024-08-27T02:59:20.000 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.003+0000 7f6ac8a229c0 20 remove_watcher() i=6 2024-08-27T02:59:20.001 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.003+0000 7f6ac8a229c0 20 remove_watcher() i=7 2024-08-27T02:59:20.015 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:20.015 INFO:tasks.workunit.client.0.smithi143.stderr:BUCKET_STATS: 2024-08-27T02:59:20.015 INFO:tasks.workunit.client.0.smithi143.stderr:bucket: myver id: 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-08-27T02:59:20.015 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:20.016 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-08-27T02:59:20.046 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:20.046 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:20.089 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.091+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.090 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.091+0000 7fec0cbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:20.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.091+0000 7fec0cbc69c0 20 realm 2024-08-27T02:59:20.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.091+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:20.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:20.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:20.091 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:20.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:20.093 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.095+0000 7fec0cbc69c0 20 searching for the correct realm 2024-08-27T02:59:20.099 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.103+0000 7fec0aecd640 0 -- 172.21.15.143:0/3618900161 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55acc74bcfb0 msgr2=0x55acc74bf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:20.105 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.107+0000 7fec09ecb640 0 -- 172.21.15.143:0/3618900161 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7febfc04c070 msgr2=0x7febfc072930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:20.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:20.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:20.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:20.112 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:20.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:20.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:20.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:20.113 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.114 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 zone default found 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 4 Realm: () 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 zonegroup default 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:20.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.115+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.119+0000 7fec0cbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:20.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.119+0000 7fec0cbc69c0 20 started sync module instance, tier type = 2024-08-27T02:59:20.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.119+0000 7fec0cbc69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:20.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.131+0000 7fec0cbc69c0 20 add_watcher() i=0 2024-08-27T02:59:20.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.131+0000 7fec0cbc69c0 20 add_watcher() i=1 2024-08-27T02:59:20.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.131+0000 7fec0cbc69c0 20 add_watcher() i=2 2024-08-27T02:59:20.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.131+0000 7fec0cbc69c0 20 add_watcher() i=3 2024-08-27T02:59:20.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.131+0000 7fec0cbc69c0 20 add_watcher() i=4 2024-08-27T02:59:20.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.131+0000 7fec0cbc69c0 20 add_watcher() i=5 2024-08-27T02:59:20.130 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.131+0000 7fec0cbc69c0 20 add_watcher() i=6 2024-08-27T02:59:20.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7fec0cbc69c0 20 add_watcher() i=7 2024-08-27T02:59:20.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7fec0cbc69c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:20.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7feac0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:20.134 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7fec0cbc69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7fec0cbc69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7fec0cbc69c0 5 note: GC not initialized 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7fea3b7fe640 20 reqs_thread_entry: start 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.135+0000 7fec0cbc69c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 20 Filter name: none 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fea397fa640 20 reqs_thread_entry: start 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-27T02:59:20.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:20.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-27T02:59:20.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-27T02:59:20.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : miss 2024-08-27T02:59:20.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:20.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:20.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:20.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 adding default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:20.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:59:20.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:20.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.139+0000 7fec0cbc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:20.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:20.147 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:20.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:20.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:20.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7feaed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94200566437584 notifier 7664 bl.length()=821 2024-08-27T02:59:20.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7feaed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:20.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7feaed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:20.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7feaed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:20.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:20.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:20.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:20.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.151+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:20.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:20.163+0000 7fec0cbc69c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-08-27T02:59:21.174 INFO:tasks.workunit.client.0.smithi143.stderr:put object successful 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:25.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:25.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.0 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.0 2024-08-27T02:59:25.163 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.1 2024-08-27T02:59:25.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.163+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.1 2024-08-27T02:59:25.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.167+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.2 2024-08-27T02:59:25.164 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.167+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.2 2024-08-27T02:59:25.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.167+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.3 2024-08-27T02:59:25.165 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.167+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.3 2024-08-27T02:59:25.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.167+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.4 2024-08-27T02:59:25.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.167+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.4 2024-08-27T02:59:25.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.171+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.5 2024-08-27T02:59:25.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.171+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.5 2024-08-27T02:59:25.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.171+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.6 2024-08-27T02:59:25.170 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.171+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.6 2024-08-27T02:59:25.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.175+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.7 2024-08-27T02:59:25.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.175+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.7 2024-08-27T02:59:25.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.175+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.8 2024-08-27T02:59:25.173 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.175+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.8 2024-08-27T02:59:25.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.175+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.9 2024-08-27T02:59:25.174 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.175+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.9 2024-08-27T02:59:25.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.179+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.10 2024-08-27T02:59:25.175 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.179+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.10 2024-08-27T02:59:25.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.179+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.11 2024-08-27T02:59:25.176 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.179+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.11 2024-08-27T02:59:25.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.183+0000 7fec0cbc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:25.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.183+0000 7fec0cbc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:25.184 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7fec0cbc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:25.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7fec0cbc69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:25.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7fec0cbc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:25.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7fec0cbc69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:25.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7feaed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94200566437584 notifier 7664 bl.length()=821 2024-08-27T02:59:25.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7feaed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:25.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7feaed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:25.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.187+0000 7feaed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:25.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.191+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:25.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.191+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:25.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.191+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:25.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.191+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:25.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.199+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.0 2024-08-27T02:59:25.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.199+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.0 2024-08-27T02:59:25.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.199+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.1 2024-08-27T02:59:25.197 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.199+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.1 2024-08-27T02:59:25.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.199+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.2 2024-08-27T02:59:25.198 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.199+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.2 2024-08-27T02:59:25.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.3 2024-08-27T02:59:25.199 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.3 2024-08-27T02:59:25.200 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.4 2024-08-27T02:59:25.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.4 2024-08-27T02:59:25.201 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.5 2024-08-27T02:59:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.5 2024-08-27T02:59:25.202 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.6 2024-08-27T02:59:25.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.203+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.6 2024-08-27T02:59:25.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.7 2024-08-27T02:59:25.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.7 2024-08-27T02:59:25.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.8 2024-08-27T02:59:25.204 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.8 2024-08-27T02:59:25.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.9 2024-08-27T02:59:25.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.9 2024-08-27T02:59:25.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.10 2024-08-27T02:59:25.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.207+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.10 2024-08-27T02:59:25.207 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.211+0000 7fec0cbc69c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.11 2024-08-27T02:59:25.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.211+0000 7fec0cbc69c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.1.11 2024-08-27T02:59:25.213 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.215+0000 7fec0cbc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:25.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.215+0000 7fec0cbc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:25.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7fec0cbc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:25.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7fec0cbc69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:25.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7fec0cbc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:25.217 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7fec0cbc69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:25.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7feaed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94200566437584 notifier 7664 bl.length()=789 2024-08-27T02:59:25.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7feaed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:25.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7feaed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:25.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.219+0000 7feaed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:25.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.223+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:25.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.223+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:25.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.223+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:25.222 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.223+0000 7fec0cbc69c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:25.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.231+0000 7fec0cbc69c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-08-27T02:59:25.234 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.235+0000 7feac0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:25.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.243+0000 7fec0cbc69c0 20 remove_watcher() i=0 2024-08-27T02:59:25.240 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.243+0000 7fec0cbc69c0 2 removed watcher, disabling cache 2024-08-27T02:59:25.242 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.243+0000 7fec0cbc69c0 20 remove_watcher() i=1 2024-08-27T02:59:25.246 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.247+0000 7fec0cbc69c0 20 remove_watcher() i=2 2024-08-27T02:59:25.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.251+0000 7fec0cbc69c0 20 remove_watcher() i=3 2024-08-27T02:59:25.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.255+0000 7fec0cbc69c0 20 remove_watcher() i=4 2024-08-27T02:59:25.254 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.255+0000 7fec0cbc69c0 20 remove_watcher() i=5 2024-08-27T02:59:25.257 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.259+0000 7fec0cbc69c0 20 remove_watcher() i=6 2024-08-27T02:59:25.259 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:25.263+0000 7fec0cbc69c0 20 remove_watcher() i=7 2024-08-27T02:59:26.179 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-08-27T02:59:26.179 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T02:59:27.067 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-27T02:59:27.522 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-08-27T02:59:29.124 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:59:29.124 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket myver --object x 2024-08-27T02:59:29.161 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:29.161 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:29.417 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.419+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:29.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 realm 2024-08-27T02:59:29.419 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:29.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:29.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:29.420 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:29.421 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:29.422 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.423+0000 7fa06d5969c0 20 searching for the correct realm 2024-08-27T02:59:29.428 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.431+0000 7fa06b89d640 0 -- 172.21.15.143:0/281239033 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fa06001a040 msgr2=0x7fa0600095e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:29.435 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.439+0000 7fa06b09c640 0 -- 172.21.15.143:0/281239033 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fa060045db0 msgr2=0x7fa06000f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:29.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.655+0000 7fa06d5969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:29.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.655+0000 7fa06d5969c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:29.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.655+0000 7fa06d5969c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:29.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.655+0000 7fa06d5969c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:29.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.655+0000 7fa06d5969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:29.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.655+0000 7fa06d5969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:29.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.655+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:29.655 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:29.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 zone default found 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 4 Realm: () 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 zonegroup default 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:29.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:29.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.659+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.663+0000 7fa06d5969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:29.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.663+0000 7fa06d5969c0 20 started sync module instance, tier type = 2024-08-27T02:59:29.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.663+0000 7fa06d5969c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:29.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=0 2024-08-27T02:59:29.687 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=1 2024-08-27T02:59:29.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=2 2024-08-27T02:59:29.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=3 2024-08-27T02:59:29.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=4 2024-08-27T02:59:29.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=5 2024-08-27T02:59:29.688 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=6 2024-08-27T02:59:29.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 20 add_watcher() i=7 2024-08-27T02:59:29.690 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.691+0000 7fa06d5969c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:29.694 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.695+0000 7f9f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:29.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:29.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:29.695 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 5 note: GC not initialized 2024-08-27T02:59:29.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7f9f20fe1640 20 reqs_thread_entry: start 2024-08-27T02:59:29.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:29.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 20 Filter name: none 2024-08-27T02:59:29.696 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7f9e9a7fc640 20 reqs_thread_entry: start 2024-08-27T02:59:29.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:29.697 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.699+0000 7fa06d5969c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:29.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:29.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:29.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-08-27T02:59:29.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 INFO: main: starting shard=0 2024-08-27T02:59:29.699 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:29.700 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:29.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 INFO: main: starting shard=1 2024-08-27T02:59:29.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:29.701 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:29.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 INFO: main: starting shard=2 2024-08-27T02:59:29.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:29.702 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.703+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:29.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: starting shard=3 2024-08-27T02:59:29.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:29.703 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:29.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: starting shard=4 2024-08-27T02:59:29.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:29.704 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:29.705 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: starting shard=5 2024-08-27T02:59:29.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:29.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:29.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:59:29.706 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 INFO: main: starting shard=6 2024-08-27T02:59:29.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:29.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.707+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:29.707 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 INFO: main: starting shard=7 2024-08-27T02:59:29.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:29.708 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:29.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 INFO: main: starting shard=8 2024-08-27T02:59:29.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:29.709 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:29.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 INFO: main: starting shard=9 2024-08-27T02:59:29.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:29.710 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.711+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:29.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 INFO: main: starting shard=10 2024-08-27T02:59:29.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:29.711 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:29.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 INFO: main: starting shard=11 2024-08-27T02:59:29.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:29.713 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:29.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 INFO: main: starting shard=12 2024-08-27T02:59:29.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:29.714 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.715+0000 7fa06d5969c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:29.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.719+0000 7fa06d5969c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:29.715 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.719+0000 7fa06d5969c0 20 INFO: main: done 2024-08-27T02:59:29.716 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.719+0000 7f9f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:29.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.723+0000 7fa06d5969c0 20 remove_watcher() i=0 2024-08-27T02:59:29.721 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.723+0000 7fa06d5969c0 2 removed watcher, disabling cache 2024-08-27T02:59:29.723 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.727+0000 7fa06d5969c0 20 remove_watcher() i=1 2024-08-27T02:59:29.726 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.727+0000 7fa06d5969c0 20 remove_watcher() i=2 2024-08-27T02:59:29.728 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.731+0000 7fa06d5969c0 20 remove_watcher() i=3 2024-08-27T02:59:29.730 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.731+0000 7fa06d5969c0 20 remove_watcher() i=4 2024-08-27T02:59:29.732 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.735+0000 7fa06d5969c0 20 remove_watcher() i=5 2024-08-27T02:59:29.733 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.735+0000 7fa06d5969c0 20 remove_watcher() i=6 2024-08-27T02:59:29.734 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:29.735+0000 7fa06d5969c0 20 remove_watcher() i=7 2024-08-27T02:59:29.932 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:59:29.932 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket myver --object y 2024-08-27T02:59:29.969 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:29.969 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:30.014 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.015+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 realm 2024-08-27T02:59:30.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:30.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.016 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.017 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:30.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:30.018 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.019+0000 7f62e53759c0 20 searching for the correct realm 2024-08-27T02:59:30.025 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.027+0000 7f62e367c640 0 -- 172.21.15.143:0/3624100937 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f62d80f1410 msgr2=0x7f62d80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:59:30.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.243+0000 7f62e2e7b640 0 -- 172.21.15.143:0/3624100937 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x5643731e4d50 msgr2=0x5643731e7140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:30.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:30.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:30.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:30.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:30.248 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:30.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:30.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.249 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:30.250 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 zone default found 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 4 Realm: () 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.251+0000 7f62e53759c0 20 zonegroup default 2024-08-27T02:59:30.251 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.252 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 started sync module instance, tier type = 2024-08-27T02:59:30.253 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.255+0000 7f62e53759c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:30.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=0 2024-08-27T02:59:30.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=1 2024-08-27T02:59:30.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=2 2024-08-27T02:59:30.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=3 2024-08-27T02:59:30.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=4 2024-08-27T02:59:30.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=5 2024-08-27T02:59:30.280 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=6 2024-08-27T02:59:30.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 20 add_watcher() i=7 2024-08-27T02:59:30.282 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.283+0000 7f62e53759c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:30.286 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.287+0000 7f61997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:30.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:30.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:30.287 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 5 note: GC not initialized 2024-08-27T02:59:30.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f6113fff640 20 reqs_thread_entry: start 2024-08-27T02:59:30.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:30.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 Filter name: none 2024-08-27T02:59:30.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f6111ffb640 20 reqs_thread_entry: start 2024-08-27T02:59:30.288 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:30.289 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:30.290 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:30.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-08-27T02:59:30.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 INFO: main: starting shard=0 2024-08-27T02:59:30.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:30.291 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.291+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:30.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: starting shard=1 2024-08-27T02:59:30.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:30.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:30.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.292 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: starting shard=2 2024-08-27T02:59:30.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:30.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:30.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: starting shard=3 2024-08-27T02:59:30.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:30.293 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:30.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.294 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 INFO: main: starting shard=4 2024-08-27T02:59:30.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:30.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.295+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:30.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 INFO: main: starting shard=5 2024-08-27T02:59:30.295 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:30.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:30.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 INFO: main: starting shard=6 2024-08-27T02:59:30.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:30.296 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:30.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 INFO: main: starting shard=7 2024-08-27T02:59:30.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:30.298 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.299+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:30.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 INFO: main: starting shard=8 2024-08-27T02:59:30.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:30.299 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:30.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 INFO: main: starting shard=9 2024-08-27T02:59:30.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:30.300 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:30.301 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:59:30.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 INFO: main: starting shard=10 2024-08-27T02:59:30.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:30.302 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.303+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:30.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 INFO: main: starting shard=11 2024-08-27T02:59:30.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:30.303 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:30.304 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 INFO: main: starting shard=12 2024-08-27T02:59:30.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:30.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:30.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.305 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.307+0000 7f62e53759c0 20 INFO: main: done 2024-08-27T02:59:30.307 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.311+0000 7f61997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:30.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.315+0000 7f62e53759c0 20 remove_watcher() i=0 2024-08-27T02:59:30.312 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.315+0000 7f62e53759c0 2 removed watcher, disabling cache 2024-08-27T02:59:30.315 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.319+0000 7f62e53759c0 20 remove_watcher() i=1 2024-08-27T02:59:30.317 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.319+0000 7f62e53759c0 20 remove_watcher() i=2 2024-08-27T02:59:30.322 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.323+0000 7f62e53759c0 20 remove_watcher() i=3 2024-08-27T02:59:30.324 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.327+0000 7f62e53759c0 20 remove_watcher() i=4 2024-08-27T02:59:30.326 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.327+0000 7f62e53759c0 20 remove_watcher() i=5 2024-08-27T02:59:30.327 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.331+0000 7f62e53759c0 20 remove_watcher() i=6 2024-08-27T02:59:30.329 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.331+0000 7f62e53759c0 20 remove_watcher() i=7 2024-08-27T02:59:30.500 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T02:59:30.500 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket myver --object z 2024-08-27T02:59:30.537 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:30.537 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:30.582 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.583+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 realm 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:30.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:30.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.587+0000 7fa5110f79c0 20 searching for the correct realm 2024-08-27T02:59:30.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.595+0000 7fa50f3fe640 0 -- 172.21.15.143:0/189646398 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fa4f8072740 msgr2=0x7fa4f806c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:30.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.599+0000 7fa50f3fe640 0 -- 172.21.15.143:0/189646398 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55b5d32cfa50 msgr2=0x55b5d32d1ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T02:59:30.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:30.607 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:30.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:30.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:30.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:30.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:30.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.608 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 zone default found 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 4 Realm: () 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:30.609 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:30.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 zonegroup default 2024-08-27T02:59:30.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:30.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 started sync module instance, tier type = 2024-08-27T02:59:30.611 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.611+0000 7fa5110f79c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:30.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=0 2024-08-27T02:59:30.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=1 2024-08-27T02:59:30.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=2 2024-08-27T02:59:30.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=3 2024-08-27T02:59:30.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=4 2024-08-27T02:59:30.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=5 2024-08-27T02:59:30.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=6 2024-08-27T02:59:30.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 20 add_watcher() i=7 2024-08-27T02:59:30.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.627+0000 7fa5110f79c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:30.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa3c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 5 note: GC not initialized 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa33ffff640 20 reqs_thread_entry: start 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 20 Filter name: none 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa33dffb640 20 reqs_thread_entry: start 2024-08-27T02:59:30.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:30.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.631+0000 7fa5110f79c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:30.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:30.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:30.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-08-27T02:59:30.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: starting shard=0 2024-08-27T02:59:30.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:30.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: starting shard=1 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: starting shard=2 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:30.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:30.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: starting shard=3 2024-08-27T02:59:30.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:30.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:30.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 INFO: main: starting shard=4 2024-08-27T02:59:30.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:30.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.635+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:30.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 INFO: main: starting shard=5 2024-08-27T02:59:30.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:30.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:30.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 INFO: main: starting shard=6 2024-08-27T02:59:30.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:30.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:30.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 INFO: main: starting shard=7 2024-08-27T02:59:30.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:30.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.639+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:30.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 INFO: main: starting shard=8 2024-08-27T02:59:30.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:30.639 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:30.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 INFO: main: starting shard=9 2024-08-27T02:59:30.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:30.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:30.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 INFO: main: starting shard=10 2024-08-27T02:59:30.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:30.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.643+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:30.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 INFO: main: starting shard=11 2024-08-27T02:59:30.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:30.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:30.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 INFO: main: starting shard=12 2024-08-27T02:59:30.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:30.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:30.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T02:59:30.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa5110f79c0 20 INFO: main: done 2024-08-27T02:59:30.646 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.647+0000 7fa3c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:30.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.655+0000 7fa5110f79c0 20 remove_watcher() i=0 2024-08-27T02:59:30.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.655+0000 7fa5110f79c0 2 removed watcher, disabling cache 2024-08-27T02:59:30.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.655+0000 7fa5110f79c0 20 remove_watcher() i=1 2024-08-27T02:59:30.656 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.659+0000 7fa5110f79c0 20 remove_watcher() i=2 2024-08-27T02:59:30.658 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.659+0000 7fa5110f79c0 20 remove_watcher() i=3 2024-08-27T02:59:30.660 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.663+0000 7fa5110f79c0 20 remove_watcher() i=4 2024-08-27T02:59:30.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.663+0000 7fa5110f79c0 20 remove_watcher() i=5 2024-08-27T02:59:30.663 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.667+0000 7fa5110f79c0 20 remove_watcher() i=6 2024-08-27T02:59:30.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:30.667+0000 7fa5110f79c0 20 remove_watcher() i=7 2024-08-27T02:59:30.707 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-27T02:59:31.134 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-08-27T02:59:31.554 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-08-27T02:59:31.587 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:31.587 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:31.625 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.627+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 realm 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:31.627 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:31.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.629 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:31.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.631+0000 7f85788769c0 20 searching for the correct realm 2024-08-27T02:59:31.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.639+0000 7f8576b7d640 0 -- 172.21.15.143:0/605366388 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f856c082a10 msgr2=0x7f856c065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:31.853 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.855+0000 7f857637c640 0 -- 172.21.15.143:0/605366388 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55b28ee5be60 msgr2=0x55b28ee5e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:31.860 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:31.861 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:31.862 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.863+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 zone default found 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 4 Realm: () 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 zonegroup default 2024-08-27T02:59:31.863 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:31.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:31.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:31.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 started sync module instance, tier type = 2024-08-27T02:59:31.865 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.867+0000 7f85788769c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:31.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.887+0000 7f85788769c0 20 add_watcher() i=0 2024-08-27T02:59:31.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.887+0000 7f85788769c0 20 add_watcher() i=1 2024-08-27T02:59:31.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.887+0000 7f85788769c0 20 add_watcher() i=2 2024-08-27T02:59:31.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.887+0000 7f85788769c0 20 add_watcher() i=3 2024-08-27T02:59:31.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.887+0000 7f85788769c0 20 add_watcher() i=4 2024-08-27T02:59:31.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.887+0000 7f85788769c0 20 add_watcher() i=5 2024-08-27T02:59:31.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.887+0000 7f85788769c0 20 add_watcher() i=6 2024-08-27T02:59:31.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.891+0000 7f85788769c0 20 add_watcher() i=7 2024-08-27T02:59:31.887 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.891+0000 7f85788769c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:31.891 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f842cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:31.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:31.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:31.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 5 note: GC not initialized 2024-08-27T02:59:31.892 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f83a77fe640 20 reqs_thread_entry: start 2024-08-27T02:59:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 Filter name: none 2024-08-27T02:59:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f83a57fa640 20 reqs_thread_entry: start 2024-08-27T02:59:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-27T02:59:31.893 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:31.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-27T02:59:31.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-27T02:59:31.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : miss 2024-08-27T02:59:31.894 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:31.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:31.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:31.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 adding default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:31.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:59:31.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:31.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.895+0000 7f85788769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f85788769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f85788769c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f85788769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f85788769c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:31.908 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f84597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94225390009824 notifier 7760 bl.length()=821 2024-08-27T02:59:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f84597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f84597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:31.909 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.911+0000 7f84597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:31.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.915+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:31.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.915+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:31.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.915+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:31.911 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.915+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:31.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.0 2024-08-27T02:59:31.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.0 2024-08-27T02:59:31.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.1 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.1 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.2 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.2 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.3 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.3 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.4 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.4 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.5 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.5 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.6 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.6 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.7 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.7 2024-08-27T02:59:31.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.8 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.8 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.10 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.10 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.11 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.11 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.12 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.12 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.13 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.13 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.14 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.14 2024-08-27T02:59:31.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.15 2024-08-27T02:59:31.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.15 2024-08-27T02:59:31.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.16 2024-08-27T02:59:31.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.16 2024-08-27T02:59:31.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:31.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:31.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:31.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:31.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:31.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:31.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:31.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.927+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:31.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.931+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:31.927 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.931+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:31.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.931+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:31.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.931+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:31.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.931+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:31.929 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.931+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:31.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.935+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:31.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.935+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:31.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.935+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:31.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.935+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:31.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.935+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:31.933 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.935+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:31.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.939+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:31.935 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.939+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:31.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.939+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:31.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.939+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.939+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:31.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.939+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:31.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.943+0000 7f85788769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:31.942 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.943+0000 7f85788769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:31.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f85788769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:31.945 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f85788769c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f85788769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f85788769c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f84597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 94225390009824 notifier 7760 bl.length()=821 2024-08-27T02:59:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f84597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f84597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:31.946 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.947+0000 7f84597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:31.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.951+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:31.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.951+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:31.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.951+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:31.948 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.951+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:31.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.955+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:31.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.955+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.0 2024-08-27T02:59:31.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.955+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:31.954 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.955+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.1 2024-08-27T02:59:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.2 2024-08-27T02:59:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:31.955 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.3 2024-08-27T02:59:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.4 2024-08-27T02:59:31.956 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.5 2024-08-27T02:59:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:31.957 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.6 2024-08-27T02:59:31.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:31.958 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.959+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.7 2024-08-27T02:59:31.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:31.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.8 2024-08-27T02:59:31.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:31.959 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.9 2024-08-27T02:59:31.960 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:31.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.10 2024-08-27T02:59:31.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:31.961 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.11 2024-08-27T02:59:31.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:31.962 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.963+0000 7f85788769c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.2.12 2024-08-27T02:59:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f85788769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : hit (requested=0x17, cached=0x17) 2024-08-27T02:59:31.963 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f85788769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:31.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f85788769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:31.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f85788769c0 10 moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:31.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f85788769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:31.966 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f85788769c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18, ofs0, ns] 2024-08-27T02:59:31.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f8459ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94225390009824 notifier 7760 bl.length()=789 2024-08-27T02:59:31.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f8459ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:31.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f8459ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:31.967 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.967+0000 7f8459ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:31.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.971+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_sources= new_sources= 2024-08-27T02:59:31.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.971+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential sources added=[] removed=[] 2024-08-27T02:59:31.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.971+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): orig_dests= new_dests= 2024-08-27T02:59:31.969 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.971+0000 7f85788769c0 20 handle_bi_update(): bucket=:myver[3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18]): potential dests added=[] removed=[] 2024-08-27T02:59:31.974 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.975+0000 7f85788769c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-08-27T02:59:31.978 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.979+0000 7f842cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:31.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.987+0000 7f85788769c0 20 remove_watcher() i=0 2024-08-27T02:59:31.984 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.987+0000 7f85788769c0 2 removed watcher, disabling cache 2024-08-27T02:59:31.986 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.987+0000 7f85788769c0 20 remove_watcher() i=1 2024-08-27T02:59:31.989 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.991+0000 7f85788769c0 20 remove_watcher() i=2 2024-08-27T02:59:31.991 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.995+0000 7f85788769c0 20 remove_watcher() i=3 2024-08-27T02:59:31.993 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.995+0000 7f85788769c0 20 remove_watcher() i=4 2024-08-27T02:59:31.994 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.995+0000 7f85788769c0 20 remove_watcher() i=5 2024-08-27T02:59:31.995 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.999+0000 7f85788769c0 20 remove_watcher() i=6 2024-08-27T02:59:31.997 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:31.999+0000 7f85788769c0 20 remove_watcher() i=7 2024-08-27T02:59:32.012 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-08-27T02:59:32.048 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:32.048 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:32.092 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 realm 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.094 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.095+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.099+0000 7fc777ed19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:32.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.099+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.099+0000 7fc777ed19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:32.096 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.099+0000 7fc777ed19c0 20 searching for the correct realm 2024-08-27T02:59:32.103 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.107+0000 7fc7751d6640 0 -- 172.21.15.143:0/332029813 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc7680d1040 msgr2=0x7fc76811d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:32.108 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.111+0000 7fc7751d6640 0 -- 172.21.15.143:0/332029813 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fc640081140 msgr2=0x7fc640083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.115+0000 7fc777ed19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.115+0000 7fc777ed19c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.115+0000 7fc777ed19c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.115+0000 7fc777ed19c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.115+0000 7fc777ed19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.115+0000 7fc777ed19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.115+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.115 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:32.116 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 zone default found 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 4 Realm: () 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 zonegroup default 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.117 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 started sync module instance, tier type = 2024-08-27T02:59:32.118 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.119+0000 7fc777ed19c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:32.131 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=0 2024-08-27T02:59:32.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=1 2024-08-27T02:59:32.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=2 2024-08-27T02:59:32.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=3 2024-08-27T02:59:32.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=4 2024-08-27T02:59:32.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=5 2024-08-27T02:59:32.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=6 2024-08-27T02:59:32.132 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 20 add_watcher() i=7 2024-08-27T02:59:32.133 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.135+0000 7fc777ed19c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:32.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc62bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:32.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:32.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:32.135 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 5 note: GC not initialized 2024-08-27T02:59:32.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc62afe5640 20 reqs_thread_entry: start 2024-08-27T02:59:32.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:32.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 Filter name: none 2024-08-27T02:59:32.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc628fe1640 20 reqs_thread_entry: start 2024-08-27T02:59:32.136 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-08-27T02:59:32.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:32.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-08-27T02:59:32.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-08-27T02:59:32.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 : miss 2024-08-27T02:59:32.137 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:32.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 info.flags=0x17 2024-08-27T02:59:32.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 adding default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 to cache LRU end 2024-08-27T02:59:32.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T02:59:32.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-08-27T02:59:32.138 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.0 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.0 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.1 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.1 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.2 2024-08-27T02:59:32.139 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.139+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.2 2024-08-27T02:59:32.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-08-27T02:59:32.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.3 2024-08-27T02:59:32.140 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.3 2024-08-27T02:59:32.141 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-08-27T02:59:32.141 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.4 2024-08-27T02:59:32.141 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.4 2024-08-27T02:59:32.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-08-27T02:59:32.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.5 2024-08-27T02:59:32.142 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.143+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.5 2024-08-27T02:59:32.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-08-27T02:59:32.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.6 2024-08-27T02:59:32.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.6 2024-08-27T02:59:32.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-08-27T02:59:32.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.7 2024-08-27T02:59:32.143 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.7 2024-08-27T02:59:32.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-08-27T02:59:32.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.8 2024-08-27T02:59:32.145 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.8 2024-08-27T02:59:32.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-08-27T02:59:32.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.10 2024-08-27T02:59:32.146 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.147+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.10 2024-08-27T02:59:32.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-08-27T02:59:32.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.11 2024-08-27T02:59:32.148 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.11 2024-08-27T02:59:32.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-08-27T02:59:32.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.12 2024-08-27T02:59:32.149 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.12 2024-08-27T02:59:32.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-08-27T02:59:32.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.13 2024-08-27T02:59:32.150 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.151+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.13 2024-08-27T02:59:32.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-08-27T02:59:32.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.14 2024-08-27T02:59:32.152 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.14 2024-08-27T02:59:32.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-08-27T02:59:32.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.15 2024-08-27T02:59:32.153 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.15 2024-08-27T02:59:32.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-08-27T02:59:32.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 10 bucket_obj is .dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.16 2024-08-27T02:59:32.154 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.16 2024-08-27T02:59:32.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-08-27T02:59:32.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.155+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.159+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:x state=0x55dc3a512ca8 s->prefetch_data=0 2024-08-27T02:59:32.155 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.159+0000 7fc777ed19c0 20 get_obj_state: setting s->obj_tag to 95fj1flbfqvemk03uw14880tmge6ygq2 2024-08-27T02:59:32.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.159+0000 7fc777ed19c0 20 get_obj_state_impl: setting s->olh_tag to zh9fjs46qovp73kih2ylyh321caujsi9 2024-08-27T02:59:32.156 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.159+0000 7fc777ed19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zh9fjs46qovp73kih2ylyh321caujsi9 2024-08-27T02:59:32.159 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.160 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-08-27T02:59:32.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 olh_log_entry: epoch=2 op=3 key=x[ET4uIUArbWSubDsMmHPor8PXvOSqt06] 2024-08-27T02:59:32.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:_:ET4uIUArbWSubDsMmHPor8PXvOSqt06_x state=0x55dc3a541568 s->prefetch_data=0 2024-08-27T02:59:32.161 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 10 manifest: total_size = 9 2024-08-27T02:59:32.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12438034670497107730 2024-08-27T02:59:32.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:_:ET4uIUArbWSubDsMmHPor8PXvOSqt06_x state=0x55dc3a541568 s->prefetch_data=0 2024-08-27T02:59:32.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 prepare_atomic_modification: state is not atomic. state=0x55dc3a541568 2024-08-27T02:59:32.162 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.163+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.167+0000 7fc777ed19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:59:32.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.167+0000 7fc777ed19c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-08-27T02:59:32.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.167+0000 7fc777ed19c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:59:32.166 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.167+0000 7fc777ed19c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18__shadow:ET4uIUArbWSubDsMmHPor8PXvOSqt06_.TDIl7VGaW_ESYL7G9aBswgXmM-I3PEa_0 2024-08-27T02:59:32.167 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.171+0000 7fc6597fa640 20 handle_completion(): completion ok for obj=x[ET4uIUArbWSubDsMmHPor8PXvOSqt06] 2024-08-27T02:59:32.168 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.171+0000 7fc777ed19c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:59:32.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.175+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:x state=0x55dc3a512ca8 s->prefetch_data=0 2024-08-27T02:59:32.171 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.175+0000 7fc777ed19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zh9fjs46qovp73kih2ylyh321caujsi9 2024-08-27T02:59:32.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.183+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.183+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.180 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.183+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.183+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:y state=0x55dc3a512ca8 s->prefetch_data=0 2024-08-27T02:59:32.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.183+0000 7fc777ed19c0 20 get_obj_state: setting s->obj_tag to cl12i8dla1nqeyyzjzke01k9c41d7f4b 2024-08-27T02:59:32.181 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.183+0000 7fc777ed19c0 20 get_obj_state_impl: setting s->olh_tag to 2ptmiirjxwxt0bwlki8n3y81jz1e423z 2024-08-27T02:59:32.182 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.183+0000 7fc777ed19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2ptmiirjxwxt0bwlki8n3y81jz1e423z 2024-08-27T02:59:32.185 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.187+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.187+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.186 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.187+0000 7fc777ed19c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-08-27T02:59:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.187+0000 7fc777ed19c0 20 olh_log_entry: epoch=2 op=3 key=y[Tc2Ueqb.JUfZkTztySIMaGvVZfY6sFu] 2024-08-27T02:59:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.187+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:_:Tc2Ueqb.JUfZkTztySIMaGvVZfY6sFu_y state=0x55dc3a541568 s->prefetch_data=0 2024-08-27T02:59:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.187+0000 7fc777ed19c0 10 manifest: total_size = 12 2024-08-27T02:59:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.187+0000 7fc777ed19c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13184752614462711516 2024-08-27T02:59:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.191+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:_:Tc2Ueqb.JUfZkTztySIMaGvVZfY6sFu_y state=0x55dc3a541568 s->prefetch_data=0 2024-08-27T02:59:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.191+0000 7fc777ed19c0 20 prepare_atomic_modification: state is not atomic. state=0x55dc3a541568 2024-08-27T02:59:32.187 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.191+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.191+0000 7fc777ed19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:59:32.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.191+0000 7fc777ed19c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-08-27T02:59:32.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.191+0000 7fc777ed19c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:59:32.190 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.191+0000 7fc777ed19c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18__shadow:Tc2Ueqb.JUfZkTztySIMaGvVZfY6sFu_.9igu113RVJcBQNZi74-bIDymhGdnxq6_0 2024-08-27T02:59:32.191 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.195+0000 7fc6597fa640 20 handle_completion(): completion ok for obj=y[Tc2Ueqb.JUfZkTztySIMaGvVZfY6sFu] 2024-08-27T02:59:32.192 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.195+0000 7fc777ed19c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:59:32.195 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.199+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:y state=0x55dc3a512ca8 s->prefetch_data=0 2024-08-27T02:59:32.196 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.199+0000 7fc777ed19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2ptmiirjxwxt0bwlki8n3y81jz1e423z 2024-08-27T02:59:32.203 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.207+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.207+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.207+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.205 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.207+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:z state=0x55dc3a512ca8 s->prefetch_data=0 2024-08-27T02:59:32.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.207+0000 7fc777ed19c0 20 get_obj_state: setting s->obj_tag to zvj2nwq1qszfzpm28zbhh2ulecfvw3t7 2024-08-27T02:59:32.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.207+0000 7fc777ed19c0 20 get_obj_state_impl: setting s->olh_tag to 7d59u2ib3ux5zbz6isqabez86d4gpl4e 2024-08-27T02:59:32.206 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.207+0000 7fc777ed19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7d59u2ib3ux5zbz6isqabez86d4gpl4e 2024-08-27T02:59:32.208 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.209 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-08-27T02:59:32.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 olh_log_entry: epoch=2 op=3 key=z[FrmytlkCJGWy.yCD.mJuJ88aseRMHe0] 2024-08-27T02:59:32.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:_:FrmytlkCJGWy.yCD.mJuJ88aseRMHe0_z state=0x55dc3a541568 s->prefetch_data=0 2024-08-27T02:59:32.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 10 manifest: total_size = 22 2024-08-27T02:59:32.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 get_obj_state: setting s->obj_tag to 3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14902977057902718974 2024-08-27T02:59:32.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:_:FrmytlkCJGWy.yCD.mJuJ88aseRMHe0_z state=0x55dc3a541568 s->prefetch_data=0 2024-08-27T02:59:32.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 prepare_atomic_modification: state is not atomic. state=0x55dc3a541568 2024-08-27T02:59:32.210 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.211+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.215+0000 7fc777ed19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-08-27T02:59:32.214 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.215+0000 7fc777ed19c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-08-27T02:59:32.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.215+0000 7fc777ed19c0 0 deleting objects inline since gc isn't initialized 2024-08-27T02:59:32.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.215+0000 7fc777ed19c0 5 delete_objs_inline: removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18__shadow:FrmytlkCJGWy.yCD.mJuJ88aseRMHe0_.FeVayN5eSv6eZdkLXAKaT3WORfEmiMw_0 2024-08-27T02:59:32.215 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.215+0000 7fc6597fa640 20 handle_completion(): completion ok for obj=z[FrmytlkCJGWy.yCD.mJuJ88aseRMHe0] 2024-08-27T02:59:32.216 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.219+0000 7fc777ed19c0 5 delete_objs_inline: refcount put returned error -2 2024-08-27T02:59:32.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.219+0000 7fc777ed19c0 20 get_obj_state: octx=0x55dc3a269d70 obj=myver:z state=0x55dc3a512ca8 s->prefetch_data=0 2024-08-27T02:59:32.218 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.219+0000 7fc777ed19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7d59u2ib3ux5zbz6isqabez86d4gpl4e 2024-08-27T02:59:32.223 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.227+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.227+0000 7fc777ed19c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18.3.9 2024-08-27T02:59:32.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.227+0000 7fc777ed19c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-08-27T02:59:32.224 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.227+0000 7fc777ed19c0 1 NOTICE: finished all shards (3 entries removed) 2024-08-27T02:59:32.225 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.227+0000 7fc62bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:32.229 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.231+0000 7fc777ed19c0 20 remove_watcher() i=0 2024-08-27T02:59:32.230 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.231+0000 7fc777ed19c0 2 removed watcher, disabling cache 2024-08-27T02:59:32.231 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.235+0000 7fc777ed19c0 20 remove_watcher() i=1 2024-08-27T02:59:32.233 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.235+0000 7fc777ed19c0 20 remove_watcher() i=2 2024-08-27T02:59:32.235 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.239+0000 7fc777ed19c0 20 remove_watcher() i=3 2024-08-27T02:59:32.237 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.239+0000 7fc777ed19c0 20 remove_watcher() i=4 2024-08-27T02:59:32.238 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.239+0000 7fc777ed19c0 20 remove_watcher() i=5 2024-08-27T02:59:32.239 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.243+0000 7fc777ed19c0 20 remove_watcher() i=6 2024-08-27T02:59:32.241 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.243+0000 7fc777ed19c0 20 remove_watcher() i=7 2024-08-27T02:59:32.508 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket stats --bucket myver 2024-08-27T02:59:32.540 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:32.540 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:32.584 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.587+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.587+0000 7f872282f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.586 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.587+0000 7f872282f9c0 20 realm 2024-08-27T02:59:32.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.587+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.587+0000 7f872282f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.587+0000 7f872282f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:32.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.587+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.591+0000 7f872282f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.591+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.591+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:32.588 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.591+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.591+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:32.589 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.591+0000 7f872282f9c0 20 searching for the correct realm 2024-08-27T02:59:32.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.599+0000 7f8720b36640 0 -- 172.21.15.143:0/1268525943 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f871412c0c0 msgr2=0x7f87140d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:32.813 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.815+0000 7f8720335640 0 -- 172.21.15.143:0/1268525943 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x562ccbd7b420 msgr2=0x562ccbd7d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.821 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:32.822 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.823+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 zone default found 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 4 Realm: () 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 zonegroup default 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.827 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:32.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 started sync module instance, tier type = 2024-08-27T02:59:32.828 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.827+0000 7f872282f9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:32.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=0 2024-08-27T02:59:32.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=1 2024-08-27T02:59:32.848 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=2 2024-08-27T02:59:32.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=3 2024-08-27T02:59:32.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=4 2024-08-27T02:59:32.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=5 2024-08-27T02:59:32.849 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=6 2024-08-27T02:59:32.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 20 add_watcher() i=7 2024-08-27T02:59:32.850 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.851+0000 7f872282f9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:32.854 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.855+0000 7f85d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:32.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:32.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:32.855 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 5 note: GC not initialized 2024-08-27T02:59:32.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f85d5fdb640 20 reqs_thread_entry: start 2024-08-27T02:59:32.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:32.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 Filter name: none 2024-08-27T02:59:32.856 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f85477fe640 20 reqs_thread_entry: start 2024-08-27T02:59:32.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:32.857 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:32.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:32.858 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-08-27T02:59:32.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.859+0000 7f872282f9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:32.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.863+0000 7f872282f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-08-27T02:59:32.859 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.863+0000 7f872282f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T02:59:32.864 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.867+0000 7f85d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:32.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.871+0000 7f872282f9c0 20 remove_watcher() i=0 2024-08-27T02:59:32.869 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.871+0000 7f872282f9c0 2 removed watcher, disabling cache 2024-08-27T02:59:32.871 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.875+0000 7f872282f9c0 20 remove_watcher() i=1 2024-08-27T02:59:32.873 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.875+0000 7f872282f9c0 20 remove_watcher() i=2 2024-08-27T02:59:32.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.879+0000 7f872282f9c0 20 remove_watcher() i=3 2024-08-27T02:59:32.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.879+0000 7f872282f9c0 20 remove_watcher() i=4 2024-08-27T02:59:32.878 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.879+0000 7f872282f9c0 20 remove_watcher() i=5 2024-08-27T02:59:32.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.883+0000 7f872282f9c0 20 remove_watcher() i=6 2024-08-27T02:59:32.881 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T02:59:32.883+0000 7f872282f9c0 20 remove_watcher() i=7 2024-08-27T02:59:32.897 INFO:tasks.workunit.client.0.smithi143.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-08-27T02:59:32.897 INFO:tasks.workunit.client.0.smithi143.stderr:Deleting bucket a-bucket 2024-08-27T02:59:33.021 INFO:tasks.workunit.client.0.smithi143.stderr:Deleting bucket myver 2024-08-27T02:59:33.595 INFO:tasks.workunit.client.0.smithi143.stderr:Completed resharding tests 2024-08-27T02:59:33.595 INFO:tasks.workunit.client.0.smithi143.stdout:connected to http://localhost:80 2024-08-27T02:59:33.690 INFO:tasks.workunit.client.0.smithi143.stderr:+ deactivate 2024-08-27T02:59:33.690 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-08-27T02:59:33.690 INFO:tasks.workunit.client.0.smithi143.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T02:59:33.690 INFO:tasks.workunit.client.0.smithi143.stderr:+ export PATH 2024-08-27T02:59:33.690 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset _OLD_VIRTUAL_PATH 2024-08-27T02:59:33.690 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n '' ']' 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ hash -r 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n '' ']' 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset VIRTUAL_ENV 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' '!' '' = nondestructive ']' 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset -f deactivate 2024-08-27T02:59:33.691 INFO:tasks.workunit.client.0.smithi143.stderr:+ echo OK. 2024-08-27T02:59:33.693 INFO:tasks.workunit.client.0.smithi143.stdout:OK. 2024-08-27T02:59:33.693 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T02:59:33.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T02:59:33.752 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-08-27T02:59:33.752 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-27T02:59:34.186 DEBUG:teuthology.parallel:result is None 2024-08-27T02:59:34.187 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:59:34.199 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:59:34.199 DEBUG:teuthology.orchestra.run.smithi143:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T02:59:34.247 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T02:59:34.247 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-08-27T02:59:34.262 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-08-27T02:59:34.262 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-08-27T02:59:34.262 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-08-27T02:59:34.262 DEBUG:teuthology.orchestra.run.smithi143:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-08-27T02:59:34.295 INFO:teuthology.orchestra.run.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-08-27T02:59:38.900 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-08-27T02:59:38.901 DEBUG:teuthology.orchestra.run.smithi143:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-08-27T02:59:38.990 INFO:teuthology.orchestra.run.smithi143.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-08-27T02:59:39.049 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2024-08-27T02:59:39.263 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2024-08-27T02:59:39.263 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2024-08-27T02:59:39.453 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2024-08-27T02:59:39.454 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-27T02:59:39.454 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-27T02:59:39.454 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-27T02:59:39.454 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-27T02:59:39.454 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-27T02:59:39.454 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-27T02:59:39.455 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2024-08-27T02:59:39.456 INFO:teuthology.orchestra.run.smithi143.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-08-27T02:59:39.456 INFO:teuthology.orchestra.run.smithi143.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-08-27T02:59:39.457 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2024-08-27T02:59:39.457 INFO:teuthology.orchestra.run.smithi143.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-08-27T02:59:39.457 INFO:teuthology.orchestra.run.smithi143.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-08-27T02:59:39.457 INFO:teuthology.orchestra.run.smithi143.stdout: fonts-wqy-zenhei fonts-indic 2024-08-27T02:59:39.493 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2024-08-27T02:59:39.494 INFO:teuthology.orchestra.run.smithi143.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-08-27T02:59:39.494 INFO:teuthology.orchestra.run.smithi143.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-08-27T02:59:39.548 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-08-27T02:59:39.548 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 46.0 MB of archives. 2024-08-27T02:59:39.548 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 155 MB of additional disk space will be used. 2024-08-27T02:59:39.548 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-08-27T02:59:39.625 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-08-27T02:59:39.707 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-08-27T02:59:39.707 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-08-27T02:59:39.710 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-08-27T02:59:39.711 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-08-27T02:59:40.131 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-08-27T02:59:40.132 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-08-27T02:59:40.221 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-08-27T02:59:40.558 INFO:teuthology.orchestra.run.smithi143.stderr:debconf: unable to initialize frontend: Dialog 2024-08-27T02:59:40.558 INFO:teuthology.orchestra.run.smithi143.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-08-27T02:59:40.558 INFO:teuthology.orchestra.run.smithi143.stderr:debconf: falling back to frontend: Readline 2024-08-27T02:59:40.569 INFO:teuthology.orchestra.run.smithi143.stderr:debconf: unable to initialize frontend: Readline 2024-08-27T02:59:40.569 INFO:teuthology.orchestra.run.smithi143.stderr:debconf: (This frontend requires a controlling tty.) 2024-08-27T02:59:40.569 INFO:teuthology.orchestra.run.smithi143.stderr:debconf: falling back to frontend: Teletype 2024-08-27T02:59:40.573 INFO:teuthology.orchestra.run.smithi143.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-08-27T02:59:40.609 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 46.0 MB in 1s (61.5 MB/s) 2024-08-27T02:59:40.717 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libgtk2.0-common. 2024-08-27T02:59:40.779 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-08-27T02:59:40.785 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-08-27T02:59:40.824 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:41.236 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-08-27T02:59:41.265 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-27T02:59:41.345 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:41.757 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libgail18:amd64. 2024-08-27T02:59:41.786 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-27T02:59:41.823 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:42.043 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libgail-common:amd64. 2024-08-27T02:59:42.060 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-27T02:59:42.101 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:42.362 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-08-27T02:59:42.378 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-08-27T02:59:42.453 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:42.873 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-08-27T02:59:42.902 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-08-27T02:59:42.943 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:44.654 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-08-27T02:59:44.682 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-08-27T02:59:44.740 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:45.217 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-08-27T02:59:45.245 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-08-27T02:59:45.287 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:46.103 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-08-27T02:59:46.132 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-08-27T02:59:46.172 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:46.523 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:47.685 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-08-27T02:59:47.710 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-08-27T02:59:47.737 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-08-27T02:59:48.068 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:48.236 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:48.596 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:48.688 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-08-27T02:59:48.756 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:48.848 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-08-27T02:59:48.877 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-08-27T02:59:48.902 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-08-27T02:59:48.929 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-08-27T02:59:49.045 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-08-27T02:59:49.197 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-08-27T02:59:49.307 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-08-27T02:59:49.418 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-08-27T02:59:49.469 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-08-27T02:59:49.519 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-08-27T02:59:49.545 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-08-27T02:59:49.572 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-08-27T02:59:49.626 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:49.744 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:49.895 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-08-27T02:59:49.987 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-08-27T02:59:50.072 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-08-27T02:59:50.199 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-27T02:59:51.232 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-27T02:59:51.333 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-27T02:59:51.601 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-27T02:59:52.088 INFO:teuthology.orchestra.run.smithi143.stdout: Gradle will be installed under /opt/gradle 2024-08-27T02:59:52.117 INFO:teuthology.orchestra.run.smithi143.stderr:--2024-08-27 02:59:52-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-08-27T02:59:52.120 INFO:teuthology.orchestra.run.smithi143.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-08-27T02:59:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-08-27T02:59:52.187 INFO:teuthology.orchestra.run.smithi143.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-08-27T02:59:52.187 INFO:teuthology.orchestra.run.smithi143.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-08-27T02:59:52.187 INFO:teuthology.orchestra.run.smithi143.stderr:--2024-08-27 02:59:52-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-08-27T02:59:52.189 INFO:teuthology.orchestra.run.smithi143.stderr:Resolving github.com (github.com)... 140.82.114.3 2024-08-27T02:59:52.199 INFO:teuthology.orchestra.run.smithi143.stderr:Connecting to github.com (github.com)|140.82.114.3|:443... connected. 2024-08-27T02:59:52.289 INFO:teuthology.orchestra.run.smithi143.stderr:HTTP request sent, awaiting response... 302 Found 2024-08-27T02:59:52.290 INFO:teuthology.orchestra.run.smithi143.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240827%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240827T025952Z&X-Amz-Expires=300&X-Amz-Signature=4b5043b531337e250c5fe57b0857b11eb582f327696a86b11cd16e967a3c95b3&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-08-27T02:59:52.290 INFO:teuthology.orchestra.run.smithi143.stderr:--2024-08-27 02:59:52-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240827%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240827T025952Z&X-Amz-Expires=300&X-Amz-Signature=4b5043b531337e250c5fe57b0857b11eb582f327696a86b11cd16e967a3c95b3&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-08-27T02:59:52.291 INFO:teuthology.orchestra.run.smithi143.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.111.133, 185.199.108.133, ... 2024-08-27T02:59:52.304 INFO:teuthology.orchestra.run.smithi143.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-08-27T02:59:52.389 INFO:teuthology.orchestra.run.smithi143.stderr:HTTP request sent, awaiting response... 200 OK 2024-08-27T02:59:52.389 INFO:teuthology.orchestra.run.smithi143.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-08-27T02:59:52.389 INFO:teuthology.orchestra.run.smithi143.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-08-27T02:59:52.389 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T02:59:52.400 INFO:teuthology.orchestra.run.smithi143.stderr: 0K .......... .......... .......... .......... .......... 0% 4.08M 22s 2024-08-27T02:59:52.412 INFO:teuthology.orchestra.run.smithi143.stderr: 50K .......... .......... .......... .......... .......... 0% 4.14M 22s 2024-08-27T02:59:52.414 INFO:teuthology.orchestra.run.smithi143.stderr: 100K .......... .......... .......... .......... .......... 0% 16.2M 17s 2024-08-27T02:59:52.417 INFO:teuthology.orchestra.run.smithi143.stderr: 150K .......... .......... .......... .......... .......... 0% 21.5M 13s 2024-08-27T02:59:52.424 INFO:teuthology.orchestra.run.smithi143.stderr: 200K .......... .......... .......... .......... .......... 0% 7.69M 13s 2024-08-27T02:59:52.425 INFO:teuthology.orchestra.run.smithi143.stderr: 250K .......... .......... .......... .......... .......... 0% 46.8M 11s 2024-08-27T02:59:52.427 INFO:teuthology.orchestra.run.smithi143.stderr: 300K .......... .......... .......... .......... .......... 0% 19.5M 10s 2024-08-27T02:59:52.429 INFO:teuthology.orchestra.run.smithi143.stderr: 350K .......... .......... .......... .......... .......... 0% 42.7M 9s 2024-08-27T02:59:52.435 INFO:teuthology.orchestra.run.smithi143.stderr: 400K .......... .......... .......... .......... .......... 0% 8.09M 9s 2024-08-27T02:59:52.435 INFO:teuthology.orchestra.run.smithi143.stderr: 450K .......... .......... .......... .......... .......... 0% 131M 9s 2024-08-27T02:59:52.435 INFO:teuthology.orchestra.run.smithi143.stderr: 500K .......... .......... .......... .......... .......... 0% 57.9M 8s 2024-08-27T02:59:52.437 INFO:teuthology.orchestra.run.smithi143.stderr: 550K .......... .......... .......... .......... .......... 0% 57.5M 7s 2024-08-27T02:59:52.441 INFO:teuthology.orchestra.run.smithi143.stderr: 600K .......... .......... .......... .......... .......... 0% 27.5M 7s 2024-08-27T02:59:52.441 INFO:teuthology.orchestra.run.smithi143.stderr: 650K .......... .......... .......... .......... .......... 0% 143M 7s 2024-08-27T02:59:52.441 INFO:teuthology.orchestra.run.smithi143.stderr: 700K .......... .......... .......... .......... .......... 0% 81.4M 6s 2024-08-27T02:59:52.442 INFO:teuthology.orchestra.run.smithi143.stderr: 750K .......... .......... .......... .......... .......... 0% 58.1M 6s 2024-08-27T02:59:52.442 INFO:teuthology.orchestra.run.smithi143.stderr: 800K .......... .......... .......... .......... .......... 0% 114M 6s 2024-08-27T02:59:53.718 INFO:teuthology.orchestra.run.smithi143.stderr: 850K .......... .......... .......... .......... .......... 0% 8.93M 6s 2024-08-27T02:59:53.718 INFO:teuthology.orchestra.run.smithi143.stderr: 900K .......... .......... .......... .......... .......... 1% 107M 6s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 950K .......... .......... .......... .......... .......... 1% 150M 5s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1000K .......... .......... .......... .......... .......... 1% 111M 5s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1050K .......... .......... .......... .......... .......... 1% 95.6M 5s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1100K .......... .......... .......... .......... .......... 1% 92.5M 5s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1150K .......... .......... .......... .......... .......... 1% 148M 5s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1200K .......... .......... .......... .......... .......... 1% 104M 4s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1250K .......... .......... .......... .......... .......... 1% 59.1M 4s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1300K .......... .......... .......... .......... .......... 1% 136M 4s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1350K .......... .......... .......... .......... .......... 1% 148M 4s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1400K .......... .......... .......... .......... .......... 1% 150M 4s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1450K .......... .......... .......... .......... .......... 1% 152M 4s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1500K .......... .......... .......... .......... .......... 1% 116M 4s 2024-08-27T02:59:53.719 INFO:teuthology.orchestra.run.smithi143.stderr: 1550K .......... .......... .......... .......... .......... 1% 133M 4s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1600K .......... .......... .......... .......... .......... 1% 145M 4s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1650K .......... .......... .......... .......... .......... 1% 150M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1700K .......... .......... .......... .......... .......... 1% 128M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1750K .......... .......... .......... .......... .......... 1% 10.9M 4s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1800K .......... .......... .......... .......... .......... 1% 115M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1850K .......... .......... .......... .......... .......... 2% 127M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1900K .......... .......... .......... .......... .......... 2% 105M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 1950K .......... .......... .......... .......... .......... 2% 130M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 2000K .......... .......... .......... .......... .......... 2% 122M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 2050K .......... .......... .......... .......... .......... 2% 102M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 2100K .......... .......... .......... .......... .......... 2% 103M 3s 2024-08-27T02:59:53.720 INFO:teuthology.orchestra.run.smithi143.stderr: 2150K .......... .......... .......... .......... .......... 2% 115M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2200K .......... .......... .......... .......... .......... 2% 112M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2250K .......... .......... .......... .......... .......... 2% 105M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2300K .......... .......... .......... .......... .......... 2% 86.1M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2350K .......... .......... .......... .......... .......... 2% 110M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2400K .......... .......... .......... .......... .......... 2% 111M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2450K .......... .......... .......... .......... .......... 2% 90.2M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2500K .......... .......... .......... .......... .......... 2% 92.5M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2550K .......... .......... .......... .......... .......... 2% 96.5M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2600K .......... .......... .......... .......... .......... 2% 141M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2650K .......... .......... .......... .......... .......... 2% 151M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2700K .......... .......... .......... .......... .......... 2% 127M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2750K .......... .......... .......... .......... .......... 3% 154M 3s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2800K .......... .......... .......... .......... .......... 3% 154M 2s 2024-08-27T02:59:53.721 INFO:teuthology.orchestra.run.smithi143.stderr: 2850K .......... .......... .......... .......... .......... 3% 149M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 2900K .......... .......... .......... .......... .......... 3% 136M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 2950K .......... .......... .......... .......... .......... 3% 140M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3000K .......... .......... .......... .......... .......... 3% 156M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3050K .......... .......... .......... .......... .......... 3% 151M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3100K .......... .......... .......... .......... .......... 3% 126M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3150K .......... .......... .......... .......... .......... 3% 140M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3200K .......... .......... .......... .......... .......... 3% 111M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3250K .......... .......... .......... .......... .......... 3% 128M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3300K .......... .......... .......... .......... .......... 3% 125M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3350K .......... .......... .......... .......... .......... 3% 129M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3400K .......... .......... .......... .......... .......... 3% 113M 2s 2024-08-27T02:59:53.722 INFO:teuthology.orchestra.run.smithi143.stderr: 3450K .......... .......... .......... .......... .......... 3% 131M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3500K .......... .......... .......... .......... .......... 3% 91.9M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3550K .......... .......... .......... .......... .......... 3% 130M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3600K .......... .......... .......... .......... .......... 3% 96.3M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3650K .......... .......... .......... .......... .......... 3% 94.5M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3700K .......... .......... .......... .......... .......... 4% 87.1M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3750K .......... .......... .......... .......... .......... 4% 119M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3800K .......... .......... .......... .......... .......... 4% 126M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3850K .......... .......... .......... .......... .......... 4% 97.1M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3900K .......... .......... .......... .......... .......... 4% 72.5M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 3950K .......... .......... .......... .......... .......... 4% 85.8M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 4000K .......... .......... .......... .......... .......... 4% 127M 2s 2024-08-27T02:59:53.723 INFO:teuthology.orchestra.run.smithi143.stderr: 4050K .......... .......... .......... .......... .......... 4% 148M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4100K .......... .......... .......... .......... .......... 4% 132M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4150K .......... .......... .......... .......... .......... 4% 137M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4200K .......... .......... .......... .......... .......... 4% 116M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4250K .......... .......... .......... .......... .......... 4% 148M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4300K .......... .......... .......... .......... .......... 4% 124M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4350K .......... .......... .......... .......... .......... 4% 144M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4400K .......... .......... .......... .......... .......... 4% 138M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4450K .......... .......... .......... .......... .......... 4% 144M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4500K .......... .......... .......... .......... .......... 4% 133M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4550K .......... .......... .......... .......... .......... 4% 111M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4600K .......... .......... .......... .......... .......... 5% 81.6M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4650K .......... .......... .......... .......... .......... 5% 90.4M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4700K .......... .......... .......... .......... .......... 5% 98.0M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4750K .......... .......... .......... .......... .......... 5% 116M 2s 2024-08-27T02:59:53.724 INFO:teuthology.orchestra.run.smithi143.stderr: 4800K .......... .......... .......... .......... .......... 5% 114M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 4850K .......... .......... .......... .......... .......... 5% 104M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 4900K .......... .......... .......... .......... .......... 5% 130M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 4950K .......... .......... .......... .......... .......... 5% 106M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5000K .......... .......... .......... .......... .......... 5% 113M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5050K .......... .......... .......... .......... .......... 5% 96.8M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5100K .......... .......... .......... .......... .......... 5% 68.7M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5150K .......... .......... .......... .......... .......... 5% 120M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5200K .......... .......... .......... .......... .......... 5% 130M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5250K .......... .......... .......... .......... .......... 5% 125M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5300K .......... .......... .......... .......... .......... 5% 128M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5350K .......... .......... .......... .......... .......... 5% 160M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5400K .......... .......... .......... .......... .......... 5% 129M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5450K .......... .......... .......... .......... .......... 5% 145M 2s 2024-08-27T02:59:53.725 INFO:teuthology.orchestra.run.smithi143.stderr: 5500K .......... .......... .......... .......... .......... 5% 121M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5550K .......... .......... .......... .......... .......... 6% 119M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5600K .......... .......... .......... .......... .......... 6% 126M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5650K .......... .......... .......... .......... .......... 6% 135M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5700K .......... .......... .......... .......... .......... 6% 113M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5750K .......... .......... .......... .......... .......... 6% 134M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5800K .......... .......... .......... .......... .......... 6% 119M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5850K .......... .......... .......... .......... .......... 6% 128M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5900K .......... .......... .......... .......... .......... 6% 129M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 5950K .......... .......... .......... .......... .......... 6% 110M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 6000K .......... .......... .......... .......... .......... 6% 95.9M 2s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 6050K .......... .......... .......... .......... .......... 6% 124M 1s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 6100K .......... .......... .......... .......... .......... 6% 136M 1s 2024-08-27T02:59:53.726 INFO:teuthology.orchestra.run.smithi143.stderr: 6150K .......... .......... .......... .......... .......... 6% 123M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6200K .......... .......... .......... .......... .......... 6% 120M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6250K .......... .......... .......... .......... .......... 6% 144M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6300K .......... .......... .......... .......... .......... 6% 116M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6350K .......... .......... .......... .......... .......... 6% 122M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6400K .......... .......... .......... .......... .......... 6% 128M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6450K .......... .......... .......... .......... .......... 6% 122M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6500K .......... .......... .......... .......... .......... 7% 123M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6550K .......... .......... .......... .......... .......... 7% 167M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6600K .......... .......... .......... .......... .......... 7% 218M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6650K .......... .......... .......... .......... .......... 7% 171M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6700K .......... .......... .......... .......... .......... 7% 130M 1s 2024-08-27T02:59:53.727 INFO:teuthology.orchestra.run.smithi143.stderr: 6750K .......... .......... .......... .......... .......... 7% 217M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 6800K .......... .......... .......... .......... .......... 7% 170M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 6850K .......... .......... .......... .......... .......... 7% 147M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 6900K .......... .......... .......... .......... .......... 7% 165M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 6950K .......... .......... .......... .......... .......... 7% 183M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7000K .......... .......... .......... .......... .......... 7% 168M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7050K .......... .......... .......... .......... .......... 7% 221M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7100K .......... .......... .......... .......... .......... 7% 185M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7150K .......... .......... .......... .......... .......... 7% 216M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7200K .......... .......... .......... .......... .......... 7% 213M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7250K .......... .......... .......... .......... .......... 7% 145M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7300K .......... .......... .......... .......... .......... 7% 190M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7350K .......... .......... .......... .......... .......... 7% 224M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7400K .......... .......... .......... .......... .......... 8% 217M 1s 2024-08-27T02:59:53.728 INFO:teuthology.orchestra.run.smithi143.stderr: 7450K .......... .......... .......... .......... .......... 8% 223M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7500K .......... .......... .......... .......... .......... 8% 183M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7550K .......... .......... .......... .......... .......... 8% 223M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7600K .......... .......... .......... .......... .......... 8% 219M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7650K .......... .......... .......... .......... .......... 8% 216M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7700K .......... .......... .......... .......... .......... 8% 168M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7750K .......... .......... .......... .......... .......... 8% 215M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7800K .......... .......... .......... .......... .......... 8% 181M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7850K .......... .......... .......... .......... .......... 8% 135M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7900K .......... .......... .......... .......... .......... 8% 115M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 7950K .......... .......... .......... .......... .......... 8% 193M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 8000K .......... .......... .......... .......... .......... 8% 215M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 8050K .......... .......... .......... .......... .......... 8% 198M 1s 2024-08-27T02:59:53.729 INFO:teuthology.orchestra.run.smithi143.stderr: 8100K .......... .......... .......... .......... .......... 8% 162M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8150K .......... .......... .......... .......... .......... 8% 145M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8200K .......... .......... .......... .......... .......... 8% 133M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8250K .......... .......... .......... .......... .......... 8% 140M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8300K .......... .......... .......... .......... .......... 8% 80.9M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8350K .......... .......... .......... .......... .......... 9% 161M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8400K .......... .......... .......... .......... .......... 9% 169M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8450K .......... .......... .......... .......... .......... 9% 165M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8500K .......... .......... .......... .......... .......... 9% 137M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8550K .......... .......... .......... .......... .......... 9% 174M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8600K .......... .......... .......... .......... .......... 9% 174M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8650K .......... .......... .......... .......... .......... 9% 170M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8700K .......... .......... .......... .......... .......... 9% 129M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8750K .......... .......... .......... .......... .......... 9% 178M 1s 2024-08-27T02:59:53.730 INFO:teuthology.orchestra.run.smithi143.stderr: 8800K .......... .......... .......... .......... .......... 9% 176M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 8850K .......... .......... .......... .......... .......... 9% 172M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 8900K .......... .......... .......... .......... .......... 9% 155M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 8950K .......... .......... .......... .......... .......... 9% 171M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9000K .......... .......... .......... .......... .......... 9% 165M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9050K .......... .......... .......... .......... .......... 9% 175M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9100K .......... .......... .......... .......... .......... 9% 152M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9150K .......... .......... .......... .......... .......... 9% 167M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9200K .......... .......... .......... .......... .......... 9% 172M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9250K .......... .......... .......... .......... .......... 10% 172M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9300K .......... .......... .......... .......... .......... 10% 164M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9350K .......... .......... .......... .......... .......... 10% 187M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9400K .......... .......... .......... .......... .......... 10% 176M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9450K .......... .......... .......... .......... .......... 10% 175M 1s 2024-08-27T02:59:53.731 INFO:teuthology.orchestra.run.smithi143.stderr: 9500K .......... .......... .......... .......... .......... 10% 152M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9550K .......... .......... .......... .......... .......... 10% 186M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9600K .......... .......... .......... .......... .......... 10% 183M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9650K .......... .......... .......... .......... .......... 10% 172M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9700K .......... .......... .......... .......... .......... 10% 151M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9750K .......... .......... .......... .......... .......... 10% 169M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9800K .......... .......... .......... .......... .......... 10% 160M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9850K .......... .......... .......... .......... .......... 10% 160M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9900K .......... .......... .......... .......... .......... 10% 144M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 9950K .......... .......... .......... .......... .......... 10% 169M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 10000K .......... .......... .......... .......... .......... 10% 174M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 10050K .......... .......... .......... .......... .......... 10% 167M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 10100K .......... .......... .......... .......... .......... 10% 152M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 10150K .......... .......... .......... .......... .......... 10% 173M 1s 2024-08-27T02:59:53.732 INFO:teuthology.orchestra.run.smithi143.stderr: 10200K .......... .......... .......... .......... .......... 11% 170M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10250K .......... .......... .......... .......... .......... 11% 198M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10300K .......... .......... .......... .......... .......... 11% 153M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10350K .......... .......... .......... .......... .......... 11% 177M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10400K .......... .......... .......... .......... .......... 11% 181M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10450K .......... .......... .......... .......... .......... 11% 174M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10500K .......... .......... .......... .......... .......... 11% 164M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10550K .......... .......... .......... .......... .......... 11% 193M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10600K .......... .......... .......... .......... .......... 11% 194M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10650K .......... .......... .......... .......... .......... 11% 159M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10700K .......... .......... .......... .......... .......... 11% 144M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10750K .......... .......... .......... .......... .......... 11% 185M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10800K .......... .......... .......... .......... .......... 11% 176M 1s 2024-08-27T02:59:53.733 INFO:teuthology.orchestra.run.smithi143.stderr: 10850K .......... .......... .......... .......... .......... 11% 174M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 10900K .......... .......... .......... .......... .......... 11% 160M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 10950K .......... .......... .......... .......... .......... 11% 188M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11000K .......... .......... .......... .......... .......... 11% 167M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11050K .......... .......... .......... .......... .......... 11% 176M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11100K .......... .......... .......... .......... .......... 12% 150M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11150K .......... .......... .......... .......... .......... 12% 170M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11200K .......... .......... .......... .......... .......... 12% 169M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11250K .......... .......... .......... .......... .......... 12% 163M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11300K .......... .......... .......... .......... .......... 12% 167M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11350K .......... .......... .......... .......... .......... 12% 175M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11400K .......... .......... .......... .......... .......... 12% 175M 1s 2024-08-27T02:59:53.734 INFO:teuthology.orchestra.run.smithi143.stderr: 11450K .......... .......... .......... .......... .......... 12% 181M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11500K .......... .......... .......... .......... .......... 12% 147M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11550K .......... .......... .......... .......... .......... 12% 188M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11600K .......... .......... .......... .......... .......... 12% 182M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11650K .......... .......... .......... .......... .......... 12% 186M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11700K .......... .......... .......... .......... .......... 12% 144M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11750K .......... .......... .......... .......... .......... 12% 157M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11800K .......... .......... .......... .......... .......... 12% 153M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11850K .......... .......... .......... .......... .......... 12% 182M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11900K .......... .......... .......... .......... .......... 12% 153M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 11950K .......... .......... .......... .......... .......... 12% 182M 1s 2024-08-27T02:59:53.735 INFO:teuthology.orchestra.run.smithi143.stderr: 12000K .......... .......... .......... .......... .......... 12% 184M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12050K .......... .......... .......... .......... .......... 13% 186M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12100K .......... .......... .......... .......... .......... 13% 145M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12150K .......... .......... .......... .......... .......... 13% 183M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12200K .......... .......... .......... .......... .......... 13% 161M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12250K .......... .......... .......... .......... .......... 13% 175M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12300K .......... .......... .......... .......... .......... 13% 125M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12350K .......... .......... .......... .......... .......... 13% 172M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12400K .......... .......... .......... .......... .......... 13% 140M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12450K .......... .......... .......... .......... .......... 13% 145M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12500K .......... .......... .......... .......... .......... 13% 164M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12550K .......... .......... .......... .......... .......... 13% 180M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12600K .......... .......... .......... .......... .......... 13% 172M 1s 2024-08-27T02:59:53.736 INFO:teuthology.orchestra.run.smithi143.stderr: 12650K .......... .......... .......... .......... .......... 13% 175M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 12700K .......... .......... .......... .......... .......... 13% 152M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 12750K .......... .......... .......... .......... .......... 13% 213M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 12800K .......... .......... .......... .......... .......... 13% 315M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 12850K .......... .......... .......... .......... .......... 13% 267M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 12900K .......... .......... .......... .......... .......... 13% 285M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 12950K .......... .......... .......... .......... .......... 13% 329M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13000K .......... .......... .......... .......... .......... 14% 328M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13050K .......... .......... .......... .......... .......... 14% 302M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13100K .......... .......... .......... .......... .......... 14% 257M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13150K .......... .......... .......... .......... .......... 14% 302M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13200K .......... .......... .......... .......... .......... 14% 279M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13250K .......... .......... .......... .......... .......... 14% 303M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13300K .......... .......... .......... .......... .......... 14% 292M 1s 2024-08-27T02:59:53.737 INFO:teuthology.orchestra.run.smithi143.stderr: 13350K .......... .......... .......... .......... .......... 14% 262M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13400K .......... .......... .......... .......... .......... 14% 280M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13450K .......... .......... .......... .......... .......... 14% 332M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13500K .......... .......... .......... .......... .......... 14% 261M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13550K .......... .......... .......... .......... .......... 14% 236M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13600K .......... .......... .......... .......... .......... 14% 266M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13650K .......... .......... .......... .......... .......... 14% 311M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13700K .......... .......... .......... .......... .......... 14% 297M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13750K .......... .......... .......... .......... .......... 14% 329M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13800K .......... .......... .......... .......... .......... 14% 322M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13850K .......... .......... .......... .......... .......... 14% 340M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13900K .......... .......... .......... .......... .......... 15% 280M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 13950K .......... .......... .......... .......... .......... 15% 328M 1s 2024-08-27T02:59:53.738 INFO:teuthology.orchestra.run.smithi143.stderr: 14000K .......... .......... .......... .......... .......... 15% 329M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14050K .......... .......... .......... .......... .......... 15% 318M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14100K .......... .......... .......... .......... .......... 15% 272M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14150K .......... .......... .......... .......... .......... 15% 332M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14200K .......... .......... .......... .......... .......... 15% 306M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14250K .......... .......... .......... .......... .......... 15% 339M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14300K .......... .......... .......... .......... .......... 15% 252M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14350K .......... .......... .......... .......... .......... 15% 233M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14400K .......... .......... .......... .......... .......... 15% 186M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14450K .......... .......... .......... .......... .......... 15% 230M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14500K .......... .......... .......... .......... .......... 15% 220M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14550K .......... .......... .......... .......... .......... 15% 236M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14600K .......... .......... .......... .......... .......... 15% 254M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14650K .......... .......... .......... .......... .......... 15% 352M 1s 2024-08-27T02:59:53.739 INFO:teuthology.orchestra.run.smithi143.stderr: 14700K .......... .......... .......... .......... .......... 15% 293M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 14750K .......... .......... .......... .......... .......... 15% 308M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 14800K .......... .......... .......... .......... .......... 15% 236M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 14850K .......... .......... .......... .......... .......... 16% 317M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 14900K .......... .......... .......... .......... .......... 16% 320M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 14950K .......... .......... .......... .......... .......... 16% 237M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15000K .......... .......... .......... .......... .......... 16% 341M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15050K .......... .......... .......... .......... .......... 16% 351M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15100K .......... .......... .......... .......... .......... 16% 260M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15150K .......... .......... .......... .......... .......... 16% 306M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15200K .......... .......... .......... .......... .......... 16% 337M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15250K .......... .......... .......... .......... .......... 16% 355M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15300K .......... .......... .......... .......... .......... 16% 324M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15350K .......... .......... .......... .......... .......... 16% 365M 1s 2024-08-27T02:59:53.740 INFO:teuthology.orchestra.run.smithi143.stderr: 15400K .......... .......... .......... .......... .......... 16% 295M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15450K .......... .......... .......... .......... .......... 16% 289M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15500K .......... .......... .......... .......... .......... 16% 295M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15550K .......... .......... .......... .......... .......... 16% 341M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15600K .......... .......... .......... .......... .......... 16% 348M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15650K .......... .......... .......... .......... .......... 16% 337M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15700K .......... .......... .......... .......... .......... 16% 254M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15750K .......... .......... .......... .......... .......... 17% 318M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15800K .......... .......... .......... .......... .......... 17% 296M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15850K .......... .......... .......... .......... .......... 17% 316M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15900K .......... .......... .......... .......... .......... 17% 110M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 15950K .......... .......... .......... .......... .......... 17% 257M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 16000K .......... .......... .......... .......... .......... 17% 278M 1s 2024-08-27T02:59:53.741 INFO:teuthology.orchestra.run.smithi143.stderr: 16050K .......... .......... .......... .......... .......... 17% 104M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16100K .......... .......... .......... .......... .......... 17% 272M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16150K .......... .......... .......... .......... .......... 17% 258M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16200K .......... .......... .......... .......... .......... 17% 290M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16250K .......... .......... .......... .......... .......... 17% 300M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16300K .......... .......... .......... .......... .......... 17% 216M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16350K .......... .......... .......... .......... .......... 17% 305M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16400K .......... .......... .......... .......... .......... 17% 368M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16450K .......... .......... .......... .......... .......... 17% 237M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16500K .......... .......... .......... .......... .......... 17% 209M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16550K .......... .......... .......... .......... .......... 17% 302M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16600K .......... .......... .......... .......... .......... 17% 102M 1s 2024-08-27T02:59:53.742 INFO:teuthology.orchestra.run.smithi143.stderr: 16650K .......... .......... .......... .......... .......... 17% 233M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 16700K .......... .......... .......... .......... .......... 18% 230M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 16750K .......... .......... .......... .......... .......... 18% 368M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 16800K .......... .......... .......... .......... .......... 18% 365M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 16850K .......... .......... .......... .......... .......... 18% 22.8M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 16900K .......... .......... .......... .......... .......... 18% 228M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 16950K .......... .......... .......... .......... .......... 18% 249M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17000K .......... .......... .......... .......... .......... 18% 259M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17050K .......... .......... .......... .......... .......... 18% 282M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17100K .......... .......... .......... .......... .......... 18% 232M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17150K .......... .......... .......... .......... .......... 18% 290M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17200K .......... .......... .......... .......... .......... 18% 315M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17250K .......... .......... .......... .......... .......... 18% 306M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17300K .......... .......... .......... .......... .......... 18% 282M 1s 2024-08-27T02:59:53.743 INFO:teuthology.orchestra.run.smithi143.stderr: 17350K .......... .......... .......... .......... .......... 18% 312M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17400K .......... .......... .......... .......... .......... 18% 319M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17450K .......... .......... .......... .......... .......... 18% 328M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17500K .......... .......... .......... .......... .......... 18% 292M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17550K .......... .......... .......... .......... .......... 18% 324M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17600K .......... .......... .......... .......... .......... 18% 330M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17650K .......... .......... .......... .......... .......... 19% 306M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17700K .......... .......... .......... .......... .......... 19% 264M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17750K .......... .......... .......... .......... .......... 19% 319M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17800K .......... .......... .......... .......... .......... 19% 287M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17850K .......... .......... .......... .......... .......... 19% 350M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17900K .......... .......... .......... .......... .......... 19% 293M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 17950K .......... .......... .......... .......... .......... 19% 315M 1s 2024-08-27T02:59:53.744 INFO:teuthology.orchestra.run.smithi143.stderr: 18000K .......... .......... .......... .......... .......... 19% 318M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18050K .......... .......... .......... .......... .......... 19% 336M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18100K .......... .......... .......... .......... .......... 19% 305M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18150K .......... .......... .......... .......... .......... 19% 355M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18200K .......... .......... .......... .......... .......... 19% 300M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18250K .......... .......... .......... .......... .......... 19% 303M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18300K .......... .......... .......... .......... .......... 19% 244M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18350K .......... .......... .......... .......... .......... 19% 331M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18400K .......... .......... .......... .......... .......... 19% 269M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18450K .......... .......... .......... .......... .......... 19% 322M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18500K .......... .......... .......... .......... .......... 19% 253M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18550K .......... .......... .......... .......... .......... 20% 321M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18600K .......... .......... .......... .......... .......... 20% 306M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18650K .......... .......... .......... .......... .......... 20% 262M 1s 2024-08-27T02:59:53.745 INFO:teuthology.orchestra.run.smithi143.stderr: 18700K .......... .......... .......... .......... .......... 20% 275M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 18750K .......... .......... .......... .......... .......... 20% 359M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 18800K .......... .......... .......... .......... .......... 20% 321M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 18850K .......... .......... .......... .......... .......... 20% 294M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 18900K .......... .......... .......... .......... .......... 20% 273M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 18950K .......... .......... .......... .......... .......... 20% 307M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19000K .......... .......... .......... .......... .......... 20% 280M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19050K .......... .......... .......... .......... .......... 20% 310M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19100K .......... .......... .......... .......... .......... 20% 250M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19150K .......... .......... .......... .......... .......... 20% 311M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19200K .......... .......... .......... .......... .......... 20% 338M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19250K .......... .......... .......... .......... .......... 20% 320M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19300K .......... .......... .......... .......... .......... 20% 252M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19350K .......... .......... .......... .......... .......... 20% 311M 1s 2024-08-27T02:59:53.746 INFO:teuthology.orchestra.run.smithi143.stderr: 19400K .......... .......... .......... .......... .......... 20% 352M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19450K .......... .......... .......... .......... .......... 20% 355M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19500K .......... .......... .......... .......... .......... 21% 277M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19550K .......... .......... .......... .......... .......... 21% 302M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19600K .......... .......... .......... .......... .......... 21% 289M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19650K .......... .......... .......... .......... .......... 21% 252M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19700K .......... .......... .......... .......... .......... 21% 326M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19750K .......... .......... .......... .......... .......... 21% 23.4M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19800K .......... .......... .......... .......... .......... 21% 229M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19850K .......... .......... .......... .......... .......... 21% 349M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19900K .......... .......... .......... .......... .......... 21% 183M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 19950K .......... .......... .......... .......... .......... 21% 299M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 20000K .......... .......... .......... .......... .......... 21% 214M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 20050K .......... .......... .......... .......... .......... 21% 291M 1s 2024-08-27T02:59:53.747 INFO:teuthology.orchestra.run.smithi143.stderr: 20100K .......... .......... .......... .......... .......... 21% 284M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20150K .......... .......... .......... .......... .......... 21% 314M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20200K .......... .......... .......... .......... .......... 21% 212M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20250K .......... .......... .......... .......... .......... 21% 245M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20300K .......... .......... .......... .......... .......... 21% 231M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20350K .......... .......... .......... .......... .......... 21% 281M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20400K .......... .......... .......... .......... .......... 22% 268M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20450K .......... .......... .......... .......... .......... 22% 328M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20500K .......... .......... .......... .......... .......... 22% 373M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20550K .......... .......... .......... .......... .......... 22% 236M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20600K .......... .......... .......... .......... .......... 22% 212M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20650K .......... .......... .......... .......... .......... 22% 323M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20700K .......... .......... .......... .......... .......... 22% 356M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20750K .......... .......... .......... .......... .......... 22% 244M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20800K .......... .......... .......... .......... .......... 22% 274M 1s 2024-08-27T02:59:53.748 INFO:teuthology.orchestra.run.smithi143.stderr: 20850K .......... .......... .......... .......... .......... 22% 288M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 20900K .......... .......... .......... .......... .......... 22% 337M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 20950K .......... .......... .......... .......... .......... 22% 305M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21000K .......... .......... .......... .......... .......... 22% 224M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21050K .......... .......... .......... .......... .......... 22% 333M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21100K .......... .......... .......... .......... .......... 22% 322M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21150K .......... .......... .......... .......... .......... 22% 196M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21200K .......... .......... .......... .......... .......... 22% 279M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21250K .......... .......... .......... .......... .......... 22% 259M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21300K .......... .......... .......... .......... .......... 22% 245M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21350K .......... .......... .......... .......... .......... 23% 292M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21400K .......... .......... .......... .......... .......... 23% 272M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21450K .......... .......... .......... .......... .......... 23% 318M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21500K .......... .......... .......... .......... .......... 23% 342M 1s 2024-08-27T02:59:53.749 INFO:teuthology.orchestra.run.smithi143.stderr: 21550K .......... .......... .......... .......... .......... 23% 208M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21600K .......... .......... .......... .......... .......... 23% 322M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21650K .......... .......... .......... .......... .......... 23% 332M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21700K .......... .......... .......... .......... .......... 23% 284M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21750K .......... .......... .......... .......... .......... 23% 304M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21800K .......... .......... .......... .......... .......... 23% 339M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21850K .......... .......... .......... .......... .......... 23% 369M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21900K .......... .......... .......... .......... .......... 23% 320M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 21950K .......... .......... .......... .......... .......... 23% 264M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 22000K .......... .......... .......... .......... .......... 23% 287M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 22050K .......... .......... .......... .......... .......... 23% 297M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 22100K .......... .......... .......... .......... .......... 23% 322M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 22150K .......... .......... .......... .......... .......... 23% 253M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 22200K .......... .......... .......... .......... .......... 23% 313M 1s 2024-08-27T02:59:53.750 INFO:teuthology.orchestra.run.smithi143.stderr: 22250K .......... .......... .......... .......... .......... 24% 285M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22300K .......... .......... .......... .......... .......... 24% 247M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22350K .......... .......... .......... .......... .......... 24% 263M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22400K .......... .......... .......... .......... .......... 24% 266M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22450K .......... .......... .......... .......... .......... 24% 347M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22500K .......... .......... .......... .......... .......... 24% 313M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22550K .......... .......... .......... .......... .......... 24% 287M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22600K .......... .......... .......... .......... .......... 24% 366M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22650K .......... .......... .......... .......... .......... 24% 326M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22700K .......... .......... .......... .......... .......... 24% 30.5M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22750K .......... .......... .......... .......... .......... 24% 233M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22800K .......... .......... .......... .......... .......... 24% 274M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22850K .......... .......... .......... .......... .......... 24% 347M 1s 2024-08-27T02:59:53.751 INFO:teuthology.orchestra.run.smithi143.stderr: 22900K .......... .......... .......... .......... .......... 24% 309M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 22950K .......... .......... .......... .......... .......... 24% 260M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23000K .......... .......... .......... .......... .......... 24% 275M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23050K .......... .......... .......... .......... .......... 24% 299M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23100K .......... .......... .......... .......... .......... 24% 371M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23150K .......... .......... .......... .......... .......... 24% 188M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23200K .......... .......... .......... .......... .......... 25% 290M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23250K .......... .......... .......... .......... .......... 25% 236M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23300K .......... .......... .......... .......... .......... 25% 354M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23350K .......... .......... .......... .......... .......... 25% 284M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23400K .......... .......... .......... .......... .......... 25% 305M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23450K .......... .......... .......... .......... .......... 25% 347M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23500K .......... .......... .......... .......... .......... 25% 310M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23550K .......... .......... .......... .......... .......... 25% 268M 1s 2024-08-27T02:59:53.752 INFO:teuthology.orchestra.run.smithi143.stderr: 23600K .......... .......... .......... .......... .......... 25% 368M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 23650K .......... .......... .......... .......... .......... 25% 329M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 23700K .......... .......... .......... .......... .......... 25% 217M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 23750K .......... .......... .......... .......... .......... 25% 241M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 23800K .......... .......... .......... .......... .......... 25% 286M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 23850K .......... .......... .......... .......... .......... 25% 321M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 23900K .......... .......... .......... .......... .......... 25% 366M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 23950K .......... .......... .......... .......... .......... 25% 173M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 24000K .......... .......... .......... .......... .......... 25% 299M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 24050K .......... .......... .......... .......... .......... 25% 358M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 24100K .......... .......... .......... .......... .......... 25% 315M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 24150K .......... .......... .......... .......... .......... 26% 278M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 24200K .......... .......... .......... .......... .......... 26% 328M 1s 2024-08-27T02:59:53.753 INFO:teuthology.orchestra.run.smithi143.stderr: 24250K .......... .......... .......... .......... .......... 26% 300M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24300K .......... .......... .......... .......... .......... 26% 311M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24350K .......... .......... .......... .......... .......... 26% 301M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24400K .......... .......... .......... .......... .......... 26% 187M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24450K .......... .......... .......... .......... .......... 26% 329M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24500K .......... .......... .......... .......... .......... 26% 338M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24550K .......... .......... .......... .......... .......... 26% 204M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24600K .......... .......... .......... .......... .......... 26% 282M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24650K .......... .......... .......... .......... .......... 26% 373M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24700K .......... .......... .......... .......... .......... 26% 240M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24750K .......... .......... .......... .......... .......... 26% 212M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24800K .......... .......... .......... .......... .......... 26% 316M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24850K .......... .......... .......... .......... .......... 26% 321M 1s 2024-08-27T02:59:53.754 INFO:teuthology.orchestra.run.smithi143.stderr: 24900K .......... .......... .......... .......... .......... 26% 306M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 24950K .......... .......... .......... .......... .......... 26% 250M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25000K .......... .......... .......... .......... .......... 26% 319M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25050K .......... .......... .......... .......... .......... 27% 280M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25100K .......... .......... .......... .......... .......... 27% 235M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25150K .......... .......... .......... .......... .......... 27% 270M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25200K .......... .......... .......... .......... .......... 27% 277M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25250K .......... .......... .......... .......... .......... 27% 311M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25300K .......... .......... .......... .......... .......... 27% 298M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25350K .......... .......... .......... .......... .......... 27% 248M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25400K .......... .......... .......... .......... .......... 27% 324M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25450K .......... .......... .......... .......... .......... 27% 375M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25500K .......... .......... .......... .......... .......... 27% 24.4M 1s 2024-08-27T02:59:53.755 INFO:teuthology.orchestra.run.smithi143.stderr: 25550K .......... .......... .......... .......... .......... 27% 191M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25600K .......... .......... .......... .......... .......... 27% 232M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25650K .......... .......... .......... .......... .......... 27% 280M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25700K .......... .......... .......... .......... .......... 27% 229M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25750K .......... .......... .......... .......... .......... 27% 266M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25800K .......... .......... .......... .......... .......... 27% 252M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25850K .......... .......... .......... .......... .......... 27% 317M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25900K .......... .......... .......... .......... .......... 27% 257M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 25950K .......... .......... .......... .......... .......... 27% 215M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 26000K .......... .......... .......... .......... .......... 28% 256M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 26050K .......... .......... .......... .......... .......... 28% 260M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 26100K .......... .......... .......... .......... .......... 28% 227M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 26150K .......... .......... .......... .......... .......... 28% 246M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 26200K .......... .......... .......... .......... .......... 28% 310M 1s 2024-08-27T02:59:53.756 INFO:teuthology.orchestra.run.smithi143.stderr: 26250K .......... .......... .......... .......... .......... 28% 237M 1s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26300K .......... .......... .......... .......... .......... 28% 229M 1s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26350K .......... .......... .......... .......... .......... 28% 243M 1s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26400K .......... .......... .......... .......... .......... 28% 229M 1s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26450K .......... .......... .......... .......... .......... 28% 264M 1s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26500K .......... .......... .......... .......... .......... 28% 300M 1s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26550K .......... .......... .......... .......... .......... 28% 227M 1s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26600K .......... .......... .......... .......... .......... 28% 315M 0s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26650K .......... .......... .......... .......... .......... 28% 246M 0s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26700K .......... .......... .......... .......... .......... 28% 291M 0s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26750K .......... .......... .......... .......... .......... 28% 241M 0s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26800K .......... .......... .......... .......... .......... 28% 288M 0s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26850K .......... .......... .......... .......... .......... 28% 220M 0s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26900K .......... .......... .......... .......... .......... 29% 248M 0s 2024-08-27T02:59:53.757 INFO:teuthology.orchestra.run.smithi143.stderr: 26950K .......... .......... .......... .......... .......... 29% 213M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27000K .......... .......... .......... .......... .......... 29% 263M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27050K .......... .......... .......... .......... .......... 29% 288M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27100K .......... .......... .......... .......... .......... 29% 306M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27150K .......... .......... .......... .......... .......... 29% 229M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27200K .......... .......... .......... .......... .......... 29% 286M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27250K .......... .......... .......... .......... .......... 29% 300M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27300K .......... .......... .......... .......... .......... 29% 246M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27350K .......... .......... .......... .......... .......... 29% 235M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27400K .......... .......... .......... .......... .......... 29% 269M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27450K .......... .......... .......... .......... .......... 29% 275M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27500K .......... .......... .......... .......... .......... 29% 239M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27550K .......... .......... .......... .......... .......... 29% 205M 0s 2024-08-27T02:59:53.758 INFO:teuthology.orchestra.run.smithi143.stderr: 27600K .......... .......... .......... .......... .......... 29% 261M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 27650K .......... .......... .......... .......... .......... 29% 289M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 27700K .......... .......... .......... .......... .......... 29% 251M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 27750K .......... .......... .......... .......... .......... 29% 234M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 27800K .......... .......... .......... .......... .......... 29% 274M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 27850K .......... .......... .......... .......... .......... 30% 249M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 27900K .......... .......... .......... .......... .......... 30% 304M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 27950K .......... .......... .......... .......... .......... 30% 238M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 28000K .......... .......... .......... .......... .......... 30% 333M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 28050K .......... .......... .......... .......... .......... 30% 295M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 28100K .......... .......... .......... .......... .......... 30% 334M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 28150K .......... .......... .......... .......... .......... 30% 298M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 28200K .......... .......... .......... .......... .......... 30% 346M 0s 2024-08-27T02:59:53.759 INFO:teuthology.orchestra.run.smithi143.stderr: 28250K .......... .......... .......... .......... .......... 30% 268M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28300K .......... .......... .......... .......... .......... 30% 290M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28350K .......... .......... .......... .......... .......... 30% 288M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28400K .......... .......... .......... .......... .......... 30% 304M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28450K .......... .......... .......... .......... .......... 30% 74.4M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28500K .......... .......... .......... .......... .......... 30% 281M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28550K .......... .......... .......... .......... .......... 30% 189M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28600K .......... .......... .......... .......... .......... 30% 254M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28650K .......... .......... .......... .......... .......... 30% 294M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28700K .......... .......... .......... .......... .......... 30% 295M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28750K .......... .......... .......... .......... .......... 31% 205M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28800K .......... .......... .......... .......... .......... 31% 308M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28850K .......... .......... .......... .......... .......... 31% 286M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28900K .......... .......... .......... .......... .......... 31% 307M 0s 2024-08-27T02:59:53.760 INFO:teuthology.orchestra.run.smithi143.stderr: 28950K .......... .......... .......... .......... .......... 31% 300M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29000K .......... .......... .......... .......... .......... 31% 312M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29050K .......... .......... .......... .......... .......... 31% 307M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29100K .......... .......... .......... .......... .......... 31% 283M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29150K .......... .......... .......... .......... .......... 31% 230M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29200K .......... .......... .......... .......... .......... 31% 328M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29250K .......... .......... .......... .......... .......... 31% 156M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29300K .......... .......... .......... .......... .......... 31% 315M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29350K .......... .......... .......... .......... .......... 31% 184M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29400K .......... .......... .......... .......... .......... 31% 256M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29450K .......... .......... .......... .......... .......... 31% 278M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29500K .......... .......... .......... .......... .......... 31% 276M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29550K .......... .......... .......... .......... .......... 31% 213M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29600K .......... .......... .......... .......... .......... 31% 300M 0s 2024-08-27T02:59:53.761 INFO:teuthology.orchestra.run.smithi143.stderr: 29650K .......... .......... .......... .......... .......... 31% 341M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 29700K .......... .......... .......... .......... .......... 32% 176M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 29750K .......... .......... .......... .......... .......... 32% 126M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 29800K .......... .......... .......... .......... .......... 32% 235M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 29850K .......... .......... .......... .......... .......... 32% 322M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 29900K .......... .......... .......... .......... .......... 32% 320M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 29950K .......... .......... .......... .......... .......... 32% 236M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 30000K .......... .......... .......... .......... .......... 32% 245M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 30050K .......... .......... .......... .......... .......... 32% 330M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 30100K .......... .......... .......... .......... .......... 32% 294M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 30150K .......... .......... .......... .......... .......... 32% 252M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 30200K .......... .......... .......... .......... .......... 32% 290M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 30250K .......... .......... .......... .......... .......... 32% 316M 0s 2024-08-27T02:59:53.762 INFO:teuthology.orchestra.run.smithi143.stderr: 30300K .......... .......... .......... .......... .......... 32% 257M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30350K .......... .......... .......... .......... .......... 32% 244M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30400K .......... .......... .......... .......... .......... 32% 306M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30450K .......... .......... .......... .......... .......... 32% 323M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30500K .......... .......... .......... .......... .......... 32% 273M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30550K .......... .......... .......... .......... .......... 32% 251M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30600K .......... .......... .......... .......... .......... 32% 267M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30650K .......... .......... .......... .......... .......... 33% 305M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30700K .......... .......... .......... .......... .......... 33% 297M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30750K .......... .......... .......... .......... .......... 33% 192M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30800K .......... .......... .......... .......... .......... 33% 281M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30850K .......... .......... .......... .......... .......... 33% 287M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30900K .......... .......... .......... .......... .......... 33% 254M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 30950K .......... .......... .......... .......... .......... 33% 260M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 31000K .......... .......... .......... .......... .......... 33% 332M 0s 2024-08-27T02:59:53.763 INFO:teuthology.orchestra.run.smithi143.stderr: 31050K .......... .......... .......... .......... .......... 33% 343M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31100K .......... .......... .......... .......... .......... 33% 81.8M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31150K .......... .......... .......... .......... .......... 33% 195M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31200K .......... .......... .......... .......... .......... 33% 294M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31250K .......... .......... .......... .......... .......... 33% 297M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31300K .......... .......... .......... .......... .......... 33% 303M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31350K .......... .......... .......... .......... .......... 33% 124M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31400K .......... .......... .......... .......... .......... 33% 263M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31450K .......... .......... .......... .......... .......... 33% 305M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31500K .......... .......... .......... .......... .......... 33% 281M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31550K .......... .......... .......... .......... .......... 34% 241M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31600K .......... .......... .......... .......... .......... 34% 273M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31650K .......... .......... .......... .......... .......... 34% 335M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31700K .......... .......... .......... .......... .......... 34% 292M 0s 2024-08-27T02:59:53.764 INFO:teuthology.orchestra.run.smithi143.stderr: 31750K .......... .......... .......... .......... .......... 34% 259M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 31800K .......... .......... .......... .......... .......... 34% 297M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 31850K .......... .......... .......... .......... .......... 34% 313M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 31900K .......... .......... .......... .......... .......... 34% 301M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 31950K .......... .......... .......... .......... .......... 34% 273M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32000K .......... .......... .......... .......... .......... 34% 311M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32050K .......... .......... .......... .......... .......... 34% 287M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32100K .......... .......... .......... .......... .......... 34% 17.3M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32150K .......... .......... .......... .......... .......... 34% 195M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32200K .......... .......... .......... .......... .......... 34% 233M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32250K .......... .......... .......... .......... .......... 34% 228M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32300K .......... .......... .......... .......... .......... 34% 270M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32350K .......... .......... .......... .......... .......... 34% 197M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32400K .......... .......... .......... .......... .......... 34% 250M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32450K .......... .......... .......... .......... .......... 34% 281M 0s 2024-08-27T02:59:53.765 INFO:teuthology.orchestra.run.smithi143.stderr: 32500K .......... .......... .......... .......... .......... 35% 241M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32550K .......... .......... .......... .......... .......... 35% 219M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32600K .......... .......... .......... .......... .......... 35% 229M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32650K .......... .......... .......... .......... .......... 35% 275M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32700K .......... .......... .......... .......... .......... 35% 302M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32750K .......... .......... .......... .......... .......... 35% 218M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32800K .......... .......... .......... .......... .......... 35% 271M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32850K .......... .......... .......... .......... .......... 35% 212M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32900K .......... .......... .......... .......... .......... 35% 262M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 32950K .......... .......... .......... .......... .......... 35% 212M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 33000K .......... .......... .......... .......... .......... 35% 309M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 33050K .......... .......... .......... .......... .......... 35% 227M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 33100K .......... .......... .......... .......... .......... 35% 235M 0s 2024-08-27T02:59:53.766 INFO:teuthology.orchestra.run.smithi143.stderr: 33150K .......... .......... .......... .......... .......... 35% 203M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33200K .......... .......... .......... .......... .......... 35% 346M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33250K .......... .......... .......... .......... .......... 35% 351M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33300K .......... .......... .......... .......... .......... 35% 346M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33350K .......... .......... .......... .......... .......... 35% 313M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33400K .......... .......... .......... .......... .......... 36% 354M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33450K .......... .......... .......... .......... .......... 36% 294M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33500K .......... .......... .......... .......... .......... 36% 316M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33550K .......... .......... .......... .......... .......... 36% 236M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33600K .......... .......... .......... .......... .......... 36% 338M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33650K .......... .......... .......... .......... .......... 36% 333M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33700K .......... .......... .......... .......... .......... 36% 293M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33750K .......... .......... .......... .......... .......... 36% 272M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33800K .......... .......... .......... .......... .......... 36% 283M 0s 2024-08-27T02:59:53.767 INFO:teuthology.orchestra.run.smithi143.stderr: 33850K .......... .......... .......... .......... .......... 36% 285M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 33900K .......... .......... .......... .......... .......... 36% 314M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 33950K .......... .......... .......... .......... .......... 36% 204M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34000K .......... .......... .......... .......... .......... 36% 296M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34050K .......... .......... .......... .......... .......... 36% 247M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34100K .......... .......... .......... .......... .......... 36% 257M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34150K .......... .......... .......... .......... .......... 36% 261M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34200K .......... .......... .......... .......... .......... 36% 251M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34250K .......... .......... .......... .......... .......... 36% 273M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34300K .......... .......... .......... .......... .......... 36% 298M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34350K .......... .......... .......... .......... .......... 37% 217M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34400K .......... .......... .......... .......... .......... 37% 264M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34450K .......... .......... .......... .......... .......... 37% 267M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34500K .......... .......... .......... .......... .......... 37% 346M 0s 2024-08-27T02:59:53.768 INFO:teuthology.orchestra.run.smithi143.stderr: 34550K .......... .......... .......... .......... .......... 37% 256M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34600K .......... .......... .......... .......... .......... 37% 349M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34650K .......... .......... .......... .......... .......... 37% 362M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34700K .......... .......... .......... .......... .......... 37% 360M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34750K .......... .......... .......... .......... .......... 37% 264M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34800K .......... .......... .......... .......... .......... 37% 344M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34850K .......... .......... .......... .......... .......... 37% 330M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34900K .......... .......... .......... .......... .......... 37% 312M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 34950K .......... .......... .......... .......... .......... 37% 313M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 35000K .......... .......... .......... .......... .......... 37% 322M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 35050K .......... .......... .......... .......... .......... 37% 51.5M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 35100K .......... .......... .......... .......... .......... 37% 29.1M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 35150K .......... .......... .......... .......... .......... 37% 233M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 35200K .......... .......... .......... .......... .......... 37% 278M 0s 2024-08-27T02:59:53.769 INFO:teuthology.orchestra.run.smithi143.stderr: 35250K .......... .......... .......... .......... .......... 37% 285M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35300K .......... .......... .......... .......... .......... 38% 265M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35350K .......... .......... .......... .......... .......... 38% 220M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35400K .......... .......... .......... .......... .......... 38% 288M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35450K .......... .......... .......... .......... .......... 38% 343M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35500K .......... .......... .......... .......... .......... 38% 259M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35550K .......... .......... .......... .......... .......... 38% 216M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35600K .......... .......... .......... .......... .......... 38% 231M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35650K .......... .......... .......... .......... .......... 38% 289M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35700K .......... .......... .......... .......... .......... 38% 305M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35750K .......... .......... .......... .......... .......... 38% 300M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35800K .......... .......... .......... .......... .......... 38% 301M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35850K .......... .......... .......... .......... .......... 38% 306M 0s 2024-08-27T02:59:53.770 INFO:teuthology.orchestra.run.smithi143.stderr: 35900K .......... .......... .......... .......... .......... 38% 328M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 35950K .......... .......... .......... .......... .......... 38% 270M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36000K .......... .......... .......... .......... .......... 38% 336M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36050K .......... .......... .......... .......... .......... 38% 345M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36100K .......... .......... .......... .......... .......... 38% 301M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36150K .......... .......... .......... .......... .......... 38% 310M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36200K .......... .......... .......... .......... .......... 39% 284M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36250K .......... .......... .......... .......... .......... 39% 309M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36300K .......... .......... .......... .......... .......... 39% 298M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36350K .......... .......... .......... .......... .......... 39% 254M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36400K .......... .......... .......... .......... .......... 39% 295M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36450K .......... .......... .......... .......... .......... 39% 335M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36500K .......... .......... .......... .......... .......... 39% 346M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36550K .......... .......... .......... .......... .......... 39% 251M 0s 2024-08-27T02:59:53.771 INFO:teuthology.orchestra.run.smithi143.stderr: 36600K .......... .......... .......... .......... .......... 39% 258M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 36650K .......... .......... .......... .......... .......... 39% 246M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 36700K .......... .......... .......... .......... .......... 39% 268M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 36750K .......... .......... .......... .......... .......... 39% 219M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 36800K .......... .......... .......... .......... .......... 39% 297M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 36850K .......... .......... .......... .......... .......... 39% 316M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 36900K .......... .......... .......... .......... .......... 39% 282M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 36950K .......... .......... .......... .......... .......... 39% 214M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 37000K .......... .......... .......... .......... .......... 39% 292M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 37050K .......... .......... .......... .......... .......... 39% 297M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 37100K .......... .......... .......... .......... .......... 39% 270M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 37150K .......... .......... .......... .......... .......... 40% 296M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 37200K .......... .......... .......... .......... .......... 40% 346M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 37250K .......... .......... .......... .......... .......... 40% 330M 0s 2024-08-27T02:59:53.772 INFO:teuthology.orchestra.run.smithi143.stderr: 37300K .......... .......... .......... .......... .......... 40% 359M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37350K .......... .......... .......... .......... .......... 40% 326M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37400K .......... .......... .......... .......... .......... 40% 374M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37450K .......... .......... .......... .......... .......... 40% 368M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37500K .......... .......... .......... .......... .......... 40% 325M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37550K .......... .......... .......... .......... .......... 40% 31.9M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37600K .......... .......... .......... .......... .......... 40% 226M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37650K .......... .......... .......... .......... .......... 40% 282M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37700K .......... .......... .......... .......... .......... 40% 291M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37750K .......... .......... .......... .......... .......... 40% 230M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37800K .......... .......... .......... .......... .......... 40% 255M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37850K .......... .......... .......... .......... .......... 40% 328M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37900K .......... .......... .......... .......... .......... 40% 376M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 37950K .......... .......... .......... .......... .......... 40% 310M 0s 2024-08-27T02:59:53.773 INFO:teuthology.orchestra.run.smithi143.stderr: 38000K .......... .......... .......... .......... .......... 40% 374M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38050K .......... .......... .......... .......... .......... 41% 277M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38100K .......... .......... .......... .......... .......... 41% 310M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38150K .......... .......... .......... .......... .......... 41% 141M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38200K .......... .......... .......... .......... .......... 41% 264M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38250K .......... .......... .......... .......... .......... 41% 334M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38300K .......... .......... .......... .......... .......... 41% 346M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38350K .......... .......... .......... .......... .......... 41% 266M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38400K .......... .......... .......... .......... .......... 41% 332M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38450K .......... .......... .......... .......... .......... 41% 198M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38500K .......... .......... .......... .......... .......... 41% 281M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38550K .......... .......... .......... .......... .......... 41% 257M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38600K .......... .......... .......... .......... .......... 41% 253M 0s 2024-08-27T02:59:53.774 INFO:teuthology.orchestra.run.smithi143.stderr: 38650K .......... .......... .......... .......... .......... 41% 285M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 38700K .......... .......... .......... .......... .......... 41% 333M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 38750K .......... .......... .......... .......... .......... 41% 246M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 38800K .......... .......... .......... .......... .......... 41% 284M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 38850K .......... .......... .......... .......... .......... 41% 323M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 38900K .......... .......... .......... .......... .......... 41% 342M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 38950K .......... .......... .......... .......... .......... 41% 243M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39000K .......... .......... .......... .......... .......... 42% 365M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39050K .......... .......... .......... .......... .......... 42% 333M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39100K .......... .......... .......... .......... .......... 42% 162M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39150K .......... .......... .......... .......... .......... 42% 194M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39200K .......... .......... .......... .......... .......... 42% 323M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39250K .......... .......... .......... .......... .......... 42% 299M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39300K .......... .......... .......... .......... .......... 42% 281M 0s 2024-08-27T02:59:53.775 INFO:teuthology.orchestra.run.smithi143.stderr: 39350K .......... .......... .......... .......... .......... 42% 254M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39400K .......... .......... .......... .......... .......... 42% 319M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39450K .......... .......... .......... .......... .......... 42% 264M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39500K .......... .......... .......... .......... .......... 42% 374M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39550K .......... .......... .......... .......... .......... 42% 209M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39600K .......... .......... .......... .......... .......... 42% 259M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39650K .......... .......... .......... .......... .......... 42% 265M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39700K .......... .......... .......... .......... .......... 42% 305M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39750K .......... .......... .......... .......... .......... 42% 276M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39800K .......... .......... .......... .......... .......... 42% 320M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39850K .......... .......... .......... .......... .......... 42% 321M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39900K .......... .......... .......... .......... .......... 43% 274M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 39950K .......... .......... .......... .......... .......... 43% 237M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 40000K .......... .......... .......... .......... .......... 43% 295M 0s 2024-08-27T02:59:53.776 INFO:teuthology.orchestra.run.smithi143.stderr: 40050K .......... .......... .......... .......... .......... 43% 336M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40100K .......... .......... .......... .......... .......... 43% 383M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40150K .......... .......... .......... .......... .......... 43% 300M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40200K .......... .......... .......... .......... .......... 43% 377M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40250K .......... .......... .......... .......... .......... 43% 20.6M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40300K .......... .......... .......... .......... .......... 43% 315M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40350K .......... .......... .......... .......... .......... 43% 226M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40400K .......... .......... .......... .......... .......... 43% 291M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40450K .......... .......... .......... .......... .......... 43% 269M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40500K .......... .......... .......... .......... .......... 43% 238M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40550K .......... .......... .......... .......... .......... 43% 270M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40600K .......... .......... .......... .......... .......... 43% 353M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40650K .......... .......... .......... .......... .......... 43% 351M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40700K .......... .......... .......... .......... .......... 43% 370M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40750K .......... .......... .......... .......... .......... 43% 251M 0s 2024-08-27T02:59:53.777 INFO:teuthology.orchestra.run.smithi143.stderr: 40800K .......... .......... .......... .......... .......... 43% 260M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 40850K .......... .......... .......... .......... .......... 44% 328M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 40900K .......... .......... .......... .......... .......... 44% 301M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 40950K .......... .......... .......... .......... .......... 44% 308M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41000K .......... .......... .......... .......... .......... 44% 284M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41050K .......... .......... .......... .......... .......... 44% 251M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41100K .......... .......... .......... .......... .......... 44% 276M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41150K .......... .......... .......... .......... .......... 44% 238M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41200K .......... .......... .......... .......... .......... 44% 367M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41250K .......... .......... .......... .......... .......... 44% 344M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41300K .......... .......... .......... .......... .......... 44% 270M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41350K .......... .......... .......... .......... .......... 44% 266M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41400K .......... .......... .......... .......... .......... 44% 302M 0s 2024-08-27T02:59:53.778 INFO:teuthology.orchestra.run.smithi143.stderr: 41450K .......... .......... .......... .......... .......... 44% 325M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41500K .......... .......... .......... .......... .......... 44% 385M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41550K .......... .......... .......... .......... .......... 44% 318M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41600K .......... .......... .......... .......... .......... 44% 313M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41650K .......... .......... .......... .......... .......... 44% 371M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41700K .......... .......... .......... .......... .......... 44% 377M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41750K .......... .......... .......... .......... .......... 44% 310M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41800K .......... .......... .......... .......... .......... 45% 289M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41850K .......... .......... .......... .......... .......... 45% 351M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41900K .......... .......... .......... .......... .......... 45% 322M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 41950K .......... .......... .......... .......... .......... 45% 236M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 42000K .......... .......... .......... .......... .......... 45% 329M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 42050K .......... .......... .......... .......... .......... 45% 281M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 42100K .......... .......... .......... .......... .......... 45% 289M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 42150K .......... .......... .......... .......... .......... 45% 307M 0s 2024-08-27T02:59:53.779 INFO:teuthology.orchestra.run.smithi143.stderr: 42200K .......... .......... .......... .......... .......... 45% 322M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42250K .......... .......... .......... .......... .......... 45% 260M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42300K .......... .......... .......... .......... .......... 45% 350M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42350K .......... .......... .......... .......... .......... 45% 201M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42400K .......... .......... .......... .......... .......... 45% 288M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42450K .......... .......... .......... .......... .......... 45% 358M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42500K .......... .......... .......... .......... .......... 45% 291M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42550K .......... .......... .......... .......... .......... 45% 239M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42600K .......... .......... .......... .......... .......... 45% 322M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42650K .......... .......... .......... .......... .......... 45% 332M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42700K .......... .......... .......... .......... .......... 46% 360M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42750K .......... .......... .......... .......... .......... 46% 335M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42800K .......... .......... .......... .......... .......... 46% 392M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42850K .......... .......... .......... .......... .......... 46% 298M 0s 2024-08-27T02:59:53.780 INFO:teuthology.orchestra.run.smithi143.stderr: 42900K .......... .......... .......... .......... .......... 46% 306M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 42950K .......... .......... .......... .......... .......... 46% 280M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43000K .......... .......... .......... .......... .......... 46% 342M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43050K .......... .......... .......... .......... .......... 46% 349M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43100K .......... .......... .......... .......... .......... 46% 20.2M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43150K .......... .......... .......... .......... .......... 46% 260M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43200K .......... .......... .......... .......... .......... 46% 318M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43250K .......... .......... .......... .......... .......... 46% 361M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43300K .......... .......... .......... .......... .......... 46% 315M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43350K .......... .......... .......... .......... .......... 46% 285M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43400K .......... .......... .......... .......... .......... 46% 334M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43450K .......... .......... .......... .......... .......... 46% 325M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43500K .......... .......... .......... .......... .......... 46% 366M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43550K .......... .......... .......... .......... .......... 46% 288M 0s 2024-08-27T02:59:53.781 INFO:teuthology.orchestra.run.smithi143.stderr: 43600K .......... .......... .......... .......... .......... 46% 164M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 43650K .......... .......... .......... .......... .......... 47% 322M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 43700K .......... .......... .......... .......... .......... 47% 303M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 43750K .......... .......... .......... .......... .......... 47% 284M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 43800K .......... .......... .......... .......... .......... 47% 345M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 43850K .......... .......... .......... .......... .......... 47% 356M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 43900K .......... .......... .......... .......... .......... 47% 347M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 43950K .......... .......... .......... .......... .......... 47% 278M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 44000K .......... .......... .......... .......... .......... 47% 316M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 44050K .......... .......... .......... .......... .......... 47% 268M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 44100K .......... .......... .......... .......... .......... 47% 309M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 44150K .......... .......... .......... .......... .......... 47% 333M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 44200K .......... .......... .......... .......... .......... 47% 250M 0s 2024-08-27T02:59:53.782 INFO:teuthology.orchestra.run.smithi143.stderr: 44250K .......... .......... .......... .......... .......... 47% 270M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44300K .......... .......... .......... .......... .......... 47% 244M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44350K .......... .......... .......... .......... .......... 47% 240M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44400K .......... .......... .......... .......... .......... 47% 250M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44450K .......... .......... .......... .......... .......... 47% 294M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44500K .......... .......... .......... .......... .......... 47% 298M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44550K .......... .......... .......... .......... .......... 48% 263M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44600K .......... .......... .......... .......... .......... 48% 276M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44650K .......... .......... .......... .......... .......... 48% 313M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44700K .......... .......... .......... .......... .......... 48% 373M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44750K .......... .......... .......... .......... .......... 48% 218M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44800K .......... .......... .......... .......... .......... 48% 327M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44850K .......... .......... .......... .......... .......... 48% 286M 0s 2024-08-27T02:59:53.783 INFO:teuthology.orchestra.run.smithi143.stderr: 44900K .......... .......... .......... .......... .......... 48% 279M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 44950K .......... .......... .......... .......... .......... 48% 336M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45000K .......... .......... .......... .......... .......... 48% 337M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45050K .......... .......... .......... .......... .......... 48% 381M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45100K .......... .......... .......... .......... .......... 48% 302M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45150K .......... .......... .......... .......... .......... 48% 190M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45200K .......... .......... .......... .......... .......... 48% 309M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45250K .......... .......... .......... .......... .......... 48% 314M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45300K .......... .......... .......... .......... .......... 48% 303M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45350K .......... .......... .......... .......... .......... 48% 280M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45400K .......... .......... .......... .......... .......... 48% 332M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45450K .......... .......... .......... .......... .......... 48% 346M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45500K .......... .......... .......... .......... .......... 49% 324M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45550K .......... .......... .......... .......... .......... 49% 271M 0s 2024-08-27T02:59:53.784 INFO:teuthology.orchestra.run.smithi143.stderr: 45600K .......... .......... .......... .......... .......... 49% 391M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 45650K .......... .......... .......... .......... .......... 49% 335M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 45700K .......... .......... .......... .......... .......... 49% 300M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 45750K .......... .......... .......... .......... .......... 49% 261M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 45800K .......... .......... .......... .......... .......... 49% 284M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 45850K .......... .......... .......... .......... .......... 49% 369M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 45900K .......... .......... .......... .......... .......... 49% 346M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 45950K .......... .......... .......... .......... .......... 49% 325M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 46000K .......... .......... .......... .......... .......... 49% 398M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 46050K .......... .......... .......... .......... .......... 49% 23.2M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 46100K .......... .......... .......... .......... .......... 49% 285M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 46150K .......... .......... .......... .......... .......... 49% 290M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 46200K .......... .......... .......... .......... .......... 49% 335M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 46250K .......... .......... .......... .......... .......... 49% 317M 0s 2024-08-27T02:59:53.785 INFO:teuthology.orchestra.run.smithi143.stderr: 46300K .......... .......... .......... .......... .......... 49% 320M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46350K .......... .......... .......... .......... .......... 49% 285M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46400K .......... .......... .......... .......... .......... 49% 323M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46450K .......... .......... .......... .......... .......... 50% 359M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46500K .......... .......... .......... .......... .......... 50% 129M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46550K .......... .......... .......... .......... .......... 50% 290M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46600K .......... .......... .......... .......... .......... 50% 376M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46650K .......... .......... .......... .......... .......... 50% 347M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46700K .......... .......... .......... .......... .......... 50% 347M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46750K .......... .......... .......... .......... .......... 50% 272M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46800K .......... .......... .......... .......... .......... 50% 348M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46850K .......... .......... .......... .......... .......... 50% 314M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46900K .......... .......... .......... .......... .......... 50% 306M 0s 2024-08-27T02:59:53.786 INFO:teuthology.orchestra.run.smithi143.stderr: 46950K .......... .......... .......... .......... .......... 50% 316M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47000K .......... .......... .......... .......... .......... 50% 288M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47050K .......... .......... .......... .......... .......... 50% 327M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47100K .......... .......... .......... .......... .......... 50% 364M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47150K .......... .......... .......... .......... .......... 50% 248M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47200K .......... .......... .......... .......... .......... 50% 308M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47250K .......... .......... .......... .......... .......... 50% 364M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47300K .......... .......... .......... .......... .......... 50% 299M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47350K .......... .......... .......... .......... .......... 51% 215M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47400K .......... .......... .......... .......... .......... 51% 281M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47450K .......... .......... .......... .......... .......... 51% 346M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47500K .......... .......... .......... .......... .......... 51% 324M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47550K .......... .......... .......... .......... .......... 51% 268M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47600K .......... .......... .......... .......... .......... 51% 284M 0s 2024-08-27T02:59:53.787 INFO:teuthology.orchestra.run.smithi143.stderr: 47650K .......... .......... .......... .......... .......... 51% 336M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 47700K .......... .......... .......... .......... .......... 51% 240M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 47750K .......... .......... .......... .......... .......... 51% 251M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 47800K .......... .......... .......... .......... .......... 51% 308M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 47850K .......... .......... .......... .......... .......... 51% 318M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 47900K .......... .......... .......... .......... .......... 51% 330M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 47950K .......... .......... .......... .......... .......... 51% 304M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48000K .......... .......... .......... .......... .......... 51% 188M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48050K .......... .......... .......... .......... .......... 51% 301M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48100K .......... .......... .......... .......... .......... 51% 305M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48150K .......... .......... .......... .......... .......... 51% 238M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48200K .......... .......... .......... .......... .......... 51% 388M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48250K .......... .......... .......... .......... .......... 51% 297M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48300K .......... .......... .......... .......... .......... 52% 299M 0s 2024-08-27T02:59:53.788 INFO:teuthology.orchestra.run.smithi143.stderr: 48350K .......... .......... .......... .......... .......... 52% 315M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48400K .......... .......... .......... .......... .......... 52% 324M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48450K .......... .......... .......... .......... .......... 52% 307M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48500K .......... .......... .......... .......... .......... 52% 311M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48550K .......... .......... .......... .......... .......... 52% 317M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48600K .......... .......... .......... .......... .......... 52% 182M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48650K .......... .......... .......... .......... .......... 52% 281M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48700K .......... .......... .......... .......... .......... 52% 342M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48750K .......... .......... .......... .......... .......... 52% 260M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48800K .......... .......... .......... .......... .......... 52% 328M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48850K .......... .......... .......... .......... .......... 52% 376M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48900K .......... .......... .......... .......... .......... 52% 23.3M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 48950K .......... .......... .......... .......... .......... 52% 235M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 49000K .......... .......... .......... .......... .......... 52% 300M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 49050K .......... .......... .......... .......... .......... 52% 342M 0s 2024-08-27T02:59:53.789 INFO:teuthology.orchestra.run.smithi143.stderr: 49100K .......... .......... .......... .......... .......... 52% 323M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49150K .......... .......... .......... .......... .......... 52% 273M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49200K .......... .......... .......... .......... .......... 53% 352M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49250K .......... .......... .......... .......... .......... 53% 289M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49300K .......... .......... .......... .......... .......... 53% 335M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49350K .......... .......... .......... .......... .......... 53% 303M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49400K .......... .......... .......... .......... .......... 53% 319M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49450K .......... .......... .......... .......... .......... 53% 343M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49500K .......... .......... .......... .......... .......... 53% 394M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49550K .......... .......... .......... .......... .......... 53% 286M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49600K .......... .......... .......... .......... .......... 53% 258M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49650K .......... .......... .......... .......... .......... 53% 284M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49700K .......... .......... .......... .......... .......... 53% 274M 0s 2024-08-27T02:59:53.790 INFO:teuthology.orchestra.run.smithi143.stderr: 49750K .......... .......... .......... .......... .......... 53% 276M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 49800K .......... .......... .......... .......... .......... 53% 329M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 49850K .......... .......... .......... .......... .......... 53% 306M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 49900K .......... .......... .......... .......... .......... 53% 312M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 49950K .......... .......... .......... .......... .......... 53% 302M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50000K .......... .......... .......... .......... .......... 53% 342M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50050K .......... .......... .......... .......... .......... 53% 189M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50100K .......... .......... .......... .......... .......... 53% 297M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50150K .......... .......... .......... .......... .......... 54% 259M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50200K .......... .......... .......... .......... .......... 54% 310M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50250K .......... .......... .......... .......... .......... 54% 267M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50300K .......... .......... .......... .......... .......... 54% 356M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50350K .......... .......... .......... .......... .......... 54% 272M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50400K .......... .......... .......... .......... .......... 54% 299M 0s 2024-08-27T02:59:53.791 INFO:teuthology.orchestra.run.smithi143.stderr: 50450K .......... .......... .......... .......... .......... 54% 351M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50500K .......... .......... .......... .......... .......... 54% 316M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50550K .......... .......... .......... .......... .......... 54% 323M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50600K .......... .......... .......... .......... .......... 54% 331M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50650K .......... .......... .......... .......... .......... 54% 314M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50700K .......... .......... .......... .......... .......... 54% 388M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50750K .......... .......... .......... .......... .......... 54% 281M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50800K .......... .......... .......... .......... .......... 54% 291M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50850K .......... .......... .......... .......... .......... 54% 378M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50900K .......... .......... .......... .......... .......... 54% 361M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 50950K .......... .......... .......... .......... .......... 54% 154M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 51000K .......... .......... .......... .......... .......... 54% 344M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 51050K .......... .......... .......... .......... .......... 55% 287M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 51100K .......... .......... .......... .......... .......... 55% 327M 0s 2024-08-27T02:59:53.792 INFO:teuthology.orchestra.run.smithi143.stderr: 51150K .......... .......... .......... .......... .......... 55% 329M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51200K .......... .......... .......... .......... .......... 55% 324M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51250K .......... .......... .......... .......... .......... 55% 301M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51300K .......... .......... .......... .......... .......... 55% 401M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51350K .......... .......... .......... .......... .......... 55% 330M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51400K .......... .......... .......... .......... .......... 55% 225M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51450K .......... .......... .......... .......... .......... 55% 343M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51500K .......... .......... .......... .......... .......... 55% 161M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51550K .......... .......... .......... .......... .......... 55% 257M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51600K .......... .......... .......... .......... .......... 55% 291M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51650K .......... .......... .......... .......... .......... 55% 265M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51700K .......... .......... .......... .......... .......... 55% 281M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51750K .......... .......... .......... .......... .......... 55% 337M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51800K .......... .......... .......... .......... .......... 55% 368M 0s 2024-08-27T02:59:53.793 INFO:teuthology.orchestra.run.smithi143.stderr: 51850K .......... .......... .......... .......... .......... 55% 23.8M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 51900K .......... .......... .......... .......... .......... 55% 334M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 51950K .......... .......... .......... .......... .......... 55% 267M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52000K .......... .......... .......... .......... .......... 56% 343M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52050K .......... .......... .......... .......... .......... 56% 351M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52100K .......... .......... .......... .......... .......... 56% 383M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52150K .......... .......... .......... .......... .......... 56% 191M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52200K .......... .......... .......... .......... .......... 56% 330M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52250K .......... .......... .......... .......... .......... 56% 304M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52300K .......... .......... .......... .......... .......... 56% 409M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52350K .......... .......... .......... .......... .......... 56% 325M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52400K .......... .......... .......... .......... .......... 56% 356M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52450K .......... .......... .......... .......... .......... 56% 385M 0s 2024-08-27T02:59:53.794 INFO:teuthology.orchestra.run.smithi143.stderr: 52500K .......... .......... .......... .......... .......... 56% 407M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52550K .......... .......... .......... .......... .......... 56% 163M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52600K .......... .......... .......... .......... .......... 56% 333M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52650K .......... .......... .......... .......... .......... 56% 346M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52700K .......... .......... .......... .......... .......... 56% 350M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52750K .......... .......... .......... .......... .......... 56% 290M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52800K .......... .......... .......... .......... .......... 56% 378M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52850K .......... .......... .......... .......... .......... 56% 305M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52900K .......... .......... .......... .......... .......... 56% 327M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 52950K .......... .......... .......... .......... .......... 57% 105M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 53000K .......... .......... .......... .......... .......... 57% 273M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 53050K .......... .......... .......... .......... .......... 57% 287M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 53100K .......... .......... .......... .......... .......... 57% 320M 0s 2024-08-27T02:59:53.795 INFO:teuthology.orchestra.run.smithi143.stderr: 53150K .......... .......... .......... .......... .......... 57% 272M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53200K .......... .......... .......... .......... .......... 57% 356M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53250K .......... .......... .......... .......... .......... 57% 357M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53300K .......... .......... .......... .......... .......... 57% 336M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53350K .......... .......... .......... .......... .......... 57% 288M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53400K .......... .......... .......... .......... .......... 57% 348M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53450K .......... .......... .......... .......... .......... 57% 320M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53500K .......... .......... .......... .......... .......... 57% 344M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53550K .......... .......... .......... .......... .......... 57% 296M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53600K .......... .......... .......... .......... .......... 57% 391M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53650K .......... .......... .......... .......... .......... 57% 350M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53700K .......... .......... .......... .......... .......... 57% 351M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53750K .......... .......... .......... .......... .......... 57% 312M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53800K .......... .......... .......... .......... .......... 57% 387M 0s 2024-08-27T02:59:53.796 INFO:teuthology.orchestra.run.smithi143.stderr: 53850K .......... .......... .......... .......... .......... 58% 245M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 53900K .......... .......... .......... .......... .......... 58% 230M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 53950K .......... .......... .......... .......... .......... 58% 228M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54000K .......... .......... .......... .......... .......... 58% 285M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54050K .......... .......... .......... .......... .......... 58% 340M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54100K .......... .......... .......... .......... .......... 58% 347M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54150K .......... .......... .......... .......... .......... 58% 274M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54200K .......... .......... .......... .......... .......... 58% 289M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54250K .......... .......... .......... .......... .......... 58% 369M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54300K .......... .......... .......... .......... .......... 58% 288M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54350K .......... .......... .......... .......... .......... 58% 295M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54400K .......... .......... .......... .......... .......... 58% 438M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54450K .......... .......... .......... .......... .......... 58% 222M 0s 2024-08-27T02:59:53.797 INFO:teuthology.orchestra.run.smithi143.stderr: 54500K .......... .......... .......... .......... .......... 58% 267M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54550K .......... .......... .......... .......... .......... 58% 312M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54600K .......... .......... .......... .......... .......... 58% 314M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54650K .......... .......... .......... .......... .......... 58% 239M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54700K .......... .......... .......... .......... .......... 58% 400M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54750K .......... .......... .......... .......... .......... 58% 21.7M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54800K .......... .......... .......... .......... .......... 59% 315M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54850K .......... .......... .......... .......... .......... 59% 277M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54900K .......... .......... .......... .......... .......... 59% 301M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 54950K .......... .......... .......... .......... .......... 59% 330M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 55000K .......... .......... .......... .......... .......... 59% 362M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 55050K .......... .......... .......... .......... .......... 59% 240M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 55100K .......... .......... .......... .......... .......... 59% 374M 0s 2024-08-27T02:59:53.798 INFO:teuthology.orchestra.run.smithi143.stderr: 55150K .......... .......... .......... .......... .......... 59% 386M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55200K .......... .......... .......... .......... .......... 59% 368M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55250K .......... .......... .......... .......... .......... 59% 319M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55300K .......... .......... .......... .......... .......... 59% 354M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55350K .......... .......... .......... .......... .......... 59% 316M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55400K .......... .......... .......... .......... .......... 59% 177M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55450K .......... .......... .......... .......... .......... 59% 338M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55500K .......... .......... .......... .......... .......... 59% 307M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55550K .......... .......... .......... .......... .......... 59% 242M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55600K .......... .......... .......... .......... .......... 59% 341M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55650K .......... .......... .......... .......... .......... 59% 287M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55700K .......... .......... .......... .......... .......... 60% 306M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55750K .......... .......... .......... .......... .......... 60% 330M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55800K .......... .......... .......... .......... .......... 60% 374M 0s 2024-08-27T02:59:53.799 INFO:teuthology.orchestra.run.smithi143.stderr: 55850K .......... .......... .......... .......... .......... 60% 324M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 55900K .......... .......... .......... .......... .......... 60% 174M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 55950K .......... .......... .......... .......... .......... 60% 263M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56000K .......... .......... .......... .......... .......... 60% 222M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56050K .......... .......... .......... .......... .......... 60% 298M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56100K .......... .......... .......... .......... .......... 60% 350M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56150K .......... .......... .......... .......... .......... 60% 306M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56200K .......... .......... .......... .......... .......... 60% 292M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56250K .......... .......... .......... .......... .......... 60% 354M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56300K .......... .......... .......... .......... .......... 60% 364M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56350K .......... .......... .......... .......... .......... 60% 278M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56400K .......... .......... .......... .......... .......... 60% 340M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56450K .......... .......... .......... .......... .......... 60% 313M 0s 2024-08-27T02:59:53.800 INFO:teuthology.orchestra.run.smithi143.stderr: 56500K .......... .......... .......... .......... .......... 60% 304M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56550K .......... .......... .......... .......... .......... 60% 249M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56600K .......... .......... .......... .......... .......... 60% 346M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56650K .......... .......... .......... .......... .......... 61% 384M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56700K .......... .......... .......... .......... .......... 61% 390M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56750K .......... .......... .......... .......... .......... 61% 343M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56800K .......... .......... .......... .......... .......... 61% 255M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56850K .......... .......... .......... .......... .......... 61% 351M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56900K .......... .......... .......... .......... .......... 61% 384M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 56950K .......... .......... .......... .......... .......... 61% 321M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 57000K .......... .......... .......... .......... .......... 61% 169M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 57050K .......... .......... .......... .......... .......... 61% 329M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 57100K .......... .......... .......... .......... .......... 61% 346M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 57150K .......... .......... .......... .......... .......... 61% 339M 0s 2024-08-27T02:59:53.801 INFO:teuthology.orchestra.run.smithi143.stderr: 57200K .......... .......... .......... .......... .......... 61% 328M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57250K .......... .......... .......... .......... .......... 61% 385M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57300K .......... .......... .......... .......... .......... 61% 380M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57350K .......... .......... .......... .......... .......... 61% 131M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57400K .......... .......... .......... .......... .......... 61% 364M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57450K .......... .......... .......... .......... .......... 61% 277M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57500K .......... .......... .......... .......... .......... 61% 395M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57550K .......... .......... .......... .......... .......... 62% 199M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57600K .......... .......... .......... .......... .......... 62% 319M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57650K .......... .......... .......... .......... .......... 62% 357M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57700K .......... .......... .......... .......... .......... 62% 19.5M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57750K .......... .......... .......... .......... .......... 62% 277M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57800K .......... .......... .......... .......... .......... 62% 316M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57850K .......... .......... .......... .......... .......... 62% 309M 0s 2024-08-27T02:59:53.802 INFO:teuthology.orchestra.run.smithi143.stderr: 57900K .......... .......... .......... .......... .......... 62% 314M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 57950K .......... .......... .......... .......... .......... 62% 265M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58000K .......... .......... .......... .......... .......... 62% 347M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58050K .......... .......... .......... .......... .......... 62% 332M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58100K .......... .......... .......... .......... .......... 62% 419M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58150K .......... .......... .......... .......... .......... 62% 323M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58200K .......... .......... .......... .......... .......... 62% 416M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58250K .......... .......... .......... .......... .......... 62% 252M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58300K .......... .......... .......... .......... .......... 62% 285M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58350K .......... .......... .......... .......... .......... 62% 238M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58400K .......... .......... .......... .......... .......... 62% 375M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58450K .......... .......... .......... .......... .......... 62% 316M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58500K .......... .......... .......... .......... .......... 63% 296M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58550K .......... .......... .......... .......... .......... 63% 276M 0s 2024-08-27T02:59:53.803 INFO:teuthology.orchestra.run.smithi143.stderr: 58600K .......... .......... .......... .......... .......... 63% 309M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 58650K .......... .......... .......... .......... .......... 63% 399M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 58700K .......... .......... .......... .......... .......... 63% 403M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 58750K .......... .......... .......... .......... .......... 63% 319M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 58800K .......... .......... .......... .......... .......... 63% 328M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 58850K .......... .......... .......... .......... .......... 63% 380M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 58900K .......... .......... .......... .......... .......... 63% 357M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 58950K .......... .......... .......... .......... .......... 63% 314M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 59000K .......... .......... .......... .......... .......... 63% 374M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 59050K .......... .......... .......... .......... .......... 63% 344M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 59100K .......... .......... .......... .......... .......... 63% 333M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 59150K .......... .......... .......... .......... .......... 63% 303M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 59200K .......... .......... .......... .......... .......... 63% 359M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 59250K .......... .......... .......... .......... .......... 63% 398M 0s 2024-08-27T02:59:53.804 INFO:teuthology.orchestra.run.smithi143.stderr: 59300K .......... .......... .......... .......... .......... 63% 316M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59350K .......... .......... .......... .......... .......... 63% 333M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59400K .......... .......... .......... .......... .......... 63% 320M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59450K .......... .......... .......... .......... .......... 64% 349M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59500K .......... .......... .......... .......... .......... 64% 385M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59550K .......... .......... .......... .......... .......... 64% 215M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59600K .......... .......... .......... .......... .......... 64% 362M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59650K .......... .......... .......... .......... .......... 64% 397M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59700K .......... .......... .......... .......... .......... 64% 194M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59750K .......... .......... .......... .......... .......... 64% 280M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59800K .......... .......... .......... .......... .......... 64% 346M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59850K .......... .......... .......... .......... .......... 64% 338M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59900K .......... .......... .......... .......... .......... 64% 273M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 59950K .......... .......... .......... .......... .......... 64% 233M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 60000K .......... .......... .......... .......... .......... 64% 390M 0s 2024-08-27T02:59:53.805 INFO:teuthology.orchestra.run.smithi143.stderr: 60050K .......... .......... .......... .......... .......... 64% 254M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60100K .......... .......... .......... .......... .......... 64% 308M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60150K .......... .......... .......... .......... .......... 64% 267M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60200K .......... .......... .......... .......... .......... 64% 373M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60250K .......... .......... .......... .......... .......... 64% 405M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60300K .......... .......... .......... .......... .......... 64% 253M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60350K .......... .......... .......... .......... .......... 65% 262M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60400K .......... .......... .......... .......... .......... 65% 304M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60450K .......... .......... .......... .......... .......... 65% 338M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60500K .......... .......... .......... .......... .......... 65% 191M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60550K .......... .......... .......... .......... .......... 65% 288M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60600K .......... .......... .......... .......... .......... 65% 358M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60650K .......... .......... .......... .......... .......... 65% 379M 0s 2024-08-27T02:59:53.806 INFO:teuthology.orchestra.run.smithi143.stderr: 60700K .......... .......... .......... .......... .......... 65% 21.6M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 60750K .......... .......... .......... .......... .......... 65% 96.9M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 60800K .......... .......... .......... .......... .......... 65% 339M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 60850K .......... .......... .......... .......... .......... 65% 373M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 60900K .......... .......... .......... .......... .......... 65% 365M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 60950K .......... .......... .......... .......... .......... 65% 341M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61000K .......... .......... .......... .......... .......... 65% 403M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61050K .......... .......... .......... .......... .......... 65% 392M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61100K .......... .......... .......... .......... .......... 65% 85.8M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61150K .......... .......... .......... .......... .......... 65% 258M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61200K .......... .......... .......... .......... .......... 65% 372M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61250K .......... .......... .......... .......... .......... 65% 350M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61300K .......... .......... .......... .......... .......... 66% 395M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61350K .......... .......... .......... .......... .......... 66% 369M 0s 2024-08-27T02:59:53.807 INFO:teuthology.orchestra.run.smithi143.stderr: 61400K .......... .......... .......... .......... .......... 66% 311M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61450K .......... .......... .......... .......... .......... 66% 350M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61500K .......... .......... .......... .......... .......... 66% 240M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61550K .......... .......... .......... .......... .......... 66% 305M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61600K .......... .......... .......... .......... .......... 66% 299M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61650K .......... .......... .......... .......... .......... 66% 329M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61700K .......... .......... .......... .......... .......... 66% 288M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61750K .......... .......... .......... .......... .......... 66% 276M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61800K .......... .......... .......... .......... .......... 66% 297M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61850K .......... .......... .......... .......... .......... 66% 298M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61900K .......... .......... .......... .......... .......... 66% 250M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 61950K .......... .......... .......... .......... .......... 66% 353M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 62000K .......... .......... .......... .......... .......... 66% 303M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 62050K .......... .......... .......... .......... .......... 66% 357M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 62100K .......... .......... .......... .......... .......... 66% 310M 0s 2024-08-27T02:59:53.808 INFO:teuthology.orchestra.run.smithi143.stderr: 62150K .......... .......... .......... .......... .......... 66% 339M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62200K .......... .......... .......... .......... .......... 67% 362M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62250K .......... .......... .......... .......... .......... 67% 357M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62300K .......... .......... .......... .......... .......... 67% 251M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62350K .......... .......... .......... .......... .......... 67% 278M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62400K .......... .......... .......... .......... .......... 67% 370M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62450K .......... .......... .......... .......... .......... 67% 338M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62500K .......... .......... .......... .......... .......... 67% 247M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62550K .......... .......... .......... .......... .......... 67% 390M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62600K .......... .......... .......... .......... .......... 67% 423M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62650K .......... .......... .......... .......... .......... 67% 393M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62700K .......... .......... .......... .......... .......... 67% 342M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62750K .......... .......... .......... .......... .......... 67% 372M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62800K .......... .......... .......... .......... .......... 67% 384M 0s 2024-08-27T02:59:53.809 INFO:teuthology.orchestra.run.smithi143.stderr: 62850K .......... .......... .......... .......... .......... 67% 369M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 62900K .......... .......... .......... .......... .......... 67% 317M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 62950K .......... .......... .......... .......... .......... 67% 394M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63000K .......... .......... .......... .......... .......... 67% 363M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63050K .......... .......... .......... .......... .......... 67% 394M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63100K .......... .......... .......... .......... .......... 67% 311M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63150K .......... .......... .......... .......... .......... 68% 368M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63200K .......... .......... .......... .......... .......... 68% 319M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63250K .......... .......... .......... .......... .......... 68% 353M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63300K .......... .......... .......... .......... .......... 68% 325M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63350K .......... .......... .......... .......... .......... 68% 397M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63400K .......... .......... .......... .......... .......... 68% 364M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63450K .......... .......... .......... .......... .......... 68% 359M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63500K .......... .......... .......... .......... .......... 68% 274M 0s 2024-08-27T02:59:53.810 INFO:teuthology.orchestra.run.smithi143.stderr: 63550K .......... .......... .......... .......... .......... 68% 314M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63600K .......... .......... .......... .......... .......... 68% 337M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63650K .......... .......... .......... .......... .......... 68% 23.1M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63700K .......... .......... .......... .......... .......... 68% 309M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63750K .......... .......... .......... .......... .......... 68% 99.1M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63800K .......... .......... .......... .......... .......... 68% 226M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63850K .......... .......... .......... .......... .......... 68% 364M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63900K .......... .......... .......... .......... .......... 68% 246M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 63950K .......... .......... .......... .......... .......... 68% 296M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 64000K .......... .......... .......... .......... .......... 68% 348M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 64050K .......... .......... .......... .......... .......... 68% 350M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 64100K .......... .......... .......... .......... .......... 69% 136M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 64150K .......... .......... .......... .......... .......... 69% 277M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 64200K .......... .......... .......... .......... .......... 69% 364M 0s 2024-08-27T02:59:53.811 INFO:teuthology.orchestra.run.smithi143.stderr: 64250K .......... .......... .......... .......... .......... 69% 213M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64300K .......... .......... .......... .......... .......... 69% 211M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64350K .......... .......... .......... .......... .......... 69% 355M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64400K .......... .......... .......... .......... .......... 69% 335M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64450K .......... .......... .......... .......... .......... 69% 299M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64500K .......... .......... .......... .......... .......... 69% 283M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64550K .......... .......... .......... .......... .......... 69% 320M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64600K .......... .......... .......... .......... .......... 69% 360M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64650K .......... .......... .......... .......... .......... 69% 316M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64700K .......... .......... .......... .......... .......... 69% 257M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64750K .......... .......... .......... .......... .......... 69% 301M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64800K .......... .......... .......... .......... .......... 69% 338M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64850K .......... .......... .......... .......... .......... 69% 390M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64900K .......... .......... .......... .......... .......... 69% 305M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 64950K .......... .......... .......... .......... .......... 69% 329M 0s 2024-08-27T02:59:53.812 INFO:teuthology.orchestra.run.smithi143.stderr: 65000K .......... .......... .......... .......... .......... 70% 314M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65050K .......... .......... .......... .......... .......... 70% 334M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65100K .......... .......... .......... .......... .......... 70% 310M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65150K .......... .......... .......... .......... .......... 70% 365M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65200K .......... .......... .......... .......... .......... 70% 402M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65250K .......... .......... .......... .......... .......... 70% 215M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65300K .......... .......... .......... .......... .......... 70% 272M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65350K .......... .......... .......... .......... .......... 70% 373M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65400K .......... .......... .......... .......... .......... 70% 352M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65450K .......... .......... .......... .......... .......... 70% 176M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65500K .......... .......... .......... .......... .......... 70% 264M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65550K .......... .......... .......... .......... .......... 70% 293M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65600K .......... .......... .......... .......... .......... 70% 349M 0s 2024-08-27T02:59:53.813 INFO:teuthology.orchestra.run.smithi143.stderr: 65650K .......... .......... .......... .......... .......... 70% 227M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 65700K .......... .......... .......... .......... .......... 70% 251M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 65750K .......... .......... .......... .......... .......... 70% 264M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 65800K .......... .......... .......... .......... .......... 70% 330M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 65850K .......... .......... .......... .......... .......... 70% 330M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 65900K .......... .......... .......... .......... .......... 70% 314M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 65950K .......... .......... .......... .......... .......... 71% 334M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66000K .......... .......... .......... .......... .......... 71% 289M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66050K .......... .......... .......... .......... .......... 71% 306M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66100K .......... .......... .......... .......... .......... 71% 278M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66150K .......... .......... .......... .......... .......... 71% 405M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66200K .......... .......... .......... .......... .......... 71% 407M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66250K .......... .......... .......... .......... .......... 71% 316M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66300K .......... .......... .......... .......... .......... 71% 248M 0s 2024-08-27T02:59:53.814 INFO:teuthology.orchestra.run.smithi143.stderr: 66350K .......... .......... .......... .......... .......... 71% 287M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66400K .......... .......... .......... .......... .......... 71% 318M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66450K .......... .......... .......... .......... .......... 71% 364M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66500K .......... .......... .......... .......... .......... 71% 327M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66550K .......... .......... .......... .......... .......... 71% 397M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66600K .......... .......... .......... .......... .......... 71% 30.7M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66650K .......... .......... .......... .......... .......... 71% 265M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66700K .......... .......... .......... .......... .......... 71% 127M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66750K .......... .......... .......... .......... .......... 71% 355M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66800K .......... .......... .......... .......... .......... 71% 342M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66850K .......... .......... .......... .......... .......... 72% 155M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66900K .......... .......... .......... .......... .......... 72% 331M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 66950K .......... .......... .......... .......... .......... 72% 331M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 67000K .......... .......... .......... .......... .......... 72% 308M 0s 2024-08-27T02:59:53.815 INFO:teuthology.orchestra.run.smithi143.stderr: 67050K .......... .......... .......... .......... .......... 72% 105M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67100K .......... .......... .......... .......... .......... 72% 277M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67150K .......... .......... .......... .......... .......... 72% 300M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67200K .......... .......... .......... .......... .......... 72% 363M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67250K .......... .......... .......... .......... .......... 72% 348M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67300K .......... .......... .......... .......... .......... 72% 224M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67350K .......... .......... .......... .......... .......... 72% 233M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67400K .......... .......... .......... .......... .......... 72% 321M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67450K .......... .......... .......... .......... .......... 72% 339M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67500K .......... .......... .......... .......... .......... 72% 305M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67550K .......... .......... .......... .......... .......... 72% 305M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67600K .......... .......... .......... .......... .......... 72% 386M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67650K .......... .......... .......... .......... .......... 72% 301M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67700K .......... .......... .......... .......... .......... 72% 282M 0s 2024-08-27T02:59:53.816 INFO:teuthology.orchestra.run.smithi143.stderr: 67750K .......... .......... .......... .......... .......... 72% 296M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 67800K .......... .......... .......... .......... .......... 73% 404M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 67850K .......... .......... .......... .......... .......... 73% 284M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 67900K .......... .......... .......... .......... .......... 73% 259M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 67950K .......... .......... .......... .......... .......... 73% 339M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68000K .......... .......... .......... .......... .......... 73% 331M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68050K .......... .......... .......... .......... .......... 73% 337M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68100K .......... .......... .......... .......... .......... 73% 322M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68150K .......... .......... .......... .......... .......... 73% 377M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68200K .......... .......... .......... .......... .......... 73% 354M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68250K .......... .......... .......... .......... .......... 73% 296M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68300K .......... .......... .......... .......... .......... 73% 252M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68350K .......... .......... .......... .......... .......... 73% 148M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68400K .......... .......... .......... .......... .......... 73% 305M 0s 2024-08-27T02:59:53.817 INFO:teuthology.orchestra.run.smithi143.stderr: 68450K .......... .......... .......... .......... .......... 73% 343M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68500K .......... .......... .......... .......... .......... 73% 237M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68550K .......... .......... .......... .......... .......... 73% 227M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68600K .......... .......... .......... .......... .......... 73% 286M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68650K .......... .......... .......... .......... .......... 73% 291M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68700K .......... .......... .......... .......... .......... 74% 257M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68750K .......... .......... .......... .......... .......... 74% 303M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68800K .......... .......... .......... .......... .......... 74% 357M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68850K .......... .......... .......... .......... .......... 74% 325M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68900K .......... .......... .......... .......... .......... 74% 326M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 68950K .......... .......... .......... .......... .......... 74% 291M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 69000K .......... .......... .......... .......... .......... 74% 323M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 69050K .......... .......... .......... .......... .......... 74% 401M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 69100K .......... .......... .......... .......... .......... 74% 346M 0s 2024-08-27T02:59:53.818 INFO:teuthology.orchestra.run.smithi143.stderr: 69150K .......... .......... .......... .......... .......... 74% 170M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69200K .......... .......... .......... .......... .......... 74% 257M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69250K .......... .......... .......... .......... .......... 74% 317M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69300K .......... .......... .......... .......... .......... 74% 257M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69350K .......... .......... .......... .......... .......... 74% 269M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69400K .......... .......... .......... .......... .......... 74% 358M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69450K .......... .......... .......... .......... .......... 74% 377M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69500K .......... .......... .......... .......... .......... 74% 34.3M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69550K .......... .......... .......... .......... .......... 74% 300M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69600K .......... .......... .......... .......... .......... 74% 300M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69650K .......... .......... .......... .......... .......... 75% 317M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69700K .......... .......... .......... .......... .......... 75% 320M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69750K .......... .......... .......... .......... .......... 75% 285M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69800K .......... .......... .......... .......... .......... 75% 325M 0s 2024-08-27T02:59:53.819 INFO:teuthology.orchestra.run.smithi143.stderr: 69850K .......... .......... .......... .......... .......... 75% 298M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 69900K .......... .......... .......... .......... .......... 75% 221M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 69950K .......... .......... .......... .......... .......... 75% 70.1M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70000K .......... .......... .......... .......... .......... 75% 283M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70050K .......... .......... .......... .......... .......... 75% 295M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70100K .......... .......... .......... .......... .......... 75% 299M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70150K .......... .......... .......... .......... .......... 75% 346M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70200K .......... .......... .......... .......... .......... 75% 275M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70250K .......... .......... .......... .......... .......... 75% 259M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70300K .......... .......... .......... .......... .......... 75% 267M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70350K .......... .......... .......... .......... .......... 75% 342M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70400K .......... .......... .......... .......... .......... 75% 272M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70450K .......... .......... .......... .......... .......... 75% 323M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70500K .......... .......... .......... .......... .......... 75% 301M 0s 2024-08-27T02:59:53.820 INFO:teuthology.orchestra.run.smithi143.stderr: 70550K .......... .......... .......... .......... .......... 75% 389M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70600K .......... .......... .......... .......... .......... 76% 237M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70650K .......... .......... .......... .......... .......... 76% 350M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70700K .......... .......... .......... .......... .......... 76% 308M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70750K .......... .......... .......... .......... .......... 76% 322M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70800K .......... .......... .......... .......... .......... 76% 310M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70850K .......... .......... .......... .......... .......... 76% 377M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70900K .......... .......... .......... .......... .......... 76% 284M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 70950K .......... .......... .......... .......... .......... 76% 386M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 71000K .......... .......... .......... .......... .......... 76% 166M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 71050K .......... .......... .......... .......... .......... 76% 326M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 71100K .......... .......... .......... .......... .......... 76% 229M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 71150K .......... .......... .......... .......... .......... 76% 335M 0s 2024-08-27T02:59:53.821 INFO:teuthology.orchestra.run.smithi143.stderr: 71200K .......... .......... .......... .......... .......... 76% 241M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71250K .......... .......... .......... .......... .......... 76% 346M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71300K .......... .......... .......... .......... .......... 76% 268M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71350K .......... .......... .......... .......... .......... 76% 365M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71400K .......... .......... .......... .......... .......... 76% 363M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71450K .......... .......... .......... .......... .......... 76% 256M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71500K .......... .......... .......... .......... .......... 77% 259M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71550K .......... .......... .......... .......... .......... 77% 326M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71600K .......... .......... .......... .......... .......... 77% 347M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71650K .......... .......... .......... .......... .......... 77% 296M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71700K .......... .......... .......... .......... .......... 77% 310M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71750K .......... .......... .......... .......... .......... 77% 317M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71800K .......... .......... .......... .......... .......... 77% 271M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71850K .......... .......... .......... .......... .......... 77% 332M 0s 2024-08-27T02:59:53.822 INFO:teuthology.orchestra.run.smithi143.stderr: 71900K .......... .......... .......... .......... .......... 77% 293M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 71950K .......... .......... .......... .......... .......... 77% 352M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72000K .......... .......... .......... .......... .......... 77% 409M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72050K .......... .......... .......... .......... .......... 77% 128M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72100K .......... .......... .......... .......... .......... 77% 302M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72150K .......... .......... .......... .......... .......... 77% 353M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72200K .......... .......... .......... .......... .......... 77% 265M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72250K .......... .......... .......... .......... .......... 77% 366M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72300K .......... .......... .......... .......... .......... 77% 299M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72350K .......... .......... .......... .......... .......... 77% 382M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72400K .......... .......... .......... .......... .......... 77% 361M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72450K .......... .......... .......... .......... .......... 78% 32.1M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72500K .......... .......... .......... .......... .......... 78% 323M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72550K .......... .......... .......... .......... .......... 78% 341M 0s 2024-08-27T02:59:53.823 INFO:teuthology.orchestra.run.smithi143.stderr: 72600K .......... .......... .......... .......... .......... 78% 348M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 72650K .......... .......... .......... .......... .......... 78% 388M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 72700K .......... .......... .......... .......... .......... 78% 237M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 72750K .......... .......... .......... .......... .......... 78% 381M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 72800K .......... .......... .......... .......... .......... 78% 322M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 72850K .......... .......... .......... .......... .......... 78% 288M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 72900K .......... .......... .......... .......... .......... 78% 312M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 72950K .......... .......... .......... .......... .......... 78% 78.9M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 73000K .......... .......... .......... .......... .......... 78% 224M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 73050K .......... .......... .......... .......... .......... 78% 343M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 73100K .......... .......... .......... .......... .......... 78% 289M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 73150K .......... .......... .......... .......... .......... 78% 104M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 73200K .......... .......... .......... .......... .......... 78% 355M 0s 2024-08-27T02:59:53.824 INFO:teuthology.orchestra.run.smithi143.stderr: 73250K .......... .......... .......... .......... .......... 78% 309M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73300K .......... .......... .......... .......... .......... 78% 307M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73350K .......... .......... .......... .......... .......... 79% 338M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73400K .......... .......... .......... .......... .......... 79% 372M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73450K .......... .......... .......... .......... .......... 79% 299M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73500K .......... .......... .......... .......... .......... 79% 260M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73550K .......... .......... .......... .......... .......... 79% 356M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73600K .......... .......... .......... .......... .......... 79% 368M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73650K .......... .......... .......... .......... .......... 79% 351M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73700K .......... .......... .......... .......... .......... 79% 288M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73750K .......... .......... .......... .......... .......... 79% 329M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73800K .......... .......... .......... .......... .......... 79% 317M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73850K .......... .......... .......... .......... .......... 79% 304M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73900K .......... .......... .......... .......... .......... 79% 269M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 73950K .......... .......... .......... .......... .......... 79% 340M 0s 2024-08-27T02:59:53.825 INFO:teuthology.orchestra.run.smithi143.stderr: 74000K .......... .......... .......... .......... .......... 79% 377M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74050K .......... .......... .......... .......... .......... 79% 302M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74100K .......... .......... .......... .......... .......... 79% 332M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74150K .......... .......... .......... .......... .......... 79% 389M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74200K .......... .......... .......... .......... .......... 79% 354M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74250K .......... .......... .......... .......... .......... 79% 388M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74300K .......... .......... .......... .......... .......... 80% 316M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74350K .......... .......... .......... .......... .......... 80% 107M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74400K .......... .......... .......... .......... .......... 80% 346M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74450K .......... .......... .......... .......... .......... 80% 386M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74500K .......... .......... .......... .......... .......... 80% 331M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74550K .......... .......... .......... .......... .......... 80% 352M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74600K .......... .......... .......... .......... .......... 80% 353M 0s 2024-08-27T02:59:53.826 INFO:teuthology.orchestra.run.smithi143.stderr: 74650K .......... .......... .......... .......... .......... 80% 396M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 74700K .......... .......... .......... .......... .......... 80% 285M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 74750K .......... .......... .......... .......... .......... 80% 300M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 74800K .......... .......... .......... .......... .......... 80% 364M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 74850K .......... .......... .......... .......... .......... 80% 276M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 74900K .......... .......... .......... .......... .......... 80% 299M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 74950K .......... .......... .......... .......... .......... 80% 324M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75000K .......... .......... .......... .......... .......... 80% 364M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75050K .......... .......... .......... .......... .......... 80% 229M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75100K .......... .......... .......... .......... .......... 80% 126M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75150K .......... .......... .......... .......... .......... 80% 315M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75200K .......... .......... .......... .......... .......... 81% 331M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75250K .......... .......... .......... .......... .......... 81% 336M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75300K .......... .......... .......... .......... .......... 81% 242M 0s 2024-08-27T02:59:53.827 INFO:teuthology.orchestra.run.smithi143.stderr: 75350K .......... .......... .......... .......... .......... 81% 339M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75400K .......... .......... .......... .......... .......... 81% 364M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75450K .......... .......... .......... .......... .......... 81% 42.0M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75500K .......... .......... .......... .......... .......... 81% 161M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75550K .......... .......... .......... .......... .......... 81% 304M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75600K .......... .......... .......... .......... .......... 81% 154M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75650K .......... .......... .......... .......... .......... 81% 339M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75700K .......... .......... .......... .......... .......... 81% 259M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75750K .......... .......... .......... .......... .......... 81% 331M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75800K .......... .......... .......... .......... .......... 81% 228M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75850K .......... .......... .......... .......... .......... 81% 370M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75900K .......... .......... .......... .......... .......... 81% 312M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 75950K .......... .......... .......... .......... .......... 81% 162M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 76000K .......... .......... .......... .......... .......... 81% 202M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 76050K .......... .......... .......... .......... .......... 81% 284M 0s 2024-08-27T02:59:53.828 INFO:teuthology.orchestra.run.smithi143.stderr: 76100K .......... .......... .......... .......... .......... 81% 349M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76150K .......... .......... .......... .......... .......... 82% 95.4M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76200K .......... .......... .......... .......... .......... 82% 330M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76250K .......... .......... .......... .......... .......... 82% 310M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76300K .......... .......... .......... .......... .......... 82% 272M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76350K .......... .......... .......... .......... .......... 82% 335M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76400K .......... .......... .......... .......... .......... 82% 174M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76450K .......... .......... .......... .......... .......... 82% 339M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76500K .......... .......... .......... .......... .......... 82% 317M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76550K .......... .......... .......... .......... .......... 82% 248M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76600K .......... .......... .......... .......... .......... 82% 307M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76650K .......... .......... .......... .......... .......... 82% 369M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76700K .......... .......... .......... .......... .......... 82% 320M 0s 2024-08-27T02:59:53.829 INFO:teuthology.orchestra.run.smithi143.stderr: 76750K .......... .......... .......... .......... .......... 82% 404M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 76800K .......... .......... .......... .......... .......... 82% 266M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 76850K .......... .......... .......... .......... .......... 82% 341M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 76900K .......... .......... .......... .......... .......... 82% 368M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 76950K .......... .......... .......... .......... .......... 82% 360M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77000K .......... .......... .......... .......... .......... 82% 316M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77050K .......... .......... .......... .......... .......... 82% 241M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77100K .......... .......... .......... .......... .......... 83% 372M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77150K .......... .......... .......... .......... .......... 83% 311M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77200K .......... .......... .......... .......... .......... 83% 275M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77250K .......... .......... .......... .......... .......... 83% 338M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77300K .......... .......... .......... .......... .......... 83% 338M 0s 2024-08-27T02:59:53.830 INFO:teuthology.orchestra.run.smithi143.stderr: 77350K .......... .......... .......... .......... .......... 83% 281M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77400K .......... .......... .......... .......... .......... 83% 121M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77450K .......... .......... .......... .......... .......... 83% 345M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77500K .......... .......... .......... .......... .......... 83% 370M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77550K .......... .......... .......... .......... .......... 83% 375M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77600K .......... .......... .......... .......... .......... 83% 296M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77650K .......... .......... .......... .......... .......... 83% 364M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77700K .......... .......... .......... .......... .......... 83% 381M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77750K .......... .......... .......... .......... .......... 83% 324M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77800K .......... .......... .......... .......... .......... 83% 252M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77850K .......... .......... .......... .......... .......... 83% 298M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77900K .......... .......... .......... .......... .......... 83% 362M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 77950K .......... .......... .......... .......... .......... 83% 295M 0s 2024-08-27T02:59:53.831 INFO:teuthology.orchestra.run.smithi143.stderr: 78000K .......... .......... .......... .......... .......... 84% 260M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78050K .......... .......... .......... .......... .......... 84% 336M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78100K .......... .......... .......... .......... .......... 84% 309M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78150K .......... .......... .......... .......... .......... 84% 153M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78200K .......... .......... .......... .......... .......... 84% 277M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78250K .......... .......... .......... .......... .......... 84% 317M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78300K .......... .......... .......... .......... .......... 84% 403M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78350K .......... .......... .......... .......... .......... 84% 69.0M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78400K .......... .......... .......... .......... .......... 84% 251M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78450K .......... .......... .......... .......... .......... 84% 353M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78500K .......... .......... .......... .......... .......... 84% 128M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78550K .......... .......... .......... .......... .......... 84% 150M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78600K .......... .......... .......... .......... .......... 84% 191M 0s 2024-08-27T02:59:53.832 INFO:teuthology.orchestra.run.smithi143.stderr: 78650K .......... .......... .......... .......... .......... 84% 326M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 78700K .......... .......... .......... .......... .......... 84% 108M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 78750K .......... .......... .......... .......... .......... 84% 287M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 78800K .......... .......... .......... .......... .......... 84% 276M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 78850K .......... .......... .......... .......... .......... 84% 179M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 78900K .......... .......... .......... .......... .......... 84% 395M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 78950K .......... .......... .......... .......... .......... 85% 347M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 79000K .......... .......... .......... .......... .......... 85% 285M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 79050K .......... .......... .......... .......... .......... 85% 309M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 79100K .......... .......... .......... .......... .......... 85% 335M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 79150K .......... .......... .......... .......... .......... 85% 150M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 79200K .......... .......... .......... .......... .......... 85% 170M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 79250K .......... .......... .......... .......... .......... 85% 280M 0s 2024-08-27T02:59:53.833 INFO:teuthology.orchestra.run.smithi143.stderr: 79300K .......... .......... .......... .......... .......... 85% 240M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79350K .......... .......... .......... .......... .......... 85% 275M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79400K .......... .......... .......... .......... .......... 85% 313M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79450K .......... .......... .......... .......... .......... 85% 131M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79500K .......... .......... .......... .......... .......... 85% 246M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79550K .......... .......... .......... .......... .......... 85% 325M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79600K .......... .......... .......... .......... .......... 85% 222M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79650K .......... .......... .......... .......... .......... 85% 306M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79700K .......... .......... .......... .......... .......... 85% 307M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79750K .......... .......... .......... .......... .......... 85% 392M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79800K .......... .......... .......... .......... .......... 85% 234M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79850K .......... .......... .......... .......... .......... 86% 259M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79900K .......... .......... .......... .......... .......... 86% 371M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 79950K .......... .......... .......... .......... .......... 86% 228M 0s 2024-08-27T02:59:53.834 INFO:teuthology.orchestra.run.smithi143.stderr: 80000K .......... .......... .......... .......... .......... 86% 286M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80050K .......... .......... .......... .......... .......... 86% 335M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80100K .......... .......... .......... .......... .......... 86% 305M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80150K .......... .......... .......... .......... .......... 86% 336M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80200K .......... .......... .......... .......... .......... 86% 255M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80250K .......... .......... .......... .......... .......... 86% 377M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80300K .......... .......... .......... .......... .......... 86% 338M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80350K .......... .......... .......... .......... .......... 86% 342M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80400K .......... .......... .......... .......... .......... 86% 347M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80450K .......... .......... .......... .......... .......... 86% 199M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80500K .......... .......... .......... .......... .......... 86% 318M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80550K .......... .......... .......... .......... .......... 86% 303M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80600K .......... .......... .......... .......... .......... 86% 309M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80650K .......... .......... .......... .......... .......... 86% 338M 0s 2024-08-27T02:59:53.835 INFO:teuthology.orchestra.run.smithi143.stderr: 80700K .......... .......... .......... .......... .......... 86% 338M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 80750K .......... .......... .......... .......... .......... 86% 281M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 80800K .......... .......... .......... .......... .......... 87% 276M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 80850K .......... .......... .......... .......... .......... 87% 263M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 80900K .......... .......... .......... .......... .......... 87% 318M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 80950K .......... .......... .......... .......... .......... 87% 305M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81000K .......... .......... .......... .......... .......... 87% 266M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81050K .......... .......... .......... .......... .......... 87% 373M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81100K .......... .......... .......... .......... .......... 87% 335M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81150K .......... .......... .......... .......... .......... 87% 337M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81200K .......... .......... .......... .......... .......... 87% 252M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81250K .......... .......... .......... .......... .......... 87% 348M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81300K .......... .......... .......... .......... .......... 87% 59.4M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81350K .......... .......... .......... .......... .......... 87% 279M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81400K .......... .......... .......... .......... .......... 87% 315M 0s 2024-08-27T02:59:53.836 INFO:teuthology.orchestra.run.smithi143.stderr: 81450K .......... .......... .......... .......... .......... 87% 309M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81500K .......... .......... .......... .......... .......... 87% 394M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81550K .......... .......... .......... .......... .......... 87% 210M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81600K .......... .......... .......... .......... .......... 87% 147M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81650K .......... .......... .......... .......... .......... 87% 129M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81700K .......... .......... .......... .......... .......... 87% 362M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81750K .......... .......... .......... .......... .......... 88% 163M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81800K .......... .......... .......... .......... .......... 88% 259M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81850K .......... .......... .......... .......... .......... 88% 266M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81900K .......... .......... .......... .......... .......... 88% 374M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 81950K .......... .......... .......... .......... .......... 88% 188M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 82000K .......... .......... .......... .......... .......... 88% 243M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 82050K .......... .......... .......... .......... .......... 88% 379M 0s 2024-08-27T02:59:53.837 INFO:teuthology.orchestra.run.smithi143.stderr: 82100K .......... .......... .......... .......... .......... 88% 321M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82150K .......... .......... .......... .......... .......... 88% 284M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82200K .......... .......... .......... .......... .......... 88% 206M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82250K .......... .......... .......... .......... .......... 88% 266M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82300K .......... .......... .......... .......... .......... 88% 145M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82350K .......... .......... .......... .......... .......... 88% 270M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82400K .......... .......... .......... .......... .......... 88% 368M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82450K .......... .......... .......... .......... .......... 88% 161M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82500K .......... .......... .......... .......... .......... 88% 210M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82550K .......... .......... .......... .......... .......... 88% 165M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82600K .......... .......... .......... .......... .......... 88% 271M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82650K .......... .......... .......... .......... .......... 89% 310M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82700K .......... .......... .......... .......... .......... 89% 318M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82750K .......... .......... .......... .......... .......... 89% 250M 0s 2024-08-27T02:59:53.838 INFO:teuthology.orchestra.run.smithi143.stderr: 82800K .......... .......... .......... .......... .......... 89% 339M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 82850K .......... .......... .......... .......... .......... 89% 141M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 82900K .......... .......... .......... .......... .......... 89% 313M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 82950K .......... .......... .......... .......... .......... 89% 327M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83000K .......... .......... .......... .......... .......... 89% 312M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83050K .......... .......... .......... .......... .......... 89% 346M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83100K .......... .......... .......... .......... .......... 89% 380M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83150K .......... .......... .......... .......... .......... 89% 282M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83200K .......... .......... .......... .......... .......... 89% 352M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83250K .......... .......... .......... .......... .......... 89% 214M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83300K .......... .......... .......... .......... .......... 89% 362M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83350K .......... .......... .......... .......... .......... 89% 301M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83400K .......... .......... .......... .......... .......... 89% 348M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83450K .......... .......... .......... .......... .......... 89% 355M 0s 2024-08-27T02:59:53.839 INFO:teuthology.orchestra.run.smithi143.stderr: 83500K .......... .......... .......... .......... .......... 89% 313M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83550K .......... .......... .......... .......... .......... 89% 286M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83600K .......... .......... .......... .......... .......... 90% 346M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83650K .......... .......... .......... .......... .......... 90% 370M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83700K .......... .......... .......... .......... .......... 90% 249M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83750K .......... .......... .......... .......... .......... 90% 303M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83800K .......... .......... .......... .......... .......... 90% 341M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83850K .......... .......... .......... .......... .......... 90% 354M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83900K .......... .......... .......... .......... .......... 90% 272M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 83950K .......... .......... .......... .......... .......... 90% 247M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 84000K .......... .......... .......... .......... .......... 90% 367M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 84050K .......... .......... .......... .......... .......... 90% 366M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 84100K .......... .......... .......... .......... .......... 90% 322M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 84150K .......... .......... .......... .......... .......... 90% 272M 0s 2024-08-27T02:59:53.840 INFO:teuthology.orchestra.run.smithi143.stderr: 84200K .......... .......... .......... .......... .......... 90% 334M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84250K .......... .......... .......... .......... .......... 90% 406M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84300K .......... .......... .......... .......... .......... 90% 59.9M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84350K .......... .......... .......... .......... .......... 90% 182M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84400K .......... .......... .......... .......... .......... 90% 282M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84450K .......... .......... .......... .......... .......... 90% 134M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84500K .......... .......... .......... .......... .......... 91% 345M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84550K .......... .......... .......... .......... .......... 91% 321M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84600K .......... .......... .......... .......... .......... 91% 199M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84650K .......... .......... .......... .......... .......... 91% 192M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84700K .......... .......... .......... .......... .......... 91% 325M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84750K .......... .......... .......... .......... .......... 91% 278M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84800K .......... .......... .......... .......... .......... 91% 135M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84850K .......... .......... .......... .......... .......... 91% 328M 0s 2024-08-27T02:59:53.841 INFO:teuthology.orchestra.run.smithi143.stderr: 84900K .......... .......... .......... .......... .......... 91% 325M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 84950K .......... .......... .......... .......... .......... 91% 361M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85000K .......... .......... .......... .......... .......... 91% 153M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85050K .......... .......... .......... .......... .......... 91% 357M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85100K .......... .......... .......... .......... .......... 91% 278M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85150K .......... .......... .......... .......... .......... 91% 248M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85200K .......... .......... .......... .......... .......... 91% 327M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85250K .......... .......... .......... .......... .......... 91% 357M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85300K .......... .......... .......... .......... .......... 91% 194M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85350K .......... .......... .......... .......... .......... 91% 211M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85400K .......... .......... .......... .......... .......... 91% 251M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85450K .......... .......... .......... .......... .......... 92% 310M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85500K .......... .......... .......... .......... .......... 92% 195M 0s 2024-08-27T02:59:53.842 INFO:teuthology.orchestra.run.smithi143.stderr: 85550K .......... .......... .......... .......... .......... 92% 152M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85600K .......... .......... .......... .......... .......... 92% 107M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85650K .......... .......... .......... .......... .......... 92% 313M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85700K .......... .......... .......... .......... .......... 92% 321M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85750K .......... .......... .......... .......... .......... 92% 279M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85800K .......... .......... .......... .......... .......... 92% 113M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85850K .......... .......... .......... .......... .......... 92% 291M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85900K .......... .......... .......... .......... .......... 92% 385M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 85950K .......... .......... .......... .......... .......... 92% 283M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 86000K .......... .......... .......... .......... .......... 92% 290M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 86050K .......... .......... .......... .......... .......... 92% 289M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 86100K .......... .......... .......... .......... .......... 92% 305M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 86150K .......... .......... .......... .......... .......... 92% 299M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 86200K .......... .......... .......... .......... .......... 92% 365M 0s 2024-08-27T02:59:53.843 INFO:teuthology.orchestra.run.smithi143.stderr: 86250K .......... .......... .......... .......... .......... 92% 353M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86300K .......... .......... .......... .......... .......... 92% 335M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86350K .......... .......... .......... .......... .......... 93% 317M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86400K .......... .......... .......... .......... .......... 93% 323M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86450K .......... .......... .......... .......... .......... 93% 345M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86500K .......... .......... .......... .......... .......... 93% 353M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86550K .......... .......... .......... .......... .......... 93% 295M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86600K .......... .......... .......... .......... .......... 93% 377M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86650K .......... .......... .......... .......... .......... 93% 349M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86700K .......... .......... .......... .......... .......... 93% 380M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86750K .......... .......... .......... .......... .......... 93% 337M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86800K .......... .......... .......... .......... .......... 93% 324M 0s 2024-08-27T02:59:53.844 INFO:teuthology.orchestra.run.smithi143.stderr: 86850K .......... .......... .......... .......... .......... 93% 335M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 86900K .......... .......... .......... .......... .......... 93% 281M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 86950K .......... .......... .......... .......... .......... 93% 336M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87000K .......... .......... .......... .......... .......... 93% 274M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87050K .......... .......... .......... .......... .......... 93% 304M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87100K .......... .......... .......... .......... .......... 93% 280M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87150K .......... .......... .......... .......... .......... 93% 269M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87200K .......... .......... .......... .......... .......... 93% 78.0M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87250K .......... .......... .......... .......... .......... 93% 315M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87300K .......... .......... .......... .......... .......... 94% 340M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87350K .......... .......... .......... .......... .......... 94% 235M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87400K .......... .......... .......... .......... .......... 94% 323M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87450K .......... .......... .......... .......... .......... 94% 177M 0s 2024-08-27T02:59:53.845 INFO:teuthology.orchestra.run.smithi143.stderr: 87500K .......... .......... .......... .......... .......... 94% 329M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87550K .......... .......... .......... .......... .......... 94% 110M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87600K .......... .......... .......... .......... .......... 94% 365M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87650K .......... .......... .......... .......... .......... 94% 54.7M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87700K .......... .......... .......... .......... .......... 94% 307M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87750K .......... .......... .......... .......... .......... 94% 289M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87800K .......... .......... .......... .......... .......... 94% 276M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87850K .......... .......... .......... .......... .......... 94% 283M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87900K .......... .......... .......... .......... .......... 94% 325M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 87950K .......... .......... .......... .......... .......... 94% 272M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 88000K .......... .......... .......... .......... .......... 94% 363M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 88050K .......... .......... .......... .......... .......... 94% 355M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 88100K .......... .......... .......... .......... .......... 94% 306M 0s 2024-08-27T02:59:53.846 INFO:teuthology.orchestra.run.smithi143.stderr: 88150K .......... .......... .......... .......... .......... 94% 261M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88200K .......... .......... .......... .......... .......... 94% 369M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88250K .......... .......... .......... .......... .......... 95% 298M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88300K .......... .......... .......... .......... .......... 95% 397M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88350K .......... .......... .......... .......... .......... 95% 285M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88400K .......... .......... .......... .......... .......... 95% 307M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88450K .......... .......... .......... .......... .......... 95% 405M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88500K .......... .......... .......... .......... .......... 95% 387M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88550K .......... .......... .......... .......... .......... 95% 265M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88600K .......... .......... .......... .......... .......... 95% 107M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88650K .......... .......... .......... .......... .......... 95% 119M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88700K .......... .......... .......... .......... .......... 95% 357M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88750K .......... .......... .......... .......... .......... 95% 79.6M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88800K .......... .......... .......... .......... .......... 95% 365M 0s 2024-08-27T02:59:53.847 INFO:teuthology.orchestra.run.smithi143.stderr: 88850K .......... .......... .......... .......... .......... 95% 319M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 88900K .......... .......... .......... .......... .......... 95% 345M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 88950K .......... .......... .......... .......... .......... 95% 317M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89000K .......... .......... .......... .......... .......... 95% 325M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89050K .......... .......... .......... .......... .......... 95% 316M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89100K .......... .......... .......... .......... .......... 95% 359M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89150K .......... .......... .......... .......... .......... 96% 273M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89200K .......... .......... .......... .......... .......... 96% 314M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89250K .......... .......... .......... .......... .......... 96% 367M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89300K .......... .......... .......... .......... .......... 96% 344M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89350K .......... .......... .......... .......... .......... 96% 294M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89400K .......... .......... .......... .......... .......... 96% 346M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89450K .......... .......... .......... .......... .......... 96% 362M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89500K .......... .......... .......... .......... .......... 96% 386M 0s 2024-08-27T02:59:53.848 INFO:teuthology.orchestra.run.smithi143.stderr: 89550K .......... .......... .......... .......... .......... 96% 263M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89600K .......... .......... .......... .......... .......... 96% 350M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89650K .......... .......... .......... .......... .......... 96% 330M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89700K .......... .......... .......... .......... .......... 96% 329M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89750K .......... .......... .......... .......... .......... 96% 300M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89800K .......... .......... .......... .......... .......... 96% 344M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89850K .......... .......... .......... .......... .......... 96% 339M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89900K .......... .......... .......... .......... .......... 96% 296M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 89950K .......... .......... .......... .......... .......... 96% 264M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 90000K .......... .......... .......... .......... .......... 96% 358M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 90050K .......... .......... .......... .......... .......... 96% 212M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 90100K .......... .......... .......... .......... .......... 97% 299M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 90150K .......... .......... .......... .......... .......... 97% 291M 0s 2024-08-27T02:59:53.849 INFO:teuthology.orchestra.run.smithi143.stderr: 90200K .......... .......... .......... .......... .......... 97% 135M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90250K .......... .......... .......... .......... .......... 97% 350M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90300K .......... .......... .......... .......... .......... 97% 356M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90350K .......... .......... .......... .......... .......... 97% 202M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90400K .......... .......... .......... .......... .......... 97% 111M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90450K .......... .......... .......... .......... .......... 97% 297M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90500K .......... .......... .......... .......... .......... 97% 362M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90550K .......... .......... .......... .......... .......... 97% 297M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90600K .......... .......... .......... .......... .......... 97% 324M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90650K .......... .......... .......... .......... .......... 97% 52.6M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90700K .......... .......... .......... .......... .......... 97% 294M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90750K .......... .......... .......... .......... .......... 97% 255M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90800K .......... .......... .......... .......... .......... 97% 279M 0s 2024-08-27T02:59:53.850 INFO:teuthology.orchestra.run.smithi143.stderr: 90850K .......... .......... .......... .......... .......... 97% 307M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 90900K .......... .......... .......... .......... .......... 97% 309M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 90950K .......... .......... .......... .......... .......... 97% 294M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91000K .......... .......... .......... .......... .......... 98% 310M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91050K .......... .......... .......... .......... .......... 98% 288M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91100K .......... .......... .......... .......... .......... 98% 351M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91150K .......... .......... .......... .......... .......... 98% 255M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91200K .......... .......... .......... .......... .......... 98% 250M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91250K .......... .......... .......... .......... .......... 98% 302M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91300K .......... .......... .......... .......... .......... 98% 338M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91350K .......... .......... .......... .......... .......... 98% 343M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91400K .......... .......... .......... .......... .......... 98% 170M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91450K .......... .......... .......... .......... .......... 98% 301M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91500K .......... .......... .......... .......... .......... 98% 340M 0s 2024-08-27T02:59:53.851 INFO:teuthology.orchestra.run.smithi143.stderr: 91550K .......... .......... .......... .......... .......... 98% 313M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91600K .......... .......... .......... .......... .......... 98% 354M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91650K .......... .......... .......... .......... .......... 98% 122M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91700K .......... .......... .......... .......... .......... 98% 67.5M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91750K .......... .......... .......... .......... .......... 98% 286M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91800K .......... .......... .......... .......... .......... 98% 315M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91850K .......... .......... .......... .......... .......... 98% 340M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91900K .......... .......... .......... .......... .......... 98% 338M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 91950K .......... .......... .......... .......... .......... 99% 203M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 92000K .......... .......... .......... .......... .......... 99% 291M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 92050K .......... .......... .......... .......... .......... 99% 346M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 92100K .......... .......... .......... .......... .......... 99% 330M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 92150K .......... .......... .......... .......... .......... 99% 372M 0s 2024-08-27T02:59:53.852 INFO:teuthology.orchestra.run.smithi143.stderr: 92200K .......... .......... .......... .......... .......... 99% 321M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92250K .......... .......... .......... .......... .......... 99% 378M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92300K .......... .......... .......... .......... .......... 99% 284M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92350K .......... .......... .......... .......... .......... 99% 345M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92400K .......... .......... .......... .......... .......... 99% 325M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92450K .......... .......... .......... .......... .......... 99% 383M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92500K .......... .......... .......... .......... .......... 99% 308M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92550K .......... .......... .......... .......... .......... 99% 368M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92600K .......... .......... .......... .......... .......... 99% 212M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92650K .......... .......... .......... .......... .......... 99% 323M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92700K .......... .......... .......... .......... .......... 99% 247M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92750K .......... .......... .......... .......... .......... 99% 286M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92800K .......... .......... .......... .......... .......... 99% 347M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92850K .......... .......... .......... .......... .......... 99% 389M 0s 2024-08-27T02:59:53.853 INFO:teuthology.orchestra.run.smithi143.stderr: 92900K 100% 134G=0.5s 2024-08-27T02:59:53.854 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T02:59:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27 02:59:52 (194 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-08-27T02:59:53.854 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout:Archive: gradle-6.0.1-bin.zip 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-08-27T02:59:53.881 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-08-27T02:59:53.882 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-08-27T02:59:53.883 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-08-27T02:59:53.884 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-08-27T02:59:53.885 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-08-27T02:59:53.886 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-08-27T02:59:53.887 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-08-27T02:59:53.888 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-08-27T02:59:53.889 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-08-27T02:59:53.890 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-08-27T02:59:53.891 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-08-27T02:59:53.894 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-08-27T02:59:53.895 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-08-27T02:59:53.896 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-08-27T02:59:53.897 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-08-27T02:59:53.898 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-08-27T02:59:53.899 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-08-27T02:59:53.900 INFO:teuthology.orchestra.run.smithi143.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-08-27T02:59:54.074 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.074 INFO:teuthology.orchestra.run.smithi143.stdout:Welcome to Gradle 6.0.1! 2024-08-27T02:59:54.074 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout:Here are the highlights of this release: 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Substantial improvements in dependency management, including 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Advanced control of transitive versions 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Support for optional features and dependencies 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Rules to tweak published metadata 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Support for Java 13 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Faster incremental Java and Groovy compilation 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - New Zinc compiler for Scala 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - VS2019 support 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: - Support for Gradle Enterprise plugin 3.0 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.075 INFO:teuthology.orchestra.run.smithi143.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:------------------------------------------------------------ 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:Gradle 6.0.1 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:------------------------------------------------------------ 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:Kotlin: 1.3.50 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:Groovy: 2.5.8 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-08-27T02:59:54.076 INFO:teuthology.orchestra.run.smithi143.stdout:OS: Linux 5.15.0-119-generic amd64 2024-08-27T02:59:54.077 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.081 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-08-27T02:59:54.081 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-08-27T02:59:54.081 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T02:59:54.081 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-08-27T02:59:54.081 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T02:59:54.081 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-08-27T02:59:54.265 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-08-27T02:59:54.265 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-08-27T02:59:54.265 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'KORXJBLEPLOEUUILJZSJ', 'access_secret': '1ml6t9tBdiWyRBZI2X3Dd/fbkRZRtN8DV5mxvO97fe4UX3nF3/qGHg==', 'region': 'mexico', 'endpoint': 'smithi143.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi143.front.sepia.ceph.com'} 2024-08-27T02:59:54.266 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-08-27T02:59:54.266 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'KORXJBLEPLOEUUILJZSJ', '--secret', '1ml6t9tBdiWyRBZI2X3Dd/fbkRZRtN8DV5mxvO97fe4UX3nF3/qGHg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-08-27T02:59:54.266 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key KORXJBLEPLOEUUILJZSJ --secret 1ml6t9tBdiWyRBZI2X3Dd/fbkRZRtN8DV5mxvO97fe4UX3nF3/qGHg== --email tester.client.0_test@test.test --cluster ceph 2024-08-27T02:59:54.307 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:54.307 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:54.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 realm 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.346+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.350+0000 7f1a97dab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:54.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.350+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.350+0000 7f1a97dab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:54.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.350+0000 7f1a97dab9c0 20 searching for the correct realm 2024-08-27T02:59:54.355 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.354+0000 7f1a960b2640 0 -- 172.21.15.143:0/2115756196 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f1a800ea910 msgr2=0x7f1a800aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:54.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.570+0000 7f1a958b1640 0 -- 172.21.15.143:0/2115756196 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55d9559ba120 msgr2=0x55d9559bc510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:54.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:54.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:54.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:54.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:54.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:54.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:54.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:54.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 zone default found 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 4 Realm: () 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 zonegroup default 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.578+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.582+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.582+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.582+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.582+0000 7f1a97dab9c0 20 started sync module instance, tier type = 2024-08-27T02:59:54.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.582+0000 7f1a97dab9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:54.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=0 2024-08-27T02:59:54.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=1 2024-08-27T02:59:54.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=2 2024-08-27T02:59:54.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=3 2024-08-27T02:59:54.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=4 2024-08-27T02:59:54.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=5 2024-08-27T02:59:54.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=6 2024-08-27T02:59:54.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 20 add_watcher() i=7 2024-08-27T02:59:54.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.602+0000 7f1a97dab9c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:54.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.606+0000 7f19477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:54.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.606+0000 7f1a97dab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:54.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.606+0000 7f1a97dab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:54.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.606+0000 7f1a97dab9c0 5 note: GC not initialized 2024-08-27T02:59:54.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.606+0000 7f19467fc640 20 reqs_thread_entry: start 2024-08-27T02:59:54.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.606+0000 7f1a97dab9c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:54.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 20 Filter name: none 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f18b7fff640 20 reqs_thread_entry: start 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-08-27T02:59:54.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-08-27T02:59:54.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-08-27T02:59:54.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache get: name=default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ : miss 2024-08-27T02:59:54.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache put: name=default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ info.flags=0x0 2024-08-27T02:59:54.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 adding default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ to cache LRU end 2024-08-27T02:59:54.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache get: name=default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ : hit (negative entry) 2024-08-27T02:59:54.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.610+0000 7f1a97dab9c0 10 cache get: name=default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ : hit (negative entry) 2024-08-27T02:59:54.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.614+0000 7f1a97dab9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-08-27T02:59:54.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.614+0000 7f1a97dab9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-27T02:59:54.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.614+0000 7f1a97dab9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-08-27T02:59:54.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.614+0000 7f19797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366286 cookie 94391932577760 notifier 7811 bl.length()=670 2024-08-27T02:59:54.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.614+0000 7f19797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-08-27T02:59:54.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.614+0000 7f19797fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-27T02:59:54.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.618+0000 7f1a97dab9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-08-27T02:59:54.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.618+0000 7f1a97dab9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-08-27T02:59:54.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.618+0000 7f1a97dab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-08-27T02:59:54.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.618+0000 7f1978ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94391932563536 notifier 7811 bl.length()=200 2024-08-27T02:59:54.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.618+0000 7f1978ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-08-27T02:59:54.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.618+0000 7f1978ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-08-27T02:59:54.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.622+0000 7f1a97dab9c0 10 cache put: name=default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ info.flags=0x7 2024-08-27T02:59:54.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.622+0000 7f1a97dab9c0 10 moving default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ to cache LRU end 2024-08-27T02:59:54.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.622+0000 7f1a97dab9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:KORXJBLEPLOEUUILJZSJ, ofs0, ns] 2024-08-27T02:59:54.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.622+0000 7f19797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94391932566032 notifier 7811 bl.length()=189 2024-08-27T02:59:54.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.622+0000 7f19797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ info.flags=0x7 2024-08-27T02:59:54.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.622+0000 7f19797fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KORXJBLEPLOEUUILJZSJ to cache LRU end 2024-08-27T02:59:54.624 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T02:59:54.624 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "tester.client.0", 2024-08-27T02:59:54.624 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Ms. tester.client.0", 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "tester.client.0_test@test.test", 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "tester.client.0", 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "KORXJBLEPLOEUUILJZSJ", 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "1ml6t9tBdiWyRBZI2X3Dd/fbkRZRtN8DV5mxvO97fe4UX3nF3/qGHg==", 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T02:59:54.614356Z" 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T02:59:54.625 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T02:59:54.626 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "rgw", 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "", 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T02:59:54.614330Z", 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T02:59:54.627 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T02:59:54.628 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T02:59:54.628 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T02:59:54.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.626+0000 7f19477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.630+0000 7f1a97dab9c0 20 remove_watcher() i=0 2024-08-27T02:59:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.630+0000 7f1a97dab9c0 2 removed watcher, disabling cache 2024-08-27T02:59:54.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.634+0000 7f1a97dab9c0 20 remove_watcher() i=1 2024-08-27T02:59:54.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.638+0000 7f1a97dab9c0 20 remove_watcher() i=2 2024-08-27T02:59:54.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.638+0000 7f1a97dab9c0 20 remove_watcher() i=3 2024-08-27T02:59:54.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.642+0000 7f1a97dab9c0 20 remove_watcher() i=4 2024-08-27T02:59:54.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.642+0000 7f1a97dab9c0 20 remove_watcher() i=5 2024-08-27T02:59:54.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.642+0000 7f1a97dab9c0 20 remove_watcher() i=6 2024-08-27T02:59:54.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.646+0000 7f1a97dab9c0 20 remove_watcher() i=7 2024-08-27T02:59:54.659 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T02:59:54.659 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-08-27T02:59:54.706 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-08-27T02:59:54.707 DEBUG:teuthology.orchestra.run.smithi143:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-08-27T02:59:54.752 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T02:59:54.826 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:54.826 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:54.870 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.870+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 realm 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:54.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:54.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:54.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:54.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.874+0000 7fc8687239c0 20 searching for the correct realm 2024-08-27T02:59:54.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:54.882+0000 7fc866a2a640 0 -- 172.21.15.143:0/3054474218 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fc85c00a040 msgr2=0x7fc85c0859c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:55.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.098+0000 7fc866229640 0 -- 172.21.15.143:0/3054474218 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55916ec1e350 msgr2=0x55916ec20780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:55.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:55.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:55.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:55.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:55.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:55.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:55.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:55.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.106+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 zone default found 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 4 Realm: () 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 zonegroup default 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 started sync module instance, tier type = 2024-08-27T02:59:55.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.110+0000 7fc8687239c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:55.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.134+0000 7fc8687239c0 20 add_watcher() i=0 2024-08-27T02:59:55.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.134+0000 7fc8687239c0 20 add_watcher() i=1 2024-08-27T02:59:55.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.134+0000 7fc8687239c0 20 add_watcher() i=2 2024-08-27T02:59:55.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.134+0000 7fc8687239c0 20 add_watcher() i=3 2024-08-27T02:59:55.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.134+0000 7fc8687239c0 20 add_watcher() i=4 2024-08-27T02:59:55.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.134+0000 7fc8687239c0 20 add_watcher() i=5 2024-08-27T02:59:55.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.134+0000 7fc8687239c0 20 add_watcher() i=6 2024-08-27T02:59:55.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.138+0000 7fc8687239c0 20 add_watcher() i=7 2024-08-27T02:59:55.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.138+0000 7fc8687239c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:55.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.142+0000 7fc71cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:55.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.142+0000 7fc8687239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:55.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.142+0000 7fc8687239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:55.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.234+0000 7fc6977fe640 20 reqs_thread_entry: start 2024-08-27T02:59:55.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.234+0000 7fc8687239c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:55.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.234+0000 7fc8687239c0 20 Filter name: none 2024-08-27T02:59:55.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.234+0000 7fc6957fa640 20 reqs_thread_entry: start 2024-08-27T02:59:55.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.234+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T02:59:55.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.238+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13281359917374753065', time=2024-08-27T04:51:37.446010+0000, chain.objs.size()=1 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.iZbh8aZp2x9DuAo5SpCdNU7ShM8sEch_0 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_81D212ofo07J2B3WSiTat9QnZpuY-Iw', time=2024-08-27T04:51:37.764233+0000, chain.objs.size()=1 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.SJQyrHOhjjsYBeEc_D5ZoQ_fwPFeOfM_0 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16385088205274346938', time=2024-08-27T04:51:37.833657+0000, chain.objs.size()=1 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.KbEHqa5TVOcVC24Fb67qxwZRa0bcgJL_0 2024-08-27T02:59:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14880595314255087498', time=2024-08-27T04:51:37.842358+0000, chain.objs.size()=1 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.VL0XtvXxmCr3PDpX8QXqVj7m5GVyeH2_0 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_RVWuf4KJ8GgYP5ms9VauxO6iJWrQO5a', time=2024-08-27T04:51:37.923701+0000, chain.objs.size()=1 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.tC0eGq-Wso_R45U43ZNOIFpnWZuyeZb_0 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5659541325896787591', time=2024-08-27T04:53:03.645210+0000, chain.objs.size()=1 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.4uRJTOQ-nsHHMiASK7Q2eFydaGE3Cii_0 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.797071729277953409', time=2024-08-27T04:54:24.337293+0000, chain.objs.size()=1 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.VqBMIGy2v4A24zqcw5rc4F6mV2nQPAJ_0 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14667522481828325407', time=2024-08-27T04:55:03.754023+0000, chain.objs.size()=1 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.fhTv5J7gwOWT-PMYf-o5iVD6UK1XbSw_0 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14940989849606083999', time=2024-08-27T04:55:48.550951+0000, chain.objs.size()=1 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.fwIxLCY7n7mdloeu7GiwvFKrjiZnuG6_0 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3290851334740836045', time=2024-08-27T04:55:48.636947+0000, chain.objs.size()=1 2024-08-27T02:59:55.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.0j5rZat-azVqUxiu-9Z6wdfhLH_EYC2_0 2024-08-27T02:59:55.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9820137987110010884', time=2024-08-27T04:56:24.096958+0000, chain.objs.size()=1 2024-08-27T02:59:55.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.ato7iOwjV3WpY_BYmdv8d-XWIdLDc_2_0 2024-08-27T02:59:55.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12690064685868997903', time=2024-08-27T04:56:29.466320+0000, chain.objs.size()=1 2024-08-27T02:59:55.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.242+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.wVp5Mj3DEg38Yk2rFOx2_MAuHDv12bG_0 2024-08-27T02:59:55.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.250+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15012928819108002914', time=2024-08-27T04:56:29.601058+0000, chain.objs.size()=1 2024-08-27T02:59:55.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.250+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.XWOsqpTUigNMJxTAL0toWEUMpVDRw7k_0 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16476306293521735730', time=2024-08-27T04:56:33.385128+0000, chain.objs.size()=1 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.iSArHj_NByN-gLP96D1zJIXbvc6CuY-_0 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.721828327813786320', time=2024-08-27T04:59:17.372778+0000, chain.objs.size()=1 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.q9bXdniwDl5N9gGi717hsOvyoVO1Rmc_0 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16675908336646106799', time=2024-08-27T04:59:17.373997+0000, chain.objs.size()=1 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.42jamNXFkNofIjv2JuC0AEEHS6FkEH7_0 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4069095798696151660', time=2024-08-27T04:59:17.420496+0000, chain.objs.size()=1 2024-08-27T02:59:55.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.BTZzFuTyEuwYZlVrsmm0zAcEFTIRmQ-_0 2024-08-27T02:59:55.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13875886701119882941', time=2024-08-27T04:59:32.448213+0000, chain.objs.size()=1 2024-08-27T02:59:55.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.254+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18__shadow:DoXAR21.s1ub4yZjZh7Hm5DGtiqU3bR_.fi4yXcfkFGnJp91bbLSMlG2w_0CqvcW_0 2024-08-27T02:59:55.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.266+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.270+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T02:59:55.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-08-27T02:59:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.74863098461428060', time=2024-08-27T04:51:38.009606+0000, chain.objs.size()=3 2024-08-27T02:59:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.1 2024-08-27T02:59:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.2 2024-08-27T02:59:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.3 2024-08-27T02:59:55.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5501784563914453315', time=2024-08-27T04:51:38.469569+0000, chain.objs.size()=1 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_.44VIaRn-K_JYy-s1jxI9NKvA8is5llZ_0 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9974938076910988059', time=2024-08-27T04:52:59.363157+0000, chain.objs.size()=1 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.lJZ-nQo7bD59DsVLHmzJDl-7f8P_tgd_0 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12908029305282933490', time=2024-08-27T04:53:03.646172+0000, chain.objs.size()=1 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.n2R9UlE-APTiJfNamDwaAcwWxn-JNN-_0 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5424678701879795727', time=2024-08-27T04:53:03.727249+0000, chain.objs.size()=1 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.3TIOF1ZO-QDnGoa7iwcF7OI1Blv7e-B_0 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.958011260879372050', time=2024-08-27T04:53:38.821245+0000, chain.objs.size()=1 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.mF_BIx7xBMXUuoDfpQo6ijLyFlqE5Xp_0 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16161913120543481308', time=2024-08-27T04:53:44.315537+0000, chain.objs.size()=1 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.e9aI9YYd2fDpxgKI5P-6PQvYRkeholE_0 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14370657823881145774', time=2024-08-27T04:54:19.547113+0000, chain.objs.size()=1 2024-08-27T02:59:55.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.DrgzH_7L5LIoJcB1VuUFxBFObbLGJt3_0 2024-08-27T02:59:55.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6480625237001419496', time=2024-08-27T04:54:19.620411+0000, chain.objs.size()=1 2024-08-27T02:59:55.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.ffQirToLH4EPFBPsVeB0TlJYA8Lei9Y_0 2024-08-27T02:59:55.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5069277543153676459', time=2024-08-27T04:54:19.695611+0000, chain.objs.size()=1 2024-08-27T02:59:55.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.274+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.mIIa8KchB-NAtRu96bwSZRw1kb718Gj_0 2024-08-27T02:59:55.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.282+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14296239812068639200', time=2024-08-27T04:54:24.163442+0000, chain.objs.size()=1 2024-08-27T02:59:55.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.282+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.hRS5EeDou-IvEe2iiYe6lbW3z0Cgel2_0 2024-08-27T02:59:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14826227839858326520', time=2024-08-27T04:54:28.367796+0000, chain.objs.size()=1 2024-08-27T02:59:55.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.sgGBc6Vkp70CxQxaM_t8Vl1PhiSTYNs_0 2024-08-27T02:59:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4971782620321847361', time=2024-08-27T04:55:03.750186+0000, chain.objs.size()=1 2024-08-27T02:59:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.qCUPKyHyHkGhYnP8i6u-VEeqsjD7XnU_0 2024-08-27T02:59:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6897006487879587934', time=2024-08-27T04:55:08.665828+0000, chain.objs.size()=1 2024-08-27T02:59:55.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.C9nvnrqBPICGJRCSxotsjdt671qjOyI_0 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10346764339165374862', time=2024-08-27T04:55:48.732678+0000, chain.objs.size()=1 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.xOb9NSUqLQfSkFk5y7XcU9rC-cJLRGU_0 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10965895389939596216', time=2024-08-27T04:56:24.088187+0000, chain.objs.size()=1 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.oh6yyqiIf28i9O03enX-hZeJTYIvkDx_0 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14030651548290909127', time=2024-08-27T04:56:24.090088+0000, chain.objs.size()=1 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.IcwZ8UGft2ovJ-STu8oGdOYB_mj_dYA_0 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5580616399980810534', time=2024-08-27T04:56:24.091542+0000, chain.objs.size()=1 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.iApWsxBzxN33iLt1AYGXjRNyQLmvyuv_0 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9961527673173834944', time=2024-08-27T04:56:33.535233+0000, chain.objs.size()=1 2024-08-27T02:59:55.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.286+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.JP3Zc3X2DhKa4UspJpik8iiK3QT396v_0 2024-08-27T02:59:55.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.294+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T02:59:55.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-08-27T02:59:55.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7891615183043664557', time=2024-08-27T04:51:38.366788+0000, chain.objs.size()=1 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.4nj3Y8jfZQvTdrJbHrE4viSHBS8Bz1P_0 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16450482074435219981', time=2024-08-27T04:53:03.720129+0000, chain.objs.size()=1 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.lFUvv8m-MIzN1AegFyMxZmkhQuFKBlW_0 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4539252694321222000', time=2024-08-27T04:53:03.920413+0000, chain.objs.size()=1 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.HxOoxL2ABMlveViDpzYFFjX92quTLlb_0 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.257274741911047378', time=2024-08-27T04:53:38.967693+0000, chain.objs.size()=1 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.L_zRPYP6Phzj-SZ8Q0wldy7GE1V4Sp8_0 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10464693854098979976', time=2024-08-27T04:54:19.475302+0000, chain.objs.size()=1 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.jazPqXXWIOyt8dUey_rh3bt7CuARJcO_0 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1981690789937516477', time=2024-08-27T04:54:24.153552+0000, chain.objs.size()=1 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.3YuRbVjxrar1RguGkeBpjb4zIttYCBE_0 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17868908105871525120', time=2024-08-27T04:54:24.258065+0000, chain.objs.size()=1 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.RjoAjwnOKpfqaGv0bd_oTld-bjRDb6I_0 2024-08-27T02:59:55.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16209964424590004379', time=2024-08-27T04:55:43.343177+0000, chain.objs.size()=1 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.4J7KEIwaapUu48_jTJ04ESPRnkgs9qZ_0 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6345732046900888559', time=2024-08-27T04:55:48.670319+0000, chain.objs.size()=1 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.szOLDd2tVZiNuWFTZvCiJQdW8jbi5LN_0 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3153428522251547940', time=2024-08-27T04:56:24.120919+0000, chain.objs.size()=1 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.CDFIYtATJCxzEkqQx_R-QJu2hsL7rlf_0 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14113324732235306739', time=2024-08-27T04:56:27.577269+0000, chain.objs.size()=1 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.EYHi3Myv6h9vB9ByAnROLoP1AoHcVeH_0 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7249662346451437532', time=2024-08-27T04:56:33.334757+0000, chain.objs.size()=1 2024-08-27T02:59:55.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.302+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.n7qTaovsNUNhCrl8dlxbrEFQ1rVq7z1_0 2024-08-27T02:59:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.306+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9530214974052558997', time=2024-08-27T04:57:08.681119+0000, chain.objs.size()=1 2024-08-27T02:59:55.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.306+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.A6F7dgh2XZs6l8H_5OdVldmE9YgptJL_0 2024-08-27T02:59:55.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.318+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.322+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T02:59:55.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.322+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-08-27T02:59:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9843786184789892698', time=2024-08-27T04:51:37.495623+0000, chain.objs.size()=1 2024-08-27T02:59:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.AqolxfjUMNK-ANLPOfi1svmS3SmjmO8_0 2024-08-27T02:59:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3812342768397689261', time=2024-08-27T04:51:37.852523+0000, chain.objs.size()=1 2024-08-27T02:59:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.KbEHqa5TVOcVC24Fb67qxwZRa0bcgJL_0 2024-08-27T02:59:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3800155153566058829', time=2024-08-27T04:51:37.978603+0000, chain.objs.size()=3 2024-08-27T02:59:55.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.1 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.2 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-STANDARD.2~9Bj2g_HfURUb3GxQ7m_9mRCK4uBgGWm.3 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14852746294301319909', time=2024-08-27T04:51:38.435158+0000, chain.objs.size()=1 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_.W5QFu5GPpi4jdSRsJEBZW-d39YF2VmS_0 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9875561370299575562', time=2024-08-27T04:52:59.361329+0000, chain.objs.size()=1 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.NXoHbFcHjROH9l293c-ZuOgILW0cKKB_0 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10708392132505345108', time=2024-08-27T04:53:03.938845+0000, chain.objs.size()=1 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.xM0ECXml3Is3cTQ8ppweDZHxUEVAP7x_0 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14965159206990917565', time=2024-08-27T04:53:38.952050+0000, chain.objs.size()=1 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.gui_2G7IofMM7tdZcyn_r0rjmUMpTVX_0 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12657191702422658315', time=2024-08-27T04:53:42.971788+0000, chain.objs.size()=1 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.trOPTlAPg-hDiT87VEsqb8GZ2hPYAXg_0 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17669080933832147896', time=2024-08-27T04:55:03.616395+0000, chain.objs.size()=1 2024-08-27T02:59:55.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.z70WC4--3cjGvKEIyxlvJx0g1w2JCcV_0 2024-08-27T02:59:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4624348080534217268', time=2024-08-27T04:55:08.825838+0000, chain.objs.size()=1 2024-08-27T02:59:55.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.326+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.G-H0VHPf4VkhDCmEHDm5EVyiQKQNfXp_0 2024-08-27T02:59:55.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10575800315560406975', time=2024-08-27T04:55:48.538387+0000, chain.objs.size()=1 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.IF1-5KrnDkZO9cTu5UjCLsQrpkOsTPO_0 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3216037057554706487', time=2024-08-27T04:56:29.477692+0000, chain.objs.size()=1 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.4XJaL5ZJDyrvyDYmOna8Uyccp6NkVsq_0 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1081086998653855712', time=2024-08-27T04:56:33.441960+0000, chain.objs.size()=1 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.YOJ9IWnTSntE0pH97ffgab668HG6bP__0 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12151439211539281468', time=2024-08-27T04:57:08.587301+0000, chain.objs.size()=1 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.vNZW3DNJcmBiVpaEPs5MXdplqc5NnHR_0 2024-08-27T02:59:55.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18113132337203853100', time=2024-08-27T04:59:17.381827+0000, chain.objs.size()=1 2024-08-27T02:59:55.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.5xBnnYNNpzwNbz7OLIhK_zA8XUitzF-_0 2024-08-27T02:59:55.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13051276018741085153', time=2024-08-27T04:59:17.384156+0000, chain.objs.size()=1 2024-08-27T02:59:55.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.334+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.e89wwT28fHLMwOg_VCtiAheGacy7228_0 2024-08-27T02:59:55.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.346+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.350+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T02:59:55.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.350+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.350+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.350+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-08-27T02:59:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.350+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16750071268354789227', time=2024-08-27T04:53:03.653630+0000, chain.objs.size()=1 2024-08-27T02:59:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.350+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.-VKqTjnVCme5hLO6SNestfAXA2uc8CL_0 2024-08-27T02:59:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13960397069554422436', time=2024-08-27T04:53:44.298371+0000, chain.objs.size()=1 2024-08-27T02:59:55.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.Z2unFRoiPkd3Xe8TWgc6ubahHAXQc6L_0 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11021941464508046839', time=2024-08-27T04:53:44.301404+0000, chain.objs.size()=1 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.pflfJ6IfV-8A2T-NOOeNE7vijlz39g__0 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16993325482322448501', time=2024-08-27T04:54:24.168428+0000, chain.objs.size()=1 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.BA01CXxzdnh8VpF-kU7upasKFXzQSZb_0 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10951939729394891430', time=2024-08-27T04:55:03.833977+0000, chain.objs.size()=1 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.-xr6UaduLbKrLopV359OW0C5s4PTNfJ_0 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6668586418909510739', time=2024-08-27T04:55:43.478031+0000, chain.objs.size()=1 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.9YRymGbXD0JguFD3hFdNMzdoze9II5i_0 2024-08-27T02:59:55.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7702372694990206834', time=2024-08-27T04:57:08.842582+0000, chain.objs.size()=1 2024-08-27T02:59:55.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.354+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.xWVCsh53pIh6zLKxN7rUzbiBUsC_GHA_0 2024-08-27T02:59:55.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.358+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.362+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T02:59:55.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-08-27T02:59:55.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12458050068362940887', time=2024-08-27T04:51:38.112574+0000, chain.objs.size()=3 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-STANDARD.2~6FLdmTCaNp8EkpYO2zuyVV9ncm6WkXV.1 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-STANDARD.2~6FLdmTCaNp8EkpYO2zuyVV9ncm6WkXV.2 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-STANDARD.2~6FLdmTCaNp8EkpYO2zuyVV9ncm6WkXV.3 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4548311035917569556', time=2024-08-27T04:51:38.179277+0000, chain.objs.size()=2 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.MZiB9Ie5JISBQrsa_wTNyDeJWtUe_9R_0 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.MZiB9Ie5JISBQrsa_wTNyDeJWtUe_9R_1 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14205558240301958369', time=2024-08-27T04:51:38.354421+0000, chain.objs.size()=1 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.vsv4KhjOE2ubpernZ9zNE_j2NOpzzim_0 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16373878611541573543', time=2024-08-27T04:53:39.092186+0000, chain.objs.size()=1 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.akofui0TrXd-os30t8WJXCy15cpXrF1_0 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17992386540783488501', time=2024-08-27T04:53:39.094393+0000, chain.objs.size()=1 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.D9mO6m90HArdzb0nZkyFIBfiZeWNQzl_0 2024-08-27T02:59:55.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5919678630076840251', time=2024-08-27T04:53:44.254501+0000, chain.objs.size()=1 2024-08-27T02:59:55.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.nQu8g1GLs6vOw6ubUS5Ewenbg_9M9nL_0 2024-08-27T02:59:55.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12631920992987935116', time=2024-08-27T04:54:19.539725+0000, chain.objs.size()=1 2024-08-27T02:59:55.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.kt8BCWLA_JSnzfDlJXfRRhORsJSiK34_0 2024-08-27T02:59:55.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16726054441484647698', time=2024-08-27T04:55:48.660377+0000, chain.objs.size()=1 2024-08-27T02:59:55.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.WHSsRv8GlB4xu26Wt6r5RZCYzWJeF-q_0 2024-08-27T02:59:55.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11696841815697335270', time=2024-08-27T04:56:33.285385+0000, chain.objs.size()=1 2024-08-27T02:59:55.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.366+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.LtTUGlDnnKA3uF-sVDjA7MVkWeCyPvd_0 2024-08-27T02:59:55.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.370+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.755512190251225502', time=2024-08-27T04:56:33.423772+0000, chain.objs.size()=1 2024-08-27T02:59:55.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.370+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.VIj-ddHIROlyJCAZ06qtQPHE5EYX8p1_0 2024-08-27T02:59:55.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.370+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14393248285245338385', time=2024-08-27T04:56:33.425558+0000, chain.objs.size()=1 2024-08-27T02:59:55.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.370+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.pVd7W2nYnaNL9mquTqZpss-hNgrTvd4_0 2024-08-27T02:59:55.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.374+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5005641424588689282', time=2024-08-27T04:56:33.528870+0000, chain.objs.size()=1 2024-08-27T02:59:55.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.374+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.S6RSi1I2XmTKR3TFcgH2pTxKNlqwLVB_0 2024-08-27T02:59:55.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.374+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.518663179855101868', time=2024-08-27T04:56:37.159655+0000, chain.objs.size()=1 2024-08-27T02:59:55.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.374+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.srzeOJAREbJfDOLOPhTNHFC3n2DkTkw_0 2024-08-27T02:59:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.378+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.382+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T02:59:55.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.382+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.382+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15744680007775551418', time=2024-08-27T04:51:38.341812+0000, chain.objs.size()=1 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.zvcKsujCJxY1SWEN6_VCHvEQAvOS9JD_0 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10083429005228018819', time=2024-08-27T04:53:03.708718+0000, chain.objs.size()=1 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.Jxlb7Hu0M86NWXfzDAu7OCtw-FXeZ5h_0 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8422202357017271130', time=2024-08-27T04:53:03.932852+0000, chain.objs.size()=1 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.SNG37spcZ6nsMnC74BryWPfsNVrK7Wn_0 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10335556334582936687', time=2024-08-27T04:54:24.260823+0000, chain.objs.size()=1 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.HbEh6rZ3zJXKLNDYt3jr1YV6fPDx7DD_0 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7044820947686559017', time=2024-08-27T04:55:08.707681+0000, chain.objs.size()=1 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.Tuwpg-n_ZyqVlVgHGzWaoWmoBMEA8vK_0 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10350192834376293299', time=2024-08-27T04:55:08.820946+0000, chain.objs.size()=1 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.Yk6nmXQIp_BZ9-yEvfaictGc6Mng1Dz_0 2024-08-27T02:59:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12482505829293206057', time=2024-08-27T04:56:29.457959+0000, chain.objs.size()=1 2024-08-27T02:59:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.386+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.BR2PA7sBnotxDj6Rt4jLP1XMC8St2nF_0 2024-08-27T02:59:55.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.390+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T02:59:55.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-08-27T02:59:55.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_Xyzb35TfKkhVltWuQ4kb8OQHVJyz5fd', time=2024-08-27T04:51:37.774410+0000, chain.objs.size()=1 2024-08-27T02:59:55.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.RPB9cvyse27pYgxJSjqKy2Kunyno5TX_0 2024-08-27T02:59:55.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13167264532570149005', time=2024-08-27T04:51:37.873648+0000, chain.objs.size()=1 2024-08-27T02:59:55.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.TPq_DYXG2eqjyeRb0J88qHGpHma-GlI_0 2024-08-27T02:59:55.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11795722501244065221', time=2024-08-27T04:52:59.388044+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.4ayqOKeXHpWK5kbjBi9N7EyB394fdGt_0 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.484038972066753081', time=2024-08-27T04:52:59.390144+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.qlUFj-IGBqSaXpdIae9hR59WWoIcuri_0 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16877486844697499972', time=2024-08-27T04:53:44.190174+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.xRf_taUJVmZye8-fkAKSjbu0YisxM9v_0 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7284960738384551104', time=2024-08-27T04:54:19.475338+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.FNbpLF5mtAUko1zl2EH7aB_eRlWRtGz_0 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.394+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14779050753181263825', time=2024-08-27T04:54:19.650555+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.57sOgZY1eNs-kCzIep_XrdsLg57w_li_0 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4174882615930794', time=2024-08-27T04:54:24.046147+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.x_AfkyW_uHHTVjAG8ZamiY23gexzHpL_0 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10495301091422242030', time=2024-08-27T04:54:24.258287+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.6otMGEz1GtiV3sl_812U_pR-mTPhzKg_0 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6980645686247809860', time=2024-08-27T04:54:28.415074+0000, chain.objs.size()=1 2024-08-27T02:59:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.X3WBI0EYUPHySsBfq32xEo6oFgf1Jrg_0 2024-08-27T02:59:55.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9368768630196698291', time=2024-08-27T04:55:03.635053+0000, chain.objs.size()=1 2024-08-27T02:59:55.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.oT6_XN9r3Nced-hKYf6Nh-u6se7VWRy_0 2024-08-27T02:59:55.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4779491697392659041', time=2024-08-27T04:55:03.720966+0000, chain.objs.size()=1 2024-08-27T02:59:55.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.398+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.kI81NyGioMYLQGTMjAQ-GSw4nebEbTI_0 2024-08-27T02:59:55.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11777705730509962740', time=2024-08-27T04:55:03.722512+0000, chain.objs.size()=1 2024-08-27T02:59:55.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.ZXjSPo0bDI4Bb0G7CyUoheNcvoPQPcz_0 2024-08-27T02:59:55.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15336314209996173375', time=2024-08-27T04:55:07.437629+0000, chain.objs.size()=1 2024-08-27T02:59:55.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.YfE-auWc53a4XBnYBmvT_xFVVNE8xVx_0 2024-08-27T02:59:55.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13443910645551126234', time=2024-08-27T04:55:08.849916+0000, chain.objs.size()=1 2024-08-27T02:59:55.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.IUmmNuaoQPyRZheaQhGZq55Op1Nb3pL_0 2024-08-27T02:59:55.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14682274588013585174', time=2024-08-27T04:55:48.582893+0000, chain.objs.size()=1 2024-08-27T02:59:55.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.402+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.mgw3zHiBHqulNbTzldLVRLFoZ0wOaxi_0 2024-08-27T02:59:55.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.410+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.410+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T02:59:55.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6830176550805702513', time=2024-08-27T04:51:37.480138+0000, chain.objs.size()=1 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.MmGV5w0jkf0bqLRiYtw704_8TPXiPzp_0 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10415926590581396717', time=2024-08-27T04:51:37.487111+0000, chain.objs.size()=1 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.n08LFwXyIV_hSVLxE-wts0WJoVJ7515_0 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11908115347689430045', time=2024-08-27T04:51:37.785332+0000, chain.objs.size()=1 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.TPq_DYXG2eqjyeRb0J88qHGpHma-GlI_0 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6657849659679012043', time=2024-08-27T04:51:38.044051+0000, chain.objs.size()=3 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.1 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.2 2024-08-27T02:59:55.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.3 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12177994487025041995', time=2024-08-27T04:52:59.270678+0000, chain.objs.size()=1 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_._YVo4mxVX253BftwsHPwNcFZfcqW7D6_0 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1058811152548562572', time=2024-08-27T04:52:59.484885+0000, chain.objs.size()=1 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.FeTZ97oQCJZX5gTZSMymfjQ0CNDaRHf_0 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4857004970328290683', time=2024-08-27T04:53:03.636191+0000, chain.objs.size()=1 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.x3PdG3KrVFVuWffsO9Yg2-N5Gjd78s1_0 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16908402808833402565', time=2024-08-27T04:53:44.318409+0000, chain.objs.size()=1 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.b2lceuY_hphcblxFn9onqqS98zYfhQv_0 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13118223714002327635', time=2024-08-27T04:53:44.320826+0000, chain.objs.size()=1 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.5cqcTF_OXPsl3I7KYofwC7C7I4ZxgBs_0 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8275649023293909686', time=2024-08-27T04:54:19.572992+0000, chain.objs.size()=1 2024-08-27T02:59:55.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.414+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.EtX_HTNZX2YhHr77WPpBlpcTX7Vx_ID_0 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11729191753933308566', time=2024-08-27T04:54:28.276949+0000, chain.objs.size()=1 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.ssRANaP_gpqg3_M-HYaGvEbiKx8hIrs_0 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17697158342606609294', time=2024-08-27T04:55:03.803370+0000, chain.objs.size()=1 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.q1Lv5NSfyaOQ7fddW0GoklSVBB1QtK7_0 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17367431853182942502', time=2024-08-27T04:56:33.326843+0000, chain.objs.size()=1 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.zaWtGDSlBJRjNCZAy6MONTcZBcKZxcg_0 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2892252613837341854', time=2024-08-27T04:57:08.629042+0000, chain.objs.size()=1 2024-08-27T02:59:55.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.418+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.ume1gxEbdRYy99WcviuVuChE1xbyv2y_0 2024-08-27T02:59:55.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.422+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.426+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T02:59:55.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13435006586829840363', time=2024-08-27T04:51:37.539671+0000, chain.objs.size()=4 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.1 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.2 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.3 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11__multipart_foo.2~a5occWRHqUTu_oBeU4ueEsEG5-hOn55.4 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14790647768880777944', time=2024-08-27T04:51:38.101654+0000, chain.objs.size()=3 2024-08-27T02:59:55.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-FROZEN.2~iE7g4jPm2C0elBNe9i5H_djTO0QBvQZ.1 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-FROZEN.2~iE7g4jPm2C0elBNe9i5H_djTO0QBvQZ.2 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-FROZEN.2~iE7g4jPm2C0elBNe9i5H_djTO0QBvQZ.3 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18431418602083579756', time=2024-08-27T04:52:59.255519+0000, chain.objs.size()=1 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.gC1wr2dwyWguRJSAi0GGQVig727-B3S_0 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13499018189406550037', time=2024-08-27T04:52:59.257412+0000, chain.objs.size()=1 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.R7foVrgrwJHEVM56Y69mTOIHUVrH4x9_0 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4817018988636077573', time=2024-08-27T04:52:59.379592+0000, chain.objs.size()=1 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.kod8t5moqIzB_tRhvQn2UHqxtvXBey__0 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16921754691035710977', time=2024-08-27T04:53:03.837836+0000, chain.objs.size()=1 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.pzRRSMeMFOzburMdY9sxWptIVLsdUSY_0 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.137764956556494583', time=2024-08-27T04:53:38.958325+0000, chain.objs.size()=1 2024-08-27T02:59:55.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.430+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.xXI0KyR9DPr0_ZtYFW74fb5aUmQys08_0 2024-08-27T02:59:55.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.434+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10513330656964060291', time=2024-08-27T04:55:03.659274+0000, chain.objs.size()=1 2024-08-27T02:59:55.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.434+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.Hp4qaqVD6BoYzAZUuogu5TwEmmD-DLJ_0 2024-08-27T02:59:55.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.434+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1660993872046628400', time=2024-08-27T04:56:29.457147+0000, chain.objs.size()=1 2024-08-27T02:59:55.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.434+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.45RPYwcSiTxVqe5ItL84Y8EbcwaOrk8_0 2024-08-27T02:59:55.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.438+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.442+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T02:59:55.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.442+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.442+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9368570598442424896', time=2024-08-27T04:51:37.648782+0000, chain.objs.size()=4 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.1 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.2 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.3 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10__multipart_foo.2~UzvtriFiOvaJAj_0IZ4pievv260fk0W.4 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4329073215024977111', time=2024-08-27T04:52:59.387936+0000, chain.objs.size()=1 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.Gbl-JobIJL-3LHNsPxiPdhG_DFbkuSz_0 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13468138082085711185', time=2024-08-27T04:53:03.809386+0000, chain.objs.size()=1 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.9rkIW8yF7FXL4MSoIne6emEjrNiVPsN_0 2024-08-27T02:59:55.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14986428648483866367', time=2024-08-27T04:53:07.947573+0000, chain.objs.size()=1 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.R-qcFOplhpF8Yc2Ertwbque5gQFqwW0_0 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6317382768864078267', time=2024-08-27T04:53:38.967637+0000, chain.objs.size()=1 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.u4GdGJ3Pe5ACgPuGA2T54uE7Nccoly9_0 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17611777577205915310', time=2024-08-27T04:54:28.264437+0000, chain.objs.size()=1 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.dwYOf7c7Hh5ElkPnX_bBm7TpGX6U0Kn_0 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7969001570915013888', time=2024-08-27T04:54:28.267107+0000, chain.objs.size()=1 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.wUYdyUO1kGjv1pss9TbbiZBbd8fPtVx_0 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6071017868277556832', time=2024-08-27T04:55:02.343592+0000, chain.objs.size()=1 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.BW3vEtB6jfHS4JARzVJ9vj9aYfMEb9y_0 2024-08-27T02:59:55.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12926169456360578986', time=2024-08-27T04:55:08.674339+0000, chain.objs.size()=1 2024-08-27T02:59:55.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.446+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.7dcsjXUh1hwg8i_NGIskCYjP2vSm1_1_0 2024-08-27T02:59:55.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.450+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17694499112122995411', time=2024-08-27T04:55:48.734548+0000, chain.objs.size()=1 2024-08-27T02:59:55.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.450+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.H36zavRv9KS95GgQiWzv5m6KbFkbV3H_0 2024-08-27T02:59:55.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.454+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11172471359180487721', time=2024-08-27T04:56:24.066984+0000, chain.objs.size()=1 2024-08-27T02:59:55.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.454+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.9yvLHwbpzYMfRJH1UX7kOpcCE_SWv6e_0 2024-08-27T02:59:55.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.454+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.458+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T02:59:55.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.458+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-08-27T02:59:55.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_O1v3-fraq0O-nxPCE_VT5ydA9HWQZjv', time=2024-08-27T04:51:37.861457+0000, chain.objs.size()=1 2024-08-27T02:59:55.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.5YxajOCAsilaKGzCxMphXHTLt8hgqJI_0 2024-08-27T02:59:55.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9096191807234344233', time=2024-08-27T04:54:19.547272+0000, chain.objs.size()=1 2024-08-27T02:59:55.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.99qvwp9UuiYxsSHs_hoyx7SqLPRr2Tx_0 2024-08-27T02:59:55.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10206554354557984493', time=2024-08-27T04:54:24.163304+0000, chain.objs.size()=1 2024-08-27T02:59:55.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.Q--bsPR0ymxd241DCKRmP9xWE8uIEyD_0 2024-08-27T02:59:55.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11009986108292926522', time=2024-08-27T04:54:28.391985+0000, chain.objs.size()=1 2024-08-27T02:59:55.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.Yect3l3bhkQHJ4pSKTzpEYIuzDbn0vQ_0 2024-08-27T02:59:55.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12922773987559127236', time=2024-08-27T04:55:48.661497+0000, chain.objs.size()=1 2024-08-27T02:59:55.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.dzG8R8_aAskhWd7IJZBtnOGVHD-aR0C_0 2024-08-27T02:59:55.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12577163854633943676', time=2024-08-27T04:55:52.564162+0000, chain.objs.size()=1 2024-08-27T02:59:55.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.Rhpydbzn6_8-QTmY4-IdQMPFTAINz8m_0 2024-08-27T02:59:55.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6922130293250822762', time=2024-08-27T04:56:29.361288+0000, chain.objs.size()=1 2024-08-27T02:59:55.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.rXxautxySwkGjnVJGdl-4p4bjWxtPv0_0 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16856170896934757808', time=2024-08-27T04:56:29.477681+0000, chain.objs.size()=1 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.gWNAG451WZ9SsF8n7fPrapWlJFmJohT_0 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17540616692215661420', time=2024-08-27T04:56:29.581138+0000, chain.objs.size()=1 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.46bXnh3PnbLZwv8Rzz6gAe1eEGwGwI6_0 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1176346113666439355', time=2024-08-27T04:56:33.559362+0000, chain.objs.size()=1 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.-Bg9NDX6A_JSusKp3oLd5kDW4S87lC7_0 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15951055490669134943', time=2024-08-27T04:57:08.657701+0000, chain.objs.size()=1 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.WY5gILudsFCiVt7lF0bk5k4ZYz1Kq5F_0 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13687319269096357114', time=2024-08-27T04:57:08.833899+0000, chain.objs.size()=1 2024-08-27T02:59:55.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.462+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.hXv5WSKGXy8XYMHyl9RlWA-L1Z41y6F_0 2024-08-27T02:59:55.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.466+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13896969608575966904', time=2024-08-27T04:59:17.381666+0000, chain.objs.size()=1 2024-08-27T02:59:55.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.466+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.zcJ12L2d4s4oXS5FWFZnOhhyUqIURRq_0 2024-08-27T02:59:55.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.470+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T02:59:55.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-08-27T02:59:55.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_6H0_IH7Sp_IDquUdoq0_4VzsDbQgiXv', time=2024-08-27T04:51:37.795552+0000, chain.objs.size()=1 2024-08-27T02:59:55.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.q7dJ8r0fB9P4Oqhf52ySjb3hDWjJ1Jk_0 2024-08-27T02:59:55.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15387456956909999274', time=2024-08-27T04:52:59.341306+0000, chain.objs.size()=1 2024-08-27T02:59:55.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.qq-eBu7Y1_uyzd1vjO3blMUI0YPJzZW_0 2024-08-27T02:59:55.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8394832888947195224', time=2024-08-27T04:54:28.349855+0000, chain.objs.size()=1 2024-08-27T02:59:55.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.5qN-RKkR0o8TsxA3E3JVds0LTzANfD0_0 2024-08-27T02:59:55.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9640640418022779765', time=2024-08-27T04:55:03.711924+0000, chain.objs.size()=1 2024-08-27T02:59:55.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.5dobVhLIUNY187FRGEGBkYhAiS7wRKk_0 2024-08-27T02:59:55.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9208972485819036304', time=2024-08-27T04:55:08.579300+0000, chain.objs.size()=1 2024-08-27T02:59:55.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.LBa0pgClCbu-zgu8ix8G3LyF0rUdSmk_0 2024-08-27T02:59:55.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3682638585789578797', time=2024-08-27T04:55:08.672498+0000, chain.objs.size()=1 2024-08-27T02:59:55.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.q_8zLX4KHJyeu3JvsgkbhCYlWog2Bug_0 2024-08-27T02:59:55.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6053407737491748972', time=2024-08-27T04:55:43.500217+0000, chain.objs.size()=1 2024-08-27T02:59:55.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.Gbwb8tMo31wuGofwK7SOPLzFbzoOMOh_0 2024-08-27T02:59:55.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4532424673680479290', time=2024-08-27T04:55:48.660099+0000, chain.objs.size()=1 2024-08-27T02:59:55.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.ZTJwV0j5ySkiCGTgD-sOWnKTE6LBBe7_0 2024-08-27T02:59:55.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10473414200599013056', time=2024-08-27T04:57:08.597401+0000, chain.objs.size()=1 2024-08-27T02:59:55.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.7OKaf3qRREZVDcuXlkySd1hzSfKXF7J_0 2024-08-27T02:59:55.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10829062347647249566', time=2024-08-27T04:59:17.371010+0000, chain.objs.size()=1 2024-08-27T02:59:55.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.lwveMvc_M-EQ2zLm8_bVtM83dSoGPt-_0 2024-08-27T02:59:55.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3063832060988813897', time=2024-08-27T04:59:32.443540+0000, chain.objs.size()=1 2024-08-27T02:59:55.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.474+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18__shadow:uiqR4DnB4xX69rIcfFva0sUfDoxm5SY_.LcHBfOJoBAvF1_v8k3FLgT74ZmGsbel_0 2024-08-27T02:59:55.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.482+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.482+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T02:59:55.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_z7G6yppMkmlZ9a8GL8QOavFX5eDWHOh', time=2024-08-27T04:51:37.988629+0000, chain.objs.size()=2 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EeKnOUouumN_mUhFD3GoJl_CccU78LY_0 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EeKnOUouumN_mUhFD3GoJl_CccU78LY_1 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15533611480471717735', time=2024-08-27T04:51:38.123860+0000, chain.objs.size()=3 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-LUKEWARM.2~aCqGOu28WvaQFhTz9lN0vhj53Pbsl9s.1 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-LUKEWARM.2~aCqGOu28WvaQFhTz9lN0vhj53Pbsl9s.2 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14__multipart_foo-LUKEWARM.2~aCqGOu28WvaQFhTz9lN0vhj53Pbsl9s.3 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6197859065559072773', time=2024-08-27T04:52:59.389392+0000, chain.objs.size()=1 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.dLJWvN2a_mnaUpj6kI_BKFJSMIbRE4l_0 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10971338925628207608', time=2024-08-27T04:54:19.483544+0000, chain.objs.size()=1 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.XlPINMUW0oX92LrLIsvWns4mb91zRRJ_0 2024-08-27T02:59:55.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3650333798750629826', time=2024-08-27T04:54:24.228906+0000, chain.objs.size()=1 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.o_BWGE8IkGHdnQuMlhAb3MYU1-8206u_0 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17458719662180055198', time=2024-08-27T04:55:03.754146+0000, chain.objs.size()=1 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_._KsLbV4OEZCVyFm8R-pUeICwWWMdH1m_0 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.766026459844774780', time=2024-08-27T04:55:43.425577+0000, chain.objs.size()=1 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.6DZsCK14FYDD3sgCteWes6QZcaaa5E6_0 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11938746516757740331', time=2024-08-27T04:55:48.742802+0000, chain.objs.size()=1 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.nDDodfJ5bzLI9hq8Ps3qWgjiE6dKwzD_0 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1659911351428211124', time=2024-08-27T04:56:33.417323+0000, chain.objs.size()=1 2024-08-27T02:59:55.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.486+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.BZOG9-H0oSHJdSW3TKt1uh2hvLHXfdz_0 2024-08-27T02:59:55.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.490+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5555362784649693215', time=2024-08-27T04:59:17.315266+0000, chain.objs.size()=1 2024-08-27T02:59:55.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.490+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.4g6crACpYf9NtuIXJnpz-2-1cnjW6w__0 2024-08-27T02:59:55.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.494+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T02:59:55.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-08-27T02:59:55.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_YtpZQ3yL6ibr_BiFeve1yldi4DuLQzX', time=2024-08-27T04:51:37.956354+0000, chain.objs.size()=2 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EqVpSLoGKHO3VIXuEDhzmcQodJZEgL7_0 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.EqVpSLoGKHO3VIXuEDhzmcQodJZEgL7_1 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2186107683697831864', time=2024-08-27T04:53:03.809522+0000, chain.objs.size()=1 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.fKP50Uk3oUClwLujs4EqrIhveHBXoo6_0 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7544294452190041652', time=2024-08-27T04:53:03.866449+0000, chain.objs.size()=1 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.4HBxLj1s6R5mViN5wgzxzEuhg0Jc1-I_0 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1088921245664421967', time=2024-08-27T04:53:38.969940+0000, chain.objs.size()=1 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.6jMlZkTpFEklrNlXSnUXJ-sgY7-RcuD_0 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5883893526493541500', time=2024-08-27T04:54:19.650306+0000, chain.objs.size()=1 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.jJ62dwV07DfFhX-X12-_AB9Gg3YL70u_0 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3513873433686930408', time=2024-08-27T04:54:28.444184+0000, chain.objs.size()=1 2024-08-27T02:59:55.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.zfvrMRc69GgvDr5Dq7PeR8ErjCTowdR_0 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10078918826923842970', time=2024-08-27T04:55:43.549122+0000, chain.objs.size()=1 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.Fav33ttp2acfpi7OxToxMpIK_HKg13X_0 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7225832060060662201', time=2024-08-27T04:56:24.066504+0000, chain.objs.size()=1 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.fpYK_EumacgUBmOLymbi5xpkbHr_G5Z_0 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17603722983763851731', time=2024-08-27T04:56:29.464567+0000, chain.objs.size()=1 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.wYLmg2LAtr988j8zOpP2Jkx9YRUeTwx_0 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8289214309071994', time=2024-08-27T04:57:08.803001+0000, chain.objs.size()=1 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.wK6dd03aB6iFaBpdlO4bRZyRsVQTebC_0 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9103651014765764956', time=2024-08-27T04:59:17.362771+0000, chain.objs.size()=1 2024-08-27T02:59:55.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.498+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.idpuk2i5iikN2SQt7aFlPZSmoS17m87_0 2024-08-27T02:59:55.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.510+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.510+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T02:59:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_H97z9BAArcmEeNXUtrxSWqFST36zA4K', time=2024-08-27T04:51:37.823897+0000, chain.objs.size()=1 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.tDETIc7NTCcTUOU-v81kLvXTZLbKb5H_0 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17588568015083594170', time=2024-08-27T04:53:38.905639+0000, chain.objs.size()=1 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.H19tb27Jb4BVabDbDE8bobI16ycFoN1_0 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8565195094186831489', time=2024-08-27T04:54:24.095562+0000, chain.objs.size()=1 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.hlfozy1YERdFJmNaR6h9PCUI4HD5xVZ_0 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8812573795377257394', time=2024-08-27T04:54:28.373183+0000, chain.objs.size()=1 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.qBTApkHmwyE3duDwg0eXHms4pwn--C1_0 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9568888276765287750', time=2024-08-27T04:55:03.578123+0000, chain.objs.size()=1 2024-08-27T02:59:55.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.4py-61EXsOE7MPGhR4rYlCK33xe8970_0 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6236380415434748152', time=2024-08-27T04:55:08.682546+0000, chain.objs.size()=1 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.5_UnkLFvTqX68AaD75I_QXM4XDv1A19_0 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4952232869274272712', time=2024-08-27T04:55:08.704088+0000, chain.objs.size()=1 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.bDIvFm6yWIue0qQDLGulk9p0Dv8Djp6_0 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14094193687941072118', time=2024-08-27T04:55:43.476894+0000, chain.objs.size()=1 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.8hDarzjbW7MnBXHWJ9F5G_gQ3tX7u9z_0 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3934063435533763152', time=2024-08-27T04:55:48.531756+0000, chain.objs.size()=1 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.FGq9um86HLJa-NppHBTS-TYcilSWHfl_0 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5628610243357712684', time=2024-08-27T04:56:33.296216+0000, chain.objs.size()=1 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.C2mtsq_bOond6chkAfjwAc-RQ9abc5Y_0 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3632592320394598321', time=2024-08-27T04:57:08.714876+0000, chain.objs.size()=1 2024-08-27T02:59:55.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.514+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.-XbDou0zi_3I3G1khb3cYyp5nklwyRi_0 2024-08-27T02:59:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.522+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.522+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T02:59:55.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-08-27T02:59:55.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10310647463942057623', time=2024-08-27T04:51:37.999128+0000, chain.objs.size()=3 2024-08-27T02:59:55.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.1 2024-08-27T02:59:55.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.2 2024-08-27T02:59:55.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.3 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1679982129035726245', time=2024-08-27T04:54:24.169865+0000, chain.objs.size()=1 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.S4cjDy99QMaRs7tEd60bX2J5B_HB7M8_0 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16172318786744121470', time=2024-08-27T04:55:03.711918+0000, chain.objs.size()=1 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.nWx-0wRYPzzn0uf5K1Ap6mXzr2PpV3v_0 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1180011130282267112', time=2024-08-27T04:55:48.662566+0000, chain.objs.size()=1 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.Kh-0DnfE8QBQk8OX7Au28oOKjUy8wx6_0 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7838367082520594788', time=2024-08-27T04:56:24.047343+0000, chain.objs.size()=1 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.kbXxmZzjoqew3Xnp3iredTrLzJyX-tm_0 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3090427398095541945', time=2024-08-27T04:56:24.048754+0000, chain.objs.size()=1 2024-08-27T02:59:55.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.L0F7w1yaIaLGHHumpc2kCvhtxFkVu-l_0 2024-08-27T02:59:55.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12912995157413247309', time=2024-08-27T04:56:24.076586+0000, chain.objs.size()=1 2024-08-27T02:59:55.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.iLQ7VDJLwwuOereQRlt9jLJfKdHXvZe_0 2024-08-27T02:59:55.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9077510232637455671', time=2024-08-27T04:56:29.393358+0000, chain.objs.size()=1 2024-08-27T02:59:55.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.526+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.DIpQyHkFcrGMhfOsF7TuuS4pPXvNA13_0 2024-08-27T02:59:55.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.530+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T02:59:55.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4929802261401316868', time=2024-08-27T04:53:03.815227+0000, chain.objs.size()=1 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.XeFpLQxMCBgfe7MypZe7PAEjO_oGH3v_0 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10696352287179885606', time=2024-08-27T04:53:44.230373+0000, chain.objs.size()=1 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.mZKRuntJZGaYodqyxr2OyyLV9lUKPVb_0 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4105624755633911422', time=2024-08-27T04:55:03.819956+0000, chain.objs.size()=1 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.iatUq_EySf00_f6w-v47UO0X7jmno5p_0 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11359420486402525977', time=2024-08-27T04:56:29.392359+0000, chain.objs.size()=1 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.w7CCQ6mLeH63WZ9yH2zs0WiFwno4EuJ_0 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4469160061956375654', time=2024-08-27T04:56:33.298766+0000, chain.objs.size()=1 2024-08-27T02:59:55.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.534+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.aHwIW1MZvqM2BvATUmEY5fq4yBML5Ln_0 2024-08-27T02:59:55.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.538+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T02:59:55.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-08-27T02:59:55.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3450394327470063873', time=2024-08-27T04:51:37.469703+0000, chain.objs.size()=1 2024-08-27T02:59:55.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_._92g-E-J27HtLwafgFpAP2-QHAAYHYN_0 2024-08-27T02:59:55.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.532761653474932060', time=2024-08-27T04:51:38.377936+0000, chain.objs.size()=1 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7__shadow_.kbPIT0v5OhAb2KSDV659Gm0D6KqRYeu_0 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7767080558016338133', time=2024-08-27T04:53:38.954068+0000, chain.objs.size()=1 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.cuDuRibfnmG2eAuYY84kTdGJRaMFSF-_0 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17640069287198082031', time=2024-08-27T04:53:44.204057+0000, chain.objs.size()=1 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.VKahrwJdG3R_5wwEFm5FLyrJTIrhatx_0 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9549260736808787276', time=2024-08-27T04:53:44.332562+0000, chain.objs.size()=1 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.jCylh73r58W_3yDYjRO-Wbtieg2Sdt-_0 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9846808731547662380', time=2024-08-27T04:54:24.255506+0000, chain.objs.size()=1 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.8jSGtWmcNrpulKzO5YZeZxMa1ERWLfJ_0 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3678527739489672816', time=2024-08-27T04:55:08.680184+0000, chain.objs.size()=1 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.BdDYEPSvGdqzcUb0FmNR7QIWVlgAPSS_0 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17342048975504558207', time=2024-08-27T04:55:43.356287+0000, chain.objs.size()=1 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.R5iO-VBVaHgyKyU2OMOU5NQX8olQFvi_0 2024-08-27T02:59:55.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18371878043910274106', time=2024-08-27T04:56:24.091576+0000, chain.objs.size()=1 2024-08-27T02:59:55.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.9Ye173nUZc4Y6mh7KncqsD5a7mTp9hT_0 2024-08-27T02:59:55.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8622459681987402872', time=2024-08-27T04:56:24.093590+0000, chain.objs.size()=1 2024-08-27T02:59:55.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.W3C4KG7WL09KBi99z5xJXSoab6A9PBt_0 2024-08-27T02:59:55.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9321422335516442367', time=2024-08-27T04:56:33.298288+0000, chain.objs.size()=1 2024-08-27T02:59:55.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.RE-M6avnIhfrALNTwI_JHVNLFtgsSti_0 2024-08-27T02:59:55.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5357338784988300066', time=2024-08-27T04:57:08.708017+0000, chain.objs.size()=1 2024-08-27T02:59:55.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.542+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.GvSMUfgiQo38TSaCDNGoBlLazXige0R_0 2024-08-27T02:59:55.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.550+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8471763362472339043', time=2024-08-27T04:57:08.810762+0000, chain.objs.size()=1 2024-08-27T02:59:55.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.550+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.IzSpcoKz0e2_rar1L4SOx85D9Tnm9Y9_0 2024-08-27T02:59:55.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.550+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.554+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T02:59:55.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-27T02:59:55.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1553501711830331110', time=2024-08-27T04:52:59.390824+0000, chain.objs.size()=1 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.Q2bdq0mh1Bv-mj2iUsFXXJ24FPZG6d7_0 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12053364336882565225', time=2024-08-27T04:53:03.739765+0000, chain.objs.size()=1 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.XdHfp0Roh3r3pIvqw3-VyXIZObUYCb8_0 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11367989537200627495', time=2024-08-27T04:53:03.815168+0000, chain.objs.size()=1 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.GcSlZPQ68EILphoJ_IV4g8zUZOXQVAp_0 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15253965790397816112', time=2024-08-27T04:54:19.486865+0000, chain.objs.size()=1 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.RJjTRU8bTYNkp_B3FA3-weVMRfyFvRd_0 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1562870693662222828', time=2024-08-27T04:55:43.560701+0000, chain.objs.size()=1 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_._cDpzMQMH6nwmWYxhPWZ2f6LrfXvwLd_0 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3340550370787537339', time=2024-08-27T04:59:32.456428+0000, chain.objs.size()=1 2024-08-27T02:59:55.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.558+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18__shadow:myUdIGQ10F5ztVP0lowM2P3gSg1Q2yw_.uUBwtrBNU0OyiOQAhekWaK00ZCo-gLQ_0 2024-08-27T02:59:55.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.562+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.562+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T02:59:55.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-08-27T02:59:55.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10359780740994382455', time=2024-08-27T04:52:59.361240+0000, chain.objs.size()=1 2024-08-27T02:59:55.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.FZkyKRqfhp1J-ZfXj0TPdB9vxpC-5p5_0 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15002769774006902531', time=2024-08-27T04:53:38.906650+0000, chain.objs.size()=1 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.yLhgCtSvfsmurA7zGEpgAeMRr0CVSNW_0 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10687826648103441483', time=2024-08-27T04:53:44.466744+0000, chain.objs.size()=1 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.wV03whiXrElr5HTJh2YkBgwrjpYC51w_0 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9574671789693131737', time=2024-08-27T04:53:44.500031+0000, chain.objs.size()=1 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.oyMjrDuPO7opNTJbqoB2Hrhelp1YL0O_0 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17984048734981666476', time=2024-08-27T04:54:19.488384+0000, chain.objs.size()=1 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.x8TMm6Cc7wxRH-dv9Uz5W31mwpOAxbc_0 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18239079592324247860', time=2024-08-27T04:54:19.490249+0000, chain.objs.size()=1 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.1xVRJQwLoSQEoLESEZZkq2Do62r-D19_0 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1806500123204047974', time=2024-08-27T04:54:28.130259+0000, chain.objs.size()=1 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.pUiykCXmra6Q0ZVuOQY9TyHk0D5aUJX_0 2024-08-27T02:59:55.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8647447595677455507', time=2024-08-27T04:54:28.213777+0000, chain.objs.size()=1 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.zlx5rNrzqzaMr2lH0CaIpHEOAZiCaEe_0 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16029910292105336544', time=2024-08-27T04:54:28.369495+0000, chain.objs.size()=1 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.XDlGHPoa3cbXHO6PCKI95CQF8hmuUY9_0 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11435181386083389259', time=2024-08-27T04:54:28.452234+0000, chain.objs.size()=1 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.q9AllATR4Cw8Qlx3qjzL7pHEMpz7Kkb_0 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3986652577690296712', time=2024-08-27T04:55:03.837725+0000, chain.objs.size()=1 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.Fx8GXsIxo1Gt-6QSfi5W49n86S5fWjQ_0 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4412618681440910140', time=2024-08-27T04:55:08.665545+0000, chain.objs.size()=1 2024-08-27T02:59:55.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.566+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.HC5Sb_BtDCQkFX84J6osBODA0n8bWnO_0 2024-08-27T02:59:55.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8101538078985768200', time=2024-08-27T04:56:24.093315+0000, chain.objs.size()=1 2024-08-27T02:59:55.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.UyWiR_d5nWwGR9F64UhX9Yp1pFTSYMy_0 2024-08-27T02:59:55.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16566549575478445626', time=2024-08-27T04:56:29.477416+0000, chain.objs.size()=1 2024-08-27T02:59:55.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.kN22HssynLgWEFJ1bEctZ0FrRipMIoi_0 2024-08-27T02:59:55.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11337011246159094289', time=2024-08-27T04:56:33.303449+0000, chain.objs.size()=1 2024-08-27T02:59:55.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.L93C06So433oks-MnaId1fvpbh3eUB-_0 2024-08-27T02:59:55.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6139421113575921308', time=2024-08-27T04:56:33.386902+0000, chain.objs.size()=1 2024-08-27T02:59:55.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.574+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.ZZ8dQ2vFtRQcspJVt8r0Q_6_rJnWMcl_0 2024-08-27T02:59:55.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.578+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T02:59:55.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T02:59:55.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1644728237607016545', time=2024-08-27T04:51:38.020219+0000, chain.objs.size()=3 2024-08-27T02:59:55.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.1 2024-08-27T02:59:55.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.2 2024-08-27T02:59:55.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-LUKEWARM.2~CDHjifzEZGR5G2k-uo749BjBmaLkiO5.3 2024-08-27T02:59:55.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3152496642347424061', time=2024-08-27T04:51:38.445529+0000, chain.objs.size()=1 2024-08-27T02:59:55.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_._HSv1OVz8A8skcCDdQFi8VRb7Dwj8_z_0 2024-08-27T02:59:55.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4144167531121606382', time=2024-08-27T04:52:57.893472+0000, chain.objs.size()=1 2024-08-27T02:59:55.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.TI5pcrk4pEfmiyA_aP7RC_EBwZxTkio_0 2024-08-27T02:59:55.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6432178152916375819', time=2024-08-27T04:53:44.247039+0000, chain.objs.size()=1 2024-08-27T02:59:55.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.YYhCmyWmvD04fXyIt_QqWBlOSMOenab_0 2024-08-27T02:59:55.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8358160547699172752', time=2024-08-27T04:53:44.332839+0000, chain.objs.size()=1 2024-08-27T02:59:55.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.xHPuyQWYidq8gxsJUn50ckwlaSCEBig_0 2024-08-27T02:59:55.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4737488385987286884', time=2024-08-27T04:54:28.244718+0000, chain.objs.size()=1 2024-08-27T02:59:55.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.vmfZpmFbdiOxY2RjzyawzBMEeB_Y5iK_0 2024-08-27T02:59:55.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4986138768226048923', time=2024-08-27T04:54:28.372553+0000, chain.objs.size()=1 2024-08-27T02:59:55.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.Vruvqqd0A-kTSc_y-U0W034XUMbA7RS_0 2024-08-27T02:59:55.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14732016331401795279', time=2024-08-27T04:55:03.751060+0000, chain.objs.size()=1 2024-08-27T02:59:55.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.A1NM88CmEjGRiEQVj93YPTO0c-xDR6X_0 2024-08-27T02:59:55.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7942454986363569846', time=2024-08-27T04:56:23.976474+0000, chain.objs.size()=1 2024-08-27T02:59:55.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.Mr622ha8KAdQ_v5t6mi0vI4AFZn_7Oi_0 2024-08-27T02:59:55.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4739116324475789806', time=2024-08-27T04:56:24.087709+0000, chain.objs.size()=1 2024-08-27T02:59:55.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.582+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.YePMrmTbFvNMQCskEzdS8XHWGKT35Iv_0 2024-08-27T02:59:55.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.586+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11763627948056980397', time=2024-08-27T04:56:33.419771+0000, chain.objs.size()=1 2024-08-27T02:59:55.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.586+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.pyDikQ5gKVtIyvTjfUhREKx6FKV_8i1_0 2024-08-27T02:59:55.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.586+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2125346630149487335', time=2024-08-27T04:57:08.711316+0000, chain.objs.size()=1 2024-08-27T02:59:55.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.586+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.LXjSzH_8Wi8cfnoezioTF0IAqRPveF8_0 2024-08-27T02:59:55.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.586+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12317725508163881609', time=2024-08-27T04:59:17.371091+0000, chain.objs.size()=1 2024-08-27T02:59:55.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.586+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.6Zek-eQgyRSrruJdSUrltcJ83IONPdL_0 2024-08-27T02:59:55.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.590+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.195607771739055740', time=2024-08-27T04:59:17.420424+0000, chain.objs.size()=1 2024-08-27T02:59:55.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.590+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_._fVVtmQ1gG7OBfai2UZxX8cOGwZvu51_0 2024-08-27T02:59:55.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.590+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.594+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T02:59:55.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.594+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-27T02:59:55.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6425506128856056288', time=2024-08-27T04:51:38.200472+0000, chain.objs.size()=2 2024-08-27T02:59:55.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.vx5CsmgWIjYqZyfv7i-XWeuWBbxisZB_0 2024-08-27T02:59:55.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.vx5CsmgWIjYqZyfv7i-XWeuWBbxisZB_1 2024-08-27T02:59:55.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7549508097955142588', time=2024-08-27T04:55:03.636763+0000, chain.objs.size()=1 2024-08-27T02:59:55.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.7fBogUWI9INk0gAKz4bvIz34hUegGU5_0 2024-08-27T02:59:55.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2495617292468147327', time=2024-08-27T04:55:08.582967+0000, chain.objs.size()=1 2024-08-27T02:59:55.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.pjzOcZGoKPvT2kR8pAzW_9sz_wJNQSa_0 2024-08-27T02:59:55.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13940386254454555981', time=2024-08-27T04:55:48.786336+0000, chain.objs.size()=1 2024-08-27T02:59:55.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.qnRqTVty05yb0PlAC87-94KwN81di5W_0 2024-08-27T02:59:55.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17332849300460880556', time=2024-08-27T04:56:24.202977+0000, chain.objs.size()=1 2024-08-27T02:59:55.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.ktuwSDguZP1SGZ3L1cAUWGZQ9Fi4tF2_0 2024-08-27T02:59:55.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2613810316444854612', time=2024-08-27T04:57:08.681299+0000, chain.objs.size()=1 2024-08-27T02:59:55.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.N3yp9EiMLSW7I75JOK97CtnRJNy2tWJ_0 2024-08-27T02:59:55.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.598+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.602+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T02:59:55.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T02:59:55.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_ioJQ9P1v1UKo5h9OaM1IuGfwlImzZTL', time=2024-08-27T04:51:37.934058+0000, chain.objs.size()=2 2024-08-27T02:59:55.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.xbw_1iuesSUeazuILKfTxsHzgBG0vtd_0 2024-08-27T02:59:55.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.xbw_1iuesSUeazuILKfTxsHzgBG0vtd_1 2024-08-27T02:59:55.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16730277245573170381', time=2024-08-27T04:51:37.945129+0000, chain.objs.size()=3 2024-08-27T02:59:55.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.1 2024-08-27T02:59:55.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.2 2024-08-27T02:59:55.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__multipart_foo-FROZEN.2~HaJio3yFPfvd5Nm47ojK3AsUzR_7L9g.3 2024-08-27T02:59:55.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13329108310039862321', time=2024-08-27T04:51:38.457564+0000, chain.objs.size()=1 2024-08-27T02:59:55.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8__shadow_.bEPMx3MmsUZfIKsx1ukmFMuKRknGEtc_0 2024-08-27T02:59:55.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1241464984656786677', time=2024-08-27T04:52:59.342853+0000, chain.objs.size()=1 2024-08-27T02:59:55.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.Fa7rC5YEou-5wohSbSQQDqw3T-f1S_R_0 2024-08-27T02:59:55.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1257445044486141786', time=2024-08-27T04:53:03.896525+0000, chain.objs.size()=1 2024-08-27T02:59:55.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.9nCcWjKhIyh5SBXiw50mZwZdi3ivjr7_0 2024-08-27T02:59:55.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6958575020925814958', time=2024-08-27T04:53:44.367698+0000, chain.objs.size()=1 2024-08-27T02:59:55.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.lr-4W7_A3K0W0TP5uNCjP6EaNEf5TUk_0 2024-08-27T02:59:55.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4576303487426593015', time=2024-08-27T04:54:24.078023+0000, chain.objs.size()=1 2024-08-27T02:59:55.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.zmV8k4nUjY5SZOCzYRRE1xRQxzxXnn9_0 2024-08-27T02:59:55.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12086396982692601263', time=2024-08-27T04:54:28.223383+0000, chain.objs.size()=1 2024-08-27T02:59:55.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.CNfNDeNT67ubaA-2CxbfOo-78Wbr9yl_0 2024-08-27T02:59:55.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3939302215644166000', time=2024-08-27T04:54:28.226286+0000, chain.objs.size()=1 2024-08-27T02:59:55.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.606+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.TcK1wp-xIvgcNVz_cR0HnOFRL2bY0Rv_0 2024-08-27T02:59:55.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16642152805676049648', time=2024-08-27T04:55:03.714016+0000, chain.objs.size()=1 2024-08-27T02:59:55.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.bAlwZFx9TuGsHHSwgyx3bG6dJmCf2xN_0 2024-08-27T02:59:55.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1777708350551362967', time=2024-08-27T04:55:43.288521+0000, chain.objs.size()=1 2024-08-27T02:59:55.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.FZQrgHFcTyBuWnKG1ub5bWpHIrDDjoC_0 2024-08-27T02:59:55.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6210760498803828558', time=2024-08-27T04:55:43.450050+0000, chain.objs.size()=1 2024-08-27T02:59:55.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_._ZrJ5SfmHLqq5dUA6fbDo414NrA55in_0 2024-08-27T02:59:55.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.116204152939568200', time=2024-08-27T04:55:43.452233+0000, chain.objs.size()=1 2024-08-27T02:59:55.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.D6bzl2Tkv00P1enNdPuDzJj-U_fG6Ip_0 2024-08-27T02:59:55.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14190799395260277088', time=2024-08-27T04:55:48.574102+0000, chain.objs.size()=1 2024-08-27T02:59:55.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.610+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.AAgo9yC-VdkYiFp5Ff_3ISYADBEfkh9_0 2024-08-27T02:59:55.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.614+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T02:59:55.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T02:59:55.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7778414874280420862', time=2024-08-27T04:52:59.478716+0000, chain.objs.size()=1 2024-08-27T02:59:55.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.j4PQkJZMQ0YQr_20IRmj1UgsiHleYfL_0 2024-08-27T02:59:55.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9809335866555724680', time=2024-08-27T04:53:38.958381+0000, chain.objs.size()=1 2024-08-27T02:59:55.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.8t71wU1RYX_VvtZlaNpGCPST68G6xCA_0 2024-08-27T02:59:55.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11710036249608914275', time=2024-08-27T04:53:44.326422+0000, chain.objs.size()=1 2024-08-27T02:59:55.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.ZCaCL0T8xvDEb2XdnCJ46FUcRczq_JI_0 2024-08-27T02:59:55.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.635761408100802529', time=2024-08-27T04:53:44.474771+0000, chain.objs.size()=1 2024-08-27T02:59:55.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.DS8jz5Tw2aNHvKRdcSb0tO3knq_CdG__0 2024-08-27T02:59:55.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17176097530035609350', time=2024-08-27T04:55:08.681575+0000, chain.objs.size()=1 2024-08-27T02:59:55.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.DkLEBVdZx2LgrxMA55MxJ-ityclnGZ__0 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5927577557653550413', time=2024-08-27T04:55:08.822626+0000, chain.objs.size()=1 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.lRR01cdJpCWpBM9Ru_v6SBL--sU0q1S_0 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9495823121518223904', time=2024-08-27T04:55:08.865527+0000, chain.objs.size()=1 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.VsoyCCtHQRFAIYE81IZTsJTFySdkccs_0 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2945752184515974276', time=2024-08-27T04:55:43.313725+0000, chain.objs.size()=1 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.QRt7fczHSzGNm9Bd-VmGfyC1VSRP7cN_0 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7107984669839363907', time=2024-08-27T04:55:43.315130+0000, chain.objs.size()=1 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.p31fmlsXUwSKOqivb-GrIrMe2I3hVA4_0 2024-08-27T02:59:55.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.766645728107938643', time=2024-08-27T04:56:24.046644+0000, chain.objs.size()=1 2024-08-27T02:59:55.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.ZhYzd95hIpG-S6Z1iN_iVmyK2fUmC2T_0 2024-08-27T02:59:55.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11526246604511031246', time=2024-08-27T04:56:24.205660+0000, chain.objs.size()=1 2024-08-27T02:59:55.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.4yrRGrFBYBZkVywcr79UGnM8861mV4b_0 2024-08-27T02:59:55.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9914415977885566099', time=2024-08-27T04:57:08.768281+0000, chain.objs.size()=1 2024-08-27T02:59:55.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.618+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.qr1cRVg3IMDNGJb9jsno2o8m2fxbyWE_0 2024-08-27T02:59:55.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.622+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15124406974242852865', time=2024-08-27T04:57:08.769545+0000, chain.objs.size()=1 2024-08-27T02:59:55.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.622+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.pyYaZKWgUuuqBgxNb0GsjKRA8wsRthr_0 2024-08-27T02:59:55.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.626+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15161955441988238430', time=2024-08-27T04:59:26.400765+0000, chain.objs.size()=1 2024-08-27T02:59:55.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.626+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18__shadow:UkvNoWe2KFOtRwvc5IjzxSQ.GG2Sqcn_.8FY-xU7t8umfM71tWkVCGg3bNCoBssz_0 2024-08-27T02:59:55.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.626+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.630+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T02:59:55.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.630+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-08-27T02:59:55.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5397974099950019039', time=2024-08-27T04:51:37.436641+0000, chain.objs.size()=1 2024-08-27T02:59:55.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.aB9b4HGRYzoKEIvMpSm7D48gAB3m1B2_0 2024-08-27T02:59:55.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6398504671496126439', time=2024-08-27T04:51:37.707090+0000, chain.objs.size()=4 2024-08-27T02:59:55.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.1 2024-08-27T02:59:55.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.2 2024-08-27T02:59:55.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.3 2024-08-27T02:59:55.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9__multipart_foo.2~eOX6JBeLLE5NqS8HEo1kkk_HVpk0LKK.4 2024-08-27T02:59:55.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3953573548017976327', time=2024-08-27T04:53:03.736994+0000, chain.objs.size()=1 2024-08-27T02:59:55.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.B2A0eUhBr93mI7Ot89RlX5VYbjyVRSs_0 2024-08-27T02:59:55.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15029853710416730751', time=2024-08-27T04:53:38.846826+0000, chain.objs.size()=1 2024-08-27T02:59:55.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.KDG9evArp8esNndpzjsjLQSnlB5VmF-_0 2024-08-27T02:59:55.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5207789460497770738', time=2024-08-27T04:54:19.542527+0000, chain.objs.size()=1 2024-08-27T02:59:55.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.hiu-Br3NnIWcZ4XJZqYyKYBeaedIKMv_0 2024-08-27T02:59:55.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5392610797025848986', time=2024-08-27T04:54:19.681032+0000, chain.objs.size()=1 2024-08-27T02:59:55.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.qigmbScRfagUERecUGasWMgcUfyaVfS_0 2024-08-27T02:59:55.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7665707700341250881', time=2024-08-27T04:54:19.682902+0000, chain.objs.size()=1 2024-08-27T02:59:55.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.CQq3Hs6lqN1535caz6fM9vgjDszvmK1_0 2024-08-27T02:59:55.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13563173322323553225', time=2024-08-27T04:54:24.101066+0000, chain.objs.size()=1 2024-08-27T02:59:55.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.d1MGgkGgJVgj1NcZs9CFNCQ65QDKwuo_0 2024-08-27T02:59:55.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15991144745658132823', time=2024-08-27T04:54:24.230618+0000, chain.objs.size()=1 2024-08-27T02:59:55.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.xGQK9bEKIDhmaOsCATKqPYSch833snd_0 2024-08-27T02:59:55.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2592360053266262757', time=2024-08-27T04:54:28.448938+0000, chain.objs.size()=1 2024-08-27T02:59:55.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.634+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.SrRIQCiHlyA2OvzYITkCI9nBZCiE7I8_0 2024-08-27T02:59:55.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4483225640164266792', time=2024-08-27T04:55:43.358892+0000, chain.objs.size()=1 2024-08-27T02:59:55.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.bsz8mbkafKfQ9H_e2nPaYepr1CiYSz9_0 2024-08-27T02:59:55.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6372509973086149285', time=2024-08-27T04:55:43.427583+0000, chain.objs.size()=1 2024-08-27T02:59:55.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.K337NAz2wBrSh5SxzXMxPYDrs__R9it_0 2024-08-27T02:59:55.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.789430965615734707', time=2024-08-27T04:55:43.487525+0000, chain.objs.size()=1 2024-08-27T02:59:55.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.1ba_NKvNn0ukYB2LU6gYz2ugYi3cmSi_0 2024-08-27T02:59:55.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15497765332040525200', time=2024-08-27T04:55:43.529152+0000, chain.objs.size()=1 2024-08-27T02:59:55.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.4x85tsdT7Qt_8SfFtrMJBiJpRcnlffz_0 2024-08-27T02:59:55.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7087319558596444706', time=2024-08-27T04:56:33.297263+0000, chain.objs.size()=1 2024-08-27T02:59:55.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.638+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.KJe5f953l2JqENUywFtAl3zpMKejLBc_0 2024-08-27T02:59:55.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.642+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T02:59:55.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-08-27T02:59:55.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10629963107393991617', time=2024-08-27T04:51:38.189355+0000, chain.objs.size()=1 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13__shadow_.YBDwLCoytx8n8BdrmtNwvn1mDWW4Hto_0 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13996907293845730679', time=2024-08-27T04:53:39.026853+0000, chain.objs.size()=1 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.tU6FVUVCagZe9B4LSb7uijnLE-VIaU1_0 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5947774578222712398', time=2024-08-27T04:53:44.334055+0000, chain.objs.size()=1 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.KSmtRpfn0LVG5lyiCvHlp3DUr9UNnX-_0 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13012164795588463381', time=2024-08-27T04:53:48.095051+0000, chain.objs.size()=1 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.LNdQoa8SROVAweG-jZYN2bzq9hhwAym_0 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1166333354148696879', time=2024-08-27T04:55:03.721272+0000, chain.objs.size()=1 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.26__shadow_.6y8mTOKMbdBvz7sSfCSm4_THQ_jvb50_0 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17643572393017239047', time=2024-08-27T04:55:08.796195+0000, chain.objs.size()=1 2024-08-27T02:59:55.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.7NhD1pxEXrUW-Q-_eQcdQLyHir_RYNp_0 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14874692280042014537', time=2024-08-27T04:56:29.356268+0000, chain.objs.size()=1 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.8ZhDjcfAsotsrCzQ3di7g-LnT3xsW30_0 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5874240490481713760', time=2024-08-27T04:56:29.464515+0000, chain.objs.size()=1 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.CIYFu1RYEIbD1VXfikDHg5gvW2Wu2ek_0 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17097509572710713429', time=2024-08-27T04:56:29.466834+0000, chain.objs.size()=1 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.k2Bz2DVk0xuqVR-pQ0B1Cx2T1Pr_Du3_0 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.259340667411974168', time=2024-08-27T04:56:29.468973+0000, chain.objs.size()=1 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.gtyh9KsL_E3y_5n7Ae2PVICMuXa9rOR_0 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1771073897011468671', time=2024-08-27T04:57:08.760665+0000, chain.objs.size()=1 2024-08-27T02:59:55.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.5_WJ4a45IfJ27aXHCIdrDOwAffvzca4_0 2024-08-27T02:59:55.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12839502617363512862', time=2024-08-27T04:57:08.831391+0000, chain.objs.size()=1 2024-08-27T02:59:55.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.646+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.cY4XNJ-OR5uOPQXMub6URFaJgDQ8Lv7_0 2024-08-27T02:59:55.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.654+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T02:59:55.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-08-27T02:59:55.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14273655400213239496', time=2024-08-27T04:51:37.588208+0000, chain.objs.size()=4 2024-08-27T02:59:55.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.1 2024-08-27T02:59:55.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.2 2024-08-27T02:59:55.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.3 2024-08-27T02:59:55.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12__multipart_foo.2~nz77eWH-EU7EQZZi7XQ6DdtItptzkVF.4 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_oCnPvLnha8Sxf9AaJcupsW0-FSfbXpB', time=2024-08-27T04:51:37.967862+0000, chain.objs.size()=2 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.MrfT33g9JhHTR_RWY-XWjKLfJTtmQvo_0 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.MrfT33g9JhHTR_RWY-XWjKLfJTtmQvo_1 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3976814626856945695', time=2024-08-27T04:52:59.376621+0000, chain.objs.size()=1 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.iiafXJm2wn4q9HQcd9MXJj2MARgN2Iz_0 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11217924108221212777', time=2024-08-27T04:53:03.650697+0000, chain.objs.size()=1 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20__shadow_.fVuU2YCcaArLAVY16NEAlCGvWfSOgfo_0 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12053182868799285819', time=2024-08-27T04:53:44.366524+0000, chain.objs.size()=1 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.22__shadow_.7qiWquFIE5x5vesNLOquGV-7CPPLqf7_0 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15306959465804699900', time=2024-08-27T04:54:19.582139+0000, chain.objs.size()=1 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.0nk8OKEO9IB7xa8d7Uz-aOE2Lc2tMPB_0 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10546681083448629910', time=2024-08-27T04:55:43.386716+0000, chain.objs.size()=1 2024-08-27T02:59:55.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.XNJrkkNAFIJouZOsMJ78EZk9LBUVgMH_0 2024-08-27T02:59:55.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2399421616000452265', time=2024-08-27T04:57:08.689494+0000, chain.objs.size()=1 2024-08-27T02:59:55.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.658+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.5u2tA7GHCiGaRZ-hflbAjqmGJjLvZe__0 2024-08-27T02:59:55.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.666+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T02:59:55.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-08-27T02:59:55.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11698415085266806171', time=2024-08-27T04:51:37.815080+0000, chain.objs.size()=1 2024-08-27T02:59:55.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.VL0XtvXxmCr3PDpX8QXqVj7m5GVyeH2_0 2024-08-27T02:59:55.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_pGEWWPLGxjKqZeFhAWtbvT5zb7id338', time=2024-08-27T04:51:38.032072+0000, chain.objs.size()=1 2024-08-27T02:59:55.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16__shadow_.QRDGRViM7aeCq47vDB0-KkYyKN3wz8H_0 2024-08-27T02:59:55.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1573276235307836716', time=2024-08-27T04:52:59.344334+0000, chain.objs.size()=1 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.ieCYzvVCpEbXQ8Ff_QC_IfUXsm0Wnl2_0 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16625037547042148367', time=2024-08-27T04:53:38.952812+0000, chain.objs.size()=1 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.YA7l5vIVJ3V6YLa6m0VKpma6EqpZna7_0 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13739035956981302211', time=2024-08-27T04:54:24.328667+0000, chain.objs.size()=1 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.BUgcAmH0WjNphWASc4iAN5xwIgaJjrz_0 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7727557747074361222', time=2024-08-27T04:56:29.452603+0000, chain.objs.size()=1 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.z1FlUHrNz18m19aRTIDcAECX191F_Eo_0 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13464234259124492116', time=2024-08-27T04:56:33.512562+0000, chain.objs.size()=1 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.myMSP4bTpOyvuFhjh1JDT6zWIuo2H5t_0 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12149817661864626221', time=2024-08-27T04:59:17.317657+0000, chain.objs.size()=1 2024-08-27T02:59:55.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.670+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17__shadow_.YsyEwX1T2gI7Plrl0b1OZCRynEH1gS-_0 2024-08-27T02:59:55.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.674+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.678+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T02:59:55.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6955447706210928412', time=2024-08-27T04:53:38.965546+0000, chain.objs.size()=1 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.5xtRhdwjDKmJUFxoj0Wdiq7_BZlMmpe_0 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.969582120023368629', time=2024-08-27T04:53:39.029771+0000, chain.objs.size()=1 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.soTA1YUnxBxA5gWUQORVxAB8nUD-WsI_0 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9279542258424565615', time=2024-08-27T04:54:23.099305+0000, chain.objs.size()=1 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.Op6GqRX-PT7hkQw5MQgNf4-HJaNjIcV_0 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2436012517588778812', time=2024-08-27T04:54:24.262503+0000, chain.objs.size()=1 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.RV2Zz0R9Abehx_8nYq-mA5xPVR6Ssb2_0 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16654270759887985666', time=2024-08-27T04:54:24.290677+0000, chain.objs.size()=1 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.24__shadow_.OHHPpYx2MpSeSTxTK0ZmAJN9vcj63TU_0 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6804336425183314587', time=2024-08-27T04:54:28.215778+0000, chain.objs.size()=1 2024-08-27T02:59:55.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.30f6kQvYSbx4ZKflsM8MH8tq02qgfgc_0 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9014164537738748114', time=2024-08-27T04:54:28.225126+0000, chain.objs.size()=1 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.25__shadow_.SXo9zuvHaQKBZE_WUAjz41p--XKWs-D_0 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18117756249279520282', time=2024-08-27T04:55:08.679634+0000, chain.objs.size()=1 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.y79ELddovFQScJ1C82mnKiLZFivmq4G_0 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9202180184553328343', time=2024-08-27T04:55:11.917841+0000, chain.objs.size()=1 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.o0oKMfuIdyOurCIKt2f7p4yk18exLTp_0 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7500567664296013509', time=2024-08-27T04:55:43.427110+0000, chain.objs.size()=1 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28__shadow_.2lt8BneAvcffH_2LtJ_hUe5F2R-Am_2_0 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4496410710973870717', time=2024-08-27T04:55:47.351250+0000, chain.objs.size()=1 2024-08-27T02:59:55.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.682+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.c6sOROoKSooNjmu0obo1liNrPZWLyOW_0 2024-08-27T02:59:55.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.686+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T02:59:55.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-08-27T02:59:55.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17845348312195308310', time=2024-08-27T04:51:37.427265+0000, chain.objs.size()=1 2024-08-27T02:59:55.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.CKzArEVS6mloU9jwWWQn23nOYbdGfGl_0 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1597749818344361333', time=2024-08-27T04:51:37.453140+0000, chain.objs.size()=1 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_._9m3P_xYwqYM7aBV6rsPcSCX6KJu-t4_0 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='_sRo19q0wqNqJdBYKN_cI2qNLRhgIQF2', time=2024-08-27T04:51:37.805473+0000, chain.objs.size()=1 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15__shadow_.n-S-Ly_kfDOvygL-u5ruh8Unswla2Rm_0 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9517428588849571781', time=2024-08-27T04:54:19.581879+0000, chain.objs.size()=1 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.23__shadow_.IsmrrhUZtcoafdpcfdvP3YVuPA723Ad_0 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10112260560326595651', time=2024-08-27T04:55:08.707612+0000, chain.objs.size()=1 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.27__shadow_.-3meF56NLtb04iC_hsmFUGh4uJNioG__0 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16588365109156622316', time=2024-08-27T04:55:48.661187+0000, chain.objs.size()=1 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.OzXuTHV70qY4HIhC_a2f56w82AloMS__0 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15529463804539042804', time=2024-08-27T04:56:29.458071+0000, chain.objs.size()=1 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.xl4CKRXTrPDsnuKkmg4wCRUzsIVEcr5_0 2024-08-27T02:59:55.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5160655510662307454', time=2024-08-27T04:56:33.363941+0000, chain.objs.size()=1 2024-08-27T02:59:55.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.690+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.32__shadow_.uPlSOUHRo_6nb0voo4L29SaHqJzHWa9_0 2024-08-27T02:59:55.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.694+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.698+0000 7fc8687239c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T02:59:55.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.698+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5893125081181443936', time=2024-08-27T04:51:37.461549+0000, chain.objs.size()=1 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4__shadow_.UwUKY_7Mqpx_5PZ4RijBpEwGU8ZCGY9_0 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5049813698566723169', time=2024-08-27T04:52:59.491688+0000, chain.objs.size()=1 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.19__shadow_.TT6uKSvqJnj3XaONRnT8Fvb3k9Rb7Ub_0 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7811715953352097800', time=2024-08-27T04:53:38.855064+0000, chain.objs.size()=1 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.CxnPOXuheP5fYlwPYTGnI-lMs3PpBDN_0 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10111378650610512629', time=2024-08-27T04:53:39.070038+0000, chain.objs.size()=1 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.21__shadow_.XRfO2scaamgxTAmcMm9k9FLKy2mJWmA_0 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6359761407513639852', time=2024-08-27T04:55:48.732692+0000, chain.objs.size()=1 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.nBQhqwb8hk6gl6RtRvSx3nd_TgFSdWQ_0 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13719100699537374108', time=2024-08-27T04:55:48.764073+0000, chain.objs.size()=1 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.cywM5HmonTepcTJQ9g7K8sarUWYWjBp_0 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11057792288047725555', time=2024-08-27T04:55:48.789794+0000, chain.objs.size()=1 2024-08-27T02:59:55.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.29__shadow_.1ZX9xZQI9RQXQshWXELrd-M33Wg6_dC_0 2024-08-27T02:59:55.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4490162904153070418', time=2024-08-27T04:56:24.193519+0000, chain.objs.size()=1 2024-08-27T02:59:55.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.30__shadow_.BrelM8YEgP4-a0GyHErKM00gvUbwE1O_0 2024-08-27T02:59:55.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6879464297565611635', time=2024-08-27T04:56:29.581003+0000, chain.objs.size()=1 2024-08-27T02:59:55.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31__shadow_.93388f0PYUO8f6EYznkVZJgQCWfawyq_0 2024-08-27T02:59:55.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14777434720435272335', time=2024-08-27T04:57:08.710396+0000, chain.objs.size()=1 2024-08-27T02:59:55.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.702+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.33__shadow_.Wv921Y9eYu9UiNHHx5jQ6JYGSGmurTC_0 2024-08-27T02:59:55.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.706+0000 7fc8687239c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T02:59:55.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.710+0000 7fc71cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:55.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.710+0000 7fc8687239c0 20 remove_watcher() i=0 2024-08-27T02:59:55.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.710+0000 7fc8687239c0 2 removed watcher, disabling cache 2024-08-27T02:59:55.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.714+0000 7fc8687239c0 20 remove_watcher() i=1 2024-08-27T02:59:55.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.714+0000 7fc8687239c0 20 remove_watcher() i=2 2024-08-27T02:59:55.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.714+0000 7fc8687239c0 20 remove_watcher() i=3 2024-08-27T02:59:55.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.718+0000 7fc8687239c0 20 remove_watcher() i=4 2024-08-27T02:59:55.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.718+0000 7fc8687239c0 20 remove_watcher() i=5 2024-08-27T02:59:55.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.718+0000 7fc8687239c0 20 remove_watcher() i=6 2024-08-27T02:59:55.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.718+0000 7fc8687239c0 20 remove_watcher() i=7 2024-08-27T02:59:55.731 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T02:59:55.799 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T02:59:55.799 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T02:59:55.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 realm 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.842+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.846+0000 7fb9287789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T02:59:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.846+0000 7fb9287789c0 20 searching for the correct realm 2024-08-27T02:59:55.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.850+0000 7fb926a7f640 0 -- 172.21.15.143:0/2380514391 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fb91c015070 msgr2=0x7fb91c05c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:55.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.858+0000 7fb92627e640 0 -- 172.21.15.143:0/2380514391 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55d3f6c32340 msgr2=0x55d3f6c34730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T02:59:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T02:59:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T02:59:55.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T02:59:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T02:59:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T02:59:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T02:59:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.862+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 zone default found 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 4 Realm: () 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T02:59:55.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 zonegroup default 2024-08-27T02:59:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados->read ofs=0 len=0 2024-08-27T02:59:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T02:59:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 started sync module instance, tier type = 2024-08-27T02:59:55.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.866+0000 7fb9287789c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.878+0000 7fb9287789c0 20 add_watcher() i=0 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.878+0000 7fb9287789c0 20 add_watcher() i=1 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.878+0000 7fb9287789c0 20 add_watcher() i=2 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.878+0000 7fb9287789c0 20 add_watcher() i=3 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.878+0000 7fb9287789c0 20 add_watcher() i=4 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.878+0000 7fb9287789c0 20 add_watcher() i=5 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.878+0000 7fb9287789c0 20 add_watcher() i=6 2024-08-27T02:59:55.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.882+0000 7fb9287789c0 20 add_watcher() i=7 2024-08-27T02:59:55.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.882+0000 7fb9287789c0 2 all 8 watchers are set, enabling cache 2024-08-27T02:59:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.882+0000 7fb7dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.882+0000 7fb9287789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T02:59:55.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.882+0000 7fb9287789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T02:59:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.950+0000 7fb7577fe640 20 reqs_thread_entry: start 2024-08-27T02:59:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.950+0000 7fb9287789c0 20 init_complete bucket index max shards: 11 2024-08-27T02:59:55.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.950+0000 7fb9287789c0 20 Filter name: none 2024-08-27T02:59:55.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.950+0000 7fb7557fa640 20 reqs_thread_entry: start 2024-08-27T02:59:55.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.950+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T02:59:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.954+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.954+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.954+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.958+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T02:59:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.958+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.958+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.958+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.958+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T02:59:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.962+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.966+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.966+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.966+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T02:59:55.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.970+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.970+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.970+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.970+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T02:59:55.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.974+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.974+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.974+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.978+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T02:59:55.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.982+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.982+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.982+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.986+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T02:59:55.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.990+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.990+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.990 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.990+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.994+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T02:59:55.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.994+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.998+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:55.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.998+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:55.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:55.998+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T02:59:56.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.002+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.002+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.002+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.006+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T02:59:56.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.010+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.010+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.010+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.010+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T02:59:56.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.014+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.018+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.018+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.022+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T02:59:56.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.026+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.026+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.026+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.030+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T02:59:56.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.038+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.038+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.038+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.038+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T02:59:56.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.042+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.042+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.042+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.046+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T02:59:56.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.050+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.050+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.050+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.054+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T02:59:56.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.058+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.058+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.062+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.062+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T02:59:56.065 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.066+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.066 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.066+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.067 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.070+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.070+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T02:59:56.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.074+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.074+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.078+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.078+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T02:59:56.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.082+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.082+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.086+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.086+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T02:59:56.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.090+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.090+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.094+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.098+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T02:59:56.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.098+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.102+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.102+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.102+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T02:59:56.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.106+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.106+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.110+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.110+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T02:59:56.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.114+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.114+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.118+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.118+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T02:59:56.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.122+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.126+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.126+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.126+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T02:59:56.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.130+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.134+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.134+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.138+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T02:59:56.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.138+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.142+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.142+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.146+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T02:59:56.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.146+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.150+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.150+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.154+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T02:59:56.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.158+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.158+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.158+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.162+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T02:59:56.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.166+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.166+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.170+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.170+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T02:59:56.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.174+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.174+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.178+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.178+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T02:59:56.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.182+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.186+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.186+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.186+0000 7fb9287789c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T02:59:56.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.190+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.194+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T02:59:56.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.194+0000 7fb9287789c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T02:59:56.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.198+0000 7fb7dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T02:59:56.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.206+0000 7fb9287789c0 20 remove_watcher() i=0 2024-08-27T02:59:56.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.206+0000 7fb9287789c0 2 removed watcher, disabling cache 2024-08-27T02:59:56.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.206+0000 7fb9287789c0 20 remove_watcher() i=1 2024-08-27T02:59:56.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.210+0000 7fb9287789c0 20 remove_watcher() i=2 2024-08-27T02:59:56.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.210+0000 7fb9287789c0 20 remove_watcher() i=3 2024-08-27T02:59:56.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.214+0000 7fb9287789c0 20 remove_watcher() i=4 2024-08-27T02:59:56.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.218+0000 7fb9287789c0 20 remove_watcher() i=5 2024-08-27T02:59:56.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.218+0000 7fb9287789c0 20 remove_watcher() i=6 2024-08-27T02:59:56.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T02:59:56.222+0000 7fb9287789c0 20 remove_watcher() i=7 2024-08-27T02:59:56.239 DEBUG:teuthology.orchestra.run.smithi143:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-08-27T02:59:56.838 INFO:teuthology.orchestra.run.smithi143.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-08-27T03:00:01.539 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :clean UP-TO-DATE 2024-08-27T03:00:20.538 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :compileJava 2024-08-27T03:00:20.539 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :processResources 2024-08-27T03:00:20.539 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :classes 2024-08-27T03:00:21.338 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:21.338 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :compileTestJava 2024-08-27T03:00:21.339 INFO:teuthology.orchestra.run.smithi143.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-08-27T03:00:21.339 INFO:teuthology.orchestra.run.smithi143.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-08-27T03:00:21.340 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:21.340 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :processTestResources NO-SOURCE 2024-08-27T03:00:21.340 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :testClasses 2024-08-27T03:00:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:27.539 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :test 2024-08-27T03:00:27.539 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:27.539 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-08-27T03:00:34.838 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:34.839 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-08-27T03:00:35.538 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:35.538 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-08-27T03:00:35.838 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:35.838 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-08-27T03:00:36.638 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:36.638 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-08-27T03:00:56.739 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:56.739 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-08-27T03:00:57.638 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:57.638 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-08-27T03:00:57.738 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:57.738 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-08-27T03:00:57.838 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:57.838 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-08-27T03:00:58.038 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:58.038 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-08-27T03:00:58.838 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:00:58.838 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-08-27T03:01:07.938 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:01:07.939 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-08-27T03:01:09.538 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:01:09.538 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-08-27T03:01:09.940 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:01:09.940 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-08-27T03:01:09.940 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27 03:01:09,926 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-08-27T03:02:04.739 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:04.740 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-08-27T03:02:06.438 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:06.439 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-08-27T03:02:06.639 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:06.639 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-08-27T03:02:07.338 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:07.339 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-08-27T03:02:07.638 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:07.639 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-08-27T03:02:09.139 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:09.139 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-08-27T03:02:17.239 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:17.239 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-08-27T03:02:18.139 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:18.139 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-08-27T03:02:18.239 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:18.239 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-08-27T03:02:18.438 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:18.439 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-08-27T03:02:38.139 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:38.139 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-08-27T03:02:39.239 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:02:39.239 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-08-27T03:03:04.839 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:03:04.839 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-08-27T03:03:06.039 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:03:06.039 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-08-27T03:03:10.139 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:03:10.139 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-08-27T03:03:11.039 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:03:11.039 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-08-27T03:05:36.340 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:05:36.340 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-08-27T03:05:37.238 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:05:37.239 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-08-27T03:05:46.239 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:05:46.239 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-08-27T03:05:47.039 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:05:47.039 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-08-27T03:05:54.639 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:05:54.639 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-08-27T03:05:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:05:55.539 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-08-27T03:06:00.438 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:00.439 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-08-27T03:06:25.039 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:25.039 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-08-27T03:06:25.338 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:25.338 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-08-27T03:06:26.238 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:26.239 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-08-27T03:06:26.438 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:26.438 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-08-27T03:06:27.338 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:27.338 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-08-27T03:06:27.538 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:27.539 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-08-27T03:06:28.439 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:28.439 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-08-27T03:06:28.638 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:28.638 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-08-27T03:06:29.538 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:29.538 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-08-27T03:06:29.838 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:29.839 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-08-27T03:06:30.738 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:30.739 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-08-27T03:06:30.938 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:30.939 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-08-27T03:06:31.838 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:31.839 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-08-27T03:06:32.138 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:32.139 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-08-27T03:06:32.938 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:32.939 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-08-27T03:06:50.638 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:50.639 INFO:teuthology.orchestra.run.smithi143.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-08-27T03:06:51.638 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:51.638 INFO:teuthology.orchestra.run.smithi143.stdout:---------------------------------------------------------------------- 2024-08-27T03:06:51.639 INFO:teuthology.orchestra.run.smithi143.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-08-27T03:06:51.639 INFO:teuthology.orchestra.run.smithi143.stdout:---------------------------------------------------------------------- 2024-08-27T03:06:51.707 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:51.707 INFO:teuthology.orchestra.run.smithi143.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-08-27T03:06:51.707 INFO:teuthology.orchestra.run.smithi143.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-08-27T03:06:51.707 INFO:teuthology.orchestra.run.smithi143.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-08-27T03:06:51.707 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:51.707 INFO:teuthology.orchestra.run.smithi143.stdout:BUILD SUCCESSFUL in 6m 55s 2024-08-27T03:06:51.707 INFO:teuthology.orchestra.run.smithi143.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-08-27T03:06:52.032 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:06:52.063 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:06:52.063 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:06:52.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 realm 2024-08-27T03:06:52.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:06:52.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.110+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.114+0000 7fe2c792b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:52.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.114+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.114+0000 7fe2c792b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:06:52.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.114+0000 7fe2c792b9c0 20 searching for the correct realm 2024-08-27T03:06:52.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.118+0000 7fe2c4c30640 0 -- 172.21.15.143:0/849277945 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fe2b811a050 msgr2=0x7fe2b8135400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:06:52.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.126+0000 7fe2c5c32640 0 -- 172.21.15.143:0/849277945 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fe2bc046910 msgr2=0x7fe2bc01d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:52.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:06:52.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 zone default found 2024-08-27T03:06:52.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 4 Realm: () 2024-08-27T03:06:52.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:06:52.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:06:52.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:06:52.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 zonegroup default 2024-08-27T03:06:52.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 started sync module instance, tier type = 2024-08-27T03:06:52.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.134+0000 7fe2c792b9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:06:52.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=0 2024-08-27T03:06:52.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=1 2024-08-27T03:06:52.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=2 2024-08-27T03:06:52.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=3 2024-08-27T03:06:52.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=4 2024-08-27T03:06:52.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=5 2024-08-27T03:06:52.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=6 2024-08-27T03:06:52.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 20 add_watcher() i=7 2024-08-27T03:06:52.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.154+0000 7fe2c792b9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:06:52.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.158+0000 7fe17b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:52.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.158+0000 7fe2c792b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:06:52.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.158+0000 7fe2c792b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:06:52.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.234+0000 7fe17a7e4640 20 reqs_thread_entry: start 2024-08-27T03:06:52.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.234+0000 7fe2c792b9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:06:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.234+0000 7fe2c792b9c0 20 Filter name: none 2024-08-27T03:06:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.234+0000 7fe0ebfff640 20 reqs_thread_entry: start 2024-08-27T03:06:52.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.234+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:06:52.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.238+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.238+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.238+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.238+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7882073686057865184', time=2024-08-27T05:03:05.361648+0000, chain.objs.size()=1 2024-08-27T03:06:52.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.238+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__shadow_.BKZOPXSZekXRqpIOqUR5bYWogXIAs-0_0 2024-08-27T03:06:52.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.242+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.246+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:06:52.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.250+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.250+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.254+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.254+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3598944761452333910', time=2024-08-27T05:02:38.518499+0000, chain.objs.size()=5 2024-08-27T03:06:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.254+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.46__multipart_key1.2~SZQdcyPZSskJRIbakbMZuwp1tnU7f4B.1 2024-08-27T03:06:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.254+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.46__multipart_key1.2~SZQdcyPZSskJRIbakbMZuwp1tnU7f4B.2 2024-08-27T03:06:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.254+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.46__multipart_key1.2~SZQdcyPZSskJRIbakbMZuwp1tnU7f4B.3 2024-08-27T03:06:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.254+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.46__multipart_key1.2~SZQdcyPZSskJRIbakbMZuwp1tnU7f4B.4 2024-08-27T03:06:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.254+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.46__multipart_key1.2~SZQdcyPZSskJRIbakbMZuwp1tnU7f4B.5 2024-08-27T03:06:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.258+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.266+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:06:52.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12368310892810102276', time=2024-08-27T05:04:41.534260+0000, chain.objs.size()=10 2024-08-27T03:06:52.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.1 2024-08-27T03:06:52.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.2 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.3 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.4 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.5 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.6 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.7 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.8 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.9 2024-08-27T03:06:52.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.270+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~SwVJ-9sMlhtEKqVvHjIRHcDXNQIqP0N.10 2024-08-27T03:06:52.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.282+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.290+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:06:52.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4158269795079736119', time=2024-08-27T05:01:08.905428+0000, chain.objs.size()=5 2024-08-27T03:06:52.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.1 2024-08-27T03:06:52.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.2 2024-08-27T03:06:52.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.3 2024-08-27T03:06:52.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.4 2024-08-27T03:06:52.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.294+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.5 2024-08-27T03:06:52.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.302+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.306+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:06:52.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.306+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17739292911387169264', time=2024-08-27T05:03:05.159121+0000, chain.objs.size()=1 2024-08-27T03:06:52.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__shadow_.7NGpphyJkSm1uLSDyt1NVt7DVOOy2a5_0 2024-08-27T03:06:52.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5645868134676701319', time=2024-08-27T05:04:23.799694+0000, chain.objs.size()=11 2024-08-27T03:06:52.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.1 2024-08-27T03:06:52.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.2 2024-08-27T03:06:52.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.3 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.4 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.5 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.6 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.7 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.8 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.9 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.10 2024-08-27T03:06:52.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.310+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~xvWoikL8ypAzcGWsTlCTzIHR6e5OnJE.11 2024-08-27T03:06:52.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.330+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.334+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:06:52.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.334+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14313314953246561182', time=2024-08-27T05:01:08.162098+0000, chain.objs.size()=5 2024-08-27T03:06:52.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.1 2024-08-27T03:06:52.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.2 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.3 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.4 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.38__multipart_key1.2~DWy8UpbZSjshhsOWXRMKp2D42qYNR8K.5 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9564976340547340441', time=2024-08-27T05:02:17.465481+0000, chain.objs.size()=5 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.45__multipart_key1.2~GzTCLj5-lM7m_LnBkawM2XXhnH89GMk.1 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.45__multipart_key1.2~GzTCLj5-lM7m_LnBkawM2XXhnH89GMk.2 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.45__multipart_key1.2~GzTCLj5-lM7m_LnBkawM2XXhnH89GMk.3 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.45__multipart_key1.2~GzTCLj5-lM7m_LnBkawM2XXhnH89GMk.4 2024-08-27T03:06:52.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.338+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.45__multipart_key1.2~GzTCLj5-lM7m_LnBkawM2XXhnH89GMk.5 2024-08-27T03:06:52.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.350+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.354+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:06:52.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10309306465874099555', time=2024-08-27T05:01:33.067864+0000, chain.objs.size()=5 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~CkgaMAX3WNn7FjtfmaVv3SJbVT6zTxm.1 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~CkgaMAX3WNn7FjtfmaVv3SJbVT6zTxm.2 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~CkgaMAX3WNn7FjtfmaVv3SJbVT6zTxm.3 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~CkgaMAX3WNn7FjtfmaVv3SJbVT6zTxm.4 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~CkgaMAX3WNn7FjtfmaVv3SJbVT6zTxm.5 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2379854678506752257', time=2024-08-27T05:02:04.584390+0000, chain.objs.size()=5 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~vN2DgcERXswfXlNU5GLUffUuA4MwZlU.1 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__shadow_key1.2~vN2DgcERXswfXlNU5GLUffUuA4MwZlU.1_1 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~vN2DgcERXswfXlNU5GLUffUuA4MwZlU.2 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__shadow_key1.2~vN2DgcERXswfXlNU5GLUffUuA4MwZlU.2_1 2024-08-27T03:06:52.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.358+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~vN2DgcERXswfXlNU5GLUffUuA4MwZlU.3 2024-08-27T03:06:52.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.370+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.374+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:06:52.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG', time=2024-08-27T05:06:23.697001+0000, chain.objs.size()=83 2024-08-27T03:06:52.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.1 2024-08-27T03:06:52.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.2 2024-08-27T03:06:52.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.3 2024-08-27T03:06:52.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.4 2024-08-27T03:06:52.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.5 2024-08-27T03:06:52.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.6 2024-08-27T03:06:52.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.7 2024-08-27T03:06:52.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.8 2024-08-27T03:06:52.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.9 2024-08-27T03:06:52.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.10 2024-08-27T03:06:52.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.11 2024-08-27T03:06:52.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.378+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.12 2024-08-27T03:06:52.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.13 2024-08-27T03:06:52.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.14 2024-08-27T03:06:52.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.15 2024-08-27T03:06:52.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.16 2024-08-27T03:06:52.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.17 2024-08-27T03:06:52.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.18 2024-08-27T03:06:52.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.19 2024-08-27T03:06:52.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.20 2024-08-27T03:06:52.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.21 2024-08-27T03:06:52.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.386+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.22 2024-08-27T03:06:52.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.390+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.23 2024-08-27T03:06:52.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.394+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.24 2024-08-27T03:06:52.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.394+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.25 2024-08-27T03:06:52.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.394+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.26 2024-08-27T03:06:52.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.394+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.27 2024-08-27T03:06:52.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.398+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.28 2024-08-27T03:06:52.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.398+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.29 2024-08-27T03:06:52.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.398+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.30 2024-08-27T03:06:52.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.398+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.31 2024-08-27T03:06:52.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.398+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.32 2024-08-27T03:06:52.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.398+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.33 2024-08-27T03:06:52.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.398+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.34 2024-08-27T03:06:52.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.402+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.35 2024-08-27T03:06:52.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.402+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.36 2024-08-27T03:06:52.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.402+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.37 2024-08-27T03:06:52.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.38 2024-08-27T03:06:52.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.39 2024-08-27T03:06:52.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.40 2024-08-27T03:06:52.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.41 2024-08-27T03:06:52.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.42 2024-08-27T03:06:52.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.43 2024-08-27T03:06:52.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.44 2024-08-27T03:06:52.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.406+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.45 2024-08-27T03:06:52.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.410+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.46 2024-08-27T03:06:52.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.410+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.47 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.48 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.49 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.50 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.51 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.52 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.53 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.54 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.55 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.56 2024-08-27T03:06:52.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.414+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.57 2024-08-27T03:06:52.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.418+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.58 2024-08-27T03:06:52.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.59 2024-08-27T03:06:52.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.60 2024-08-27T03:06:52.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.61 2024-08-27T03:06:52.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.62 2024-08-27T03:06:52.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.63 2024-08-27T03:06:52.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.64 2024-08-27T03:06:52.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.65 2024-08-27T03:06:52.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.66 2024-08-27T03:06:52.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.67 2024-08-27T03:06:52.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.68 2024-08-27T03:06:52.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.422+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.69 2024-08-27T03:06:52.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.70 2024-08-27T03:06:52.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.71 2024-08-27T03:06:52.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.72 2024-08-27T03:06:52.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.73 2024-08-27T03:06:52.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.74 2024-08-27T03:06:52.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.75 2024-08-27T03:06:52.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.76 2024-08-27T03:06:52.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.77 2024-08-27T03:06:52.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.78 2024-08-27T03:06:52.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.79 2024-08-27T03:06:52.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.426+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.80 2024-08-27T03:06:52.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.434+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.81 2024-08-27T03:06:52.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.434+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.82 2024-08-27T03:06:52.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.434+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.52__multipart_key1.2~zA6gpV9sgdfO8UOfhWUWyFAi6iXsJeG.83 2024-08-27T03:06:52.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.438+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.442+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:06:52.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.442+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.442+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.442+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.442+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:06:52.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.446+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.446+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.446+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.446+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:06:52.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1649062381004025466', time=2024-08-27T05:01:50.997220+0000, chain.objs.size()=5 2024-08-27T03:06:52.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~apSJSFoKa4YQAcIqhMsRdou8dZC5ByZ.1 2024-08-27T03:06:52.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__shadow_key1.2~apSJSFoKa4YQAcIqhMsRdou8dZC5ByZ.1_1 2024-08-27T03:06:52.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~apSJSFoKa4YQAcIqhMsRdou8dZC5ByZ.2 2024-08-27T03:06:52.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__shadow_key1.2~apSJSFoKa4YQAcIqhMsRdou8dZC5ByZ.2_1 2024-08-27T03:06:52.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.450+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~apSJSFoKa4YQAcIqhMsRdou8dZC5ByZ.3 2024-08-27T03:06:52.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.454+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.454+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:06:52.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17274012699378620083', time=2024-08-27T05:04:06.922498+0000, chain.objs.size()=11 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.1 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.2 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.3 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.4 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.5 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.6 2024-08-27T03:06:52.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.7 2024-08-27T03:06:52.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.8 2024-08-27T03:06:52.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.9 2024-08-27T03:06:52.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.10 2024-08-27T03:06:52.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.458+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~flmnUveX7xfl4YIKyArDklAD8Ocyeq9.11 2024-08-27T03:06:52.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.466+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.470+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:06:52.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.470+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.470+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.470+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.470+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2241873206659585308', time=2024-08-27T05:06:28.930467+0000, chain.objs.size()=1 2024-08-27T03:06:52.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.470+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.56__shadow_.dFhDZ2XMcHUazdjs6iClsKHekK0c8BY_0 2024-08-27T03:06:52.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.474+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.474+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:06:52.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9565482493519143435', time=2024-08-27T05:06:25.582249+0000, chain.objs.size()=1 2024-08-27T03:06:52.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.53__shadow_.41PzPf6JF1s-V5zuOP3rxvzTebMuXUQ_0 2024-08-27T03:06:52.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7218301628529200474', time=2024-08-27T05:06:26.700213+0000, chain.objs.size()=1 2024-08-27T03:06:52.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.54__shadow_.Dus4UByWR__Zh1tj9OnAL9oDeVaOVoE_0 2024-08-27T03:06:52.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.478+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.482+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:06:52.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.482+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.486+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.486+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.486+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:06:52.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.486+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.486+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.486+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:06:52.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2072955517599743523', time=2024-08-27T05:01:27.945402+0000, chain.objs.size()=5 2024-08-27T03:06:52.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~QM1Yfin3jIJ-i-wJdwNETgqJO8sAeTD.1 2024-08-27T03:06:52.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~QM1Yfin3jIJ-i-wJdwNETgqJO8sAeTD.2 2024-08-27T03:06:52.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~QM1Yfin3jIJ-i-wJdwNETgqJO8sAeTD.3 2024-08-27T03:06:52.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~QM1Yfin3jIJ-i-wJdwNETgqJO8sAeTD.4 2024-08-27T03:06:52.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~QM1Yfin3jIJ-i-wJdwNETgqJO8sAeTD.5 2024-08-27T03:06:52.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17016871364490713971', time=2024-08-27T05:01:37.223661+0000, chain.objs.size()=5 2024-08-27T03:06:52.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kqyZPdrDrb48jqzfMLouBvTaP1m8JPm.1 2024-08-27T03:06:52.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kqyZPdrDrb48jqzfMLouBvTaP1m8JPm.2 2024-08-27T03:06:52.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kqyZPdrDrb48jqzfMLouBvTaP1m8JPm.3 2024-08-27T03:06:52.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kqyZPdrDrb48jqzfMLouBvTaP1m8JPm.4 2024-08-27T03:06:52.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.490+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kqyZPdrDrb48jqzfMLouBvTaP1m8JPm.5 2024-08-27T03:06:52.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.498+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.502+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:06:52.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.502+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.502+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.502+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:06:52.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16349192836132771643', time=2024-08-27T05:05:36.231382+0000, chain.objs.size()=11 2024-08-27T03:06:52.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.1 2024-08-27T03:06:52.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.1_1 2024-08-27T03:06:52.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.2 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.2_1 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.3 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.3_1 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.4 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.4_1 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.5 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.5_1 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~pH0hGj2BMxNtjwwVx02MtbDDQMIxPM1.6 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2213499376250079061', time=2024-08-27T05:06:30.073366+0000, chain.objs.size()=1 2024-08-27T03:06:52.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.506+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.57__shadow_.Lmfi6Jy1XlkVXGOy8SB_QtPLlbFNNYI_0 2024-08-27T03:06:52.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.514+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.518+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:06:52.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.518+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12259918824676425371', time=2024-08-27T05:03:05.458620+0000, chain.objs.size()=1 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__shadow_.HOx10Hs8DrbkN0CkCfexGhjGOlpGaem_0 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11811679496918555110', time=2024-08-27T05:05:19.989375+0000, chain.objs.size()=11 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.1 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.1_1 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.2 2024-08-27T03:06:52.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.2_1 2024-08-27T03:06:52.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.3 2024-08-27T03:06:52.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.3_1 2024-08-27T03:06:52.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.4 2024-08-27T03:06:52.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.4_1 2024-08-27T03:06:52.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.5 2024-08-27T03:06:52.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.5_1 2024-08-27T03:06:52.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.522+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~9uJSzVQr-ZkN0-UzxiQOCAsk0CUDdBb.6 2024-08-27T03:06:52.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4964813528228829822', time=2024-08-27T05:05:36.594797+0000, chain.objs.size()=11 2024-08-27T03:06:52.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.1 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.1_1 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.2 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.2_1 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.3 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.3_1 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.4 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.4_1 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.5 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__shadow_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.5_1 2024-08-27T03:06:52.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.526+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.49__multipart_key1.2~g4Jvy-vPiz9iB00a1Fl5voOs5-hE-Go.6 2024-08-27T03:06:52.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.530+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13778795366638187944', time=2024-08-27T05:05:54.829419+0000, chain.objs.size()=5 2024-08-27T03:06:52.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.530+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.51__multipart_key1.2~3xYVMjmWiMlmPG7nFr_9Z2CT1r1LxIr.1 2024-08-27T03:06:52.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.534+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.51__multipart_key1.2~3xYVMjmWiMlmPG7nFr_9Z2CT1r1LxIr.2 2024-08-27T03:06:52.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.534+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.51__multipart_key1.2~3xYVMjmWiMlmPG7nFr_9Z2CT1r1LxIr.3 2024-08-27T03:06:52.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.534+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.51__multipart_key1.2~3xYVMjmWiMlmPG7nFr_9Z2CT1r1LxIr.4 2024-08-27T03:06:52.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.534+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.51__multipart_key1.2~3xYVMjmWiMlmPG7nFr_9Z2CT1r1LxIr.5 2024-08-27T03:06:52.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.538+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:06:52.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-27T03:06:52.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~WvDU_qG_IagXJk5uucbaGBkM4uu5ze6', time=2024-08-27T05:00:34.703367+0000, chain.objs.size()=5 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.34__multipart_key1.2~WvDU_qG_IagXJk5uucbaGBkM4uu5ze6.1 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.34__multipart_key1.2~WvDU_qG_IagXJk5uucbaGBkM4uu5ze6.2 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.34__multipart_key1.2~WvDU_qG_IagXJk5uucbaGBkM4uu5ze6.3 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.34__multipart_key1.2~WvDU_qG_IagXJk5uucbaGBkM4uu5ze6.4 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.34__multipart_key1.2~WvDU_qG_IagXJk5uucbaGBkM4uu5ze6.5 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10190830074917584402', time=2024-08-27T05:03:05.063013+0000, chain.objs.size()=5 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file.mpg.2~ynvK3l-8enFDj_PVsEUKcWnit34Q_gf.1 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file.mpg.2~ynvK3l-8enFDj_PVsEUKcWnit34Q_gf.2 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file.mpg.2~ynvK3l-8enFDj_PVsEUKcWnit34Q_gf.3 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file.mpg.2~ynvK3l-8enFDj_PVsEUKcWnit34Q_gf.4 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file.mpg.2~ynvK3l-8enFDj_PVsEUKcWnit34Q_gf.5 2024-08-27T03:06:52.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12128448954310737947', time=2024-08-27T05:05:46.438314+0000, chain.objs.size()=5 2024-08-27T03:06:52.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.50__multipart_key1.2~4HfhLNzXCpN10wiJJZzPxXEuHw47Z0x.1 2024-08-27T03:06:52.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.542+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.50__multipart_key1.2~4HfhLNzXCpN10wiJJZzPxXEuHw47Z0x.2 2024-08-27T03:06:52.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.550+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.50__multipart_key1.2~4HfhLNzXCpN10wiJJZzPxXEuHw47Z0x.3 2024-08-27T03:06:52.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.550+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.50__multipart_key1.2~4HfhLNzXCpN10wiJJZzPxXEuHw47Z0x.4 2024-08-27T03:06:52.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.550+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.50__multipart_key1.2~4HfhLNzXCpN10wiJJZzPxXEuHw47Z0x.5 2024-08-27T03:06:52.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.554+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.558+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:06:52.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.558+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.558+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.558+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.558+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7838181819803998125', time=2024-08-27T05:06:27.818074+0000, chain.objs.size()=1 2024-08-27T03:06:52.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.558+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.55__shadow_.o8__KYkz6jBI1nwmrzHxZ9rGGcICRAu_0 2024-08-27T03:06:52.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.562+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.562+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:06:52.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.566+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.566+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.566+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.566+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14468272686760792181', time=2024-08-27T05:06:31.212080+0000, chain.objs.size()=1 2024-08-27T03:06:52.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.566+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.58__shadow_.sBT8-v2KSu9uNPvtX6a7gb0klDw4YiL_0 2024-08-27T03:06:52.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.566+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.570+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:06:52.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.570+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.570+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.570+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.574+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:06:52.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.574+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.574+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.574+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.578+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:06:52.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.578+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.578+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.578+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.582+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:06:52.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.582+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.582+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.582+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.582+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8109580481067743292', time=2024-08-27T05:05:44.668009+0000, chain.objs.size()=1 2024-08-27T03:06:52.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.582+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.50__shadow_.GvHP3_T0UPIUrI1xJjGiRfQ_Fc_mQDn_0 2024-08-27T03:06:52.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.586+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.586+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:06:52.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12355540360455459106', time=2024-08-27T05:00:56.992818+0000, chain.objs.size()=5 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.36__multipart_key1.2~588TV02YyPCSri4KeI6R6Vum9M_X5Ec.1 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.36__multipart_key1.2~588TV02YyPCSri4KeI6R6Vum9M_X5Ec.2 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.36__multipart_key1.2~588TV02YyPCSri4KeI6R6Vum9M_X5Ec.3 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.36__multipart_key1.2~588TV02YyPCSri4KeI6R6Vum9M_X5Ec.4 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.36__multipart_key1.2~588TV02YyPCSri4KeI6R6Vum9M_X5Ec.5 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8582197656291943430', time=2024-08-27T05:02:04.943562+0000, chain.objs.size()=5 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kTRBwXk3IWdk8eTWPw5aRgNDw76AnMa.1 2024-08-27T03:06:52.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__shadow_key1.2~kTRBwXk3IWdk8eTWPw5aRgNDw76AnMa.1_1 2024-08-27T03:06:52.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kTRBwXk3IWdk8eTWPw5aRgNDw76AnMa.2 2024-08-27T03:06:52.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__shadow_key1.2~kTRBwXk3IWdk8eTWPw5aRgNDw76AnMa.2_1 2024-08-27T03:06:52.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.590+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.41__multipart_key1.2~kTRBwXk3IWdk8eTWPw5aRgNDw76AnMa.3 2024-08-27T03:06:52.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.598+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:06:52.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15678239131211252360', time=2024-08-27T05:06:50.941050+0000, chain.objs.size()=11 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.1 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.2 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.3 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.4 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.5 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.6 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.7 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.8 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.9 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.10 2024-08-27T03:06:52.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.602+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.60__multipart_key1.2~OU_poTmGnBQJzFJmqod-9go09HaBLMp.11 2024-08-27T03:06:52.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.610+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.614+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:06:52.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.614+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.614+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.614+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.614+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:06:52.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:06:52.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8364523956616875300', time=2024-08-27T05:02:05.777154+0000, chain.objs.size()=4 2024-08-27T03:06:52.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.40__shadow_.Cv8Zt2BiH1eIfAupRexI0PepZKVWwPK_0 2024-08-27T03:06:52.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.40__shadow_.Cv8Zt2BiH1eIfAupRexI0PepZKVWwPK_1 2024-08-27T03:06:52.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.40__shadow_.Cv8Zt2BiH1eIfAupRexI0PepZKVWwPK_2 2024-08-27T03:06:52.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.618+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.40__shadow_.Cv8Zt2BiH1eIfAupRexI0PepZKVWwPK_3 2024-08-27T03:06:52.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.622+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:06:52.626 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:52.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:52.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3545188706204581080', time=2024-08-27T05:03:05.263684+0000, chain.objs.size()=5 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file2.mpg.2~8dhpDWLTmbhrzx-yZnzfrg4qtRtuqw0.1 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file2.mpg.2~8dhpDWLTmbhrzx-yZnzfrg4qtRtuqw0.2 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file2.mpg.2~8dhpDWLTmbhrzx-yZnzfrg4qtRtuqw0.3 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file2.mpg.2~8dhpDWLTmbhrzx-yZnzfrg4qtRtuqw0.4 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.47__multipart_file2.mpg.2~8dhpDWLTmbhrzx-yZnzfrg4qtRtuqw0.5 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XOpmjizXxbo3OnpJRYMze75PIw_b5tp', time=2024-08-27T05:03:10.706439+0000, chain.objs.size()=3 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.48__multipart_key1.2~XOpmjizXxbo3OnpJRYMze75PIw_b5tp.7 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.48__multipart_key1.2~XOpmjizXxbo3OnpJRYMze75PIw_b5tp.10 2024-08-27T03:06:52.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.626+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.48__multipart_key1.2~XOpmjizXxbo3OnpJRYMze75PIw_b5tp.13 2024-08-27T03:06:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.634+0000 7fe2c792b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:06:52.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.638+0000 7fe17b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:52.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.638+0000 7fe2c792b9c0 20 remove_watcher() i=0 2024-08-27T03:06:52.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.638+0000 7fe2c792b9c0 2 removed watcher, disabling cache 2024-08-27T03:06:52.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.638+0000 7fe2c792b9c0 20 remove_watcher() i=1 2024-08-27T03:06:52.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.642+0000 7fe2c792b9c0 20 remove_watcher() i=2 2024-08-27T03:06:52.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.642+0000 7fe2c792b9c0 20 remove_watcher() i=3 2024-08-27T03:06:52.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.642+0000 7fe2c792b9c0 20 remove_watcher() i=4 2024-08-27T03:06:52.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.646+0000 7fe2c792b9c0 20 remove_watcher() i=5 2024-08-27T03:06:52.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.646+0000 7fe2c792b9c0 20 remove_watcher() i=6 2024-08-27T03:06:52.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.646+0000 7fe2c792b9c0 20 remove_watcher() i=7 2024-08-27T03:06:52.659 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:06:52.728 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:06:52.728 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:06:52.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 realm 2024-08-27T03:06:52.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:06:52.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:52.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:52.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.774+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:52.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.778+0000 7feb5b7589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:06:52.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.778+0000 7feb5b7589c0 20 searching for the correct realm 2024-08-27T03:06:52.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.782+0000 7feb59a5f640 0 -- 172.21.15.143:0/4105017966 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7feb4c0393a0 msgr2=0x7feb4c039820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:06:52.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:52.998+0000 7feb5925e640 0 -- 172.21.15.143:0/4105017966 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x562825b075c0 msgr2=0x562825b099d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:06:53.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:06:53.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:06:53.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:06:53.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:06:53.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:06:53.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:06:53.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.006+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:53.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:06:53.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 zone default found 2024-08-27T03:06:53.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 4 Realm: () 2024-08-27T03:06:53.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:06:53.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:06:53.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:06:53.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 zonegroup default 2024-08-27T03:06:53.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 started sync module instance, tier type = 2024-08-27T03:06:53.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.010+0000 7feb5b7589c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:06:53.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=0 2024-08-27T03:06:53.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=1 2024-08-27T03:06:53.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=2 2024-08-27T03:06:53.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=3 2024-08-27T03:06:53.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=4 2024-08-27T03:06:53.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=5 2024-08-27T03:06:53.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=6 2024-08-27T03:06:53.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 20 add_watcher() i=7 2024-08-27T03:06:53.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.038+0000 7feb5b7589c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:06:53.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.042+0000 7fea0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:53.044 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.046+0000 7feb5b7589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:06:53.044 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.046+0000 7feb5b7589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:06:53.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.134+0000 7fea0efe5640 20 reqs_thread_entry: start 2024-08-27T03:06:53.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.134+0000 7feb5b7589c0 20 init_complete bucket index max shards: 11 2024-08-27T03:06:53.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.134+0000 7feb5b7589c0 20 Filter name: none 2024-08-27T03:06:53.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.134+0000 7fea0cfe1640 20 reqs_thread_entry: start 2024-08-27T03:06:53.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.134+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:06:53.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.138+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.138+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.138+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.142+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:06:53.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.146+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.146+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.146+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.150+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:06:53.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.154+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.154+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.154+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.158+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:06:53.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.162+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.162+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.162+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.166+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:06:53.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.170+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.170+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.170+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.174+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:06:53.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.174+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.178+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.178+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.182+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:06:53.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.186+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.186+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.186+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.190+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:06:53.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.194+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.194+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.194+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.198+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:06:53.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.202+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.202+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.202+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.206+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:06:53.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.210+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.210+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.214+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.214+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:06:53.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.218+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.222+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.222+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.222+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:06:53.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.226+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.226+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.230+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.230+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:06:53.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.234+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.238+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.238+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.242+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:06:53.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.246+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.246+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.250+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.250+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:06:53.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.254+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.254+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.258+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.258+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:06:53.263 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.262+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.266+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.266+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.270+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:06:53.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.274+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.274+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.274+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.278+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:06:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.282+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.286+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.286+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.290+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:06:53.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.294+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.294+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.298+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.298+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:06:53.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.302+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.306+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.306+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.306+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:06:53.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.310+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.314+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.314+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.318+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:06:53.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.322+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.322+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.322+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.326+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:06:53.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.330+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.330+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.330+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.334+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:06:53.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.338+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.338+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.338+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.342+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:06:53.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.346+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.346+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.350+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.350+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:06:53.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.354+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.358+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.358+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.358+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:06:53.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.362+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.366+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.366+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.370+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:06:53.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.374+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.374+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.374+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.378+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:06:53.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.382+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.382+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.382+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.386+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:06:53.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.386+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.390+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.390+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.394+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:06:53.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.394+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.398+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.398+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.398+0000 7feb5b7589c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:06:53.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.402+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.406+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.406+0000 7feb5b7589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.410+0000 7fea0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:53.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.414+0000 7feb5b7589c0 20 remove_watcher() i=0 2024-08-27T03:06:53.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.414+0000 7feb5b7589c0 2 removed watcher, disabling cache 2024-08-27T03:06:53.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.418+0000 7feb5b7589c0 20 remove_watcher() i=1 2024-08-27T03:06:53.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.418+0000 7feb5b7589c0 20 remove_watcher() i=2 2024-08-27T03:06:53.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.422+0000 7feb5b7589c0 20 remove_watcher() i=3 2024-08-27T03:06:53.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.426+0000 7feb5b7589c0 20 remove_watcher() i=4 2024-08-27T03:06:53.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.426+0000 7feb5b7589c0 20 remove_watcher() i=5 2024-08-27T03:06:53.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.426+0000 7feb5b7589c0 20 remove_watcher() i=6 2024-08-27T03:06:53.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.430+0000 7feb5b7589c0 20 remove_watcher() i=7 2024-08-27T03:06:53.448 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:06:53.527 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:06:53.527 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:06:53.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 realm 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.574+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.578+0000 7f40e053d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:53.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.578+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.578+0000 7f40e053d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:06:53.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.578+0000 7f40e053d9c0 20 searching for the correct realm 2024-08-27T03:06:53.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.582+0000 7f40de844640 0 -- 172.21.15.143:0/3190191141 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x556a75b4aed0 msgr2=0x556a75b4d360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:06:53.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.590+0000 7f40de043640 0 -- 172.21.15.143:0/3190191141 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f40d4058050 msgr2=0x7f40d4045e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 zone default found 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 4 Realm: () 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 zonegroup default 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.598+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.602+0000 7f40e053d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.602+0000 7f40e053d9c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.602+0000 7f40e053d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.602+0000 7f40e053d9c0 20 started sync module instance, tier type = 2024-08-27T03:06:53.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.602+0000 7f40e053d9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:06:53.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=0 2024-08-27T03:06:53.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=1 2024-08-27T03:06:53.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=2 2024-08-27T03:06:53.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=3 2024-08-27T03:06:53.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=4 2024-08-27T03:06:53.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=5 2024-08-27T03:06:53.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=6 2024-08-27T03:06:53.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 20 add_watcher() i=7 2024-08-27T03:06:53.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.618+0000 7f40e053d9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:06:53.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.622+0000 7f3f94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:53.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.622+0000 7f40e053d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:06:53.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.622+0000 7f40e053d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:06:53.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.698+0000 7f3f0f7fe640 20 reqs_thread_entry: start 2024-08-27T03:06:53.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.698+0000 7f40e053d9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:06:53.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.698+0000 7f40e053d9c0 20 Filter name: none 2024-08-27T03:06:53.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.698+0000 7f3f0d7fa640 20 reqs_thread_entry: start 2024-08-27T03:06:53.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.698+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:06:53.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.702+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.702+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.706+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.706+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:06:53.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.710+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.710+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.710+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.714+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:06:53.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.714+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.718+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.718+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.722+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:06:53.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.722+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.722+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.722+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.726+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:06:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.726+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.730+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.730+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.730+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:06:53.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.734+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.738+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.738+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.742+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:06:53.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.746+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.750+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.750+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.754+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:06:53.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.754+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.758+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.758+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.762+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:06:53.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.762+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.766+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.766+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.770+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:06:53.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.774+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.774+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.774+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.778+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:06:53.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.782+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.782+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.786+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.786+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:06:53.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.794+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.794+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.794+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.798+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:06:53.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.802+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.802+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.806+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.806+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:06:53.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.810+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.814+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.814+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.814+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:06:53.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.818+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.822+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.822+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.822+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:06:53.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.826+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.826+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.830+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.830+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:06:53.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.834+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.834+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.838+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.838+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:06:53.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.842+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.846+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.846+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.850+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:06:53.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.854+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.854+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.854+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.858+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:06:53.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.862+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.866+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.866+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.870+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:06:53.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.870+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.874+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.874+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.878+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:06:53.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.882+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.882+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.882+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.886+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:06:53.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.890+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.890+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.890+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.894+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:06:53.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.898+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.898+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.898+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.902+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:06:53.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.906+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.910+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.910+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.910+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:06:53.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.914+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.918+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.918+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.922+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:06:53.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.926+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.926+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.926+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.930+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:06:53.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.934+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.934+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.934+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.938+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:06:53.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.942+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.946+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.946+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.946+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:06:53.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.950+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.954+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.954+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.958+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:06:53.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.962+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.962+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.962+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.966+0000 7f40e053d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:06:53.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.974+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.974+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:53.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.974+0000 7f40e053d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:53.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.978+0000 7f3f94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:53.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.986+0000 7f40e053d9c0 20 remove_watcher() i=0 2024-08-27T03:06:53.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.986+0000 7f40e053d9c0 2 removed watcher, disabling cache 2024-08-27T03:06:53.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.990+0000 7f40e053d9c0 20 remove_watcher() i=1 2024-08-27T03:06:53.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.990+0000 7f40e053d9c0 20 remove_watcher() i=2 2024-08-27T03:06:53.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.994+0000 7f40e053d9c0 20 remove_watcher() i=3 2024-08-27T03:06:53.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.998+0000 7f40e053d9c0 20 remove_watcher() i=4 2024-08-27T03:06:53.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:53.998+0000 7f40e053d9c0 20 remove_watcher() i=5 2024-08-27T03:06:54.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.002+0000 7f40e053d9c0 20 remove_watcher() i=6 2024-08-27T03:06:54.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.002+0000 7f40e053d9c0 20 remove_watcher() i=7 2024-08-27T03:06:54.027 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:06:54.100 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:06:54.100 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:06:54.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.146+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 realm 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:54.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:54.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.150+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.154+0000 7f1b1d7989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:06:54.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.154+0000 7f1b1d7989c0 20 searching for the correct realm 2024-08-27T03:06:54.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.158+0000 7f1b1aa9d640 0 -- 172.21.15.143:0/3412205582 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f1b0c0ea060 msgr2=0x7f1b0c11c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:06:54.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.166+0000 7f1b1aa9d640 0 -- 172.21.15.143:0/3412205582 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f19e40810c0 msgr2=0x7f19e40834f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.170+0000 7f1b1d7989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.170+0000 7f1b1d7989c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.170+0000 7f1b1d7989c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.170+0000 7f1b1d7989c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.170+0000 7f1b1d7989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.170+0000 7f1b1d7989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.170+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:06:54.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 zone default found 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 4 Realm: () 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 zonegroup default 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:54.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados->read ofs=0 len=0 2024-08-27T03:06:54.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:06:54.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 started sync module instance, tier type = 2024-08-27T03:06:54.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.174+0000 7f1b1d7989c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:06:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=0 2024-08-27T03:06:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=1 2024-08-27T03:06:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=2 2024-08-27T03:06:54.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=3 2024-08-27T03:06:54.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=4 2024-08-27T03:06:54.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=5 2024-08-27T03:06:54.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=6 2024-08-27T03:06:54.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 20 add_watcher() i=7 2024-08-27T03:06:54.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.190+0000 7f1b1d7989c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:06:54.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.194+0000 7f19d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:54.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.194+0000 7f1b1d7989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:06:54.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.194+0000 7f1b1d7989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:06:54.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.274+0000 7f19d0fe1640 20 reqs_thread_entry: start 2024-08-27T03:06:54.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.274+0000 7f1b1d7989c0 20 init_complete bucket index max shards: 11 2024-08-27T03:06:54.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.274+0000 7f1b1d7989c0 20 Filter name: none 2024-08-27T03:06:54.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.274+0000 7f194a7fc640 20 reqs_thread_entry: start 2024-08-27T03:06:54.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.274+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:06:54.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.278+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.278+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.278+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.278+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:06:54.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.282+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.286+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.286+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.290+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:06:54.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.294+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.294+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.294+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.294+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:06:54.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.302+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.302+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.302+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.306+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:06:54.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.310+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.310+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.310+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.310+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:06:54.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.314+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.318+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.318+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.322+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:06:54.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.326+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.326+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.326+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.330+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:06:54.332 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.334+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.334+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.334+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.338+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:06:54.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.342+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.342+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.342+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.342+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:06:54.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.346+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.350+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.350+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.354+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:06:54.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.358+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.358+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.358+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.358+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:06:54.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.362+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.362+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.362+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.366+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:06:54.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.370+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.370+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.370+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.374+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:06:54.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.378+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.382+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.382+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.386+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:06:54.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.386+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.390+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.390+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.390+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:06:54.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.394+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.398+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.398+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.402+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:06:54.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.406+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.406+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.406+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.410+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:06:54.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.410+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.414+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.414+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.414+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:06:54.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.418+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.422+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.422+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.426+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:06:54.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.426+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.426+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.430+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.430+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:06:54.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.434+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.434+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.438+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.438+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:06:54.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.442+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.442+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.442+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.446+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:06:54.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.446+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.450+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.450+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.450+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:06:54.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.454+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.454+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.458+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.458+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:06:54.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.462+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.462+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.466+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.466+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:06:54.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.470+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.470+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.470+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.474+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:06:54.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.478+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.478+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.478+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.482+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:06:54.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.486+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.486+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.486+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.490+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:06:54.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.490+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.490+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.490+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.494+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:06:54.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.498+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.498+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.498+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.502+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:06:54.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.506+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.506+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.506+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.506+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:06:54.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.510+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.510+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:06:54.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.510+0000 7f1b1d7989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:06:54.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.514+0000 7f19d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:06:54.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.522+0000 7f1b1d7989c0 20 remove_watcher() i=0 2024-08-27T03:06:54.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.522+0000 7f1b1d7989c0 2 removed watcher, disabling cache 2024-08-27T03:06:54.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.522+0000 7f1b1d7989c0 20 remove_watcher() i=1 2024-08-27T03:06:54.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.526+0000 7f1b1d7989c0 20 remove_watcher() i=2 2024-08-27T03:06:54.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.526+0000 7f1b1d7989c0 20 remove_watcher() i=3 2024-08-27T03:06:54.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.530+0000 7f1b1d7989c0 20 remove_watcher() i=4 2024-08-27T03:06:54.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.530+0000 7f1b1d7989c0 20 remove_watcher() i=5 2024-08-27T03:06:54.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.534+0000 7f1b1d7989c0 20 remove_watcher() i=6 2024-08-27T03:06:54.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:06:54.534+0000 7f1b1d7989c0 20 remove_watcher() i=7 2024-08-27T03:06:54.554 DEBUG:teuthology.orchestra.run.smithi143:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-08-27T03:06:55.263 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :clean 2024-08-27T03:06:56.160 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :compileJava 2024-08-27T03:06:56.161 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :processResources 2024-08-27T03:06:56.161 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :classes 2024-08-27T03:06:56.660 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:56.660 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :compileTestJava 2024-08-27T03:06:56.661 INFO:teuthology.orchestra.run.smithi143.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-08-27T03:06:56.661 INFO:teuthology.orchestra.run.smithi143.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-08-27T03:06:56.662 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:56.662 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :processTestResources NO-SOURCE 2024-08-27T03:06:56.662 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :testClasses 2024-08-27T03:06:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:58.661 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :test 2024-08-27T03:06:58.661 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:58.661 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests STANDARD_OUT 2024-08-27T03:06:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27 03:06:58,065 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-08-27T03:06:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:58.662 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-08-27T03:06:58.662 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:58.662 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-08-27T03:06:58.960 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:58.960 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-08-27T03:06:59.060 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:59.060 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-08-27T03:06:59.760 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:59.760 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-08-27T03:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:06:59.960 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-08-27T03:07:00.660 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:00.660 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-08-27T03:07:01.160 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:01.160 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-08-27T03:07:01.360 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:01.360 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-08-27T03:07:01.660 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:01.660 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-08-27T03:07:02.460 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:02.460 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-08-27T03:07:02.560 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:02.560 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-08-27T03:07:02.760 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:02.761 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-08-27T03:07:03.160 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:03.161 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-08-27T03:07:04.460 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:04.460 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-08-27T03:07:04.660 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:04.660 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-08-27T03:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:05.360 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-08-27T03:07:05.460 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:05.460 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------- 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------- 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:BUILD SUCCESSFUL in 10s 2024-08-27T03:07:05.661 INFO:teuthology.orchestra.run.smithi143.stdout:5 actionable tasks: 5 executed 2024-08-27T03:07:05.684 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:07:05.709 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:07:05.709 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:07:05.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:05.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 realm 2024-08-27T03:07:05.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:05.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:07:05.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:05.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.754+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.758+0000 7ff3714e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.758+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.758+0000 7ff3714e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:07:05.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.758+0000 7ff3714e99c0 20 searching for the correct realm 2024-08-27T03:07:05.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.766+0000 7ff36f7f0640 0 -- 172.21.15.143:0/1979384100 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55bfa84c3d10 msgr2=0x55bfa84c61b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:07:05.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.770+0000 7ff36e7ee640 0 -- 172.21.15.143:0/1979384100 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff3680c4040 msgr2=0x7ff3680df420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:05.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:05.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 zone default found 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 4 Realm: () 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 zonegroup default 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:05.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:05.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:05.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:05.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 started sync module instance, tier type = 2024-08-27T03:07:05.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.778+0000 7ff3714e99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:07:05.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.794+0000 7ff3714e99c0 20 add_watcher() i=0 2024-08-27T03:07:05.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.794+0000 7ff3714e99c0 20 add_watcher() i=1 2024-08-27T03:07:05.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.794+0000 7ff3714e99c0 20 add_watcher() i=2 2024-08-27T03:07:05.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.794+0000 7ff3714e99c0 20 add_watcher() i=3 2024-08-27T03:07:05.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.794+0000 7ff3714e99c0 20 add_watcher() i=4 2024-08-27T03:07:05.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.794+0000 7ff3714e99c0 20 add_watcher() i=5 2024-08-27T03:07:05.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.794+0000 7ff3714e99c0 20 add_watcher() i=6 2024-08-27T03:07:05.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.798+0000 7ff3714e99c0 20 add_watcher() i=7 2024-08-27T03:07:05.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.798+0000 7ff3714e99c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:07:05.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.798+0000 7ff2257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:05.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.798+0000 7ff3714e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:07:05.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.798+0000 7ff3714e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:07:05.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.874+0000 7ff19ffff640 20 reqs_thread_entry: start 2024-08-27T03:07:05.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.874+0000 7ff3714e99c0 20 init_complete bucket index max shards: 11 2024-08-27T03:07:05.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.874+0000 7ff3714e99c0 20 Filter name: none 2024-08-27T03:07:05.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.874+0000 7ff19dffb640 20 reqs_thread_entry: start 2024-08-27T03:07:05.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.874+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:07:05.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.878+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.878+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.882+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:07:05.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.882+0000 7ff3714e99c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1932372698996189659', time=2024-08-27T05:07:03.867064+0000, chain.objs.size()=1 2024-08-27T03:07:05.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.882+0000 7ff3714e99c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.66__shadow_.laQBImt4V1MtpzGCwSJLVrgXFczjZNN_0 2024-08-27T03:07:05.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.882+0000 7ff3714e99c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:07:05.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.890+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:07:05.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.894+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.894+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.894+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.898+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:07:05.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.902+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.902+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.902+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.906+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:07:05.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.910+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.910+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.910+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.914+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:07:05.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.918+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.918+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.918+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.922+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:07:05.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.926+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.926+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.926+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.930+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:07:05.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.934+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.934+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.938+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.938+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:07:05.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.942+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.942+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.942+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.946+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:07:05.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.950+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.950+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.954+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.954+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:07:05.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.958+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.958+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.958+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.962+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:07:05.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.966+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.966+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.966+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.970+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:07:05.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.974+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.974+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.974+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.978+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:07:05.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.982+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.982+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.982+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.986+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:07:05.990 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.990+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.990+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:05.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.994+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.994+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:07:05.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.998+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:05.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:05.998+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.002+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:07:06.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.002+0000 7ff3714e99c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16558043560261141017', time=2024-08-27T05:07:01.898600+0000, chain.objs.size()=1 2024-08-27T03:07:06.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.002+0000 7ff3714e99c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.65__shadow_.R2GD90h2oZYEtv0oqe4IRVFt9xmdqDm_0 2024-08-27T03:07:06.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.006+0000 7ff3714e99c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:07:06.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.010+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:07:06.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.014+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.018+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.018+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.022+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:07:06.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.022+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.026+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.026+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.026+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:07:06.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.030+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.034+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.034+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.038+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:07:06.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.038+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.042+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.042+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.042+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:07:06.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.046+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.050+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.050+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.050+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:07:06.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.054+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.054+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.058+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.058+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:07:06.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.062+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.066+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.066+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.067 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.066+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:07:06.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.070+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.074+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.074+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.078+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:07:06.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.082+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.082+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.082+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.086+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:07:06.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.086+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.090+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.090+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.094+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:07:06.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.098+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.098+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.098+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.102+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:07:06.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.106+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.106+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.106+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.110+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:07:06.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.114+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.114+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.118+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.118+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:07:06.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.122+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.126+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.126+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.126+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:07:06.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.130+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.134+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.134+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.138+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:07:06.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.142+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.142+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.142+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.146+0000 7ff3714e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:07:06.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.150+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.150+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.154+0000 7ff3714e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.158+0000 7ff2257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:06.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.162+0000 7ff3714e99c0 20 remove_watcher() i=0 2024-08-27T03:07:06.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.162+0000 7ff3714e99c0 2 removed watcher, disabling cache 2024-08-27T03:07:06.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.166+0000 7ff3714e99c0 20 remove_watcher() i=1 2024-08-27T03:07:06.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.166+0000 7ff3714e99c0 20 remove_watcher() i=2 2024-08-27T03:07:06.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.170+0000 7ff3714e99c0 20 remove_watcher() i=3 2024-08-27T03:07:06.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.174+0000 7ff3714e99c0 20 remove_watcher() i=4 2024-08-27T03:07:06.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.174+0000 7ff3714e99c0 20 remove_watcher() i=5 2024-08-27T03:07:06.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.178+0000 7ff3714e99c0 20 remove_watcher() i=6 2024-08-27T03:07:06.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.178+0000 7ff3714e99c0 20 remove_watcher() i=7 2024-08-27T03:07:06.202 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:07:06.274 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:07:06.275 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:07:06.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.322+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 realm 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:06.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:07:06.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.326+0000 7fae19de69c0 20 searching for the correct realm 2024-08-27T03:07:06.332 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.334+0000 7fae170eb640 0 -- 172.21.15.143:0/2289091468 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fae0810b030 msgr2=0x7fae08118a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:07:06.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.342+0000 7fae170eb640 0 -- 172.21.15.143:0/2289091468 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7face0081140 msgr2=0x7face0083570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.346+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:06.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 zone default found 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 4 Realm: () 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 zonegroup default 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 started sync module instance, tier type = 2024-08-27T03:07:06.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.350+0000 7fae19de69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:07:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=0 2024-08-27T03:07:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=1 2024-08-27T03:07:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=2 2024-08-27T03:07:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=3 2024-08-27T03:07:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=4 2024-08-27T03:07:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=5 2024-08-27T03:07:06.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=6 2024-08-27T03:07:06.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 20 add_watcher() i=7 2024-08-27T03:07:06.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.366+0000 7fae19de69c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:07:06.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.370+0000 7faccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.370+0000 7fae19de69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:07:06.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.370+0000 7fae19de69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:07:06.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.442+0000 7facccfe1640 20 reqs_thread_entry: start 2024-08-27T03:07:06.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.442+0000 7fae19de69c0 20 init_complete bucket index max shards: 11 2024-08-27T03:07:06.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.442+0000 7fae19de69c0 20 Filter name: none 2024-08-27T03:07:06.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.442+0000 7fac467fc640 20 reqs_thread_entry: start 2024-08-27T03:07:06.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.442+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:07:06.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.446+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.446+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.446+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.450+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:07:06.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.450+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.454+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.454+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.454+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:07:06.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.458+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.462+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.462+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.462+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:07:06.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.466+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.470+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.470+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.474+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:07:06.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.474+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.474+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.474+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.478+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:07:06.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.478+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.482+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.482+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.482+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:07:06.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.486+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.490+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.490+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.494+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:07:06.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.494+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.494+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.494+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.498+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:07:06.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.498+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.502+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.502+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.502+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:07:06.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.506+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.506+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.506+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.510+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:07:06.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.514+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.514+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.514+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.518+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:07:06.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.522+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.522+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.522+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.522+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:07:06.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.526+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.530+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.530+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.530+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:07:06.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.534+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.534+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.534+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.538+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:07:06.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.542+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.542+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.542+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.546+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:07:06.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.550+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.550+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.554+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.554+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:07:06.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.558+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.558+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.562+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.563 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.562+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:07:06.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.566+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.566+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.566+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.570+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:07:06.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.574+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.574+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.574+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.578+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:07:06.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.578+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.578+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.582+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.582+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:07:06.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.586+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.586+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.586+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.590+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:07:06.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.594+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.594+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.598+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.598+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:07:06.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.602+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.606+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.606+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.610+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:07:06.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.610+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.610+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.614+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.614+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:07:06.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.618+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.618+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.622+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.622+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:07:06.626 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.626+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.626+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.630+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.630+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:07:06.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.634+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.638+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.638+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.638+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:07:06.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.642+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.646+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.646+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.650+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:07:06.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.650+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.654+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.654+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.654+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:07:06.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.658+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.658+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.662+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.662+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:07:06.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.666+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.666+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.666+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.670+0000 7fae19de69c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:07:06.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.674+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.674+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.674+0000 7fae19de69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.678+0000 7faccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:06.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.682+0000 7fae19de69c0 20 remove_watcher() i=0 2024-08-27T03:07:06.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.682+0000 7fae19de69c0 2 removed watcher, disabling cache 2024-08-27T03:07:06.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.686+0000 7fae19de69c0 20 remove_watcher() i=1 2024-08-27T03:07:06.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.686+0000 7fae19de69c0 20 remove_watcher() i=2 2024-08-27T03:07:06.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.690+0000 7fae19de69c0 20 remove_watcher() i=3 2024-08-27T03:07:06.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.690+0000 7fae19de69c0 20 remove_watcher() i=4 2024-08-27T03:07:06.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.694+0000 7fae19de69c0 20 remove_watcher() i=5 2024-08-27T03:07:06.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.694+0000 7fae19de69c0 20 remove_watcher() i=6 2024-08-27T03:07:06.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.694+0000 7fae19de69c0 20 remove_watcher() i=7 2024-08-27T03:07:06.714 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:07:06.786 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:07:06.786 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:07:06.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 realm 2024-08-27T03:07:06.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:07:06.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.834+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.838+0000 7fa50df159c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:06.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.838+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.838+0000 7fa50df159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:07:06.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.838+0000 7fa50df159c0 20 searching for the correct realm 2024-08-27T03:07:06.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.842+0000 7fa50b21a640 0 -- 172.21.15.143:0/2008775905 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x559000437950 msgr2=0x559000439e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:07:06.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.850+0000 7fa50b21a640 0 -- 172.21.15.143:0/2008775905 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fa4fc03a070 msgr2=0x7fa4fc03b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:06.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:07:06.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 zone default found 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 4 Realm: () 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 zonegroup default 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:06.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:06.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 started sync module instance, tier type = 2024-08-27T03:07:06.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.858+0000 7fa50df159c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:07:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=0 2024-08-27T03:07:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=1 2024-08-27T03:07:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=2 2024-08-27T03:07:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=3 2024-08-27T03:07:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=4 2024-08-27T03:07:06.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=5 2024-08-27T03:07:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=6 2024-08-27T03:07:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 20 add_watcher() i=7 2024-08-27T03:07:06.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.874+0000 7fa50df159c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:07:06.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.878+0000 7fa3c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:06.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.878+0000 7fa50df159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:07:06.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.878+0000 7fa50df159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:07:06.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.954+0000 7fa3c0fe1640 20 reqs_thread_entry: start 2024-08-27T03:07:06.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.954+0000 7fa50df159c0 20 init_complete bucket index max shards: 11 2024-08-27T03:07:06.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.954+0000 7fa50df159c0 20 Filter name: none 2024-08-27T03:07:06.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.954+0000 7fa33a7fc640 20 reqs_thread_entry: start 2024-08-27T03:07:06.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.954+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:07:06.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.958+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.958+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.958+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.962+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:07:06.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.962+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.966+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.966+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.970+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:07:06.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.970+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.974+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.974+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.974+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:07:06.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.978+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.978+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.978+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.982+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:07:06.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.986+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.986+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.986+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.990+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:07:06.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.994+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:06.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.998+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:06.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:06.998+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.002+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:07:07.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.002+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.006+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.006+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.006+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:07:07.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.010+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.014+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.014+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.018+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:07:07.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.022+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.022+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.022+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.026+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:07:07.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.026+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.030+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.030+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.034+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:07:07.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.034+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.038+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.038+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.042+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:07:07.044 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.046+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.046+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.046+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.050+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:07:07.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.054+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.054+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.054+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.058+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:07:07.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.062+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.062+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.062+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.065 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.066+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:07:07.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.070+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.070+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.070+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.074+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:07:07.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.078+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.078+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.078+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.082+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:07:07.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.086+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.086+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.086 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.086+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.090+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:07:07.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.090+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.094+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.094+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.094+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:07:07.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.098+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.098+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.098+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.102+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:07:07.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.106+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.106+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.106+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.110+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:07:07.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.110+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.114+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.114+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.114+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:07:07.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.118+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.118+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.118+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.122+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:07:07.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.126+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.126+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.130+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.130+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:07:07.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.134+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.134+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.138+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.138+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:07:07.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.142+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.142+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.142+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.146+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:07:07.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.150+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.150+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.150+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.154+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:07:07.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.154+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.154+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.158+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.158+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:07:07.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.162+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.162+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.162+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.166+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:07:07.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.166+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.166+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.170+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.170+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:07:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.174+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.174+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.174+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.174+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:07:07.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.178+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.182+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.182+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.182+0000 7fa50df159c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:07:07.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.186+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.190+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.190+0000 7fa50df159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.194+0000 7fa3c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:07.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.198+0000 7fa50df159c0 20 remove_watcher() i=0 2024-08-27T03:07:07.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.198+0000 7fa50df159c0 2 removed watcher, disabling cache 2024-08-27T03:07:07.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.202+0000 7fa50df159c0 20 remove_watcher() i=1 2024-08-27T03:07:07.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.206+0000 7fa50df159c0 20 remove_watcher() i=2 2024-08-27T03:07:07.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.206+0000 7fa50df159c0 20 remove_watcher() i=3 2024-08-27T03:07:07.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.210+0000 7fa50df159c0 20 remove_watcher() i=4 2024-08-27T03:07:07.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.210+0000 7fa50df159c0 20 remove_watcher() i=5 2024-08-27T03:07:07.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.214+0000 7fa50df159c0 20 remove_watcher() i=6 2024-08-27T03:07:07.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.214+0000 7fa50df159c0 20 remove_watcher() i=7 2024-08-27T03:07:07.238 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:07:07.311 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:07:07.311 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:07:07.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:07.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 realm 2024-08-27T03:07:07.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:07.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:07:07.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:07.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.358+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.362+0000 7f4caef819c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.362+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.362+0000 7f4caef819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:07:07.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.362+0000 7f4caef819c0 20 searching for the correct realm 2024-08-27T03:07:07.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.366+0000 7f4ca7fff640 0 -- 172.21.15.143:0/2442223260 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x55994f2a1bd0 msgr2=0x55994f2a4090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:07:07.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.374+0000 7f4caca87640 0 -- 172.21.15.143:0/2442223260 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f4c9804f040 msgr2=0x7f4c9808b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:07:07.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:07:07.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:07:07.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:07:07.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:07:07.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:07:07.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:07:07.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:07.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:07:07.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:07:07.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 zone default found 2024-08-27T03:07:07.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 4 Realm: () 2024-08-27T03:07:07.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:07:07.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:07:07.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:07:07.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 zonegroup default 2024-08-27T03:07:07.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:07.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:07.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados->read ofs=0 len=0 2024-08-27T03:07:07.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:07:07.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 started sync module instance, tier type = 2024-08-27T03:07:07.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.382+0000 7f4caef819c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:07:07.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.398+0000 7f4caef819c0 20 add_watcher() i=0 2024-08-27T03:07:07.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.398+0000 7f4caef819c0 20 add_watcher() i=1 2024-08-27T03:07:07.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.398+0000 7f4caef819c0 20 add_watcher() i=2 2024-08-27T03:07:07.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.398+0000 7f4caef819c0 20 add_watcher() i=3 2024-08-27T03:07:07.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.398+0000 7f4caef819c0 20 add_watcher() i=4 2024-08-27T03:07:07.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.398+0000 7f4caef819c0 20 add_watcher() i=5 2024-08-27T03:07:07.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.398+0000 7f4caef819c0 20 add_watcher() i=6 2024-08-27T03:07:07.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.402+0000 7f4caef819c0 20 add_watcher() i=7 2024-08-27T03:07:07.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.402+0000 7f4caef819c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:07:07.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.402+0000 7f4b62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:07.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.402+0000 7f4caef819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:07:07.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.402+0000 7f4caef819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:07:07.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.482+0000 7f4b61fe3640 20 reqs_thread_entry: start 2024-08-27T03:07:07.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.482+0000 7f4caef819c0 20 init_complete bucket index max shards: 11 2024-08-27T03:07:07.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.482+0000 7f4caef819c0 20 Filter name: none 2024-08-27T03:07:07.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.482+0000 7f4ad37fe640 20 reqs_thread_entry: start 2024-08-27T03:07:07.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.482+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:07:07.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.482+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.482+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.486+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.486+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:07:07.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.490+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.490+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.490+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.494+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:07:07.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.494+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.498+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.498+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.498+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:07:07.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.502+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.502+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.502+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.502+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:07:07.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.506+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.506+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.506+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.510+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:07:07.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.514+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.514+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.518+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.518+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:07:07.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.522+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.522+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.522+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.526+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:07:07.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.530+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.530+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.530+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.534+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:07:07.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.538+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.538+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.538+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.538+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:07:07.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.542+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.542+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.546+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.546+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:07:07.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.550+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.550+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.554+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.554+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:07:07.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.558+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.562+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.562+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.566+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:07:07.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.570+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.570+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.570+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.574+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:07:07.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.578+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.578+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.578+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.582+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:07:07.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.586+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.586+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.590+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.590+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:07:07.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.594+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.598+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.598+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.598+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:07:07.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.602+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.606+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.606+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.610+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:07:07.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.614+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.614+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.614+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.618+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:07:07.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.622+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.622+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.622+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.626+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:07:07.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.630+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.630+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.634+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.638+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:07:07.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.642+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.642+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.642+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.646+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:07:07.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.650+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.654+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.654+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.658+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:07:07.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.662+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.662+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.662+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.665 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.666+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:07:07.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.670+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.670+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.674+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.674+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:07:07.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.678+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.682+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.682+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.682+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:07:07.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.686+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.690+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.690+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.690+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:07:07.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.694+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.694+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.698+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.698+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:07:07.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.702+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.702+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.706+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.706+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:07:07.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.710+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.714+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.714+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.714+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:07:07.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.718+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.722+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.722+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.726+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:07:07.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.730+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.730+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.730+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.734+0000 7f4caef819c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:07:07.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.738+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.738+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:07:07.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.738+0000 7f4caef819c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:07:07.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.742+0000 7f4b62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:07:07.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.750+0000 7f4caef819c0 20 remove_watcher() i=0 2024-08-27T03:07:07.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.750+0000 7f4caef819c0 2 removed watcher, disabling cache 2024-08-27T03:07:07.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.750+0000 7f4caef819c0 20 remove_watcher() i=1 2024-08-27T03:07:07.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.754+0000 7f4caef819c0 20 remove_watcher() i=2 2024-08-27T03:07:07.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.754+0000 7f4caef819c0 20 remove_watcher() i=3 2024-08-27T03:07:07.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.758+0000 7f4caef819c0 20 remove_watcher() i=4 2024-08-27T03:07:07.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.762+0000 7f4caef819c0 20 remove_watcher() i=5 2024-08-27T03:07:07.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.762+0000 7f4caef819c0 20 remove_watcher() i=6 2024-08-27T03:07:07.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:07:07.762+0000 7f4caef819c0 20 remove_watcher() i=7 2024-08-27T03:07:07.780 DEBUG:teuthology.orchestra.run.smithi143:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-08-27T03:07:08.475 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :clean 2024-08-27T03:07:09.372 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :compileJava 2024-08-27T03:07:09.372 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :processResources 2024-08-27T03:07:09.372 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :classes 2024-08-27T03:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:09.773 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :compileTestJava 2024-08-27T03:07:09.773 INFO:teuthology.orchestra.run.smithi143.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-08-27T03:07:09.774 INFO:teuthology.orchestra.run.smithi143.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-08-27T03:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :processTestResources NO-SOURCE 2024-08-27T03:07:09.774 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :testClasses 2024-08-27T03:07:11.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:11.773 INFO:teuthology.orchestra.run.smithi143.stdout:> Task :test 2024-08-27T03:07:11.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:11.773 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests STANDARD_OUT 2024-08-27T03:07:11.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27 03:07:11,167 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-08-27T03:07:11.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-08-27T03:07:11.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:11.774 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-08-27T03:07:12.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:12.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-08-27T03:07:13.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:13.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-08-27T03:07:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:13.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-08-27T03:07:14.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:14.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-08-27T03:07:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:14.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-08-27T03:07:18.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:18.173 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-08-27T03:07:18.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-08-27T03:07:18.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:18.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-08-27T03:07:19.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:19.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-08-27T03:07:20.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:20.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-08-27T03:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:20.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-08-27T03:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:20.973 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-08-27T03:07:21.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:21.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-08-27T03:07:21.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:21.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-08-27T03:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:21.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-08-27T03:07:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:24.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-08-27T03:07:24.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:24.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-08-27T03:07:25.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:25.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-08-27T03:07:25.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:25.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-08-27T03:07:26.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:26.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-08-27T03:07:26.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:26.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-08-27T03:07:27.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:27.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-08-27T03:07:27.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:27.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-08-27T03:07:27.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:27.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-08-27T03:07:28.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:28.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-08-27T03:07:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:28.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-08-27T03:07:29.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:29.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-08-27T03:07:29.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:29.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-08-27T03:07:30.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:30.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-08-27T03:07:30.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:30.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-08-27T03:07:31.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:31.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-08-27T03:07:35.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:35.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-08-27T03:07:36.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:07:36.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-08-27T03:08:10.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:10.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-08-27T03:08:11.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:11.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-08-27T03:08:11.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:11.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-08-27T03:08:12.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:12.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-08-27T03:08:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:12.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-08-27T03:08:13.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:13.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-08-27T03:08:17.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:17.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-08-27T03:08:17.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:17.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-08-27T03:08:17.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:17.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-08-27T03:08:18.071 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:18.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-08-27T03:08:23.171 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:23.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-08-27T03:08:24.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:24.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests STANDARD_OUT 2024-08-27T03:08:24.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27 03:08:24,260 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-27T03:08:24.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27 03:08:24,260 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-08-27T03:08:24.871 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:24.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-08-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-08-27T03:08:45.471 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:45.471 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-08-27T03:08:48.671 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:48.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-08-27T03:08:49.471 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:08:49.471 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-08-27T03:09:17.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:17.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-08-27T03:09:18.071 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:18.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-08-27T03:09:23.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:23.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-08-27T03:09:24.271 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:24.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-08-27T03:09:27.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:27.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-08-27T03:09:28.271 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:28.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-08-27T03:09:30.671 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:30.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-08-27T03:09:43.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:43.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-08-27T03:09:44.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:44.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-08-27T03:09:44.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:44.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-08-27T03:09:44.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:44.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-08-27T03:09:45.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:45.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-08-27T03:09:45.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:45.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-08-27T03:09:46.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:46.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-08-27T03:09:46.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:46.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-08-27T03:09:46.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:46.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-08-27T03:09:47.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:47.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-08-27T03:09:47.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:47.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-08-27T03:09:47.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:47.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-08-27T03:09:48.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:48.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-08-27T03:09:48.971 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:48.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-08-27T03:09:49.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:49.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-08-27T03:09:50.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:50.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-08-27T03:09:51.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:51.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-08-27T03:09:51.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:51.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-08-27T03:09:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:52.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-08-27T03:09:53.373 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:53.374 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-08-27T03:09:54.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:54.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-08-27T03:09:54.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:54.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-08-27T03:09:55.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:55.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-08-27T03:09:56.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:56.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-08-27T03:09:57.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:57.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-08-27T03:09:57.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:57.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-08-27T03:09:58.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:58.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-08-27T03:09:59.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:09:59.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-08-27T03:10:00.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:00.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-08-27T03:10:00.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:00.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-08-27T03:10:01.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:01.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-08-27T03:10:02.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:02.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-08-27T03:10:03.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:03.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-08-27T03:10:03.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:03.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-08-27T03:10:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:04.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-08-27T03:10:05.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:05.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-08-27T03:10:06.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:06.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-08-27T03:10:06.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:06.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-08-27T03:10:07.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:07.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-08-27T03:10:08.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:08.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-08-27T03:10:09.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:09.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-08-27T03:10:09.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:09.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-08-27T03:10:10.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:10.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-08-27T03:10:11.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:11.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-08-27T03:10:12.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:12.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-08-27T03:10:12.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:12.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-08-27T03:10:13.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:13.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-08-27T03:10:14.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:14.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-08-27T03:10:15.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:15.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-08-27T03:10:15.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:15.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-08-27T03:10:16.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:16.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-08-27T03:10:17.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:17.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-08-27T03:10:18.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:18.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-08-27T03:10:18.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-08-27T03:10:19.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:19.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-08-27T03:10:20.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:20.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-08-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-08-27T03:10:21.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:21.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-08-27T03:10:22.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:22.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-08-27T03:10:22.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:22.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-08-27T03:10:23.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:23.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-08-27T03:10:23.472 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:23.472 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-08-27T03:10:24.172 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:24.172 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-08-27T03:10:24.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:24.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-08-27T03:10:25.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:25.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-08-27T03:10:25.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:25.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-08-27T03:10:26.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:26.072 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-08-27T03:10:26.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:26.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-08-27T03:10:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:27.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-08-27T03:10:27.372 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:27.372 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-08-27T03:10:27.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:27.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-08-27T03:10:27.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:27.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-08-27T03:10:28.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:28.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-08-27T03:10:28.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:28.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-08-27T03:10:29.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:29.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-08-27T03:10:29.972 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:29.972 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-08-27T03:10:30.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:30.672 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-08-27T03:10:30.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:30.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-08-27T03:10:31.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:31.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-08-27T03:10:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:34.872 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-08-27T03:10:35.572 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:35.572 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-08-27T03:10:39.272 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:39.272 INFO:teuthology.orchestra.run.smithi143.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout:---------------------------------------------------------------------- 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout:---------------------------------------------------------------------- 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-08-27T03:10:40.104 INFO:teuthology.orchestra.run.smithi143.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-08-27T03:10:40.105 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:40.105 INFO:teuthology.orchestra.run.smithi143.stdout:BUILD SUCCESSFUL in 3m 32s 2024-08-27T03:10:40.105 INFO:teuthology.orchestra.run.smithi143.stdout:5 actionable tasks: 5 executed 2024-08-27T03:10:40.115 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:10:40.145 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:40.145 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:40.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 realm 2024-08-27T03:10:40.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:40.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.188+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.192+0000 7f79ea2389c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:40.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.192+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.192+0000 7f79ea2389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:40.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.192+0000 7f79ea2389c0 20 searching for the correct realm 2024-08-27T03:10:40.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.196+0000 7f79e753d640 0 -- 172.21.15.143:0/985497299 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f79d8017070 msgr2=0x7f79d807d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:40.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.204+0000 7f79e853f640 0 -- 172.21.15.143:0/985497299 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f79dc06a950 msgr2=0x7f79dc0239f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 zone default found 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 4 Realm: () 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 zonegroup default 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 started sync module instance, tier type = 2024-08-27T03:10:40.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.212+0000 7f79ea2389c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:40.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=0 2024-08-27T03:10:40.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=1 2024-08-27T03:10:40.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=2 2024-08-27T03:10:40.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=3 2024-08-27T03:10:40.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=4 2024-08-27T03:10:40.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=5 2024-08-27T03:10:40.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=6 2024-08-27T03:10:40.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 20 add_watcher() i=7 2024-08-27T03:10:40.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f79ea2389c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:40.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.232+0000 7f789dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:40.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.236+0000 7f79ea2389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:40.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.236+0000 7f79ea2389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:40.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.308+0000 7f789cfe1640 20 reqs_thread_entry: start 2024-08-27T03:10:40.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.308+0000 7f79ea2389c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:40.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.308+0000 7f79ea2389c0 20 Filter name: none 2024-08-27T03:10:40.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.308+0000 7f78167fc640 20 reqs_thread_entry: start 2024-08-27T03:10:40.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.308+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:10:40.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.379180880071245067', time=2024-08-27T05:07:20.321930+0000, chain.objs.size()=1 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.75__shadow_.dkeKgNJyrjHRAZWypFzdBv96rbDPX2E_0 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8250372644457973761', time=2024-08-27T05:08:17.290802+0000, chain.objs.size()=5 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.92__multipart_key1.2~hinMfA-3T_klkGMw41WBFeL56QyC1kO.1 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.92__multipart_key1.2~hinMfA-3T_klkGMw41WBFeL56QyC1kO.2 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.92__multipart_key1.2~hinMfA-3T_klkGMw41WBFeL56QyC1kO.3 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.92__multipart_key1.2~hinMfA-3T_klkGMw41WBFeL56QyC1kO.4 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.92__multipart_key1.2~hinMfA-3T_klkGMw41WBFeL56QyC1kO.5 2024-08-27T03:10:40.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12589106330141363705', time=2024-08-27T05:09:53.665281+0000, chain.objs.size()=1 2024-08-27T03:10:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.108__shadow_.gw2yGnkEDGRsPye_5Sm9FCzpseaBiBT_0 2024-08-27T03:10:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3077424169034313054', time=2024-08-27T05:10:07.185944+0000, chain.objs.size()=1 2024-08-27T03:10:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.117__shadow_.CYIETRm-rst2s2ZyDiq5dRrElvHkm9F_0 2024-08-27T03:10:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17020675640068434225', time=2024-08-27T05:10:11.520460+0000, chain.objs.size()=1 2024-08-27T03:10:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.120__shadow_.7MfKAJ7-um41cGS__e8lhfUnjbLCJOk_0 2024-08-27T03:10:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7275427756238047876', time=2024-08-27T05:10:18.982612+0000, chain.objs.size()=1 2024-08-27T03:10:40.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.312+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.125__shadow_.AIQ8jiQXJYg6AnIdAZTtS4N-d-rc9ar_0 2024-08-27T03:10:40.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.328+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.331 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.328+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:10:40.332 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:10:40.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8976454474879275205', time=2024-08-27T05:09:58.316154+0000, chain.objs.size()=1 2024-08-27T03:10:40.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.111__shadow_.Nnf1qmsnu719odiHD1Qw-KOeBzVNEBp_0 2024-08-27T03:10:40.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14535307727307976338', time=2024-08-27T05:10:39.424651+0000, chain.objs.size()=5 2024-08-27T03:10:40.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.138__multipart_key1/data/file.mpg.2~Eto74SfCdLm1uo_Oh7u06IS2e9cDd-d.1 2024-08-27T03:10:40.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.138__multipart_key1/data/file.mpg.2~Eto74SfCdLm1uo_Oh7u06IS2e9cDd-d.2 2024-08-27T03:10:40.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.138__multipart_key1/data/file.mpg.2~Eto74SfCdLm1uo_Oh7u06IS2e9cDd-d.3 2024-08-27T03:10:40.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.138__multipart_key1/data/file.mpg.2~Eto74SfCdLm1uo_Oh7u06IS2e9cDd-d.4 2024-08-27T03:10:40.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.332+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.138__multipart_key1/data/file.mpg.2~Eto74SfCdLm1uo_Oh7u06IS2e9cDd-d.5 2024-08-27T03:10:40.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.344+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.344+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:10:40.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.348+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.352+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.352+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:10:40.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.352+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3698288942021868463', time=2024-08-27T05:09:22.026172+0000, chain.objs.size()=1 2024-08-27T03:10:40.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.352+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.97__shadow_.2zkYpkix0ayFOVFBsyUNxezIBvveufV_0 2024-08-27T03:10:40.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.352+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2996152248463102855', time=2024-08-27T05:10:29.079592+0000, chain.objs.size()=1 2024-08-27T03:10:40.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.352+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.134__shadow_.six5A4hyBcBSzMpi4TjYNhcMYtQvLp6_0 2024-08-27T03:10:40.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.356+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.360+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:10:40.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:10:40.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6540609992758442284', time=2024-08-27T05:07:24.342402+0000, chain.objs.size()=2 2024-08-27T03:10:40.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.77__shadow_.YmXvE_mCEG0sZPfHefbrEn4XFY7La_h_0 2024-08-27T03:10:40.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.77__shadow_.YmXvE_mCEG0sZPfHefbrEn4XFY7La_h_1 2024-08-27T03:10:40.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5099145683835980897', time=2024-08-27T05:10:21.803537+0000, chain.objs.size()=1 2024-08-27T03:10:40.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.364+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.127__shadow_._5uKnYRf8EAL9_XXltj2strcDu7MFhm_0 2024-08-27T03:10:40.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.368+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.372+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:10:40.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6175232663627315560', time=2024-08-27T05:09:23.699327+0000, chain.objs.size()=5 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.97__multipart_key1.2~v97ROuIGRnfapOS8idZIsoG8-t7ms4t.1 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.97__multipart_key1.2~v97ROuIGRnfapOS8idZIsoG8-t7ms4t.2 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.97__multipart_key1.2~v97ROuIGRnfapOS8idZIsoG8-t7ms4t.3 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.97__multipart_key1.2~v97ROuIGRnfapOS8idZIsoG8-t7ms4t.4 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.97__multipart_key1.2~v97ROuIGRnfapOS8idZIsoG8-t7ms4t.5 2024-08-27T03:10:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13927175145201959431', time=2024-08-27T05:10:11.590551+0000, chain.objs.size()=1 2024-08-27T03:10:40.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.120__shadow_.3kQ3AxWrcdXCmTQEVJdQTfw06rOCxW0_0 2024-08-27T03:10:40.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16445136237132234177', time=2024-08-27T05:10:26.519371+0000, chain.objs.size()=1 2024-08-27T03:10:40.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.376+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.132__shadow_.2-_Z_6hBFMqe-76c9oU-SHguKbFtqnn_0 2024-08-27T03:10:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.384+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:10:40.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-27T03:10:40.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4371054284768157547', time=2024-08-27T05:08:05.466380+0000, chain.objs.size()=5 2024-08-27T03:10:40.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~HeSasSyMNUep7l8zCSIiwRhMZLKfpwj.1 2024-08-27T03:10:40.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__shadow_key1.2~HeSasSyMNUep7l8zCSIiwRhMZLKfpwj.1_1 2024-08-27T03:10:40.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~HeSasSyMNUep7l8zCSIiwRhMZLKfpwj.2 2024-08-27T03:10:40.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__shadow_key1.2~HeSasSyMNUep7l8zCSIiwRhMZLKfpwj.2_1 2024-08-27T03:10:40.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~HeSasSyMNUep7l8zCSIiwRhMZLKfpwj.3 2024-08-27T03:10:40.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1526413536254608668', time=2024-08-27T05:10:01.176661+0000, chain.objs.size()=1 2024-08-27T03:10:40.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.113__shadow_.cGOCVGVXQkKahlRsnK3GWEYOAvfYTOF_0 2024-08-27T03:10:40.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13493425572088974126', time=2024-08-27T05:10:02.687027+0000, chain.objs.size()=1 2024-08-27T03:10:40.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.392+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.114__shadow_.VjqbOcPLxgeOCcY3N8WMbHj8gLfM0fD_0 2024-08-27T03:10:40.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.404+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.408+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:10:40.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.408+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1117238414274459003', time=2024-08-27T05:07:50.828831+0000, chain.objs.size()=5 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~Hy-PLNncucd4tJ6LK17tXtGULdA8HG5.1 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~Hy-PLNncucd4tJ6LK17tXtGULdA8HG5.2 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~Hy-PLNncucd4tJ6LK17tXtGULdA8HG5.3 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~Hy-PLNncucd4tJ6LK17tXtGULdA8HG5.4 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~Hy-PLNncucd4tJ6LK17tXtGULdA8HG5.5 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8274952715599478095', time=2024-08-27T05:09:55.249443+0000, chain.objs.size()=1 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.109__shadow_.gxmNQDVZhgxz5crH24zLzdisPtXuIQk_0 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7066224182752730625', time=2024-08-27T05:09:58.164798+0000, chain.objs.size()=1 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.111__shadow_.1vT7NirffijjhICvt2QSUAGwcjd8JAD_0 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12881335219662875143', time=2024-08-27T05:10:04.161577+0000, chain.objs.size()=1 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.115__shadow_.1M55_ilhEThWbYLZl2BwRjHp_InR6sN_0 2024-08-27T03:10:40.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17800031235790719241', time=2024-08-27T05:10:05.813511+0000, chain.objs.size()=1 2024-08-27T03:10:40.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.412+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.116__shadow_.VRVvNVe8KSR0CychNmZrwYJ_4YfrRH9_0 2024-08-27T03:10:40.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.420+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:10:40.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16059270166675392236', time=2024-08-27T05:09:51.967915+0000, chain.objs.size()=1 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.107__shadow_.ZoQFwkoD2a95N7EFQ0D7HGCIXrOaJZ6_0 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8891857154151376934', time=2024-08-27T05:09:56.768479+0000, chain.objs.size()=1 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.110__shadow_.7toVmVhRduoltbX2Z_zozVhxKBLefg8_0 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5430645190436253932', time=2024-08-27T05:10:04.379012+0000, chain.objs.size()=1 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.115__shadow_.BGUxdisnu7F4l92p60iIAvr4eKE84OO_0 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14651394646050298009', time=2024-08-27T05:10:08.504598+0000, chain.objs.size()=1 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.118__shadow_.91kVGKBRzYbfhiNcPnS1B5pLfXwvlif_0 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8425369606650564858', time=2024-08-27T05:10:10.051439+0000, chain.objs.size()=1 2024-08-27T03:10:40.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.119__shadow_.vDYbq0R24Tkl9ixJMovMbrzRqYiJaAC_0 2024-08-27T03:10:40.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15083718442072408099', time=2024-08-27T05:10:17.524314+0000, chain.objs.size()=1 2024-08-27T03:10:40.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.124__shadow_.-wFYx9IjafyY1_vFOVvEhDc3HhTj2L3_0 2024-08-27T03:10:40.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14965399993331726543', time=2024-08-27T05:10:18.910968+0000, chain.objs.size()=1 2024-08-27T03:10:40.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.428+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.125__shadow_.iHV0xGlNc43g5yhVWY9jbni7rsmXjMY_0 2024-08-27T03:10:40.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.436+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.440+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:10:40.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4528810363845330963', time=2024-08-27T05:07:35.452200+0000, chain.objs.size()=5 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.1 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.2 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.3 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.4 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.5 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7348585793027204425', time=2024-08-27T05:07:36.065256+0000, chain.objs.size()=5 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.1 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.2 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.3 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.4 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.85__multipart_key1.2~zw-EzbdViszfnEimUiLdpD6pj1mLUvi.5 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8361007274299854418', time=2024-08-27T05:09:11.003938+0000, chain.objs.size()=5 2024-08-27T03:10:40.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~jk7fk27v598wHZgRPvsQ34KQUL5qnZe.1 2024-08-27T03:10:40.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.444+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~jk7fk27v598wHZgRPvsQ34KQUL5qnZe.2 2024-08-27T03:10:40.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.452+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~jk7fk27v598wHZgRPvsQ34KQUL5qnZe.3 2024-08-27T03:10:40.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.452+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~jk7fk27v598wHZgRPvsQ34KQUL5qnZe.4 2024-08-27T03:10:40.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.452+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~jk7fk27v598wHZgRPvsQ34KQUL5qnZe.5 2024-08-27T03:10:40.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.452+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16701457533939591844', time=2024-08-27T05:10:11.448693+0000, chain.objs.size()=1 2024-08-27T03:10:40.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.452+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.120__shadow_.4oVvAfpe1coLiQ4y0iKaQPLo98t8cRZ_0 2024-08-27T03:10:40.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.452+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3201371435507706742', time=2024-08-27T05:10:28.030358+0000, chain.objs.size()=1 2024-08-27T03:10:40.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.452+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.133__shadow_.rM45Tyf_dEpBVf2yxIVzCmqL2ILWvjg_0 2024-08-27T03:10:40.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.464+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:10:40.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6474352478372838984', time=2024-08-27T05:07:25.309945+0000, chain.objs.size()=1 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.78__shadow_.xtT2Wy4561XAo5nlEYLp7s0o509ehDN_0 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5017396167753991698', time=2024-08-27T05:09:27.651294+0000, chain.objs.size()=5 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.98__multipart_key1.2~2Feg9xKzvNuUhbKdphd805Nxju2m8rA.1 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.98__multipart_key1.2~2Feg9xKzvNuUhbKdphd805Nxju2m8rA.2 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.98__multipart_key1.2~2Feg9xKzvNuUhbKdphd805Nxju2m8rA.3 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.98__multipart_key1.2~2Feg9xKzvNuUhbKdphd805Nxju2m8rA.4 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.98__multipart_key1.2~2Feg9xKzvNuUhbKdphd805Nxju2m8rA.5 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1124617150668904910', time=2024-08-27T05:09:52.112600+0000, chain.objs.size()=1 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.107__shadow_.9Fd-CIwXSenR1_jQ9tNup906n9a-c_v_0 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7783835332929164316', time=2024-08-27T05:10:01.247498+0000, chain.objs.size()=1 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.113__shadow_.MT_t2bdVi0h4IzATByGop24EPZUrUE2_0 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14450316563586982873', time=2024-08-27T05:10:07.111678+0000, chain.objs.size()=1 2024-08-27T03:10:40.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.468+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.117__shadow_.4kZBX7wGUGGPsvz5wkyfeHKBX4VZ0it_0 2024-08-27T03:10:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.480+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.480+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:10:40.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12091921350298263575', time=2024-08-27T05:09:53.590994+0000, chain.objs.size()=1 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.108__shadow_.x1P06qDIP-PCLjfmpwJq32rTpqmco5z_0 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15928015551017611267', time=2024-08-27T05:09:55.176356+0000, chain.objs.size()=1 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.109__shadow_.BkoNJXZ6A-nkvyRRoax83GLtjpyNhjd_0 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12112613073366796352', time=2024-08-27T05:10:14.580899+0000, chain.objs.size()=1 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.122__shadow_.bOHr1-f-t_i-rlnm81QXJJd0nBp7Nky_0 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1134219432655026448', time=2024-08-27T05:10:16.076036+0000, chain.objs.size()=1 2024-08-27T03:10:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.123__shadow_.rXkUpmvzFodTfxGn3pR3e6sSrQLp469_0 2024-08-27T03:10:40.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.950670075677847301', time=2024-08-27T05:10:16.223504+0000, chain.objs.size()=1 2024-08-27T03:10:40.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.123__shadow_.dARBw8TcWHnLh-AtRWfEYKWuy3XRGzG_0 2024-08-27T03:10:40.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18063413243502903980', time=2024-08-27T05:10:39.501602+0000, chain.objs.size()=1 2024-08-27T03:10:40.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.484+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.138__shadow_.U2SMoE7KMX18bdpseMSl1uwqcrwPR4J_0 2024-08-27T03:10:40.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.492+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.496+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:10:40.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.496+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.500+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.500+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:10:40.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.500+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10923718796722654683', time=2024-08-27T05:09:52.185395+0000, chain.objs.size()=1 2024-08-27T03:10:40.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.500+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.107__shadow_.ui6AtW6CbrFupjfWmfnkhgTc65WkKrB_0 2024-08-27T03:10:40.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.500+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.504+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:10:40.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11871877009840491126', time=2024-08-27T05:08:00.635429+0000, chain.objs.size()=5 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~wg_MeMSBECi1doSnw-V0170lyjvKg0X.1 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~wg_MeMSBECi1doSnw-V0170lyjvKg0X.2 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~wg_MeMSBECi1doSnw-V0170lyjvKg0X.3 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~wg_MeMSBECi1doSnw-V0170lyjvKg0X.4 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~wg_MeMSBECi1doSnw-V0170lyjvKg0X.5 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7677171124332567970', time=2024-08-27T05:09:44.604800+0000, chain.objs.size()=1 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.100__shadow_.5Yv8miqcV4eixVJ7v8JNpCJzOG7Z2mX_0 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.410582069787036169', time=2024-08-27T05:09:50.580983+0000, chain.objs.size()=1 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.106__shadow_.ppve-X_37jC-lzI0aQZ9IKG7uSdCf_U_0 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4180548383543107740', time=2024-08-27T05:10:13.187423+0000, chain.objs.size()=1 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.121__shadow_.bxDAH0-J7rTTmac7r3jElyQR1ipyadW_0 2024-08-27T03:10:40.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15424710828395725040', time=2024-08-27T05:10:24.542756+0000, chain.objs.size()=1 2024-08-27T03:10:40.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.508+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.130__shadow_.86Iy9Ccsa4D5vMTVfibrdmALrNUTGek_0 2024-08-27T03:10:40.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.516+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.520+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:10:40.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2756464416415465048', time=2024-08-27T05:08:44.697702+0000, chain.objs.size()=1 2024-08-27T03:10:40.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__shadow_.MYo7AH4vkhAg_Mq3wCEGhnPoYkXqykK_0 2024-08-27T03:10:40.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13939580164389466577', time=2024-08-27T05:09:55.101206+0000, chain.objs.size()=1 2024-08-27T03:10:40.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.109__shadow_.ElULb5PxC1ZUjTRiv7s-KMRP_aNVYOP_0 2024-08-27T03:10:40.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5925824920256243140', time=2024-08-27T05:09:56.695193+0000, chain.objs.size()=1 2024-08-27T03:10:40.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.110__shadow_.V03T1g-tp2P-Bio-TcsC5Frwovt2C_3_0 2024-08-27T03:10:40.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2700148998045181453', time=2024-08-27T05:10:10.199324+0000, chain.objs.size()=1 2024-08-27T03:10:40.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.119__shadow_.N8Bv9Yiv14pEEB01FIGnn7ftK5F2txd_0 2024-08-27T03:10:40.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12083833923721774079', time=2024-08-27T05:10:16.151376+0000, chain.objs.size()=1 2024-08-27T03:10:40.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.524+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.123__shadow_.sjEdC0LKFqN-V5cf-kXOPWCG-GHZQ6G_0 2024-08-27T03:10:40.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.528+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.532+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:10:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.532+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.532+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12678345891861278707', time=2024-08-27T05:08:44.623261+0000, chain.objs.size()=5 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file.mpg.2~tps0vkDBVHBDLefZs5aSaUZaXzuQm99.1 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file.mpg.2~tps0vkDBVHBDLefZs5aSaUZaXzuQm99.2 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file.mpg.2~tps0vkDBVHBDLefZs5aSaUZaXzuQm99.3 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file.mpg.2~tps0vkDBVHBDLefZs5aSaUZaXzuQm99.4 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file.mpg.2~tps0vkDBVHBDLefZs5aSaUZaXzuQm99.5 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9311101353848665807', time=2024-08-27T05:08:44.774129+0000, chain.objs.size()=5 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file2.mpg.2~ahqnW5pwWpxYdzJGZ2LBOl4GHjTBX-E.1 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file2.mpg.2~ahqnW5pwWpxYdzJGZ2LBOl4GHjTBX-E.2 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file2.mpg.2~ahqnW5pwWpxYdzJGZ2LBOl4GHjTBX-E.3 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file2.mpg.2~ahqnW5pwWpxYdzJGZ2LBOl4GHjTBX-E.4 2024-08-27T03:10:40.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__multipart_file2.mpg.2~ahqnW5pwWpxYdzJGZ2LBOl4GHjTBX-E.5 2024-08-27T03:10:40.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16351913732091893421', time=2024-08-27T05:10:11.651426+0000, chain.objs.size()=1 2024-08-27T03:10:40.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.120__shadow_.JapWRZht8x94Qgy5WYcrD_7DRy06T38_0 2024-08-27T03:10:40.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15706656225164867939', time=2024-08-27T05:10:16.295098+0000, chain.objs.size()=1 2024-08-27T03:10:40.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.536+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.123__shadow_.ehxTWFGL8xdDaRald3Pz-rE6VL125C7_0 2024-08-27T03:10:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.544+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.548+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:10:40.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.548+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18127677407165423237', time=2024-08-27T05:08:11.049492+0000, chain.objs.size()=4 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.87__shadow_.jVCtXiEp9RrGVkazVBK80uK6w8kQith_0 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.87__shadow_.jVCtXiEp9RrGVkazVBK80uK6w8kQith_1 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.87__shadow_.jVCtXiEp9RrGVkazVBK80uK6w8kQith_2 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.87__shadow_.jVCtXiEp9RrGVkazVBK80uK6w8kQith_3 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2121219825773715111', time=2024-08-27T05:10:01.317738+0000, chain.objs.size()=1 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.113__shadow_.WstLDfywqFACoZBr1cwFxFagXImHUeB_0 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3310298742359322073', time=2024-08-27T05:10:02.781246+0000, chain.objs.size()=1 2024-08-27T03:10:40.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.114__shadow_.8l9ykcrkOWx-HZjbJ0PNrCkudUC1qUq_0 2024-08-27T03:10:40.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12103736311523768564', time=2024-08-27T05:10:17.596509+0000, chain.objs.size()=1 2024-08-27T03:10:40.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.552+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.124__shadow_.KJ5s3e2a5NVt1LyjvPMQsHwQZkPhnL4_0 2024-08-27T03:10:40.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.556+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.560+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:10:40.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-27T03:10:40.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13604426758783194159', time=2024-08-27T05:09:17.156085+0000, chain.objs.size()=5 2024-08-27T03:10:40.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~z4ir9igvVEBxVHxNTDBUhZDObzxjaBv.1 2024-08-27T03:10:40.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__shadow_key1.2~z4ir9igvVEBxVHxNTDBUhZDObzxjaBv.1_1 2024-08-27T03:10:40.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~z4ir9igvVEBxVHxNTDBUhZDObzxjaBv.2 2024-08-27T03:10:40.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__shadow_key1.2~z4ir9igvVEBxVHxNTDBUhZDObzxjaBv.2_1 2024-08-27T03:10:40.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~z4ir9igvVEBxVHxNTDBUhZDObzxjaBv.3 2024-08-27T03:10:40.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1533911989356824772', time=2024-08-27T05:10:20.320046+0000, chain.objs.size()=1 2024-08-27T03:10:40.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.126__shadow_.tnwf4GKV8C6gfUDQ1cyve-839-CBnVM_0 2024-08-27T03:10:40.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2703663827069328202', time=2024-08-27T05:10:26.354979+0000, chain.objs.size()=1 2024-08-27T03:10:40.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.564+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.132__shadow_.MceU7Dydleix9A1vgZRBA-tFFM9fesd_0 2024-08-27T03:10:40.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.572+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.572+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:10:40.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13753536837826034161', time=2024-08-27T05:09:07.597056+0000, chain.objs.size()=5 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~guGygSeQXjiEl-BSa6NyN0WaihGzXzv.1 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~guGygSeQXjiEl-BSa6NyN0WaihGzXzv.2 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~guGygSeQXjiEl-BSa6NyN0WaihGzXzv.3 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~guGygSeQXjiEl-BSa6NyN0WaihGzXzv.4 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~guGygSeQXjiEl-BSa6NyN0WaihGzXzv.5 2024-08-27T03:10:40.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15531166536173322810', time=2024-08-27T05:09:56.567766+0000, chain.objs.size()=1 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.110__shadow_.7MneYdL7LgVTG0N3FK8b7eTlVbx8fF5_0 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11557994834595044860', time=2024-08-27T05:10:08.579290+0000, chain.objs.size()=1 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.118__shadow_.7QwfkFiWgjLZr2BTKSZexHU52l8l6Wk_0 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15923274707542278235', time=2024-08-27T05:10:14.743689+0000, chain.objs.size()=1 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.122__shadow_.6Ku6fjDSZ0aO_8CWmD9i57PccpIRFAM_0 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5073095839761854350', time=2024-08-27T05:10:17.663862+0000, chain.objs.size()=1 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.124__shadow_.Di1KdxK7q_K2ps4zIkYao07G58_-_BO_0 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9498106064824945868', time=2024-08-27T05:10:25.504977+0000, chain.objs.size()=1 2024-08-27T03:10:40.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.576+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.131__shadow_.g9Q32UHepEst88gnNLO6w4jOfaLT7NA_0 2024-08-27T03:10:40.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.584+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:10:40.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15532319359514069947', time=2024-08-27T05:07:13.263138+0000, chain.objs.size()=1 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.71__shadow_.4Ts19YdT_P0ROmgX7u8vNtT0QpNhIHV_0 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.114754607313712794', time=2024-08-27T05:10:04.232800+0000, chain.objs.size()=1 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.115__shadow_.HOZbB1lF11713KbyxFiZedo2d2hsTsl_0 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14716422269746397361', time=2024-08-27T05:10:04.306935+0000, chain.objs.size()=1 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.115__shadow_.OKPdFGkM8F_T_rgJIKK-UJgOXhDIHar_0 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14273145003780541374', time=2024-08-27T05:10:35.060239+0000, chain.objs.size()=5 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.137__multipart_key1.2~lOMVTtLQmR5MEmVFyNupJRxC5G6H1xv.1 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.137__multipart_key1.2~lOMVTtLQmR5MEmVFyNupJRxC5G6H1xv.2 2024-08-27T03:10:40.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.137__multipart_key1.2~lOMVTtLQmR5MEmVFyNupJRxC5G6H1xv.3 2024-08-27T03:10:40.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.137__multipart_key1.2~lOMVTtLQmR5MEmVFyNupJRxC5G6H1xv.4 2024-08-27T03:10:40.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.588+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.137__multipart_key1.2~lOMVTtLQmR5MEmVFyNupJRxC5G6H1xv.5 2024-08-27T03:10:40.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.596+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:10:40.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16295030005644195653', time=2024-08-27T05:08:10.152839+0000, chain.objs.size()=5 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~-DjTdoznxMGuaBigbibD7I56W1samL3.1 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__shadow_key1.2~-DjTdoznxMGuaBigbibD7I56W1samL3.1_1 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~-DjTdoznxMGuaBigbibD7I56W1samL3.2 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__shadow_key1.2~-DjTdoznxMGuaBigbibD7I56W1samL3.2_1 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~-DjTdoznxMGuaBigbibD7I56W1samL3.3 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17686992178541507216', time=2024-08-27T05:09:50.655150+0000, chain.objs.size()=1 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.600+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.106__shadow_.MiRoasl0wsK6l9oTQ004hq1CCUAuBtF_0 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.604+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16920781366520327845', time=2024-08-27T05:09:59.765022+0000, chain.objs.size()=1 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.604+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.112__shadow_.jPJMQxM4ithv8S_NNZkmmF_42IaPUoe_0 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.604+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14394332863169189635', time=2024-08-27T05:10:10.124087+0000, chain.objs.size()=1 2024-08-27T03:10:40.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.604+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.119__shadow_.cmlugXbzyzREmUuZDfOiU2I_koiavGM_0 2024-08-27T03:10:40.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.608+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:10:40.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8836988944926455881', time=2024-08-27T05:09:17.476746+0000, chain.objs.size()=5 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~yWRaapqA-etUflh_k9dtKHXKvcZw566.1 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__shadow_key1.2~yWRaapqA-etUflh_k9dtKHXKvcZw566.1_1 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~yWRaapqA-etUflh_k9dtKHXKvcZw566.2 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__shadow_key1.2~yWRaapqA-etUflh_k9dtKHXKvcZw566.2_1 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~yWRaapqA-etUflh_k9dtKHXKvcZw566.3 2024-08-27T03:10:40.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9317486787531014323', time=2024-08-27T05:09:58.092738+0000, chain.objs.size()=1 2024-08-27T03:10:40.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.111__shadow_.Bqm8cFtaqmfjhm5JQQSajKlaJL84xOZ_0 2024-08-27T03:10:40.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13788989978641807719', time=2024-08-27T05:10:01.103138+0000, chain.objs.size()=1 2024-08-27T03:10:40.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.113__shadow_.uN3zUoHe9McGjyrCixYGEc8EBAbnVYe_0 2024-08-27T03:10:40.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4891880485062167695', time=2024-08-27T05:10:20.391723+0000, chain.objs.size()=1 2024-08-27T03:10:40.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.612+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.126__shadow_.e-g9_yV6rFfKdNXA55NensLiyosUtpL_0 2024-08-27T03:10:40.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.620+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.620+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:10:40.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SNpiNZayJCu1Yx1S9L6yiumGSKgTUWw', time=2024-08-27T05:07:18.052393+0000, chain.objs.size()=5 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.73__multipart_key1.2~SNpiNZayJCu1Yx1S9L6yiumGSKgTUWw.1 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.73__multipart_key1.2~SNpiNZayJCu1Yx1S9L6yiumGSKgTUWw.2 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.73__multipart_key1.2~SNpiNZayJCu1Yx1S9L6yiumGSKgTUWw.3 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.73__multipart_key1.2~SNpiNZayJCu1Yx1S9L6yiumGSKgTUWw.4 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.73__multipart_key1.2~SNpiNZayJCu1Yx1S9L6yiumGSKgTUWw.5 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3758714702029451584', time=2024-08-27T05:09:52.039655+0000, chain.objs.size()=1 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.107__shadow_.tsGoZLWL3fNHa7RrdJk21tU2RRmI6Dy_0 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4401056661408778109', time=2024-08-27T05:10:02.616099+0000, chain.objs.size()=1 2024-08-27T03:10:40.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.114__shadow_.liV-j_Z7Gwzkq5frzmVFJyt5Nn7yfyV_0 2024-08-27T03:10:40.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9063388346967670067', time=2024-08-27T05:10:02.853914+0000, chain.objs.size()=1 2024-08-27T03:10:40.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.114__shadow_.j0ZqhsVPuFM2B7SMvB2cleaYpAIT1QK_0 2024-08-27T03:10:40.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4826467019959644221', time=2024-08-27T05:10:20.461701+0000, chain.objs.size()=1 2024-08-27T03:10:40.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.624+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.126__shadow_.pV2G6SJlqbhFB7gLlbOY0iZagJXqNR2_0 2024-08-27T03:10:40.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.628+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.632+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:10:40.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-08-27T03:10:40.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3452099608187381590', time=2024-08-27T05:09:50.448200+0000, chain.objs.size()=1 2024-08-27T03:10:40.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.106__shadow_._Max11x8rTDwbg-2hge3-9gE1eRxYye_0 2024-08-27T03:10:40.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11917416045449417722', time=2024-08-27T05:09:59.834893+0000, chain.objs.size()=1 2024-08-27T03:10:40.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.112__shadow_.UgCDBCbGhWKd9hsIMDvnusfRwH0UxVj_0 2024-08-27T03:10:40.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11167427668748737658', time=2024-08-27T05:10:13.043689+0000, chain.objs.size()=1 2024-08-27T03:10:40.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.636+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.121__shadow_.qPT3GfilPV93JvHpjImlXgaBIFHLEuw_0 2024-08-27T03:10:40.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.640+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.640+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:10:40.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:10:40.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='2~JuwZwMxDPAwIrqTTywLdAF4ha_fd-jK', time=2024-08-27T05:08:49.155136+0000, chain.objs.size()=5 2024-08-27T03:10:40.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.95__multipart_key1.2~JuwZwMxDPAwIrqTTywLdAF4ha_fd-jK.7 2024-08-27T03:10:40.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.95__multipart_key1.2~JuwZwMxDPAwIrqTTywLdAF4ha_fd-jK.8 2024-08-27T03:10:40.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.95__multipart_key1.2~JuwZwMxDPAwIrqTTywLdAF4ha_fd-jK.9 2024-08-27T03:10:40.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.95__multipart_key1.2~JuwZwMxDPAwIrqTTywLdAF4ha_fd-jK.10 2024-08-27T03:10:40.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.644+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.95__multipart_key1.2~JuwZwMxDPAwIrqTTywLdAF4ha_fd-jK.11 2024-08-27T03:10:40.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.648+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:10:40.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:10:40.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2970084724017746759', time=2024-08-27T05:09:53.741489+0000, chain.objs.size()=1 2024-08-27T03:10:40.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.108__shadow_.hpOllSKoGIU_kfANZkQHVeDG_zj6cLc_0 2024-08-27T03:10:40.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11400545777215135495', time=2024-08-27T05:10:14.510339+0000, chain.objs.size()=1 2024-08-27T03:10:40.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.656+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.122__shadow_.izDKxIzQuMWtRiYfyKjRWI1qBM-x6aN_0 2024-08-27T03:10:40.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.660+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:10:40.665 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8777960453941200787', time=2024-08-27T05:08:44.915408+0000, chain.objs.size()=1 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__shadow_.Kw4T3a1WHO5r1DWD-ykDM93Jdz-i7pL_0 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3939504739969403877', time=2024-08-27T05:09:04.396370+0000, chain.objs.size()=5 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~sfTF4uUiy-fptCGszGF4m5uXebU9osd.1 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~sfTF4uUiy-fptCGszGF4m5uXebU9osd.2 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~sfTF4uUiy-fptCGszGF4m5uXebU9osd.3 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~sfTF4uUiy-fptCGszGF4m5uXebU9osd.4 2024-08-27T03:10:40.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.664+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~sfTF4uUiy-fptCGszGF4m5uXebU9osd.5 2024-08-27T03:10:40.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.668+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.672+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:10:40.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.672+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15020389946504828619', time=2024-08-27T05:08:10.447103+0000, chain.objs.size()=5 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~e7eGoiuwNOQZzUzIW9kU1-0pz7UZrPv.1 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__shadow_key1.2~e7eGoiuwNOQZzUzIW9kU1-0pz7UZrPv.1_1 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~e7eGoiuwNOQZzUzIW9kU1-0pz7UZrPv.2 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__shadow_key1.2~e7eGoiuwNOQZzUzIW9kU1-0pz7UZrPv.2_1 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~e7eGoiuwNOQZzUzIW9kU1-0pz7UZrPv.3 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5024533376919972342', time=2024-08-27T05:09:50.524529+0000, chain.objs.size()=1 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.106__shadow_.VZYtrUHQx183Wv_eEjRsAn4YhHPxrlY_0 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14111029533143499504', time=2024-08-27T05:10:08.651558+0000, chain.objs.size()=1 2024-08-27T03:10:40.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.118__shadow_.r5HhCq0bBpPfOIv40BteOyYgasltfkk_0 2024-08-27T03:10:40.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16233259437902850842', time=2024-08-27T05:10:21.655033+0000, chain.objs.size()=1 2024-08-27T03:10:40.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.127__shadow_.z5x4v2yc3cJf6CyCJddGESaiEsIwBFs_0 2024-08-27T03:10:40.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14498634892134849676', time=2024-08-27T05:10:21.729540+0000, chain.objs.size()=1 2024-08-27T03:10:40.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.676+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.127__shadow_.tiP-Qh4qAQfZIG1OFp8udGiLYD4ilME_0 2024-08-27T03:10:40.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.680+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.684+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:10:40.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-08-27T03:10:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='2~rqECNOyCsDRYJ3U7JE37xMesufky_jd', time=2024-08-27T05:09:38.131991+0000, chain.objs.size()=56 2024-08-27T03:10:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.1 2024-08-27T03:10:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.2 2024-08-27T03:10:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.3 2024-08-27T03:10:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.4 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.5 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.6 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.7 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.8 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.9 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.10 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.11 2024-08-27T03:10:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.688+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.12 2024-08-27T03:10:40.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.692+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.13 2024-08-27T03:10:40.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.692+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.14 2024-08-27T03:10:40.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.15 2024-08-27T03:10:40.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.16 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.17 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.18 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.19 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.20 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.21 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.22 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.23 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.24 2024-08-27T03:10:40.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.696+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.25 2024-08-27T03:10:40.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.700+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.26 2024-08-27T03:10:40.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.700+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.27 2024-08-27T03:10:40.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.28 2024-08-27T03:10:40.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.29 2024-08-27T03:10:40.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.30 2024-08-27T03:10:40.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.31 2024-08-27T03:10:40.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.32 2024-08-27T03:10:40.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.33 2024-08-27T03:10:40.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.34 2024-08-27T03:10:40.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.35 2024-08-27T03:10:40.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.704+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.36 2024-08-27T03:10:40.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.37 2024-08-27T03:10:40.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.38 2024-08-27T03:10:40.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.39 2024-08-27T03:10:40.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.40 2024-08-27T03:10:40.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.41 2024-08-27T03:10:40.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.42 2024-08-27T03:10:40.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.43 2024-08-27T03:10:40.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.708+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.44 2024-08-27T03:10:40.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.45 2024-08-27T03:10:40.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.46 2024-08-27T03:10:40.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.47 2024-08-27T03:10:40.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.48 2024-08-27T03:10:40.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.49 2024-08-27T03:10:40.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.50 2024-08-27T03:10:40.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.51 2024-08-27T03:10:40.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.712+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.52 2024-08-27T03:10:40.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.716+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.53 2024-08-27T03:10:40.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.716+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.54 2024-08-27T03:10:40.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.716+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.55 2024-08-27T03:10:40.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.716+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.99__multipart_key1.2~rqECNOyCsDRYJ3U7JE37xMesufky_jd.56 2024-08-27T03:10:40.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.720+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.724+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:10:40.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-08-27T03:10:40.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12861973132237386805', time=2024-08-27T05:09:14.387844+0000, chain.objs.size()=5 2024-08-27T03:10:40.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~gNXoTNl3d6OtXige_-v-aVrA14jTgC5.1 2024-08-27T03:10:40.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__shadow_key1.2~gNXoTNl3d6OtXige_-v-aVrA14jTgC5.1_1 2024-08-27T03:10:40.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~gNXoTNl3d6OtXige_-v-aVrA14jTgC5.2 2024-08-27T03:10:40.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__shadow_key1.2~gNXoTNl3d6OtXige_-v-aVrA14jTgC5.2_1 2024-08-27T03:10:40.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96__multipart_key1.2~gNXoTNl3d6OtXige_-v-aVrA14jTgC5.3 2024-08-27T03:10:40.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3435594527447243429', time=2024-08-27T05:09:53.518897+0000, chain.objs.size()=1 2024-08-27T03:10:40.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.108__shadow_.xqbNyztnffkB0gr2VOQnyL5lfmi_Lfq_0 2024-08-27T03:10:40.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17016288300937687235', time=2024-08-27T05:09:58.240967+0000, chain.objs.size()=1 2024-08-27T03:10:40.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.111__shadow_.f_zTK5HouTbRRcWSOPwxxN4gVfCvgaF_0 2024-08-27T03:10:40.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5088412794401298507', time=2024-08-27T05:10:07.255853+0000, chain.objs.size()=1 2024-08-27T03:10:40.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.728+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.117__shadow_.wgLxJhPpE-4ADv3uYQ7NutX_2BKczNa_0 2024-08-27T03:10:40.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.736+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.740+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:10:40.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-08-27T03:10:40.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5670547192704069429', time=2024-08-27T05:07:26.295540+0000, chain.objs.size()=1 2024-08-27T03:10:40.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.79__shadow_.LKtm6s1yc2UxNdxA-UPhlnY3pl_z_bT_0 2024-08-27T03:10:40.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15209716221435960590', time=2024-08-27T05:10:05.672129+0000, chain.objs.size()=1 2024-08-27T03:10:40.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.116__shadow_.Sio4-Idaa1mvHOgdJ3vdmlrJq1IYAaY_0 2024-08-27T03:10:40.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.744+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.748+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:10:40.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.748+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.748+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-08-27T03:10:40.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12802745454142597796', time=2024-08-27T05:07:30.619761+0000, chain.objs.size()=1 2024-08-27T03:10:40.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.84__shadow_.X7b2hpHq8ffAiWGKN8qjd-apf9tHzwY_0 2024-08-27T03:10:40.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16048232965688983869', time=2024-08-27T05:07:55.775124+0000, chain.objs.size()=5 2024-08-27T03:10:40.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~LiJfEioX42zd6hB2WpmiWh08o81kttK.1 2024-08-27T03:10:40.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~LiJfEioX42zd6hB2WpmiWh08o81kttK.2 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~LiJfEioX42zd6hB2WpmiWh08o81kttK.3 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~LiJfEioX42zd6hB2WpmiWh08o81kttK.4 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.88__multipart_key1.2~LiJfEioX42zd6hB2WpmiWh08o81kttK.5 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16403064444084899497', time=2024-08-27T05:08:44.844452+0000, chain.objs.size()=1 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.94__shadow_.n_tzBoeezXk951BE0efdp3qz7bXYBRl_0 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2273224368204806516', time=2024-08-27T05:09:56.625750+0000, chain.objs.size()=1 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.110__shadow_.MnH6YsqfMThZe0yndPWmfq4poqn7qUb_0 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11749616527663013466', time=2024-08-27T05:09:59.638166+0000, chain.objs.size()=1 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.112__shadow_.VK6BRGO3l1m2DzdlUsIFHnGge37h29G_0 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2050779747163060636', time=2024-08-27T05:09:59.694976+0000, chain.objs.size()=1 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.112__shadow_.HANE5L7ocRzix7_M5OI-eK93Hu2wzTP_0 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6314964391293787405', time=2024-08-27T05:10:05.881366+0000, chain.objs.size()=1 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.116__shadow_.XFf2SZRrELpsxFhFWupVedlUSrusg4k_0 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1573644130052975117', time=2024-08-27T05:10:12.966134+0000, chain.objs.size()=1 2024-08-27T03:10:40.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.752+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.121__shadow_.3YdA9ZyBFXzkq_GgwgBzJng4dPdVxCu_0 2024-08-27T03:10:40.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.756+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12134028589988058667', time=2024-08-27T05:10:13.116631+0000, chain.objs.size()=1 2024-08-27T03:10:40.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.756+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.121__shadow_.73_TN91YfB6TAQp_scODHct_ZGBiGjc_0 2024-08-27T03:10:40.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.756+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17271275864671136139', time=2024-08-27T05:10:14.673167+0000, chain.objs.size()=1 2024-08-27T03:10:40.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.756+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.122__shadow_.6lHpVRS2lRAUZN8SkCXwx5P1OKO09fI_0 2024-08-27T03:10:40.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.760+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.760+0000 7f79ea2389c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:10:40.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:40.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6279451685257965792', time=2024-08-27T05:08:24.022568+0000, chain.objs.size()=5 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.93__multipart_key1.2~n9jFQqdOM4KhkCJjJBaZb2EZYPKcurC.1 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.93__multipart_key1.2~n9jFQqdOM4KhkCJjJBaZb2EZYPKcurC.2 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.93__multipart_key1.2~n9jFQqdOM4KhkCJjJBaZb2EZYPKcurC.3 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.93__multipart_key1.2~n9jFQqdOM4KhkCJjJBaZb2EZYPKcurC.4 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.93__multipart_key1.2~n9jFQqdOM4KhkCJjJBaZb2EZYPKcurC.5 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13309305388016349437', time=2024-08-27T05:09:55.039898+0000, chain.objs.size()=1 2024-08-27T03:10:40.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.109__shadow_.4Lk-LaHE4Coc_1zzgCx8Shh3bIdAP1Y_0 2024-08-27T03:10:40.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1070772042872367076', time=2024-08-27T05:10:05.744027+0000, chain.objs.size()=1 2024-08-27T03:10:40.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.116__shadow_.DGlzSTbE4Q3jWxyKOBD_qhjiH6fHw3b_0 2024-08-27T03:10:40.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.566805340350790463', time=2024-08-27T05:10:09.982145+0000, chain.objs.size()=1 2024-08-27T03:10:40.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.119__shadow_.U6EsFfZOyUv5JMGCjmsc15VLSvLPRjd_0 2024-08-27T03:10:40.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3016910640683199017', time=2024-08-27T05:10:19.057380+0000, chain.objs.size()=1 2024-08-27T03:10:40.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.764+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.125__shadow_.dVtFJPIQ6DDilb9ZuyqfjSK0H6jojQh_0 2024-08-27T03:10:40.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.768+0000 7f79ea2389c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:10:40.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.772+0000 7f789dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:40.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.776+0000 7f79ea2389c0 20 remove_watcher() i=0 2024-08-27T03:10:40.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.776+0000 7f79ea2389c0 2 removed watcher, disabling cache 2024-08-27T03:10:40.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.776+0000 7f79ea2389c0 20 remove_watcher() i=1 2024-08-27T03:10:40.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.780+0000 7f79ea2389c0 20 remove_watcher() i=2 2024-08-27T03:10:40.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.780+0000 7f79ea2389c0 20 remove_watcher() i=3 2024-08-27T03:10:40.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.780+0000 7f79ea2389c0 20 remove_watcher() i=4 2024-08-27T03:10:40.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.780+0000 7f79ea2389c0 20 remove_watcher() i=5 2024-08-27T03:10:40.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.784+0000 7f79ea2389c0 20 remove_watcher() i=6 2024-08-27T03:10:40.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.784+0000 7f79ea2389c0 20 remove_watcher() i=7 2024-08-27T03:10:40.798 DEBUG:teuthology.orchestra.run.smithi143:> radosgw-admin gc process --include-all 2024-08-27T03:10:40.867 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:40.867 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:40.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 realm 2024-08-27T03:10:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:40.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.912+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.916+0000 7fbcf42f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.916+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.916+0000 7fbcf42f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.916+0000 7fbcf42f79c0 20 searching for the correct realm 2024-08-27T03:10:40.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:40.924+0000 7fbcf25fe640 0 -- 172.21.15.143:0/988501634 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fbce801a040 msgr2=0x7fbce804d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:41.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.140+0000 7fbcf1dfd640 0 -- 172.21.15.143:0/988501634 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55edb63e9550 msgr2=0x55edb63eb940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:41.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:41.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:41.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:41.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:41.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:41.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:41.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:41.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:41.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:41.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:41.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.148+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:41.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:41.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 zone default found 2024-08-27T03:10:41.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 4 Realm: () 2024-08-27T03:10:41.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:41.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:41.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:41.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 zonegroup default 2024-08-27T03:10:41.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:41.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:41.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:41.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:41.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:41.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:41.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 started sync module instance, tier type = 2024-08-27T03:10:41.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.152+0000 7fbcf42f79c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:41.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.176+0000 7fbcf42f79c0 20 add_watcher() i=0 2024-08-27T03:10:41.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.176+0000 7fbcf42f79c0 20 add_watcher() i=1 2024-08-27T03:10:41.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.176+0000 7fbcf42f79c0 20 add_watcher() i=2 2024-08-27T03:10:41.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.176+0000 7fbcf42f79c0 20 add_watcher() i=3 2024-08-27T03:10:41.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.176+0000 7fbcf42f79c0 20 add_watcher() i=4 2024-08-27T03:10:41.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.176+0000 7fbcf42f79c0 20 add_watcher() i=5 2024-08-27T03:10:41.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.176+0000 7fbcf42f79c0 20 add_watcher() i=6 2024-08-27T03:10:41.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.180+0000 7fbcf42f79c0 20 add_watcher() i=7 2024-08-27T03:10:41.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.180+0000 7fbcf42f79c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:41.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.184+0000 7fbba37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:41.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.184+0000 7fbcf42f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:41.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.184+0000 7fbcf42f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.272+0000 7fbba27fc640 20 reqs_thread_entry: start 2024-08-27T03:10:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.272+0000 7fbcf42f79c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.272+0000 7fbcf42f79c0 20 Filter name: none 2024-08-27T03:10:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.272+0000 7fbb13fff640 20 reqs_thread_entry: start 2024-08-27T03:10:41.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.272+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:10:41.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.276+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.276+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.276+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.280+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:10:41.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.284+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.284+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.284+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.284+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:10:41.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.288+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.292+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.292+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.292+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:10:41.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.296+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.296+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.300+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.300+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:10:41.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.304+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.304+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.304+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.304+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:10:41.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.308+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.308+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.308+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.312+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:10:41.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.316+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.316+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.316+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.316+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:10:41.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.320+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.320+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.320+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.324+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:10:41.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.328+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.328+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.328+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.328+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:10:41.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.332+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.332+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.336+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.336+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:10:41.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.340+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.340+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.344+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.344+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:10:41.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.348+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.348+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.352+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.352+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:10:41.355 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.356+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.356+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.356+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.356+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:10:41.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.360+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.360+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.360+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.360+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:10:41.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.364+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.364+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.364+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.368+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:10:41.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.368+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.372+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.372+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.372+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:10:41.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.376+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.376+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.376+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.376+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:10:41.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.380+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.380+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.380+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.384+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:10:41.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.388+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.388+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.388+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.392+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:10:41.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.396+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.396+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.396+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.396+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:10:41.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.400+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.400+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.400+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.404+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:10:41.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.408+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.408+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.408+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.412+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:10:41.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.412+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.416+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.416+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.416+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:10:41.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.420+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.424+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.424+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.424+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:10:41.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.428+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.432+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.432+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.436+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:10:41.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.436+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.436+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.436+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.440+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:10:41.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.444+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.444+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.444+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.448+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:10:41.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.452+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.452+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.452+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.456+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:10:41.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.456+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.456+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.456+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.460+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:10:41.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.464+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.464+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.468+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.468+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:10:41.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.472+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.476+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.476+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.480+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:10:41.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.480+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.484+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:10:41.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.484+0000 7fbcf42f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:10:41.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.488+0000 7fbba37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:41.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.492+0000 7fbcf42f79c0 20 remove_watcher() i=0 2024-08-27T03:10:41.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.492+0000 7fbcf42f79c0 2 removed watcher, disabling cache 2024-08-27T03:10:41.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.496+0000 7fbcf42f79c0 20 remove_watcher() i=1 2024-08-27T03:10:41.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.496+0000 7fbcf42f79c0 20 remove_watcher() i=2 2024-08-27T03:10:41.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.500+0000 7fbcf42f79c0 20 remove_watcher() i=3 2024-08-27T03:10:41.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.500+0000 7fbcf42f79c0 20 remove_watcher() i=4 2024-08-27T03:10:41.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.504+0000 7fbcf42f79c0 20 remove_watcher() i=5 2024-08-27T03:10:41.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.504+0000 7fbcf42f79c0 20 remove_watcher() i=6 2024-08-27T03:10:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:41.504+0000 7fbcf42f79c0 20 remove_watcher() i=7 2024-08-27T03:10:41.526 INFO:teuthology.run_tasks:Running task s3tests... 2024-08-27T03:10:41.554 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-08-27T03:10:41.555 INFO:tasks.s3tests:Downloading s3-tests... 2024-08-27T03:10:41.555 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-08-27T03:10:41.555 DEBUG:teuthology.orchestra.run.smithi143:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-08-27T03:10:41.573 INFO:teuthology.orchestra.run.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-08-27T03:10:42.377 INFO:tasks.s3tests:Creating rgw users... 2024-08-27T03:10:42.377 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-08-27T03:10:42.459 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:42.459 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:42.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 realm 2024-08-27T03:10:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.500+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.504+0000 7f044b0cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:42.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.504+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.504+0000 7f044b0cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:42.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.504+0000 7f044b0cc9c0 20 searching for the correct realm 2024-08-27T03:10:42.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.508+0000 7f04493d3640 0 -- 172.21.15.143:0/261325219 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f043c076040 msgr2=0x7f043c05b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:42.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.516+0000 7f0448bd2640 0 -- 172.21.15.143:0/261325219 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f043c046bb0 msgr2=0x7f043c063040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.732+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:42.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:42.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 zone default found 2024-08-27T03:10:42.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 4 Realm: () 2024-08-27T03:10:42.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:42.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:42.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:42.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 zonegroup default 2024-08-27T03:10:42.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 started sync module instance, tier type = 2024-08-27T03:10:42.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.736+0000 7f044b0cc9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:42.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.760+0000 7f044b0cc9c0 20 add_watcher() i=0 2024-08-27T03:10:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.760+0000 7f044b0cc9c0 20 add_watcher() i=1 2024-08-27T03:10:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.760+0000 7f044b0cc9c0 20 add_watcher() i=2 2024-08-27T03:10:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.760+0000 7f044b0cc9c0 20 add_watcher() i=3 2024-08-27T03:10:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.760+0000 7f044b0cc9c0 20 add_watcher() i=4 2024-08-27T03:10:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.760+0000 7f044b0cc9c0 20 add_watcher() i=5 2024-08-27T03:10:42.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.760+0000 7f044b0cc9c0 20 add_watcher() i=6 2024-08-27T03:10:42.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.764+0000 7f044b0cc9c0 20 add_watcher() i=7 2024-08-27T03:10:42.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.764+0000 7f044b0cc9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:42.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.768+0000 7f02fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:42.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.768+0000 7f044b0cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:42.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.768+0000 7f044b0cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:42.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.768+0000 7f044b0cc9c0 5 note: GC not initialized 2024-08-27T03:10:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.768+0000 7f02fdfe3640 20 reqs_thread_entry: start 2024-08-27T03:10:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.768+0000 7f044b0cc9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 20 Filter name: none 2024-08-27T03:10:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f026f7fe640 20 reqs_thread_entry: start 2024-08-27T03:10:42.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-08-27T03:10:42.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-08-27T03:10:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-08-27T03:10:42.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-08-27T03:10:42.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-08-27T03:10:42.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.772+0000 7f044b0cc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-08-27T03:10:42.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.776+0000 7f031ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366272 cookie 94361818777088 notifier 8027 bl.length()=384 2024-08-27T03:10:42.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.776+0000 7f031ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-08-27T03:10:42.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.776+0000 7f031ffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-08-27T03:10:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.780+0000 7f044b0cc9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-08-27T03:10:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.780+0000 7f044b0cc9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-08-27T03:10:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.780+0000 7f044b0cc9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-08-27T03:10:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.780+0000 7f031ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366304 cookie 94361818788256 notifier 8027 bl.length()=225 2024-08-27T03:10:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.780+0000 7f031ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-08-27T03:10:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.780+0000 7f031ffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-08-27T03:10:42.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.784+0000 7f044b0cc9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-08-27T03:10:42.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.784+0000 7f044b0cc9c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-08-27T03:10:42.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.784+0000 7f044b0cc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-08-27T03:10:42.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.784+0000 7f031f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366252 cookie 94361818784112 notifier 8027 bl.length()=234 2024-08-27T03:10:42.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.784+0000 7f031f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-08-27T03:10:42.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.784+0000 7f031f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-08-27T03:10:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.788+0000 7f02fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:42.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.792+0000 7f044b0cc9c0 20 remove_watcher() i=0 2024-08-27T03:10:42.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.792+0000 7f044b0cc9c0 2 removed watcher, disabling cache 2024-08-27T03:10:42.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.796+0000 7f044b0cc9c0 20 remove_watcher() i=1 2024-08-27T03:10:42.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.796+0000 7f044b0cc9c0 20 remove_watcher() i=2 2024-08-27T03:10:42.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.800+0000 7f044b0cc9c0 20 remove_watcher() i=3 2024-08-27T03:10:42.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.800+0000 7f044b0cc9c0 20 remove_watcher() i=4 2024-08-27T03:10:42.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.804+0000 7f044b0cc9c0 20 remove_watcher() i=5 2024-08-27T03:10:42.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.804+0000 7f044b0cc9c0 20 remove_watcher() i=6 2024-08-27T03:10:42.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.804+0000 7f044b0cc9c0 20 remove_watcher() i=7 2024-08-27T03:10:42.821 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:42.821 INFO:teuthology.orchestra.run.smithi143.stdout: "id": "RGW11111111111111111", 2024-08-27T03:10:42.821 INFO:teuthology.orchestra.run.smithi143.stdout: "tenant": "", 2024-08-27T03:10:42.821 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "Mr.RGW11111111111111111", 2024-08-27T03:10:42.821 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "RGW11111111111111111+test@test.test", 2024-08-27T03:10:42.821 INFO:teuthology.orchestra.run.smithi143.stdout: "quota": { 2024-08-27T03:10:42.821 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_users": 1000, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_roles": 1000, 2024-08-27T03:10:42.822 INFO:teuthology.orchestra.run.smithi143.stdout: "max_groups": 1000, 2024-08-27T03:10:42.823 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:42.823 INFO:teuthology.orchestra.run.smithi143.stdout: "max_access_keys": 4 2024-08-27T03:10:42.823 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:42.824 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-08-27T03:10:42.825 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key RJQANCIFCDOUKPNMDEHH --secret r1UJnFZqzVHYqk+6zaE6AMOTxLOVmipCZHWf2l98uXVh5sdjj1tluw== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-08-27T03:10:42.916 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:42.916 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:42.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 realm 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:42.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.956+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.960+0000 7faaad8729c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:42.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.960+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:42.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.960+0000 7faaad8729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:42.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.960+0000 7faaad8729c0 20 searching for the correct realm 2024-08-27T03:10:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:42.968+0000 7faaabb79640 0 -- 172.21.15.143:0/2937415572 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7faaa00649d0 msgr2=0x7faaa0062870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:10:43.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.184+0000 7faaab378640 0 -- 172.21.15.143:0/2937415572 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55d6d73b8c30 msgr2=0x55d6d73bb0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:43.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:43.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:43.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:43.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.192+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:43.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 zone default found 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 4 Realm: () 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 zonegroup default 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 started sync module instance, tier type = 2024-08-27T03:10:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.196+0000 7faaad8729c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:43.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=0 2024-08-27T03:10:43.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=1 2024-08-27T03:10:43.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=2 2024-08-27T03:10:43.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=3 2024-08-27T03:10:43.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=4 2024-08-27T03:10:43.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=5 2024-08-27T03:10:43.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=6 2024-08-27T03:10:43.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 20 add_watcher() i=7 2024-08-27T03:10:43.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.220+0000 7faaad8729c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:43.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.224+0000 7fa961fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:43.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.224+0000 7faaad8729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:43.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.224+0000 7faaad8729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:43.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 5 note: GC not initialized 2024-08-27T03:10:43.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7fa960fe1640 20 reqs_thread_entry: start 2024-08-27T03:10:43.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:43.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 Filter name: none 2024-08-27T03:10:43.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7fa8da7fc640 20 reqs_thread_entry: start 2024-08-27T03:10:43.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-08-27T03:10:43.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-08-27T03:10:43.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-27T03:10:43.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-08-27T03:10:43.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-08-27T03:10:43.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-08-27T03:10:43.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 cache get: name=default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH : miss 2024-08-27T03:10:43.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 cache put: name=default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH info.flags=0x0 2024-08-27T03:10:43.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 adding default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH to cache LRU end 2024-08-27T03:10:43.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-08-27T03:10:43.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.228+0000 7faaad8729c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 20 rados_obj.operate() r=0 bl.length=184 2024-08-27T03:10:43.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-08-27T03:10:43.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-08-27T03:10:43.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:43.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 cache get: name=default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH : hit (negative entry) 2024-08-27T03:10:43.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 cache get: name=default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH : hit (negative entry) 2024-08-27T03:10:43.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-27T03:10:43.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-27T03:10:43.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7faaad8729c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-08-27T03:10:43.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7fa98effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366305 cookie 94381222375920 notifier 8526 bl.length()=673 2024-08-27T03:10:43.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7fa98effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-27T03:10:43.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.232+0000 7fa98effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-27T03:10:43.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.240+0000 7faaad8729c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-08-27T03:10:43.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.240+0000 7faaad8729c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-08-27T03:10:43.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.240+0000 7faaad8729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-08-27T03:10:43.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.240+0000 7fa98e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366306 cookie 94381222410416 notifier 8526 bl.length()=185 2024-08-27T03:10:43.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.240+0000 7fa98e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-08-27T03:10:43.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.240+0000 7fa98e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-08-27T03:10:43.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.244+0000 7faaad8729c0 10 cache put: name=default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH info.flags=0x7 2024-08-27T03:10:43.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.244+0000 7faaad8729c0 10 moving default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH to cache LRU end 2024-08-27T03:10:43.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.244+0000 7faaad8729c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:RJQANCIFCDOUKPNMDEHH, ofs0, ns] 2024-08-27T03:10:43.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.244+0000 7fa98effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366367 cookie 94381222413152 notifier 8526 bl.length()=186 2024-08-27T03:10:43.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.244+0000 7fa98effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH info.flags=0x7 2024-08-27T03:10:43.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.244+0000 7fa98effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RJQANCIFCDOUKPNMDEHH to cache LRU end 2024-08-27T03:10:43.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.248+0000 7faaad8729c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-08-27T03:10:43.249 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "foo.client.0", 2024-08-27T03:10:43.249 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr.RGW11111111111111111", 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "foo+test@test.test", 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "foo.client.0", 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "RJQANCIFCDOUKPNMDEHH", 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "r1UJnFZqzVHYqk+6zaE6AMOTxLOVmipCZHWf2l98uXVh5sdjj1tluw==", 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:43.236851Z" 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:43.250 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:43.251 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "root", 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "RGW11111111111111111", 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:43.236784Z", 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T03:10:43.252 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T03:10:43.253 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:43.253 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:43.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.248+0000 7fa961fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:43.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.252+0000 7faaad8729c0 20 remove_watcher() i=0 2024-08-27T03:10:43.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.252+0000 7faaad8729c0 2 removed watcher, disabling cache 2024-08-27T03:10:43.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.256+0000 7faaad8729c0 20 remove_watcher() i=1 2024-08-27T03:10:43.260 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.260+0000 7faaad8729c0 20 remove_watcher() i=2 2024-08-27T03:10:43.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.260+0000 7faaad8729c0 20 remove_watcher() i=3 2024-08-27T03:10:43.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.264+0000 7faaad8729c0 20 remove_watcher() i=4 2024-08-27T03:10:43.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.264+0000 7faaad8729c0 20 remove_watcher() i=5 2024-08-27T03:10:43.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.264+0000 7faaad8729c0 20 remove_watcher() i=6 2024-08-27T03:10:43.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.268+0000 7faaad8729c0 20 remove_watcher() i=7 2024-08-27T03:10:43.283 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9346333736 --totp-seed BRKLSGK6LY6IPG36LU55ESIEXP7RNU4JXEDQJUF262ITTZUT2Z7BHZDH7QZPHH3O --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-27T03:10:43.326 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:43.326 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:43.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.364+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.364+0000 7f58a04a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.364+0000 7f58a04a99c0 20 realm 2024-08-27T03:10:43.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.364+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:43.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:43.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:43.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.368+0000 7f58a04a99c0 20 searching for the correct realm 2024-08-27T03:10:43.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.376+0000 7f589e7b0640 0 -- 172.21.15.143:0/3921466134 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55a5a1b89d30 msgr2=0x55a5a1b8c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:43.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.380+0000 7f589d7ae640 0 -- 172.21.15.143:0/3921466134 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f5890070b20 msgr2=0x7f589006e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:10:43.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:43.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:43.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 zone default found 2024-08-27T03:10:43.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 4 Realm: () 2024-08-27T03:10:43.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:43.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:43.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:43.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 zonegroup default 2024-08-27T03:10:43.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.388+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.392+0000 7f58a04a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.392+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.392+0000 7f58a04a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.392+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.392+0000 7f58a04a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:43.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.392+0000 7f58a04a99c0 20 started sync module instance, tier type = 2024-08-27T03:10:43.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.392+0000 7f58a04a99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:43.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=0 2024-08-27T03:10:43.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=1 2024-08-27T03:10:43.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=2 2024-08-27T03:10:43.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=3 2024-08-27T03:10:43.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=4 2024-08-27T03:10:43.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=5 2024-08-27T03:10:43.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=6 2024-08-27T03:10:43.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 20 add_watcher() i=7 2024-08-27T03:10:43.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.408+0000 7f58a04a99c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f574f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 5 note: GC not initialized 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f574e7fc640 20 reqs_thread_entry: start 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 20 Filter name: none 2024-08-27T03:10:43.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f56bffff640 20 reqs_thread_entry: start 2024-08-27T03:10:43.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-08-27T03:10:43.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:43.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 20 rados_obj.operate() r=0 bl.length=488 2024-08-27T03:10:43.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-08-27T03:10:43.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-27T03:10:43.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:43.412+0000 7f58a04a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:45.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.300+0000 7f58a04a99c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-27T03:10:45.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.300+0000 7f58a04a99c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-27T03:10:45.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.300+0000 7f58a04a99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-08-27T03:10:45.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.300+0000 7f5780ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300899 cookie 94169871203536 notifier 8063 bl.length()=687 2024-08-27T03:10:45.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.300+0000 7f5780ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-08-27T03:10:45.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.300+0000 7f5780ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-08-27T03:10:45.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.308+0000 7f574f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:45.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.312+0000 7f58a04a99c0 20 remove_watcher() i=0 2024-08-27T03:10:45.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.312+0000 7f58a04a99c0 2 removed watcher, disabling cache 2024-08-27T03:10:45.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.312+0000 7f58a04a99c0 20 remove_watcher() i=1 2024-08-27T03:10:45.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.316+0000 7f58a04a99c0 20 remove_watcher() i=2 2024-08-27T03:10:45.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.320+0000 7f58a04a99c0 20 remove_watcher() i=3 2024-08-27T03:10:45.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.320+0000 7f58a04a99c0 20 remove_watcher() i=4 2024-08-27T03:10:45.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.324+0000 7f58a04a99c0 20 remove_watcher() i=5 2024-08-27T03:10:45.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.328+0000 7f58a04a99c0 20 remove_watcher() i=6 2024-08-27T03:10:45.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.328+0000 7f58a04a99c0 20 remove_watcher() i=7 2024-08-27T03:10:45.350 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-08-27T03:10:45.351 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key ITSHXKTCWFWMKSAICLFB --secret WAB1wZP1nfiPohe1myqJdh9Io4kIF0yxQT4Yg+iTguQ7h8HjiNUYxg== --cluster ceph 2024-08-27T03:10:45.437 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:45.437 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:45.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 realm 2024-08-27T03:10:45.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:45.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.476+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.480+0000 7f256285a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.480+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.480+0000 7f256285a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.480+0000 7f256285a9c0 20 searching for the correct realm 2024-08-27T03:10:45.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.484+0000 7f2560b61640 0 -- 172.21.15.143:0/2129845371 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f255406d2a0 msgr2=0x7f2554097980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:45.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.700+0000 7f2560360640 0 -- 172.21.15.143:0/2129845371 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55a1ae536b70 msgr2=0x55a1ae538f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:45.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:45.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:45.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:45.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:45.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:45.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:45.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:45.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.708+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:45.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 zone default found 2024-08-27T03:10:45.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 4 Realm: () 2024-08-27T03:10:45.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:45.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:45.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:45.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 zonegroup default 2024-08-27T03:10:45.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 started sync module instance, tier type = 2024-08-27T03:10:45.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.712+0000 7f256285a9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:45.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=0 2024-08-27T03:10:45.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=1 2024-08-27T03:10:45.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=2 2024-08-27T03:10:45.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=3 2024-08-27T03:10:45.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=4 2024-08-27T03:10:45.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=5 2024-08-27T03:10:45.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=6 2024-08-27T03:10:45.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 20 add_watcher() i=7 2024-08-27T03:10:45.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.736+0000 7f256285a9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:45.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.740+0000 7f2416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:45.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.740+0000 7f256285a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:45.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.740+0000 7f256285a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:45.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.740+0000 7f256285a9c0 5 note: GC not initialized 2024-08-27T03:10:45.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.740+0000 7f2415fdb640 20 reqs_thread_entry: start 2024-08-27T03:10:45.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.740+0000 7f256285a9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:45.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 20 Filter name: none 2024-08-27T03:10:45.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f23877fe640 20 reqs_thread_entry: start 2024-08-27T03:10:45.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-08-27T03:10:45.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-08-27T03:10:45.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-27T03:10:45.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-08-27T03:10:45.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache get: name=default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB : miss 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache put: name=default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB info.flags=0x0 2024-08-27T03:10:45.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 adding default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB to cache LRU end 2024-08-27T03:10:45.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache get: name=default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB : hit (negative entry) 2024-08-27T03:10:45.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.744+0000 7f256285a9c0 10 cache get: name=default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB : hit (negative entry) 2024-08-27T03:10:45.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.748+0000 7f256285a9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-27T03:10:45.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.748+0000 7f256285a9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-27T03:10:45.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.748+0000 7f256285a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-08-27T03:10:45.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.748+0000 7f24377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300865 cookie 94152902831648 notifier 8081 bl.length()=645 2024-08-27T03:10:45.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.748+0000 7f24377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-27T03:10:45.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.748+0000 7f24377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-27T03:10:45.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.752+0000 7f256285a9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-08-27T03:10:45.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.752+0000 7f256285a9c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-08-27T03:10:45.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.752+0000 7f256285a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-08-27T03:10:45.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.752+0000 7f24377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300960 cookie 94152902846608 notifier 8081 bl.length()=185 2024-08-27T03:10:45.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.752+0000 7f24377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-08-27T03:10:45.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.752+0000 7f24377fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-08-27T03:10:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.760+0000 7f256285a9c0 10 cache put: name=default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB info.flags=0x7 2024-08-27T03:10:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.760+0000 7f256285a9c0 10 moving default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB to cache LRU end 2024-08-27T03:10:45.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.760+0000 7f256285a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:ITSHXKTCWFWMKSAICLFB, ofs0, ns] 2024-08-27T03:10:45.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.760+0000 7f24377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300900 cookie 94152902806160 notifier 8081 bl.length()=186 2024-08-27T03:10:45.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.760+0000 7f24377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB info.flags=0x7 2024-08-27T03:10:45.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.760+0000 7f24377fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ITSHXKTCWFWMKSAICLFB to cache LRU end 2024-08-27T03:10:45.763 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:45.763 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "bar.client.0", 2024-08-27T03:10:45.763 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr.bar.client.0", 2024-08-27T03:10:45.763 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "bar+test@test.test", 2024-08-27T03:10:45.763 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T03:10:45.763 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:45.763 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "bar.client.0", 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "ITSHXKTCWFWMKSAICLFB", 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "WAB1wZP1nfiPohe1myqJdh9Io4kIF0yxQT4Yg+iTguQ7h8HjiNUYxg==", 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:45.750654Z" 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T03:10:45.764 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:45.765 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "rgw", 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "", 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:45.750629Z", 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:45.766 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:45.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.764+0000 7f2416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:45.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.768+0000 7f256285a9c0 20 remove_watcher() i=0 2024-08-27T03:10:45.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.768+0000 7f256285a9c0 2 removed watcher, disabling cache 2024-08-27T03:10:45.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.772+0000 7f256285a9c0 20 remove_watcher() i=1 2024-08-27T03:10:45.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.772+0000 7f256285a9c0 20 remove_watcher() i=2 2024-08-27T03:10:45.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.776+0000 7f256285a9c0 20 remove_watcher() i=3 2024-08-27T03:10:45.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.776+0000 7f256285a9c0 20 remove_watcher() i=4 2024-08-27T03:10:45.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.780+0000 7f256285a9c0 20 remove_watcher() i=5 2024-08-27T03:10:45.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.780+0000 7f256285a9c0 20 remove_watcher() i=6 2024-08-27T03:10:45.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.780+0000 7f256285a9c0 20 remove_watcher() i=7 2024-08-27T03:10:45.801 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 9010103099 --totp-seed L4NT2A2XSDY6DPW4AJTYAUPEIZUBHAUO3VTA5ZUD3LGALCE7HGS2Q2EWNLVFUMNB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-27T03:10:45.847 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:45.847 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:45.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.884+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.884+0000 7fe8688c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.884+0000 7fe8688c69c0 20 realm 2024-08-27T03:10:45.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.884+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.884+0000 7fe8688c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.884+0000 7fe8688c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:45.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.884+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.888+0000 7fe8688c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.888+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.888+0000 7fe8688c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:45.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.888+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.888+0000 7fe8688c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:45.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.888+0000 7fe8688c69c0 20 searching for the correct realm 2024-08-27T03:10:45.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.896+0000 7fe865bcb640 0 -- 172.21.15.143:0/1193500719 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fe8600f7660 msgr2=0x7fe8600e9ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:45.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.900+0000 7fe865bcb640 0 -- 172.21.15.143:0/1193500719 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fe730081ea0 msgr2=0x7fe7300842d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:45.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:45.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:45.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 zone default found 2024-08-27T03:10:45.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 4 Realm: () 2024-08-27T03:10:45.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:45.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:45.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:45.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 zonegroup default 2024-08-27T03:10:45.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:45.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 started sync module instance, tier type = 2024-08-27T03:10:45.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.908+0000 7fe8688c69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:45.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=0 2024-08-27T03:10:45.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=1 2024-08-27T03:10:45.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=2 2024-08-27T03:10:45.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=3 2024-08-27T03:10:45.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=4 2024-08-27T03:10:45.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=5 2024-08-27T03:10:45.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=6 2024-08-27T03:10:45.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 20 add_watcher() i=7 2024-08-27T03:10:45.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.924+0000 7fe8688c69c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:45.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe71cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:45.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:45.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 5 note: GC not initialized 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe6977fe640 20 reqs_thread_entry: start 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 20 Filter name: none 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe6957fa640 20 reqs_thread_entry: start 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:45.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 20 rados_obj.operate() r=0 bl.length=460 2024-08-27T03:10:45.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-08-27T03:10:45.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-27T03:10:45.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.928+0000 7fe8688c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:45.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.936+0000 7fe8688c69c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-27T03:10:45.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.936+0000 7fe8688c69c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-27T03:10:45.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.936+0000 7fe8688c69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-08-27T03:10:45.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.936+0000 7fe749ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300866 cookie 94922754761744 notifier 8580 bl.length()=659 2024-08-27T03:10:45.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.936+0000 7fe749ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-08-27T03:10:45.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.936+0000 7fe749ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-08-27T03:10:45.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.940+0000 7fe71cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:45.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.944+0000 7fe8688c69c0 20 remove_watcher() i=0 2024-08-27T03:10:45.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.944+0000 7fe8688c69c0 2 removed watcher, disabling cache 2024-08-27T03:10:45.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.948+0000 7fe8688c69c0 20 remove_watcher() i=1 2024-08-27T03:10:45.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.948+0000 7fe8688c69c0 20 remove_watcher() i=2 2024-08-27T03:10:45.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.952+0000 7fe8688c69c0 20 remove_watcher() i=3 2024-08-27T03:10:45.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.952+0000 7fe8688c69c0 20 remove_watcher() i=4 2024-08-27T03:10:45.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.956+0000 7fe8688c69c0 20 remove_watcher() i=5 2024-08-27T03:10:45.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.956+0000 7fe8688c69c0 20 remove_watcher() i=6 2024-08-27T03:10:45.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:45.956+0000 7fe8688c69c0 20 remove_watcher() i=7 2024-08-27T03:10:45.973 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-08-27T03:10:46.058 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:46.058 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:46.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.096+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 realm 2024-08-27T03:10:46.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:46.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:46.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.100+0000 7f50833d39c0 20 searching for the correct realm 2024-08-27T03:10:46.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.108+0000 7f50806d8640 0 -- 172.21.15.143:0/4151973770 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x55f19e5839c0 msgr2=0x55f19e585e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.116+0000 7f5080ed9640 0 -- 172.21.15.143:0/4151973770 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f5068099300 msgr2=0x7f5068076020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.120+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 zone default found 2024-08-27T03:10:46.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 4 Realm: () 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 zonegroup default 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 started sync module instance, tier type = 2024-08-27T03:10:46.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.124+0000 7f50833d39c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:46.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=0 2024-08-27T03:10:46.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=1 2024-08-27T03:10:46.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=2 2024-08-27T03:10:46.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=3 2024-08-27T03:10:46.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=4 2024-08-27T03:10:46.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=5 2024-08-27T03:10:46.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=6 2024-08-27T03:10:46.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 20 add_watcher() i=7 2024-08-27T03:10:46.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.140+0000 7f50833d39c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f4f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 5 note: GC not initialized 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f4f367e4640 20 reqs_thread_entry: start 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 Filter name: none 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f4f2f7fe640 20 reqs_thread_entry: start 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-08-27T03:10:46.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-08-27T03:10:46.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-08-27T03:10:46.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-08-27T03:10:46.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-08-27T03:10:46.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-08-27T03:10:46.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-08-27T03:10:46.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.144+0000 7f50833d39c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-08-27T03:10:46.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.148+0000 7f50833d39c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-08-27T03:10:46.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.148+0000 7f50833d39c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-08-27T03:10:46.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.148+0000 7f50833d39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-08-27T03:10:46.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.148+0000 7f4f57fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300867 cookie 94496232076960 notifier 8117 bl.length()=389 2024-08-27T03:10:46.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.148+0000 7f4f57fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-08-27T03:10:46.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.148+0000 7f4f57fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-08-27T03:10:46.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.156+0000 7f50833d39c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-08-27T03:10:46.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.156+0000 7f50833d39c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-08-27T03:10:46.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.156+0000 7f50833d39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-08-27T03:10:46.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.156+0000 7f4f577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300901 cookie 94496232085536 notifier 8117 bl.length()=230 2024-08-27T03:10:46.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.156+0000 7f4f577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-08-27T03:10:46.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.156+0000 7f4f577fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-08-27T03:10:46.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.160+0000 7f50833d39c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-08-27T03:10:46.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.160+0000 7f50833d39c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-08-27T03:10:46.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.160+0000 7f50833d39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-08-27T03:10:46.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.160+0000 7f4f577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300845 cookie 94496232074464 notifier 8117 bl.length()=234 2024-08-27T03:10:46.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.160+0000 7f4f577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-08-27T03:10:46.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.160+0000 7f4f577fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-08-27T03:10:46.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.164+0000 7f4f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:46.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.168+0000 7f50833d39c0 20 remove_watcher() i=0 2024-08-27T03:10:46.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.168+0000 7f50833d39c0 2 removed watcher, disabling cache 2024-08-27T03:10:46.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.172+0000 7f50833d39c0 20 remove_watcher() i=1 2024-08-27T03:10:46.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.172+0000 7f50833d39c0 20 remove_watcher() i=2 2024-08-27T03:10:46.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.176+0000 7f50833d39c0 20 remove_watcher() i=3 2024-08-27T03:10:46.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.176+0000 7f50833d39c0 20 remove_watcher() i=4 2024-08-27T03:10:46.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.180+0000 7f50833d39c0 20 remove_watcher() i=5 2024-08-27T03:10:46.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.180+0000 7f50833d39c0 20 remove_watcher() i=6 2024-08-27T03:10:46.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.180+0000 7f50833d39c0 20 remove_watcher() i=7 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "id": "RGW33333333333333333", 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "tenant": "testx", 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "Mr.RGW33333333333333333", 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "RGW33333333333333333+test@test.test", 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "quota": { 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:46.197 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_users": 1000, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_roles": 1000, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_groups": 1000, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout: "max_access_keys": 4 2024-08-27T03:10:46.198 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:46.200 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-08-27T03:10:46.200 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key ATHDCKKGVTUPZQWSSJHC --secret lyoAavmyckRIldyQThrWGuHe1PcnkWxuCp72CPMWK0Zr7aiOxh0dkw== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-08-27T03:10:46.294 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:46.295 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:46.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.344+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.344+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.344+0000 7fd5ef9419c0 20 realm 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:46.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.348+0000 7fd5ef9419c0 20 searching for the correct realm 2024-08-27T03:10:46.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.368+0000 7fd5ecc46640 0 -- 172.21.15.143:0/4203131834 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fd5e80a9070 msgr2=0x7fd5e80fc120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.384+0000 7fd5edc48640 0 -- 172.21.15.143:0/4203131834 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fd5e407daa0 msgr2=0x7fd5e40030a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:46.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:46.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:46.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:46.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:46.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:46.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.388+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 zone default found 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 4 Realm: () 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 zonegroup default 2024-08-27T03:10:46.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 started sync module instance, tier type = 2024-08-27T03:10:46.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.392+0000 7fd5ef9419c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:46.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.408+0000 7fd5ef9419c0 20 add_watcher() i=0 2024-08-27T03:10:46.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.408+0000 7fd5ef9419c0 20 add_watcher() i=1 2024-08-27T03:10:46.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.408+0000 7fd5ef9419c0 20 add_watcher() i=2 2024-08-27T03:10:46.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.408+0000 7fd5ef9419c0 20 add_watcher() i=3 2024-08-27T03:10:46.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.408+0000 7fd5ef9419c0 20 add_watcher() i=4 2024-08-27T03:10:46.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.408+0000 7fd5ef9419c0 20 add_watcher() i=5 2024-08-27T03:10:46.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.408+0000 7fd5ef9419c0 20 add_watcher() i=6 2024-08-27T03:10:46.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.412+0000 7fd5ef9419c0 20 add_watcher() i=7 2024-08-27T03:10:46.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.412+0000 7fd5ef9419c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:46.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.412+0000 7fd4a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:46.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.412+0000 7fd5ef9419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:46.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.412+0000 7fd5ef9419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:46.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.412+0000 7fd5ef9419c0 5 note: GC not initialized 2024-08-27T03:10:46.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd4a27e4640 20 reqs_thread_entry: start 2024-08-27T03:10:46.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:46.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 Filter name: none 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd413fff640 20 reqs_thread_entry: start 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-08-27T03:10:46.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-08-27T03:10:46.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-08-27T03:10:46.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 cache get: name=default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC : miss 2024-08-27T03:10:46.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 cache put: name=default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC info.flags=0x0 2024-08-27T03:10:46.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 adding default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC to cache LRU end 2024-08-27T03:10:46.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-08-27T03:10:46.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.416+0000 7fd5ef9419c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 20 rados_obj.operate() r=0 bl.length=189 2024-08-27T03:10:46.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-08-27T03:10:46.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-08-27T03:10:46.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:46.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 cache get: name=default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC : hit (negative entry) 2024-08-27T03:10:46.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 cache get: name=default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC : hit (negative entry) 2024-08-27T03:10:46.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-27T03:10:46.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-27T03:10:46.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd5ef9419c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-08-27T03:10:46.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd4d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268257 cookie 94475098134368 notifier 8135 bl.length()=732 2024-08-27T03:10:46.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd4d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-27T03:10:46.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.420+0000 7fd4d0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-27T03:10:46.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.428+0000 7fd5ef9419c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-08-27T03:10:46.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.428+0000 7fd5ef9419c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-08-27T03:10:46.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.428+0000 7fd5ef9419c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-08-27T03:10:46.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.428+0000 7fd4bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268136 cookie 94475098131872 notifier 8135 bl.length()=215 2024-08-27T03:10:46.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.428+0000 7fd4bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-08-27T03:10:46.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.428+0000 7fd4bffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-08-27T03:10:46.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.436+0000 7fd5ef9419c0 10 cache put: name=default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC info.flags=0x7 2024-08-27T03:10:46.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.436+0000 7fd5ef9419c0 10 moving default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC to cache LRU end 2024-08-27T03:10:46.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.436+0000 7fd5ef9419c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:ATHDCKKGVTUPZQWSSJHC, ofs0, ns] 2024-08-27T03:10:46.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.436+0000 7fd4bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268164 cookie 94475098122832 notifier 8135 bl.length()=201 2024-08-27T03:10:46.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.436+0000 7fd4bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC info.flags=0x7 2024-08-27T03:10:46.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.436+0000 7fd4bffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ATHDCKKGVTUPZQWSSJHC to cache LRU end 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.444+0000 7fd5ef9419c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "testx$tenanteduser.client.0", 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr.RGW33333333333333333", 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "testx$tenanteduser+test@test.test", 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:46.444 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "testx$tenanteduser.client.0", 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "ATHDCKKGVTUPZQWSSJHC", 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "lyoAavmyckRIldyQThrWGuHe1PcnkWxuCp72CPMWK0Zr7aiOxh0dkw==", 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:46.424625Z" 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:46.445 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "root", 2024-08-27T03:10:46.446 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "RGW33333333333333333", 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:46.424603Z", 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:46.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.444+0000 7fd4a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:46.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.448+0000 7fd5ef9419c0 20 remove_watcher() i=0 2024-08-27T03:10:46.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.448+0000 7fd5ef9419c0 2 removed watcher, disabling cache 2024-08-27T03:10:46.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.452+0000 7fd5ef9419c0 20 remove_watcher() i=1 2024-08-27T03:10:46.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.452+0000 7fd5ef9419c0 20 remove_watcher() i=2 2024-08-27T03:10:46.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.456+0000 7fd5ef9419c0 20 remove_watcher() i=3 2024-08-27T03:10:46.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.456+0000 7fd5ef9419c0 20 remove_watcher() i=4 2024-08-27T03:10:46.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.460+0000 7fd5ef9419c0 20 remove_watcher() i=5 2024-08-27T03:10:46.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.460+0000 7fd5ef9419c0 20 remove_watcher() i=6 2024-08-27T03:10:46.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.460+0000 7fd5ef9419c0 20 remove_watcher() i=7 2024-08-27T03:10:46.479 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0277615036 --totp-seed V6BZD52UHP3U74LFASFE3V43YBJLRWDX4BCMDQPDIF5WUYF6OKTCEWZODXM7Y5CJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-27T03:10:46.527 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:46.527 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:46.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.564+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 realm 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:46.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.568+0000 7fba850e59c0 20 searching for the correct realm 2024-08-27T03:10:46.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.576+0000 7fba823ea640 0 -- 172.21.15.143:0/3093338555 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fba740018e0 msgr2=0x7fba740eb950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.580+0000 7fba833ec640 0 -- 172.21.15.143:0/3093338555 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fba7808f8b0 msgr2=0x7fba780600d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:46.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:46.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:46.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:46.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:46.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:46.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 zone default found 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 4 Realm: () 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 zonegroup default 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.588+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.592+0000 7fba850e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.592+0000 7fba850e59c0 20 started sync module instance, tier type = 2024-08-27T03:10:46.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.592+0000 7fba850e59c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:46.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.604+0000 7fba850e59c0 20 add_watcher() i=0 2024-08-27T03:10:46.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.604+0000 7fba850e59c0 20 add_watcher() i=1 2024-08-27T03:10:46.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.604+0000 7fba850e59c0 20 add_watcher() i=2 2024-08-27T03:10:46.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.604+0000 7fba850e59c0 20 add_watcher() i=3 2024-08-27T03:10:46.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.604+0000 7fba850e59c0 20 add_watcher() i=4 2024-08-27T03:10:46.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.604+0000 7fba850e59c0 20 add_watcher() i=5 2024-08-27T03:10:46.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.604+0000 7fba850e59c0 20 add_watcher() i=6 2024-08-27T03:10:46.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 20 add_watcher() i=7 2024-08-27T03:10:46.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fb9397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 5 note: GC not initialized 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fb8b3fff640 20 reqs_thread_entry: start 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 20 Filter name: none 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fb8b1ffb640 20 reqs_thread_entry: start 2024-08-27T03:10:46.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-08-27T03:10:46.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 20 rados_obj.operate() r=0 bl.length=532 2024-08-27T03:10:46.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-08-27T03:10:46.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-27T03:10:46.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.608+0000 7fba850e59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:46.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.612+0000 7fba850e59c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-27T03:10:46.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.612+0000 7fba850e59c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-27T03:10:46.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.612+0000 7fba850e59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-08-27T03:10:46.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.612+0000 7fb9667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268258 cookie 94660380196480 notifier 8153 bl.length()=746 2024-08-27T03:10:46.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.612+0000 7fb9667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-08-27T03:10:46.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.612+0000 7fb9667fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-08-27T03:10:46.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.616+0000 7fb9397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:46.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.620+0000 7fba850e59c0 20 remove_watcher() i=0 2024-08-27T03:10:46.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.620+0000 7fba850e59c0 2 removed watcher, disabling cache 2024-08-27T03:10:46.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.624+0000 7fba850e59c0 20 remove_watcher() i=1 2024-08-27T03:10:46.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.624+0000 7fba850e59c0 20 remove_watcher() i=2 2024-08-27T03:10:46.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.628+0000 7fba850e59c0 20 remove_watcher() i=3 2024-08-27T03:10:46.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.628+0000 7fba850e59c0 20 remove_watcher() i=4 2024-08-27T03:10:46.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.632+0000 7fba850e59c0 20 remove_watcher() i=5 2024-08-27T03:10:46.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.632+0000 7fba850e59c0 20 remove_watcher() i=6 2024-08-27T03:10:46.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.632+0000 7fba850e59c0 20 remove_watcher() i=7 2024-08-27T03:10:46.648 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-08-27T03:10:46.649 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key BSVOVWOCRVYNMBUFMYGT --secret lxqSAadN84iurRp9BGkaLPX3RDK5Zet0LtwvKbxkE2NoLgADXJ57jg== --cluster ceph 2024-08-27T03:10:46.687 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:46.687 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:46.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.724+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 realm 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:46.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.728+0000 7fd2f51289c0 20 searching for the correct realm 2024-08-27T03:10:46.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.736+0000 7fd2f342f640 0 -- 172.21.15.143:0/1827084069 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fd2e8076860 msgr2=0x7fd2e80647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.952+0000 7fd2f2c2e640 0 -- 172.21.15.143:0/1827084069 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x564ff1898190 msgr2=0x564ff189a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:46.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:46.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 zone default found 2024-08-27T03:10:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 4 Realm: () 2024-08-27T03:10:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:46.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 zonegroup default 2024-08-27T03:10:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.960+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.964+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.964+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.964+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.964+0000 7fd2f51289c0 20 started sync module instance, tier type = 2024-08-27T03:10:46.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.964+0000 7fd2f51289c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:46.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=0 2024-08-27T03:10:46.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=1 2024-08-27T03:10:46.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=2 2024-08-27T03:10:46.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=3 2024-08-27T03:10:46.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=4 2024-08-27T03:10:46.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=5 2024-08-27T03:10:46.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=6 2024-08-27T03:10:46.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 20 add_watcher() i=7 2024-08-27T03:10:46.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.988+0000 7fd2f51289c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:46.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd1a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:46.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:46.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:46.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 5 note: GC not initialized 2024-08-27T03:10:46.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd123fff640 20 reqs_thread_entry: start 2024-08-27T03:10:46.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:46.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 20 Filter name: none 2024-08-27T03:10:46.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd121ffb640 20 reqs_thread_entry: start 2024-08-27T03:10:46.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-08-27T03:10:46.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:46.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:46.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-08-27T03:10:46.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-08-27T03:10:47.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:46.996+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-08-27T03:10:47.000 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-08-27T03:10:47.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 cache get: name=default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT : miss 2024-08-27T03:10:47.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 cache put: name=default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT info.flags=0x0 2024-08-27T03:10:47.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 adding default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT to cache LRU end 2024-08-27T03:10:47.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 cache get: name=default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT : hit (negative entry) 2024-08-27T03:10:47.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 cache get: name=default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT : hit (negative entry) 2024-08-27T03:10:47.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-27T03:10:47.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd2f51289c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-08-27T03:10:47.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd1d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268137 cookie 94901354780288 notifier 8168 bl.length()=660 2024-08-27T03:10:47.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd1d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-27T03:10:47.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.000+0000 7fd1d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.008+0000 7fd2f51289c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-08-27T03:10:47.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.008+0000 7fd2f51289c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-08-27T03:10:47.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.008+0000 7fd2f51289c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-08-27T03:10:47.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.008+0000 7fd1d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268165 cookie 94901354761456 notifier 8168 bl.length()=191 2024-08-27T03:10:47.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.008+0000 7fd1d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-08-27T03:10:47.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.008+0000 7fd1d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-08-27T03:10:47.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.012+0000 7fd2f51289c0 10 cache put: name=default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT info.flags=0x7 2024-08-27T03:10:47.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.012+0000 7fd2f51289c0 10 moving default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT to cache LRU end 2024-08-27T03:10:47.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.012+0000 7fd2f51289c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:BSVOVWOCRVYNMBUFMYGT, ofs0, ns] 2024-08-27T03:10:47.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.012+0000 7fd1d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268166 cookie 94901354761456 notifier 8168 bl.length()=189 2024-08-27T03:10:47.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.012+0000 7fd1d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT info.flags=0x7 2024-08-27T03:10:47.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.012+0000 7fd1d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BSVOVWOCRVYNMBUFMYGT to cache LRU end 2024-08-27T03:10:47.017 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:47.017 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "foobar.client.0", 2024-08-27T03:10:47.017 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr.foobar.client.0", 2024-08-27T03:10:47.017 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "foobar+test@test.test", 2024-08-27T03:10:47.017 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "foobar.client.0", 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "BSVOVWOCRVYNMBUFMYGT", 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "lxqSAadN84iurRp9BGkaLPX3RDK5Zet0LtwvKbxkE2NoLgADXJ57jg==", 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:47.005494Z" 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T03:10:47.018 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:47.019 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "rgw", 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "", 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:47.005463Z", 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:47.020 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:47.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.016+0000 7fd1a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:47.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.020+0000 7fd2f51289c0 20 remove_watcher() i=0 2024-08-27T03:10:47.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.020+0000 7fd2f51289c0 2 removed watcher, disabling cache 2024-08-27T03:10:47.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.024+0000 7fd2f51289c0 20 remove_watcher() i=1 2024-08-27T03:10:47.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.028+0000 7fd2f51289c0 20 remove_watcher() i=2 2024-08-27T03:10:47.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.028+0000 7fd2f51289c0 20 remove_watcher() i=3 2024-08-27T03:10:47.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.032+0000 7fd2f51289c0 20 remove_watcher() i=4 2024-08-27T03:10:47.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.032+0000 7fd2f51289c0 20 remove_watcher() i=5 2024-08-27T03:10:47.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.036+0000 7fd2f51289c0 20 remove_watcher() i=6 2024-08-27T03:10:47.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.036+0000 7fd2f51289c0 20 remove_watcher() i=7 2024-08-27T03:10:47.053 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6034834365 --totp-seed XIDIOZ4Y3XNLHFRHQKK2Z6MF3ZPQ7CP64A4655U225Q7PZ5L7O7MIW6F7IWCJU4L --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-27T03:10:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:47.143 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:47.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.180+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 realm 2024-08-27T03:10:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:47.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:47.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.184+0000 7f21bdfe89c0 20 searching for the correct realm 2024-08-27T03:10:47.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.192+0000 7f21bc2ef640 0 -- 172.21.15.143:0/2003631175 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f21b0091040 msgr2=0x7f21b0098920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.408+0000 7f21bbaee640 0 -- 172.21.15.143:0/2003631175 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x55ece1713dd0 msgr2=0x55ece17161c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:47.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:47.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:47.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:47.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:47.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:47.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:47.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:47.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 zone default found 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 4 Realm: () 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 zonegroup default 2024-08-27T03:10:47.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.416+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.420+0000 7f21bdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.420+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.420+0000 7f21bdfe89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.420+0000 7f21bdfe89c0 20 started sync module instance, tier type = 2024-08-27T03:10:47.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.420+0000 7f21bdfe89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:47.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.440+0000 7f21bdfe89c0 20 add_watcher() i=0 2024-08-27T03:10:47.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.440+0000 7f21bdfe89c0 20 add_watcher() i=1 2024-08-27T03:10:47.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.440+0000 7f21bdfe89c0 20 add_watcher() i=2 2024-08-27T03:10:47.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.440+0000 7f21bdfe89c0 20 add_watcher() i=3 2024-08-27T03:10:47.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.440+0000 7f21bdfe89c0 20 add_watcher() i=4 2024-08-27T03:10:47.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.440+0000 7f21bdfe89c0 20 add_watcher() i=5 2024-08-27T03:10:47.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.440+0000 7f21bdfe89c0 20 add_watcher() i=6 2024-08-27T03:10:47.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.444+0000 7f21bdfe89c0 20 add_watcher() i=7 2024-08-27T03:10:47.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.444+0000 7f21bdfe89c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:47.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f2071fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:47.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:47.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:47.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 5 note: GC not initialized 2024-08-27T03:10:47.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f2070fe1640 20 reqs_thread_entry: start 2024-08-27T03:10:47.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:47.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 20 Filter name: none 2024-08-27T03:10:47.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f1fea7fc640 20 reqs_thread_entry: start 2024-08-27T03:10:47.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-08-27T03:10:47.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 20 rados_obj.operate() r=0 bl.length=472 2024-08-27T03:10:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-08-27T03:10:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.448+0000 7f21bdfe89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:47.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.456+0000 7f21bdfe89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-27T03:10:47.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.456+0000 7f21bdfe89c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.456+0000 7f21bdfe89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-08-27T03:10:47.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.456+0000 7f209affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268138 cookie 94475882991104 notifier 8670 bl.length()=674 2024-08-27T03:10:47.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.456+0000 7f209affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-27T03:10:47.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.456+0000 7f209affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.460+0000 7f2071fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:47.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.464+0000 7f21bdfe89c0 20 remove_watcher() i=0 2024-08-27T03:10:47.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.464+0000 7f21bdfe89c0 2 removed watcher, disabling cache 2024-08-27T03:10:47.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.464+0000 7f21bdfe89c0 20 remove_watcher() i=1 2024-08-27T03:10:47.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.468+0000 7f21bdfe89c0 20 remove_watcher() i=2 2024-08-27T03:10:47.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.472+0000 7f21bdfe89c0 20 remove_watcher() i=3 2024-08-27T03:10:47.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.472+0000 7f21bdfe89c0 20 remove_watcher() i=4 2024-08-27T03:10:47.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.480+0000 7f21bdfe89c0 20 remove_watcher() i=5 2024-08-27T03:10:47.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.480+0000 7f21bdfe89c0 20 remove_watcher() i=6 2024-08-27T03:10:47.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.480+0000 7f21bdfe89c0 20 remove_watcher() i=7 2024-08-27T03:10:47.493 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-08-27T03:10:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:47.525 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:47.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 realm 2024-08-27T03:10:47.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:47.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.564+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.568+0000 7fbf886b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:47.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.568+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.568+0000 7fbf886b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:47.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.568+0000 7fbf886b89c0 20 searching for the correct realm 2024-08-27T03:10:47.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.572+0000 7fbf859bd640 0 -- 172.21.15.143:0/2549588054 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55f5133aee60 msgr2=0x55f5133b12f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:47.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.580+0000 7fbf859bd640 0 -- 172.21.15.143:0/2549588054 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fbf780d0040 msgr2=0x7fbf780eb440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:47.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:47.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 zone default found 2024-08-27T03:10:47.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 4 Realm: () 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 zonegroup default 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 started sync module instance, tier type = 2024-08-27T03:10:47.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.588+0000 7fbf886b89c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:47.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.604+0000 7fbf886b89c0 20 add_watcher() i=0 2024-08-27T03:10:47.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.604+0000 7fbf886b89c0 20 add_watcher() i=1 2024-08-27T03:10:47.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.604+0000 7fbf886b89c0 20 add_watcher() i=2 2024-08-27T03:10:47.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.604+0000 7fbf886b89c0 20 add_watcher() i=3 2024-08-27T03:10:47.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.604+0000 7fbf886b89c0 20 add_watcher() i=4 2024-08-27T03:10:47.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.604+0000 7fbf886b89c0 20 add_watcher() i=5 2024-08-27T03:10:47.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.604+0000 7fbf886b89c0 20 add_watcher() i=6 2024-08-27T03:10:47.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 20 add_watcher() i=7 2024-08-27T03:10:47.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:47.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbe3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:47.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:47.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 5 note: GC not initialized 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbdb77fe640 20 reqs_thread_entry: start 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 20 Filter name: none 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbdb57fa640 20 reqs_thread_entry: start 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.608+0000 7fbf886b89c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbf886b89c0 20 rados_obj.operate() r=0 bl.length=486 2024-08-27T03:10:47.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbf886b89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-08-27T03:10:47.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbf886b89c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbf886b89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:47.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbf886b89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-27T03:10:47.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbf886b89c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbf886b89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-08-27T03:10:47.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbe69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268139 cookie 94511078038496 notifier 8688 bl.length()=727 2024-08-27T03:10:47.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbe69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-08-27T03:10:47.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.612+0000 7fbe69ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "foobar.client.0", 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr.foobar.client.0", 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "foobar+test@test.test", 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "foobar.client.0", 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "BSVOVWOCRVYNMBUFMYGT", 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "lxqSAadN84iurRp9BGkaLPX3RDK5Zet0LtwvKbxkE2NoLgADXJ57jg==", 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T03:10:47.616 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:47.005494Z" 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [ 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "oidc-provider", 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "perm": "*" 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "roles", 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "perm": "*" 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "user-policy", 2024-08-27T03:10:47.617 INFO:teuthology.orchestra.run.smithi143.stdout: "perm": "*" 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T03:10:47.618 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "rgw", 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [ 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "6034834365" 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "", 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:47.005463Z", 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T03:10:47.619 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T03:10:47.620 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:47.620 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:47.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.616+0000 7fbe3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:47.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.620+0000 7fbf886b89c0 20 remove_watcher() i=0 2024-08-27T03:10:47.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.620+0000 7fbf886b89c0 2 removed watcher, disabling cache 2024-08-27T03:10:47.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.620+0000 7fbf886b89c0 20 remove_watcher() i=1 2024-08-27T03:10:47.626 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.624+0000 7fbf886b89c0 20 remove_watcher() i=2 2024-08-27T03:10:47.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.628+0000 7fbf886b89c0 20 remove_watcher() i=3 2024-08-27T03:10:47.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.628+0000 7fbf886b89c0 20 remove_watcher() i=4 2024-08-27T03:10:47.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.628+0000 7fbf886b89c0 20 remove_watcher() i=5 2024-08-27T03:10:47.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.632+0000 7fbf886b89c0 20 remove_watcher() i=6 2024-08-27T03:10:47.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.632+0000 7fbf886b89c0 20 remove_watcher() i=7 2024-08-27T03:10:47.649 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-08-27T03:10:47.727 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:47.728 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:47.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 realm 2024-08-27T03:10:47.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:47.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:47.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.772+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.776+0000 7fe059cc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:47.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.776+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:47.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.776+0000 7fe059cc29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:47.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.776+0000 7fe059cc29c0 20 searching for the correct realm 2024-08-27T03:10:47.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.780+0000 7fe057fc9640 0 -- 172.21.15.143:0/2297472299 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7fe05001d060 msgr2=0x7fe050077960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:47.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:47.784+0000 7fe0577c8640 0 -- 172.21.15.143:0/2297472299 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fe050078e90 msgr2=0x7fe0500980c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:10:48.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:48.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:48.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:48.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:48.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:48.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:48.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.004+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:48.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 zone default found 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 4 Realm: () 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 zonegroup default 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 started sync module instance, tier type = 2024-08-27T03:10:48.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.008+0000 7fe059cc29c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:48.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.032+0000 7fe059cc29c0 20 add_watcher() i=0 2024-08-27T03:10:48.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.032+0000 7fe059cc29c0 20 add_watcher() i=1 2024-08-27T03:10:48.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.032+0000 7fe059cc29c0 20 add_watcher() i=2 2024-08-27T03:10:48.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.032+0000 7fe059cc29c0 20 add_watcher() i=3 2024-08-27T03:10:48.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.032+0000 7fe059cc29c0 20 add_watcher() i=4 2024-08-27T03:10:48.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.032+0000 7fe059cc29c0 20 add_watcher() i=5 2024-08-27T03:10:48.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.040+0000 7fe059cc29c0 20 add_watcher() i=6 2024-08-27T03:10:48.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.040+0000 7fe059cc29c0 20 add_watcher() i=7 2024-08-27T03:10:48.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.040+0000 7fe059cc29c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:48.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.040+0000 7fdf0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:48.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:48.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 5 note: GC not initialized 2024-08-27T03:10:48.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fde877fe640 20 reqs_thread_entry: start 2024-08-27T03:10:48.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:48.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 Filter name: none 2024-08-27T03:10:48.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fde857fa640 20 reqs_thread_entry: start 2024-08-27T03:10:48.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-08-27T03:10:48.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-08-27T03:10:48.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-08-27T03:10:48.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-08-27T03:10:48.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-08-27T03:10:48.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-08-27T03:10:48.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-08-27T03:10:48.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.044+0000 7fe059cc29c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-08-27T03:10:48.044 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.048+0000 7fe059cc29c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-08-27T03:10:48.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.048+0000 7fe059cc29c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-08-27T03:10:48.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.048+0000 7fe059cc29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-08-27T03:10:48.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.048+0000 7fdf39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268167 cookie 94648249049728 notifier 8709 bl.length()=384 2024-08-27T03:10:48.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.048+0000 7fdf39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-08-27T03:10:48.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.048+0000 7fdf39ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-08-27T03:10:48.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.052+0000 7fe059cc29c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-08-27T03:10:48.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.052+0000 7fe059cc29c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-08-27T03:10:48.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.052+0000 7fe059cc29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-08-27T03:10:48.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.056+0000 7fdf39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268198 cookie 94648249057072 notifier 8709 bl.length()=225 2024-08-27T03:10:48.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.056+0000 7fdf39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-08-27T03:10:48.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.056+0000 7fdf39ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-08-27T03:10:48.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.060+0000 7fe059cc29c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-08-27T03:10:48.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.060+0000 7fe059cc29c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-08-27T03:10:48.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.060+0000 7fe059cc29c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-08-27T03:10:48.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.060+0000 7fdf39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268142 cookie 94648249054800 notifier 8709 bl.length()=234 2024-08-27T03:10:48.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.060+0000 7fdf39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-08-27T03:10:48.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.060+0000 7fdf39ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-08-27T03:10:48.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.064+0000 7fdf0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.065 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.068+0000 7fe059cc29c0 20 remove_watcher() i=0 2024-08-27T03:10:48.065 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.068+0000 7fe059cc29c0 2 removed watcher, disabling cache 2024-08-27T03:10:48.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.072+0000 7fe059cc29c0 20 remove_watcher() i=1 2024-08-27T03:10:48.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.072+0000 7fe059cc29c0 20 remove_watcher() i=2 2024-08-27T03:10:48.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.076+0000 7fe059cc29c0 20 remove_watcher() i=3 2024-08-27T03:10:48.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.076+0000 7fe059cc29c0 20 remove_watcher() i=4 2024-08-27T03:10:48.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.080+0000 7fe059cc29c0 20 remove_watcher() i=5 2024-08-27T03:10:48.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.080+0000 7fe059cc29c0 20 remove_watcher() i=6 2024-08-27T03:10:48.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.080+0000 7fe059cc29c0 20 remove_watcher() i=7 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "id": "RGW88888888888888888", 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "tenant": "", 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "Mr.RGW88888888888888888", 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "RGW88888888888888888+test@test.test", 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "quota": { 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:48.092 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_users": 1000, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_roles": 1000, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_groups": 1000, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout: "max_access_keys": 4 2024-08-27T03:10:48.093 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:48.095 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-08-27T03:10:48.095 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key ACEIAYHCVPBKPLTVCHMQ --secret QP2a3GO6Qi+K6UJquYViHRYxQvW6ELK3LmBMmXSVtIpNUoAf/3O8zA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-08-27T03:10:48.182 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:48.182 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:48.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.224+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 realm 2024-08-27T03:10:48.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:48.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:48.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:48.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.228+0000 7f70080a59c0 20 searching for the correct realm 2024-08-27T03:10:48.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.236+0000 7f70053aa640 0 -- 172.21.15.143:0/3327819848 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x555e1f296380 msgr2=0x555e1f298840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:48.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.240+0000 7f7005bab640 0 -- 172.21.15.143:0/3327819848 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f6ffc0d68e0 msgr2=0x7f6ffc0d43e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:48.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:48.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:48.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:48.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:48.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:48.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:48.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.248+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 zone default found 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 4 Realm: () 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 zonegroup default 2024-08-27T03:10:48.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 started sync module instance, tier type = 2024-08-27T03:10:48.249 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.252+0000 7f70080a59c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:48.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=0 2024-08-27T03:10:48.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=1 2024-08-27T03:10:48.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=2 2024-08-27T03:10:48.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=3 2024-08-27T03:10:48.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=4 2024-08-27T03:10:48.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=5 2024-08-27T03:10:48.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=6 2024-08-27T03:10:48.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 20 add_watcher() i=7 2024-08-27T03:10:48.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.276+0000 7f70080a59c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f6ebbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 5 note: GC not initialized 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f6ebafe5640 20 reqs_thread_entry: start 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 Filter name: none 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f6eb8fe1640 20 reqs_thread_entry: start 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-08-27T03:10:48.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-08-27T03:10:48.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-27T03:10:48.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 cache get: name=default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ : miss 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 cache put: name=default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ info.flags=0x0 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 adding default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ to cache LRU end 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-08-27T03:10:48.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.280+0000 7f70080a59c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 20 rados_obj.operate() r=0 bl.length=184 2024-08-27T03:10:48.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-08-27T03:10:48.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-08-27T03:10:48.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:48.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 cache get: name=default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ : hit (negative entry) 2024-08-27T03:10:48.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 cache get: name=default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ : hit (negative entry) 2024-08-27T03:10:48.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-27T03:10:48.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-27T03:10:48.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f70080a59c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-08-27T03:10:48.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f6ee97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268168 cookie 93862738108144 notifier 8240 bl.length()=681 2024-08-27T03:10:48.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f6ee97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-27T03:10:48.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.284+0000 7f6ee97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-27T03:10:48.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.288+0000 7f70080a59c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-08-27T03:10:48.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.288+0000 7f70080a59c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-08-27T03:10:48.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.288+0000 7f70080a59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-08-27T03:10:48.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.288+0000 7f6ee8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268259 cookie 93862738119952 notifier 8240 bl.length()=189 2024-08-27T03:10:48.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.288+0000 7f6ee8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-08-27T03:10:48.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.288+0000 7f6ee8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-08-27T03:10:48.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.292+0000 7f70080a59c0 10 cache put: name=default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ info.flags=0x7 2024-08-27T03:10:48.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.292+0000 7f70080a59c0 10 moving default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ to cache LRU end 2024-08-27T03:10:48.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.292+0000 7f70080a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ACEIAYHCVPBKPLTVCHMQ, ofs0, ns] 2024-08-27T03:10:48.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.296+0000 7f6ee8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268199 cookie 93862738116112 notifier 8240 bl.length()=188 2024-08-27T03:10:48.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.296+0000 7f6ee8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ info.flags=0x7 2024-08-27T03:10:48.292 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.296+0000 7f6ee8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ACEIAYHCVPBKPLTVCHMQ to cache LRU end 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.300+0000 7f70080a59c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "root1.client.0", 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr.RGW88888888888888888", 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "root1+test@test.test", 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "root1.client.0", 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "ACEIAYHCVPBKPLTVCHMQ", 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "QP2a3GO6Qi+K6UJquYViHRYxQvW6ELK3LmBMmXSVtIpNUoAf/3O8zA==", 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:48.284414Z" 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T03:10:48.297 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:48.298 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "root", 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "RGW88888888888888888", 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:48.284396Z", 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:48.299 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:48.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.300+0000 7f6ebbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.308+0000 7f70080a59c0 20 remove_watcher() i=0 2024-08-27T03:10:48.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.308+0000 7f70080a59c0 2 removed watcher, disabling cache 2024-08-27T03:10:48.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.308+0000 7f70080a59c0 20 remove_watcher() i=1 2024-08-27T03:10:48.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.312+0000 7f70080a59c0 20 remove_watcher() i=2 2024-08-27T03:10:48.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.312+0000 7f70080a59c0 20 remove_watcher() i=3 2024-08-27T03:10:48.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.316+0000 7f70080a59c0 20 remove_watcher() i=4 2024-08-27T03:10:48.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.316+0000 7f70080a59c0 20 remove_watcher() i=5 2024-08-27T03:10:48.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.316+0000 7f70080a59c0 20 remove_watcher() i=6 2024-08-27T03:10:48.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.320+0000 7f70080a59c0 20 remove_watcher() i=7 2024-08-27T03:10:48.331 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0278095060 --totp-seed XEMVTCULNO6UDBS3LAFHGG6RIJJHMMLEFIFFSKMLSAQAEXE2XXMWL2N5X4I2T7DH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-27T03:10:48.372 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:48.372 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:48.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 realm 2024-08-27T03:10:48.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:48.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.416+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.420+0000 7faaebaff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:48.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.420+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.420+0000 7faaebaff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:48.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.420+0000 7faaebaff9c0 20 searching for the correct realm 2024-08-27T03:10:48.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.424+0000 7faae9605640 0 -- 172.21.15.143:0/2149832386 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x7faae4035040 msgr2=0x7faae401a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:48.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.428+0000 7faae9e06640 0 -- 172.21.15.143:0/2149832386 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7faad4021060 msgr2=0x7faad408a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:48.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.436+0000 7faaebaff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.436+0000 7faaebaff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.436+0000 7faaebaff9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.436+0000 7faaebaff9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.436+0000 7faaebaff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.436+0000 7faaebaff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.436+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 zone default found 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 4 Realm: () 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:48.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 zonegroup default 2024-08-27T03:10:48.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 started sync module instance, tier type = 2024-08-27T03:10:48.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.440+0000 7faaebaff9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:48.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=0 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=1 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=2 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=3 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=4 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=5 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=6 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 20 add_watcher() i=7 2024-08-27T03:10:48.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.460+0000 7faaebaff9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7fa99f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 5 note: GC not initialized 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7fa99e7e4640 20 reqs_thread_entry: start 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 20 Filter name: none 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7fa90ffff640 20 reqs_thread_entry: start 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-08-27T03:10:48.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 20 rados_obj.operate() r=0 bl.length=494 2024-08-27T03:10:48.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-08-27T03:10:48.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-27T03:10:48.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.464+0000 7faaebaff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.468+0000 7faaebaff9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-27T03:10:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.468+0000 7faaebaff9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-27T03:10:48.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.468+0000 7faaebaff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-08-27T03:10:48.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.468+0000 7fa9ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268169 cookie 94821106156160 notifier 8745 bl.length()=695 2024-08-27T03:10:48.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.468+0000 7fa9ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-08-27T03:10:48.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.468+0000 7fa9ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-08-27T03:10:48.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.472+0000 7fa99f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.476+0000 7faaebaff9c0 20 remove_watcher() i=0 2024-08-27T03:10:48.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.476+0000 7faaebaff9c0 2 removed watcher, disabling cache 2024-08-27T03:10:48.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.476+0000 7faaebaff9c0 20 remove_watcher() i=1 2024-08-27T03:10:48.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.480+0000 7faaebaff9c0 20 remove_watcher() i=2 2024-08-27T03:10:48.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.480+0000 7faaebaff9c0 20 remove_watcher() i=3 2024-08-27T03:10:48.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.484+0000 7faaebaff9c0 20 remove_watcher() i=4 2024-08-27T03:10:48.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.484+0000 7faaebaff9c0 20 remove_watcher() i=5 2024-08-27T03:10:48.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.484+0000 7faaebaff9c0 20 remove_watcher() i=6 2024-08-27T03:10:48.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.488+0000 7faaebaff9c0 20 remove_watcher() i=7 2024-08-27T03:10:48.500 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-08-27T03:10:48.577 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:48.577 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:48.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.620+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.620+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.620+0000 7fcc888e69c0 20 realm 2024-08-27T03:10:48.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.620+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:48.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:48.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:48.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.624+0000 7fcc888e69c0 20 searching for the correct realm 2024-08-27T03:10:48.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.632+0000 7fcc86bed640 0 -- 172.21.15.143:0/1930199108 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7fcc7c05a040 msgr2=0x7fcc7c05b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:48.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.848+0000 7fcc863ec640 0 -- 172.21.15.143:0/1930199108 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x56171cfc8160 msgr2=0x56171cfca550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 zone default found 2024-08-27T03:10:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 4 Realm: () 2024-08-27T03:10:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 zonegroup default 2024-08-27T03:10:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.856+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.860+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.860+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.860+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.860+0000 7fcc888e69c0 20 started sync module instance, tier type = 2024-08-27T03:10:48.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.860+0000 7fcc888e69c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=0 2024-08-27T03:10:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=1 2024-08-27T03:10:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=2 2024-08-27T03:10:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=3 2024-08-27T03:10:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=4 2024-08-27T03:10:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=5 2024-08-27T03:10:48.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=6 2024-08-27T03:10:48.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 20 add_watcher() i=7 2024-08-27T03:10:48.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.884+0000 7fcc888e69c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.888+0000 7fcb3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.888+0000 7fcc888e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:48.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.888+0000 7fcc888e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:48.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.888+0000 7fcc888e69c0 5 note: GC not initialized 2024-08-27T03:10:48.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.888+0000 7fcab77fe640 20 reqs_thread_entry: start 2024-08-27T03:10:48.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.888+0000 7fcc888e69c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:48.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.888+0000 7fcc888e69c0 20 Filter name: none 2024-08-27T03:10:48.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcab57fa640 20 reqs_thread_entry: start 2024-08-27T03:10:48.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-08-27T03:10:48.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-08-27T03:10:48.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-08-27T03:10:48.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-08-27T03:10:48.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-08-27T03:10:48.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:48.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:48.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-08-27T03:10:48.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-08-27T03:10:48.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.892+0000 7fcc888e69c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-08-27T03:10:48.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.896+0000 7fcc888e69c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-08-27T03:10:48.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.896+0000 7fcc888e69c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-08-27T03:10:48.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.896+0000 7fcc888e69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-08-27T03:10:48.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.896+0000 7fcb69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268170 cookie 94657270583088 notifier 8273 bl.length()=384 2024-08-27T03:10:48.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.896+0000 7fcb69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-08-27T03:10:48.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.896+0000 7fcb69ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-08-27T03:10:48.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.900+0000 7fcc888e69c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-08-27T03:10:48.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.900+0000 7fcc888e69c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-08-27T03:10:48.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.900+0000 7fcc888e69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-08-27T03:10:48.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.900+0000 7fcb69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268200 cookie 94657270591520 notifier 8273 bl.length()=225 2024-08-27T03:10:48.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.900+0000 7fcb69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-08-27T03:10:48.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.900+0000 7fcb69ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-08-27T03:10:48.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.908+0000 7fcc888e69c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-08-27T03:10:48.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.908+0000 7fcc888e69c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-08-27T03:10:48.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.908+0000 7fcc888e69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-08-27T03:10:48.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.908+0000 7fcb697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268143 cookie 94657270588816 notifier 8273 bl.length()=234 2024-08-27T03:10:48.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.908+0000 7fcb697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-08-27T03:10:48.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.908+0000 7fcb697fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-08-27T03:10:48.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.912+0000 7fcb3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:48.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.916+0000 7fcc888e69c0 20 remove_watcher() i=0 2024-08-27T03:10:48.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.916+0000 7fcc888e69c0 2 removed watcher, disabling cache 2024-08-27T03:10:48.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.916+0000 7fcc888e69c0 20 remove_watcher() i=1 2024-08-27T03:10:48.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.920+0000 7fcc888e69c0 20 remove_watcher() i=2 2024-08-27T03:10:48.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.924+0000 7fcc888e69c0 20 remove_watcher() i=3 2024-08-27T03:10:48.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.924+0000 7fcc888e69c0 20 remove_watcher() i=4 2024-08-27T03:10:48.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.924+0000 7fcc888e69c0 20 remove_watcher() i=5 2024-08-27T03:10:48.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.928+0000 7fcc888e69c0 20 remove_watcher() i=6 2024-08-27T03:10:48.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:48.928+0000 7fcc888e69c0 20 remove_watcher() i=7 2024-08-27T03:10:48.939 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:48.939 INFO:teuthology.orchestra.run.smithi143.stdout: "id": "RGW99999999999999999", 2024-08-27T03:10:48.939 INFO:teuthology.orchestra.run.smithi143.stdout: "tenant": "", 2024-08-27T03:10:48.939 INFO:teuthology.orchestra.run.smithi143.stdout: "name": "Mr.RGW99999999999999999", 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "RGW99999999999999999+test@test.test", 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "quota": { 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:48.940 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:48.941 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:48.941 INFO:teuthology.orchestra.run.smithi143.stdout: "max_users": 1000, 2024-08-27T03:10:48.941 INFO:teuthology.orchestra.run.smithi143.stdout: "max_roles": 1000, 2024-08-27T03:10:48.941 INFO:teuthology.orchestra.run.smithi143.stdout: "max_groups": 1000, 2024-08-27T03:10:48.941 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:48.941 INFO:teuthology.orchestra.run.smithi143.stdout: "max_access_keys": 4 2024-08-27T03:10:48.941 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:48.942 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-08-27T03:10:48.942 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key RXDCAYDYRWJVQEUMUVPS --secret SXN7uFkcGs3YnmpgNH99lzwBp8IAo2cJ0fS740FPV6OmJzd2dvHS1w== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-08-27T03:10:49.030 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:49.030 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:49.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.072+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 realm 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:49.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:49.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.076+0000 7fb4a87a99c0 20 searching for the correct realm 2024-08-27T03:10:49.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.084+0000 7fb4a6ab0640 0 -- 172.21.15.143:0/3175555485 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x563d4df018b0 msgr2=0x563d4df03d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:49.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.092+0000 7fb4a5aae640 0 -- 172.21.15.143:0/3175555485 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb4980ca070 msgr2=0x7fb4981257e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:49.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.096+0000 7fb4a87a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.096+0000 7fb4a87a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.096+0000 7fb4a87a99c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.096+0000 7fb4a87a99c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.096+0000 7fb4a87a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.096+0000 7fb4a87a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.096+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:49.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:49.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 zone default found 2024-08-27T03:10:49.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 4 Realm: () 2024-08-27T03:10:49.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:49.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:49.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:49.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 zonegroup default 2024-08-27T03:10:49.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 started sync module instance, tier type = 2024-08-27T03:10:49.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.100+0000 7fb4a87a99c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:49.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.116+0000 7fb4a87a99c0 20 add_watcher() i=0 2024-08-27T03:10:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.116+0000 7fb4a87a99c0 20 add_watcher() i=1 2024-08-27T03:10:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.116+0000 7fb4a87a99c0 20 add_watcher() i=2 2024-08-27T03:10:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.116+0000 7fb4a87a99c0 20 add_watcher() i=3 2024-08-27T03:10:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.116+0000 7fb4a87a99c0 20 add_watcher() i=4 2024-08-27T03:10:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.116+0000 7fb4a87a99c0 20 add_watcher() i=5 2024-08-27T03:10:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.116+0000 7fb4a87a99c0 20 add_watcher() i=6 2024-08-27T03:10:49.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 add_watcher() i=7 2024-08-27T03:10:49.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:49.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb35cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:49.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:49.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:49.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 5 note: GC not initialized 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb2d77fe640 20 reqs_thread_entry: start 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 Filter name: none 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb2d57fa640 20 reqs_thread_entry: start 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-08-27T03:10:49.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.120+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 cache get: name=default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS : miss 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 cache put: name=default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS info.flags=0x0 2024-08-27T03:10:49.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 adding default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS to cache LRU end 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 20 rados_obj.operate() r=0 bl.length=184 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 cache get: name=default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS : hit (negative entry) 2024-08-27T03:10:49.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.124+0000 7fb4a87a99c0 10 cache get: name=default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS : hit (negative entry) 2024-08-27T03:10:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.128+0000 7fb4a87a99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-27T03:10:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.128+0000 7fb4a87a99c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-27T03:10:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.128+0000 7fb4a87a99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-08-27T03:10:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.128+0000 7fb389ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268171 cookie 94821300580208 notifier 8285 bl.length()=681 2024-08-27T03:10:49.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.128+0000 7fb389ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-27T03:10:49.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.128+0000 7fb389ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-27T03:10:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.132+0000 7fb4a87a99c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-08-27T03:10:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.132+0000 7fb4a87a99c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-08-27T03:10:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.132+0000 7fb4a87a99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-08-27T03:10:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.132+0000 7fb3897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268260 cookie 94821300638608 notifier 8285 bl.length()=189 2024-08-27T03:10:49.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.132+0000 7fb3897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-08-27T03:10:49.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.132+0000 7fb3897fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-08-27T03:10:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.136+0000 7fb4a87a99c0 10 cache put: name=default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS info.flags=0x7 2024-08-27T03:10:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.136+0000 7fb4a87a99c0 10 moving default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS to cache LRU end 2024-08-27T03:10:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.136+0000 7fb4a87a99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:RXDCAYDYRWJVQEUMUVPS, ofs0, ns] 2024-08-27T03:10:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.136+0000 7fb3897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268201 cookie 94821300582416 notifier 8285 bl.length()=188 2024-08-27T03:10:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.136+0000 7fb3897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS info.flags=0x7 2024-08-27T03:10:49.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.136+0000 7fb3897fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RXDCAYDYRWJVQEUMUVPS to cache LRU end 2024-08-27T03:10:49.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.140+0000 7fb4a87a99c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-08-27T03:10:49.139 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:10:49.139 INFO:teuthology.orchestra.run.smithi143.stdout: "user_id": "root2.client.0", 2024-08-27T03:10:49.139 INFO:teuthology.orchestra.run.smithi143.stdout: "display_name": "Mr.RGW99999999999999999", 2024-08-27T03:10:49.139 INFO:teuthology.orchestra.run.smithi143.stdout: "email": "root2+test@test.test", 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "suspended": 0, 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "max_buckets": 1000, 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "subusers": [], 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "keys": [ 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "user": "root2.client.0", 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "access_key": "RXDCAYDYRWJVQEUMUVPS", 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "secret_key": "SXN7uFkcGs3YnmpgNH99lzwBp8IAo2cJ0fS740FPV6OmJzd2dvHS1w==", 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "active": true, 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:49.126092Z" 2024-08-27T03:10:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "swift_keys": [], 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": [], 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "op_mask": "read, write, delete", 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "default_placement": "", 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "default_storage_class": "", 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "placement_tags": [], 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "bucket_quota": { 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:49.141 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "user_quota": { 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "enabled": false, 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "check_on_raw": false, 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size": -1, 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "max_size_kb": 0, 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "max_objects": -1 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "temp_url_keys": [], 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "root", 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "mfa_ids": [], 2024-08-27T03:10:49.142 INFO:teuthology.orchestra.run.smithi143.stdout: "account_id": "RGW99999999999999999", 2024-08-27T03:10:49.143 INFO:teuthology.orchestra.run.smithi143.stdout: "path": "/", 2024-08-27T03:10:49.143 INFO:teuthology.orchestra.run.smithi143.stdout: "create_date": "2024-08-27T03:10:49.126077Z", 2024-08-27T03:10:49.143 INFO:teuthology.orchestra.run.smithi143.stdout: "tags": [], 2024-08-27T03:10:49.143 INFO:teuthology.orchestra.run.smithi143.stdout: "group_ids": [] 2024-08-27T03:10:49.143 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:10:49.143 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:10:49.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.144+0000 7fb35cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:49.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.148+0000 7fb4a87a99c0 20 remove_watcher() i=0 2024-08-27T03:10:49.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.148+0000 7fb4a87a99c0 2 removed watcher, disabling cache 2024-08-27T03:10:49.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.148+0000 7fb4a87a99c0 20 remove_watcher() i=1 2024-08-27T03:10:49.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.152+0000 7fb4a87a99c0 20 remove_watcher() i=2 2024-08-27T03:10:49.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.152+0000 7fb4a87a99c0 20 remove_watcher() i=3 2024-08-27T03:10:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.156+0000 7fb4a87a99c0 20 remove_watcher() i=4 2024-08-27T03:10:49.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.156+0000 7fb4a87a99c0 20 remove_watcher() i=5 2024-08-27T03:10:49.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.160+0000 7fb4a87a99c0 20 remove_watcher() i=6 2024-08-27T03:10:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.160+0000 7fb4a87a99c0 20 remove_watcher() i=7 2024-08-27T03:10:49.173 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 5197846478 --totp-seed X7ZCHWADE3UL76Q47PZ34HPYOOWSIUYZUPFIKB75L6KJFVGZLPJZA4KDTJK5ULS4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-08-27T03:10:49.214 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:10:49.214 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:10:49.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.256+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 realm 2024-08-27T03:10:49.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:10:49.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:49.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:10:49.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.260+0000 7fc637fb49c0 20 searching for the correct realm 2024-08-27T03:10:49.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.268+0000 7fc6352b9640 0 -- 172.21.15.143:0/2430737243 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x55a02578aa30 msgr2=0x55a02578cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:49.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.272+0000 7fc635aba640 0 -- 172.21.15.143:0/2430737243 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fc62c07a380 msgr2=0x7fc62c063410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:10:49.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:10:49.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:10:49.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:10:49.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:10:49.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:10:49.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:10:49.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.280+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:10:49.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 zone default found 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 4 Realm: () 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 zonegroup default 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:10:49.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 started sync module instance, tier type = 2024-08-27T03:10:49.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.284+0000 7fc637fb49c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:10:49.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=0 2024-08-27T03:10:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=1 2024-08-27T03:10:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=2 2024-08-27T03:10:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=3 2024-08-27T03:10:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=4 2024-08-27T03:10:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=5 2024-08-27T03:10:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=6 2024-08-27T03:10:49.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 20 add_watcher() i=7 2024-08-27T03:10:49.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.300+0000 7fc637fb49c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:10:49.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc4e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:49.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:10:49.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:10:49.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 5 note: GC not initialized 2024-08-27T03:10:49.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc4e67fc640 20 reqs_thread_entry: start 2024-08-27T03:10:49.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 20 init_complete bucket index max shards: 11 2024-08-27T03:10:49.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 20 Filter name: none 2024-08-27T03:10:49.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc457fff640 20 reqs_thread_entry: start 2024-08-27T03:10:49.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-08-27T03:10:49.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 20 rados->read ofs=0 len=0 2024-08-27T03:10:49.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 20 rados_obj.operate() r=0 bl.length=494 2024-08-27T03:10:49.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-08-27T03:10:49.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-27T03:10:49.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.304+0000 7fc637fb49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:10:49.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.308+0000 7fc637fb49c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-27T03:10:49.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.308+0000 7fc637fb49c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-27T03:10:49.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.308+0000 7fc637fb49c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-08-27T03:10:49.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.308+0000 7fc5197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268172 cookie 94146311844400 notifier 8802 bl.length()=695 2024-08-27T03:10:49.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.308+0000 7fc5197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-08-27T03:10:49.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.308+0000 7fc5197fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-08-27T03:10:49.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.312+0000 7fc4e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:10:49.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.316+0000 7fc637fb49c0 20 remove_watcher() i=0 2024-08-27T03:10:49.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.316+0000 7fc637fb49c0 2 removed watcher, disabling cache 2024-08-27T03:10:49.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.320+0000 7fc637fb49c0 20 remove_watcher() i=1 2024-08-27T03:10:49.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.320+0000 7fc637fb49c0 20 remove_watcher() i=2 2024-08-27T03:10:49.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.324+0000 7fc637fb49c0 20 remove_watcher() i=3 2024-08-27T03:10:49.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.324+0000 7fc637fb49c0 20 remove_watcher() i=4 2024-08-27T03:10:49.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.324+0000 7fc637fb49c0 20 remove_watcher() i=5 2024-08-27T03:10:49.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.328+0000 7fc637fb49c0 20 remove_watcher() i=6 2024-08-27T03:10:49.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:10:49.328+0000 7fc637fb49c0 20 remove_watcher() i=7 2024-08-27T03:10:49.340 INFO:tasks.s3tests:Configuring s3-tests... 2024-08-27T03:10:49.340 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T03:10:49.340 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-08-27T03:10:49.392 INFO:tasks.s3tests:Configuring boto... 2024-08-27T03:10:49.393 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T03:10:49.393 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-08-27T03:10:49.440 DEBUG:teuthology.orchestra.run.smithi143:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-08-27T03:10:49.618 INFO:teuthology.orchestra.run.smithi143.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-08-27T03:10:49.813 INFO:teuthology.orchestra.run.smithi143.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-08-27T03:10:50.093 INFO:teuthology.orchestra.run.smithi143.stdout:py installdeps: -rrequirements.txt 2024-08-27T03:12:47.371 INFO:teuthology.orchestra.run.smithi143.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-08-27T03:12:49.153 INFO:teuthology.orchestra.run.smithi143.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.7.4,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.15.4,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.2.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.2,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=e3c64dea28b1fba77eb862cfc6fd0537918b794a7bf1018d82620dbb863eefea,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.0,urllib3==1.26.19,virtualenv==20.26.3,zope.event==5.0,zope.interface==7.0.2 2024-08-27T03:12:49.154 INFO:teuthology.orchestra.run.smithi143.stdout:py run-test-pre: PYTHONHASHSEED='797235498' 2024-08-27T03:12:49.154 INFO:teuthology.orchestra.run.smithi143.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-08-27T03:12:49.339 INFO:teuthology.orchestra.run.smithi143.stdout:============================= test session starts ============================== 2024-08-27T03:12:49.339 INFO:teuthology.orchestra.run.smithi143.stdout:platform linux -- Python 3.10.6, pytest-8.3.2, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-08-27T03:12:49.339 INFO:teuthology.orchestra.run.smithi143.stdout:cachedir: .tox/py/.pytest_cache 2024-08-27T03:12:49.339 INFO:teuthology.orchestra.run.smithi143.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-08-27T03:12:49.339 INFO:teuthology.orchestra.run.smithi143.stdout:configfile: pytest.ini 2024-08-27T03:12:51.154 INFO:teuthology.orchestra.run.smithi143.stdout:collecting ... collected 869 items / 126 deselected / 743 selected 2024-08-27T03:12:51.154 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:12:52.012 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-08-27T03:12:52.722 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-08-27T03:12:53.583 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-08-27T03:12:54.442 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-08-27T03:12:55.161 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-08-27T03:12:55.962 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-08-27T03:12:56.962 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-08-27T03:12:57.648 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-08-27T03:12:57.815 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-08-27T03:12:57.977 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-08-27T03:12:58.715 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-08-27T03:12:59.455 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-08-27T03:13:00.148 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-08-27T03:13:00.863 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-08-27T03:13:01.036 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-08-27T03:13:01.209 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-08-27T03:13:01.321 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-08-27T03:13:01.432 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-08-27T03:13:01.542 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-08-27T03:13:01.654 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-08-27T03:13:01.767 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-08-27T03:13:01.879 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-08-27T03:13:01.990 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-08-27T03:13:02.103 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-08-27T03:13:02.213 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-08-27T03:13:02.325 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-08-27T03:13:02.436 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-08-27T03:13:02.549 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-08-27T03:13:02.659 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-08-27T03:13:02.773 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-08-27T03:13:02.884 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-08-27T03:13:02.996 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-08-27T03:13:03.108 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-08-27T03:13:03.221 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-08-27T03:13:03.335 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-08-27T03:13:03.451 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-08-27T03:13:03.562 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-08-27T03:13:03.673 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-08-27T03:13:03.783 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-08-27T03:13:03.898 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-08-27T03:13:04.027 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-08-27T03:13:04.138 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-08-27T03:13:04.250 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-08-27T03:13:04.364 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-08-27T03:13:04.475 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-08-27T03:13:04.587 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-08-27T03:13:04.700 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-08-27T03:13:04.811 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-08-27T03:13:04.923 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-08-27T03:13:05.037 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-08-27T03:13:05.149 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-08-27T03:13:05.260 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-08-27T03:13:05.410 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-08-27T03:13:06.712 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-08-27T03:13:12.286 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-08-27T03:13:19.153 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-08-27T03:13:28.418 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-08-27T03:13:41.715 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-08-27T03:13:45.214 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-08-27T03:13:50.249 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-08-27T03:13:51.864 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-08-27T03:13:52.545 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-08-27T03:13:53.451 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-08-27T03:13:54.411 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-08-27T03:13:56.004 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-08-27T03:13:57.034 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-08-27T03:13:57.686 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 9%] 2024-08-27T03:13:57.688 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-08-27T03:13:57.690 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-08-27T03:13:57.692 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-08-27T03:13:57.695 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-08-27T03:13:57.697 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-08-27T03:13:57.699 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-08-27T03:13:57.701 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-08-27T03:13:57.704 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-08-27T03:13:57.706 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-08-27T03:13:57.708 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-08-27T03:13:57.710 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-08-27T03:13:57.712 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-08-27T03:13:57.715 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-08-27T03:13:57.717 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-08-27T03:13:57.719 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-08-27T03:13:57.721 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-08-27T03:13:57.723 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-08-27T03:13:57.725 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-08-27T03:13:57.727 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-08-27T03:13:57.729 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-08-27T03:13:57.731 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-08-27T03:13:57.733 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-08-27T03:13:57.735 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-08-27T03:13:57.736 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-08-27T03:13:57.738 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-08-27T03:13:57.740 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-08-27T03:13:57.741 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-08-27T03:13:57.845 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-08-27T03:13:57.857 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-08-27T03:13:59.475 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-08-27T03:14:12.351 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-08-27T03:14:13.591 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-08-27T03:14:15.055 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-08-27T03:14:16.544 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-08-27T03:14:18.019 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-08-27T03:14:19.507 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-08-27T03:14:20.671 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-08-27T03:14:22.196 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-08-27T03:14:23.551 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-08-27T03:14:24.915 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-08-27T03:14:26.116 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-08-27T03:14:27.279 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-08-27T03:14:28.415 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-08-27T03:14:28.947 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-08-27T03:14:30.208 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-08-27T03:14:31.695 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-08-27T03:14:33.171 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-08-27T03:14:34.363 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-08-27T03:14:35.559 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-08-27T03:14:36.775 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-08-27T03:14:37.980 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-08-27T03:14:39.195 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 16%] 2024-08-27T03:14:40.323 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-08-27T03:14:41.463 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-08-27T03:14:42.019 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-08-27T03:14:42.615 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-08-27T03:14:43.196 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-08-27T03:14:43.759 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-08-27T03:14:44.315 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-08-27T03:14:45.419 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-08-27T03:14:46.007 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-08-27T03:14:46.679 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-08-27T03:14:47.643 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-08-27T03:14:48.544 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-08-27T03:14:49.135 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-08-27T03:14:50.059 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-08-27T03:14:50.983 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 18%] 2024-08-27T03:14:52.187 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-08-27T03:14:53.003 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-08-27T03:14:53.895 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-08-27T03:14:54.804 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-08-27T03:14:56.295 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-08-27T03:14:57.975 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-08-27T03:14:59.415 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-08-27T03:15:01.099 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-08-27T03:15:02.955 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-08-27T03:15:05.483 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-08-27T03:15:07.959 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-08-27T03:15:09.955 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-08-27T03:15:11.875 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-08-27T03:15:13.331 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-08-27T03:15:15.095 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 20%] 2024-08-27T03:15:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-08-27T03:15:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-08-27T03:15:20.212 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-08-27T03:15:22.147 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-08-27T03:15:25.972 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-08-27T03:15:30.923 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-08-27T03:15:33.787 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-08-27T03:15:36.396 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-08-27T03:15:38.424 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-08-27T03:15:39.783 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-08-27T03:15:42.172 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-08-27T03:15:43.804 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-08-27T03:15:46.052 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-08-27T03:15:47.580 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-08-27T03:15:50.492 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 22%] 2024-08-27T03:15:53.096 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-08-27T03:15:56.288 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-08-27T03:15:59.536 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-08-27T03:16:01.724 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-08-27T03:16:03.800 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-08-27T03:16:05.400 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-08-27T03:16:09.248 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 23%] 2024-08-27T03:16:12.136 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-08-27T03:16:15.344 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-08-27T03:16:18.312 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-08-27T03:16:21.248 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-08-27T03:16:24.176 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-08-27T03:16:26.792 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-08-27T03:16:28.505 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-08-27T03:16:30.452 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 24%] 2024-08-27T03:16:34.032 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-08-27T03:16:38.624 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-08-27T03:16:40.552 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-08-27T03:16:43.536 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-08-27T03:16:46.436 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-08-27T03:16:49.385 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-08-27T03:16:52.501 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 25%] 2024-08-27T03:16:55.776 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-08-27T03:16:58.856 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-08-27T03:17:01.722 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-08-27T03:17:03.692 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-08-27T03:17:06.789 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 25%] 2024-08-27T03:17:09.885 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 25%] 2024-08-27T03:17:12.993 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 25%] 2024-08-27T03:17:16.041 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-08-27T03:17:19.193 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-08-27T03:17:22.233 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-08-27T03:17:25.349 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-08-27T03:17:28.401 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-08-27T03:17:31.473 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 26%] 2024-08-27T03:17:34.589 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 26%] 2024-08-27T03:17:37.617 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-08-27T03:17:40.717 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-08-27T03:17:42.733 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-08-27T03:17:44.781 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-08-27T03:17:46.765 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-08-27T03:17:48.722 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 27%] 2024-08-27T03:17:50.248 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 27%] 2024-08-27T03:17:52.328 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 27%] 2024-08-27T03:17:54.196 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-08-27T03:17:56.008 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-08-27T03:17:57.904 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-08-27T03:17:59.796 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-08-27T03:18:01.621 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-08-27T03:18:03.472 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 28%] 2024-08-27T03:18:05.305 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 28%] 2024-08-27T03:18:07.980 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-08-27T03:18:10.712 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-08-27T03:18:12.164 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-08-27T03:18:13.653 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-08-27T03:18:15.488 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-08-27T03:18:17.324 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 29%] 2024-08-27T03:18:20.021 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 29%] 2024-08-27T03:18:22.733 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-08-27T03:18:24.600 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-08-27T03:18:26.428 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-08-27T03:18:28.272 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-08-27T03:18:30.108 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-08-27T03:18:32.000 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-08-27T03:18:33.856 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 30%] 2024-08-27T03:18:35.672 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 30%] 2024-08-27T03:18:37.492 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-08-27T03:18:39.360 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-08-27T03:18:41.196 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-08-27T03:18:43.020 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-08-27T03:18:44.944 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-08-27T03:18:46.696 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 31%] 2024-08-27T03:18:48.440 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 31%] 2024-08-27T03:18:50.148 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-08-27T03:18:51.981 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-08-27T03:18:53.832 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-08-27T03:21:05.130 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-08-27T03:21:06.841 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-08-27T03:21:08.509 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-08-27T03:21:10.309 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 32%] 2024-08-27T03:21:12.013 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 32%] 2024-08-27T03:21:13.697 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-08-27T03:21:15.421 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-08-27T03:21:17.157 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-08-27T03:21:18.847 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-08-27T03:21:20.593 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-08-27T03:21:22.341 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 33%] 2024-08-27T03:21:24.097 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 33%] 2024-08-27T03:21:25.841 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-08-27T03:21:27.686 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-08-27T03:21:29.494 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-08-27T03:21:31.370 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-08-27T03:21:33.177 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-08-27T03:21:35.089 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-08-27T03:21:36.913 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-08-27T03:21:38.753 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 34%] 2024-08-27T03:21:40.601 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-08-27T03:21:42.453 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-08-27T03:21:44.349 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-08-27T03:21:46.966 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-08-27T03:21:49.226 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-08-27T03:21:51.085 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 35%] 2024-08-27T03:21:52.921 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 35%] 2024-08-27T03:21:54.721 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-08-27T03:21:56.601 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-08-27T03:21:57.250 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-08-27T03:21:58.685 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-08-27T03:22:03.889 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-08-27T03:22:09.006 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-08-27T03:22:10.854 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 36%] 2024-08-27T03:22:12.682 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-08-27T03:22:14.554 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-08-27T03:22:16.461 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-08-27T03:22:18.422 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-08-27T03:22:20.437 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-08-27T03:22:22.298 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-08-27T03:22:24.153 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 37%] 2024-08-27T03:22:26.013 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 37%] 2024-08-27T03:22:27.882 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-08-27T03:22:29.670 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-08-27T03:22:31.570 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-08-27T03:22:33.830 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-08-27T03:22:36.726 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-08-27T03:22:38.010 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 38%] 2024-08-27T03:22:39.381 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 38%] 2024-08-27T03:22:40.598 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-08-27T03:22:41.746 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-08-27T03:22:42.334 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-08-27T03:22:42.910 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-08-27T03:22:43.494 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-08-27T03:22:44.986 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-08-27T03:22:49.562 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 39%] 2024-08-27T03:22:50.154 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 39%] 2024-08-27T03:22:51.630 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-08-27T03:22:52.810 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-08-27T03:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-08-27T03:22:55.266 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-08-27T03:23:00.298 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-08-27T03:23:02.362 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 40%] 2024-08-27T03:23:04.374 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 40%] 2024-08-27T03:25:15.587 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-08-27T03:27:26.903 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-08-27T03:27:28.310 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-08-27T03:27:29.711 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-08-27T03:27:31.130 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-08-27T03:27:32.567 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-08-27T03:27:34.322 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 41%] 2024-08-27T03:27:35.747 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 41%] 2024-08-27T03:27:37.195 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-08-27T03:27:38.859 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-08-27T03:27:40.518 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-08-27T03:27:41.978 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-08-27T03:27:43.498 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-08-27T03:27:45.087 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 42%] 2024-08-27T03:27:46.514 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 42%] 2024-08-27T03:27:47.714 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-08-27T03:27:49.114 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-08-27T03:27:50.442 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-08-27T03:27:52.447 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-08-27T03:27:53.902 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-08-27T03:27:55.314 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-08-27T03:27:56.659 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 43%] 2024-08-27T03:27:58.083 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-08-27T03:27:59.674 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-08-27T03:28:00.890 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-08-27T03:28:02.087 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-08-27T03:28:03.271 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-08-27T03:28:04.490 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-08-27T03:28:05.686 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 44%] 2024-08-27T03:28:06.902 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 44%] 2024-08-27T03:28:08.330 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-08-27T03:28:09.582 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-08-27T03:28:10.762 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-08-27T03:28:11.963 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-08-27T03:28:13.166 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-08-27T03:28:15.039 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-08-27T03:28:16.263 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 45%] 2024-08-27T03:28:17.427 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-08-27T03:28:18.702 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-08-27T03:28:19.947 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-08-27T03:28:21.151 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-08-27T03:28:22.354 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-08-27T03:28:23.603 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-08-27T03:28:25.711 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 46%] 2024-08-27T03:28:26.910 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 46%] 2024-08-27T03:28:28.399 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-08-27T03:28:29.914 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-08-27T03:28:31.434 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-08-27T03:28:32.910 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-08-27T03:28:34.418 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-08-27T03:28:36.950 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-08-27T03:28:38.415 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 47%] 2024-08-27T03:28:39.922 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-08-27T03:28:41.634 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-08-27T03:28:43.339 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-08-27T03:28:45.110 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-08-27T03:28:46.539 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-08-27T03:28:48.222 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-08-27T03:28:50.190 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 48%] 2024-08-27T03:28:51.678 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 48%] 2024-08-27T03:28:53.391 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-08-27T03:28:54.790 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-08-27T03:28:56.066 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-08-27T03:28:57.302 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-08-27T03:28:58.726 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-08-27T03:29:00.027 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 49%] 2024-08-27T03:29:00.606 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 49%] 2024-08-27T03:29:02.535 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-08-27T03:29:03.919 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-08-27T03:29:05.359 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-08-27T03:29:09.746 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-08-27T03:29:11.215 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-08-27T03:29:12.702 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-08-27T03:29:14.114 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 50%] 2024-08-27T03:29:15.566 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-08-27T03:29:16.866 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-08-27T03:29:18.294 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-08-27T03:29:19.766 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-08-27T03:29:21.262 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-08-27T03:29:22.631 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-08-27T03:29:24.011 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 51%] 2024-08-27T03:29:25.423 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 51%] 2024-08-27T03:29:26.875 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-08-27T03:29:28.331 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-08-27T03:29:29.711 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-08-27T03:29:31.151 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-08-27T03:29:32.546 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-08-27T03:29:33.923 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-08-27T03:29:34.507 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 52%] 2024-08-27T03:29:35.086 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-08-27T03:29:35.727 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-08-27T03:29:36.882 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-08-27T03:29:38.018 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-08-27T03:29:39.178 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-08-27T03:29:40.303 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-08-27T03:29:41.614 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 53%] 2024-08-27T03:29:42.202 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 53%] 2024-08-27T03:29:42.806 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-08-27T03:29:44.174 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-08-27T03:29:44.767 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-08-27T03:29:45.370 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-08-27T03:29:46.006 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-08-27T03:29:46.594 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-08-27T03:29:47.899 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 54%] 2024-08-27T03:29:49.166 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-08-27T03:29:50.358 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-08-27T03:29:51.734 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-08-27T03:29:52.966 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-08-27T03:29:54.191 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-08-27T03:29:55.418 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-08-27T03:29:56.846 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 55%] 2024-08-27T03:29:58.082 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 55%] 2024-08-27T03:29:59.311 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-08-27T03:30:00.810 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-08-27T03:30:02.278 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-08-27T03:30:03.954 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-08-27T03:30:05.486 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-08-27T03:30:06.990 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-08-27T03:30:08.631 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 56%] 2024-08-27T03:30:10.266 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-08-27T03:30:12.046 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-08-27T03:30:13.742 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-08-27T03:30:14.966 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-08-27T03:30:16.734 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-08-27T03:30:18.438 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-08-27T03:30:20.106 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 57%] 2024-08-27T03:30:21.794 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-08-27T03:30:23.443 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-08-27T03:30:25.382 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-08-27T03:30:27.114 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-08-27T03:30:28.818 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-08-27T03:30:30.599 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-08-27T03:30:32.278 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-08-27T03:30:33.566 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 58%] 2024-08-27T03:30:35.086 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-08-27T03:30:36.667 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-08-27T03:30:38.062 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-08-27T03:30:39.414 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-08-27T03:30:41.090 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-08-27T03:30:43.258 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-08-27T03:30:45.418 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 59%] 2024-08-27T03:30:47.582 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-08-27T03:30:49.831 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-08-27T03:30:52.022 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-08-27T03:30:54.202 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-08-27T03:30:56.438 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-08-27T03:30:58.626 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-08-27T03:31:00.810 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-08-27T03:31:03.210 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 60%] 2024-08-27T03:31:05.546 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-08-27T03:31:07.974 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-08-27T03:31:11.767 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-08-27T03:31:15.482 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-08-27T03:31:16.034 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-08-27T03:31:16.662 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-08-27T03:31:17.234 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 61%] 2024-08-27T03:31:18.506 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-08-27T03:31:19.778 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-08-27T03:31:20.918 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-08-27T03:31:22.114 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-08-27T03:31:24.030 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-08-27T03:31:29.375 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-08-27T03:31:31.458 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 62%] 2024-08-27T03:31:33.274 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 62%] 2024-08-27T03:31:38.442 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-08-27T03:31:40.146 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-08-27T03:31:42.102 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-08-27T03:31:43.663 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-08-27T03:31:45.322 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-08-27T03:31:48.178 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-08-27T03:31:50.722 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 63%] 2024-08-27T03:31:52.766 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-08-27T03:31:54.667 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-08-27T03:31:57.742 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-08-27T03:32:00.702 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-08-27T03:32:01.918 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-08-27T03:32:03.155 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-08-27T03:32:08.178 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 64%] 2024-08-27T03:32:10.159 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-08-27T03:32:23.738 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-08-27T03:32:25.034 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-08-27T03:32:26.822 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-08-27T03:32:31.014 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-08-27T03:32:32.678 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-08-27T03:32:35.630 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-08-27T03:32:46.810 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 65%] 2024-08-27T03:33:01.786 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-08-27T03:33:23.990 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-08-27T03:34:53.219 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-08-27T03:35:05.530 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-08-27T03:35:24.054 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-08-27T03:35:26.758 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-08-27T03:35:31.675 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 66%] 2024-08-27T03:35:35.990 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-08-27T03:35:39.234 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-08-27T03:35:40.686 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-08-27T03:35:45.418 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-08-27T03:35:47.203 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-08-27T03:35:48.798 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-08-27T03:35:50.326 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-08-27T03:36:11.930 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 67%] 2024-08-27T03:36:16.274 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-08-27T03:36:17.858 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-08-27T03:36:19.183 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-08-27T03:36:20.791 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-08-27T03:36:26.486 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-08-27T03:36:30.914 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-08-27T03:36:35.235 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 68%] 2024-08-27T03:36:36.754 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-08-27T03:36:38.266 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-08-27T03:36:39.839 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-08-27T03:36:41.370 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-08-27T03:36:42.882 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-08-27T03:36:44.442 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-08-27T03:36:45.994 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-08-27T03:36:48.242 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 69%] 2024-08-27T03:36:51.758 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-08-27T03:36:56.675 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-08-27T03:36:59.322 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-08-27T03:37:03.614 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-08-27T03:37:10.106 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-08-27T03:37:12.830 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-08-27T03:37:17.622 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 70%] 2024-08-27T03:37:25.386 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-08-27T03:37:27.822 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-08-27T03:37:29.614 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-08-27T03:37:32.070 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-08-27T03:37:33.574 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-08-27T03:37:40.590 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-08-27T03:37:42.082 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-08-27T03:37:43.522 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-08-27T03:37:45.026 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-08-27T03:37:46.474 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-08-27T03:37:48.350 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-08-27T03:38:12.054 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-08-27T03:38:15.122 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-08-27T03:38:17.098 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-08-27T03:38:19.494 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 72%] 2024-08-27T03:38:21.938 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-08-27T03:38:31.990 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-08-27T03:38:34.682 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-08-27T03:38:46.170 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-08-27T03:39:28.418 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-08-27T03:39:51.622 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-08-27T03:39:57.034 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-08-27T03:40:02.131 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-08-27T03:40:04.342 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-08-27T03:40:06.786 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-08-27T03:40:08.543 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-08-27T03:40:11.454 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-08-27T03:40:13.998 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-08-27T03:40:18.222 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-08-27T03:40:19.615 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 74%] 2024-08-27T03:40:21.030 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-08-27T03:40:22.370 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-08-27T03:40:23.582 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-08-27T03:40:24.926 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-08-27T03:40:26.338 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-08-27T03:40:27.594 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-08-27T03:40:28.826 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 75%] 2024-08-27T03:40:30.499 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-08-27T03:40:31.774 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-08-27T03:40:33.046 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-08-27T03:40:34.306 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-08-27T03:40:35.671 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-08-27T03:40:36.870 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-08-27T03:40:38.418 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-08-27T03:40:39.922 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 76%] 2024-08-27T03:40:41.834 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-08-27T03:40:43.318 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-08-27T03:40:44.882 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-08-27T03:40:46.390 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-08-27T03:40:47.838 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-08-27T03:40:49.126 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-08-27T03:40:50.510 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 77%] 2024-08-27T03:40:51.794 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-08-27T03:40:53.114 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-08-27T03:41:31.359 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-08-27T03:42:10.643 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-08-27T03:42:20.946 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-08-27T03:42:22.326 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-08-27T03:43:24.467 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-08-27T03:44:26.910 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-08-27T03:44:28.535 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-08-27T03:44:30.010 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-08-27T03:44:31.354 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-08-27T03:44:32.570 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-08-27T03:45:00.103 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-08-27T03:45:08.962 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-08-27T03:45:18.051 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 79%] 2024-08-27T03:45:19.490 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-08-27T03:45:20.987 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-08-27T03:45:22.454 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-08-27T03:45:24.410 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-08-27T03:45:25.903 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-08-27T03:45:27.382 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-08-27T03:45:29.011 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-08-27T03:45:30.562 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-08-27T03:45:32.334 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-08-27T03:45:34.167 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-08-27T03:45:35.715 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-08-27T03:45:37.263 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-08-27T03:45:40.019 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-08-27T03:45:42.654 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-08-27T03:45:45.430 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 81%] 2024-08-27T03:45:48.346 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-08-27T03:45:50.975 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-08-27T03:45:54.002 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-08-27T03:45:56.542 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-08-27T03:45:59.603 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-08-27T03:46:02.074 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-08-27T03:46:04.778 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-08-27T03:46:07.506 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-08-27T03:46:09.062 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-08-27T03:46:10.486 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-08-27T03:46:12.055 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-08-27T03:46:15.342 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-08-27T03:46:17.931 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-08-27T03:46:20.935 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-08-27T03:46:24.930 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 83%] 2024-08-27T03:46:46.794 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-08-27T03:46:49.070 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-08-27T03:46:51.606 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-08-27T03:46:54.134 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-08-27T03:46:57.422 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-08-27T03:47:00.314 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-08-27T03:47:01.918 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-08-27T03:47:04.575 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-08-27T03:47:05.870 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-08-27T03:47:07.066 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-08-27T03:47:08.258 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-08-27T03:47:09.447 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-08-27T03:47:11.077 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-08-27T03:47:12.370 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-08-27T03:47:14.818 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-08-27T03:47:16.278 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-08-27T03:47:17.538 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-08-27T03:47:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-08-27T03:47:20.014 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-08-27T03:47:21.270 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-08-27T03:47:22.610 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-08-27T03:47:23.882 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-08-27T03:47:25.087 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-08-27T03:47:26.378 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-08-27T03:47:27.630 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-08-27T03:47:29.562 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-08-27T03:47:31.102 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-08-27T03:47:32.798 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-08-27T03:47:34.458 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-08-27T03:47:36.139 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-08-27T03:47:37.834 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-08-27T03:47:39.854 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-08-27T03:47:41.658 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-08-27T03:47:43.410 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-08-27T03:47:45.078 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-08-27T03:47:46.875 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-08-27T03:47:48.514 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 88%] 2024-08-27T03:47:50.390 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-08-27T03:47:52.398 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-08-27T03:47:54.258 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-08-27T03:47:56.051 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-08-27T03:47:57.511 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-08-27T03:47:59.079 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-08-27T03:48:01.002 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-08-27T03:48:02.467 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-08-27T03:48:04.214 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-08-27T03:48:06.294 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-08-27T03:48:07.863 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-08-27T03:48:09.678 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-08-27T03:48:11.406 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-08-27T03:48:22.662 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-08-27T03:48:24.250 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 90%] 2024-08-27T03:48:35.026 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-08-27T03:48:36.727 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-08-27T03:48:38.366 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-08-27T03:48:39.582 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-08-27T03:48:40.926 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-08-27T03:48:42.322 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-08-27T03:48:43.698 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-08-27T03:48:45.130 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-08-27T03:48:46.511 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-08-27T03:48:47.722 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-08-27T03:48:49.046 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-08-27T03:48:50.590 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-08-27T03:48:51.974 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-08-27T03:48:53.586 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-08-27T03:48:55.078 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-08-27T03:48:56.470 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-08-27T03:48:57.871 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-08-27T03:48:59.778 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-08-27T03:49:10.278 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-08-27T03:49:11.518 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-08-27T03:49:12.959 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-08-27T03:49:14.451 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-08-27T03:49:15.958 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-08-27T03:49:18.366 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-08-27T03:49:19.958 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-08-27T03:49:22.727 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-08-27T03:49:28.926 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-08-27T03:49:30.935 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-08-27T03:49:43.882 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-08-27T03:49:55.127 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-08-27T03:49:56.327 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-08-27T03:49:58.011 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-08-27T03:50:14.243 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-08-27T03:50:39.075 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-08-27T03:50:43.843 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-08-27T03:50:46.739 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-08-27T03:50:49.571 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-08-27T03:50:55.199 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-08-27T03:50:56.343 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-08-27T03:51:01.395 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-08-27T03:51:07.143 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-08-27T03:52:59.891 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-08-27T03:53:04.035 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-08-27T03:53:10.167 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-08-27T03:53:15.231 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-08-27T03:53:16.471 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-08-27T03:53:23.811 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-08-27T03:53:28.027 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-08-27T03:53:29.623 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-08-27T03:53:31.419 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-08-27T03:53:39.491 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-08-27T03:53:44.123 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-08-27T03:53:49.839 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-08-27T03:53:52.367 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-08-27T03:53:52.871 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-08-27T03:53:57.667 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-08-27T03:54:02.595 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-08-27T03:54:05.587 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-08-27T03:54:14.839 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-08-27T03:54:16.751 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-08-27T03:56:37.804 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-08-27T03:56:38.323 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-08-27T03:56:40.191 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-08-27T03:56:41.583 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-08-27T03:56:43.295 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-08-27T03:56:45.308 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-08-27T03:56:45.453 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout:=============================== warnings summary =============================== 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: import imp 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py:120 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: if boto_type is 'S3Connection': 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_headers.py:124 2024-08-27T03:56:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: elif boto_type is 'HTTPRequest': 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3.py:359 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py:176 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: if k is 'BucketName': 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py:253 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-08-27T03:56:45.455 INFO:teuthology.orchestra.run.smithi143.stdout: @pytest.mark.timeout(10) 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests/functional/test_s3_website.py:1077 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: @pytest.mark.s3website_routing_rules 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.456 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.457 INFO:teuthology.orchestra.run.smithi143.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-08-27T03:56:45.458 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: ["starts-with", "$key", "\$foo"],\ 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-08-27T03:56:45.459 INFO:teuthology.orchestra.run.smithi143.stdout:= 677 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 2636.11s (0:43:56) = 2024-08-27T03:56:45.647 INFO:teuthology.orchestra.run.smithi143.stdout:___________________________________ summary ____________________________________ 2024-08-27T03:56:45.647 INFO:teuthology.orchestra.run.smithi143.stdout: py: commands succeeded 2024-08-27T03:56:45.647 INFO:teuthology.orchestra.run.smithi143.stdout: congratulations :) 2024-08-27T03:56:45.685 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-08-27T03:56:45.686 DEBUG:teuthology.orchestra.run.smithi143:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-08-27T03:56:45.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T03:56:45.787 INFO:tasks.s3tests:Cleaning up boto... 2024-08-27T03:56:45.787 DEBUG:teuthology.orchestra.run.smithi143:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-08-27T03:56:45.792 INFO:tasks.s3tests:Removing s3-tests... 2024-08-27T03:56:45.792 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-08-27T03:56:45.979 INFO:teuthology.run_tasks:Running task workunit... 2024-08-27T03:56:45.991 INFO:tasks.workunit:Pulling workunits from ref d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T03:56:45.992 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-27T03:56:45.992 DEBUG:teuthology.orchestra.run.smithi143:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-27T03:56:45.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T03:56:45.998 INFO:teuthology.orchestra.run.smithi143.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-08-27T03:56:45.998 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T03:56:46.044 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-08-27T03:56:46.045 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-08-27T03:56:46.093 INFO:tasks.workunit:timeout=3h 2024-08-27T03:56:46.093 INFO:tasks.workunit:cleanup=True 2024-08-27T03:56:46.093 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d17b22856a85d7d49d47be692c778d4419f41641 2024-08-27T03:56:46.142 INFO:tasks.workunit.client.0.smithi143.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-27T03:57:43.040 INFO:tasks.workunit.client.0.smithi143.stderr:Note: switching to 'd17b22856a85d7d49d47be692c778d4419f41641'. 2024-08-27T03:57:43.040 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:43.040 INFO:tasks.workunit.client.0.smithi143.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr:state without impacting any branches by switching back to a branch. 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: git switch -c 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr:Or undo this operation with: 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: git switch - 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-27T03:57:43.041 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:43.042 INFO:tasks.workunit.client.0.smithi143.stderr:HEAD is now at d17b22856a8 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-08-27T03:57:43.046 DEBUG:teuthology.orchestra.run.smithi143:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-27T03:57:43.093 INFO:tasks.workunit.client.0.smithi143.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-27T03:57:43.096 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T03:57:43.096 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-27T03:57:43.152 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-27T03:57:43.206 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-27T03:57:43.249 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-27T03:57:43.250 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T03:57:43.251 INFO:tasks.workunit.client.0.smithi143.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-27T03:57:43.295 INFO:tasks.workunit.client.0.smithi143.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-27T03:57:43.298 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-08-27T03:57:43.298 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-27T03:57:43.345 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-08-27T03:57:43.346 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-08-27T03:57:43.346 DEBUG:teuthology.orchestra.run.smithi143:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d17b22856a85d7d49d47be692c778d4419f41641 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-08-27T03:57:43.396 INFO:tasks.workunit.client.0.smithi143.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-08-27T03:57:43.397 INFO:tasks.workunit.client.0.smithi143.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T03:57:43.397 INFO:tasks.workunit.client.0.smithi143.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T03:57:46.263 INFO:tasks.workunit.client.0.smithi143.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-08-27T03:57:46.263 INFO:tasks.workunit.client.0.smithi143.stderr:++ deactivate nondestructive 2024-08-27T03:57:46.263 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T03:57:46.263 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T03:57:46.263 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T03:57:46.263 INFO:tasks.workunit.client.0.smithi143.stderr:++ hash -r 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ unset VIRTUAL_ENV 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ export VIRTUAL_ENV 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ export PATH 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n '' ']' 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -z '' ']' 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ _OLD_VIRTUAL_PS1= 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ PS1='(rgw) ' 2024-08-27T03:57:46.264 INFO:tasks.workunit.client.0.smithi143.stderr:++ export PS1 2024-08-27T03:57:46.265 INFO:tasks.workunit.client.0.smithi143.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-08-27T03:57:46.265 INFO:tasks.workunit.client.0.smithi143.stderr:++ export VIRTUAL_ENV_PROMPT 2024-08-27T03:57:46.265 INFO:tasks.workunit.client.0.smithi143.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T03:57:46.265 INFO:tasks.workunit.client.0.smithi143.stderr:++ hash -r 2024-08-27T03:57:46.265 INFO:tasks.workunit.client.0.smithi143.stderr:+ pip install pip --upgrade 2024-08-27T03:57:46.624 INFO:tasks.workunit.client.0.smithi143.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-08-27T03:57:46.815 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting pip 2024-08-27T03:57:46.821 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-08-27T03:57:46.855 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: pip 2024-08-27T03:57:46.855 INFO:tasks.workunit.client.0.smithi143.stdout: Attempting uninstall: pip 2024-08-27T03:57:46.856 INFO:tasks.workunit.client.0.smithi143.stdout: Found existing installation: pip 22.0.2 2024-08-27T03:57:47.114 INFO:tasks.workunit.client.0.smithi143.stdout: Uninstalling pip-22.0.2: 2024-08-27T03:57:47.120 INFO:tasks.workunit.client.0.smithi143.stdout: Successfully uninstalled pip-22.0.2 2024-08-27T03:57:47.855 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed pip-24.2 2024-08-27T03:57:47.915 INFO:tasks.workunit.client.0.smithi143.stderr:+ pip install boto3 2024-08-27T03:57:48.887 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting boto3 2024-08-27T03:57:48.889 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached boto3-1.35.6-py3-none-any.whl.metadata (6.6 kB) 2024-08-27T03:57:49.451 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting botocore<1.36.0,>=1.35.6 (from boto3) 2024-08-27T03:57:49.452 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached botocore-1.35.6-py3-none-any.whl.metadata (5.7 kB) 2024-08-27T03:57:49.504 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-08-27T03:57:49.505 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-08-27T03:57:49.561 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-08-27T03:57:49.563 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-08-27T03:57:49.617 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T03:57:49.617 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-08-27T03:57:49.721 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T03:57:49.723 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-08-27T03:57:49.966 INFO:tasks.workunit.client.0.smithi143.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.6->boto3) 2024-08-27T03:57:49.967 INFO:tasks.workunit.client.0.smithi143.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-08-27T03:57:49.970 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached boto3-1.35.6-py3-none-any.whl (139 kB) 2024-08-27T03:57:49.972 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached botocore-1.35.6-py3-none-any.whl (12.5 MB) 2024-08-27T03:57:49.981 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-08-27T03:57:49.982 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-08-27T03:57:49.984 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-08-27T03:57:49.985 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-08-27T03:57:49.986 INFO:tasks.workunit.client.0.smithi143.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-08-27T03:57:50.056 INFO:tasks.workunit.client.0.smithi143.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-08-27T03:57:51.153 INFO:tasks.workunit.client.0.smithi143.stdout:Successfully installed boto3-1.35.6 botocore-1.35.6 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-08-27T03:57:51.333 INFO:tasks.workunit.client.0.smithi143.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-08-27T03:57:51.467 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-08-27T03:57:51.507 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:57:51.507 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:57:51.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 realm 2024-08-27T03:57:51.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:57:51.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.544+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.548+0000 7fb12c7d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:57:51.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.548+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.548+0000 7fb12c7d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:57:51.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.548+0000 7fb12c7d19c0 20 searching for the correct realm 2024-08-27T03:57:51.560 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.556+0000 7fb129ad6640 0 -- 172.21.15.143:0/1033495827 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7fb11c0df930 msgr2=0x7fb11c0b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:51.566 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.560+0000 7fb129ad6640 0 -- 172.21.15.143:0/1033495827 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7faff4081ea0 msgr2=0x7faff40842d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:51.572 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:57:51.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:57:51.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 zone default found 2024-08-27T03:57:51.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 4 Realm: () 2024-08-27T03:57:51.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:57:51.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:57:51.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:57:51.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 zonegroup default 2024-08-27T03:57:51.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 started sync module instance, tier type = 2024-08-27T03:57:51.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.568+0000 7fb12c7d19c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=0 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=1 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=2 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=3 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=4 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=5 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=6 2024-08-27T03:57:51.591 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 20 add_watcher() i=7 2024-08-27T03:57:51.592 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.584+0000 7fb12c7d19c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fafe0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 5 note: GC not initialized 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7faf5b7fe640 20 reqs_thread_entry: start 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 init_complete bucket index max shards: 11 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 Filter name: none 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7faf597fa640 20 reqs_thread_entry: start 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-08-27T03:57:51.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-08-27T03:57:51.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-08-27T03:57:51.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-08-27T03:57:51.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:51.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:51.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-08-27T03:57:51.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-08-27T03:57:51.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-08-27T03:57:51.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.588+0000 7fb12c7d19c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-08-27T03:57:51.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.592+0000 7fb12c7d19c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-08-27T03:57:51.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.592+0000 7fb12c7d19c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-08-27T03:57:51.599 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.592+0000 7fb12c7d19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-08-27T03:57:51.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.592+0000 7fb00dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269363 cookie 94884510450912 notifier 8820 bl.length()=613 2024-08-27T03:57:51.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.592+0000 7fb00dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-08-27T03:57:51.600 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.592+0000 7fb00dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-08-27T03:57:51.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.596+0000 7fb12c7d19c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-08-27T03:57:51.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.596+0000 7fb12c7d19c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-08-27T03:57:51.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.596+0000 7fb12c7d19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-08-27T03:57:51.603 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.596+0000 7fb00dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269479 cookie 94884510458864 notifier 8820 bl.length()=191 2024-08-27T03:57:51.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.596+0000 7fb00dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-08-27T03:57:51.604 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.596+0000 7fb00dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-08-27T03:57:51.605 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.600+0000 7fafe0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:57:51.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.604+0000 7fb12c7d19c0 20 remove_watcher() i=0 2024-08-27T03:57:51.610 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.604+0000 7fb12c7d19c0 2 removed watcher, disabling cache 2024-08-27T03:57:51.612 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.608+0000 7fb12c7d19c0 20 remove_watcher() i=1 2024-08-27T03:57:51.614 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.608+0000 7fb12c7d19c0 20 remove_watcher() i=2 2024-08-27T03:57:51.616 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.612+0000 7fb12c7d19c0 20 remove_watcher() i=3 2024-08-27T03:57:51.618 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.612+0000 7fb12c7d19c0 20 remove_watcher() i=4 2024-08-27T03:57:51.619 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.612+0000 7fb12c7d19c0 20 remove_watcher() i=5 2024-08-27T03:57:51.620 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.616+0000 7fb12c7d19c0 20 remove_watcher() i=6 2024-08-27T03:57:51.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:51.616+0000 7fb12c7d19c0 20 remove_watcher() i=7 2024-08-27T03:57:52.048 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-08-27T03:57:52.049 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:52.420 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-08-27T03:57:52.453 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:57:52.453 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:57:52.498 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.492+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 realm 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:52.501 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:57:52.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:57:52.503 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.496+0000 7ff186b4a9c0 20 searching for the correct realm 2024-08-27T03:57:52.510 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.504+0000 7ff183e4f640 0 -- 172.21.15.143:0/1579890320 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff1740fac20 msgr2=0x7ff1740fb3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:52.516 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.512+0000 7ff183e4f640 0 -- 172.21.15.143:0/1579890320 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7ff04c081ea0 msgr2=0x7ff04c0842d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.516+0000 7ff186b4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.516+0000 7ff186b4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.516+0000 7ff186b4a9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.516+0000 7ff186b4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.516+0000 7ff186b4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.516+0000 7ff186b4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.516+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:52.524 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:57:52.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:57:52.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 zone default found 2024-08-27T03:57:52.525 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 4 Realm: () 2024-08-27T03:57:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:57:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:57:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:57:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 zonegroup default 2024-08-27T03:57:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:52.526 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:52.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:52.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 started sync module instance, tier type = 2024-08-27T03:57:52.527 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.520+0000 7ff186b4a9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=0 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=1 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=2 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=3 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=4 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=5 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=6 2024-08-27T03:57:52.542 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 20 add_watcher() i=7 2024-08-27T03:57:52.543 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.536+0000 7ff186b4a9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:57:52.545 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff03afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:57:52.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:57:52.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:57:52.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 5 note: GC not initialized 2024-08-27T03:57:52.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff039fdb640 20 reqs_thread_entry: start 2024-08-27T03:57:52.546 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:57:52.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 20 Filter name: none 2024-08-27T03:57:52.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7fefab7fe640 20 reqs_thread_entry: start 2024-08-27T03:57:52.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 20 rados_obj.operate() r=0 bl.length=209 2024-08-27T03:57:52.547 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.540+0000 7ff186b4a9c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:52.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 rados_obj.operate() r=0 bl.length=431 2024-08-27T03:57:52.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T03:57:52.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T03:57:52.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: starting shard=0 2024-08-27T03:57:52.548 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.0 2024-08-27T03:57:52.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: starting shard=1 2024-08-27T03:57:52.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.1 2024-08-27T03:57:52.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: starting shard=2 2024-08-27T03:57:52.549 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.2 2024-08-27T03:57:52.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: starting shard=3 2024-08-27T03:57:52.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.3 2024-08-27T03:57:52.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: starting shard=4 2024-08-27T03:57:52.550 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.4 2024-08-27T03:57:52.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 INFO: main: starting shard=5 2024-08-27T03:57:52.551 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.544+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.5 2024-08-27T03:57:52.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.552 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: starting shard=6 2024-08-27T03:57:52.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.6 2024-08-27T03:57:52.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: starting shard=7 2024-08-27T03:57:52.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.7 2024-08-27T03:57:52.553 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: starting shard=8 2024-08-27T03:57:52.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.8 2024-08-27T03:57:52.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: starting shard=9 2024-08-27T03:57:52.554 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.9 2024-08-27T03:57:52.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: starting shard=10 2024-08-27T03:57:52.555 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.10 2024-08-27T03:57:52.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:52.556 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.548+0000 7ff186b4a9c0 20 INFO: main: done 2024-08-27T03:57:52.557 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.552+0000 7ff03afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:57:52.564 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.560+0000 7ff186b4a9c0 20 remove_watcher() i=0 2024-08-27T03:57:52.565 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.560+0000 7ff186b4a9c0 2 removed watcher, disabling cache 2024-08-27T03:57:52.567 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.560+0000 7ff186b4a9c0 20 remove_watcher() i=1 2024-08-27T03:57:52.569 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.564+0000 7ff186b4a9c0 20 remove_watcher() i=2 2024-08-27T03:57:52.570 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.564+0000 7ff186b4a9c0 20 remove_watcher() i=3 2024-08-27T03:57:52.573 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.568+0000 7ff186b4a9c0 20 remove_watcher() i=4 2024-08-27T03:57:52.574 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.568+0000 7ff186b4a9c0 20 remove_watcher() i=5 2024-08-27T03:57:52.575 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.568+0000 7ff186b4a9c0 20 remove_watcher() i=6 2024-08-27T03:57:52.576 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.572+0000 7ff186b4a9c0 20 remove_watcher() i=7 2024-08-27T03:57:52.591 INFO:tasks.workunit.client.0.smithi143.stderr:rados -p default.rgw.buckets.data ls | grep 7f0ac25e-1ce6-420d-bfc2-848e66e08e7c 2024-08-27T03:57:52.614 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:57:52.614 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:57:52.763 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:52.756+0000 7f058739b640 0 -- 172.21.15.143:0/2358869333 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x7f057c0c0020 msgr2=0x7f057c0f8780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:52.793 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-08-27T03:57:52.793 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:52.794 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-27T03:57:54.358 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-27T03:57:54.801 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-08-27T03:57:54.830 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:57:54.830 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:57:54.872 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:54.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 realm 2024-08-27T03:57:54.874 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:54.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:57:54.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:54.875 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.868+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.872+0000 7f64864519c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:57:54.876 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.872+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.872+0000 7f64864519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:57:54.877 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.872+0000 7f64864519c0 20 searching for the correct realm 2024-08-27T03:57:54.880 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.876+0000 7f6483f57640 0 -- 172.21.15.143:0/4248128187 >> [v2:172.21.15.143:6800/2368617930,v1:172.21.15.143:6801/2368617930] conn(0x562165d3e780 msgr2=0x7f647c0f81a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:54.886 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.880+0000 7f6484758640 0 -- 172.21.15.143:0/4248128187 >> [v2:172.21.15.181:6816/1853453285,v1:172.21.15.181:6817/1853453285] conn(0x7f6478018070 msgr2=0x7f6478033980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:54.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:57:54.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:57:54.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:57:54.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:57:54.895 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:57:54.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:57:54.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:54.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.888+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.896 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 zone default found 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 4 Realm: () 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 zonegroup default 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:54.897 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:54.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:57:54.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 started sync module instance, tier type = 2024-08-27T03:57:54.898 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.892+0000 7f64864519c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:57:54.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=0 2024-08-27T03:57:54.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=1 2024-08-27T03:57:54.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=2 2024-08-27T03:57:54.912 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=3 2024-08-27T03:57:54.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=4 2024-08-27T03:57:54.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=5 2024-08-27T03:57:54.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=6 2024-08-27T03:57:54.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 20 add_watcher() i=7 2024-08-27T03:57:54.913 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f64864519c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:57:54.915 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.908+0000 7f6339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 5 note: GC not initialized 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f6338fe1640 20 reqs_thread_entry: start 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 init_complete bucket index max shards: 11 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 Filter name: none 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f62b27fc640 20 reqs_thread_entry: start 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 rados_obj.operate() r=0 bl.length=209 2024-08-27T03:57:54.917 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 rados->read ofs=0 len=0 2024-08-27T03:57:54.918 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 rados_obj.operate() r=0 bl.length=431 2024-08-27T03:57:54.918 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: starting shard=0 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.0 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: starting shard=1 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.1 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: starting shard=2 2024-08-27T03:57:54.919 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.2 2024-08-27T03:57:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: starting shard=3 2024-08-27T03:57:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.3 2024-08-27T03:57:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 INFO: main: starting shard=4 2024-08-27T03:57:54.920 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.912+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.4 2024-08-27T03:57:54.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: starting shard=5 2024-08-27T03:57:54.921 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.5 2024-08-27T03:57:54.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: starting shard=6 2024-08-27T03:57:54.922 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.6 2024-08-27T03:57:54.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: starting shard=7 2024-08-27T03:57:54.923 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.7 2024-08-27T03:57:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: starting shard=8 2024-08-27T03:57:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.8 2024-08-27T03:57:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 INFO: main: starting shard=9 2024-08-27T03:57:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.916+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.9 2024-08-27T03:57:54.924 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.920+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.920+0000 7f64864519c0 20 INFO: main: starting shard=10 2024-08-27T03:57:54.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.920+0000 7f64864519c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.10 2024-08-27T03:57:54.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.920+0000 7f64864519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-08-27T03:57:54.925 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.920+0000 7f64864519c0 20 INFO: main: done 2024-08-27T03:57:54.926 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.920+0000 7f6339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:57:54.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.924+0000 7f64864519c0 20 remove_watcher() i=0 2024-08-27T03:57:54.931 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.924+0000 7f64864519c0 2 removed watcher, disabling cache 2024-08-27T03:57:54.932 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.928+0000 7f64864519c0 20 remove_watcher() i=1 2024-08-27T03:57:54.934 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.928+0000 7f64864519c0 20 remove_watcher() i=2 2024-08-27T03:57:54.936 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.932+0000 7f64864519c0 20 remove_watcher() i=3 2024-08-27T03:57:54.938 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.932+0000 7f64864519c0 20 remove_watcher() i=4 2024-08-27T03:57:54.939 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.932+0000 7f64864519c0 20 remove_watcher() i=5 2024-08-27T03:57:54.940 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.932+0000 7f64864519c0 20 remove_watcher() i=6 2024-08-27T03:57:54.941 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:54.936+0000 7f64864519c0 20 remove_watcher() i=7 2024-08-27T03:57:54.952 INFO:tasks.workunit.client.0.smithi143.stderr:rados -p default.rgw.buckets.data ls | grep 1a46a1e9-a6c2-4597-8e0d-05fecb46e7f2 2024-08-27T03:57:54.972 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:57:54.972 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:57:55.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:57:55.352+0000 7ff1f5687640 0 -- 172.21.15.143:0/736170365 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x7ff1e801c6c0 msgr2=0x7ff1e801cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:57:55.385 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-08-27T03:57:55.385 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:55.638 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-08-27T03:57:57.285 INFO:tasks.workunit.client.0.smithi143.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-08-27T03:57:57.285 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-08-27T03:57:57.836 INFO:tasks.workunit.client.0.smithi143.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-08-27T03:57:57.836 INFO:tasks.workunit.client.0.smithi143.stderr: 2024-08-27T03:57:58.221 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-08-27T03:58:01.847 INFO:tasks.workunit.client.0.smithi143.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-08-27T03:58:02.289 INFO:tasks.workunit.client.0.smithi143.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-08-27T03:58:02.317 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:58:02.317 INFO:tasks.workunit.client.0.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:58:02.358 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:02.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 realm 2024-08-27T03:58:02.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.359 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:02.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:58:02.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:02.360 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.352+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.356+0000 7f5461a2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:58:02.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.356+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.361 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.356+0000 7f5461a2c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:58:02.362 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.356+0000 7f5461a2c9c0 20 searching for the correct realm 2024-08-27T03:58:02.368 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.364+0000 7f545fd33640 0 -- 172.21.15.143:0/3534842656 >> [v2:172.21.15.181:6808/3659401645,v1:172.21.15.181:6809/3659401645] conn(0x7f54540b6ba0 msgr2=0x7f54540ea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:02.587 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.580+0000 7f545f532640 0 -- 172.21.15.143:0/3534842656 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x5624d1aff730 msgr2=0x5624d1b01b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:02.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:58:02.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:58:02.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:58:02.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:58:02.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:58:02.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:58:02.594 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:02.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:58:02.595 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 zone default found 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 4 Realm: () 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 zonegroup default 2024-08-27T03:58:02.596 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.588+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.592+0000 7f5461a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:02.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.592+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.592+0000 7f5461a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:02.597 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.592+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.592+0000 7f5461a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:02.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.592+0000 7f5461a2c9c0 20 started sync module instance, tier type = 2024-08-27T03:58:02.598 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.592+0000 7f5461a2c9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:58:02.621 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.616+0000 7f5461a2c9c0 20 add_watcher() i=0 2024-08-27T03:58:02.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.616+0000 7f5461a2c9c0 20 add_watcher() i=1 2024-08-27T03:58:02.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.616+0000 7f5461a2c9c0 20 add_watcher() i=2 2024-08-27T03:58:02.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.616+0000 7f5461a2c9c0 20 add_watcher() i=3 2024-08-27T03:58:02.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.616+0000 7f5461a2c9c0 20 add_watcher() i=4 2024-08-27T03:58:02.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.616+0000 7f5461a2c9c0 20 add_watcher() i=5 2024-08-27T03:58:02.622 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.616+0000 7f5461a2c9c0 20 add_watcher() i=6 2024-08-27T03:58:02.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.620+0000 7f5461a2c9c0 20 add_watcher() i=7 2024-08-27T03:58:02.626 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.620+0000 7f5461a2c9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:58:02.630 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.624+0000 7f5315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:58:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.624+0000 7f5461a2c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:58:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.624+0000 7f5461a2c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:58:02.631 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.624+0000 7f5461a2c9c0 5 note: GC not initialized 2024-08-27T03:58:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.624+0000 7f5314fe1640 20 reqs_thread_entry: start 2024-08-27T03:58:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:58:02.632 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 Filter name: none 2024-08-27T03:58:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f528e7fc640 20 reqs_thread_entry: start 2024-08-27T03:58:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-08-27T03:58:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 rados_obj.operate() r=0 bl.length=209 2024-08-27T03:58:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-08-27T03:58:02.633 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-08-27T03:58:02.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776 : miss 2024-08-27T03:58:02.634 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 rados_obj.operate() r=0 bl.length=431 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776 info.flags=0x17 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776 to cache LRU end 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.0 2024-08-27T03:58:02.635 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-08-27T03:58:02.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.628+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.1 2024-08-27T03:58:02.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-08-27T03:58:02.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.2 2024-08-27T03:58:02.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-08-27T03:58:02.636 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.3 2024-08-27T03:58:02.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-08-27T03:58:02.637 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.4 2024-08-27T03:58:02.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-08-27T03:58:02.638 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.632+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.5 2024-08-27T03:58:02.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-08-27T03:58:02.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.6 2024-08-27T03:58:02.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-08-27T03:58:02.640 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.7 2024-08-27T03:58:02.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-08-27T03:58:02.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.8 2024-08-27T03:58:02.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-08-27T03:58:02.641 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.9 2024-08-27T03:58:02.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-08-27T03:58:02.642 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 20 bucket index object: :.dir.3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776.10 2024-08-27T03:58:02.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-08-27T03:58:02.643 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.636+0000 7f5461a2c9c0 1 NOTICE: finished all shards (0 entries found) 2024-08-27T03:58:02.645 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.640+0000 7f5315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:58:02.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.644+0000 7f5461a2c9c0 20 remove_watcher() i=0 2024-08-27T03:58:02.650 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.644+0000 7f5461a2c9c0 2 removed watcher, disabling cache 2024-08-27T03:58:02.652 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.648+0000 7f5461a2c9c0 20 remove_watcher() i=1 2024-08-27T03:58:02.654 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.648+0000 7f5461a2c9c0 20 remove_watcher() i=2 2024-08-27T03:58:02.657 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.652+0000 7f5461a2c9c0 20 remove_watcher() i=3 2024-08-27T03:58:02.659 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.652+0000 7f5461a2c9c0 20 remove_watcher() i=4 2024-08-27T03:58:02.661 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.656+0000 7f5461a2c9c0 20 remove_watcher() i=5 2024-08-27T03:58:02.662 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.656+0000 7f5461a2c9c0 20 remove_watcher() i=6 2024-08-27T03:58:02.664 INFO:tasks.workunit.client.0.smithi143.stderr:2024-08-27T03:58:02.656+0000 7f5461a2c9c0 20 remove_watcher() i=7 2024-08-27T03:58:02.678 INFO:tasks.workunit.client.0.smithi143.stderr:Deleting bucket versioning-bucket 2024-08-27T03:58:03.030 INFO:tasks.workunit.client.0.smithi143.stderr:Completed bucket versioning tests 2024-08-27T03:58:03.030 INFO:tasks.workunit.client.0.smithi143.stdout:connected to http://localhost:80 2024-08-27T03:58:03.120 INFO:tasks.workunit.client.0.smithi143.stderr:+ deactivate 2024-08-27T03:58:03.120 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ export PATH 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset _OLD_VIRTUAL_PATH 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n '' ']' 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ hash -r 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' -n '' ']' 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset VIRTUAL_ENV 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ '[' '!' '' = nondestructive ']' 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ unset -f deactivate 2024-08-27T03:58:03.121 INFO:tasks.workunit.client.0.smithi143.stderr:+ echo OK. 2024-08-27T03:58:03.123 INFO:tasks.workunit.client.0.smithi143.stdout:OK. 2024-08-27T03:58:03.123 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-27T03:58:03.124 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-27T03:58:03.177 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-08-27T03:58:03.177 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-27T03:58:03.573 DEBUG:teuthology.parallel:result is None 2024-08-27T03:58:03.574 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T03:58:03.587 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T03:58:03.587 DEBUG:teuthology.orchestra.run.smithi143:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-08-27T03:58:03.632 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-08-27T03:58:03.632 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-08-27T03:58:03.642 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-08-27T03:58:03.657 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-08-27T03:58:03.657 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-08-27T03:58:03.657 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-08-27T03:58:03.724 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-08-27T03:58:03.724 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-08-27T03:58:03.759 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:58:03.760 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:58:03.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.792+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 realm 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:03.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:58:03.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.796+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.800+0000 7fdec587c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:58:03.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.800+0000 7fdec587c9c0 20 searching for the correct realm 2024-08-27T03:58:03.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.804+0000 7fdec3b83640 0 -- 172.21.15.143:0/224132883 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x5585837b8300 msgr2=0x5585837ba790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:03.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.808+0000 7fdec3382640 0 -- 172.21.15.143:0/224132883 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7fdeac068d30 msgr2=0x7fdeac066ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:03.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.816+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:58:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:58:03.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 zone default found 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 4 Realm: () 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 zonegroup default 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:03.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:03.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:03.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 started sync module instance, tier type = 2024-08-27T03:58:03.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.820+0000 7fdec587c9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:58:03.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=0 2024-08-27T03:58:03.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=1 2024-08-27T03:58:03.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=2 2024-08-27T03:58:03.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=3 2024-08-27T03:58:03.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=4 2024-08-27T03:58:03.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=5 2024-08-27T03:58:03.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=6 2024-08-27T03:58:03.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 20 add_watcher() i=7 2024-08-27T03:58:03.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.836+0000 7fdec587c9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:58:03.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.840+0000 7fdd79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:58:03.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.840+0000 7fdec587c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:58:03.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.840+0000 7fdec587c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:58:03.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdd78fe1640 20 reqs_thread_entry: start 2024-08-27T03:58:03.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:58:03.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 20 Filter name: none 2024-08-27T03:58:03.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdcf27fc640 20 reqs_thread_entry: start 2024-08-27T03:58:03.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-08-27T03:58:03.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:03.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 20 rados_obj.operate() r=0 bl.length=482 2024-08-27T03:58:03.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-08-27T03:58:03.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-08-27T03:58:03.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.920+0000 7fdec587c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-08-27T03:58:03.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.924+0000 7fdec587c9c0 10 removing key index: KORXJBLEPLOEUUILJZSJ 2024-08-27T03:58:03.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.924+0000 7fdec587c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:KORXJBLEPLOEUUILJZSJ, ofs0, ns] 2024-08-27T03:58:03.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.924+0000 7fdda6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268179 cookie 94031924926976 notifier 8946 bl.length()=170 2024-08-27T03:58:03.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.928+0000 7fdec587c9c0 10 removing email index: tester.client.0_test@test.test 2024-08-27T03:58:03.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.928+0000 7fdec587c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-08-27T03:58:03.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.928+0000 7fdda67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268195 cookie 94031924978864 notifier 8946 bl.length()=181 2024-08-27T03:58:03.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.932+0000 7fdec587c9c0 10 removing user buckets index 2024-08-27T03:58:03.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.932+0000 7fdec587c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-08-27T03:58:03.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.932+0000 7fdda67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269364 cookie 94031924987920 notifier 8946 bl.length()=172 2024-08-27T03:58:03.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.936+0000 7fdec587c9c0 10 removing user index: tester.client.0 2024-08-27T03:58:03.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.936+0000 7fdec587c9c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-08-27T03:58:03.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.936+0000 7fdec587c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-08-27T03:58:03.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.940+0000 7fdda67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269482 cookie 94031924982128 notifier 8946 bl.length()=164 2024-08-27T03:58:03.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.940+0000 7fdd79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:58:03.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.948+0000 7fdec587c9c0 20 remove_watcher() i=0 2024-08-27T03:58:03.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.948+0000 7fdec587c9c0 2 removed watcher, disabling cache 2024-08-27T03:58:03.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.948+0000 7fdec587c9c0 20 remove_watcher() i=1 2024-08-27T03:58:03.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.952+0000 7fdec587c9c0 20 remove_watcher() i=2 2024-08-27T03:58:03.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.952+0000 7fdec587c9c0 20 remove_watcher() i=3 2024-08-27T03:58:03.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.956+0000 7fdec587c9c0 20 remove_watcher() i=4 2024-08-27T03:58:03.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.956+0000 7fdec587c9c0 20 remove_watcher() i=5 2024-08-27T03:58:03.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.956+0000 7fdec587c9c0 20 remove_watcher() i=6 2024-08-27T03:58:03.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:03.960+0000 7fdec587c9c0 20 remove_watcher() i=7 2024-08-27T03:58:03.983 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-08-27T03:58:03.994 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-08-27T03:58:04.006 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-08-27T03:58:04.068 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-08-27T03:58:04.079 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-08-27T03:58:04.079 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T03:58:04.134 INFO:tasks.rgw.client.0.smithi143.stdout:2024-08-27T03:58:04.116+0000 e570640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 37974) UID: 0 2024-08-27T03:58:04.135 INFO:tasks.rgw.client.0.smithi143.stdout:2024-08-27T03:58:04.124+0000 8ed8f80 -1 shutting down 2024-08-27T03:58:24.162 INFO:tasks.rgw.client.0.smithi143.stderr:==00:01:27:07.016 37978== could not unlink /tmp/vgdb-pipe-from-vgdb-to-37978-by-root-on-??? 2024-08-27T03:58:24.162 INFO:tasks.rgw.client.0.smithi143.stderr:==00:01:27:07.016 37978== could not unlink /tmp/vgdb-pipe-to-vgdb-from-37978-by-root-on-??? 2024-08-27T03:58:24.163 INFO:tasks.rgw.client.0.smithi143.stderr:==00:01:27:07.016 37978== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-37978-by-root-on-??? 2024-08-27T03:58:25.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-08-27T03:58:28.484 INFO:tasks.rgw.client.0:Stopped 2024-08-27T03:58:28.485 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-08-27T03:58:28.491 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f /etc/ceph/vault-root-token 2024-08-27T03:58:28.545 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-08-27T03:58:28.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-08-27T03:58:28.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-08-27T03:58:28.601 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-08-27T03:58:28.695 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setuser ceph since I am not root 2024-08-27T03:58:28.695 INFO:teuthology.orchestra.run.smithi143.stderr:ignoring --setgroup ceph since I am not root 2024-08-27T03:58:28.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 realm 2024-08-27T03:58:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-08-27T03:58:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:28.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:58:28.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.735+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.739+0000 7f1ca364c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-08-27T03:58:28.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.739+0000 7f1ca364c9c0 20 searching for the correct realm 2024-08-27T03:58:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.743+0000 7f1ca0951640 0 -- 172.21.15.143:0/3782803346 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f1c9411f1d0 msgr2=0x7f1c9412d2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:58:28.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.751+0000 7f1ca1152640 0 -- 172.21.15.143:0/3782803346 >> [v2:172.21.15.143:6816/203223605,v1:172.21.15.143:6817/203223605] conn(0x7f1c9806ba00 msgr2=0x7f1c9801fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:28.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-08-27T03:58:28.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-08-27T03:58:28.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 RGWRados::pool_iterate: got zone_info.3a884aa2-81b8-4172-8e69-44ac4b13efc2 2024-08-27T03:58:28.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 RGWRados::pool_iterate: got zonegroup_info.289ef2f8-6c0e-402d-9db4-d43d387a377b 2024-08-27T03:58:28.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-08-27T03:58:28.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-08-27T03:58:28.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:28.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-08-27T03:58:28.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-08-27T03:58:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 zone default found 2024-08-27T03:58:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 4 Realm: () 2024-08-27T03:58:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 4 ZoneGroup: default (289ef2f8-6c0e-402d-9db4-d43d387a377b) 2024-08-27T03:58:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 4 Zone: default (3a884aa2-81b8-4172-8e69-44ac4b13efc2) 2024-08-27T03:58:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-08-27T03:58:28.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 zonegroup default 2024-08-27T03:58:28.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:28.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.971+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.975+0000 7f1ca364c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:28.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.975+0000 7f1ca364c9c0 20 rados->read ofs=0 len=0 2024-08-27T03:58:28.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.975+0000 7f1ca364c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-08-27T03:58:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.975+0000 7f1ca364c9c0 20 started sync module instance, tier type = 2024-08-27T03:58:28.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.975+0000 7f1ca364c9c0 20 started zone id=3a884aa2-81b8-4172-8e69-44ac4b13efc2 (name=default) with tier type = 2024-08-27T03:58:29.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.999+0000 7f1ca364c9c0 20 add_watcher() i=0 2024-08-27T03:58:29.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.999+0000 7f1ca364c9c0 20 add_watcher() i=1 2024-08-27T03:58:29.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.999+0000 7f1ca364c9c0 20 add_watcher() i=2 2024-08-27T03:58:29.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.999+0000 7f1ca364c9c0 20 add_watcher() i=3 2024-08-27T03:58:29.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.999+0000 7f1ca364c9c0 20 add_watcher() i=4 2024-08-27T03:58:29.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.999+0000 7f1ca364c9c0 20 add_watcher() i=5 2024-08-27T03:58:29.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:28.999+0000 7f1ca364c9c0 20 add_watcher() i=6 2024-08-27T03:58:29.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.003+0000 7f1ca364c9c0 20 add_watcher() i=7 2024-08-27T03:58:29.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.003+0000 7f1ca364c9c0 2 all 8 watchers are set, enabling cache 2024-08-27T03:58:29.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.007+0000 7f1b57fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:58:29.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.007+0000 7f1ca364c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-08-27T03:58:29.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.007+0000 7f1ca364c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-08-27T03:58:29.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.099+0000 7f1b56fe5640 20 reqs_thread_entry: start 2024-08-27T03:58:29.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.099+0000 7f1ca364c9c0 20 init_complete bucket index max shards: 11 2024-08-27T03:58:29.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.099+0000 7f1ca364c9c0 20 Filter name: none 2024-08-27T03:58:29.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.099+0000 7f1b54fe1640 20 reqs_thread_entry: start 2024-08-27T03:58:29.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.099+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-08-27T03:58:29.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48725' 2024-08-27T03:58:29.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_vF7Qz9M9UxWa7hw4mu6Z66NS38WM0v2', time=2024-08-27T05:13:41.164718+0000, chain.objs.size()=2 2024-08-27T03:58:29.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.H-aYnOPfvE-zKz51lT2-50crmWeXelR_0 2024-08-27T03:58:29.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.H-aYnOPfvE-zKz51lT2-50crmWeXelR_1 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13699020664055406104', time=2024-08-27T05:18:34.847474+0000, chain.objs.size()=1 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.245__shadow_.bMyaHHPVXq_W3pL_3m0eOg86YId4O3g_0 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.609242150492639718', time=2024-08-27T05:20:35.611343+0000, chain.objs.size()=1 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HgJFzgZa_VfY40TTP_3iaumyTIbftmb_0 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9194369991695352947', time=2024-08-27T05:20:36.054607+0000, chain.objs.size()=1 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2sqD4gBMAqbuP_rNFhDT1QKh-RwXEUC_0 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3902928078456564367', time=2024-08-27T05:20:36.908561+0000, chain.objs.size()=1 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uWzwHT7fxc5vAW6yOYLxB0DDMvH5LSF_0 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12103392357113697013', time=2024-08-27T05:20:37.968243+0000, chain.objs.size()=1 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gdBdGXBDvqfaPpMex0jnJxNMVJJf0VL_0 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7108971235842540237', time=2024-08-27T05:20:39.263725+0000, chain.objs.size()=1 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TUVv589Lv0zcC1gKlZfIbO65dR9K7SU_0 2024-08-27T03:58:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8370219430616148099', time=2024-08-27T05:20:39.320729+0000, chain.objs.size()=1 2024-08-27T03:58:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.wGN5fZ65v0m5IF0FXvo8gCCLhDMdcA9_0 2024-08-27T03:58:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14056494128506314832', time=2024-08-27T05:20:39.560134+0000, chain.objs.size()=1 2024-08-27T03:58:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.e_Hp3POlUXM15mWSbm67RUYcFzJNqIj_0 2024-08-27T03:58:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5247253249537297397', time=2024-08-27T05:20:39.794473+0000, chain.objs.size()=1 2024-08-27T03:58:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.M2hjS_pS3VmH8AwekW0J9oNrB4tXW2S_0 2024-08-27T03:58:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15321686895062237438', time=2024-08-27T05:20:43.110235+0000, chain.objs.size()=1 2024-08-27T03:58:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XoapQU4Az7l8ChnzlGKDNGkRnam6rXa_0 2024-08-27T03:58:29.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.111+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4505893368594758343', time=2024-08-27T05:20:43.211956+0000, chain.objs.size()=1 2024-08-27T03:58:29.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.111+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WrFrnpaYRkGrD_fbiTZlyqVv-P6gm4m_0 2024-08-27T03:58:29.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.111+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6711514841297578919', time=2024-08-27T05:20:43.613822+0000, chain.objs.size()=1 2024-08-27T03:58:29.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nUiCJ3LhGMgrNTPjFT7J2dR-1ArAYyf_0 2024-08-27T03:58:29.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10706381350521050452', time=2024-08-27T05:20:45.252564+0000, chain.objs.size()=1 2024-08-27T03:58:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Zfs64UkkGxlCqXx7JPoUT46X0hovCJ5_0 2024-08-27T03:58:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2689252881396050633', time=2024-08-27T05:20:46.077192+0000, chain.objs.size()=1 2024-08-27T03:58:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6RPn6aG2KfNyq0dCX3yR_xx6NPzYicc_0 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517311976864991144', time=2024-08-27T05:20:46.103210+0000, chain.objs.size()=1 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.e1igmnsWWJOSo2ObARqGCNcTPZcfuD__0 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10214495888543682175', time=2024-08-27T05:20:48.342783+0000, chain.objs.size()=1 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.l4jdkE-RpDAvuppkxxxjxubUvGg58ai_0 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9708205998556894378', time=2024-08-27T05:20:48.731007+0000, chain.objs.size()=1 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lYj6km-RPHz0EyqpRJlLp6aajmc89cQ_0 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17224037372366103556', time=2024-08-27T05:20:51.013929+0000, chain.objs.size()=1 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nArRCTelT1cw-1bmA0BHNtoz3wK-pfM_0 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15415941110860277490', time=2024-08-27T05:20:51.213649+0000, chain.objs.size()=1 2024-08-27T03:58:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VUqJqre01MvASCPmpErAZM2Z7GUQnuU_0 2024-08-27T03:58:29.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4964637138984121761', time=2024-08-27T05:20:51.782213+0000, chain.objs.size()=1 2024-08-27T03:58:29.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.DYQ2E9uTF-OJIfjV_JqtOKkZXLuSHMs_0 2024-08-27T03:58:29.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1276650506113574216', time=2024-08-27T05:20:52.121656+0000, chain.objs.size()=1 2024-08-27T03:58:29.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.yySax1tnCyTOfxBaeNsEwbMfAFHTwhJ_0 2024-08-27T03:58:29.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12087721189454500518', time=2024-08-27T05:20:52.123657+0000, chain.objs.size()=1 2024-08-27T03:58:29.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.baViVD8-9LaGgX3mc71-xuv-xCvkBbu_0 2024-08-27T03:58:29.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2154122051733723200', time=2024-08-27T05:20:52.378631+0000, chain.objs.size()=1 2024-08-27T03:58:29.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hNV7JQB_nSA1qGK7IF_5ZrpEFbiGB03_0 2024-08-27T03:58:29.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6794592719554860734', time=2024-08-27T05:20:55.225224+0000, chain.objs.size()=1 2024-08-27T03:58:29.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5RUbmZpyLICrifmVh3zVPeFUZhwg6zN_0 2024-08-27T03:58:29.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17130746707808885033', time=2024-08-27T05:20:55.823107+0000, chain.objs.size()=1 2024-08-27T03:58:29.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.P9E0wRoDV3Esf-if2eginrsGozgvT9-_0 2024-08-27T03:58:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17234844814426529100', time=2024-08-27T05:20:56.788508+0000, chain.objs.size()=1 2024-08-27T03:58:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aHzuaRmOCokp4EswUi88HDKwAflRKlG_0 2024-08-27T03:58:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10654229222559235551', time=2024-08-27T05:20:57.307822+0000, chain.objs.size()=1 2024-08-27T03:58:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hc4jzuu08LeXEKMkO4Ki-tuq1hAyHMP_0 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3299112723886521712', time=2024-08-27T05:20:58.178503+0000, chain.objs.size()=1 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ChijnBa7fZ_L56JO5qQqQ617KMDSAWk_0 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16051835895919214943', time=2024-08-27T05:20:59.379405+0000, chain.objs.size()=1 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xUDPhD9Z4yS-vl46BZBpiZGtlj4tbcH_0 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11407108263719848855', time=2024-08-27T05:21:00.478305+0000, chain.objs.size()=1 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NNGRAQ-BhX5bFptz-EPw-oFFV_9YAGI_0 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17642288698851385637', time=2024-08-27T05:21:00.699197+0000, chain.objs.size()=1 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gdKFrlGWov_cbEmM3vKQa_myfzONwpe_0 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4805052725266139663', time=2024-08-27T05:21:41.645848+0000, chain.objs.size()=1 2024-08-27T03:58:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.277__shadow_.I47x5CBW1G_sfXYGJ2SIp_fvHROcANE_0 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9370394773374822505', time=2024-08-27T05:22:08.010095+0000, chain.objs.size()=1 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.RsaugRA4Vwg3yIw84TAFv3VdphYvHQO_0 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8035571557354064565', time=2024-08-27T05:22:09.967653+0000, chain.objs.size()=1 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.288__shadow_.ZV9DIIm5G8DnFAiFm2xAJJZJ2SH2b2n_0 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11029161704631559081', time=2024-08-27T05:22:11.875768+0000, chain.objs.size()=1 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.289__shadow_.HjdlRuYZvxdKO3q2BQhVFRYtpaIsJcm_0 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15868870884552849779', time=2024-08-27T05:22:23.315502+0000, chain.objs.size()=1 2024-08-27T03:58:29.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.295__shadow_.uqZ-2OwXP_TuZ06t0766GVSeN3IGN1U_0 2024-08-27T03:58:29.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13385041202744421226', time=2024-08-27T05:22:25.167911+0000, chain.objs.size()=1 2024-08-27T03:58:29.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.296__shadow_.a2kI0kzh_tNBBTvXF0jtBYlMs4Aqz_f_0 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2835760204922206552', time=2024-08-27T05:22:27.045588+0000, chain.objs.size()=1 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.297__shadow_.Yx6nEJjhHg_4IhQhdNvL87a0OoasQFu_0 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.540548569575497389', time=2024-08-27T05:22:28.842511+0000, chain.objs.size()=1 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.298__shadow_.6RCGSBRtTM5guL97J8s37xRLdJrQB2T_0 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9913595980607543067', time=2024-08-27T05:24:48.656764+0000, chain.objs.size()=1 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.B-TajIZsAw7ZpS3kl6KF6vmASB5xH6d_0 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16040648367753612929', time=2024-08-27T05:24:50.478682+0000, chain.objs.size()=1 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4O_VVlEstWAwXWPrzTzaiTVWzqTNDqo_0 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16088107208637626483', time=2024-08-27T05:24:50.935814+0000, chain.objs.size()=1 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QktQq2S28yzb9Q_ey7oC4VFxN0_ZsvG_0 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12283184945518177172', time=2024-08-27T05:24:52.336509+0000, chain.objs.size()=1 2024-08-27T03:58:29.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Lh9KcdayJV7u0evs7Fv2ne_Lo6-3Lxz_0 2024-08-27T03:58:29.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6922460346890462044', time=2024-08-27T05:24:52.591275+0000, chain.objs.size()=1 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yHm8t6zZFzQbODcT4HjE_b7dir5rDY7_0 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14314461179465933509', time=2024-08-27T05:24:55.070433+0000, chain.objs.size()=1 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.h4Ny5SrGUXN6ioX54V4Qj_ZwY7dbowT_0 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7562508906783377754', time=2024-08-27T05:24:55.520055+0000, chain.objs.size()=1 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6HueZAthtyR9Sut3CXqVS_8OQTh3Bnp_0 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8300745117319282196', time=2024-08-27T05:24:56.994645+0000, chain.objs.size()=1 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yn_yzgfKnZEWt7yVnfvcwawoRdLuVhy_0 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12632973510877523529', time=2024-08-27T05:24:59.200321+0000, chain.objs.size()=1 2024-08-27T03:58:29.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uu1eeI4EmyXRISDE3E4K8ZlWeaQwwLU_0 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13789582068139238414', time=2024-08-27T05:24:59.289842+0000, chain.objs.size()=1 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Lv96woMmVE2x-8V-ZyxpMnFgSxnNbdH_0 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16315810776966512528', time=2024-08-27T05:24:59.929434+0000, chain.objs.size()=1 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ldG8LUkiq4ws7E1_-zQ0ZX0n-KF11nq_0 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14493701673421419645', time=2024-08-27T05:24:59.931519+0000, chain.objs.size()=1 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.C02Q3tBN6kNSdV9T8Y9JVDl10WZnLCu_0 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7193847476076774601', time=2024-08-27T05:25:00.478499+0000, chain.objs.size()=1 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SP9JYtfoYLa6SLMdTST_fgIK6QOkaGL_0 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17003291772077871704', time=2024-08-27T05:25:00.776748+0000, chain.objs.size()=1 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zDEAsxmCwmuPUUHSMEiDg5PDyZ6LkXi_0 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15541348838704329183', time=2024-08-27T05:25:02.114928+0000, chain.objs.size()=1 2024-08-27T03:58:29.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fLX0Sc-1SCXrEubzuod16OrX19rPfDy_0 2024-08-27T03:58:29.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15420260410734172081', time=2024-08-27T05:25:02.503348+0000, chain.objs.size()=1 2024-08-27T03:58:29.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vJr6x8-7ubeYX0H5tsS9GAWYZvnrwYG_0 2024-08-27T03:58:29.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13775905114498341680', time=2024-08-27T05:25:02.682417+0000, chain.objs.size()=1 2024-08-27T03:58:29.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.UZ-bgfO0Eqka9iahAiMwDj9yYd6A4L-_0 2024-08-27T03:58:29.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5760679977172470663', time=2024-08-27T05:25:04.483661+0000, chain.objs.size()=1 2024-08-27T03:58:29.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bcQ_mu0Hy6Y0Oq9XLR_pNHnv5d5uJib_0 2024-08-27T03:58:29.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10353415667763828832', time=2024-08-27T05:25:05.910803+0000, chain.objs.size()=1 2024-08-27T03:58:29.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mmv_EY2ba3VlOVpquS5h3mtLfkvKuyD_0 2024-08-27T03:58:29.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11612292455097070654', time=2024-08-27T05:25:06.141591+0000, chain.objs.size()=1 2024-08-27T03:58:29.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TgzCq5c1ok9B-GqOvBhqZnWBQmYcfzA_0 2024-08-27T03:58:29.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18387133936521820855', time=2024-08-27T05:25:06.326620+0000, chain.objs.size()=1 2024-08-27T03:58:29.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fzBR9z7eXKQOBsM6My-kkdXhsULjJye_0 2024-08-27T03:58:29.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7241522355506376761', time=2024-08-27T05:25:06.576252+0000, chain.objs.size()=1 2024-08-27T03:58:29.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1s-nPOmcGC5eJtHrtPjfKjuAQbsTN77_0 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14124167951653262457', time=2024-08-27T05:25:06.683856+0000, chain.objs.size()=1 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dlyNsV0wmv9rFgN1s25xL4Uj9NH3apB_0 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4740758700609838247', time=2024-08-27T05:25:07.035336+0000, chain.objs.size()=1 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.UtsklNNYJIFmbiLLPwU8zA9wIOpHlsc_0 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5776526610651180429', time=2024-08-27T05:25:07.352235+0000, chain.objs.size()=1 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7UR9EDodn-ArdBPWapnWndp0jqYAygw_0 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14340578972601893429', time=2024-08-27T05:25:08.754648+0000, chain.objs.size()=1 2024-08-27T03:58:29.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.L_aoJeNbxWdzVmmOtFMsoiLR24RjLOt_0 2024-08-27T03:58:29.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15935824414572823062', time=2024-08-27T05:25:09.919134+0000, chain.objs.size()=1 2024-08-27T03:58:29.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8gbCjZN5-GHg32JbjKn7X0A9hEu8wIv_0 2024-08-27T03:58:29.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1007789346417748274', time=2024-08-27T05:25:10.366380+0000, chain.objs.size()=1 2024-08-27T03:58:29.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8XU6YfqgDA1G3xFomeDSnYBKBz534MX_0 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18382590474108140765', time=2024-08-27T05:25:12.867484+0000, chain.objs.size()=1 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4U3kZ2eFVn1xJP6C7RZ7ABYINmV3N2O_0 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1471029471650854773', time=2024-08-27T05:25:13.507779+0000, chain.objs.size()=1 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.w28tEct8FWAzvO4bglAPnLXp24LPTHw_0 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11364446498610546944', time=2024-08-27T05:25:14.501161+0000, chain.objs.size()=1 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vqxHG_RofMKnpkWcZglqgELrA84v4-j_0 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1859028873352842268', time=2024-08-27T05:26:59.266826+0000, chain.objs.size()=1 2024-08-27T03:58:29.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pPZqD_4prlrXeFHeA4aQqztFIjcg9zX_0 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4940211642777740720', time=2024-08-27T05:26:59.568659+0000, chain.objs.size()=1 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Vby-eEijqpci5ADzrkeaAK6yXjhOQos_0 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7321320549596630774', time=2024-08-27T05:27:00.348004+0000, chain.objs.size()=1 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VTKN783TOItAiFRy3ZIoTOB8PU6YcaH_0 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5342945111661182782', time=2024-08-27T05:27:01.779975+0000, chain.objs.size()=1 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BrAx2iztZHkQddi1ryhhv5igK3CUHHS_0 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2351826058795099372', time=2024-08-27T05:27:02.795685+0000, chain.objs.size()=1 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.kuOsJbswf-QCNSiCO2VadsjMi_Bqi92_0 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14222909719690688744', time=2024-08-27T05:27:04.042623+0000, chain.objs.size()=1 2024-08-27T03:58:29.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HNVJkAz49ouxvAaCpJ0MejpRp39BjR2_0 2024-08-27T03:58:29.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16797638431309152554', time=2024-08-27T05:27:04.367567+0000, chain.objs.size()=1 2024-08-27T03:58:29.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.iTUa1ozO_KvBHRLj89iKaFcfgWuLUqU_0 2024-08-27T03:58:29.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14276464309330927026', time=2024-08-27T05:27:04.374121+0000, chain.objs.size()=1 2024-08-27T03:58:29.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qJS_HYcWhW_eBChjluRG13OlcZAT4l7_0 2024-08-27T03:58:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8095604786491312469', time=2024-08-27T05:27:04.562302+0000, chain.objs.size()=1 2024-08-27T03:58:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2UAR5ZkS-vOCj2ZgkmgPXFKpWdU7VQA_0 2024-08-27T03:58:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15714364364506332675', time=2024-08-27T05:27:07.779545+0000, chain.objs.size()=1 2024-08-27T03:58:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.R5nyNfb0GtQakSBXBXGymjIdOcdMFh8_0 2024-08-27T03:58:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6760441077831230021', time=2024-08-27T05:27:09.168955+0000, chain.objs.size()=1 2024-08-27T03:58:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DlWZsoyDu_MubVPZ9tHagaiZvBG4AX__0 2024-08-27T03:58:29.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13914892269397717566', time=2024-08-27T05:27:11.522601+0000, chain.objs.size()=1 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TkIiv_N6G3HppqCt4FdKH0RKx9tNkMs_0 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13312799266026076718', time=2024-08-27T05:27:11.938513+0000, chain.objs.size()=1 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UsW3M4sCw3q8L_JtA90GgERzctrq4yS_0 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9837742336824616074', time=2024-08-27T05:27:12.776280+0000, chain.objs.size()=1 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p2f82ZDGkZ3lduir1AcOVP7O_e7NSV-_0 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8026707109278617473', time=2024-08-27T05:27:15.181925+0000, chain.objs.size()=1 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Qg17H57OfASypvJ8feg20z_reuyQmaJ_0 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10332563472723928824', time=2024-08-27T05:27:15.220548+0000, chain.objs.size()=1 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.XyRmW9IqKMdBb5poaYtdt8NnTdEBN2a_0 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9688672441810235802', time=2024-08-27T05:27:16.804680+0000, chain.objs.size()=1 2024-08-27T03:58:29.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KZp2WY-fQFaXxLqmh4QEDRy1cYHBO89_0 2024-08-27T03:58:29.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.902973403413648097', time=2024-08-27T05:27:19.192747+0000, chain.objs.size()=1 2024-08-27T03:58:29.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lw3bt8YmgW189SO-lnruHu0bWZEnWHn_0 2024-08-27T03:58:29.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18428858635513404892', time=2024-08-27T05:27:20.047504+0000, chain.objs.size()=1 2024-08-27T03:58:29.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fuY8SkbUQ2eLgX8MshuG1fc8kSIBc1H_0 2024-08-27T03:58:29.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6087770293824887433', time=2024-08-27T05:27:20.641456+0000, chain.objs.size()=1 2024-08-27T03:58:29.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.yToU1atZyGJ0r8AumAmEpcyuRY-J0Ye_0 2024-08-27T03:58:29.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11877187071933430403', time=2024-08-27T05:27:21.130910+0000, chain.objs.size()=1 2024-08-27T03:58:29.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pJc0j7Wk1jobOnrYKWzIuOfd8p9pwQy_0 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10893789989152552995', time=2024-08-27T05:27:21.356985+0000, chain.objs.size()=1 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Rpl-239lgRhLVl5qrGRGLyGygZy3wUK_0 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16020250319667028808', time=2024-08-27T05:27:24.728664+0000, chain.objs.size()=1 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.YXmv2Gh-tIAczWRTyD2twAWZP4HDlow_0 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12837317709599987607', time=2024-08-27T05:27:24.946179+0000, chain.objs.size()=1 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lmd9v6EJvhNfFM1PVvpf_x6spN0PN_K_0 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11040280562175175514', time=2024-08-27T05:27:25.063786+0000, chain.objs.size()=1 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uJFP2rXE0YbAzFeD9e992G3cunI4IQO_0 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16904509622441927205', time=2024-08-27T05:28:33.600127+0000, chain.objs.size()=1 2024-08-27T03:58:29.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.367__shadow_.LE2qd5XAi4JwUy1LeSgih4Izt0CmbyA_0 2024-08-27T03:58:29.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14722726184311549997', time=2024-08-27T05:28:52.584696+0000, chain.objs.size()=1 2024-08-27T03:58:29.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.378__shadow_.Tk1oSuRTsKEtdqen7y6QhQQil2O0ChF_0 2024-08-27T03:58:29.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9356290383391244298', time=2024-08-27T05:31:56.906956+0000, chain.objs.size()=1 2024-08-27T03:58:29.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.492__shadow_.B1QugGToai23lw1chl5Zm26LlYFW7vh_0 2024-08-27T03:58:29.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.203+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8656851442179201680', time=2024-08-27T05:32:06.022408+0000, chain.objs.size()=1 2024-08-27T03:58:29.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.497__shadow:nGBnVWVmI3DA67.4KlPAhM9ux0Gc029_.rEh1fYZ9-qfRs1r-giIeLw9ZBIE8vlQ_0 2024-08-27T03:58:29.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48725 2024-08-27T03:58:29.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-08-27T03:58:29.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14915158412770545717', time=2024-08-27T05:32:46.001519+0000, chain.objs.size()=1 2024-08-27T03:58:29.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.512__multipart_mymultipart.2~byWOAUCxAtQi0rxVSGdwLTHJHwJwIBB.1 2024-08-27T03:58:29.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6819487096715182501', time=2024-08-27T05:37:02.285600+0000, chain.objs.size()=1 2024-08-27T03:58:29.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.548__shadow_.l_WMHfxFbp3HMLYGRGAbO--gZAJ3D6e_0 2024-08-27T03:58:29.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10212064084800559157', time=2024-08-27T05:38:13.178222+0000, chain.objs.size()=1 2024-08-27T03:58:29.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.564__shadow:B-AeUZ9f4Fg1etvnB-G7DKj6X6Xod-V_.os4pYybBx0ywVCpiZxq65ERsnlijbJP_0 2024-08-27T03:58:29.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4140982405694525076', time=2024-08-27T05:38:29.688053+0000, chain.objs.size()=1 2024-08-27T03:58:29.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:4IJrTLUhWxidMWHmQtOguY-aRlLDns0_.8c1Uf0oC1t5NKdYPBAY8jEWKh73M9mE_0 2024-08-27T03:58:29.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1859545158231765710', time=2024-08-27T05:39:55.636016+0000, chain.objs.size()=1 2024-08-27T03:58:29.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:JECjx1Tec0Aw5JX86RY..uoQxASUbJf_.CLd6E8ADjSPp_HCq_b1c2ocNL4TbokI_0 2024-08-27T03:58:29.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.176203743629737118', time=2024-08-27T05:40:12.977498+0000, chain.objs.size()=1 2024-08-27T03:58:29.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.580__shadow:8KCoMdyV.65r5cKTENFfmzaQOzFItua_.mv0-MyJwnXFigwSlqZzeir-SKKhLls1_0 2024-08-27T03:58:29.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-08-27T03:58:29.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46164' 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9324228358393521065', time=2024-08-27T05:13:18.656388+0000, chain.objs.size()=3 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-LUKEWARM.2~sGN8H-1mEIPFIB0PYe80BxF1Vo65hDL.1 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-LUKEWARM.2~sGN8H-1mEIPFIB0PYe80BxF1Vo65hDL.2 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-LUKEWARM.2~sGN8H-1mEIPFIB0PYe80BxF1Vo65hDL.3 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_fk7YKI8RngB4fQUejcgbOoaoS4ZiGkZ', time=2024-08-27T05:13:21.804625+0000, chain.objs.size()=2 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_._-zjFXJBDgZ7R573DCwEvAfEwprmavM_0 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_._-zjFXJBDgZ7R573DCwEvAfEwprmavM_1 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Yv5Bo-xvKy8hJEdDiTx6pcki99SC1YT', time=2024-08-27T05:13:49.835413+0000, chain.objs.size()=2 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.159__shadow_.GPjDlloCWdHBQANkjDN0ked_il0hr5d_0 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.159__shadow_.GPjDlloCWdHBQANkjDN0ked_il0hr5d_1 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16106353800575224924', time=2024-08-27T05:14:14.244060+0000, chain.objs.size()=1 2024-08-27T03:58:29.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.170__shadow_.AdhIFlLZHjCJE5h1Yu_8vcnKTRCQsjw_0 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3214060322042610499', time=2024-08-27T05:17:53.365900+0000, chain.objs.size()=1 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.224__shadow_.QO7B_j_zj8-BjAHnkGmwl_ftDJLnO28_0 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10194040334689967620', time=2024-08-27T05:18:12.821802+0000, chain.objs.size()=1 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.234__shadow_.4bW7K2GUjTGjHYVM3LoUNA-AHBNvl3a_0 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3613422676927221478', time=2024-08-27T05:18:21.912672+0000, chain.objs.size()=1 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.238__shadow_.Bm7Yd_F9P0AOaaUuc5UGk7Pw__Ug8J3_0 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3212709535667587657', time=2024-08-27T05:18:36.688591+0000, chain.objs.size()=1 2024-08-27T03:58:29.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.246__shadow_.GzvRFhJcDdxcFzpjBJfvPmQUSMnso3e_0 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11460136037138925377', time=2024-08-27T05:20:35.181316+0000, chain.objs.size()=1 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.wgcJMLaHi2Tp6PvY0GK434JKymaejsL_0 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573377724685091700', time=2024-08-27T05:20:35.368524+0000, chain.objs.size()=1 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TwVRbFThHJCcx1WGk0j4YJTeeACl22m_0 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1970196568642186109', time=2024-08-27T05:20:35.604379+0000, chain.objs.size()=1 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0kX5U6Skl6PUQ9OPB2W3Wg88dY7WQVm_0 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14038401222438635336', time=2024-08-27T05:20:36.166722+0000, chain.objs.size()=1 2024-08-27T03:58:29.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hAMZ4VrAknDUfb88fvQOjS4X422XCpS_0 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13667333045024177962', time=2024-08-27T05:20:36.849419+0000, chain.objs.size()=1 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iie_HZHd6hSOZXHZ5VtUWcCpqvm8lrn_0 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2702283843278146372', time=2024-08-27T05:20:36.850832+0000, chain.objs.size()=1 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mtwdXYUe9n8S-a8A3G7DxagUYSsE8DO_0 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5904149959810236183', time=2024-08-27T05:20:40.354180+0000, chain.objs.size()=1 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PDXLghkZ1mtJgHN5igZ1p_ZTzW3JEk0_0 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2250896028598440244', time=2024-08-27T05:20:40.463535+0000, chain.objs.size()=1 2024-08-27T03:58:29.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.u1-r9fY180wXaZ0384kE_xiKWSxjRsn_0 2024-08-27T03:58:29.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2383450227777926370', time=2024-08-27T05:20:41.688965+0000, chain.objs.size()=1 2024-08-27T03:58:29.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rhU9iPa99LafwCMHii4Sk9UGHS6GEZd_0 2024-08-27T03:58:29.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10676104768137571326', time=2024-08-27T05:20:42.158797+0000, chain.objs.size()=1 2024-08-27T03:58:29.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bltpRutusmWrQGuIsYgcY6y8qV8pLiZ_0 2024-08-27T03:58:29.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3441852861315281140', time=2024-08-27T05:20:44.027866+0000, chain.objs.size()=1 2024-08-27T03:58:29.228 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.I9ih_x-QlLeCM_TYUvQjethusu6CbAU_0 2024-08-27T03:58:29.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4895841987738053891', time=2024-08-27T05:20:44.936343+0000, chain.objs.size()=1 2024-08-27T03:58:29.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5QfbjeqG58WjJdIGqZEwO-6qlQFnYG7_0 2024-08-27T03:58:29.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10077321997126919012', time=2024-08-27T05:20:45.164365+0000, chain.objs.size()=1 2024-08-27T03:58:29.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._37K0QTzTb_woLQdV4mvdiVvp0uOn2g_0 2024-08-27T03:58:29.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2382144723597455486', time=2024-08-27T05:20:45.906405+0000, chain.objs.size()=1 2024-08-27T03:58:29.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GpjlRSr0mcx-907TxMgdajuaKG73MjY_0 2024-08-27T03:58:29.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3146406436289851720', time=2024-08-27T05:20:46.081276+0000, chain.objs.size()=1 2024-08-27T03:58:29.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TxelI3y5D7ymZniejk01LW90xldzRUi_0 2024-08-27T03:58:29.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9350776295870250497', time=2024-08-27T05:20:47.061050+0000, chain.objs.size()=1 2024-08-27T03:58:29.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vcGjbZLZ_pr8FMQhHr4ovSH1NYYjB0X_0 2024-08-27T03:58:29.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.765774233769052671', time=2024-08-27T05:20:47.062626+0000, chain.objs.size()=1 2024-08-27T03:58:29.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QufTrVlJYRaiDm7rNIswfkK67gT9ika_0 2024-08-27T03:58:29.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12143517262757715146', time=2024-08-27T05:20:47.441667+0000, chain.objs.size()=1 2024-08-27T03:58:29.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.DcYQ9LleCsoYunW9vuKOYsj69w0yYkb_0 2024-08-27T03:58:29.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8953147356106375181', time=2024-08-27T05:20:47.926630+0000, chain.objs.size()=1 2024-08-27T03:58:29.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.yoyrnWEikuuXx7_c1AplVnnKz7mRU3g_0 2024-08-27T03:58:29.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16046532972117781438', time=2024-08-27T05:20:48.343753+0000, chain.objs.size()=1 2024-08-27T03:58:29.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.F-7lLLs2c35lDQvXLaJmatdVbwoyVGA_0 2024-08-27T03:58:29.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16659973552568802289', time=2024-08-27T05:20:48.640404+0000, chain.objs.size()=1 2024-08-27T03:58:29.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LrkPCFEqN8tew8XucBL0Cus0mx-y0_K_0 2024-08-27T03:58:29.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18343184807168374551', time=2024-08-27T05:20:48.895922+0000, chain.objs.size()=1 2024-08-27T03:58:29.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Rk-76Nc5XLFBJP59sZfWBXIegJeGcK7_0 2024-08-27T03:58:29.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6899081782924991163', time=2024-08-27T05:20:49.623987+0000, chain.objs.size()=1 2024-08-27T03:58:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NbNszNgArJwN21zmv3KG5LJxV_5GohI_0 2024-08-27T03:58:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10263356712213518091', time=2024-08-27T05:20:49.720572+0000, chain.objs.size()=1 2024-08-27T03:58:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.k7nu91WUXu4dHpD_S3hJg1pDY3p9x1m_0 2024-08-27T03:58:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14275565623341305168', time=2024-08-27T05:20:49.885683+0000, chain.objs.size()=1 2024-08-27T03:58:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TNJjTgqXyDEhAREYRBi55XiT-ThjheA_0 2024-08-27T03:58:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14317404773369531840', time=2024-08-27T05:20:49.899359+0000, chain.objs.size()=1 2024-08-27T03:58:29.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SNZg6nNR6mdqt-rUu3vsxcTYaVgiMiV_0 2024-08-27T03:58:29.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4698792373457267656', time=2024-08-27T05:20:51.728344+0000, chain.objs.size()=1 2024-08-27T03:58:29.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.YesmZ3jugMBfU0AKL91fvE9l_aFp50B_0 2024-08-27T03:58:29.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15194496664532078601', time=2024-08-27T05:20:52.122509+0000, chain.objs.size()=1 2024-08-27T03:58:29.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._6UsN46TcH72GMTP5lvB1Nhlkkz5eqE_0 2024-08-27T03:58:29.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5489191992774883414', time=2024-08-27T05:20:52.239678+0000, chain.objs.size()=1 2024-08-27T03:58:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NCnXa6buMr2P2__lRR-XvuuJ2wvp7eK_0 2024-08-27T03:58:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5639047769875073554', time=2024-08-27T05:20:52.448226+0000, chain.objs.size()=1 2024-08-27T03:58:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TxlUv9qNhWwAfbb3v9P2Yf-CZuFvoFk_0 2024-08-27T03:58:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4543411683286283335', time=2024-08-27T05:20:54.852200+0000, chain.objs.size()=1 2024-08-27T03:58:29.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.V4jKghDLhYyAiGC7P5er7uiM5Tj4q6H_0 2024-08-27T03:58:29.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18030532546234954022', time=2024-08-27T05:20:55.319014+0000, chain.objs.size()=1 2024-08-27T03:58:29.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xjkTRDKBVPVyMrHWvqjw-xIZe3fvRdx_0 2024-08-27T03:58:29.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12532380165801902547', time=2024-08-27T05:20:56.367928+0000, chain.objs.size()=1 2024-08-27T03:58:29.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vT_Cmr4OBaKNFyIIen0PRNiyoHPm2Lw_0 2024-08-27T03:58:29.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.941183382903625294', time=2024-08-27T05:20:58.071208+0000, chain.objs.size()=1 2024-08-27T03:58:29.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._UiGOXgmLZj0gZdlMrqCLsdb9IKjZA2_0 2024-08-27T03:58:29.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6669334369694819268', time=2024-08-27T05:20:58.281136+0000, chain.objs.size()=1 2024-08-27T03:58:29.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.flJytnanom3bQ4DNtPuZF1wep96H5U-_0 2024-08-27T03:58:29.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1387708232199720833', time=2024-08-27T05:20:58.414802+0000, chain.objs.size()=1 2024-08-27T03:58:29.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NDeiaw-sUfGbqG_Ob8QN_LugYemCTjw_0 2024-08-27T03:58:29.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2740139186690781990', time=2024-08-27T05:20:58.596494+0000, chain.objs.size()=1 2024-08-27T03:58:29.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4jtWej8wu6At1yUVRovD3GW4eAOsRrE_0 2024-08-27T03:58:29.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6625749982555846361', time=2024-08-27T05:20:59.184682+0000, chain.objs.size()=1 2024-08-27T03:58:29.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eJN2Ye8CqvHB9FPTXlptuXNXorwmD4V_0 2024-08-27T03:58:29.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10157625648398812441', time=2024-08-27T05:20:59.339939+0000, chain.objs.size()=1 2024-08-27T03:58:29.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8Kx9vIG3F4Br926SEYOUUROeH7NhWfg_0 2024-08-27T03:58:29.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8330252585300488478', time=2024-08-27T05:21:00.192325+0000, chain.objs.size()=1 2024-08-27T03:58:29.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qtXqnCmRDczTgtm39_2owTeKgQ1E5RK_0 2024-08-27T03:58:29.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4668032917006896056', time=2024-08-27T05:21:03.095214+0000, chain.objs.size()=1 2024-08-27T03:58:29.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BCwSE5z7SC8ilwWRuJokFGiPIpr5aom_0 2024-08-27T03:58:29.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.725722712510514454', time=2024-08-27T05:21:03.708265+0000, chain.objs.size()=1 2024-08-27T03:58:29.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.S-4tjHapokOQvOTWHdWZS0yHhBy0BDf_0 2024-08-27T03:58:29.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9421475214858005515', time=2024-08-27T05:21:07.713544+0000, chain.objs.size()=1 2024-08-27T03:58:29.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.258__shadow_.9wnCy0jKhkY17DWpoQfsU7dNaD-u_rD_0 2024-08-27T03:58:29.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16224428982612074287', time=2024-08-27T05:21:21.523950+0000, chain.objs.size()=1 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.266__shadow_.x-ZSyL2XS8SnVDCOjKcRE3eL9PYF0L6_0 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16056384480121492244', time=2024-08-27T05:21:25.027274+0000, chain.objs.size()=1 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.268__shadow_.ruU5E7eh3hpE8YyqPF1z9epoeb8lbC-_0 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12887637850022756885', time=2024-08-27T05:21:36.114313+0000, chain.objs.size()=1 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.274__shadow_.F9ZGFPsskHa6kLFDQgQUlLUz6ymm68G_0 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12580372561763499375', time=2024-08-27T05:22:11.861501+0000, chain.objs.size()=1 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.289__shadow_.PTcc38kgUXHP5G9A_VaYFhYD2VLDbxb_0 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8323497641952660905', time=2024-08-27T05:22:19.590022+0000, chain.objs.size()=1 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.293__shadow_.-fEZdTrwAGJDN1HHpRD2hDk7yB7TvAe_0 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16318127363015331190', time=2024-08-27T05:22:21.475677+0000, chain.objs.size()=1 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.294__shadow_.POFdssvRL-SCZHbsyNesz0k53apcR9h_0 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15282031619849818128', time=2024-08-27T05:22:27.065503+0000, chain.objs.size()=1 2024-08-27T03:58:29.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.297__shadow_._4YKr7o6A2lrwCUPjfVXUiyc5xFOIK8_0 2024-08-27T03:58:29.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10368798219952110327', time=2024-08-27T05:22:32.989832+0000, chain.objs.size()=1 2024-08-27T03:58:29.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.300__shadow_.jBz1zyFjI1RdzsLtqyzyepWe-PIgIEN_0 2024-08-27T03:58:29.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14206012206865236204', time=2024-08-27T05:24:46.398754+0000, chain.objs.size()=1 2024-08-27T03:58:29.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Z1DmxLIGwQ1Ijq0wmBEmNCRwGiA6OTG_0 2024-08-27T03:58:29.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17875146543147848980', time=2024-08-27T05:24:47.422655+0000, chain.objs.size()=1 2024-08-27T03:58:29.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ReA8S7qi0CpH7nR7fNyQueat1jvlRT4_0 2024-08-27T03:58:29.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5193890133184949048', time=2024-08-27T05:24:47.767571+0000, chain.objs.size()=1 2024-08-27T03:58:29.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iFhL8qj1fxa_ZZ5brCJIFjUa-z6f8SX_0 2024-08-27T03:58:29.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9040704072046204957', time=2024-08-27T05:24:48.448716+0000, chain.objs.size()=1 2024-08-27T03:58:29.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iMjfhqSsya9ZO8O8XRbw6XyD2AVQsfS_0 2024-08-27T03:58:29.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1802810663738064171', time=2024-08-27T05:24:48.693270+0000, chain.objs.size()=1 2024-08-27T03:58:29.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9AxBdwh_uD3dyLr_2nBcS_vouG1HdTJ_0 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18186469011670692001', time=2024-08-27T05:24:48.734827+0000, chain.objs.size()=1 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1sKms5LZgR83R1Smf4pWD2fS4nj3u5t_0 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7310672170747275293', time=2024-08-27T05:24:50.874971+0000, chain.objs.size()=1 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5pJ9u7LW_nbeSpr02E2mOXWLgwZG9Ov_0 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11166642452388068220', time=2024-08-27T05:24:51.207446+0000, chain.objs.size()=1 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9jOJgY5BAtCbDquwHnbmple2963sNYu_0 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16492091974495087997', time=2024-08-27T05:24:52.066659+0000, chain.objs.size()=1 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.aM8eaCg0fqRM2Dwu69to0QMarXL2go7_0 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3652682184986139706', time=2024-08-27T05:24:52.205404+0000, chain.objs.size()=1 2024-08-27T03:58:29.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._lVsnCBy-uQt7vwJ7-iToyxfCWjI3_w_0 2024-08-27T03:58:29.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17230446752826020281', time=2024-08-27T05:24:55.373654+0000, chain.objs.size()=1 2024-08-27T03:58:29.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YXx3wT_H7Vk_vZMV81hDp7qHfs8MS7C_0 2024-08-27T03:58:29.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2694203043888054834', time=2024-08-27T05:24:55.375517+0000, chain.objs.size()=1 2024-08-27T03:58:29.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x5dOWcQgZGPeLcqRu4SMCnjPhzIEQKr_0 2024-08-27T03:58:29.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11133645875995640770', time=2024-08-27T05:24:55.617728+0000, chain.objs.size()=1 2024-08-27T03:58:29.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kDm6qD3gatQKVF1fMA4Vq-ufY5MYsXb_0 2024-08-27T03:58:29.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.259+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16924018661175913880', time=2024-08-27T05:24:55.868736+0000, chain.objs.size()=1 2024-08-27T03:58:29.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.259+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.r015ndGPggUyWApjN4BhrEMcbkC9TTM_0 2024-08-27T03:58:29.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.259+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14053277391872565366', time=2024-08-27T05:24:58.165428+0000, chain.objs.size()=1 2024-08-27T03:58:29.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.259+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Pzzk6CdlmE4KURkWK1T72hJcUzd3S_r_0 2024-08-27T03:58:29.263 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.259+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4573458425138762424', time=2024-08-27T05:24:58.687268+0000, chain.objs.size()=1 2024-08-27T03:58:29.263 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.259+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uwyRdv1M6PWR8_Xccq_dWr4s1ghXBPk_0 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6133263924831736250', time=2024-08-27T05:24:58.980207+0000, chain.objs.size()=1 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wezmElczxOisXGS93AeI81m-LcSaQD__0 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17804869006698998428', time=2024-08-27T05:24:59.106746+0000, chain.objs.size()=1 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0JQCLCD45gkdpZ_x3AgR7UmuyqxtdiI_0 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2996300791069436865', time=2024-08-27T05:24:59.497614+0000, chain.objs.size()=1 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Qp1pLRNn2AHeH5jMCO8dzTjTgf6mkx5_0 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6799277223355809311', time=2024-08-27T05:24:59.705875+0000, chain.objs.size()=1 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LnOMTwjgM2DiQ82ccKEOPFVJn3T-CCZ_0 2024-08-27T03:58:29.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4492688536485985912', time=2024-08-27T05:24:59.977051+0000, chain.objs.size()=1 2024-08-27T03:58:29.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4ZVKq3CN7MNOpPNxj3_GTG54_TFLgJu_0 2024-08-27T03:58:29.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3877383264211503895', time=2024-08-27T05:25:01.629166+0000, chain.objs.size()=1 2024-08-27T03:58:29.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.R6TGID0H04FESTuGKuX2QWZlHavVgC0_0 2024-08-27T03:58:29.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3309471718459816825', time=2024-08-27T05:25:01.631308+0000, chain.objs.size()=1 2024-08-27T03:58:29.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XaB30ykY_ppTkGP0qi-OoOg8kpfM3sS_0 2024-08-27T03:58:29.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6592074005740070595', time=2024-08-27T05:25:02.545874+0000, chain.objs.size()=1 2024-08-27T03:58:29.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VR2s72voMVdD2baEeCCPDHdLNj8hDXw_0 2024-08-27T03:58:29.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2538305394523004830', time=2024-08-27T05:25:03.127385+0000, chain.objs.size()=1 2024-08-27T03:58:29.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gPGih-b0Q2w3kYCNyPNLXsxSpR1i-7l_0 2024-08-27T03:58:29.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7753001787713164216', time=2024-08-27T05:25:03.362687+0000, chain.objs.size()=1 2024-08-27T03:58:29.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hSypPva1_WzX9I4KvBuNM-Y-0fA-5ki_0 2024-08-27T03:58:29.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9163156439831659526', time=2024-08-27T05:25:03.603962+0000, chain.objs.size()=1 2024-08-27T03:58:29.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.A9mIcRZuLffoVpAb9_YyZZL-SywCMsR_0 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6031482335542896349', time=2024-08-27T05:25:03.715896+0000, chain.objs.size()=1 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MIPiVbhXLREzO82yyj5EcxBaHwq-bye_0 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17661817069384450218', time=2024-08-27T05:25:03.793904+0000, chain.objs.size()=1 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZDFeQhFh_OZJlDkiqU1Uh1fThuyxIiK_0 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2791972956300424647', time=2024-08-27T05:25:03.957921+0000, chain.objs.size()=1 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.T9bulPJGOL9-I8JZwo1xzQ-TGQg1WbK_0 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15379771125803257108', time=2024-08-27T05:25:04.009306+0000, chain.objs.size()=1 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6D7rcaBX18_U_2tVEML923qCyg3DJQe_0 2024-08-27T03:58:29.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10619173543274837298', time=2024-08-27T05:25:04.248433+0000, chain.objs.size()=1 2024-08-27T03:58:29.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kMrTfgl3K0JQIXiN7jmNy1KJZ-v0f4k_0 2024-08-27T03:58:29.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5423230191349158667', time=2024-08-27T05:25:05.262156+0000, chain.objs.size()=1 2024-08-27T03:58:29.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zivugYfCDAVek2wa9rzbRJTz4TQnX8R_0 2024-08-27T03:58:29.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3557354596921628964', time=2024-08-27T05:25:07.156874+0000, chain.objs.size()=1 2024-08-27T03:58:29.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.u4ioBUHPZRSbnPoPUGyHSH6O5MkyYa9_0 2024-08-27T03:58:29.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.322255399772239620', time=2024-08-27T05:25:07.159324+0000, chain.objs.size()=1 2024-08-27T03:58:29.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9BUzaXQHb2MEskfcf3Av1w5ATFLmE_H_0 2024-08-27T03:58:29.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10102876730676571891', time=2024-08-27T05:25:07.341979+0000, chain.objs.size()=1 2024-08-27T03:58:29.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ML4gYEsQ9ErH-BEkPMQL5qwZ7oE9oSg_0 2024-08-27T03:58:29.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11003486663811511430', time=2024-08-27T05:25:07.343701+0000, chain.objs.size()=1 2024-08-27T03:58:29.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CD8MNePWSM-OoFvgi2TTrssS7gMv6DC_0 2024-08-27T03:58:29.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12189630129815221031', time=2024-08-27T05:25:08.067028+0000, chain.objs.size()=1 2024-08-27T03:58:29.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jD5LfMLSaw1Y0Y5nscVVuz2MDrc44Wh_0 2024-08-27T03:58:29.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14888041220168702339', time=2024-08-27T05:25:11.056573+0000, chain.objs.size()=1 2024-08-27T03:58:29.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jNTQQZ8OQ21RsPaKGDxdktka0FNPCuD_0 2024-08-27T03:58:29.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17916966827384612853', time=2024-08-27T05:25:11.437771+0000, chain.objs.size()=1 2024-08-27T03:58:29.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3sO5isZlF9NNbBvbNSPqpIwQqMyVmVH_0 2024-08-27T03:58:29.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2652230881976753442', time=2024-08-27T05:25:12.296317+0000, chain.objs.size()=1 2024-08-27T03:58:29.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vC0HY7SIxiNtyOGeom0B7OmeRMzVItr_0 2024-08-27T03:58:29.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46164 2024-08-27T03:58:29.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=49, truncated=0, next_marker='' 2024-08-27T03:58:29.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5420314371068902179', time=2024-08-27T05:25:12.367365+0000, chain.objs.size()=1 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0PevmG0n4y8kNDheSiS1_iBbr2TbwEA_0 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9284877688940372987', time=2024-08-27T05:25:13.129100+0000, chain.objs.size()=1 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.y3iSvHQVPZvtSchzwgsh_8Fon0PR8s3_0 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.142413141829782024', time=2024-08-27T05:25:13.901998+0000, chain.objs.size()=1 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZAJE0NaUnJgU3dZNOxLW8gaG6JVsSg6_0 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3540081550691943508', time=2024-08-27T05:25:14.376646+0000, chain.objs.size()=1 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YtL0846Tdr8XeTft9vjElxpcna8fPrf_0 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15717920837859247194', time=2024-08-27T05:26:57.716818+0000, chain.objs.size()=1 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uiWE9PSbvYFRm14eOPbxHsIJ9ZMDFG1_0 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2023012385914035178', time=2024-08-27T05:26:59.410320+0000, chain.objs.size()=1 2024-08-27T03:58:29.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.awIV1LfbMRu_qkatBgv0D6kbejHlkY2_0 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13708949583007946201', time=2024-08-27T05:27:02.675383+0000, chain.objs.size()=1 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gqZZty9xlEzyOkptob-O20aqVBOXNmR_0 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15067838359126642405', time=2024-08-27T05:27:02.889283+0000, chain.objs.size()=1 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EMJ8my_N1JSG_i1xPX7iXzCZK-0-v1y_0 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2030843366576412420', time=2024-08-27T05:27:06.331736+0000, chain.objs.size()=1 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.L7U4dQvsNazbu8PJZzCV8G00gluUqOI_0 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6759412989906794936', time=2024-08-27T05:27:06.428595+0000, chain.objs.size()=1 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.oDf4Q11XIZt15N_Nb-BI81Uu7jHPkIX_0 2024-08-27T03:58:29.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5049015468353291745', time=2024-08-27T05:27:07.912454+0000, chain.objs.size()=1 2024-08-27T03:58:29.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jRnOyG4u_0y42tfgbD5lm6t8EhlsUbG_0 2024-08-27T03:58:29.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11191770157620108890', time=2024-08-27T05:27:09.959687+0000, chain.objs.size()=1 2024-08-27T03:58:29.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cqWEZ1RIA1PYd9atgOQ8GCexA_hbP38_0 2024-08-27T03:58:29.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9474227234186413666', time=2024-08-27T05:27:11.735685+0000, chain.objs.size()=1 2024-08-27T03:58:29.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BefT5e4Mr7JixM8N-HtCt73xtLoxMLe_0 2024-08-27T03:58:29.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5682226827041028170', time=2024-08-27T05:27:12.886307+0000, chain.objs.size()=1 2024-08-27T03:58:29.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rK3bB9Mfyoats9mXdo-WOjBpNfE7263_0 2024-08-27T03:58:29.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12557611584568337658', time=2024-08-27T05:27:13.656180+0000, chain.objs.size()=1 2024-08-27T03:58:29.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._7FmxOKCrRN4SM20KZl8JWkVbY5yEOh_0 2024-08-27T03:58:29.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9279362677994184396', time=2024-08-27T05:27:13.658826+0000, chain.objs.size()=1 2024-08-27T03:58:29.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZaUuGzg0p42ga-O-2eOfCeFDb3nh60C_0 2024-08-27T03:58:29.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13277962049815278508', time=2024-08-27T05:27:14.258165+0000, chain.objs.size()=1 2024-08-27T03:58:29.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mInoyNDhpu1UwKm-6g80Vif8F6L0Edc_0 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16390397064767032535', time=2024-08-27T05:27:16.521001+0000, chain.objs.size()=1 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BBQtQ0nL3Czh6O9knPQLKYtZppXCq7A_0 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1953325205929749750', time=2024-08-27T05:27:17.885099+0000, chain.objs.size()=1 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rjzi4duj5C69h8WSPb5rQWZauKxzlER_0 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7160206215753322033', time=2024-08-27T05:27:18.240358+0000, chain.objs.size()=1 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.d7ePIqWrVGGjcSxaVVLn73tiB3dNn-O_0 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15672648650656627184', time=2024-08-27T05:27:18.354524+0000, chain.objs.size()=1 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DydT-5oXaM0t82ye5qxwo1ashodi9qH_0 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4655847971518311897', time=2024-08-27T05:27:18.773765+0000, chain.objs.size()=1 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5NyqodOIhLtDF_BGMBidnZE-sQ6PJWH_0 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5696356329894920565', time=2024-08-27T05:27:21.054208+0000, chain.objs.size()=1 2024-08-27T03:58:29.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8PZPONzqn5C6fnbG9W78g7BrczFmGj3_0 2024-08-27T03:58:29.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2746756778057119330', time=2024-08-27T05:27:21.150361+0000, chain.objs.size()=1 2024-08-27T03:58:29.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.x14URaN5gRLbg09wPqsn19IxPn3Ik11_0 2024-08-27T03:58:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8175948535891681120', time=2024-08-27T05:27:25.386616+0000, chain.objs.size()=1 2024-08-27T03:58:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LbzRZ4bOgICGd4C7QoDBRRuVrLekRoh_0 2024-08-27T03:58:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6720363507392180108', time=2024-08-27T05:27:37.650887+0000, chain.objs.size()=1 2024-08-27T03:58:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.326__shadow_.cYUOHz7nV9CeWl-AvBp2NzTQ1KYCpue_0 2024-08-27T03:58:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5998368477708229210', time=2024-08-27T05:28:49.191106+0000, chain.objs.size()=1 2024-08-27T03:58:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.376__shadow_.eS0o4TF35Su4HDaTHhJA2L0MWfrBlnP_0 2024-08-27T03:58:29.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7948920532550334333', time=2024-08-27T05:30:53.384415+0000, chain.objs.size()=1 2024-08-27T03:58:29.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.454__shadow_.jLk7vS_oKSjA5r6yvP1fiynKGBEgFfV_0 2024-08-27T03:58:29.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4301215117586794691', time=2024-08-27T05:31:00.032845+0000, chain.objs.size()=1 2024-08-27T03:58:29.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.457__shadow_.4KXaFtmUFGPXXJ_ovLwEVtJNb4Ro7qG_0 2024-08-27T03:58:29.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8105648371230557307', time=2024-08-27T05:31:23.214243+0000, chain.objs.size()=1 2024-08-27T03:58:29.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.475__shadow_.wAJcRWjbvPR8NgMlmtO6-mNerNgur25_0 2024-08-27T03:58:29.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15591955393410015524', time=2024-08-27T05:31:28.541144+0000, chain.objs.size()=1 2024-08-27T03:58:29.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.13YcvjUSVq1bm99Hb50tllv_4fVHJPo_0 2024-08-27T03:58:29.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11697391404013300642', time=2024-08-27T05:32:22.242453+0000, chain.objs.size()=6 2024-08-27T03:58:29.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.1 2024-08-27T03:58:29.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.2 2024-08-27T03:58:29.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.3 2024-08-27T03:58:29.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.4 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.5 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.6 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2547888664687615959', time=2024-08-27T05:32:45.419386+0000, chain.objs.size()=1 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.511__shadow_.vEAirr6Y3ZoNKgvO-319Qt-pAkQGzvS_0 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5460238682990606488', time=2024-08-27T05:35:34.559529+0000, chain.objs.size()=1 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.522__shadow_.0cmaOagJtFuuNSoZ3uOHZGJXJRVZ5L6_0 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10050294439046483401', time=2024-08-27T05:37:28.812898+0000, chain.objs.size()=1 2024-08-27T03:58:29.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.554__shadow_.ALYaqI5fU50pAVFAh5PJZUrQKi5wiX3_0 2024-08-27T03:58:29.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11559885060198892196', time=2024-08-27T05:38:20.276899+0000, chain.objs.size()=1 2024-08-27T03:58:29.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.567__shadow_.0ovo4Ywy5o7aRzLI_eFqQCROfzYvnjr_0 2024-08-27T03:58:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3821260882509456823', time=2024-08-27T05:38:40.544695+0000, chain.objs.size()=1 2024-08-27T03:58:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:o1eAL5Ny1A57-i9R8e-WXIRPFI3bTdk_.XZxFUbOoLL9qUxQv2nd00yM1vNQsW8L_0 2024-08-27T03:58:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13040019248718360254', time=2024-08-27T05:39:50.605459+0000, chain.objs.size()=4 2024-08-27T03:58:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~LUNatxat9aFcTzRZ-Vy5iEl-LrBkH2s.1 2024-08-27T03:58:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~LUNatxat9aFcTzRZ-Vy5iEl-LrBkH2s.2 2024-08-27T03:58:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~LUNatxat9aFcTzRZ-Vy5iEl-LrBkH2s.3 2024-08-27T03:58:29.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~LUNatxat9aFcTzRZ-Vy5iEl-LrBkH2s.4 2024-08-27T03:58:29.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3341361123076110206', time=2024-08-27T05:39:55.783106+0000, chain.objs.size()=1 2024-08-27T03:58:29.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:nFDVw8hhSndANU10bMv39S6pCjMFqYX_.lKsfp870wGR-Kkx7-56qZz6SViOl_4n_0 2024-08-27T03:58:29.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3553118029502703004', time=2024-08-27T05:40:00.594703+0000, chain.objs.size()=1 2024-08-27T03:58:29.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:A.1zT7kMJ3t.oYi1gvmbRwYRKatiVrJ_.yxaAqDWj2jDej5alUViZhF4qu-qi0fx_0 2024-08-27T03:58:29.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4422016031753785988', time=2024-08-27T05:40:16.752423+0000, chain.objs.size()=1 2024-08-27T03:58:29.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:iurcq6SrprhoVgG7bdm7E86hHSZhV86_.mT1FDaC0JHjiltUr3-V-pxYatIgv4rQ_0 2024-08-27T03:58:29.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9452609281287432047', time=2024-08-27T05:45:18.718168+0000, chain.objs.size()=1 2024-08-27T03:58:29.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.620__shadow_.HYGqsjatROqhgqia7yBFry4iReMUhMq_0 2024-08-27T03:58:29.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6283639624676634020', time=2024-08-27T05:45:50.179797+0000, chain.objs.size()=1 2024-08-27T03:58:29.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.638__shadow_.i33x7U_V0qL7H7VBNDvu1w4MchNghe0_0 2024-08-27T03:58:29.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15198857623767260939', time=2024-08-27T05:46:55.993668+0000, chain.objs.size()=1 2024-08-27T03:58:29.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.660__shadow_.toVJ1mDFWmgK7gTrj__tw0IpBqUfccS_0 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5625390588270847591', time=2024-08-27T05:47:33.414337+0000, chain.objs.size()=1 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.687__shadow:79x4SSO8hjv1pIWLRT4T-lVtZGDKYl6_.42R8JoB_vWDZ8khaAETqlXFbL8byfYu_0 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6513079926014489226', time=2024-08-27T05:47:51.373667+0000, chain.objs.size()=1 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.697__shadow:etMYg5TlHHIioeRMGLrwkMEX2fFakvW_.pb70KPVKyL0tuyekseRo21EjM5vuuaO_0 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10616587879714258642', time=2024-08-27T05:48:00.124375+0000, chain.objs.size()=1 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.702__shadow:28qmEmCM7ItJJhQ1qfKEd9hRWT-MmZW_.GMdxhcGYvT8THYkAZgpQCmi7XJJiEhY_0 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8673225435196687815', time=2024-08-27T05:48:06.797921+0000, chain.objs.size()=1 2024-08-27T03:58:29.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.706__shadow:ZNoaSWzOVcfy-pDtqZnYqTVRGST.EWm_.sdPiXAjGN-UYa7fZglEfy_q9AWYRHQb_0 2024-08-27T03:58:29.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14702893682616797491', time=2024-08-27T05:48:21.784746+0000, chain.objs.size()=1 2024-08-27T03:58:29.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.709__shadow:Rh96wbHX2MDTwN79wMJKj69Frcj9b3f_.ov9hzItYFoCdns3VZRl2GWfQNaLpi1w_0 2024-08-27T03:58:29.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-08-27T03:58:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43349' 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1265702419953480796', time=2024-08-27T05:20:36.293369+0000, chain.objs.size()=1 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5MgKyATxh7EKdGV2xkbgkDIxnmwHDe-_0 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4415495374262896162', time=2024-08-27T05:20:37.352131+0000, chain.objs.size()=1 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FHwrhqYf1RWsb2cwxgPGkCPk9mFDZeR_0 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9620910233987127250', time=2024-08-27T05:20:37.607842+0000, chain.objs.size()=1 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sfMp29JqhILARSoRzfhJammIqHskw3b_0 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5339125468570220860', time=2024-08-27T05:20:39.269573+0000, chain.objs.size()=1 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NgueGTTeC6SvCScKHxBkA4uzgVCPa9V_0 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7215333757132964172', time=2024-08-27T05:20:39.400983+0000, chain.objs.size()=1 2024-08-27T03:58:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0g74w_2zDr-BzOPXYU6CeqnB0VIDvh-_0 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4362669040681328752', time=2024-08-27T05:20:40.587763+0000, chain.objs.size()=1 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BFDVh_-lt9r0_LrBDfuI3KqKIASf2N1_0 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4987546952993179549', time=2024-08-27T05:20:40.893584+0000, chain.objs.size()=1 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sVkfthxmtC6iBHGHtq__3wHZVaNCZ1S_0 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7632368591184051766', time=2024-08-27T05:20:41.869395+0000, chain.objs.size()=1 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vonzQ4iEMbJ6In50rV1gZbRYeYvglej_0 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6045241443961123051', time=2024-08-27T05:20:42.148252+0000, chain.objs.size()=1 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KQyluXSJMz5wKQPXEJbTIntvzStLO6D_0 2024-08-27T03:58:29.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15644507637213765638', time=2024-08-27T05:20:42.185924+0000, chain.objs.size()=1 2024-08-27T03:58:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Cjw2I2Tz6KPuhZKAv25WpgFIEml5ok0_0 2024-08-27T03:58:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1192755284888829277', time=2024-08-27T05:20:43.681353+0000, chain.objs.size()=1 2024-08-27T03:58:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eQlBGQKeq_Q44jAVo3bMx9nk7Glvu15_0 2024-08-27T03:58:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13059170146654282860', time=2024-08-27T05:20:44.466669+0000, chain.objs.size()=1 2024-08-27T03:58:29.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RcjI9SGk_bdCIE4fsx-xd1wIzhA8HDE_0 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17222481355815288863', time=2024-08-27T05:20:44.468674+0000, chain.objs.size()=1 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.clyCosK6nwa29Oj102a5mN-MxWaEsYy_0 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5635374146077413367', time=2024-08-27T05:20:45.426231+0000, chain.objs.size()=1 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.X-uj-AIWbpN7S3pdvTOhylt6FelWiLY_0 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11225674452389063516', time=2024-08-27T05:20:45.665882+0000, chain.objs.size()=1 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SgPXk8_ttYx6ZDh0ECJ8HIjluzbSM6__0 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8094182456138697932', time=2024-08-27T05:20:45.865132+0000, chain.objs.size()=1 2024-08-27T03:58:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pRmcu4c6Pb228VHLJSLuRDNQpFLFYtC_0 2024-08-27T03:58:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15256847147590786050', time=2024-08-27T05:20:47.026666+0000, chain.objs.size()=1 2024-08-27T03:58:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FRRrkILDfiUPQnLHBAvsbqThV9UzcUk_0 2024-08-27T03:58:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13633013992755216375', time=2024-08-27T05:20:47.609238+0000, chain.objs.size()=1 2024-08-27T03:58:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Gqgdq6qhicIyjE95NwwZu7N-94437zs_0 2024-08-27T03:58:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1684892794699398870', time=2024-08-27T05:20:49.271072+0000, chain.objs.size()=1 2024-08-27T03:58:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QsCLnnUczFIo-D8rQDL4k-wEszw0kAL_0 2024-08-27T03:58:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16848009164695094059', time=2024-08-27T05:20:49.698371+0000, chain.objs.size()=1 2024-08-27T03:58:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5pBwG_NvjJAJOMkhTWM50nDCmvw5Y9L_0 2024-08-27T03:58:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.308323995245151469', time=2024-08-27T05:20:50.774170+0000, chain.objs.size()=1 2024-08-27T03:58:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.DL08o4CmL16wnb8z2Rk4dj396lPg8tv_0 2024-08-27T03:58:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12361630933735608910', time=2024-08-27T05:20:51.891410+0000, chain.objs.size()=1 2024-08-27T03:58:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LzyTw87ew9RNNSepSazEbpnTXsbf2ZK_0 2024-08-27T03:58:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5381646334027300988', time=2024-08-27T05:20:53.346646+0000, chain.objs.size()=1 2024-08-27T03:58:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-cSVyi4ThCw_WRULpo0CpNGq8Wu6ldA_0 2024-08-27T03:58:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17196104711564709329', time=2024-08-27T05:20:54.426193+0000, chain.objs.size()=1 2024-08-27T03:58:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8_1g7OE-YZXIMT4JN3Y7tJDaANFVhRw_0 2024-08-27T03:58:29.331 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15839336667306000929', time=2024-08-27T05:20:54.865099+0000, chain.objs.size()=1 2024-08-27T03:58:29.331 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8POqf9FCIN9LO8XmX24xQI-uNvGECgQ_0 2024-08-27T03:58:29.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16136330718597975171', time=2024-08-27T05:20:55.398703+0000, chain.objs.size()=1 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._bdDd-P83HBqP15YGEWLJFwi41PMxlB_0 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15266376955731619744', time=2024-08-27T05:20:55.637714+0000, chain.objs.size()=1 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zj8o9p61Y92KbZbw-_LR14wbeEvK6Fn_0 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3295468913837667330', time=2024-08-27T05:20:56.853160+0000, chain.objs.size()=1 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rfW4J2dJXNiZgsFAyTaGDBp8HWhHQrg_0 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9633653102240934874', time=2024-08-27T05:20:56.856417+0000, chain.objs.size()=1 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zX7hoVLL393J8P-8sG4qxC1VUsJVbku_0 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1383941301654878249', time=2024-08-27T05:20:57.258316+0000, chain.objs.size()=1 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.UxrwdMdjm8c0v-_waY6L9ZPYLfMv4Tl_0 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.236151296088912134', time=2024-08-27T05:20:57.316952+0000, chain.objs.size()=1 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3IRXV0lYi4cwi9ntH6LtLfXW8BdG6Ga_0 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10990315562492354270', time=2024-08-27T05:20:58.073462+0000, chain.objs.size()=1 2024-08-27T03:58:29.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.a0gGGQ68aHs0mg8hjbHTKR05cj1p6K-_0 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.451394968003731877', time=2024-08-27T05:20:58.633187+0000, chain.objs.size()=1 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hdrmDyIRavAqNH8w-u-B4MG2xJex_J8_0 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11255413532589126754', time=2024-08-27T05:21:00.001800+0000, chain.objs.size()=1 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FH501HspyvSODBf9mg6ZSM3LdgSiV3G_0 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8410688580582815744', time=2024-08-27T05:21:00.493998+0000, chain.objs.size()=1 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rrIe1WW-Bk7UIywrGguUyEK1Oc6hMpG_0 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15407802071257900592', time=2024-08-27T05:21:00.825876+0000, chain.objs.size()=1 2024-08-27T03:58:29.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aYYeeh_boTF_9lI00U_LK3FxRtoQLUb_0 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15577914281674785415', time=2024-08-27T05:21:01.601202+0000, chain.objs.size()=1 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.seaXmzg-CE1Xj90_LnW-a3akWMEWqjk_0 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14955467215320872405', time=2024-08-27T05:21:03.506412+0000, chain.objs.size()=1 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HkqIAMpFudA8FcVVZuVZvg8YrtyFnnO_0 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9536149853549832689', time=2024-08-27T05:21:03.549083+0000, chain.objs.size()=1 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jJKd_c8cKd5yMYk8e8v_U7XdE4Dnub2_0 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1181335983441819526', time=2024-08-27T05:21:16.335744+0000, chain.objs.size()=1 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.263__shadow_.nf9CpT2pdYNC4w23voxrL67KEHA1nRJ_0 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1440152954950773337', time=2024-08-27T05:21:26.861084+0000, chain.objs.size()=1 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.269__shadow_.mr0lEursNtRN3frcT5VWwjhh8g7gyE0_0 2024-08-27T03:58:29.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5746027607350766381', time=2024-08-27T05:21:32.376159+0000, chain.objs.size()=1 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.272__shadow_.vJtzWPR9rrjQbjrXiUCJQ11bSh6oyV4_0 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9414059436228245811', time=2024-08-27T05:21:41.646628+0000, chain.objs.size()=1 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.277__shadow_.Hn3eBEWMNXGKaPm7bamd5K0jMRzklOm_0 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17853795419327686676', time=2024-08-27T05:21:52.088358+0000, chain.objs.size()=1 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.282__shadow_.pldeVA61QSFtRAl5oLYM-1j-hTmrNKM_0 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8759278449844221625', time=2024-08-27T05:22:02.703648+0000, chain.objs.size()=1 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.HQYHjzZdlwo7TPt497191KuWVAKpZYv_0 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15037586773648436199', time=2024-08-27T05:22:07.854209+0000, chain.objs.size()=1 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.wQdqCC53XsthBPuuPkrUH4yuvfSdZtG_0 2024-08-27T03:58:29.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11055819553328973506', time=2024-08-27T05:22:07.879689+0000, chain.objs.size()=1 2024-08-27T03:58:29.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.uD3avDwWsb1svMoK47RtB7CAh-GSjb5_0 2024-08-27T03:58:29.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.384950578128674905', time=2024-08-27T05:22:08.077128+0000, chain.objs.size()=1 2024-08-27T03:58:29.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.9MR6tQWiBDK-Gp0pqCa9e_LqMiwdxlo_0 2024-08-27T03:58:29.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4253482047337417590', time=2024-08-27T05:22:30.731685+0000, chain.objs.size()=1 2024-08-27T03:58:29.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.299__shadow_.GUCneFov5wWtJz_kROBNEyb67hJLBBY_0 2024-08-27T03:58:29.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11619961679582809771', time=2024-08-27T05:24:46.425652+0000, chain.objs.size()=1 2024-08-27T03:58:29.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2LzhxqHSh6O4s9cKCDviBlytZb4xOz4_0 2024-08-27T03:58:29.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4201966511524920903', time=2024-08-27T05:24:50.373731+0000, chain.objs.size()=1 2024-08-27T03:58:29.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yX4gHKclnMKcRXyRLhiAmnxaUfmfdk7_0 2024-08-27T03:58:29.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8118643154172504549', time=2024-08-27T05:24:51.583057+0000, chain.objs.size()=1 2024-08-27T03:58:29.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.V5wQATgmbaQ21ZM4ALjisvNsJfG14-O_0 2024-08-27T03:58:29.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15395239391177119192', time=2024-08-27T05:24:55.135410+0000, chain.objs.size()=1 2024-08-27T03:58:29.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DRV5IAQiTZxYjKp3VGTAE5HQ09D46ze_0 2024-08-27T03:58:29.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8570758484023225264', time=2024-08-27T05:24:58.157657+0000, chain.objs.size()=1 2024-08-27T03:58:29.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fBD0wDYPL0tc9R2_MMn5T5QK4DH1wjg_0 2024-08-27T03:58:29.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17322805571839105367', time=2024-08-27T05:24:58.163923+0000, chain.objs.size()=1 2024-08-27T03:58:29.349 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XVbuuIlDTmeupcGTDtJQnOqg04Cow_-_0 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8396121530954109152', time=2024-08-27T05:24:59.671133+0000, chain.objs.size()=1 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Ff_pvGkdNpigj4yXijDST2ikwbCnni6_0 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17251983613960379361', time=2024-08-27T05:25:00.017835+0000, chain.objs.size()=1 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.W2U7ejh6TR-EAPibSjdbqcbHXa_HhrY_0 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10854589951823679696', time=2024-08-27T05:25:00.382865+0000, chain.objs.size()=1 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._U_0_x5l0OCjj4r62qnAU66OwpB6IcS_0 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7996948261336884370', time=2024-08-27T05:25:02.205789+0000, chain.objs.size()=1 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rwqcyslh3OEj1Sz04GDW5wGA8J6ortX_0 2024-08-27T03:58:29.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13205347508883318976', time=2024-08-27T05:25:02.509273+0000, chain.objs.size()=1 2024-08-27T03:58:29.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bDanI9vVgUHVwS2T6qFMrWsUVUgXwXV_0 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.425120420219688869', time=2024-08-27T05:25:02.648803+0000, chain.objs.size()=1 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uHl4SIpScbrApP1aWS5DhL5ZxteQa4B_0 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16431050513222576640', time=2024-08-27T05:25:03.887000+0000, chain.objs.size()=1 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Bz2v4b4A88fPYyJHC5XAWYXXPKi8rU5_0 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14107298388546222518', time=2024-08-27T05:25:04.250304+0000, chain.objs.size()=1 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YG7RL8g5mblLOeaxt2X-tL8MaLwavLN_0 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6885432879935011515', time=2024-08-27T05:25:05.673701+0000, chain.objs.size()=1 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CkzE1ZP4wjf9smjD2l3uxmvYIiXwUrR_0 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8898127114586867187', time=2024-08-27T05:25:05.913450+0000, chain.objs.size()=1 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uVlLOS4qCkdtJ9UuGWcr94MFzoD5Gjf_0 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15130573193226459594', time=2024-08-27T05:25:06.031906+0000, chain.objs.size()=1 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kgi51XdkHoZ03P3hfkXX5irlcv48hAT_0 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16373656626567230580', time=2024-08-27T05:25:07.045530+0000, chain.objs.size()=1 2024-08-27T03:58:29.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QSsO5pk4GoB-fx5qPPOZ83L7Z0Mk8FM_0 2024-08-27T03:58:29.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8444364153668489540', time=2024-08-27T05:25:07.876527+0000, chain.objs.size()=1 2024-08-27T03:58:29.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.U4EhuGYZCazdXSvGcshJGvBgPbsdruw_0 2024-08-27T03:58:29.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14431448150008165146', time=2024-08-27T05:25:08.657076+0000, chain.objs.size()=1 2024-08-27T03:58:29.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iX4eyfhyQccS6SaysAueIzJq-OKkoLM_0 2024-08-27T03:58:29.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6426044341862122119', time=2024-08-27T05:25:09.164106+0000, chain.objs.size()=1 2024-08-27T03:58:29.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OaxodVrWE-yuvPpObrCb9mp7bGWo8A-_0 2024-08-27T03:58:29.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1567570612221423039', time=2024-08-27T05:25:10.614787+0000, chain.objs.size()=1 2024-08-27T03:58:29.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zcUht4WbAMI15sUBwjIMCJk8iCw5VyH_0 2024-08-27T03:58:29.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8154336011873844685', time=2024-08-27T05:25:10.687366+0000, chain.objs.size()=1 2024-08-27T03:58:29.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.V6TCE0EmV_Zg3hvQv09H1dfx5kVO3TB_0 2024-08-27T03:58:29.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3490870527680718717', time=2024-08-27T05:25:11.499483+0000, chain.objs.size()=1 2024-08-27T03:58:29.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LCyBazb8SQdbObKKVuLM0i510QGb1Pu_0 2024-08-27T03:58:29.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6413352107374012135', time=2024-08-27T05:25:11.527086+0000, chain.objs.size()=1 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Fzv7J3HwhRdRi0R4YVlsetNJ0XfELfA_0 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9892559856448827709', time=2024-08-27T05:25:12.211499+0000, chain.objs.size()=1 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2SIpxxLHpeh7aqN0SnZIreTwdeRcmT__0 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1881338892632843997', time=2024-08-27T05:25:12.690724+0000, chain.objs.size()=1 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.c7kzLYVvKpK4iUj0TqeVQl_Co94Uatd_0 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9142799767636320162', time=2024-08-27T05:26:58.395693+0000, chain.objs.size()=1 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9iAQCCM4gQkQI9iQbej-nev36QcgY4O_0 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15527824140698066502', time=2024-08-27T05:26:58.914033+0000, chain.objs.size()=1 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9aoog3t4-JGW73IFK9JuTmqdOPplsK4_0 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14921718655137285692', time=2024-08-27T05:26:59.850168+0000, chain.objs.size()=1 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HRsaybPC39PTHPb6CAA5pEtLA_wYP3Q_0 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1173242043496456081', time=2024-08-27T05:27:01.782212+0000, chain.objs.size()=1 2024-08-27T03:58:29.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Bqx8JJZ7CGS-TYJofZRXyEVZCHawt6R_0 2024-08-27T03:58:29.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12633501680023970679', time=2024-08-27T05:27:01.784123+0000, chain.objs.size()=1 2024-08-27T03:58:29.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.iS0xv0JqLJrhFUfYE2HxRoPIYNVwGfw_0 2024-08-27T03:58:29.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13910299498226136143', time=2024-08-27T05:27:02.095319+0000, chain.objs.size()=1 2024-08-27T03:58:29.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FHOCm1ZQHwWgnhwbjQKR1D7JFg3G3jh_0 2024-08-27T03:58:29.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16863621334074328479', time=2024-08-27T05:27:02.241176+0000, chain.objs.size()=1 2024-08-27T03:58:29.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EQVsh5VGcsZyhYpZgpzMYEAjxCUAzul_0 2024-08-27T03:58:29.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17820309850639576155', time=2024-08-27T05:27:02.428281+0000, chain.objs.size()=1 2024-08-27T03:58:29.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wVwGdGuP4XTh-g-6VNB3xegSHQAweyr_0 2024-08-27T03:58:29.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15491429288721095231', time=2024-08-27T05:27:02.864404+0000, chain.objs.size()=1 2024-08-27T03:58:29.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0zvJlMWH07t3ZsaPgJP7QBWW2gpTpy1_0 2024-08-27T03:58:29.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18306717608048642163', time=2024-08-27T05:27:03.703112+0000, chain.objs.size()=1 2024-08-27T03:58:29.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Aq_zEuBEXapM5ZQNhcKMBND1UKwNNmd_0 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5296577967665022173', time=2024-08-27T05:27:04.089029+0000, chain.objs.size()=1 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7Vq2vXATO28M6bSIg-vfYG-0JMzNxBQ_0 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3917820016986337582', time=2024-08-27T05:27:04.507846+0000, chain.objs.size()=1 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JiYQj-Rj611mlqTHHnhwFe815Rfzwx4_0 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.161604131451644881', time=2024-08-27T05:27:05.386856+0000, chain.objs.size()=1 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bKNcWXyM-ahnbmJJ-93doeVkw95Cpr__0 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9253505660133233172', time=2024-08-27T05:27:07.712533+0000, chain.objs.size()=1 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3adIYcfL6f0I9TbB-LHT6CEATOT3sum_0 2024-08-27T03:58:29.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16116273317770781787', time=2024-08-27T05:27:10.222945+0000, chain.objs.size()=1 2024-08-27T03:58:29.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nWI9k5oSQ4_UfPKEsWoZHrYuZc3dR_W_0 2024-08-27T03:58:29.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14517860669116567486', time=2024-08-27T05:27:10.412704+0000, chain.objs.size()=1 2024-08-27T03:58:29.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8dvUuDbTHK_y7lpjEMrRdyJLVW-acSO_0 2024-08-27T03:58:29.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9866340679816481659', time=2024-08-27T05:27:13.224928+0000, chain.objs.size()=1 2024-08-27T03:58:29.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bNph4Y-EC149eBTnxQegnB4cDUJiyDl_0 2024-08-27T03:58:29.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17974600821770624743', time=2024-08-27T05:27:13.727579+0000, chain.objs.size()=1 2024-08-27T03:58:29.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mHKO0q-5iAMEvWhR2O0NPnyqMgaq5BW_0 2024-08-27T03:58:29.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17342895460053168541', time=2024-08-27T05:27:13.996154+0000, chain.objs.size()=1 2024-08-27T03:58:29.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.SwLma6UFuZNfAOJphwunFLwbfC0ud8l_0 2024-08-27T03:58:29.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1945333328090932389', time=2024-08-27T05:27:14.031033+0000, chain.objs.size()=1 2024-08-27T03:58:29.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6VFqA4tLZjSdJg_OEJvdbet2cWhbUuN_0 2024-08-27T03:58:29.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7058324190015795775', time=2024-08-27T05:27:15.043858+0000, chain.objs.size()=1 2024-08-27T03:58:29.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.adbtQU9SkmubykAlipAKAPfBxxkw4NS_0 2024-08-27T03:58:29.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9449707479890132743', time=2024-08-27T05:27:15.294466+0000, chain.objs.size()=1 2024-08-27T03:58:29.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.i8WjO7n1G5tH1hiYDw8oU-BtIktVbAr_0 2024-08-27T03:58:29.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16402671432174479614', time=2024-08-27T05:27:17.625340+0000, chain.objs.size()=1 2024-08-27T03:58:29.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.C857YCDOlHPsHCvmkdghPN12URJ3scP_0 2024-08-27T03:58:29.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16005562030752747648', time=2024-08-27T05:27:17.627161+0000, chain.objs.size()=1 2024-08-27T03:58:29.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.oFQISV50wlKHBy1TpLoGH2Vm3xLvaIX_0 2024-08-27T03:58:29.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43349 2024-08-27T03:58:29.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-08-27T03:58:29.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17428165816013055630', time=2024-08-27T05:27:20.737356+0000, chain.objs.size()=1 2024-08-27T03:58:29.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QebejZdE4rSscFFj2JVFbVW_UlFwZo5_0 2024-08-27T03:58:29.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2264930008484665940', time=2024-08-27T05:27:20.963009+0000, chain.objs.size()=1 2024-08-27T03:58:29.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.diRciwAENjF_dW2D1tKEGbMQ7ChOcDd_0 2024-08-27T03:58:29.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8304602229998148062', time=2024-08-27T05:27:21.047321+0000, chain.objs.size()=1 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.WAGb0hpU3EsyfYAIEyDu-lKBvxwLzJ2_0 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7128493889729398932', time=2024-08-27T05:27:21.482576+0000, chain.objs.size()=1 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.WAuKwmsGjJjT1QfLZ-qudqQpEy2-BNC_0 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.722074562363244559', time=2024-08-27T05:27:22.748587+0000, chain.objs.size()=1 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3K0JHqjJ8yZZ2xgmlkzZa_6KWrOpAYQ_0 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2236631192413500242', time=2024-08-27T05:27:23.732655+0000, chain.objs.size()=1 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LLs1sMU1jw8xAbnjZTBGNI6rsveh-Da_0 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14654840252544825950', time=2024-08-27T05:27:24.458207+0000, chain.objs.size()=1 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zb7wzkOL5CFepEQw6ga_VU3lTAkQTay_0 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5209993169627762008', time=2024-08-27T05:27:25.915948+0000, chain.objs.size()=1 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.d69zhDUV7Vtd4Sl9BX_efiHcr6aJSC5_0 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7998007213137829971', time=2024-08-27T05:30:42.469494+0000, chain.objs.size()=1 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.449__shadow_.suiQDquapFOsQSUAlNrs3eRQmTTgsM8_0 2024-08-27T03:58:29.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2546357052331949158', time=2024-08-27T05:31:30.649528+0000, chain.objs.size()=1 2024-08-27T03:58:29.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.478__shadow_.DCbL9W4TD5EylJv2dYEDjStrT5TI8eO_0 2024-08-27T03:58:29.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17887805240121384463', time=2024-08-27T05:32:34.249991+0000, chain.objs.size()=1 2024-08-27T03:58:29.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.509__shadow_.NRc8LA2Wd3ZefQNF-w2z-TUgdZjYaLI_0 2024-08-27T03:58:29.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2380249455662544506', time=2024-08-27T05:35:35.196134+0000, chain.objs.size()=2 2024-08-27T03:58:29.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.522__multipart_mymultipart.2~tx0bgKVvlp4FoKXUYRM5dR5heF0pKsS.1 2024-08-27T03:58:29.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.522__multipart_mymultipart.2~tx0bgKVvlp4FoKXUYRM5dR5heF0pKsS.2 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12116226631576769323', time=2024-08-27T05:36:50.402403+0000, chain.objs.size()=1 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.545__shadow_._zH7z8OJrVNXAVmRl0w7D_OeKifTvan_0 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3374490614714075185', time=2024-08-27T05:38:04.508559+0000, chain.objs.size()=1 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:64HA6B-uocifuxU7xx0Tx82T4zZFAZL_.AbGq-6P-D4EZ-ZRQlirxbjia_SLf34W_0 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10361515300732876374', time=2024-08-27T05:39:08.658696+0000, chain.objs.size()=1 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:Prnf1wxXw-0CjOrFT1pyCYnDCAOAgpS_.BGndyQgJ0dttqYXKsGt2_a6HvLA28eR_0 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.254050480435710600', time=2024-08-27T05:45:41.283406+0000, chain.objs.size()=1 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.634__shadow_.JRrADlp2d3UsC57pshfxlFhdI0izBSN_0 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7849084905092098930', time=2024-08-27T05:45:41.855320+0000, chain.objs.size()=1 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.635__shadow_.uavSGXOWSj_ddIc99Fvp3YGYiGLyzlu_0 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5578437015588450395', time=2024-08-27T05:46:06.717320+0000, chain.objs.size()=1 2024-08-27T03:58:29.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.644__shadow_.9My0WwAi0KnzDfNGSrFj7zZlkPbnwPP_0 2024-08-27T03:58:29.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9038079263847352211', time=2024-08-27T05:48:05.387839+0000, chain.objs.size()=1 2024-08-27T03:58:29.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.705__multipart_file1.2~W4FS8B7U8p7xjnGQ35gkER13MXr8VA7.1 2024-08-27T03:58:29.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-08-27T03:58:29.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42854' 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16593659157338683572', time=2024-08-27T05:12:53.166396+0000, chain.objs.size()=1 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.141__shadow_.b4Yj7572mnsCfXrZzXbgtvfDoMXiLyg_0 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16353158743332103748', time=2024-08-27T05:13:21.186535+0000, chain.objs.size()=2 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.mJuv2KEDmGZG48eQcmm1KJNyKi1p4PM_0 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.mJuv2KEDmGZG48eQcmm1KJNyKi1p4PM_1 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3741303998873211569', time=2024-08-27T05:14:18.708360+0000, chain.objs.size()=1 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.173__shadow_.IzFZE7-QFTcf7xp-INL3qkxFbr0J7oz_0 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5871269994839923892', time=2024-08-27T05:18:07.154113+0000, chain.objs.size()=1 2024-08-27T03:58:29.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.231__shadow_.4ubAwAkat_dfIJUCgzVhdzOSiUnoHgf_0 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16265315705451842776', time=2024-08-27T05:18:14.660984+0000, chain.objs.size()=1 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.235__shadow_.QEvkJiH69d2BjLAMnjHh-T8fTfWBuXx_0 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18046748717296631928', time=2024-08-27T05:18:40.380262+0000, chain.objs.size()=1 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.248__shadow_.BroZRen6Pf9ztSZvrwwBISEAiwT36V3_0 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1053532875609828148', time=2024-08-27T05:20:36.054599+0000, chain.objs.size()=1 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jYU-zY_KigBfpwgzIByp0NGrbuH3PQ9_0 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9568765824141940431', time=2024-08-27T05:20:36.866276+0000, chain.objs.size()=1 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HikpnOwYO2N0VtmGTIiLgFrzYOeQHWG_0 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12773632885724726390', time=2024-08-27T05:20:37.968246+0000, chain.objs.size()=1 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Slyf7gXVFMcuT688FOTM7dx2y34UguQ_0 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14384332221996503438', time=2024-08-27T05:20:37.971154+0000, chain.objs.size()=1 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZgtseX4QPqk7z5JQrvQpzpmTNDhRvMI_0 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18280845420244507753', time=2024-08-27T05:20:40.774199+0000, chain.objs.size()=1 2024-08-27T03:58:29.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sEqAfaKetOBmMnFOW3NrmThfbHHJB01_0 2024-08-27T03:58:29.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3073038580116435259', time=2024-08-27T05:20:41.216242+0000, chain.objs.size()=1 2024-08-27T03:58:29.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.U_sh009HRHpvm0ln7xIOM1W7DiI8lIV_0 2024-08-27T03:58:29.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7728983013060095010', time=2024-08-27T05:20:43.144150+0000, chain.objs.size()=1 2024-08-27T03:58:29.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gJZvwoe8dyseaq8nfC93pw8FYqQQ4wF_0 2024-08-27T03:58:29.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16013889915102460007', time=2024-08-27T05:20:43.212156+0000, chain.objs.size()=1 2024-08-27T03:58:29.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KeBwFVH3kGQ4But0YiACKMi1Gs2rBx4_0 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11844152173395435974', time=2024-08-27T05:20:44.034207+0000, chain.objs.size()=1 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sdfWm1LzOgBRdQuUYifXll6tgxO60bA_0 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15011705897057468951', time=2024-08-27T05:20:44.609745+0000, chain.objs.size()=1 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6t6tGykJBsqYu7x5vRg5T8OrFPYOBNm_0 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11139561827423938526', time=2024-08-27T05:20:47.763149+0000, chain.objs.size()=1 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FtUGwusLvm1y0wei_Ve2hzpz7H_WfLU_0 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7023432347835974604', time=2024-08-27T05:20:48.266858+0000, chain.objs.size()=1 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.k8T6KtMKWRR42sJZfDrvei2DSumPoFS_0 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13569901686058257211', time=2024-08-27T05:20:49.775375+0000, chain.objs.size()=1 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.h0ysePOm1YXm4tYmJ7Jp1MoWy5KQuXh_0 2024-08-27T03:58:29.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17023601340998274966', time=2024-08-27T05:20:49.884814+0000, chain.objs.size()=1 2024-08-27T03:58:29.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HluZIQiLKHaBXL1s4xTNjmYwpOu6zY0_0 2024-08-27T03:58:29.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2119775447033949623', time=2024-08-27T05:20:51.782203+0000, chain.objs.size()=1 2024-08-27T03:58:29.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ES0dDDZAuA-K_Kj76ic6AX1qx6T97ZB_0 2024-08-27T03:58:29.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2233777422011332736', time=2024-08-27T05:20:51.784450+0000, chain.objs.size()=1 2024-08-27T03:58:29.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XHgSIT1-Cz-301WfGbI3HES-FqFsQRp_0 2024-08-27T03:58:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3430231222375572923', time=2024-08-27T05:20:52.231242+0000, chain.objs.size()=1 2024-08-27T03:58:29.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TzAzjNmV7cSM7lJjklWWpnTEZKJFpXT_0 2024-08-27T03:58:29.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5979767200300778771', time=2024-08-27T05:20:54.842739+0000, chain.objs.size()=1 2024-08-27T03:58:29.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VpXJZSDVdbYFO2vFxeuooR_GEX-DVEn_0 2024-08-27T03:58:29.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15270198014025380193', time=2024-08-27T05:20:55.332140+0000, chain.objs.size()=1 2024-08-27T03:58:29.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.plR6om5DU4wJjaZH1EoziEwFJ2d71by_0 2024-08-27T03:58:29.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8262558193394185213', time=2024-08-27T05:20:56.298358+0000, chain.objs.size()=1 2024-08-27T03:58:29.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.T2hWrDgBFNxPl6DiF2rGXwAvQou3QcR_0 2024-08-27T03:58:29.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9181986977944987692', time=2024-08-27T05:20:56.788571+0000, chain.objs.size()=1 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WMzHlGV3c5kAfYnUStL0F2Kis7H9ZSl_0 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9147545492380182863', time=2024-08-27T05:20:56.983320+0000, chain.objs.size()=1 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jEuL2hoyxM8A8ukEcm8DXqkpBhJ2-2D_0 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10085116788111645492', time=2024-08-27T05:20:58.092137+0000, chain.objs.size()=1 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.C-Qt5_3Z3XppGKHVp5uarrr3f5xJhaa_0 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8916999960606619906', time=2024-08-27T05:20:58.178850+0000, chain.objs.size()=1 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Mdd0iwHXOCbh7D3hQ3IXo2KOuWYYB0h_0 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3822676274288107717', time=2024-08-27T05:20:59.772561+0000, chain.objs.size()=1 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TIeY8uIGonPixdumrHsevqQJ_b96u3__0 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11323206365916195539', time=2024-08-27T05:20:59.774709+0000, chain.objs.size()=1 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iUaCvcqEJ6mNN5e78ddunviq5qrrLIm_0 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7163055167164473007', time=2024-08-27T05:21:02.408987+0000, chain.objs.size()=1 2024-08-27T03:58:29.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hZSf5eGVNFJWMw2mIRDnTzSXgZTxLZO_0 2024-08-27T03:58:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16550196600047909808', time=2024-08-27T05:21:04.207774+0000, chain.objs.size()=1 2024-08-27T03:58:29.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._4mwv3X-zTsJ6uLAv1R6eTkyC7xLagj_0 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18123565500000293474', time=2024-08-27T05:21:07.714520+0000, chain.objs.size()=1 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.258__shadow_.zrmeRusUflsqCgmTpkelhdutRaAK7Xe_0 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11973745334525127244', time=2024-08-27T05:21:37.916414+0000, chain.objs.size()=1 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.275__shadow_.gLNK4KCNfMgpzYDt81ihEsYxE-ypc7z_0 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.284178382772826724', time=2024-08-27T05:21:39.739831+0000, chain.objs.size()=1 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.276__shadow_.dVWjpHVHhnDZcPSVoOnEVCjqKIm8kl9_0 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14040039883396900087', time=2024-08-27T05:21:48.207877+0000, chain.objs.size()=1 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.280__shadow_.NYJa1IzHRbwGkXVlKVY2Lx61AHSCUGd_0 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6458690776895656119', time=2024-08-27T05:22:07.841933+0000, chain.objs.size()=1 2024-08-27T03:58:29.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.gbEy_oAXvJEK9crwhCurgTvfn3ynFP6_0 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1000829464954190458', time=2024-08-27T05:22:19.585068+0000, chain.objs.size()=1 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.293__shadow_.2fTJBdmAiByrCmjTjSpD1YwPWcULFJ8_0 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2589372957445971199', time=2024-08-27T05:24:47.340938+0000, chain.objs.size()=1 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8NPOC9DHZEIXV7x42Yxkr-tFwCVQv7p_0 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7550103316360733304', time=2024-08-27T05:24:47.430702+0000, chain.objs.size()=1 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uRGcn42Dd29qk3P8QfLvmPya2XJ7Iqi_0 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13010195391642897129', time=2024-08-27T05:24:47.996528+0000, chain.objs.size()=1 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.D4n6antv_XrnrFpIUdkHiCt7c-rtcrs_0 2024-08-27T03:58:29.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7112815794233757865', time=2024-08-27T05:24:48.839465+0000, chain.objs.size()=1 2024-08-27T03:58:29.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.APhLx0hu7JuG7n5p63zHt7ygqBgUaGf_0 2024-08-27T03:58:29.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8114187213139786474', time=2024-08-27T05:24:51.323087+0000, chain.objs.size()=1 2024-08-27T03:58:29.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3p-S129M5lXkoVNHERIGP0ZUYfIRIUa_0 2024-08-27T03:58:29.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4141793849478243809', time=2024-08-27T05:24:51.927868+0000, chain.objs.size()=1 2024-08-27T03:58:29.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hMG_ASdLHuUhVlVWDR2udsTARSWCIK2_0 2024-08-27T03:58:29.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17656851453479186229', time=2024-08-27T05:24:52.336219+0000, chain.objs.size()=1 2024-08-27T03:58:29.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0kszo_qeu3vYt1jJiWuFm3btQ-uv9A__0 2024-08-27T03:58:29.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17115501337949557984', time=2024-08-27T05:24:52.591410+0000, chain.objs.size()=1 2024-08-27T03:58:29.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rMr8UrNPZzYroBXgEtPjQMyDHDtiYCM_0 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17455043532249366360', time=2024-08-27T05:24:52.727768+0000, chain.objs.size()=1 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.l024az2qF8rQ6z37t0L7FsAgwT5U1nB_0 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15219441591705563535', time=2024-08-27T05:24:54.910797+0000, chain.objs.size()=1 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.H19LzkR90vQ6e9cb1ADiG-7bKgawq2b_0 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6542865632744404806', time=2024-08-27T05:24:55.407266+0000, chain.objs.size()=1 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ugmK6FArIMhjZ7SrqXlcG6LBjSzxLMZ_0 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18263449766771442362', time=2024-08-27T05:24:56.422223+0000, chain.objs.size()=1 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.71n4xu5iJ-6OfFmNU-HWPfwjOwLl7ku_0 2024-08-27T03:58:29.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14600374635229862419', time=2024-08-27T05:24:56.670638+0000, chain.objs.size()=1 2024-08-27T03:58:29.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2ZbfSCqekUlIVt0RXEjxje7Ruzg10vL_0 2024-08-27T03:58:29.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8987877540894579065', time=2024-08-27T05:24:56.851019+0000, chain.objs.size()=1 2024-08-27T03:58:29.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DScK7sIMPijZ7Zj8T7QdHELQaAZl15g_0 2024-08-27T03:58:29.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14983087558688868677', time=2024-08-27T05:24:58.019199+0000, chain.objs.size()=1 2024-08-27T03:58:29.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qn3JTSrDekpwugkzo76mKdmusmH8Mz2_0 2024-08-27T03:58:29.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1186228204224101334', time=2024-08-27T05:24:58.496661+0000, chain.objs.size()=1 2024-08-27T03:58:29.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.py16MC18B4Mq7teS-crVzddt9MqL69X_0 2024-08-27T03:58:29.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14752950820806571506', time=2024-08-27T05:25:00.676731+0000, chain.objs.size()=1 2024-08-27T03:58:29.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eg55f6gUNFHDDPuI9f86nXpfPTfn4vU_0 2024-08-27T03:58:29.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8207417249464215901', time=2024-08-27T05:25:00.678760+0000, chain.objs.size()=1 2024-08-27T03:58:29.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ReJXb23m-r_hhTn3hBwkujTHNAHQwR__0 2024-08-27T03:58:29.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12455294775889063408', time=2024-08-27T05:25:01.731747+0000, chain.objs.size()=1 2024-08-27T03:58:29.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XoSpKpOa_YE7orDWvTbUjVy9u24We2T_0 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16119094673801111711', time=2024-08-27T05:25:01.733841+0000, chain.objs.size()=1 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LiBt-VrjsHOij9SNDSMJYsH1RFtkydE_0 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13780753730283925323', time=2024-08-27T05:25:02.423839+0000, chain.objs.size()=1 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CYcKEf_Rs2J_OYUnnw5KkpCEpdBJ96c_0 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11622520993312830117', time=2024-08-27T05:25:03.106331+0000, chain.objs.size()=1 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mJjo_QCW7fiBcB8xTSUGBTjxJ3mM0nP_0 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14512176029257080072', time=2024-08-27T05:25:03.291399+0000, chain.objs.size()=1 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BZVb4r5g2-fAPTzxXw16YsL04A4Zazf_0 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11481239197671781583', time=2024-08-27T05:25:03.907603+0000, chain.objs.size()=1 2024-08-27T03:58:29.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.--qx0fqtu-lChnbdm1IMswP2LQ2Ata9_0 2024-08-27T03:58:29.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6152137599786663827', time=2024-08-27T05:25:06.077461+0000, chain.objs.size()=1 2024-08-27T03:58:29.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZlfFb-SIGYS3blzvqsGZEGa8_RgrZjK_0 2024-08-27T03:58:29.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10001711916402869920', time=2024-08-27T05:25:06.397227+0000, chain.objs.size()=1 2024-08-27T03:58:29.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.JEOlHUEXyjBIzLhUvIaIW1uk0swnL0U_0 2024-08-27T03:58:29.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13818549431166462966', time=2024-08-27T05:25:08.091682+0000, chain.objs.size()=1 2024-08-27T03:58:29.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.c_pbSFISf8OCjyMHZlof_XnqJV11qtJ_0 2024-08-27T03:58:29.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5973790143894608159', time=2024-08-27T05:25:08.754457+0000, chain.objs.size()=1 2024-08-27T03:58:29.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uAX0bhjA8Dk6LEwi6F19vy3uRgx7YWi_0 2024-08-27T03:58:29.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6820356821513695201', time=2024-08-27T05:25:08.952863+0000, chain.objs.size()=1 2024-08-27T03:58:29.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4mipLaJ69pUKg7Ok3bPK1pnfLzphanu_0 2024-08-27T03:58:29.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4420264055786618239', time=2024-08-27T05:25:10.207122+0000, chain.objs.size()=1 2024-08-27T03:58:29.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AA6VpaYHCOwZtFbKld_1NkJApeCFNQm_0 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9678252675121621242', time=2024-08-27T05:25:10.777118+0000, chain.objs.size()=1 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TYwJUhYW5L1qVqzl7pfBr593Sq9xMPT_0 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12816711499999493290', time=2024-08-27T05:25:13.364713+0000, chain.objs.size()=1 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.03TVgKapSUHEEBf9nEPZkRbXejvZcQ5_0 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.936264507345720850', time=2024-08-27T05:25:13.507656+0000, chain.objs.size()=1 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.afRzZV_o3P--l86xfdPhn_tTj2nMInA_0 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10275917704358926627', time=2024-08-27T05:25:14.482821+0000, chain.objs.size()=1 2024-08-27T03:58:29.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qO7EgJIx2F7KBDGe2ei3M59CfjvUugC_0 2024-08-27T03:58:29.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1567501731144393064', time=2024-08-27T05:26:59.106162+0000, chain.objs.size()=1 2024-08-27T03:58:29.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MZ9nFaAsf7ASxB4rHvvCss0T89ZTT4-_0 2024-08-27T03:58:29.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5469774164827637008', time=2024-08-27T05:26:59.490587+0000, chain.objs.size()=1 2024-08-27T03:58:29.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vWbwb-KGatnRQjLOovkvUR5JtljhyyI_0 2024-08-27T03:58:29.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15148193909042000291', time=2024-08-27T05:26:59.681569+0000, chain.objs.size()=1 2024-08-27T03:58:29.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-D-CvkOQGL5iF988PCNl8uWDiJjU5G8_0 2024-08-27T03:58:29.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14163693816340883534', time=2024-08-27T05:27:00.546853+0000, chain.objs.size()=1 2024-08-27T03:58:29.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._vXeTJKyfM4lOY1guxCtSsbral55ht5_0 2024-08-27T03:58:29.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11592445921634358246', time=2024-08-27T05:27:03.915143+0000, chain.objs.size()=1 2024-08-27T03:58:29.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uupa9sZH6lyEpKwglmnznMVRZU9fFAE_0 2024-08-27T03:58:29.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2538528489755081994', time=2024-08-27T05:27:05.483555+0000, chain.objs.size()=1 2024-08-27T03:58:29.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ywH0MhGF81VBNlg3cjrmSdR6xGWUFHV_0 2024-08-27T03:58:29.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4311855007366859463', time=2024-08-27T05:27:05.799675+0000, chain.objs.size()=1 2024-08-27T03:58:29.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Q5bIae3LwYv26jhKaoCgVGxCcZz5kTg_0 2024-08-27T03:58:29.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.751689081094532438', time=2024-08-27T05:27:08.055847+0000, chain.objs.size()=1 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vmOeU2ZEUBxohWIB4pHdQwYMSkWGvLI_0 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2698696995678807815', time=2024-08-27T05:27:09.586194+0000, chain.objs.size()=1 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dcb68PXqt2L5fuvZ0f4937A_FnPem45_0 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8842639984993855657', time=2024-08-27T05:27:10.332726+0000, chain.objs.size()=1 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GgywA3CQzNvbKv2nGj4lAV4FtU6wnBy_0 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5240375572243579968', time=2024-08-27T05:27:11.731227+0000, chain.objs.size()=1 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5p2RMkc2g6NIfZxcLUBliI7XNXXN5y9_0 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13114718982525310892', time=2024-08-27T05:27:13.830629+0000, chain.objs.size()=1 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.sxII_qQpyIXwPj84MTnFJJ-tumLbumt_0 2024-08-27T03:58:29.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3103781743480869948', time=2024-08-27T05:27:13.832510+0000, chain.objs.size()=1 2024-08-27T03:58:29.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Oo2I1FJV0AQEFSzVwaSbcXTp_gWuqO4_0 2024-08-27T03:58:29.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17015059724518460523', time=2024-08-27T05:27:15.010640+0000, chain.objs.size()=1 2024-08-27T03:58:29.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jhCuT1EvS2e0aPvPD5EY2qt_jYaOtdy_0 2024-08-27T03:58:29.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13418081957516167792', time=2024-08-27T05:27:15.407155+0000, chain.objs.size()=1 2024-08-27T03:58:29.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AG0dqoYYWQPhA-7ij_1a7cLRbuZZ0Ro_0 2024-08-27T03:58:29.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2588935391343652925', time=2024-08-27T05:27:15.641263+0000, chain.objs.size()=1 2024-08-27T03:58:29.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Zcn5QmUZYJEFYmC7KBWmznr-J2TgZcq_0 2024-08-27T03:58:29.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15772765297876658520', time=2024-08-27T05:27:16.502769+0000, chain.objs.size()=1 2024-08-27T03:58:29.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mpJtM-umUDGXMy4uywFy_8LXRsmX0Rp_0 2024-08-27T03:58:29.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.128431150782023005', time=2024-08-27T05:27:17.331439+0000, chain.objs.size()=1 2024-08-27T03:58:29.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TwkZ-QBx8ieua6msy3Ie7FK0QmFBBJA_0 2024-08-27T03:58:29.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4019287356091371828', time=2024-08-27T05:27:18.232253+0000, chain.objs.size()=1 2024-08-27T03:58:29.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.YvjD7Dqn_s-P3ZcLWcKKESA8axKCdca_0 2024-08-27T03:58:29.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1376284768896816362', time=2024-08-27T05:27:20.663926+0000, chain.objs.size()=1 2024-08-27T03:58:29.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vlnUzaKAK219Wm2iR8EdQwGdgPi8otC_0 2024-08-27T03:58:29.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5679724295370485597', time=2024-08-27T05:27:20.991150+0000, chain.objs.size()=1 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pYhSKPOW5qisf07AKIUBgMN3XqSMdch_0 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3183456930892659768', time=2024-08-27T05:27:23.681879+0000, chain.objs.size()=1 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KLNdXHiXyQXYAtBcfuKpjVlNGded04r_0 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14746327637349054554', time=2024-08-27T05:27:24.503327+0000, chain.objs.size()=1 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rsl1ZaWeee6wgerJ9nj3lbDG7dBd5Jo_0 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13010956238168442729', time=2024-08-27T05:27:24.946188+0000, chain.objs.size()=1 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.o1boSWYyzzetYILbbBATTAD3pxKpK2A_0 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4115453324037783282', time=2024-08-27T05:27:26.030038+0000, chain.objs.size()=1 2024-08-27T03:58:29.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.YCIMiRoEIPE1CeNHpKQ8A4n9xa1T_Vg_0 2024-08-27T03:58:29.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9762734456030130401', time=2024-08-27T05:28:39.081500+0000, chain.objs.size()=1 2024-08-27T03:58:29.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.370__shadow_._53AYaMCvidN0A_nvuiS6x3PnJRRYru_0 2024-08-27T03:58:29.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42854 2024-08-27T03:58:29.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16731319260038043171', time=2024-08-27T05:29:31.872779+0000, chain.objs.size()=1 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.404__shadow_.FFb-Bn705qBmPgn9DS57bXQYMQRkP-s_0 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16854098019974864657', time=2024-08-27T05:30:46.785786+0000, chain.objs.size()=1 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.451__shadow_.8Tq1BnwA_BPQqKdCFizkCli5KRDbk4t_0 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4076044970574950365', time=2024-08-27T05:30:48.970715+0000, chain.objs.size()=1 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.452__shadow_.CcdHbdfIpLA_NwLFflZvDYq3KrjdwyO_0 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2566591694961530444', time=2024-08-27T05:30:53.376973+0000, chain.objs.size()=1 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.454__shadow_.FIwjzqR99udE7YaPHBA0gp4tKbsut7w_0 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13854943095575700535', time=2024-08-27T05:31:04.743312+0000, chain.objs.size()=1 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.459__shadow_.gea2-YogXhBf0vhtFChVY0p4hcLqkRF_0 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5871082593212876041', time=2024-08-27T05:31:53.825703+0000, chain.objs.size()=1 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.490__shadow_.V-rUJmaWkQobpKRAj2QaF3HfcDcp9Zy_0 2024-08-27T03:58:29.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13713692720013763037', time=2024-08-27T05:32:30.218026+0000, chain.objs.size()=1 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.507__multipart_mymultipart.2~dtCbvMyksm8iLiHaJpf64Z3CBLAs_Tq.1 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11330488668802799481', time=2024-08-27T05:36:57.972673+0000, chain.objs.size()=1 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.547__shadow_.M8MYjZ32dyexLBQ2jvDJBLdTtELXABI_0 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13666596937703867728', time=2024-08-27T05:37:26.588934+0000, chain.objs.size()=1 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.553__shadow_.KlGF1qxSY0WrC5bwvAHC9P-qITzZBg-_0 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17030109431316513836', time=2024-08-27T05:46:45.331460+0000, chain.objs.size()=6 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.655__multipart_baz.2~Pwwp7NKivkbn5hJ8rRFVrSXEpMHPJUK.1 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.655__multipart_baz.2~Pwwp7NKivkbn5hJ8rRFVrSXEpMHPJUK.2 2024-08-27T03:58:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.655__multipart_baz.2~Pwwp7NKivkbn5hJ8rRFVrSXEpMHPJUK.3 2024-08-27T03:58:29.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.459+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.655__multipart_baz.2~Pwwp7NKivkbn5hJ8rRFVrSXEpMHPJUK.4 2024-08-27T03:58:29.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.459+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.655__multipart_baz.2~Pwwp7NKivkbn5hJ8rRFVrSXEpMHPJUK.5 2024-08-27T03:58:29.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.459+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.655__multipart_baz.2~Pwwp7NKivkbn5hJ8rRFVrSXEpMHPJUK.6 2024-08-27T03:58:29.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.459+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3303099646525270069', time=2024-08-27T05:47:47.495896+0000, chain.objs.size()=1 2024-08-27T03:58:29.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.459+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.695__shadow:1Yg0sZvQzNXA0p8XtgZFeNfug5PZ6-O_.OPSAzxlFpdDSGdMQGu4h4Yt4Fg3fmfi_0 2024-08-27T03:58:29.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.459+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1523432509270614094', time=2024-08-27T05:47:49.348560+0000, chain.objs.size()=1 2024-08-27T03:58:29.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.459+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.696__multipart_file1.2~DlkmVDJmCx-cK5zwSXKpgC1L_4oxPuP.1 2024-08-27T03:58:29.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-08-27T03:58:29.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44241' 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8318491083951260471', time=2024-08-27T05:13:18.730017+0000, chain.objs.size()=3 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-STANDARD.2~x2ejDaitbvLmb4oP7k4R_rsTFGAbHbe.1 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-STANDARD.2~x2ejDaitbvLmb4oP7k4R_rsTFGAbHbe.2 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-STANDARD.2~x2ejDaitbvLmb4oP7k4R_rsTFGAbHbe.3 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~uVMND3kawWqPLhN2O1vUvPHA5x9e7OD', time=2024-08-27T05:15:07.139940+0000, chain.objs.size()=1 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.196__multipart_mymultipart.2~uVMND3kawWqPLhN2O1vUvPHA5x9e7OD.1 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6754221972353967261', time=2024-08-27T05:18:14.666503+0000, chain.objs.size()=1 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.235__shadow_.H9wXX5AfC97vy3OLJCbsWZ__S8_yZPc_0 2024-08-27T03:58:29.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7791803753620533558', time=2024-08-27T05:18:21.895384+0000, chain.objs.size()=1 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.238__shadow_._fvViF_9zcgXma-T5Pmcfq_cDcOWr3e_0 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2952267413125718918', time=2024-08-27T05:18:31.121079+0000, chain.objs.size()=1 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.243__shadow_.kcze3bgb-Zp8sRcvT1_O2VRj0716C7J_0 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16910050951006167311', time=2024-08-27T05:20:36.587312+0000, chain.objs.size()=1 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.a2CfikmNKLKZ4wU2AdcNPSyOl0_ZaEe_0 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7693969882202188852', time=2024-08-27T05:20:36.632639+0000, chain.objs.size()=1 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uwvXC6hlm6HTIHF6fqLFMviFrOEDesz_0 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10814979140608139751', time=2024-08-27T05:20:37.382639+0000, chain.objs.size()=1 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.39hqpJ4zg-99a8nkQ1Op5GGgqqoghEO_0 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18377419335967006511', time=2024-08-27T05:20:41.117358+0000, chain.objs.size()=1 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GfjE-70t3ilya0MWxxqO309dfEQ_liY_0 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3617065707433428227', time=2024-08-27T05:20:41.871818+0000, chain.objs.size()=1 2024-08-27T03:58:29.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eXbDCWZsXQBm79lb5EQ1RWAKxNvQCSI_0 2024-08-27T03:58:29.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.471+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2360580954282403510', time=2024-08-27T05:20:43.476400+0000, chain.objs.size()=1 2024-08-27T03:58:29.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.471+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4G7pOmx2nsr20Znu9vYkO206rbG1kUJ_0 2024-08-27T03:58:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17853336075423257723', time=2024-08-27T05:20:44.246314+0000, chain.objs.size()=1 2024-08-27T03:58:29.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xPTd3-toItF0tNsDm_bKL5FlHLU5ikS_0 2024-08-27T03:58:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4169287941294608211', time=2024-08-27T05:20:44.247889+0000, chain.objs.size()=1 2024-08-27T03:58:29.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3XglwdZ9sGAbz_wNHEimyRtVMjabb-C_0 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5829958455608009784', time=2024-08-27T05:20:45.193686+0000, chain.objs.size()=1 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.AcM9lLip-cEsJRTOjc8idFFX-3fsDyM_0 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5171534247590272145', time=2024-08-27T05:20:45.524709+0000, chain.objs.size()=1 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.j1bxrObIqJ2v1Zj-RxPRdTwSOu0DICR_0 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3000776914311429040', time=2024-08-27T05:20:45.612398+0000, chain.objs.size()=1 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-DYm-cYWgEIBbEzU-dqUHPfVmJhRe6J_0 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5671235329159277355', time=2024-08-27T05:20:47.903425+0000, chain.objs.size()=1 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GJZYH3nilzZ6q6tEN2nrqtIWk5B26C6_0 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6953392157432207324', time=2024-08-27T05:20:49.148632+0000, chain.objs.size()=1 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._OjFcNgyH7A3zzyytQnsBPkx2q58A9C_0 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18299999921686190493', time=2024-08-27T05:20:51.311949+0000, chain.objs.size()=1 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kpYTC27J0SrH5uksG75ucc_0hevtid2_0 2024-08-27T03:58:29.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5096806738012445599', time=2024-08-27T05:20:51.392008+0000, chain.objs.size()=1 2024-08-27T03:58:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.yaRMiep5F0z3o6sveRY-pCXmKgjdoxT_0 2024-08-27T03:58:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10267212278692057797', time=2024-08-27T05:20:51.606533+0000, chain.objs.size()=1 2024-08-27T03:58:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.12AIx8iSAnFBAGevxayxnM3IeiOhm88_0 2024-08-27T03:58:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14215647113678256524', time=2024-08-27T05:20:51.871811+0000, chain.objs.size()=1 2024-08-27T03:58:29.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.h8vaYl8S1ufKAMcEQpi5ffQTgRrYFpf_0 2024-08-27T03:58:29.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8672682005912021647', time=2024-08-27T05:20:52.480144+0000, chain.objs.size()=1 2024-08-27T03:58:29.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bO-v--IQCWqQIWpYpddnuDJrrZDtCOU_0 2024-08-27T03:58:29.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15585882558483624306', time=2024-08-27T05:20:52.820250+0000, chain.objs.size()=1 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.A28D4fdrpxxai8jToYMgry0G5CFBDKq_0 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15241458472878713052', time=2024-08-27T05:20:53.071227+0000, chain.objs.size()=1 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.p7rvKJzD1ZUG3R0wex6jFtaT7EaKl6K_0 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14237813759385497808', time=2024-08-27T05:20:53.414171+0000, chain.objs.size()=1 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.emcHTl1xY4T-ziYEKDF6T_M6taJsyDo_0 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16922184551906403887', time=2024-08-27T05:20:53.635840+0000, chain.objs.size()=1 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dBsv-56lCuM3vgWZ51DLNNXxsKHHN1c_0 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18387461645090965461', time=2024-08-27T05:20:54.558728+0000, chain.objs.size()=1 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6UG-Zznb_wyH5I5rViecRP4IjWejO2h_0 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2699504045676599710', time=2024-08-27T05:20:55.674707+0000, chain.objs.size()=1 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fyzBzBdw22l-r5OCfY_1EsZ1cD5BAou_0 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9691606745626891261', time=2024-08-27T05:20:56.546679+0000, chain.objs.size()=1 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iuNYEZyH6DHLk-WZZ3d6aguy_nSLewu_0 2024-08-27T03:58:29.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13735782721429853557', time=2024-08-27T05:20:57.257456+0000, chain.objs.size()=1 2024-08-27T03:58:29.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.y5XQUZ4bSpOTl-bX-M5xq-DeOEEltUy_0 2024-08-27T03:58:29.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12958306061901534456', time=2024-08-27T05:20:57.369451+0000, chain.objs.size()=1 2024-08-27T03:58:29.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2HEoLSofwwIpduHyfll32KW2q2jlZDZ_0 2024-08-27T03:58:29.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.483+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4822193150457849651', time=2024-08-27T05:20:59.410000+0000, chain.objs.size()=1 2024-08-27T03:58:29.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.483+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JdY4FsbYIK1Sr0kzTfhQHd98rZtkqQI_0 2024-08-27T03:58:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16705498998794862301', time=2024-08-27T05:20:59.775773+0000, chain.objs.size()=1 2024-08-27T03:58:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._t1mhc7Z_iSQe2XW_WD7abMvbK9_OQn_0 2024-08-27T03:58:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16363527390919918290', time=2024-08-27T05:20:59.974994+0000, chain.objs.size()=1 2024-08-27T03:58:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7e-L_dTB6BIu6aQmSEpouOzR5U00isH_0 2024-08-27T03:58:29.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10517698286335649647', time=2024-08-27T05:20:59.976927+0000, chain.objs.size()=1 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.buBhnTsIKisO66revtR5FgldA572L4p_0 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11948593676073017006', time=2024-08-27T05:21:00.603366+0000, chain.objs.size()=1 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rT7W58c4IxD-hkOl5kdIKKeYM0GrBz3_0 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1959892249430424376', time=2024-08-27T05:21:00.814286+0000, chain.objs.size()=1 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hd1R4myhMfQ9_mcTWnnAlZv7T4nnVez_0 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9775553281374960635', time=2024-08-27T05:21:04.209755+0000, chain.objs.size()=1 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.A1OE0GmAokn56cE_RxZHpzOR2dfru_T_0 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3755375903617454051', time=2024-08-27T05:21:23.251052+0000, chain.objs.size()=1 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.267__shadow_.OLsl01w2BCGWBU7QW4EA1e2eKpLjj8k_0 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17129837593557063407', time=2024-08-27T05:21:50.284179+0000, chain.objs.size()=1 2024-08-27T03:58:29.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.281__shadow_.Vn_IHlPNcMRynlhCMMciQOr3tEvOXNX_0 2024-08-27T03:58:29.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14040381312346438910', time=2024-08-27T05:21:52.097059+0000, chain.objs.size()=1 2024-08-27T03:58:29.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.282__shadow_.NiEnv3j6xsb2_a_OenDDQlupHKn5yt2_0 2024-08-27T03:58:29.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4728850106217065199', time=2024-08-27T05:21:53.900619+0000, chain.objs.size()=1 2024-08-27T03:58:29.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.283__shadow_.2gmj1178mnufkHynq1P4uupUY8NxGqm_0 2024-08-27T03:58:29.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1933172947860046903', time=2024-08-27T05:22:08.156996+0000, chain.objs.size()=1 2024-08-27T03:58:29.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.9Z0jSKcF6Sn1aFf8drSKX1gFbziJ3mG_0 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3924924592735434438', time=2024-08-27T05:22:11.864692+0000, chain.objs.size()=1 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.289__shadow_.zfNEnjgttyNJa9jGCUMCORsuYo-gziW_0 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5662717238546925527', time=2024-08-27T05:22:15.596199+0000, chain.objs.size()=1 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.291__shadow_.TZz4wxK7eEnIp0NbfGM3Sr-XVS4ASFO_0 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5426296654491192199', time=2024-08-27T05:23:01.017677+0000, chain.objs.size()=1 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.315__shadow_.25b0xXI4OL0ZEtmY_3QpU_skMMftODQ_0 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10309022280696635900', time=2024-08-27T05:24:46.822989+0000, chain.objs.size()=1 2024-08-27T03:58:29.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.L-1N1J8B9dRwR4s0hXbefYvggNfJ5Hi_0 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1136726845594098690', time=2024-08-27T05:24:47.234201+0000, chain.objs.size()=1 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.l0TqrsnIrwO9dB2jvUQ0Egb81jI3A0t_0 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4565599883455588186', time=2024-08-27T05:24:47.873024+0000, chain.objs.size()=1 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5-ILXdHkmfRbr5-8iXqL65Zjn_wfYal_0 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7561260098762366523', time=2024-08-27T05:24:48.082163+0000, chain.objs.size()=1 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.HbPAywC5q_gQyU_KSsmnqAkwCn1Swpk_0 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17757685020102980244', time=2024-08-27T05:24:49.224571+0000, chain.objs.size()=1 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vDhd2JwfEXOqjI_U2NMpwXNqcv8cumE_0 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3128785166419194149', time=2024-08-27T05:24:50.725488+0000, chain.objs.size()=1 2024-08-27T03:58:29.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.50oooN8GkX1FyHyEhCcrexFDyjJhuK5_0 2024-08-27T03:58:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17597484860022577203', time=2024-08-27T05:24:51.119643+0000, chain.objs.size()=1 2024-08-27T03:58:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.R96lfhIFY_AMKtPGiGJzHGXIaST0b1E_0 2024-08-27T03:58:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11244955864665017197', time=2024-08-27T05:24:54.600040+0000, chain.objs.size()=1 2024-08-27T03:58:29.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DxSIqJV47nHYjUJPX24tLniypshCfRz_0 2024-08-27T03:58:29.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5624249464512568398', time=2024-08-27T05:24:56.588088+0000, chain.objs.size()=1 2024-08-27T03:58:29.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0E_kCSYYRrZocsrVJCdgTzb0IRXunoi_0 2024-08-27T03:58:29.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3196891801102473912', time=2024-08-27T05:24:58.620368+0000, chain.objs.size()=1 2024-08-27T03:58:29.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fauSgHUwhj82pNIBA7IBKQ8JGGvp2e9_0 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1028576759958983084', time=2024-08-27T05:24:59.580138+0000, chain.objs.size()=1 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fiYPfjE9jpzaJmnLROvulrWiTuTwNHp_0 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5252437554003708994', time=2024-08-27T05:24:59.581840+0000, chain.objs.size()=1 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LqFB4TEAYC6wGwiatdeSSEohrxpaQet_0 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5805373402265471296', time=2024-08-27T05:25:00.475265+0000, chain.objs.size()=1 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0r-EL3ro14ZX3yLs_dCfN97JgeWp3h4_0 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3693108902491356524', time=2024-08-27T05:25:01.978345+0000, chain.objs.size()=1 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Auha36kWqU0earecfExMi-1MuMKr676_0 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6232156191848409230', time=2024-08-27T05:25:02.040574+0000, chain.objs.size()=1 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GFDYqu0VLaFa_o4tgc3-D2koXYKMz4J_0 2024-08-27T03:58:29.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2267790126898155708', time=2024-08-27T05:25:02.420233+0000, chain.objs.size()=1 2024-08-27T03:58:29.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8dZzZuGcWIseDDYdA9lnPhH922xh6xc_0 2024-08-27T03:58:29.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12836692512088073011', time=2024-08-27T05:25:02.465783+0000, chain.objs.size()=1 2024-08-27T03:58:29.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.R1kg8uY_9OpJuutt7qE-IoesdsuCY0N_0 2024-08-27T03:58:29.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15374157048513671174', time=2024-08-27T05:25:02.845220+0000, chain.objs.size()=1 2024-08-27T03:58:29.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vBreUo98nDbsK4HmuoyHIuQNR-LpZOC_0 2024-08-27T03:58:29.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3124371526850399268', time=2024-08-27T05:25:03.245355+0000, chain.objs.size()=1 2024-08-27T03:58:29.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LoyqrHPx7HS8gEHyLJdT9nIJlPcNckf_0 2024-08-27T03:58:29.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18341276890455795401', time=2024-08-27T05:25:03.633932+0000, chain.objs.size()=1 2024-08-27T03:58:29.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RSZbu5kHZHS5rTmSytLhFkSMoVl-pbT_0 2024-08-27T03:58:29.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16763326268221644191', time=2024-08-27T05:25:04.468479+0000, chain.objs.size()=1 2024-08-27T03:58:29.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.HYeVNqItG5kHEBeJ4gcgXaM0eSxpOz4_0 2024-08-27T03:58:29.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15558710877352786959', time=2024-08-27T05:25:05.196824+0000, chain.objs.size()=1 2024-08-27T03:58:29.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gOn2qThPOT1PpJs6qS7tfloLnE4TmM7_0 2024-08-27T03:58:29.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4630228533780010128', time=2024-08-27T05:25:05.937072+0000, chain.objs.size()=1 2024-08-27T03:58:29.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5AwJ4u_rjKSDHu-hUqYAwpOi25VRC_C_0 2024-08-27T03:58:29.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2271120472748370233', time=2024-08-27T05:25:06.261813+0000, chain.objs.size()=1 2024-08-27T03:58:29.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0SXc_Hhe_cS51kLtSpfP4k9t2b35DFo_0 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6171503634317967973', time=2024-08-27T05:25:06.352242+0000, chain.objs.size()=1 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DeBOITg14OCGParWXjEzcxAaLmMLohc_0 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5483820331778933479', time=2024-08-27T05:25:07.373405+0000, chain.objs.size()=1 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3AeSCMkiRkK2xZ0wEnIpi_xGVv5ueNP_0 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10090121026812556686', time=2024-08-27T05:25:09.348914+0000, chain.objs.size()=1 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9Aor9P2tQO6Ii29botuqzaACC-cL1WA_0 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13007843719731694159', time=2024-08-27T05:25:10.259849+0000, chain.objs.size()=1 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.V-CN4UmnsZc-Fng7zJtH1nSS1i0e9vW_0 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17262630154549347074', time=2024-08-27T05:25:10.380551+0000, chain.objs.size()=1 2024-08-27T03:58:29.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.U29Sb2ZfU0LmYpOLKnKIUyN43QG6EqQ_0 2024-08-27T03:58:29.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16976811938283008261', time=2024-08-27T05:25:11.376017+0000, chain.objs.size()=1 2024-08-27T03:58:29.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.JshF8NOTH5geKfW_NZrfVr_OQPDbcIQ_0 2024-08-27T03:58:29.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5253831195897771904', time=2024-08-27T05:25:12.276555+0000, chain.objs.size()=1 2024-08-27T03:58:29.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KOJ_CnMdOhs-MmUI5ManlV1-YzUd5to_0 2024-08-27T03:58:29.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14523035299093438318', time=2024-08-27T05:25:12.763921+0000, chain.objs.size()=1 2024-08-27T03:58:29.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rrpv9RUM9cBSy3mEn0oq7gcZ5voFTfg_0 2024-08-27T03:58:29.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5710145896312072166', time=2024-08-27T05:25:13.008276+0000, chain.objs.size()=1 2024-08-27T03:58:29.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cqusCxXUu1sJMqSkQMKwNCVs-g7r9WU_0 2024-08-27T03:58:29.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3372174870485434099', time=2024-08-27T05:25:13.650192+0000, chain.objs.size()=1 2024-08-27T03:58:29.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qcphjq3KXPHI4Hhr25jVZwz5vRrww7Q_0 2024-08-27T03:58:29.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7821804420850810338', time=2024-08-27T05:25:14.199168+0000, chain.objs.size()=1 2024-08-27T03:58:29.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.n8r-7orLHiEaDXE-2PpoTa_LUQgpj_O_0 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5080693520270001772', time=2024-08-27T05:26:58.384539+0000, chain.objs.size()=1 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.O5Y0rsQ1qh28ujJAMVCosqrdkCPiTCm_0 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11342543748496472565', time=2024-08-27T05:27:00.277806+0000, chain.objs.size()=1 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.whZNHo4e4obY-36SEZtpnlynB6AlwMk_0 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4464110010628300611', time=2024-08-27T05:27:01.661966+0000, chain.objs.size()=1 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.b-0FFadE294yS1m38PguuEQh1hSwBM7_0 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10692335868622398488', time=2024-08-27T05:27:01.798407+0000, chain.objs.size()=1 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dH8Pw1qmBd0xPCk6Xv70kMqQkDzHV9d_0 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16575592152273967709', time=2024-08-27T05:27:01.926756+0000, chain.objs.size()=1 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7R9GlKAXFzoHYWlKYmEBtMMjgdUYKwG_0 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16741553371017478169', time=2024-08-27T05:27:02.101030+0000, chain.objs.size()=1 2024-08-27T03:58:29.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AyGKTl6eXq8f59E97E2nlGsD3mc-ZSQ_0 2024-08-27T03:58:29.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7007103162415440314', time=2024-08-27T05:27:02.102544+0000, chain.objs.size()=1 2024-08-27T03:58:29.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Lm1qycmZ7MOm2yGsSiQfV-NGcOr90oT_0 2024-08-27T03:58:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1956595303654755360', time=2024-08-27T05:27:02.327601+0000, chain.objs.size()=1 2024-08-27T03:58:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EFKpONavqRBEKT7Tq6E4AIT7iCPZgvO_0 2024-08-27T03:58:29.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2703182647380293145', time=2024-08-27T05:27:03.045039+0000, chain.objs.size()=1 2024-08-27T03:58:29.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.knc7uf8P7qhdK5R_m8DFvaVUcCCvGqh_0 2024-08-27T03:58:29.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15640684979032167704', time=2024-08-27T05:27:03.828732+0000, chain.objs.size()=1 2024-08-27T03:58:29.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ryurxCh4rp8sj49LRV9Uordcv1Zsa_Y_0 2024-08-27T03:58:29.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9637692157600680259', time=2024-08-27T05:27:05.481313+0000, chain.objs.size()=1 2024-08-27T03:58:29.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NqtX8_28W3OmXjcrwXPmXvHI81CvDTB_0 2024-08-27T03:58:29.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7965963053196375245', time=2024-08-27T05:27:06.148477+0000, chain.objs.size()=1 2024-08-27T03:58:29.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JfJ37QVGWhHNerTPW1g9B6O49lRzLS7_0 2024-08-27T03:58:29.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14108327762823412144', time=2024-08-27T05:27:06.733193+0000, chain.objs.size()=1 2024-08-27T03:58:29.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.oGc5mWOPePLPPs_c5whpFSFA9BhAYas_0 2024-08-27T03:58:29.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17314758239096090187', time=2024-08-27T05:27:07.134488+0000, chain.objs.size()=1 2024-08-27T03:58:29.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pN8tXYr9FW5XtQe9pUNHvIm5OVaBFxZ_0 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12167350008036525968', time=2024-08-27T05:27:07.182553+0000, chain.objs.size()=1 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ssmcZk1xd2rvm4H4lw05CnFMuKvSO6B_0 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10030330207526443422', time=2024-08-27T05:27:08.144930+0000, chain.objs.size()=1 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1-gTnCpSVMEJeMiGOovjKZaHxwowfqf_0 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10817449124761816656', time=2024-08-27T05:27:09.768804+0000, chain.objs.size()=1 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.atlFjrAMWw7mkXPrxDCnnp0wCo1f446_0 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17717212676803155794', time=2024-08-27T05:27:10.314095+0000, chain.objs.size()=1 2024-08-27T03:58:29.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Ykv6tl-Pl72hCSSoZu7cQ7aYounsPkX_0 2024-08-27T03:58:29.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44241 2024-08-27T03:58:29.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9121142704459088507', time=2024-08-27T05:27:12.892164+0000, chain.objs.size()=1 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.A68-wsd_dH868Dgk_MlEYUC5yRK0CQW_0 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1742812370138168865', time=2024-08-27T05:27:13.729870+0000, chain.objs.size()=1 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wenII_q00BAifMgt2eMLR1d6UEV4bAn_0 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6553845385946178164', time=2024-08-27T05:27:15.305834+0000, chain.objs.size()=1 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.k0WA41kTzJ62XLxvFkfFlDGRgcBYZsm_0 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17324532099925921872', time=2024-08-27T05:27:15.307685+0000, chain.objs.size()=1 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3AqYb8Xy1XuBjkZnH3PvHCwegw7Butt_0 2024-08-27T03:58:29.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2716737554275428177', time=2024-08-27T05:27:16.854043+0000, chain.objs.size()=1 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cs9ca3-9GgXwvmcvbCOgpss9d6i-w7M_0 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6340754125818028880', time=2024-08-27T05:27:17.237186+0000, chain.objs.size()=1 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Rjnyqk4lSPHebDKzijRI1wbTWnyYdbx_0 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1662040967497572988', time=2024-08-27T05:27:18.201600+0000, chain.objs.size()=1 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.O-YS-abItiGcZsNrb8Ak3nM23md5F5z_0 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4096394551723810729', time=2024-08-27T05:27:18.783546+0000, chain.objs.size()=1 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.tR68b6SBPHU2CpIGtTnhaUvGmo2R4RI_0 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17650055780637767058', time=2024-08-27T05:27:20.076729+0000, chain.objs.size()=1 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2Jy99vf9vpn_KCGVu3d8Zc4TYmX0yIQ_0 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10465906408017343661', time=2024-08-27T05:27:20.745136+0000, chain.objs.size()=1 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.myU_5xdyzDp_jwRUrMDpd3V8wfT436C_0 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10521774270113184820', time=2024-08-27T05:27:21.135608+0000, chain.objs.size()=1 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DFmYHV9iT5xxCfBn9zTxQSlwKabu7b4_0 2024-08-27T03:58:29.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8958811326273985664', time=2024-08-27T05:27:36.384400+0000, chain.objs.size()=1 2024-08-27T03:58:29.529 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.325__shadow_.eRuqoyLgOjUuSVeVO8_WxGxGAidMxvT_0 2024-08-27T03:58:29.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3005348148200967326', time=2024-08-27T05:27:39.656189+0000, chain.objs.size()=1 2024-08-27T03:58:29.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.327__shadow_.hhxkxb0LBttS4P8qce23as-ZTvxfYy6_0 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9240148340459794570', time=2024-08-27T05:27:41.185244+0000, chain.objs.size()=1 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.328__shadow_.8LlbgW2KIReV4li1OOj_MylZmGxq2kz_0 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13045809025905025642', time=2024-08-27T05:27:53.074470+0000, chain.objs.size()=1 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.336__shadow_.PhnfWbkA-oClMUrR-L1X5IeqTS3eOUz_0 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7206892781114395927', time=2024-08-27T05:27:54.500425+0000, chain.objs.size()=1 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.337__shadow_.wPczJk9HVhhuYyJCmwBuJ__lS71ZEDL_0 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2389756736523626230', time=2024-08-27T05:28:07.538800+0000, chain.objs.size()=1 2024-08-27T03:58:29.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.347__shadow_.tw9dMeqEhvwxAytGVubi1oEo3_MK_2U_0 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5375824636393885402', time=2024-08-27T05:29:28.912947+0000, chain.objs.size()=1 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.402__shadow_.35xQXUyWnp3J9JV937zpRdUjSsQd7m6_0 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15792012655090428527', time=2024-08-27T05:31:37.621061+0000, chain.objs.size()=1 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.480__shadow_.ODPi7Yx3dhfo2r1sT_7b8x_85hW6XCM_0 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8463750520734099496', time=2024-08-27T05:31:44.093379+0000, chain.objs.size()=1 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.484__shadow_.9kJs_f3xb1iGD9N3vf_daZGa8cf7dWa_0 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8463750520734099496', time=2024-08-27T05:31:44.533486+0000, chain.objs.size()=1 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.484__shadow_.9kJs_f3xb1iGD9N3vf_daZGa8cf7dWa_0 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14041368148934655512', time=2024-08-27T05:31:49.011213+0000, chain.objs.size()=1 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.487__shadow_.Ayj29V_kH_diF9L1T1nNaTuFv3SYRV5_0 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Qhz7JWszmmHtVXjaqpc2dcKC9xl20ua', time=2024-08-27T05:33:32.841842+0000, chain.objs.size()=1 2024-08-27T03:58:29.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Qhz7JWszmmHtVXjaqpc2dcKC9xl20ua.1 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~4jFnQqcqobvX2p81XA6lIs-WWk8CdrD', time=2024-08-27T05:35:44.223902+0000, chain.objs.size()=1 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.525__multipart_mymultipart.2~4jFnQqcqobvX2p81XA6lIs-WWk8CdrD.1 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3264833587208480036', time=2024-08-27T05:37:51.152227+0000, chain.objs.size()=1 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:Oe1ZV2I0LQNWR-HlQ-Kdo3CvFJ46ywd_.9E18EdlYY0AqRCDk8sm5PkCZttrm3_r_0 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14951493871327471561', time=2024-08-27T05:37:52.335443+0000, chain.objs.size()=1 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:-QJR5GPlzxOckLGoFuGyCuq36.G95M5_.p-xT1xbPAew_nDMn9U5CGotWvxyvuQV_0 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10055557954067103903', time=2024-08-27T05:38:58.505328+0000, chain.objs.size()=1 2024-08-27T03:58:29.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:beCnaIv8x8VNPaSb3e6Qkp4.FYNCSU4_.XAsD7ubN0iLqW53Jx_hOzdMt6zX6HyZ_0 2024-08-27T03:58:29.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3312655518879101824', time=2024-08-27T05:39:12.485339+0000, chain.objs.size()=1 2024-08-27T03:58:29.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:D76jt8IxQo5Xpxn3CCeEv6jW6BpNrp2_.h-jeK3skgj176xDVPchEvHC_zevjwi-_0 2024-08-27T03:58:29.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8049978472168975047', time=2024-08-27T05:39:13.536391+0000, chain.objs.size()=1 2024-08-27T03:58:29.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:-IKeO5OLAB0bbWUc6RUIHFcIdKBSu1C_.Eho05oYaV75lx3W16FxirGNZbJMizS8_0 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6911371453420666320', time=2024-08-27T05:39:17.104094+0000, chain.objs.size()=1 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:nr1oBzHjVjxPNlMiWOtLFLiqp7bqArA_.IFXF4PUYZXBTcJC-H5CkAlScuyibSJ9_0 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8801887354229872941', time=2024-08-27T05:39:26.256698+0000, chain.objs.size()=1 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:jY3cPlitYrbBY5g5DfhDUcfM904YuBK_.7b6lHsLa8BGyaGSc8DPk7zpV_54c4-g_0 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7292413606494634571', time=2024-08-27T05:40:00.493678+0000, chain.objs.size()=1 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:1triO.iW6CVZoeLCPBkNdmABxrH56dp_.bg3xwjMqcWgOWeFRLeLIvU93YXzXHUF_0 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16831922249538181770', time=2024-08-27T05:40:16.854412+0000, chain.objs.size()=1 2024-08-27T03:58:29.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:JmCo3cLqb2pYlUH6nUBZjun0hAWNNV._.oR1P2tymde1Z-piwUAHHB41jK7tUsik_0 2024-08-27T03:58:29.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16054308231585887883', time=2024-08-27T05:46:44.625809+0000, chain.objs.size()=6 2024-08-27T03:58:29.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.654__multipart_bar.2~T7SoQvN9agj57ox64GV49CBr1mcWopW.1 2024-08-27T03:58:29.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.535+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.654__multipart_bar.2~T7SoQvN9agj57ox64GV49CBr1mcWopW.2 2024-08-27T03:58:29.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.539+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.654__multipart_bar.2~T7SoQvN9agj57ox64GV49CBr1mcWopW.3 2024-08-27T03:58:29.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.539+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.654__multipart_bar.2~T7SoQvN9agj57ox64GV49CBr1mcWopW.4 2024-08-27T03:58:29.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.539+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.654__multipart_bar.2~T7SoQvN9agj57ox64GV49CBr1mcWopW.5 2024-08-27T03:58:29.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.654__multipart_bar.2~T7SoQvN9agj57ox64GV49CBr1mcWopW.6 2024-08-27T03:58:29.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14519598508088253136', time=2024-08-27T05:46:48.262098+0000, chain.objs.size()=1 2024-08-27T03:58:29.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.657__shadow_.vQN6mVkJF7KVYp7pDMxCLkPuqveogxs_0 2024-08-27T03:58:29.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14506695459923156695', time=2024-08-27T05:46:50.775237+0000, chain.objs.size()=1 2024-08-27T03:58:29.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.658__shadow_.HFqffztRCCkXub0QvEONA2x-56kkgHu_0 2024-08-27T03:58:29.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16961087725215139019', time=2024-08-27T05:46:55.972155+0000, chain.objs.size()=1 2024-08-27T03:58:29.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.660__shadow_.ieF5Ei1jvo9vNmDbtkiA9vEvTYql97U_0 2024-08-27T03:58:29.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14030367350228442754', time=2024-08-27T05:48:01.657609+0000, chain.objs.size()=1 2024-08-27T03:58:29.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.703__shadow_.3Bc-UrIRHfVWMhUxSGJ_GIJCZAxb3In_0 2024-08-27T03:58:29.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-08-27T03:58:29.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46870' 2024-08-27T03:58:29.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15640083107670173594', time=2024-08-27T05:18:09.869195+0000, chain.objs.size()=1 2024-08-27T03:58:29.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.232__shadow_.oYaKp2CqlkgNlp7tINS92PqU-J68u92_0 2024-08-27T03:58:29.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5127719180247605272', time=2024-08-27T05:18:19.172498+0000, chain.objs.size()=1 2024-08-27T03:58:29.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.237__shadow_.v5fS3JlFAQCcNLNfcSHHaq5KTXccTfM_0 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.130736924166044006', time=2024-08-27T05:18:25.625772+0000, chain.objs.size()=1 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.240__shadow_.ubckgffNlG934hE83Fl7tBy4ofMp_Oy_0 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15358212010121703589', time=2024-08-27T05:18:25.627243+0000, chain.objs.size()=1 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.240__shadow_.SRl49BnIiIIqOnZ0zXhvE0rVm09kv3b_0 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16610538573177818681', time=2024-08-27T05:18:27.428113+0000, chain.objs.size()=1 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.241__shadow_.bD87wLumIddjjDyzAV_OCBQXYHgskhA_0 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.614728816580349162', time=2024-08-27T05:20:35.175566+0000, chain.objs.size()=1 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5YvBsSzqnmGBsur5R48_IVt5i4zXGN5_0 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9815030561012333040', time=2024-08-27T05:20:35.227330+0000, chain.objs.size()=1 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XlNBTyGhTCC6Ue7f_sf0qi8j7p5mfH9_0 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4933145797199313719', time=2024-08-27T05:20:35.287591+0000, chain.objs.size()=1 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aSRULMA3o2rAMqq2CGljotLfKale0Pm_0 2024-08-27T03:58:29.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7690339663683684701', time=2024-08-27T05:20:35.399212+0000, chain.objs.size()=1 2024-08-27T03:58:29.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.cHKDQY4rR_d3UBrsjE6F1VNUw5Ba2LJ_0 2024-08-27T03:58:29.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15939156798400967484', time=2024-08-27T05:20:36.070134+0000, chain.objs.size()=1 2024-08-27T03:58:29.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OJJvuIQGuHOVqA0URiycHc8W8w9S1Qx_0 2024-08-27T03:58:29.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3514447383248034612', time=2024-08-27T05:20:36.842653+0000, chain.objs.size()=1 2024-08-27T03:58:29.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ishOvqJBdVcUzXxOTEJjytXbZVZeUIR_0 2024-08-27T03:58:29.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18010820590183146571', time=2024-08-27T05:20:37.255920+0000, chain.objs.size()=1 2024-08-27T03:58:29.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.I0-KyVse9dK6kSmchp2FP7aJOjeuqQM_0 2024-08-27T03:58:29.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16018319463354610712', time=2024-08-27T05:20:37.777447+0000, chain.objs.size()=1 2024-08-27T03:58:29.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zO4bn_BORh9yoy-KfNy3QHIr8ke1rby_0 2024-08-27T03:58:29.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1248093435932914838', time=2024-08-27T05:20:37.841553+0000, chain.objs.size()=1 2024-08-27T03:58:29.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dwY4GQDMEpbMlsY7oYvB69UhnLfk3GZ_0 2024-08-27T03:58:29.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8198936237594685571', time=2024-08-27T05:20:39.676588+0000, chain.objs.size()=1 2024-08-27T03:58:29.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qFchmTLpwSr8OZ3K7pm-rvKm312Hoo7_0 2024-08-27T03:58:29.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15594052137689943317', time=2024-08-27T05:20:40.120737+0000, chain.objs.size()=1 2024-08-27T03:58:29.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uSquEFQiprrEAYt-ECxn4UU-HQw54kF_0 2024-08-27T03:58:29.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1444386760684116739', time=2024-08-27T05:20:40.352964+0000, chain.objs.size()=1 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HgVVvdc6mmIBbIjr_1unSX-s42zVc6G_0 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13694268683642707008', time=2024-08-27T05:20:40.364076+0000, chain.objs.size()=1 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HPnLZh1g_EcMVxkyvfW2-xekL0EdBbE_0 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13627133266776865984', time=2024-08-27T05:20:41.259289+0000, chain.objs.size()=1 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5HNZcFJCHeyKX43JX2Hjin-eNMvKmF1_0 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1761463604848657443', time=2024-08-27T05:20:43.150657+0000, chain.objs.size()=1 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ljxxXC4Akj2FDS-ne3I6yioL1FNTzwQ_0 2024-08-27T03:58:29.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12657463176544940663', time=2024-08-27T05:20:43.928178+0000, chain.objs.size()=1 2024-08-27T03:58:29.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WI6-991gE12zeBH0bvIcT9OdL3QGqd9_0 2024-08-27T03:58:29.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.772840092232482390', time=2024-08-27T05:20:44.251140+0000, chain.objs.size()=1 2024-08-27T03:58:29.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7Jpvf_BSYNWItGRy0ImTfjQ5MMqWZti_0 2024-08-27T03:58:29.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2725552968473031920', time=2024-08-27T05:20:44.572464+0000, chain.objs.size()=1 2024-08-27T03:58:29.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4fI1PDs-wPvHP7kccyD-6hSHjx-uUCY_0 2024-08-27T03:58:29.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5488194867511979683', time=2024-08-27T05:20:45.195794+0000, chain.objs.size()=1 2024-08-27T03:58:29.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ujj6k8nXujZHTZa5mAcG2dXZ9DNo36o_0 2024-08-27T03:58:29.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4384782941629960709', time=2024-08-27T05:20:45.958094+0000, chain.objs.size()=1 2024-08-27T03:58:29.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5vU5R8vsWgw7cc35g3P_PAC5jXjcgZX_0 2024-08-27T03:58:29.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3491071209450551114', time=2024-08-27T05:20:46.086112+0000, chain.objs.size()=1 2024-08-27T03:58:29.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.559+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ahwAKttDgwggGgWV_aYxXohejPvfE7-_0 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4538615219549200797', time=2024-08-27T05:20:48.184068+0000, chain.objs.size()=1 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.cy57X99tRLRpKIlRnqenZ_wzh-jzKUA_0 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.394542281527564965', time=2024-08-27T05:20:49.503228+0000, chain.objs.size()=1 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pMVw3NYOClChhL9xZMYULMjWuhF6fFc_0 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12830620456704346232', time=2024-08-27T05:20:49.852713+0000, chain.objs.size()=1 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HTKXW80KTVdFCxn_HLKrKh18F1zUVOg_0 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15051386849932804782', time=2024-08-27T05:20:50.822120+0000, chain.objs.size()=1 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MMjlCfg_xkC4WWDZL6Djt7o6MPXfEsL_0 2024-08-27T03:58:29.564 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8077771354313383957', time=2024-08-27T05:20:52.130367+0000, chain.objs.size()=1 2024-08-27T03:58:29.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JbEFqoi15Gvm1QWs06fzv6G53igoGcZ_0 2024-08-27T03:58:29.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14869918691479774161', time=2024-08-27T05:20:52.368615+0000, chain.objs.size()=1 2024-08-27T03:58:29.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.yNrBNuhoqB_sDQEgWj-Bn44JL5YY_-q_0 2024-08-27T03:58:29.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15188670109252655135', time=2024-08-27T05:20:52.370639+0000, chain.objs.size()=1 2024-08-27T03:58:29.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jvxi2V_bhOqseu7PjUJkMV3u8V0fzwo_0 2024-08-27T03:58:29.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9937577156822664343', time=2024-08-27T05:20:52.961668+0000, chain.objs.size()=1 2024-08-27T03:58:29.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4ydOglOm_gFvVxUTwoCW6593iBL9Q6j_0 2024-08-27T03:58:29.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14361269286910129038', time=2024-08-27T05:20:53.269035+0000, chain.objs.size()=1 2024-08-27T03:58:29.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.P_p3VrEOpPrHa-UJjlv6UBG-GFTJink_0 2024-08-27T03:58:29.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3534544199298542358', time=2024-08-27T05:20:55.063766+0000, chain.objs.size()=1 2024-08-27T03:58:29.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.107Xo38pwZUZcaaZBLGiU8SfAZIfKFE_0 2024-08-27T03:58:29.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16694572699026864566', time=2024-08-27T05:20:55.065871+0000, chain.objs.size()=1 2024-08-27T03:58:29.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FBC2iPM09gLz5aziTDKnjTCZFLgMt3r_0 2024-08-27T03:58:29.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15429727391601736001', time=2024-08-27T05:20:55.524558+0000, chain.objs.size()=1 2024-08-27T03:58:29.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NWSXzm02gYaCf47t2549h2HSHEGHYk1_0 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9639921080533507008', time=2024-08-27T05:20:56.972529+0000, chain.objs.size()=1 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Z3UV3cOyN6rLx3SrLTcrCjdtc1LxSIN_0 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6345777440765464073', time=2024-08-27T05:20:57.322180+0000, chain.objs.size()=1 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QNAQykhR2mjU9Tq2NfMK-S0E6j7N9za_0 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5078701279804635124', time=2024-08-27T05:20:58.367046+0000, chain.objs.size()=1 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xCfpIo3qe_G79wSL3E_LgpfYGjSljDF_0 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7934247531691761274', time=2024-08-27T05:20:58.915068+0000, chain.objs.size()=1 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.APcBGiboC2nVWb6wJUhaBPRFf4C3r18_0 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6977401639850799593', time=2024-08-27T05:20:59.079982+0000, chain.objs.size()=1 2024-08-27T03:58:29.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.a24Rw1juOW7AAs2-9_u9A-w_cDNWzrj_0 2024-08-27T03:58:29.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11284323437094247644', time=2024-08-27T05:20:59.572899+0000, chain.objs.size()=1 2024-08-27T03:58:29.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4pJNmdiEej6kK3OfsZyU95aogQueR_o_0 2024-08-27T03:58:29.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18236314487920800624', time=2024-08-27T05:20:59.813241+0000, chain.objs.size()=1 2024-08-27T03:58:29.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.a3xJhNwHu7vqEflFzGRB0JcYAJKllRc_0 2024-08-27T03:58:29.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.811802966053810922', time=2024-08-27T05:21:00.170148+0000, chain.objs.size()=1 2024-08-27T03:58:29.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bhq44zuwTzkXF9CJ0ZEKOP5GUX3E5t-_0 2024-08-27T03:58:29.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9577343449909367584', time=2024-08-27T05:21:02.365240+0000, chain.objs.size()=1 2024-08-27T03:58:29.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CcETxFNriBARHlr6I1Qgs95RuWgXLbL_0 2024-08-27T03:58:29.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12341618228835343815', time=2024-08-27T05:21:03.379509+0000, chain.objs.size()=1 2024-08-27T03:58:29.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ldj3w1RkacYPwbfChaAdvq8HH30Z1mm_0 2024-08-27T03:58:29.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7035030877523308088', time=2024-08-27T05:21:06.038153+0000, chain.objs.size()=1 2024-08-27T03:58:29.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.257__shadow_.yimS96h-M_5ZGlKcPmxIJL2eKj6FQDY_0 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3513278752156436136', time=2024-08-27T05:21:11.191163+0000, chain.objs.size()=1 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.260__shadow_.GyiDryhM4brGlsfNPZ5uYwFPNOqoX-0_0 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15652035128817090402', time=2024-08-27T05:21:12.904999+0000, chain.objs.size()=1 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.261__shadow_.wR0iutgYlhjluLnZMd9STYjstvSCW2O_0 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9570241723893371859', time=2024-08-27T05:21:43.542141+0000, chain.objs.size()=1 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.278__shadow_.bK6k4MVjU4pBmCIinPMjyvieSGnp5HA_0 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4384802827484155489', time=2024-08-27T05:21:55.765649+0000, chain.objs.size()=1 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.284__shadow_.zMtdvXCPrGB0WxgnqRvdrm2wOA5VpcC_0 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7587613384650518776', time=2024-08-27T05:22:13.745038+0000, chain.objs.size()=1 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.290__shadow_.MsYDfFvAuBJfy5xWRx1zAWRHmOYqype_0 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7065826023283708095', time=2024-08-27T05:24:47.077621+0000, chain.objs.size()=1 2024-08-27T03:58:29.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QIpTExa3uDFsw8GpJAbMQ1Z34-RhMTA_0 2024-08-27T03:58:29.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2093478402035160987', time=2024-08-27T05:24:47.539120+0000, chain.objs.size()=1 2024-08-27T03:58:29.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iX9Rosau7z3nDViLp_cQsetGu4Z8wLg_0 2024-08-27T03:58:29.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17083841058746596985', time=2024-08-27T05:24:48.806436+0000, chain.objs.size()=1 2024-08-27T03:58:29.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZT0O1kqcygxV9ie2TAs3nAqDdhWwhcy_0 2024-08-27T03:58:29.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11790538484542714326', time=2024-08-27T05:24:48.906160+0000, chain.objs.size()=1 2024-08-27T03:58:29.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VHPYNxiX8qbVgKehYzVeeLaF88ARFnk_0 2024-08-27T03:58:29.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17785987134734841750', time=2024-08-27T05:24:49.100274+0000, chain.objs.size()=1 2024-08-27T03:58:29.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5LFnCVOvgFM8G9GmwR1ivaB1Hdi-PnW_0 2024-08-27T03:58:29.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.314509563207839728', time=2024-08-27T05:24:50.806820+0000, chain.objs.size()=1 2024-08-27T03:58:29.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5blxywYh63bp6GWqfXy-SDpH35PZU7__0 2024-08-27T03:58:29.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5431711297708708929', time=2024-08-27T05:24:52.172830+0000, chain.objs.size()=1 2024-08-27T03:58:29.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8dpGUO2qhLDbJb55S5vwrdK8MtnnlUz_0 2024-08-27T03:58:29.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18203473250973657735', time=2024-08-27T05:24:52.503372+0000, chain.objs.size()=1 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.UI0vOjqCjCq9BEReZ7WJMx-24Qbv_5B_0 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11852165863396354456', time=2024-08-27T05:24:52.651193+0000, chain.objs.size()=1 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Vf8gYIHK6_Jq9iWE9S0AVwploYxZcmb_0 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4497145993654023805', time=2024-08-27T05:24:53.023198+0000, chain.objs.size()=1 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AdAunDNs_92JuJvsyZlEbNsB2hYXliY_0 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7807214146004687745', time=2024-08-27T05:24:54.260919+0000, chain.objs.size()=1 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uaz5QTVOvtYLNcWnPpPgMFdxB-XVXB-_0 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5781034740239907310', time=2024-08-27T05:24:54.263443+0000, chain.objs.size()=1 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vBO9yZKuaO7vIsDQ4TwypWGvl485PZx_0 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18025603216644844374', time=2024-08-27T05:24:55.474354+0000, chain.objs.size()=1 2024-08-27T03:58:29.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.41Uy5rUyOTh9De84P3gCO6wU-X9-bMs_0 2024-08-27T03:58:29.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9627734208737016508', time=2024-08-27T05:24:56.294889+0000, chain.objs.size()=1 2024-08-27T03:58:29.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.d2Gvk9RHUaW8lnDPVwLb_HKDqObHm4s_0 2024-08-27T03:58:29.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7703988815783716897', time=2024-08-27T05:24:58.042576+0000, chain.objs.size()=1 2024-08-27T03:58:29.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GTPoJbn4UFc3HHZmM-2y1kX2sX5O9z7_0 2024-08-27T03:58:29.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8811318839062466030', time=2024-08-27T05:24:58.161712+0000, chain.objs.size()=1 2024-08-27T03:58:29.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-9vogktT9SblGvwdB-bhE0oVqZYQq9l_0 2024-08-27T03:58:29.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1989568886759815733', time=2024-08-27T05:25:02.161772+0000, chain.objs.size()=1 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Mtvu9oRUWGe5FFAoKkvKPaHBK-7m42h_0 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9507828495166411850', time=2024-08-27T05:25:03.868001+0000, chain.objs.size()=1 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.USsu0h5SSdILS0n-WQvKfIYJLmilutc_0 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18378822353848047219', time=2024-08-27T05:25:05.204406+0000, chain.objs.size()=1 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Nx-RN8I1U4We2g9YafBUKdxcZax5H1m_0 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14171856325975711269', time=2024-08-27T05:25:05.248439+0000, chain.objs.size()=1 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.X1iTXdEcJQCoozf9hPOi45hLmBGzTi-_0 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9898672815273699585', time=2024-08-27T05:25:05.640047+0000, chain.objs.size()=1 2024-08-27T03:58:29.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1gKhHyyHo5JVgVvGBPoTyRQo1AWMqPG_0 2024-08-27T03:58:29.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14548869858394635262', time=2024-08-27T05:25:05.642452+0000, chain.objs.size()=1 2024-08-27T03:58:29.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gZPQleQzbbJ5dpKKO04rH8LIfnww0k2_0 2024-08-27T03:58:29.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17921613367672553296', time=2024-08-27T05:25:06.986927+0000, chain.objs.size()=1 2024-08-27T03:58:29.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SQs7c-sHx_qPp8I7KvUusMyHlxDgGdy_0 2024-08-27T03:58:29.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12128853779621149783', time=2024-08-27T05:25:07.558197+0000, chain.objs.size()=1 2024-08-27T03:58:29.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.UiFUjTw7HNf3u4TArOdMIlFG_y8gaq-_0 2024-08-27T03:58:29.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11913214115065281393', time=2024-08-27T05:25:09.294076+0000, chain.objs.size()=1 2024-08-27T03:58:29.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VFqVPZ9qo6eIef1l2Wl6KJPwUqv_JE7_0 2024-08-27T03:58:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17335858077445745602', time=2024-08-27T05:25:10.248758+0000, chain.objs.size()=1 2024-08-27T03:58:29.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.majWj5HtCP2T8uRi0L1qvbn0i4LLuFL_0 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4307006247698745469', time=2024-08-27T05:25:11.248865+0000, chain.objs.size()=1 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0I7yyRz_ci6y1EVnGj24X_R8U8DSl23_0 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14195223813133845576', time=2024-08-27T05:25:13.496709+0000, chain.objs.size()=1 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qdm0Ft58C5to0UFRH-6nKJaJysk8I1j_0 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5581155429037048505', time=2024-08-27T05:26:57.666709+0000, chain.objs.size()=1 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-x0u8tDykZFQ_KhN9L3mL3qnePIPHuy_0 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13157199840048951630', time=2024-08-27T05:26:58.084447+0000, chain.objs.size()=1 2024-08-27T03:58:29.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.XdgZ4RR1ZilYcre0nHYTesFoBkzPwyy_0 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16504094386740151256', time=2024-08-27T05:26:59.879334+0000, chain.objs.size()=1 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.M_w7HI6Qjnyi0gXD4puJmeZ1kNn23hJ_0 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7411996604434647848', time=2024-08-27T05:26:59.961699+0000, chain.objs.size()=1 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.c2liYL0w-M9N9H-UhksREH1gcj8XjCr_0 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6569492338390249825', time=2024-08-27T05:27:01.624718+0000, chain.objs.size()=1 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hdpMIiND0RtkrcJGlSrOLYLz-SaU5Ek_0 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11658472197466183412', time=2024-08-27T05:27:03.482841+0000, chain.objs.size()=1 2024-08-27T03:58:29.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3ndnWnMAePglUp2P9xYtY0MQnM3O0F__0 2024-08-27T03:58:29.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7756843908691367689', time=2024-08-27T05:27:04.180722+0000, chain.objs.size()=1 2024-08-27T03:58:29.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2FtVbWv9-s5A3LTk_b8pb5y5W8kd18J_0 2024-08-27T03:58:29.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16020524443804870158', time=2024-08-27T05:27:07.257965+0000, chain.objs.size()=1 2024-08-27T03:58:29.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dLQiXmJgtapebgqH5XqXareSTxU0c85_0 2024-08-27T03:58:29.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15757753788669179524', time=2024-08-27T05:27:07.859406+0000, chain.objs.size()=1 2024-08-27T03:58:29.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Q-gV-VvI-XK3a-JgtXGjkQKCu_Ko7Kx_0 2024-08-27T03:58:29.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14767497610916004496', time=2024-08-27T05:27:07.925571+0000, chain.objs.size()=1 2024-08-27T03:58:29.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7ZYLHZgud7mibv7bwf_9SA71sjfaMn8_0 2024-08-27T03:58:29.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9970115879675977222', time=2024-08-27T05:27:09.939853+0000, chain.objs.size()=1 2024-08-27T03:58:29.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.m3lLwf7ZqvmGFwHgsswYh9ZY2CY1GAp_0 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16247290052655866687', time=2024-08-27T05:27:10.409400+0000, chain.objs.size()=1 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gYMIL4iYb1sOXcE_ZlE56B_U8PmjKqd_0 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15895779095295593109', time=2024-08-27T05:27:10.411340+0000, chain.objs.size()=1 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.99Bk6IuBSkICuF5tH86WqiSucIjEiBt_0 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9191754340438431793', time=2024-08-27T05:27:10.652108+0000, chain.objs.size()=1 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.T3t2dRQU5-yLPNgPtFQ8zohPM7HfxVg_0 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12093941379419492043', time=2024-08-27T05:27:11.063674+0000, chain.objs.size()=1 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DxOHLwvRoOPALT58wyGI_d2dWp4yXR0_0 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9821596668202810158', time=2024-08-27T05:27:11.936486+0000, chain.objs.size()=1 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EYh0FVQylp8q75PcnhrjKHF669xf0T8_0 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2720353691633462007', time=2024-08-27T05:27:11.939448+0000, chain.objs.size()=1 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jPXMM_OInLyJRiQVA1ROCMy9E3AJHme_0 2024-08-27T03:58:29.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2777569297096184107', time=2024-08-27T05:27:15.336981+0000, chain.objs.size()=1 2024-08-27T03:58:29.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UoU6fmzmANqsfjUa-Vz20ADz5aomZyf_0 2024-08-27T03:58:29.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46870 2024-08-27T03:58:29.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-08-27T03:58:29.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8080504398682568356', time=2024-08-27T05:27:16.483279+0000, chain.objs.size()=1 2024-08-27T03:58:29.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Bw_Y13H7zSXkcHCZSNIYnbe_scOF55f_0 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6640389211822278736', time=2024-08-27T05:27:18.330856+0000, chain.objs.size()=1 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OAGa8UzywGhV_DU3g6W6dmFeyFNqokd_0 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8596361639413092387', time=2024-08-27T05:27:18.591721+0000, chain.objs.size()=1 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ycDGRRaM0LHppdti_St7IPlWHei9l5L_0 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10130679618025591328', time=2024-08-27T05:27:20.822012+0000, chain.objs.size()=1 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.tuX4qXtc4UH_MOzki8IvLPJ6XuXa6_8_0 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2463573600681791355', time=2024-08-27T05:27:22.118802+0000, chain.objs.size()=1 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.faoO17iURZhNWnJEyfOWfe-zeG0Giyr_0 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14752100440692139430', time=2024-08-27T05:27:22.274235+0000, chain.objs.size()=1 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HgDorBaEM-HXIShdH6ApUNcQDuoh21w_0 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6098477793361714004', time=2024-08-27T05:27:22.732933+0000, chain.objs.size()=1 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pY5EGwMfMWCKTNoWwjmVcDK6NIRnhTP_0 2024-08-27T03:58:29.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16212443093235513216', time=2024-08-27T05:27:23.654007+0000, chain.objs.size()=1 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2UculT0ODQXJsc3s5d6vUpKPoPkumHV_0 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14545665489215994623', time=2024-08-27T05:27:23.878922+0000, chain.objs.size()=1 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.kIhuLIFsXg1TW122IqEo5EpQRG3uNWM_0 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13219521385539054904', time=2024-08-27T05:27:24.618946+0000, chain.objs.size()=1 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9RQ2yqXgQTF7wRNDeNsRVw9-AwAIXLB_0 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4240982353444922680', time=2024-08-27T05:27:25.186578+0000, chain.objs.size()=1 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RXHtkf3AP_vV1VZbMyjt1Oq9W2BKQpm_0 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9534649983398361681', time=2024-08-27T05:27:25.833432+0000, chain.objs.size()=1 2024-08-27T03:58:29.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.plpNukxAy72TtIeiz52Z84REVY_9D8k_0 2024-08-27T03:58:29.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14903488147978063415', time=2024-08-27T05:29:30.354214+0000, chain.objs.size()=1 2024-08-27T03:58:29.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.403__shadow_.60X6iLtUeNKQRUsGAi2b5TOESSLX5cq_0 2024-08-27T03:58:29.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9372532193460830571', time=2024-08-27T05:30:20.980602+0000, chain.objs.size()=1 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.436__shadow_.OJIgNbc4_khCsNfJLx1YorDeduHixLd_0 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9105831627528384211', time=2024-08-27T05:30:42.466183+0000, chain.objs.size()=1 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.449__shadow_.4pmLiIHxiU0abM2qxmUwvMhwK4RXB7f_0 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9899923289755045538', time=2024-08-27T05:31:04.749256+0000, chain.objs.size()=1 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.459__shadow_.FW8qRQYVRV8eGoqF7Uz66X6ykABPma8_0 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16141455870164408883', time=2024-08-27T05:31:59.920929+0000, chain.objs.size()=1 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.494__shadow_.arB3ne_p3Nw5RY8WloDsmB9GVf5hfir_0 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8982257399063713859', time=2024-08-27T05:33:22.493200+0000, chain.objs.size()=1 2024-08-27T03:58:29.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.514__shadow:-0LT41wjA9wcFYNLUbbDadbYWl7uiNT_.8R11l_vjMmXe69FPe7NsZGEKI9qKh1b_0 2024-08-27T03:58:29.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4193129514947781316', time=2024-08-27T05:34:41.876850+0000, chain.objs.size()=6 2024-08-27T03:58:29.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn.1 2024-08-27T03:58:29.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.F-1knjqh6YMslRFZOlWwbbDMXzZYPWQm.2 2024-08-27T03:58:29.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.oeA9-KNYOEAok6aeqhuPWyPfzfjkLvgQ.3 2024-08-27T03:58:29.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn.4 2024-08-27T03:58:29.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn.5 2024-08-27T03:58:29.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn.6 2024-08-27T03:58:29.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13038717440386168983', time=2024-08-27T05:35:12.824490+0000, chain.objs.size()=2 2024-08-27T03:58:29.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~XcBTBHRlrWpyKOfBdnt99JwfX502-f3.1 2024-08-27T03:58:29.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~XcBTBHRlrWpyKOfBdnt99JwfX502-f3.2 2024-08-27T03:58:29.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9691064830330044458', time=2024-08-27T05:35:23.328601+0000, chain.objs.size()=2 2024-08-27T03:58:29.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~IkKDTOePDGt2xN_U-x9t3bn6Jr83wHM.1 2024-08-27T03:58:29.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.615+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~IkKDTOePDGt2xN_U-x9t3bn6Jr83wHM.2 2024-08-27T03:58:29.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.615+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD', time=2024-08-27T05:35:26.137180+0000, chain.objs.size()=10 2024-08-27T03:58:29.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.615+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.1 2024-08-27T03:58:29.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.615+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.2 2024-08-27T03:58:29.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.615+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.3 2024-08-27T03:58:29.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.615+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.4 2024-08-27T03:58:29.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.615+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.5 2024-08-27T03:58:29.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.6 2024-08-27T03:58:29.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.7 2024-08-27T03:58:29.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.8 2024-08-27T03:58:29.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.9 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.520__multipart_mymultipart.2~JG1_85dcXSv2akzC4TQ1-m8Z4DRvKjD.10 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16317762582145866445', time=2024-08-27T05:36:47.453684+0000, chain.objs.size()=1 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.544__shadow_.mLzQb4JE0z1c0pw_2xqT3FtQWwWOH_5_0 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3839486697380172489', time=2024-08-27T05:37:11.018291+0000, chain.objs.size()=1 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.550__shadow_.zafl9FOYROGmvajM7gKS6zMRSBifx5C_0 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10576134299125892053', time=2024-08-27T05:38:02.327238+0000, chain.objs.size()=1 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:LRy8WmtutmKZUnLoe5lGyPaF-F9ki9f_.u2GMEnEw0ONd43iYkboFb_03C8m-BIF_0 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12967407478061968286', time=2024-08-27T05:38:06.680136+0000, chain.objs.size()=1 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:ZNKtVt7CS3E7CAo3FXkv1AfOP211UgQ_.-P7twYq5BrbrNoGw7VNUugFsvzaBdpB_0 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15075450956172936365', time=2024-08-27T05:38:41.573695+0000, chain.objs.size()=1 2024-08-27T03:58:29.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:HhWJtJlFRfF7xrK.vrAnHr5pTHRgpNA_.722Z1GaX-tMS433Ruub-UU4D1gnUJIk_0 2024-08-27T03:58:29.626 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3348503574290696623', time=2024-08-27T05:38:43.333989+0000, chain.objs.size()=1 2024-08-27T03:58:29.626 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:5xEnHysXkZL8kSBebYx0FzUx8BHV213_.GG_SicGnbpCaEokcuqQtcajlws0t7JI_0 2024-08-27T03:58:29.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6493651382039982350', time=2024-08-27T05:39:01.103446+0000, chain.objs.size()=1 2024-08-27T03:58:29.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:BqdrT0kh9gzuy77aU4PZ7snyWqOPqW5_.hfJMdHws3ExxCLxW8n6brlNsXFZ_8v__0 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2554597041635620680', time=2024-08-27T05:39:49.144094+0000, chain.objs.size()=4 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~-_5vGF61bQDeosfHxdC3BPypDRXoFEp.1 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~-_5vGF61bQDeosfHxdC3BPypDRXoFEp.2 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~-_5vGF61bQDeosfHxdC3BPypDRXoFEp.3 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~-_5vGF61bQDeosfHxdC3BPypDRXoFEp.4 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5825054346263236974', time=2024-08-27T05:39:55.438933+0000, chain.objs.size()=1 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:.1RmSvYaKy0eO9-OPjzg.DWmCnUP1-W_.VClu16ktRigOAysVzWTwLjWoskNpyPL_0 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.627+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13288069960783092508', time=2024-08-27T05:40:29.621335+0000, chain.objs.size()=1 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.627+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.590__shadow_.0HnmI0PnlnW6-2VeTv15HwkuBXsfLH9_0 2024-08-27T03:58:29.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.627+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~2UslTvzFFAVT-7D6zrNNTG9IYxeDGt1', time=2024-08-27T05:45:08.367742+0000, chain.objs.size()=6 2024-08-27T03:58:29.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.627+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.618__multipart_multipart_enc.2~2UslTvzFFAVT-7D6zrNNTG9IYxeDGt1.1 2024-08-27T03:58:29.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.627+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.618__multipart_multipart_enc.2~2UslTvzFFAVT-7D6zrNNTG9IYxeDGt1.2 2024-08-27T03:58:29.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.627+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.618__multipart_multipart_enc.2~2UslTvzFFAVT-7D6zrNNTG9IYxeDGt1.3 2024-08-27T03:58:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.627+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.618__multipart_multipart_enc.2~2UslTvzFFAVT-7D6zrNNTG9IYxeDGt1.4 2024-08-27T03:58:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.618__multipart_multipart_enc.2~2UslTvzFFAVT-7D6zrNNTG9IYxeDGt1.5 2024-08-27T03:58:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.618__multipart_multipart_enc.2~2UslTvzFFAVT-7D6zrNNTG9IYxeDGt1.6 2024-08-27T03:58:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5775279267225478144', time=2024-08-27T05:46:20.131320+0000, chain.objs.size()=2 2024-08-27T03:58:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.650__shadow_.uRSz8fLLs0Uq-4MohXQzrfFRer-PbUj_0 2024-08-27T03:58:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.650__shadow_.uRSz8fLLs0Uq-4MohXQzrfFRer-PbUj_1 2024-08-27T03:58:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13414000203404898602', time=2024-08-27T05:46:45.964482+0000, chain.objs.size()=6 2024-08-27T03:58:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.656__multipart_foo.2~KVGPJmTyO673Pspk72d8rHwTxf6PXA8.1 2024-08-27T03:58:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.656__multipart_foo.2~KVGPJmTyO673Pspk72d8rHwTxf6PXA8.2 2024-08-27T03:58:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.656__multipart_foo.2~KVGPJmTyO673Pspk72d8rHwTxf6PXA8.3 2024-08-27T03:58:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.656__multipart_foo.2~KVGPJmTyO673Pspk72d8rHwTxf6PXA8.4 2024-08-27T03:58:29.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.656__multipart_foo.2~KVGPJmTyO673Pspk72d8rHwTxf6PXA8.5 2024-08-27T03:58:29.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.656__multipart_foo.2~KVGPJmTyO673Pspk72d8rHwTxf6PXA8.6 2024-08-27T03:58:29.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.639+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8498578161240377779', time=2024-08-27T05:46:50.757873+0000, chain.objs.size()=1 2024-08-27T03:58:29.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.658__shadow_.gmbpM7BSshwvHCPAQ6FscMQ3JxU31Of_0 2024-08-27T03:58:29.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.639+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18089084468214646650', time=2024-08-27T05:48:35.878059+0000, chain.objs.size()=1 2024-08-27T03:58:29.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.712__shadow_.unXhw6KlPZ9qx0qPD5DxE2NhWMG8eC7_0 2024-08-27T03:58:29.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.643+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.643+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-08-27T03:58:29.649 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45224' 2024-08-27T03:58:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_MQyndMBgGBIHwzYqrhrULQzS_HS_U94', time=2024-08-27T05:13:24.474397+0000, chain.objs.size()=2 2024-08-27T03:58:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.XHjVWQRt5hFcZGYDbX7LYFCwC4HAlbf_0 2024-08-27T03:58:29.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.XHjVWQRt5hFcZGYDbX7LYFCwC4HAlbf_1 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18326038813508006740', time=2024-08-27T05:13:35.320240+0000, chain.objs.size()=3 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-LUKEWARM.2~47fcBvyOczFvK-TQ3IKf0024JgMZ3ty.1 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-LUKEWARM.2~47fcBvyOczFvK-TQ3IKf0024JgMZ3ty.2 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-LUKEWARM.2~47fcBvyOczFvK-TQ3IKf0024JgMZ3ty.3 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5227192739129448069', time=2024-08-27T05:14:15.725944+0000, chain.objs.size()=1 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.171__shadow_.um95knMjPTxkOzWztphXucGW-4R6FII_0 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18168194813614753439', time=2024-08-27T05:18:02.611783+0000, chain.objs.size()=1 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.229__shadow_.GotHp7vc_lDF7XpGB7691roUklOr7nK_0 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8426326880747562268', time=2024-08-27T05:18:29.308728+0000, chain.objs.size()=1 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.242__shadow_.pxd554J5IRcAAyxAv68cgHmOH_2Eic6_0 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11978470063157060964', time=2024-08-27T05:18:36.670590+0000, chain.objs.size()=1 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.246__shadow_.dUh1mY6VSf45J7ZFmgb-l6YLYaosu3H_0 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13872410050358806432', time=2024-08-27T05:18:38.554852+0000, chain.objs.size()=1 2024-08-27T03:58:29.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.247__shadow_.xpqVdSlg3wS0pEAHMfXE8C1IXibeMxM_0 2024-08-27T03:58:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13364490770173209484', time=2024-08-27T05:18:44.122023+0000, chain.objs.size()=1 2024-08-27T03:58:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.250__shadow_.JZT6BttaVQQjcuF1KbUfqMmH-4F0cLy_0 2024-08-27T03:58:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13104226643206387650', time=2024-08-27T05:18:45.870792+0000, chain.objs.size()=1 2024-08-27T03:58:29.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.251__shadow_.gNxiP6BlzHdB5iI3Lnc_YU5zHqYjIwF_0 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1396670187533236390', time=2024-08-27T05:20:35.136929+0000, chain.objs.size()=1 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OIisZmwF9x3mbbQXxz3sbZNASQqbeZi_0 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7724155309633939487', time=2024-08-27T05:20:35.199518+0000, chain.objs.size()=1 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SyNzWiLwtNrV0PKv1W1o-o9GZ-tmCVC_0 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5318458452494383042', time=2024-08-27T05:20:35.710682+0000, chain.objs.size()=1 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0AB4h4PQA4tc0M5fvbQervv2C5jSVwd_0 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14181328911819457519', time=2024-08-27T05:20:36.165535+0000, chain.objs.size()=1 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nkDeILGZlOMY5AVBkfp2ioX2Jh9j8k-_0 2024-08-27T03:58:29.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12203847684482687332', time=2024-08-27T05:20:36.353236+0000, chain.objs.size()=1 2024-08-27T03:58:29.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.tjJppHg6MpHX8tnQ8I0qnzMurUJj-vM_0 2024-08-27T03:58:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12400831426334578245', time=2024-08-27T05:20:36.389358+0000, chain.objs.size()=1 2024-08-27T03:58:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.u1co_wv9T0tL2ZwixqasZOsBgqVXefN_0 2024-08-27T03:58:29.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1633952518423282717', time=2024-08-27T05:20:36.476150+0000, chain.objs.size()=1 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sShp8XVrzqkwRQli4w2nXOIf_cJZPth_0 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3900448256603312269', time=2024-08-27T05:20:37.653637+0000, chain.objs.size()=1 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mM2gWWyVkBd4R8oOs96Mv1XcaMCjHSY_0 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14358433087356684784', time=2024-08-27T05:20:37.745580+0000, chain.objs.size()=1 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ng_zWXjO1BIXo_q6wcODJlDbB13PlWA_0 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10285443623376439938', time=2024-08-27T05:20:39.236075+0000, chain.objs.size()=1 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.YQoY1tMKUGu8LyaxQuUEvPkGiTeFVMt_0 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16498402552754146292', time=2024-08-27T05:20:40.114516+0000, chain.objs.size()=1 2024-08-27T03:58:29.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.J6zA2j-gwD0ECKE_qzMMXqVqVsicinw_0 2024-08-27T03:58:29.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5345812647541237212', time=2024-08-27T05:20:40.448034+0000, chain.objs.size()=1 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TQJycrNVdRUudBuHuUSh1MNX3S6rR5D_0 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8471006198910087144', time=2024-08-27T05:20:41.169132+0000, chain.objs.size()=1 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RW-1AHBfDsCgQKwvj6xEQBHmfwvERIl_0 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13573215412402465969', time=2024-08-27T05:20:41.300342+0000, chain.objs.size()=1 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.V1cdNSktHxIdfEzG6pqL4IFlCxR0Onl_0 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10988068703635760871', time=2024-08-27T05:20:41.477813+0000, chain.objs.size()=1 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3gjCJ8E6l0jqphW3Ij4tLtka8ss-hZG_0 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3758119395576342295', time=2024-08-27T05:20:41.706019+0000, chain.objs.size()=1 2024-08-27T03:58:29.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ok6BLSTwDTNFu-K3pXNOMxNCR_rkoL7_0 2024-08-27T03:58:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3240396546039663667', time=2024-08-27T05:20:43.369817+0000, chain.objs.size()=1 2024-08-27T03:58:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oLfC_Q2LW7bBYJhfFUqJ8ZsxVALlXXJ_0 2024-08-27T03:58:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13521120173875151491', time=2024-08-27T05:20:43.720772+0000, chain.objs.size()=1 2024-08-27T03:58:29.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xN5A483rrRgatt2nB6jYSPOdiHZbpIc_0 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16950576410582213069', time=2024-08-27T05:20:43.922754+0000, chain.objs.size()=1 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MSLTorkxdhrO30WI6xgeGge92OYZRSf_0 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10111929123696664637', time=2024-08-27T05:20:44.819803+0000, chain.objs.size()=1 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eUHcvlDL2kBiqXM7JK_7Fl7metvDA-1_0 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5781024292650203465', time=2024-08-27T05:20:45.072919+0000, chain.objs.size()=1 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lvia5whz8MJMsUnkGynXzmSMdSWNuH1_0 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8873445964894041049', time=2024-08-27T05:20:45.493077+0000, chain.objs.size()=1 2024-08-27T03:58:29.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.w2cTNfHhrDQfKGSQMbhyB7Ik0kXbLaj_0 2024-08-27T03:58:29.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7402739653406388234', time=2024-08-27T05:20:47.051603+0000, chain.objs.size()=1 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mGrspuFoSxrunakNopFM-3I1WlMyM97_0 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3906579729029589458', time=2024-08-27T05:20:49.324754+0000, chain.objs.size()=1 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WGGCDFBaSup-nvAqDnbKHfQrUKC5_RM_0 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14360384140910863345', time=2024-08-27T05:20:51.208558+0000, chain.objs.size()=1 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qm_-zXn6kh95FOhoC53XXvcut3hHour_0 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7048527793316210308', time=2024-08-27T05:20:51.879475+0000, chain.objs.size()=1 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HcnPsJuOA00PLwr1hy3reLUCLnhVQAt_0 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12677435375291661272', time=2024-08-27T05:20:52.126404+0000, chain.objs.size()=1 2024-08-27T03:58:29.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PNPUndBYup1_tA1aYj4QjmHcplDtSt4_0 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16722436957643829837', time=2024-08-27T05:20:53.309372+0000, chain.objs.size()=1 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.daQIdubesCiId3RMzPYAHYJgPL0KTrk_0 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3842468220436788512', time=2024-08-27T05:20:53.684526+0000, chain.objs.size()=1 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7AVzWFvyiz2uXHk7AWwN1gC_zijh96i_0 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1861925228688975958', time=2024-08-27T05:20:55.196379+0000, chain.objs.size()=1 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.huGPz73i82qI3PHVOT0YWuRHQMOzwQN_0 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4852013455567546708', time=2024-08-27T05:20:58.926878+0000, chain.objs.size()=1 2024-08-27T03:58:29.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pqyJnMQpmd7k3woiaENtPgQBveV3SC-_0 2024-08-27T03:58:29.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5942989253570479571', time=2024-08-27T05:20:59.125932+0000, chain.objs.size()=1 2024-08-27T03:58:29.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bxQqO2oYlOTair1cfufP2UhFxksd5BE_0 2024-08-27T03:58:29.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8783024603609766581', time=2024-08-27T05:20:59.294070+0000, chain.objs.size()=1 2024-08-27T03:58:29.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.q6jnpPx8QVQ4EvsXo0s4JkduOXlQd0k_0 2024-08-27T03:58:29.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.588263706048591487', time=2024-08-27T05:20:59.392588+0000, chain.objs.size()=1 2024-08-27T03:58:29.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.o5-7Bax5pHkyt3D1o2HRN0V8pOLdi6d_0 2024-08-27T03:58:29.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10678685009259506157', time=2024-08-27T05:21:02.644063+0000, chain.objs.size()=1 2024-08-27T03:58:29.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.63ps9irF8druK7RCmGytzwaKKvJMHL7_0 2024-08-27T03:58:29.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9808060633541639284', time=2024-08-27T05:21:03.127501+0000, chain.objs.size()=1 2024-08-27T03:58:29.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BbbxcppfeLcT1rF5Y-MDq_HJras40ur_0 2024-08-27T03:58:29.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.360593288684198403', time=2024-08-27T05:21:04.053913+0000, chain.objs.size()=1 2024-08-27T03:58:29.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Vi21ofN8aet1ogbYVqzjkJh0wTthIeO_0 2024-08-27T03:58:29.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8783898971304258667', time=2024-08-27T05:21:09.460168+0000, chain.objs.size()=1 2024-08-27T03:58:29.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.259__shadow_.lhWv5QZrZzyEaJjaqxjQ78K-fb7FsBj_0 2024-08-27T03:58:29.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11527460279424631397', time=2024-08-27T05:21:14.597613+0000, chain.objs.size()=1 2024-08-27T03:58:29.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.262__shadow_.dHsNutgKxjteA9uwmb9GxfUm-dnJFEt_0 2024-08-27T03:58:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8255515362578113013', time=2024-08-27T05:21:32.361349+0000, chain.objs.size()=1 2024-08-27T03:58:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.272__shadow_.4t35ZU-V_vUykIMnqekmTyQKG1zi-fF_0 2024-08-27T03:58:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3362098682394311815', time=2024-08-27T05:22:02.834917+0000, chain.objs.size()=1 2024-08-27T03:58:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.iRvNlBjnw_QyBldMTP6qtiD_w3VuSw2_0 2024-08-27T03:58:29.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4972537176818566124', time=2024-08-27T05:22:02.983485+0000, chain.objs.size()=1 2024-08-27T03:58:29.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_._k5-wtNfDE4ZkVhk_wlktLDm5l1PKNm_0 2024-08-27T03:58:29.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1531503249768566974', time=2024-08-27T05:22:15.602859+0000, chain.objs.size()=1 2024-08-27T03:58:29.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.291__shadow_.FJj1GTBDYrEzv_F-hCkGIpL4XqcTdaB_0 2024-08-27T03:58:29.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15536394705483987385', time=2024-08-27T05:22:21.466495+0000, chain.objs.size()=1 2024-08-27T03:58:29.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.294__shadow_.ArdYBDo0Hm0sPJqGHCE_CRTqCIyX9OD_0 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16990647368867351389', time=2024-08-27T05:22:30.734176+0000, chain.objs.size()=1 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.299__shadow_.KQsp9BU2H8R4CnmnTsYkm3975ZRQHPw_0 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11789229194318961609', time=2024-08-27T05:23:03.043022+0000, chain.objs.size()=1 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.316__shadow_.MGDbMD-QMUrJihAGn6kASWPjxtt1Fho_0 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5344399076842970462', time=2024-08-27T05:24:46.447552+0000, chain.objs.size()=1 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.in30sZt1dIdYwkx3Xgfyiz6B_VIK1vg_0 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2107115609737673597', time=2024-08-27T05:24:46.490301+0000, chain.objs.size()=1 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dmdmQInnhoHmml4JJA2O1kBd76qFlog_0 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13954890667937549922', time=2024-08-27T05:24:48.693696+0000, chain.objs.size()=1 2024-08-27T03:58:29.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.aJ8ym9Y2hHcgV0UKMBZHew9shjo89vn_0 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4875379306330352635', time=2024-08-27T05:24:49.340629+0000, chain.objs.size()=1 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0off6r774lIi3-mnGehXqM6jdZ0UPCd_0 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2315085358312657004', time=2024-08-27T05:24:50.892392+0000, chain.objs.size()=1 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.q04Ra9xp3FFMzKCK4tmPiM6tyxJB9Tg_0 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16328054598327516135', time=2024-08-27T05:24:51.284581+0000, chain.objs.size()=1 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x4oJfaYNFqWFAnNLc6Vc92Rjvsl4xhI_0 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8988460679610121656', time=2024-08-27T05:24:54.256638+0000, chain.objs.size()=1 2024-08-27T03:58:29.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rJmDj6aHo8IzcI9oK1Dp6hYI5FBySLD_0 2024-08-27T03:58:29.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10443180250394526886', time=2024-08-27T05:24:54.365778+0000, chain.objs.size()=1 2024-08-27T03:58:29.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zHcOV8fNM615FAfI6Kn5hrYIj-m8Han_0 2024-08-27T03:58:29.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4423602025263440914', time=2024-08-27T05:24:55.047701+0000, chain.objs.size()=1 2024-08-27T03:58:29.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4UxoXjwX4z85tXKSN9Bo4Bt64RnU4ZG_0 2024-08-27T03:58:29.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11567195297771371956', time=2024-08-27T05:24:55.414223+0000, chain.objs.size()=1 2024-08-27T03:58:29.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AuiWkmxstBZGP8MK5fmvx7fAF6Xy05j_0 2024-08-27T03:58:29.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7162968640076203925', time=2024-08-27T05:24:55.882920+0000, chain.objs.size()=1 2024-08-27T03:58:29.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zxtawN3L12qltDf5DscTV7vYUQ-swlf_0 2024-08-27T03:58:29.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9432348845029892972', time=2024-08-27T05:24:57.107829+0000, chain.objs.size()=1 2024-08-27T03:58:29.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.INVdP_mhjYv2ZfTO9sckweh2IvC7RO9_0 2024-08-27T03:58:29.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15262752687936887662', time=2024-08-27T05:24:58.864434+0000, chain.objs.size()=1 2024-08-27T03:58:29.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XAX7yCXSQ-D5KDGdKImVlp5_56wjMIO_0 2024-08-27T03:58:29.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16178298841060924470', time=2024-08-27T05:24:59.843950+0000, chain.objs.size()=1 2024-08-27T03:58:29.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5AO3jZ4Eq7UQhUBldxIrBU6X81hePgy_0 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10635030624343250909', time=2024-08-27T05:25:00.138264+0000, chain.objs.size()=1 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.pDivftqP3mQZ5H8nuXP_LFL5fQmoS-1_0 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13316389815916196247', time=2024-08-27T05:25:00.821144+0000, chain.objs.size()=1 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.c56o01ufOodluhGxqdrdsscS1g4dE9J_0 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.105764906274344477', time=2024-08-27T05:25:01.693556+0000, chain.objs.size()=1 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mHJ7KRYC5oLXxj513eqRdCtRGZGi6Hn_0 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11665106077623456757', time=2024-08-27T05:25:02.477501+0000, chain.objs.size()=1 2024-08-27T03:58:29.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TzH-Vl9TC3Lg1BlT_5c3VNPJSe0THcw_0 2024-08-27T03:58:29.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1236914225036550487', time=2024-08-27T05:25:04.145420+0000, chain.objs.size()=1 2024-08-27T03:58:29.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hYNsBtag2IV9Be-S1bgenLsx3iOHzqU_0 2024-08-27T03:58:29.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4320573077516412363', time=2024-08-27T05:25:05.553710+0000, chain.objs.size()=1 2024-08-27T03:58:29.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZMdZMPOEKZj3qzLDpJ3axzW6QTgafkX_0 2024-08-27T03:58:29.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7660601730248863365', time=2024-08-27T05:25:06.517304+0000, chain.objs.size()=1 2024-08-27T03:58:29.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wx5FoKaERVbaLOOKT9w6cwRCLGYfXV9_0 2024-08-27T03:58:29.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11168571077447515649', time=2024-08-27T05:25:06.678311+0000, chain.objs.size()=1 2024-08-27T03:58:29.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1FVZNY2Bh5gLcUxXNEIQS6P6wQ7ewLj_0 2024-08-27T03:58:29.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17044350007188836297', time=2024-08-27T05:25:07.475648+0000, chain.objs.size()=1 2024-08-27T03:58:29.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3UZgkPUo3TaarkJF4ujpT90lmAxf9rT_0 2024-08-27T03:58:29.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7196215771789001050', time=2024-08-27T05:25:07.477797+0000, chain.objs.size()=1 2024-08-27T03:58:29.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7Z8pVY9Gc0I0DvaPZ332a4UCBvysb4E_0 2024-08-27T03:58:29.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1754316216530529579', time=2024-08-27T05:25:07.913182+0000, chain.objs.size()=1 2024-08-27T03:58:29.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PSo-C1E5uPMMfGGU1vkYT-nGv1_tHFo_0 2024-08-27T03:58:29.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12463236335644766526', time=2024-08-27T05:25:08.001839+0000, chain.objs.size()=1 2024-08-27T03:58:29.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Z6c-wJ8gS1pB678yM7z2Ocnf42SJ-5Y_0 2024-08-27T03:58:29.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13397058102027540423', time=2024-08-27T05:25:08.859618+0000, chain.objs.size()=1 2024-08-27T03:58:29.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2D0Ye7MK3UBTTQzSwRGUaUMzaWtiX84_0 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15192614779819990717', time=2024-08-27T05:25:08.870023+0000, chain.objs.size()=1 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uEosiM1Z6d9PUqQgg4dMJQYXqgGMbxG_0 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286771444472482771', time=2024-08-27T05:25:09.551001+0000, chain.objs.size()=1 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Vv4mPLLKmaA75sP4bfneH_aqkxDAscn_0 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7721668044544117291', time=2024-08-27T05:25:09.809833+0000, chain.objs.size()=1 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yh1fq8138KRQP7LlDmiQYREJROAc15T_0 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14743547854779994257', time=2024-08-27T05:25:10.135894+0000, chain.objs.size()=1 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.IiVUzifRq2oHsCEX70zw3igTin6icL5_0 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10957097166483135544', time=2024-08-27T05:25:10.483234+0000, chain.objs.size()=1 2024-08-27T03:58:29.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VfOiI9ue7G5VFvWPT_-JoDTJmxzax-i_0 2024-08-27T03:58:29.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8414943562818126179', time=2024-08-27T05:25:12.743178+0000, chain.objs.size()=1 2024-08-27T03:58:29.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7FWLhVwrbbCaom6y2Tq010Sn2IO-SB6_0 2024-08-27T03:58:29.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2657701727428625635', time=2024-08-27T05:25:12.968017+0000, chain.objs.size()=1 2024-08-27T03:58:29.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.p_1cvnIP21in-926dl9ZJtoX7gOHTV1_0 2024-08-27T03:58:29.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13233396407441749540', time=2024-08-27T05:25:13.907116+0000, chain.objs.size()=1 2024-08-27T03:58:29.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zItfhYs7XsacFw5wQg-Ahj2imEfsSxH_0 2024-08-27T03:58:29.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3061173244972804249', time=2024-08-27T05:25:14.255599+0000, chain.objs.size()=1 2024-08-27T03:58:29.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FZPJ7uuZmiBo-pvJgbRrld_Twg9dBAJ_0 2024-08-27T03:58:29.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1657093311138597438', time=2024-08-27T05:26:59.133840+0000, chain.objs.size()=1 2024-08-27T03:58:29.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2y1tlw-VdOztyOSNlVe_Ez5XiKi_7rH_0 2024-08-27T03:58:29.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13418663019598772332', time=2024-08-27T05:27:05.919410+0000, chain.objs.size()=1 2024-08-27T03:58:29.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.g-ddP1V4lRlzyuvqPhRtATu4wUZlk_F_0 2024-08-27T03:58:29.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7763516027241707152', time=2024-08-27T05:27:06.148229+0000, chain.objs.size()=1 2024-08-27T03:58:29.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KQW2VOtIoN58z--jKgKwVWDvWPq4AAD_0 2024-08-27T03:58:29.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4303257283142692683', time=2024-08-27T05:27:06.264667+0000, chain.objs.size()=1 2024-08-27T03:58:29.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.or7b0tUHMxO_0YQkjMLu2YzORbgYTOT_0 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14776357005922868873', time=2024-08-27T05:27:06.611404+0000, chain.objs.size()=1 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TFA0aiK40x1knnXZq31nOsBuoG-Wrkn_0 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4084114319492626507', time=2024-08-27T05:27:07.925866+0000, chain.objs.size()=1 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LvcjDFUBHA0h4yyRzTEjvHaQIDxFqX5_0 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2436387151190338727', time=2024-08-27T05:27:09.602981+0000, chain.objs.size()=1 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CeEOsNzuBEzl8FURWtVon7kBvQ2_sZX_0 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5763939152710172315', time=2024-08-27T05:27:14.602337+0000, chain.objs.size()=1 2024-08-27T03:58:29.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.s3ZWqX26C7H5w6cgIX967tweWyzUmql_0 2024-08-27T03:58:29.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15904541431871983698', time=2024-08-27T05:27:16.874481+0000, chain.objs.size()=1 2024-08-27T03:58:29.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.699+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BgIUGe3Tw0QcOOwNpM9n5Ex_XaCdM8l_0 2024-08-27T03:58:29.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45224 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9422020645613093879', time=2024-08-27T05:27:16.974768+0000, chain.objs.size()=1 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mORY90r8JQhWdZ0i1MPVpxfrrWIiJ5S_0 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12288440312922078992', time=2024-08-27T05:27:17.380551+0000, chain.objs.size()=1 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N8QYlAAeWq2Iqz8qwNrxT2U4MJwqVly_0 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14053061490767005752', time=2024-08-27T05:27:17.753173+0000, chain.objs.size()=1 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DvMG1iuwVYhJIDVaXo9HPkBT_zoj8nn_0 2024-08-27T03:58:29.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7750088630333469448', time=2024-08-27T05:27:18.376970+0000, chain.objs.size()=1 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mYeQTyqasXqpTdq2zwO6hG30zHsehFp_0 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10351463503951916070', time=2024-08-27T05:27:18.794079+0000, chain.objs.size()=1 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.O03difk9P3aq7SL0CfEAYO73upcWlXT_0 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11366536151843962125', time=2024-08-27T05:27:18.928168+0000, chain.objs.size()=1 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.aXJykTVFgvX5TM_NXEKX4owcAmVrmcE_0 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2287373177087771381', time=2024-08-27T05:27:19.013181+0000, chain.objs.size()=1 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.g97VLLxiv6my8BapEwbj_8bE54OLJWM_0 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7905818778958186358', time=2024-08-27T05:27:20.079326+0000, chain.objs.size()=1 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Ng8IozAlDVdMy5KoWMN60Bzd2sD7YYV_0 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3684749340362445156', time=2024-08-27T05:27:20.740535+0000, chain.objs.size()=1 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dSVT4Q8B_k0kcoqSP7I3_WbLv_UAD8J_0 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13463909436795956342', time=2024-08-27T05:27:21.159020+0000, chain.objs.size()=1 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rcPDycWKWOfbFMIY3tyfwJbne57vkn3_0 2024-08-27T03:58:29.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10476575993433672517', time=2024-08-27T05:27:22.398008+0000, chain.objs.size()=1 2024-08-27T03:58:29.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.exhxV-CaWge5z3m7hOV_wQXqJPEa00c_0 2024-08-27T03:58:29.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1097150512498331660', time=2024-08-27T05:27:23.876373+0000, chain.objs.size()=1 2024-08-27T03:58:29.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Qnc8UcWb700GAl6FpOt1R-Noo2k5VtW_0 2024-08-27T03:58:29.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6341629846437806356', time=2024-08-27T05:27:24.195341+0000, chain.objs.size()=1 2024-08-27T03:58:29.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OqAS6DkgVcnof-Kr_WrYlGV43AzSRUh_0 2024-08-27T03:58:29.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6780752405554504290', time=2024-08-27T05:27:24.893240+0000, chain.objs.size()=1 2024-08-27T03:58:29.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ctyXT7-Pza8A91gSV36Bvseypi9xjym_0 2024-08-27T03:58:29.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17240273588197026570', time=2024-08-27T05:27:24.970999+0000, chain.objs.size()=1 2024-08-27T03:58:29.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CjHXV4AGCA51_JC8diJBziU5J5oZHRM_0 2024-08-27T03:58:29.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11925321862207581108', time=2024-08-27T05:27:24.973009+0000, chain.objs.size()=1 2024-08-27T03:58:29.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Nn6-dncIXgfTwNFgwZYKOjEub7kNcZ7_0 2024-08-27T03:58:29.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14540618150180991719', time=2024-08-27T05:27:25.186129+0000, chain.objs.size()=1 2024-08-27T03:58:29.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AA42P5MF7uPGnYPTC9pwGS8I5hzk34a_0 2024-08-27T03:58:29.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12478785106515627480', time=2024-08-27T05:30:46.781188+0000, chain.objs.size()=1 2024-08-27T03:58:29.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.451__shadow_.QvbLdJly5v5qtwryVe5_6EwKprdfExS_0 2024-08-27T03:58:29.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1115163097754068050', time=2024-08-27T05:30:48.966568+0000, chain.objs.size()=1 2024-08-27T03:58:29.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.452__shadow_.5rtSEx_2Zf-i0IpXtojDNodCqemI9Nl_0 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8465440846258262521', time=2024-08-27T05:31:04.752174+0000, chain.objs.size()=1 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.459__shadow_.pzJSWdhkFG_uV6eeKx0bOfDojXrD9oe_0 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15934497428945320819', time=2024-08-27T05:31:28.438486+0000, chain.objs.size()=1 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.11V7iHBaR7_2kZDeQAtNAdb7zVPz7kJ_0 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11872403894781667382', time=2024-08-27T05:31:31.878119+0000, chain.objs.size()=1 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.479__shadow_.QVacIKUjR95SX250uAmR5LY51uiW9AB_0 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17500427125333003457', time=2024-08-27T05:32:39.532138+0000, chain.objs.size()=1 2024-08-27T03:58:29.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.512__multipart_mymultipart.2~RHu3ASqEyy1-B8qEkg9iFSEpTLi0TE4.1 2024-08-27T03:58:29.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17151295735914817319', time=2024-08-27T05:33:01.001142+0000, chain.objs.size()=6 2024-08-27T03:58:29.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.513__multipart_mymultipart.2~iP7LW9Oq9qhFm7b16q04QO29DvYXxsH.1 2024-08-27T03:58:29.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.513__multipart_mymultipart.2~iP7LW9Oq9qhFm7b16q04QO29DvYXxsH.2 2024-08-27T03:58:29.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.513__multipart_mymultipart.2~iP7LW9Oq9qhFm7b16q04QO29DvYXxsH.3 2024-08-27T03:58:29.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.513__multipart_mymultipart.2~iP7LW9Oq9qhFm7b16q04QO29DvYXxsH.4 2024-08-27T03:58:29.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.513__multipart_mymultipart.2~iP7LW9Oq9qhFm7b16q04QO29DvYXxsH.5 2024-08-27T03:58:29.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.513__multipart_mymultipart.2~iP7LW9Oq9qhFm7b16q04QO29DvYXxsH.6 2024-08-27T03:58:29.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14765006450260360558', time=2024-08-27T05:37:16.302664+0000, chain.objs.size()=1 2024-08-27T03:58:29.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.551__shadow_.OO1GjIrOE07u3mtkJmTRFEZ_tZ9Gmc6_0 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16208608110548815515', time=2024-08-27T05:42:20.167882+0000, chain.objs.size()=6 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.609__multipart_multipart_enc.2~tBdrTC2cJ6L-N1OpcS4gHrQEHgN0Fwz.1 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.609__multipart_multipart_enc.2~tBdrTC2cJ6L-N1OpcS4gHrQEHgN0Fwz.2 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.609__multipart_multipart_enc.2~tBdrTC2cJ6L-N1OpcS4gHrQEHgN0Fwz.3 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.609__multipart_multipart_enc.2~tBdrTC2cJ6L-N1OpcS4gHrQEHgN0Fwz.4 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.609__multipart_multipart_enc.2~tBdrTC2cJ6L-N1OpcS4gHrQEHgN0Fwz.5 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.609__multipart_multipart_enc.2~tBdrTC2cJ6L-N1OpcS4gHrQEHgN0Fwz.6 2024-08-27T03:58:29.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15058021382930232645', time=2024-08-27T05:44:25.770610+0000, chain.objs.size()=1 2024-08-27T03:58:29.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.612__shadow_.7N2qALdmrqeZhIldqblbDBWpZ5kc5OG_0 2024-08-27T03:58:29.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~AH-RiQkkZ6nZVTj0wBajP1QESAO7M1M', time=2024-08-27T05:45:17.366625+0000, chain.objs.size()=6 2024-08-27T03:58:29.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.619__multipart_multipart_enc.2~AH-RiQkkZ6nZVTj0wBajP1QESAO7M1M.1 2024-08-27T03:58:29.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.619__multipart_multipart_enc.2~AH-RiQkkZ6nZVTj0wBajP1QESAO7M1M.2 2024-08-27T03:58:29.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.619__multipart_multipart_enc.2~AH-RiQkkZ6nZVTj0wBajP1QESAO7M1M.3 2024-08-27T03:58:29.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.619__multipart_multipart_enc.2~AH-RiQkkZ6nZVTj0wBajP1QESAO7M1M.4 2024-08-27T03:58:29.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.619__multipart_multipart_enc.2~AH-RiQkkZ6nZVTj0wBajP1QESAO7M1M.5 2024-08-27T03:58:29.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.619__multipart_multipart_enc.2~AH-RiQkkZ6nZVTj0wBajP1QESAO7M1M.6 2024-08-27T03:58:29.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7767090805888499849', time=2024-08-27T05:45:23.601359+0000, chain.objs.size()=1 2024-08-27T03:58:29.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.623__shadow_.AvK_n43AAqad6Ufv5G1hE540Kj5Hz0r_0 2024-08-27T03:58:29.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.731+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-08-27T03:58:29.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=99, truncated=0, next_marker='' 2024-08-27T03:58:29.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_9X-0JvSiAofZZGcHxIeWr1ioOtfAexY', time=2024-08-27T05:13:27.922683+0000, chain.objs.size()=2 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.WPhuP9t091RMB7AxsgIVElv-bpybkev_0 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.WPhuP9t091RMB7AxsgIVElv-bpybkev_1 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3454006440412231975', time=2024-08-27T05:18:40.380550+0000, chain.objs.size()=1 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.248__shadow_.ISG5piNJzDSLm5ayO5MT-NXWYLlZr4B_0 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16992704388683882782', time=2024-08-27T05:18:51.171731+0000, chain.objs.size()=1 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.254__shadow_.pQXWS8g56MQynCJ_zktHTDXE2UZ0YC-_0 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2266646073949258623', time=2024-08-27T05:20:37.183468+0000, chain.objs.size()=1 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3aevjUedATw3tljakzpdpNw-KLOoUHN_0 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3618828343592844668', time=2024-08-27T05:20:37.724370+0000, chain.objs.size()=1 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SEwmfUoPZNhVvOYoX9aRqpmXdTe9ygA_0 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17486741362645248517', time=2024-08-27T05:20:39.260999+0000, chain.objs.size()=1 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.c3zGprcEGeBRRNXC26iGBjjHHE4fnbQ_0 2024-08-27T03:58:29.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7158198816082257658', time=2024-08-27T05:20:39.647475+0000, chain.objs.size()=1 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CTWgIRZ7h433gHJw45WyVtVkVKltZKO_0 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12720299789281227334', time=2024-08-27T05:20:40.020387+0000, chain.objs.size()=1 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5A7juVjVls3aXEtsO7ax_aP3Ibay1LP_0 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2513339666660132138', time=2024-08-27T05:20:40.561020+0000, chain.objs.size()=1 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NNvuLMYH9KhifUSvRz3fR3LMsNgI3dV_0 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.506864438700518388', time=2024-08-27T05:20:40.774048+0000, chain.objs.size()=1 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.M6_t98ATniAoWFR5EF-mzXqzfNhNxrk_0 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17357754711478529837', time=2024-08-27T05:20:42.055961+0000, chain.objs.size()=1 2024-08-27T03:58:29.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Zhkqi1EYA7hXnwriNnqaLalEHBaqRrn_0 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9279768364452277885', time=2024-08-27T05:20:43.215128+0000, chain.objs.size()=1 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.g6faz6pRtdoNj2CcKl1Kk5GN96sqltE_0 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4390685404607896366', time=2024-08-27T05:20:43.497753+0000, chain.objs.size()=1 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.un9zqqeYh5PaxwUplkEq5oIL3udbG02_0 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8236627436810179328', time=2024-08-27T05:20:43.614987+0000, chain.objs.size()=1 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EBhn6Fmpp9Pu5lQ7xEIQUsLpYkfsCI0_0 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4007216105719287654', time=2024-08-27T05:20:44.087558+0000, chain.objs.size()=1 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NPrF6LHKOVBTCGwWQYfwU-WTclBWhuu_0 2024-08-27T03:58:29.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3474563416417340814', time=2024-08-27T05:20:47.869702+0000, chain.objs.size()=1 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Iw1s2jyFMT0MLpPstb60Y2Ot6Qm0OVB_0 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8707053021249444475', time=2024-08-27T05:20:48.729340+0000, chain.objs.size()=1 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kiFYpKCU0_KEC0N7UDID4KiW7qpu-bh_0 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7429527148853667528', time=2024-08-27T05:20:49.884671+0000, chain.objs.size()=1 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GH7_5YFW0uUr0PNxscqa4kz-NailIHZ_0 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.320134461752208329', time=2024-08-27T05:20:51.311178+0000, chain.objs.size()=1 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.np1UerrOv3HmA6rPYV8-X9gaPRD_F-k_0 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16958870944249890338', time=2024-08-27T05:20:51.621439+0000, chain.objs.size()=1 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Q73K_DTmkYUt367g8AZvp-E3K1Drsfu_0 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3005241657948503962', time=2024-08-27T05:20:52.029540+0000, chain.objs.size()=1 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xqDDntWYScK-XjNxSvSjzJnMjoH7xsj_0 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6901373305496006056', time=2024-08-27T05:20:52.799802+0000, chain.objs.size()=1 2024-08-27T03:58:29.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aGm1Utn_7FoGayYsZ6ewwTnUVCUdKH7_0 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16881464283974264687', time=2024-08-27T05:20:55.449872+0000, chain.objs.size()=1 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.x9FqxGgQj8Cf-6ghiApXm8lmwUIi2O-_0 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9200473495075713458', time=2024-08-27T05:20:57.168074+0000, chain.objs.size()=1 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pfdREzi11mNezngy2PrygyLFVRuR4Gr_0 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15141672701790994497', time=2024-08-27T05:20:58.013941+0000, chain.objs.size()=1 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0q-1iHNPts1wrDfwOlxI-jIF3udbu8S_0 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6119091521361294274', time=2024-08-27T05:20:59.009793+0000, chain.objs.size()=1 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8u-8nI7NL0-iIVeYRIpn_4sDBruMAas_0 2024-08-27T03:58:29.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7619321731356119274', time=2024-08-27T05:21:00.025224+0000, chain.objs.size()=1 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Gu1gRg67YS5ZQcJGXmL6lpfgUIBW62X_0 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17576012522686828961', time=2024-08-27T05:21:00.292655+0000, chain.objs.size()=1 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rOM7wbyYhXyFPB11npsyYFNDyJWnQk0_0 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.201368325739556704', time=2024-08-27T05:21:00.896853+0000, chain.objs.size()=1 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zyG2clAePudGhLIUszYWrKuwvSW6jg-_0 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10723334990418342600', time=2024-08-27T05:21:02.014168+0000, chain.objs.size()=1 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3I9wYfFOAK9KBQBj-MHVJDAVUKAKQpF_0 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9055139406882110441', time=2024-08-27T05:21:34.232557+0000, chain.objs.size()=1 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.273__shadow_.N7FR3Og6796ptsx8rc71w1RPB-WZ1Oj_0 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8846906086986511726', time=2024-08-27T05:21:45.855887+0000, chain.objs.size()=1 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.279__shadow_.P4TPDS4wjxpz9mcieAW1-Nk-ibH6vAd_0 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2973440584320843377', time=2024-08-27T05:22:23.306033+0000, chain.objs.size()=1 2024-08-27T03:58:29.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.295__shadow_.9LeFWKWLoUbVS87rb_nzeUxv5dg8D2L_0 2024-08-27T03:58:29.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3460354711599258132', time=2024-08-27T05:22:28.864792+0000, chain.objs.size()=1 2024-08-27T03:58:29.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.298__shadow_.s7eeWCMwX5ycd10ThmC--Yjsc4OaPiw_0 2024-08-27T03:58:29.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8807824842940213834', time=2024-08-27T05:22:30.713147+0000, chain.objs.size()=1 2024-08-27T03:58:29.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.299__shadow_.dgxHDLazoxMSuqKdLAc-k9XoTuvBNId_0 2024-08-27T03:58:29.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9118733105870649509', time=2024-08-27T05:24:46.387050+0000, chain.objs.size()=1 2024-08-27T03:58:29.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FEBqaaCiLPqIpHVxIZBTudps15gsZDR_0 2024-08-27T03:58:29.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7908474459623534626', time=2024-08-27T05:24:47.178621+0000, chain.objs.size()=1 2024-08-27T03:58:29.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3FDugZo1GMOQhOZRu7uF_-gckOPfV68_0 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10318422467857610161', time=2024-08-27T05:24:47.248839+0000, chain.objs.size()=1 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._IKMU2vzUp35LPPJSw0JztXp_T0_sgF_0 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13540022573796138396', time=2024-08-27T05:24:47.462307+0000, chain.objs.size()=1 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.A4GmGoo5a8bdizq9txqEv8sV1886Yo2_0 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7491584575410539979', time=2024-08-27T05:24:47.748223+0000, chain.objs.size()=1 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nGVyIdjV8-c5voxeMNP11zSx0AkbQUe_0 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18031396715449794811', time=2024-08-27T05:24:48.266055+0000, chain.objs.size()=1 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.n3oV7y4zDyxcAoTyCu6R7D6_mq9NwQr_0 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9602804954021837568', time=2024-08-27T05:24:50.476821+0000, chain.objs.size()=1 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YeL3kNlLiQq80n09wWM_OhkOh7hjlt8_0 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4746962752108925477', time=2024-08-27T05:24:53.118662+0000, chain.objs.size()=1 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.g2tld2pjtRHbqgAmf7oXL-5STjvvk1w_0 2024-08-27T03:58:29.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14254669924237228286', time=2024-08-27T05:24:53.206392+0000, chain.objs.size()=1 2024-08-27T03:58:29.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x5aa42a7K_Hr1IFV92eHMmmtEIke5vS_0 2024-08-27T03:58:29.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11358457800604403813', time=2024-08-27T05:24:54.246420+0000, chain.objs.size()=1 2024-08-27T03:58:29.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AdkdWv0zoU5zyPtPMazazQ94pJ7atLO_0 2024-08-27T03:58:29.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11270444332793191855', time=2024-08-27T05:24:55.407270+0000, chain.objs.size()=1 2024-08-27T03:58:29.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dzaej_h8Xyf9ali63eRE7rDOndBScvX_0 2024-08-27T03:58:29.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2252233829038223795', time=2024-08-27T05:24:58.139518+0000, chain.objs.size()=1 2024-08-27T03:58:29.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OmKoUmv0u8CVt2Olks9bBEF5yUmPiAP_0 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13832703265200487851', time=2024-08-27T05:25:00.678571+0000, chain.objs.size()=1 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eBvl7ca8Ei__4s6JBpePhPulMNe9SBI_0 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9901917686310866998', time=2024-08-27T05:25:03.428226+0000, chain.objs.size()=1 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XyimV-wmvoA5dmZqInAMTmrqNhya0BN_0 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.451603080125131654', time=2024-08-27T05:25:03.907603+0000, chain.objs.size()=1 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.M24cGmSzzTKvCiJpuXDi75GcT37m6py_0 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13381908156350842429', time=2024-08-27T05:25:03.964068+0000, chain.objs.size()=1 2024-08-27T03:58:29.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Z1Uk94e45E-pnJsh73mwIx5J69jxo-H_0 2024-08-27T03:58:29.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4138988750026359901', time=2024-08-27T05:25:04.125674+0000, chain.objs.size()=1 2024-08-27T03:58:29.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vuomkNrQLz9DN7OZMDqHce65QYQYezx_0 2024-08-27T03:58:29.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8143372427202998770', time=2024-08-27T05:25:04.415201+0000, chain.objs.size()=1 2024-08-27T03:58:29.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.leS2RYzI56H2kPzIe_A3m0GexyAkCkV_0 2024-08-27T03:58:29.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3991503446203838746', time=2024-08-27T05:25:05.566921+0000, chain.objs.size()=1 2024-08-27T03:58:29.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uN7z0CSn05uE6pNNhhWYLBh2FdM0UwO_0 2024-08-27T03:58:29.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5087565811632583077', time=2024-08-27T05:25:07.035056+0000, chain.objs.size()=1 2024-08-27T03:58:29.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Ct374Cr56teBTiPvb3Tv1u9uKzsLe6Y_0 2024-08-27T03:58:29.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4318026532824068749', time=2024-08-27T05:25:07.708948+0000, chain.objs.size()=1 2024-08-27T03:58:29.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.poJca5ZtrPx9qa-m09Pl5GkpVZKLBE9_0 2024-08-27T03:58:29.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15237865547853092505', time=2024-08-27T05:25:09.124856+0000, chain.objs.size()=1 2024-08-27T03:58:29.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SFsiaC-VNw9u7jrKfUKTt_sdqbdC8ir_0 2024-08-27T03:58:29.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17222600275800374191', time=2024-08-27T05:25:10.464192+0000, chain.objs.size()=1 2024-08-27T03:58:29.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.h4eWBmxyUzMT1u5sL493weoeTlYUXz7_0 2024-08-27T03:58:29.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15578403153710443118', time=2024-08-27T05:25:13.118317+0000, chain.objs.size()=1 2024-08-27T03:58:29.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FFAfWLi4gyfLMVvjI_YuVcnAsm4IJvG_0 2024-08-27T03:58:29.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14782287880331814526', time=2024-08-27T05:25:13.895896+0000, chain.objs.size()=1 2024-08-27T03:58:29.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.r60l_86F1gCbeOIh_w-4iKyfUimwerh_0 2024-08-27T03:58:29.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10786150295655134605', time=2024-08-27T05:25:14.501265+0000, chain.objs.size()=1 2024-08-27T03:58:29.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sbxBPC_2XUu_-tOSnMxzqfgIndjMKQI_0 2024-08-27T03:58:29.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7744178698348958257', time=2024-08-27T05:26:59.403619+0000, chain.objs.size()=1 2024-08-27T03:58:29.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7dhc7IrLYrPo2yGKtLUuKa1WPWH6lF0_0 2024-08-27T03:58:29.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16374934752264426167', time=2024-08-27T05:27:02.795493+0000, chain.objs.size()=1 2024-08-27T03:58:29.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.SZNrbrTftgu5qVJifgKNPrztZJAmpf4_0 2024-08-27T03:58:29.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2077526349906713904', time=2024-08-27T05:27:03.080418+0000, chain.objs.size()=1 2024-08-27T03:58:29.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FXPaiDoA2QCXLm7xXICN1GW-mMCqzql_0 2024-08-27T03:58:29.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16203557468658099091', time=2024-08-27T05:27:06.075684+0000, chain.objs.size()=1 2024-08-27T03:58:29.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4oVP3_71kW9qrJVDfEfqTBw2qAWyNiW_0 2024-08-27T03:58:29.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12172233634521978064', time=2024-08-27T05:27:08.055826+0000, chain.objs.size()=1 2024-08-27T03:58:29.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MFR443IIDUz3SVuOJzuGjcvfrTwco9R_0 2024-08-27T03:58:29.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7418115367953227377', time=2024-08-27T05:27:11.967076+0000, chain.objs.size()=1 2024-08-27T03:58:29.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9znYL7wuk5K4pwzROwE1_Y01qerFt9A_0 2024-08-27T03:58:29.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4881396800170053237', time=2024-08-27T05:27:12.811581+0000, chain.objs.size()=1 2024-08-27T03:58:29.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.D29SG-36NkH7M7nNcyOgC3iujN2Ftpj_0 2024-08-27T03:58:29.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2939172419222616078', time=2024-08-27T05:27:13.714170+0000, chain.objs.size()=1 2024-08-27T03:58:29.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._zkXU_1H7fDSZxHfZxP5kYQyZHuItOp_0 2024-08-27T03:58:29.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17434991729955853947', time=2024-08-27T05:27:13.715762+0000, chain.objs.size()=1 2024-08-27T03:58:29.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Iyacqz83ZKxZs0mPUktlC-oUgiYVt6K_0 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7327552119166505940', time=2024-08-27T05:27:15.103448+0000, chain.objs.size()=1 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7iFebeBCHlpoBD5GHRActx6eSSf-AqN_0 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2360793284094709785', time=2024-08-27T05:27:15.105005+0000, chain.objs.size()=1 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p9ws0kLwBzBvPR7pdL88ISGciZAR6YR_0 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9427363431317952776', time=2024-08-27T05:27:15.641824+0000, chain.objs.size()=1 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GfJXVhGBnmS9Dk_B6dDlUVdHjpupKTR_0 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11365924232327348428', time=2024-08-27T05:27:16.391411+0000, chain.objs.size()=1 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mcSvejao58HOYGOklbx474t10BVcXHd_0 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9688269467645214452', time=2024-08-27T05:27:17.399844+0000, chain.objs.size()=1 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.d2A56yG46dBANHmjyh_XPrLUpHPBjU7_0 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2065585689037176660', time=2024-08-27T05:27:18.232223+0000, chain.objs.size()=1 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4A1hfp3wRC0dwtnT4cKZ5YLSxSHvIrW_0 2024-08-27T03:58:29.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14225918284073008943', time=2024-08-27T05:27:20.051774+0000, chain.objs.size()=1 2024-08-27T03:58:29.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5DZRFKGgT4rx7PviTLDz7bCCMUIrxZ3_0 2024-08-27T03:58:29.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17142898800835539198', time=2024-08-27T05:27:21.221455+0000, chain.objs.size()=1 2024-08-27T03:58:29.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rsngLvyQycDrYN6ukDaK7o3MZr0Svfg_0 2024-08-27T03:58:29.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12045582325673034548', time=2024-08-27T05:27:22.177672+0000, chain.objs.size()=1 2024-08-27T03:58:29.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9LuDiBwCN4TQU_C-ZUjG6CrOKu8pXBs_0 2024-08-27T03:58:29.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18251805387949437328', time=2024-08-27T05:27:25.421602+0000, chain.objs.size()=1 2024-08-27T03:58:29.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.n2J-Ly3uab6ekW4GpDUs8_VwAkQG_mA_0 2024-08-27T03:58:29.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4341814994496038258', time=2024-08-27T05:27:25.571281+0000, chain.objs.size()=1 2024-08-27T03:58:29.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nzg7R84mcV-JzF_fRoQnykldBhK2Ka1_0 2024-08-27T03:58:29.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13380810126484153587', time=2024-08-27T05:27:25.834695+0000, chain.objs.size()=1 2024-08-27T03:58:29.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7_yQMynt2EVJQLAX6Mc9-W2p4Ft0ERH_0 2024-08-27T03:58:29.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17938806619227889825', time=2024-08-27T05:27:25.918742+0000, chain.objs.size()=1 2024-08-27T03:58:29.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Jyqwh1oGiuKWk4JQnNFTAHsuM8EhoQf_0 2024-08-27T03:58:29.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2040001695793851656', time=2024-08-27T05:27:49.649411+0000, chain.objs.size()=1 2024-08-27T03:58:29.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.334__shadow_.NxtaOgB1AGfksTf2b4gVZN0hvgnuyUu_0 2024-08-27T03:58:29.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17014980157479176420', time=2024-08-27T05:30:09.057502+0000, chain.objs.size()=1 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.429__shadow_.GKxaCvaPtAkdL_lOf968bhctFxTwjZO_0 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13966718700998312322', time=2024-08-27T05:30:29.800573+0000, chain.objs.size()=1 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.441__shadow_.pNBMyxvHUAPkCUS9yKV5pI8Z0H-5eJg_0 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.469430209389230611', time=2024-08-27T05:31:02.377529+0000, chain.objs.size()=1 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.458__shadow_.tgc_HJUcN-3zpXYrYdgWE3J7iHPvXUL_0 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3683904290344137426', time=2024-08-27T05:31:06.280052+0000, chain.objs.size()=1 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.460__shadow_.nhnyTd9Ik6MLnnRh5X40e6F5so9A4n__0 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17282171515312651852', time=2024-08-27T05:33:15.990213+0000, chain.objs.size()=3 2024-08-27T03:58:29.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~0D7w1BZPuAvTRzOWL7W-ZUzskG307p1.1 2024-08-27T03:58:29.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~0D7w1BZPuAvTRzOWL7W-ZUzskG307p1.2 2024-08-27T03:58:29.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~0D7w1BZPuAvTRzOWL7W-ZUzskG307p1.3 2024-08-27T03:58:29.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2555875100760285418', time=2024-08-27T05:34:52.461051+0000, chain.objs.size()=6 2024-08-27T03:58:29.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.wb2yZ7il6d0p398D4VH4WKz-uRKmBkEU.1 2024-08-27T03:58:29.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.H8QFXt5bw549byEVNc5wnkGp_8-PKKvP.2 2024-08-27T03:58:29.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.gMxxeqx2yksLiBqkipX7B3RmIeLK7JUj.3 2024-08-27T03:58:29.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.lFLY1p8_SGwThPRpQWKWQI4wz5DZ0ymz.4 2024-08-27T03:58:29.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.H7I0hevC-IWeTsDncnNwjZmt_8SjHocL.5 2024-08-27T03:58:29.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.4AeqmIMoqswiCZhr_HcbrKNsna9XfhdN.6 2024-08-27T03:58:29.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9423281290656602046', time=2024-08-27T05:36:55.822058+0000, chain.objs.size()=1 2024-08-27T03:58:29.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.546__shadow_.LJL6S0M9eoZkTVxBmxuT63rAa79mwTb_0 2024-08-27T03:58:29.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9502240731199876525', time=2024-08-27T05:38:13.686868+0000, chain.objs.size()=1 2024-08-27T03:58:29.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.564__shadow:EpMRaotLnkToco8g0TupNDuHqA12Y8K_.CkSzJ8BlRlWFJxjP1ktQanw2OPHENdR_0 2024-08-27T03:58:29.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2097688164353432601', time=2024-08-27T05:38:50.941954+0000, chain.objs.size()=1 2024-08-27T03:58:29.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:d.ErACh.zi2B9mN8hmCqGUM.SwUX6p3_.czZnRgaJpMm6d_HWDJ5sboH-mry2TvE_0 2024-08-27T03:58:29.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10329811420828234922', time=2024-08-27T05:38:52.107570+0000, chain.objs.size()=1 2024-08-27T03:58:29.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:NFXpsf9feN-mnE7El9PYQj4O45KzV-0_.b9o9uMzC3rhlgT4BOkautiSDOC05afo_0 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6766586678662970691', time=2024-08-27T05:38:59.872661+0000, chain.objs.size()=1 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:OnohyIPouEpU1s66j3AhyBcyUOBgV7c_.Sa4giF5znoT9-_6cZCdTYhqr8VZxrbd_0 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4546150126471606576', time=2024-08-27T05:39:27.355320+0000, chain.objs.size()=1 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:scC8.dRhjWx5W6XI5MWcc4TUmO6upV6_.wzSRP4bYpXbku2ZENcsRkL3U9XEzDeO_0 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8090430223086972486', time=2024-08-27T05:40:01.319292+0000, chain.objs.size()=1 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:A.1zT7kMJ3t.oYi1gvmbRwYRKatiVrJ_.yxaAqDWj2jDej5alUViZhF4qu-qi0fx_0 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7792865690447108829', time=2024-08-27T05:40:01.328690+0000, chain.objs.size()=1 2024-08-27T03:58:29.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:1triO.iW6CVZoeLCPBkNdmABxrH56dp_.bg3xwjMqcWgOWeFRLeLIvU93YXzXHUF_0 2024-08-27T03:58:29.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3353994878979384547', time=2024-08-27T05:40:10.515059+0000, chain.objs.size()=1 2024-08-27T03:58:29.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.579__shadow:MwrDVnkHMKPYo-2Tec24IBhy7a5ohBN_.sx49MxTjOSJ00en9IIgQ54T5DrcPoT9_0 2024-08-27T03:58:29.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.799+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-08-27T03:58:29.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.799+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.799+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53541' 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Zl0p32iC9ndSuY9x4QypOkrvmK3NXKa', time=2024-08-27T05:13:27.996781+0000, chain.objs.size()=2 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.h_z07z9hZWgZv9PxA_0VAIq0bKRaQMS_0 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.h_z07z9hZWgZv9PxA_0VAIq0bKRaQMS_1 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2636368917492326515', time=2024-08-27T05:13:50.855092+0000, chain.objs.size()=1 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.160__shadow_.GijVQPIXDvfyhpF1UrQVcd1wbgW7hgc_0 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6669927891575068920', time=2024-08-27T05:17:58.954521+0000, chain.objs.size()=1 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.227__shadow_.0Jz3ZS7_V6tEMkwA1oIvwGU8tVcTSqn_0 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5761992256716870762', time=2024-08-27T05:18:07.121641+0000, chain.objs.size()=1 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.231__shadow_.sXHPQePDYG75DNSNNO95SFlL72n1xze_0 2024-08-27T03:58:29.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4056098503178674408', time=2024-08-27T05:18:33.014561+0000, chain.objs.size()=1 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.244__shadow_.Y0E7le__RGAFFRS_tLrGBuHljinLD-R_0 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10545685951066163369', time=2024-08-27T05:18:34.858299+0000, chain.objs.size()=1 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.245__shadow_.sTjzjdLpK5oe466CKboC9_Hj2aM5tW__0 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4829482336083388652', time=2024-08-27T05:18:38.538693+0000, chain.objs.size()=1 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.247__shadow_.f0pOSoaNijzCRXewdD25rH7P07I-Lrv_0 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17748925458097174931', time=2024-08-27T05:18:38.563489+0000, chain.objs.size()=1 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.247__shadow_.hkn36IHTFp6x5i3QNKGJ1cf4cok0CXJ_0 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7938444164192280052', time=2024-08-27T05:18:42.198767+0000, chain.objs.size()=1 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.249__shadow_.gARCHWEIU3-uM9MwvrPeolbb2Y396zn_0 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18343552916663541446', time=2024-08-27T05:20:35.714933+0000, chain.objs.size()=1 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.y1VZkRl8RZ1xL8BPoBUvTQu4LZSDFqV_0 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15156132576114593218', time=2024-08-27T05:20:36.064073+0000, chain.objs.size()=1 2024-08-27T03:58:29.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QMs1YiuKomenNa7ur_zEX6LskkC5-Z3_0 2024-08-27T03:58:29.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5019730526516559388', time=2024-08-27T05:20:36.449458+0000, chain.objs.size()=1 2024-08-27T03:58:29.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.cGdMdayvJgePRtDDox6NDelTDnH0mrh_0 2024-08-27T03:58:29.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11628680619470029330', time=2024-08-27T05:20:37.866707+0000, chain.objs.size()=1 2024-08-27T03:58:29.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dCsnqXKS7uVgyliOVf4maBB1II7nvQ2_0 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4271791597545813438', time=2024-08-27T05:20:39.775522+0000, chain.objs.size()=1 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.DouoxBcRCaaiFZH35f3h-sD-GVoAK1x_0 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9282430775384062661', time=2024-08-27T05:20:40.814618+0000, chain.objs.size()=1 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TpSdQwW4Q0_YhKCx9-jMni5F9EP4Gju_0 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1242999418828065526', time=2024-08-27T05:20:41.079930+0000, chain.objs.size()=1 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.U9C8GBIkhNzAYzM0cOGkhNRdwNxEwJJ_0 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6808203927469388873', time=2024-08-27T05:20:41.696893+0000, chain.objs.size()=1 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gf3bX7asGuScgZo-ZoBOOVHpSMLt4J4_0 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9594710350498850952', time=2024-08-27T05:20:43.303591+0000, chain.objs.size()=1 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PHW_50HOheV8dZqMLLiTp6iPrDxGY0a_0 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14533681109532252011', time=2024-08-27T05:20:44.576836+0000, chain.objs.size()=1 2024-08-27T03:58:29.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hk20s4OAbxtYAicW_Mr8VRM7tOd4II6_0 2024-08-27T03:58:29.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11677993193482692391', time=2024-08-27T05:20:45.595172+0000, chain.objs.size()=1 2024-08-27T03:58:29.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.afbmA5hXeCr5DP8UqkTXYM0qbhpWR6r_0 2024-08-27T03:58:29.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1916679772862420174', time=2024-08-27T05:20:47.707465+0000, chain.objs.size()=1 2024-08-27T03:58:29.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PiOvZQlvLjdpludAe-IsZ_eR22g6n1O_0 2024-08-27T03:58:29.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17539717271780884636', time=2024-08-27T05:20:48.056079+0000, chain.objs.size()=1 2024-08-27T03:58:29.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.B8II4QU09vvzVcLqem3gQKvDJgtb_w3_0 2024-08-27T03:58:29.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9822633449209062181', time=2024-08-27T05:20:49.428339+0000, chain.objs.size()=1 2024-08-27T03:58:29.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eVF0vFWcc5O-bJbxGU33RdhtPSyX-Gi_0 2024-08-27T03:58:29.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18363493684593631947', time=2024-08-27T05:20:49.430028+0000, chain.objs.size()=1 2024-08-27T03:58:29.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vBxLuPhiNf2cUkP963Fa8W6M9E3pnve_0 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15981428025520371368', time=2024-08-27T05:20:49.933313+0000, chain.objs.size()=1 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.No9erTyhOdVEe7-D4P4wr3pPAmqhCzu_0 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9850631346779251254', time=2024-08-27T05:20:51.354422+0000, chain.objs.size()=1 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.cgt_b0N8vXf3pfno3ZAEVq7ESF9RH2p_0 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9960237877959177755', time=2024-08-27T05:20:52.466698+0000, chain.objs.size()=1 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5pag79Ez0SirZD3qVETgn5TkfsGsgBw_0 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14761721174002153144', time=2024-08-27T05:20:53.220953+0000, chain.objs.size()=1 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aSj2BVdyFGSvMBU3VMowaTscswsaGRq_0 2024-08-27T03:58:29.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4223422079029631668', time=2024-08-27T05:20:53.605052+0000, chain.objs.size()=1 2024-08-27T03:58:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vBgPS6WbohLXpKcnQ9ftRz3UigLB6Sz_0 2024-08-27T03:58:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2147875898488254905', time=2024-08-27T05:20:54.411284+0000, chain.objs.size()=1 2024-08-27T03:58:29.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JfKRKOHWFEzaLqlKZ6Nj7PVIP5TtjfR_0 2024-08-27T03:58:29.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14112014434833824759', time=2024-08-27T05:20:56.892602+0000, chain.objs.size()=1 2024-08-27T03:58:29.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5x6AUsPLU6A1hSiv0iXJq_uATn1tqO6_0 2024-08-27T03:58:29.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5211176843960016943', time=2024-08-27T05:20:57.156510+0000, chain.objs.size()=1 2024-08-27T03:58:29.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PyLH8yveOCjjEgvoSicuKIrUZRSFFpF_0 2024-08-27T03:58:29.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2120221600990596250', time=2024-08-27T05:20:57.255299+0000, chain.objs.size()=1 2024-08-27T03:58:29.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mms7DO3KhjZNSwRSQwoqReHRWCNQXYz_0 2024-08-27T03:58:29.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13671084958098352717', time=2024-08-27T05:20:57.390241+0000, chain.objs.size()=1 2024-08-27T03:58:29.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HhxqGF-84_U2xa3ahzIuhYicuvqwAXd_0 2024-08-27T03:58:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3639727272537602862', time=2024-08-27T05:20:58.593432+0000, chain.objs.size()=1 2024-08-27T03:58:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aiNhpJscRMczaLA7NHeh308-Sl1GyTQ_0 2024-08-27T03:58:29.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18101546301674138364', time=2024-08-27T05:20:59.271710+0000, chain.objs.size()=1 2024-08-27T03:58:29.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nfSiSxiPKiNok-aUVBe_GY2HscaITW1_0 2024-08-27T03:58:29.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9394464926976229736', time=2024-08-27T05:20:59.392048+0000, chain.objs.size()=1 2024-08-27T03:58:29.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EYMn3gbkNQqLcixvgsYSxXUJBanuQ29_0 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6476357565185915478', time=2024-08-27T05:21:00.736916+0000, chain.objs.size()=1 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WgL7ddGo0MDepaR-PwUNAVHvCmBTsHH_0 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4122136918830543577', time=2024-08-27T05:21:04.096658+0000, chain.objs.size()=1 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GN7hYSrPcyBLAYZqQLLiN2YJWGkofy1_0 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7215429804090741403', time=2024-08-27T05:21:19.782304+0000, chain.objs.size()=1 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.265__shadow_.QdvnTdy31Ct2e7xGvb8QhgiBZ1BcndW_0 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8614764395436149341', time=2024-08-27T05:22:03.022254+0000, chain.objs.size()=1 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.04VaCcFJro15ynxDmdIH2h03Wr_x1jA_0 2024-08-27T03:58:29.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11697757986635645454', time=2024-08-27T05:22:07.995348+0000, chain.objs.size()=1 2024-08-27T03:58:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.BJTvjr5_epMAE8JVADvEpW5brHQKUet_0 2024-08-27T03:58:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16140161344006253735', time=2024-08-27T05:22:08.157422+0000, chain.objs.size()=1 2024-08-27T03:58:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.Us2COD-qUFnCOA1LS7ODWa1fe3KlecW_0 2024-08-27T03:58:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1180091139706644533', time=2024-08-27T05:22:23.337243+0000, chain.objs.size()=1 2024-08-27T03:58:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.295__shadow_.Um0wQ1kl8GjsOTayDN4jUfyfxgund9Y_0 2024-08-27T03:58:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8300478554530535859', time=2024-08-27T05:22:44.182273+0000, chain.objs.size()=1 2024-08-27T03:58:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.307__shadow_.KNRoFN4rWleylOUxyK9b52BLqXQfxD7_0 2024-08-27T03:58:29.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2186729969199132192', time=2024-08-27T05:22:57.468041+0000, chain.objs.size()=1 2024-08-27T03:58:29.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.313__shadow:beYO5g5b2iGBIcP2z-uPkSLmYu5RF2F_.ghehEyA3nWVcsF9WryhyWwWCr59D7VU_0 2024-08-27T03:58:29.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1387481048126781157', time=2024-08-27T05:24:47.661774+0000, chain.objs.size()=1 2024-08-27T03:58:29.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sPWDDMACMayIIOuVO2unP72672uUDY9_0 2024-08-27T03:58:29.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2322859788845588591', time=2024-08-27T05:24:48.270179+0000, chain.objs.size()=1 2024-08-27T03:58:29.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RiNmnc8HJnbbmVXgX6WqtiY54-lqmMO_0 2024-08-27T03:58:29.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15101378777123822999', time=2024-08-27T05:24:48.419021+0000, chain.objs.size()=1 2024-08-27T03:58:29.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kR7qU6xF1zANcJuWb8RH6PisUVFyjUV_0 2024-08-27T03:58:29.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13231115590160476046', time=2024-08-27T05:24:48.541586+0000, chain.objs.size()=1 2024-08-27T03:58:29.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.e-fMbpwfuyhXxkp7wz1B-hIXEA_AGJv_0 2024-08-27T03:58:29.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11839690485651505671', time=2024-08-27T05:24:48.550849+0000, chain.objs.size()=1 2024-08-27T03:58:29.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._jHWE0Dn8BDEQK88two-f53LU_dXVEN_0 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13939617376277332967', time=2024-08-27T05:24:49.311424+0000, chain.objs.size()=1 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yktrvL8ZFSJF8kWDToZiOF0_8aqFzIY_0 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10371172822873167237', time=2024-08-27T05:24:54.254427+0000, chain.objs.size()=1 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.08G2gm6M9SHfV0w4_tg4E8DPAa5RJZL_0 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8110813998885529163', time=2024-08-27T05:24:54.889051+0000, chain.objs.size()=1 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YXrIz2FOlKS3ysw1tShFzA8dV2DL_Fs_0 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3612686844486969228', time=2024-08-27T05:24:55.236165+0000, chain.objs.size()=1 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MFsk2i90ur56BqoPD035TomtKwFAcBW_0 2024-08-27T03:58:29.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5982644533077916593', time=2024-08-27T05:24:57.110195+0000, chain.objs.size()=1 2024-08-27T03:58:29.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bJdNaCSvcspjhuRHpEH0yHYFsjFrNil_0 2024-08-27T03:58:29.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10913471987573041096', time=2024-08-27T05:24:58.530040+0000, chain.objs.size()=1 2024-08-27T03:58:29.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.b03kXpuCkcdbeQluFusS89Ancs6v2HT_0 2024-08-27T03:58:29.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16689853225328539337', time=2024-08-27T05:24:58.891578+0000, chain.objs.size()=1 2024-08-27T03:58:29.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.aJclOlDyhdLNvuMODu0RkNM062MC5AL_0 2024-08-27T03:58:29.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17495899747697699531', time=2024-08-27T05:25:00.662379+0000, chain.objs.size()=1 2024-08-27T03:58:29.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jaIC09ovxVcQPyO8_Tx--_1E4R3GEwF_0 2024-08-27T03:58:29.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8502618423495394556', time=2024-08-27T05:25:05.251210+0000, chain.objs.size()=1 2024-08-27T03:58:29.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MgUyHtUfAR45EalXTDRI8c48GZJfQiW_0 2024-08-27T03:58:29.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11975866652652738716', time=2024-08-27T05:25:05.795110+0000, chain.objs.size()=1 2024-08-27T03:58:29.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OjvOVwY3ADIVO9jYWXJ_GEmYXT-ydEr_0 2024-08-27T03:58:29.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9958373671470818967', time=2024-08-27T05:25:09.158435+0000, chain.objs.size()=1 2024-08-27T03:58:29.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8TxNpG-Nz6OcHFWFETSzjpDqPK2tFKF_0 2024-08-27T03:58:29.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15922530274362694914', time=2024-08-27T05:25:09.196147+0000, chain.objs.size()=1 2024-08-27T03:58:29.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4e5p4p9L8gD0se9_sA5OfvR4z4dJVRy_0 2024-08-27T03:58:29.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9991885510531954231', time=2024-08-27T05:25:09.197681+0000, chain.objs.size()=1 2024-08-27T03:58:29.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ddsPk5_LeaYf4kplPQMaTdTIhaeAi4f_0 2024-08-27T03:58:29.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9324833775278763078', time=2024-08-27T05:25:09.847702+0000, chain.objs.size()=1 2024-08-27T03:58:29.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3_wjLcnv9RGTOSAxRBKFsbqbdUOQ98W_0 2024-08-27T03:58:29.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15241012875124683752', time=2024-08-27T05:25:10.561912+0000, chain.objs.size()=1 2024-08-27T03:58:29.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0FNNYcQy1ki2puwpylRf_6hOso52zHM_0 2024-08-27T03:58:29.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17810036685216902899', time=2024-08-27T05:25:11.354455+0000, chain.objs.size()=1 2024-08-27T03:58:29.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8ja-jEtXdltudOjyxxyQ_lYN1rnwa3v_0 2024-08-27T03:58:29.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16365407068001540490', time=2024-08-27T05:25:11.484191+0000, chain.objs.size()=1 2024-08-27T03:58:29.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1iLjTnYo-vHBHQUo3i0DRTTPlEUzzLp_0 2024-08-27T03:58:29.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2147420903272260083', time=2024-08-27T05:25:11.508936+0000, chain.objs.size()=1 2024-08-27T03:58:29.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.uj6Q3m_Ax1alHsbKgXd_9Ky2I1aQaCE_0 2024-08-27T03:58:29.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12163089261909982875', time=2024-08-27T05:25:12.372039+0000, chain.objs.size()=1 2024-08-27T03:58:29.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CxHceUTIEnkP4YqStirdKqoDkQc6LCv_0 2024-08-27T03:58:29.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16690382478962715252', time=2024-08-27T05:25:14.634557+0000, chain.objs.size()=1 2024-08-27T03:58:29.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.X_bova1Ffy84qolzow_6BkIjiEP0ffZ_0 2024-08-27T03:58:29.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2724078670756938430', time=2024-08-27T05:26:58.449778+0000, chain.objs.size()=1 2024-08-27T03:58:29.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.q7A4gnThUBHiO2_X9SS5fLS1hTpxp8y_0 2024-08-27T03:58:29.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8147950741401530597', time=2024-08-27T05:26:58.803601+0000, chain.objs.size()=1 2024-08-27T03:58:29.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.A8Yu82A0CoCHQK7bWECFT1i_BbkdH2I_0 2024-08-27T03:58:29.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3909074542583503949', time=2024-08-27T05:26:59.482405+0000, chain.objs.size()=1 2024-08-27T03:58:29.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NXgYkjc1VRV4u13IA38uWQqN36rXstB_0 2024-08-27T03:58:29.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13475635880200289124', time=2024-08-27T05:27:02.063650+0000, chain.objs.size()=1 2024-08-27T03:58:29.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jPVWdzdhcIvE0Jans89GjF6tXEdQk-G_0 2024-08-27T03:58:29.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1511762968185784453', time=2024-08-27T05:27:02.169114+0000, chain.objs.size()=1 2024-08-27T03:58:29.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xOLB04YkLeGgGp5Z8_dTFPkvcphpuab_0 2024-08-27T03:58:29.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13961443366135198508', time=2024-08-27T05:27:02.558507+0000, chain.objs.size()=1 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cDO2C1MYIOVLmlERE9C9E-Qw_VwHice_0 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15440262766829754169', time=2024-08-27T05:27:02.890070+0000, chain.objs.size()=1 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1eQs14uMnpg4tSzKMRFsWvEPOpPdJc5_0 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.352948382493589058', time=2024-08-27T05:27:03.285354+0000, chain.objs.size()=1 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mQO-PQ7IxKZkuydStIHVNAl2lfZ5jEi_0 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16949446176798731039', time=2024-08-27T05:27:04.035797+0000, chain.objs.size()=1 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qnj-9DONzH40xE2X8iF5W8xlUk-7COJ_0 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.151668142927613508', time=2024-08-27T05:27:06.673429+0000, chain.objs.size()=1 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5xH5oZff7d8wvaI7bjB2o6KQb5B2Tx4_0 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17058970703526359282', time=2024-08-27T05:27:06.750009+0000, chain.objs.size()=1 2024-08-27T03:58:29.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.baC1mrVExUhUFMWLTwcNqoEW1bwD2yE_0 2024-08-27T03:58:29.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9285444843810043899', time=2024-08-27T05:27:07.150851+0000, chain.objs.size()=1 2024-08-27T03:58:29.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9a987G1UlZ73bVI_nHaM8HlAJQJay_k_0 2024-08-27T03:58:29.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.484584883861942917', time=2024-08-27T05:27:10.793923+0000, chain.objs.size()=1 2024-08-27T03:58:29.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TZOY6EOQuKcWec5DBI7v6KpiJW_tN0Q_0 2024-08-27T03:58:29.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6445964259710297637', time=2024-08-27T05:27:11.271760+0000, chain.objs.size()=1 2024-08-27T03:58:29.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.oEQTvSdDolsc_2AeDADoKUsVfJ5xIDt_0 2024-08-27T03:58:29.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3164984013882302851', time=2024-08-27T05:27:12.860944+0000, chain.objs.size()=1 2024-08-27T03:58:29.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Ka4TlQCPpZ0rwFKGnrCT0_FrVO0qB9n_0 2024-08-27T03:58:29.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3780813420149864025', time=2024-08-27T05:27:14.063207+0000, chain.objs.size()=1 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FQa4ewQxmDigdOsft5nhRJ-Mnd9xfbY_0 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17522596425350821455', time=2024-08-27T05:27:14.066990+0000, chain.objs.size()=1 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Hg-RIktJPkWwyGKOvTANE8jD7y8JMWJ_0 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11939775616154871973', time=2024-08-27T05:27:14.661932+0000, chain.objs.size()=1 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.O2VOr-1ifq4yeK6Q6QfDT1NJaUKKZqd_0 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.549463249834040604', time=2024-08-27T05:27:17.999229+0000, chain.objs.size()=1 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.m946CzPfTAr_J-cnrBA23XQhVfk74Yp_0 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9158389626633348365', time=2024-08-27T05:27:18.558115+0000, chain.objs.size()=1 2024-08-27T03:58:29.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4dFyTVS3e5QJf-6FTNV-w3nBVxJZbZr_0 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16424930839163805039', time=2024-08-27T05:27:19.190844+0000, chain.objs.size()=1 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZR4OBiKWUAMOI00_IopycMBAHo_0po7_0 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15180935875633185996', time=2024-08-27T05:27:20.662286+0000, chain.objs.size()=1 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.F-m-9Son-ad7x1Bn51bYEyBEP-qeJbF_0 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.542096612457146899', time=2024-08-27T05:27:20.809417+0000, chain.objs.size()=1 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1b_7-w-GHfJv_CFH4nsDmcCapqUcpd0_0 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7723064484631270460', time=2024-08-27T05:27:21.033005+0000, chain.objs.size()=1 2024-08-27T03:58:29.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.30edrWufKOxV1ofdA3HVDuqGwz3Rvav_0 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5466195851395098673', time=2024-08-27T05:27:21.418447+0000, chain.objs.size()=1 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.t3eyYB-lTUw35tTzv3ZbzWmjC4Ew2le_0 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14648712001369245067', time=2024-08-27T05:27:22.408434+0000, chain.objs.size()=1 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AMFJS6eA7lWRqMuRBHFcPr3Nw6LIb1U_0 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6711125997685538309', time=2024-08-27T05:27:22.515534+0000, chain.objs.size()=1 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AOYGZABNMX8h5qmQvQpVyXUU7hAlftX_0 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13307512923075640826', time=2024-08-27T05:27:23.700056+0000, chain.objs.size()=1 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Oi_KAUee7PudxAy3L7AwCoSqNdBAqrj_0 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11461985262664124037', time=2024-08-27T05:27:24.949474+0000, chain.objs.size()=1 2024-08-27T03:58:29.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hNelqp1LoI8uOcm2wK6PoB2rUmL2v0J_0 2024-08-27T03:58:29.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53541 2024-08-27T03:58:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T03:58:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12585442685778308609', time=2024-08-27T05:27:25.895911+0000, chain.objs.size()=1 2024-08-27T03:58:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.PpUdc-FYV9xStRyhhEC4B9Zpi8nCrlS_0 2024-08-27T03:58:29.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11167737166514057630', time=2024-08-27T05:27:44.280171+0000, chain.objs.size()=1 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.330__shadow_.fGnn3AEzru-HYt1O6aVyVGu2BZRwrrh_0 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7550158376124864577', time=2024-08-27T05:30:51.227071+0000, chain.objs.size()=1 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.453__shadow_.R9E98g1jznXhEvw5TtzvdwUEy9nXFCL_0 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11323930788686557806', time=2024-08-27T05:31:06.580085+0000, chain.objs.size()=1 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.460__shadow_.616qHt9l1Kp1rs0GVPZ8lPJ8kKrPu4C_0 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9222315702857016861', time=2024-08-27T05:31:28.518206+0000, chain.objs.size()=1 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.Pf39F_EjACZyhxpqNAVDnBP1gze1j-0_0 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17734716946554133019', time=2024-08-27T05:31:53.824649+0000, chain.objs.size()=1 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.490__shadow_.V-rUJmaWkQobpKRAj2QaF3HfcDcp9Zy_0 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17439095994166871483', time=2024-08-27T05:32:06.048584+0000, chain.objs.size()=1 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.497__shadow:nGBnVWVmI3DA67.4KlPAhM9ux0Gc029_.rEh1fYZ9-qfRs1r-giIeLw9ZBIE8vlQ_0 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~aHxsMA_De2EZ3ElByGAYRC7Pf43Dmj2', time=2024-08-27T05:35:38.075889+0000, chain.objs.size()=2 2024-08-27T03:58:29.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.523__multipart_mymultipart.2~aHxsMA_De2EZ3ElByGAYRC7Pf43Dmj2.1 2024-08-27T03:58:29.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.523__multipart_mymultipart.2~aHxsMA_De2EZ3ElByGAYRC7Pf43Dmj2.2 2024-08-27T03:58:29.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18036927422476794379', time=2024-08-27T05:38:09.075838+0000, chain.objs.size()=1 2024-08-27T03:58:29.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:OwEHTTILWnCpiCvWiyC7T0ZgX3lTT0e_.oNxZBvcw8YskjgfVQB8lfJH8JvGgm5m_0 2024-08-27T03:58:29.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1681357575158450886', time=2024-08-27T05:38:33.661696+0000, chain.objs.size()=1 2024-08-27T03:58:29.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.569__shadow:hzev2Qq5f3sdlyXyApLSKHblR3a0zfZ_.Js-SogE-XcPqmcXiNHC012D7JdLmg5q_0 2024-08-27T03:58:29.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3854343262282467082', time=2024-08-27T05:38:38.047878+0000, chain.objs.size()=1 2024-08-27T03:58:29.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:MiDZzQGoGCGg5ulitB4RiBI3asBZzUm_.CdhqjN_dL883qWebu-EKgEz52ct3KI8_0 2024-08-27T03:58:29.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16653372529168459844', time=2024-08-27T05:45:44.638478+0000, chain.objs.size()=2 2024-08-27T03:58:29.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.636__shadow_.ZpSYczvLt0Ey6qAA_VxOQO_E69s2weK_0 2024-08-27T03:58:29.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.636__shadow_.ZpSYczvLt0Ey6qAA_VxOQO_E69s2weK_1 2024-08-27T03:58:29.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2670909806558083002', time=2024-08-27T05:46:53.303648+0000, chain.objs.size()=1 2024-08-27T03:58:29.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.659__shadow_.aNToBylQi6hFDnb6c64RrZ5ivsoif4w_0 2024-08-27T03:58:29.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10947729754474074969', time=2024-08-27T05:47:53.068662+0000, chain.objs.size()=1 2024-08-27T03:58:29.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.698__shadow:h2FX0alfrcGuyHU.E.F9-jbG9bq7.27_.4chhotFSlOAtqY8YHzKe0ZfWYqfL0rj_0 2024-08-27T03:58:29.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.867+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-08-27T03:58:29.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48411' 2024-08-27T03:58:29.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13398081134735909146', time=2024-08-27T05:13:11.735947+0000, chain.objs.size()=2 2024-08-27T03:58:29.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.152__shadow_.vhJc77V5gl26I8W6MgY6F0LsOJBLqh4_0 2024-08-27T03:58:29.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.152__shadow_.vhJc77V5gl26I8W6MgY6F0LsOJBLqh4_1 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6169652705824910084', time=2024-08-27T05:13:39.665415+0000, chain.objs.size()=3 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-FROZEN.2~0PM4eVKMlCZMW4Nm9Gv7LxCcoKssxsn.1 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-FROZEN.2~0PM4eVKMlCZMW4Nm9Gv7LxCcoKssxsn.2 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-FROZEN.2~0PM4eVKMlCZMW4Nm9Gv7LxCcoKssxsn.3 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13472988205416612834', time=2024-08-27T05:14:22.766819+0000, chain.objs.size()=1 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.176__shadow_.4c5LDsA5QSIWXl0u-xtbRuq1dl_O_0G_0 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.906112705476063289', time=2024-08-27T05:15:00.048080+0000, chain.objs.size()=1 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.193__shadow_.57MyeAjUhX_v4fxG0kI7SCFJQDdb3pu_0 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3671809252109535371', time=2024-08-27T05:17:58.962140+0000, chain.objs.size()=1 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.227__shadow_.YeKSh5OwlJXwToPFlyrFgu_sRueqBjC_0 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3426574011923875015', time=2024-08-27T05:18:09.891052+0000, chain.objs.size()=1 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.232__shadow_.OoBYL45EK91yVvdEni4-Eb3CjyQIC4x_0 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13290888050465216613', time=2024-08-27T05:18:14.643094+0000, chain.objs.size()=1 2024-08-27T03:58:29.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.235__shadow_.2q3RBf7a4EK8ZwhUhdd628znT8eCy8e_0 2024-08-27T03:58:29.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10901571182164427885', time=2024-08-27T05:20:35.145724+0000, chain.objs.size()=1 2024-08-27T03:58:29.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.knS-Chchkpy7GF_9MleP_97OvDV-MUE_0 2024-08-27T03:58:29.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16587365759083249277', time=2024-08-27T05:20:35.227308+0000, chain.objs.size()=1 2024-08-27T03:58:29.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.g9j8a095invb4BfDkwB-oT7Aj9XTbVx_0 2024-08-27T03:58:29.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9405630797599780051', time=2024-08-27T05:20:36.708200+0000, chain.objs.size()=1 2024-08-27T03:58:29.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KV8Bvpq63_AJF9PLihHIC1wbBzU7spS_0 2024-08-27T03:58:29.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14582338062394066019', time=2024-08-27T05:20:36.859895+0000, chain.objs.size()=1 2024-08-27T03:58:29.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-Facnuw8ebTY2qRRiu09X12mPcniMD__0 2024-08-27T03:58:29.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13148181725431089670', time=2024-08-27T05:20:37.122407+0000, chain.objs.size()=1 2024-08-27T03:58:29.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NS0QsHyVim83Eoc0uYxtM2KI6-r2Ry8_0 2024-08-27T03:58:29.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7499489337745980942', time=2024-08-27T05:20:37.170288+0000, chain.objs.size()=1 2024-08-27T03:58:29.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ILpkodOzZd2MElo6AYAZ5TxQkJlllAD_0 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.668818900491079777', time=2024-08-27T05:20:37.442758+0000, chain.objs.size()=1 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pKksG47RQKvn-ZIn8eM6V_6siGv8Kkb_0 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1498474336314335056', time=2024-08-27T05:20:38.056407+0000, chain.objs.size()=1 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rv1agBSM3VsvHDgsKDVzjFifvm--AZm_0 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5903378429469936908', time=2024-08-27T05:20:38.115383+0000, chain.objs.size()=1 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4KujOS_C6_IgvaZ8fIrOXJUpZ3-roMe_0 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3248591341196301804', time=2024-08-27T05:20:38.117095+0000, chain.objs.size()=1 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.W_Xa7I59dsMEJV5hM73h4zJEkcHYTNB_0 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2804199917635354945', time=2024-08-27T05:20:40.403496+0000, chain.objs.size()=1 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Xv637p1bOS2umzok42W9eEFNMsZWoxZ_0 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501781936493081256', time=2024-08-27T05:20:40.739650+0000, chain.objs.size()=1 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vxXCf_KSm2CRZGvh9IbSzj6UKH1kgvM_0 2024-08-27T03:58:29.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2677586716181949914', time=2024-08-27T05:20:41.556581+0000, chain.objs.size()=1 2024-08-27T03:58:29.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Jy7HU0Pv4LXTKYB9ruos3J3dmIeoZG9_0 2024-08-27T03:58:29.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7156917299481846784', time=2024-08-27T05:20:41.558636+0000, chain.objs.size()=1 2024-08-27T03:58:29.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mRPGcsHqhPx4v-cQIBV51WxATonJgBx_0 2024-08-27T03:58:29.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7549269841369867244', time=2024-08-27T05:20:41.631274+0000, chain.objs.size()=1 2024-08-27T03:58:29.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rF4UlXlNd138nz6URYdkq_4bRQn65AH_0 2024-08-27T03:58:29.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7465531881603312301', time=2024-08-27T05:20:41.978123+0000, chain.objs.size()=1 2024-08-27T03:58:29.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MGVmrKxLK_kOM2-b2nfFDZnTFi4JmdO_0 2024-08-27T03:58:29.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2057464057073488586', time=2024-08-27T05:20:43.208517+0000, chain.objs.size()=1 2024-08-27T03:58:29.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pLXdQZkG6UoXWhvd75G-U7r3HwFmjPv_0 2024-08-27T03:58:29.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15898307639639122871', time=2024-08-27T05:20:44.709067+0000, chain.objs.size()=1 2024-08-27T03:58:29.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zArthAFgyaVfNoJ4o6Ua-FSwlzU7Pqp_0 2024-08-27T03:58:29.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1400633161246932891', time=2024-08-27T05:20:44.791677+0000, chain.objs.size()=1 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HJw_BqsKLSKumZQzjBW87YE9H1vHueh_0 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10434963606568279927', time=2024-08-27T05:20:45.786308+0000, chain.objs.size()=1 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Jo8sa_gPDvCEFP8lYMSunvVQ6QPwE6m_0 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10867930619778622542', time=2024-08-27T05:20:47.494083+0000, chain.objs.size()=1 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iTRmZMtOJcDyI-KHwHtJP_ktA0m3hOA_0 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7553146764740412035', time=2024-08-27T05:20:48.487036+0000, chain.objs.size()=1 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.AgYRIkb3e0_ySwnhhKz1I-QGebVHr9i_0 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8632607259436067429', time=2024-08-27T05:20:51.148696+0000, chain.objs.size()=1 2024-08-27T03:58:29.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Sw-3pY4_quQ23Cuu38n0JRXP4IpU4Zj_0 2024-08-27T03:58:29.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17636921614178901045', time=2024-08-27T05:20:51.581345+0000, chain.objs.size()=1 2024-08-27T03:58:29.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.W-qArMj4rRU2DBchZGYMD5fluyFVb44_0 2024-08-27T03:58:29.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14015899096358093233', time=2024-08-27T05:20:52.129613+0000, chain.objs.size()=1 2024-08-27T03:58:29.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xhrNMISZqYukN6ziejzZBTe6G2b-Fxm_0 2024-08-27T03:58:29.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11643688765691815734', time=2024-08-27T05:20:52.466250+0000, chain.objs.size()=1 2024-08-27T03:58:29.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.R1K8Rfue9K7sH_zShr3_tFfS6P3-a_Z_0 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9740331935315616150', time=2024-08-27T05:20:52.649491+0000, chain.objs.size()=1 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.o3gVrI_EQ4X-Utua0njjoLn3CgS8kk4_0 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15286970568094456763', time=2024-08-27T05:20:52.888436+0000, chain.objs.size()=1 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.coALvit5DY5PEWTILRbhJWI7jwGmBE-_0 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16869619886960050427', time=2024-08-27T05:20:54.568148+0000, chain.objs.size()=1 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KafROFXaftaQv785YTTNX5VwakcZaeK_0 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6478746300807453581', time=2024-08-27T05:20:55.524597+0000, chain.objs.size()=1 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iFoYLXy_QSdcVyojJlE6oZ88tW2fG4y_0 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16780438030724807988', time=2024-08-27T05:20:56.619076+0000, chain.objs.size()=1 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.C2QdFxn1eDfsDzZ7dsKzNZg6pVchfdj_0 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4048540830603966376', time=2024-08-27T05:20:56.673726+0000, chain.objs.size()=1 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mZYwarIPZE4D_yLSY6jacWCsoZGCft6_0 2024-08-27T03:58:29.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12083232939277467058', time=2024-08-27T05:20:56.700789+0000, chain.objs.size()=1 2024-08-27T03:58:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EsHWMVJCKzZ38PFgxsChPt7oyTAoU0R_0 2024-08-27T03:58:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13530099508929833177', time=2024-08-27T05:20:58.117019+0000, chain.objs.size()=1 2024-08-27T03:58:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8jga4FdDDUhAF4GvZvkSuj0SU-rT-73_0 2024-08-27T03:58:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8010076081931911768', time=2024-08-27T05:20:59.127536+0000, chain.objs.size()=1 2024-08-27T03:58:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KPZTE48Tz6K25N0a3kUjt1TUR_N55fe_0 2024-08-27T03:58:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8621581257664538263', time=2024-08-27T05:21:00.770630+0000, chain.objs.size()=1 2024-08-27T03:58:29.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vDDv6DJqGHXgUg4-vcAxjc9zDuYJn3U_0 2024-08-27T03:58:29.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7953580606386129582', time=2024-08-27T05:21:00.897884+0000, chain.objs.size()=1 2024-08-27T03:58:29.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4swPwKZl1q9FnmqXbmEQ-6InxR43Ylx_0 2024-08-27T03:58:29.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18410267079840521990', time=2024-08-27T05:21:02.737991+0000, chain.objs.size()=1 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ttth7B5nWoMBN-eg8-LCgchUgnsBWbj_0 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2294740574679825448', time=2024-08-27T05:21:02.865858+0000, chain.objs.size()=1 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kTDxTptOk_PJ-VBT1-rfEMYNxx3H0fj_0 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13045638477861549741', time=2024-08-27T05:21:03.735266+0000, chain.objs.size()=1 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zPN_tpy3ByYXvcnPvfQfND7jR4zq6IV_0 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2173708825689107569', time=2024-08-27T05:21:03.823899+0000, chain.objs.size()=1 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.e8PUSG5MJ9uUNjSsRl4Ap3g-CszGLD-_0 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15216419710672934283', time=2024-08-27T05:21:06.024732+0000, chain.objs.size()=1 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.257__shadow_.DszbFFrgCPZQ_K9hCpAAlCvpIFzfbWy_0 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10495644017179596594', time=2024-08-27T05:21:23.268839+0000, chain.objs.size()=1 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.267__shadow_.bQcqli0kAkTrevWMjvtaTOr0ghy3-IX_0 2024-08-27T03:58:29.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3903464932094843449', time=2024-08-27T05:21:55.773369+0000, chain.objs.size()=1 2024-08-27T03:58:29.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.284__shadow_.qxemYCKRLd8yz9jOe6f6aLRVpmcYSa0_0 2024-08-27T03:58:29.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8924163051448060106', time=2024-08-27T05:21:55.786413+0000, chain.objs.size()=1 2024-08-27T03:58:29.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.284__shadow_.3CW3Vo3k4OrQQaLRv3poquKUNJr03mM_0 2024-08-27T03:58:29.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12024099248687520853', time=2024-08-27T05:22:02.696924+0000, chain.objs.size()=1 2024-08-27T03:58:29.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.ADTK9VCYhubcrWA3hvg7_YaEDCoHEra_0 2024-08-27T03:58:29.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14789926301071039005', time=2024-08-27T05:22:02.699178+0000, chain.objs.size()=1 2024-08-27T03:58:29.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.RhLheU_SZuCTj7cghzvuq2a9J8pyWn2_0 2024-08-27T03:58:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13130919015121084503', time=2024-08-27T05:22:02.700954+0000, chain.objs.size()=1 2024-08-27T03:58:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.2ZdXPlSBpjupNYUhIaM-c2xPEKbyvm9_0 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3114873130198691605', time=2024-08-27T05:22:02.758048+0000, chain.objs.size()=1 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.D9Cn_bZqGFinWkhTLWBrbu3WQBD2aZY_0 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1998583692079479620', time=2024-08-27T05:22:03.018846+0000, chain.objs.size()=1 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.oPeKloLXF3QgfTWOqpa6Fp--059CqKV_0 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8271020186999703775', time=2024-08-27T05:22:19.560128+0000, chain.objs.size()=1 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.899+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.293__shadow_.8WvWwPy5kXoi1E4oJlTqYWn0Etvib8r_0 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10479114686864343157', time=2024-08-27T05:22:50.778819+0000, chain.objs.size()=1 2024-08-27T03:58:29.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.309__shadow_.GrvJUHN9_zcFQZmK-gLMzciSqAuf-_V_0 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16948623267510093739', time=2024-08-27T05:24:48.056992+0000, chain.objs.size()=1 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TVymw_5DA0bebKuP2B_8883x8fWJYUx_0 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6977140780823256424', time=2024-08-27T05:24:48.148945+0000, chain.objs.size()=1 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.q5ray5pAeYon8Ttuq3W4OQdKlF61Eih_0 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12651327540115285107', time=2024-08-27T05:24:48.398357+0000, chain.objs.size()=1 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.EN869PTkos9KCi3otSGQUe_z6WFl5f9_0 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.339481488757019778', time=2024-08-27T05:24:49.046923+0000, chain.objs.size()=1 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bGVunZyzH99mQQSLscJv2qAYPHE2q7j_0 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2052883032729368267', time=2024-08-27T05:24:49.185041+0000, chain.objs.size()=1 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.WRYU4fYAMh0VWZxTuEBYeQToUYVqaaL_0 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2291969918987690401', time=2024-08-27T05:24:53.046247+0000, chain.objs.size()=1 2024-08-27T03:58:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2MJgAul-mwjLolGV6OQXL3I6DyGreln_0 2024-08-27T03:58:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3834134383215820437', time=2024-08-27T05:24:54.619301+0000, chain.objs.size()=1 2024-08-27T03:58:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._vVvtNS_S6D76yEaKsyEpmlFbnqOuKa_0 2024-08-27T03:58:29.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4279743087343611228', time=2024-08-27T05:24:55.071459+0000, chain.objs.size()=1 2024-08-27T03:58:29.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VWd6a3DPgcNDr54YnMGUZgfKFKKTPyF_0 2024-08-27T03:58:29.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1802910408691604662', time=2024-08-27T05:24:55.474284+0000, chain.objs.size()=1 2024-08-27T03:58:29.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.T8hGuIUZmE-TWn37LRtodpmGboIDwwL_0 2024-08-27T03:58:29.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13318847645217309172', time=2024-08-27T05:24:55.476422+0000, chain.objs.size()=1 2024-08-27T03:58:29.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wGxuF_aps2EBMu1rb0xm2Y6E1tRH8uv_0 2024-08-27T03:58:29.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7331720202795985730', time=2024-08-27T05:24:55.863766+0000, chain.objs.size()=1 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TvAKWR3RfCD-YN7HC_sAIGJ5cFv-GqN_0 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9507716487985284729', time=2024-08-27T05:24:55.959501+0000, chain.objs.size()=1 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Mp0HZZtuGPv_k7uwwGnMlJx8pAKeFm3_0 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10214277700350140116', time=2024-08-27T05:24:56.356896+0000, chain.objs.size()=1 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1ct0N2yKKotVr3C-FYwV3Zhi6Dw37Is_0 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10750323921408113294', time=2024-08-27T05:24:58.863443+0000, chain.objs.size()=1 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jp5kCgue1Cr7u0pRk45vrlx9LHoIiBZ_0 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5484636993988753002', time=2024-08-27T05:24:59.021554+0000, chain.objs.size()=1 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yrAIADD1YUpVjv63Equpke90i9LQ8jM_0 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13962204343658271741', time=2024-08-27T05:24:59.305639+0000, chain.objs.size()=1 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.g5P0CM8R0rc-ZVSl7eP6BlEYtsan2FR_0 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8178872029191056177', time=2024-08-27T05:24:59.352595+0000, chain.objs.size()=1 2024-08-27T03:58:29.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.P4gtzaKX8jlzQgz2fiNeaLKLk89BOrF_0 2024-08-27T03:58:29.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2771704690256233934', time=2024-08-27T05:24:59.354372+0000, chain.objs.size()=1 2024-08-27T03:58:29.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DIB-BhtmdF9CTyEHfTWMSHGPTvE1vu0_0 2024-08-27T03:58:29.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9851725663617640053', time=2024-08-27T05:25:00.506836+0000, chain.objs.size()=1 2024-08-27T03:58:29.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hC2gbYv9FuPHJJBqjcWFUvyvIbkybPW_0 2024-08-27T03:58:29.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12808110395609630294', time=2024-08-27T05:25:00.750830+0000, chain.objs.size()=1 2024-08-27T03:58:29.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gIZ9BTSh5QuHbRuEHlrUiOXS-6fuuh2_0 2024-08-27T03:58:29.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7066385666196794413', time=2024-08-27T05:25:00.821521+0000, chain.objs.size()=1 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iIkQLy7mG9jHtB-jwcGKDz4eXMY94Ah_0 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.492098393089818198', time=2024-08-27T05:25:02.022541+0000, chain.objs.size()=1 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._E4CHqYBGHWf1sRY9A-0wk5WiKQxpGp_0 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6685155402820628821', time=2024-08-27T05:25:02.936696+0000, chain.objs.size()=1 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xsMBRirJilBzdqw0Kfq19Ewta9PCqtp_0 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11996121814649165223', time=2024-08-27T05:25:02.989089+0000, chain.objs.size()=1 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.912SF--tOURNAMvrf6ho1bMiRJ96Pw3_0 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8803654725627805053', time=2024-08-27T05:25:03.234669+0000, chain.objs.size()=1 2024-08-27T03:58:29.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1cKeJomZq2Ew-47F4wgUw4fGN_Hg7ON_0 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2700970017533420113', time=2024-08-27T05:25:03.448352+0000, chain.objs.size()=1 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DzfcnO5oUwnnjUCGcaLZnDSClkLhnuP_0 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13455872040537537193', time=2024-08-27T05:25:05.925700+0000, chain.objs.size()=1 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.j-99-ZHqzUT3kTfxehNvLEd7_hwRpg9_0 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2306177311683013106', time=2024-08-27T05:25:06.009341+0000, chain.objs.size()=1 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.85NjMwH-Z66mgakfSr2FcuPvItyFdkm_0 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3328301940890561594', time=2024-08-27T05:25:06.767153+0000, chain.objs.size()=1 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1x5FoHw2SdwZjYLrLsO8p91vFwQxLZT_0 2024-08-27T03:58:29.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.915+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15285863971848460904', time=2024-08-27T05:25:07.651891+0000, chain.objs.size()=1 2024-08-27T03:58:29.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.915+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Ge_zaAGsWw8NFPFm93v7KnejXwIE0-J_0 2024-08-27T03:58:29.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5335116175419236796', time=2024-08-27T05:25:09.093163+0000, chain.objs.size()=1 2024-08-27T03:58:29.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AVPSCNKOj_soBQQxNI6BxXroNS7zcx0_0 2024-08-27T03:58:29.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4225842251910301238', time=2024-08-27T05:25:09.294073+0000, chain.objs.size()=1 2024-08-27T03:58:29.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.pcxDtC4OVHN6XaGxhzKrBAUOXcCSkLz_0 2024-08-27T03:58:29.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9538522006172872726', time=2024-08-27T05:25:09.442514+0000, chain.objs.size()=1 2024-08-27T03:58:29.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2lHVRFFr49Z5mSRIRPfb54mOF3znGqj_0 2024-08-27T03:58:29.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14157230230822049442', time=2024-08-27T05:25:09.813240+0000, chain.objs.size()=1 2024-08-27T03:58:29.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.X601R8MSumxVGzb1-sNpYUOcWwnQCaD_0 2024-08-27T03:58:29.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8218299302132880024', time=2024-08-27T05:25:10.020196+0000, chain.objs.size()=1 2024-08-27T03:58:29.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wBSdktCqSaD8G4qQtO7Gy2ue00AozC9_0 2024-08-27T03:58:29.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3064943051020736594', time=2024-08-27T05:25:10.785831+0000, chain.objs.size()=1 2024-08-27T03:58:29.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KWXozruYZgfmyM5tbVfbUCZXg22vmyt_0 2024-08-27T03:58:29.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1164043208125472359', time=2024-08-27T05:25:11.053767+0000, chain.objs.size()=1 2024-08-27T03:58:29.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2zwG7MWr5RQnstykVEaZ3fR9-w42h8A_0 2024-08-27T03:58:29.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.435752722880653192', time=2024-08-27T05:25:11.375019+0000, chain.objs.size()=1 2024-08-27T03:58:29.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kASw5QH83mW3zSDKfi5GEL-dvpKQgN1_0 2024-08-27T03:58:29.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5599968209469114008', time=2024-08-27T05:25:13.026185+0000, chain.objs.size()=1 2024-08-27T03:58:29.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7XoA2IhljpaFV3TPLYpPetRlwkfdX4G_0 2024-08-27T03:58:29.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17948818618530471939', time=2024-08-27T05:25:13.778897+0000, chain.objs.size()=1 2024-08-27T03:58:29.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.P-23P6S4VJqzhV9NikmhIBISL2LPXOh_0 2024-08-27T03:58:29.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16608232758991272267', time=2024-08-27T05:26:58.633024+0000, chain.objs.size()=1 2024-08-27T03:58:29.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Lpvn-WDghuO6oCLv94sxBKNa5ZqL8EB_0 2024-08-27T03:58:29.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48411 2024-08-27T03:58:29.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-08-27T03:58:29.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2631908047946051999', time=2024-08-27T05:26:59.569272+0000, chain.objs.size()=1 2024-08-27T03:58:29.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QXWpgRDwXB50Wd_aqkbUwAu5Qnc_wjn_0 2024-08-27T03:58:29.931 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2339252121516943346', time=2024-08-27T05:27:01.750076+0000, chain.objs.size()=1 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.oCWviiPgtVD7cnH5MA7jfs1G6x5YqvD_0 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15969798329158946689', time=2024-08-27T05:27:02.862092+0000, chain.objs.size()=1 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.V7tMVwjy53kXfZjQte6UakJ6kSJSdJY_0 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5710699330801348861', time=2024-08-27T05:27:03.674087+0000, chain.objs.size()=1 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jJixliPtPyr8gykesvmgFljRv_I7bdC_0 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10053986975880633159', time=2024-08-27T05:27:03.700287+0000, chain.objs.size()=1 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pN0Nq2-l4n4qPHWDM35-zkWNAToWQLp_0 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3034465260729797280', time=2024-08-27T05:27:04.178367+0000, chain.objs.size()=1 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VuN_t1WLY63HBa6AAvEujcvDG-OQuMx_0 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15529965445612377239', time=2024-08-27T05:27:05.867202+0000, chain.objs.size()=1 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jqpKfrfxqVty_qEpBlc4-jlPMQzbuWe_0 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11046843484622480833', time=2024-08-27T05:27:06.844249+0000, chain.objs.size()=1 2024-08-27T03:58:29.932 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MD8zH_Z35_yLaeL3YrUz2phnC9WHjDF_0 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7113016630623622878', time=2024-08-27T05:27:07.224228+0000, chain.objs.size()=1 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nFHeK70_e_OHO4Be2xIeXKgoDAV4bkW_0 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7707566100563538245', time=2024-08-27T05:27:07.511085+0000, chain.objs.size()=1 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cywGxL02QV5KqtwU9orP-EQPc6BpVLx_0 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15525246109354081002', time=2024-08-27T05:27:07.560709+0000, chain.objs.size()=1 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7RQ0_UX6NJIbquSBUN9EFZU2qwrt2rv_0 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6865928827697076706', time=2024-08-27T05:27:07.703700+0000, chain.objs.size()=1 2024-08-27T03:58:29.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2FM3kHI1TyCNc04m7xfMcWYTN_p_iVA_0 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.219837624211667122', time=2024-08-27T05:27:11.446876+0000, chain.objs.size()=1 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QHES0QkzQ1BHv9ff1KIqGdy7QVtdJ4J_0 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3612521985172176518', time=2024-08-27T05:27:11.766138+0000, chain.objs.size()=1 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.L23fXX7pzr28nByBzJeNEOXAIouDmCq_0 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14393936666515581147', time=2024-08-27T05:27:13.165740+0000, chain.objs.size()=1 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CcL9YFFyWUX0H3QGa_c3hrkSnbkjF1J_0 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18048335009308849821', time=2024-08-27T05:27:14.635156+0000, chain.objs.size()=1 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.t_LVYTthLBS5YgwaXbm-wdUebWebZjD_0 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5734927233343532113', time=2024-08-27T05:27:15.225371+0000, chain.objs.size()=1 2024-08-27T03:58:29.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.n9pXXf6mvjOccZHVxjll2_mO_jpF3Ta_0 2024-08-27T03:58:29.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8503591389378185231', time=2024-08-27T05:27:17.468534+0000, chain.objs.size()=1 2024-08-27T03:58:29.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ui1jsOeupCpYe1FvkhUNes8Q-nStSmn_0 2024-08-27T03:58:29.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17006352482066191649', time=2024-08-27T05:27:17.828142+0000, chain.objs.size()=1 2024-08-27T03:58:29.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CD3HKajxMjtnQTmieqQBVVf350_Copy_0 2024-08-27T03:58:29.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5377004413012834948', time=2024-08-27T05:27:17.994441+0000, chain.objs.size()=1 2024-08-27T03:58:29.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jCIQ95sPuvwED1BdQ6UZG38m7jYhjWe_0 2024-08-27T03:58:29.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14717747112168430704', time=2024-08-27T05:27:19.959054+0000, chain.objs.size()=1 2024-08-27T03:58:29.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FpXZanmFQA72yoHFQiVpeoTr2zkjXu9_0 2024-08-27T03:58:29.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8585924574608328912', time=2024-08-27T05:27:20.042765+0000, chain.objs.size()=1 2024-08-27T03:58:29.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.byQz00lrXnXXwUvi9EC5FbkMRH6b5XT_0 2024-08-27T03:58:29.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5012750600283756464', time=2024-08-27T05:27:21.313260+0000, chain.objs.size()=1 2024-08-27T03:58:29.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UiZ4tRtL5ui8Gr8mSGB28nzv7flpsHx_0 2024-08-27T03:58:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5117624497882581752', time=2024-08-27T05:27:21.948691+0000, chain.objs.size()=1 2024-08-27T03:58:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MVU2Rm5FC-4XqDdxekkD7EBykNadG3x_0 2024-08-27T03:58:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2505219686124292421', time=2024-08-27T05:27:22.970048+0000, chain.objs.size()=1 2024-08-27T03:58:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6RiBIrwEVCXRY9_mUdZ0EHFYLvrdvn3_0 2024-08-27T03:58:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14322749498267299796', time=2024-08-27T05:27:24.052585+0000, chain.objs.size()=1 2024-08-27T03:58:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JF7ucTJNMvsFNpSRhhsSoRbPe8CtC2d_0 2024-08-27T03:58:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9900828514883546781', time=2024-08-27T05:27:24.250392+0000, chain.objs.size()=1 2024-08-27T03:58:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-SQlIDWiKZtKLhwHONwRewmwqUoiB8E_0 2024-08-27T03:58:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.757227686628198140', time=2024-08-27T05:27:25.659411+0000, chain.objs.size()=1 2024-08-27T03:58:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7hGGUGgTJ-43rgO5u3ax2YxgTejOxCL_0 2024-08-27T03:58:29.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14490114383436987770', time=2024-08-27T05:27:55.859386+0000, chain.objs.size()=1 2024-08-27T03:58:29.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.338__shadow_.S_CE0VT2C8RY9SG8jKb0RoThiGeHxXN_0 2024-08-27T03:58:29.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6510043957378888294', time=2024-08-27T05:28:27.588369+0000, chain.objs.size()=1 2024-08-27T03:58:29.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.363__shadow_.NjPVhKQonql7UleSefxnjdvGnStbtSb_0 2024-08-27T03:58:29.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15372233616110319099', time=2024-08-27T05:30:57.828005+0000, chain.objs.size()=1 2024-08-27T03:58:29.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.456__shadow_.rFE8vHKrod98NBaaENec_j6MGLRIwzx_0 2024-08-27T03:58:29.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10359685071996701758', time=2024-08-27T05:37:14.615233+0000, chain.objs.size()=1 2024-08-27T03:58:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.551__shadow_.BZvQIvYU7wtL21lMHSIijxIE8RZYW5y_0 2024-08-27T03:58:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1973358806009422535', time=2024-08-27T05:37:30.250504+0000, chain.objs.size()=1 2024-08-27T03:58:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.555__multipart_mymultipart.2~i4nWCMFhNzpFO1iiBYBONbe9igLdcv3.1 2024-08-27T03:58:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13995262942011265478', time=2024-08-27T05:38:06.083857+0000, chain.objs.size()=1 2024-08-27T03:58:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:W7CDshWynDpZH5XOIKF42pWz5.KaDD-_.SQS0IlBzJrIrIOhE8sTyaewfo8xp9Js_0 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1082902600764461751', time=2024-08-27T05:38:23.661602+0000, chain.objs.size()=1 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow_.9ctkuloAmYj39wu7ePmHWQZBV0pCBti_0 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12674577958433724572', time=2024-08-27T05:38:33.167310+0000, chain.objs.size()=1 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.569__shadow_.oo_2MXT2c0uhw2ASReYG5N1TQ3mWVYR_0 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15632744864544269455', time=2024-08-27T05:38:45.104443+0000, chain.objs.size()=1 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:MUzQpv0hEjm3ih5EO9kyyKOnk3re1EI_.sSAQMVCJBRoc55bt21iZc2nQwSg201S_0 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1524848873866970197', time=2024-08-27T05:45:58.781108+0000, chain.objs.size()=1 2024-08-27T03:58:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.641__shadow_.2K-yceDLx7RZEPeka2NoIh_19ZL0y1K_0 2024-08-27T03:58:29.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17652779206352422470', time=2024-08-27T05:47:38.591351+0000, chain.objs.size()=1 2024-08-27T03:58:29.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.690__shadow:qJh6woh2Dq3RAgar2jL84HIbbradhsG_.Dmf-IcjWBFrYTscl-0e-M7zMTedpwh6_0 2024-08-27T03:58:29.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3966095844352739062', time=2024-08-27T05:49:57.223799+0000, chain.objs.size()=1 2024-08-27T03:58:29.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.739__shadow_.ULBrRwWjm5MGrXyQo1dB8j1Gcf3pl5f_0 2024-08-27T03:58:29.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.947+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:29.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-08-27T03:58:29.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:29.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:29.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42207' 2024-08-27T03:58:29.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1173703257873779597', time=2024-08-27T05:13:31.584295+0000, chain.objs.size()=3 2024-08-27T03:58:29.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-STANDARD.2~29V9Sd7uNqDwEhZDvPDAwTr55VXxU5G.1 2024-08-27T03:58:29.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-STANDARD.2~29V9Sd7uNqDwEhZDvPDAwTr55VXxU5G.2 2024-08-27T03:58:29.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__multipart_foo-STANDARD.2~29V9Sd7uNqDwEhZDvPDAwTr55VXxU5G.3 2024-08-27T03:58:29.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15935692218739920482', time=2024-08-27T05:14:30.833338+0000, chain.objs.size()=1 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.182__shadow_.VpOLEiZ_IzD9Sd41IgHT_8ylVzFMMz0_0 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2791822620531195576', time=2024-08-27T05:18:25.600200+0000, chain.objs.size()=1 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.240__shadow_.9C-VMA_NE4ZSTCpCCjRjBDHv0G6EIJL_0 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8414361852190384833', time=2024-08-27T05:18:45.850582+0000, chain.objs.size()=1 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.251__shadow_.NsAt_qnIB0OpRh1Fofvc5rI2GCMDDPD_0 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13792441632497611308', time=2024-08-27T05:18:47.589150+0000, chain.objs.size()=1 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.252__shadow_.XGNT0TX-Phl-TQVVzIG1YmLmL6v9hIG_0 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13214946468686239723', time=2024-08-27T05:18:51.156544+0000, chain.objs.size()=1 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.254__shadow_.OUQNaJO7LiNx5OP2bib89nPyhnguBfR_0 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2253650361139615232', time=2024-08-27T05:18:51.178131+0000, chain.objs.size()=1 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.254__shadow_.eBllojxXXcKB5F69HrW7ewgJpsE61uf_0 2024-08-27T03:58:29.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7208875321320216374', time=2024-08-27T05:18:52.987038+0000, chain.objs.size()=1 2024-08-27T03:58:29.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.255__shadow_.U0cg1Arpdq91n41OGJKKnSvH8Tyaq3f_0 2024-08-27T03:58:29.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6642079687671473471', time=2024-08-27T05:18:52.988635+0000, chain.objs.size()=1 2024-08-27T03:58:29.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.255__shadow_.D0lqBqJyeHL7cLbcaHHEkfASGksHDH7_0 2024-08-27T03:58:29.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16050599053770744634', time=2024-08-27T05:20:36.832308+0000, chain.objs.size()=1 2024-08-27T03:58:29.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.1dxYSGqPDlCt3L0UYLvZ9OqjkA8QbSj_0 2024-08-27T03:58:29.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3327099628401875072', time=2024-08-27T05:20:37.617235+0000, chain.objs.size()=1 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.K3sXI5f873fbHoZJea241g5nk3oKZxq_0 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.952177554423440094', time=2024-08-27T05:20:38.163949+0000, chain.objs.size()=1 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qvtA2W2d8bHmBobrxIXI8K-5Xa4YqxG_0 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12460539863208296717', time=2024-08-27T05:20:39.411867+0000, chain.objs.size()=1 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hmA7Oo-N9uRFzEevYpY24iX1IWvgaxi_0 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15361182707628519233', time=2024-08-27T05:20:47.055306+0000, chain.objs.size()=1 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bm2aew8RdFqX7AXHl6V8VoHBgDvcU0X_0 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11445744749684811376', time=2024-08-27T05:20:47.060214+0000, chain.objs.size()=1 2024-08-27T03:58:29.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.49hS00LO3WeB__COyP0Pbr2Tv5NBT7S_0 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2830794520296928067', time=2024-08-27T05:20:47.411876+0000, chain.objs.size()=1 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RBhXxy7i0R121z0LgS4gSheApfLWTiU_0 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11370077904081288135', time=2024-08-27T05:20:48.936344+0000, chain.objs.size()=1 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.YEdnlHCHtzeKDPJA4bEAukYdznAID9V_0 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14526288938374972136', time=2024-08-27T05:20:53.369925+0000, chain.objs.size()=1 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._-10H1XYk25KTiU7y33w-wzOxv38s97_0 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7654523067006242705', time=2024-08-27T05:20:54.619408+0000, chain.objs.size()=1 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nRsB4NYdzHPJjjVgOBXaOtWEnYUGxC4_0 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3817987200606195156', time=2024-08-27T05:20:58.735563+0000, chain.objs.size()=1 2024-08-27T03:58:29.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Uhztw6iBlxB_b5IFKIb2iOtSI-itz7M_0 2024-08-27T03:58:29.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8608204101529415300', time=2024-08-27T05:20:59.388952+0000, chain.objs.size()=1 2024-08-27T03:58:29.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.veVdJjNVhCOTn_AILWo2lfiiMtY9Ta2_0 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4771057150990430272', time=2024-08-27T05:20:59.797622+0000, chain.objs.size()=1 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rZzcyviQHEk6Imnvaj6AYtF7zI_nCv6_0 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10809094978629064560', time=2024-08-27T05:21:00.075752+0000, chain.objs.size()=1 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.X6azn7t4PcW1-hOs2opXTHvEvvA0Gkj_0 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7532216200966480698', time=2024-08-27T05:21:00.752716+0000, chain.objs.size()=1 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9bCBihxpWoFrgdYK895cZXse6eoHCHN_0 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9730791335985006131', time=2024-08-27T05:21:03.351030+0000, chain.objs.size()=1 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hVN4Jjm5WTgWzdueX83ytLh8pPKtoAW_0 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12156063958992624867', time=2024-08-27T05:21:03.446569+0000, chain.objs.size()=1 2024-08-27T03:58:29.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xT_MJB_JSOz5rElmbSbXdXhyYPrAxac_0 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9512282604381243516', time=2024-08-27T05:21:03.824888+0000, chain.objs.size()=1 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.v7aCaNf0KCVQZlRybP6okn2vseeyczY_0 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13293886412072884609', time=2024-08-27T05:21:11.212732+0000, chain.objs.size()=1 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.260__shadow_.PYd__ooZFANsuGlSDKtuWmTGOWL_5YG_0 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6877093214397813998', time=2024-08-27T05:21:36.075163+0000, chain.objs.size()=1 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.274__shadow_.T_i5jKa27QVUZTWzpQT2cP5KJxDyv-F_0 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17947220395005737178', time=2024-08-27T05:21:37.937895+0000, chain.objs.size()=1 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.275__shadow_.h5OHcZFBhjMVU9aX4qeUgRgew_hKYNg_0 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3610268187741619476', time=2024-08-27T05:21:48.208660+0000, chain.objs.size()=1 2024-08-27T03:58:29.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.280__shadow_.ArWWMl3teZ2vcxBBuIJsYswAnTg8_Ry_0 2024-08-27T03:58:29.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5750364057163261824', time=2024-08-27T05:21:53.895157+0000, chain.objs.size()=1 2024-08-27T03:58:29.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.283__shadow_.5NeG06gBjvz0NcQGGg9KIRtfwEVKIcV_0 2024-08-27T03:58:29.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2343673341762337317', time=2024-08-27T05:22:02.787823+0000, chain.objs.size()=1 2024-08-27T03:58:29.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.8V0fZp_HGb1gLoll4OJ3Myfcv_wFIy7_0 2024-08-27T03:58:29.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17976964169641790674', time=2024-08-27T05:22:02.789196+0000, chain.objs.size()=1 2024-08-27T03:58:29.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.Gk00cO3P4enNF9e9pmqO1ufc2VU05Xs_0 2024-08-27T03:58:29.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13322870111136071938', time=2024-08-27T05:22:15.624955+0000, chain.objs.size()=1 2024-08-27T03:58:29.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.291__shadow_.JuE6NIfQ0hbj3x0opl8uj3_wQQvBja9_0 2024-08-27T03:58:29.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4122996217514373768', time=2024-08-27T05:22:21.448853+0000, chain.objs.size()=1 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.294__shadow_.3yZI2wi5ZJZ6G_l8PnfTagD2QqnQsuo_0 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4152108815997251516', time=2024-08-27T05:22:25.168022+0000, chain.objs.size()=1 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.296__shadow_.Qp9s0oIlt1gpVES9HfMiIXVbg1zPJvc_0 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1296883020570223385', time=2024-08-27T05:22:25.169579+0000, chain.objs.size()=1 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.296__shadow_.lI2Y1WZx_Mq698BWE6DU2BrKumNjeEM_0 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3331935090747184090', time=2024-08-27T05:22:33.009709+0000, chain.objs.size()=1 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.300__shadow_.7xCWTVRUCPY_Ny3dhqX3ZFR4GeW97fC_0 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8421861690430376316', time=2024-08-27T05:24:46.820285+0000, chain.objs.size()=1 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hBsjN9p_INP1KOEMicDBHzMFHKbXzCh_0 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10016258126687180600', time=2024-08-27T05:24:47.316128+0000, chain.objs.size()=1 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Pf-WA-xoD4pPFBtzYMVfl6XPD-P4Qon_0 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14983549625623872034', time=2024-08-27T05:24:47.772498+0000, chain.objs.size()=1 2024-08-27T03:58:29.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gGHcVpuROvzvm6kXxjYY-rgADfwhiTb_0 2024-08-27T03:58:29.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16360049144566005202', time=2024-08-27T05:24:47.883391+0000, chain.objs.size()=1 2024-08-27T03:58:29.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YM49aayyyZkRUf0eYYGTNWQAnmvkmOD_0 2024-08-27T03:58:29.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12761943312755687971', time=2024-08-27T05:24:51.119399+0000, chain.objs.size()=1 2024-08-27T03:58:29.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FAnxvnR5n2kqLf_fLDhakMp2Nn47EFY_0 2024-08-27T03:58:29.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4975369448593681841', time=2024-08-27T05:24:53.203076+0000, chain.objs.size()=1 2024-08-27T03:58:29.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gYGDxJa5_H4TC--aKaGJPgilNIfkHOv_0 2024-08-27T03:58:29.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7635030877560810268', time=2024-08-27T05:24:53.205503+0000, chain.objs.size()=1 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.foT4ksAq6F9kOHuezzbCNjWsqABny4T_0 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9961609477908591073', time=2024-08-27T05:24:55.883113+0000, chain.objs.size()=1 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SzcBGU6AiAd0MSHjDtqTHrEDAuccnO3_0 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7937675313932546121', time=2024-08-27T05:24:56.304540+0000, chain.objs.size()=1 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rgMbRBy_iweL1kWRLLFIAIsEs2Xxhcy_0 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1958165313318538607', time=2024-08-27T05:24:56.438178+0000, chain.objs.size()=1 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3KsyE12RjQzKclz3cuKCjrDDq6YzGNf_0 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7937355465215059495', time=2024-08-27T05:24:56.709778+0000, chain.objs.size()=1 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.taHKobSoMb1ykugQvFO5ktZScp8BOrX_0 2024-08-27T03:58:29.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12569476919711968668', time=2024-08-27T05:24:56.740301+0000, chain.objs.size()=1 2024-08-27T03:58:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0u1zUcZTONv_Ap8gaumzTzUzHA-hco4_0 2024-08-27T03:58:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.424666911073990717', time=2024-08-27T05:24:58.171993+0000, chain.objs.size()=1 2024-08-27T03:58:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dObFAm6evT-YZZoQBcugalkfSofW1qu_0 2024-08-27T03:58:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12378242884835790616', time=2024-08-27T05:24:58.421075+0000, chain.objs.size()=1 2024-08-27T03:58:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6eI_hDIsD5GwwakCocdJy-f3iUkZRsy_0 2024-08-27T03:58:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12920841254331313218', time=2024-08-27T05:24:58.468070+0000, chain.objs.size()=1 2024-08-27T03:58:29.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iqCNYpaPpN12n-IvhwgmQQEFySKFrbP_0 2024-08-27T03:58:29.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.979+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1639708315710280286', time=2024-08-27T05:24:59.135925+0000, chain.objs.size()=1 2024-08-27T03:58:29.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.979+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iCuqd9aTFmePy8DlmbVDFKq-qcrfgDM_0 2024-08-27T03:58:29.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6777658104364081713', time=2024-08-27T05:24:59.214754+0000, chain.objs.size()=1 2024-08-27T03:58:29.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.soxTnpPhzyKc-aLhJ5n1uxF-961LjjM_0 2024-08-27T03:58:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10144132984656807161', time=2024-08-27T05:24:59.216743+0000, chain.objs.size()=1 2024-08-27T03:58:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.f_yaC2u6uNnEoVZWFwQfxrHmg5J7EiR_0 2024-08-27T03:58:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16419986717590575127', time=2024-08-27T05:24:59.307981+0000, chain.objs.size()=1 2024-08-27T03:58:29.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.o8UCWzbjNrcW29e5kFJlBmkfL5gPAcJ_0 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11613195541315120709', time=2024-08-27T05:24:59.792324+0000, chain.objs.size()=1 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wOF-y3djUpAa1N7UPLjNB3snmFnASmx_0 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11171374656469078833', time=2024-08-27T05:25:00.061160+0000, chain.objs.size()=1 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vzG0BFvGHG3z5nwEnzLgre_JmYL6Ul2_0 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13237419380170602408', time=2024-08-27T05:25:00.283355+0000, chain.objs.size()=1 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gOEqRCDGt3a-yHMyjOlux6WiNq1URtl_0 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11013709498266067725', time=2024-08-27T05:25:00.285491+0000, chain.objs.size()=1 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LIic4q29q9qQG9h9AswLJJ1xw9Xltvd_0 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3905553161535475097', time=2024-08-27T05:25:01.692170+0000, chain.objs.size()=1 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CPaeenQixFTLG28-IVEhcLxXUxUQkGN_0 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.431837782309572136', time=2024-08-27T05:25:02.111430+0000, chain.objs.size()=1 2024-08-27T03:58:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.abZzCcWxBoZuFvx2EIQmZUn9zOaWFyE_0 2024-08-27T03:58:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8296471099639939563', time=2024-08-27T05:25:03.356608+0000, chain.objs.size()=1 2024-08-27T03:58:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.koB7uFeuSHNezY6q3CDy1tQCjZPhHu__0 2024-08-27T03:58:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9780263692621374204', time=2024-08-27T05:25:04.500534+0000, chain.objs.size()=1 2024-08-27T03:58:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YayzkXU-hE_3ojF_4JX1BgoQCZTo-KI_0 2024-08-27T03:58:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9952090072259951711', time=2024-08-27T05:25:05.254758+0000, chain.objs.size()=1 2024-08-27T03:58:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vgpk5IijQJxJcJ1XpNyt2gk_JfSnw7m_0 2024-08-27T03:58:29.990 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9169142320317208321', time=2024-08-27T05:25:05.603219+0000, chain.objs.size()=1 2024-08-27T03:58:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GRDY_2WE-8KwA4q0hJum3cmNgDiGK8y_0 2024-08-27T03:58:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15478130795527565658', time=2024-08-27T05:25:05.806347+0000, chain.objs.size()=1 2024-08-27T03:58:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cmv-NWSiOtiSngBzW2JCOmnsyrP_j9D_0 2024-08-27T03:58:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16859311354352399908', time=2024-08-27T05:25:06.783290+0000, chain.objs.size()=1 2024-08-27T03:58:29.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XkIC4xmE5sUIFK3tpuluNwkYDN6qyJU_0 2024-08-27T03:58:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12883340001530887311', time=2024-08-27T05:25:08.972427+0000, chain.objs.size()=1 2024-08-27T03:58:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FOnwIUIKgSAEE1pJfKAShTzzAZVAeUz_0 2024-08-27T03:58:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9536511919978741648', time=2024-08-27T05:25:09.733205+0000, chain.objs.size()=1 2024-08-27T03:58:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.opUAx_vUHmCk0vjfgmaj1x9yxZipiWU_0 2024-08-27T03:58:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501584119488836355', time=2024-08-27T05:25:10.132562+0000, chain.objs.size()=1 2024-08-27T03:58:29.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.987+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VGJ2qM59gLI2d2TLxUaVsL9jXzieeHI_0 2024-08-27T03:58:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17889517818045258280', time=2024-08-27T05:25:10.144798+0000, chain.objs.size()=1 2024-08-27T03:58:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9hnoXTFnFB5M7HzZFbF74pdIXQqdwE7_0 2024-08-27T03:58:29.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15716930996917896845', time=2024-08-27T05:25:11.485893+0000, chain.objs.size()=1 2024-08-27T03:58:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RXOKd3Oy_RSyKLv2PJKgm6E7PC0-a3I_0 2024-08-27T03:58:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18426441198548329250', time=2024-08-27T05:25:12.308376+0000, chain.objs.size()=1 2024-08-27T03:58:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.WfCHLmsLdR-YbUtqHTI6v4decFInFkL_0 2024-08-27T03:58:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10166337984722155831', time=2024-08-27T05:25:12.872199+0000, chain.objs.size()=1 2024-08-27T03:58:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qae5UcrNPoiX42Npgm508euDCAnVO5Z_0 2024-08-27T03:58:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5702715194701664565', time=2024-08-27T05:25:13.904056+0000, chain.objs.size()=1 2024-08-27T03:58:29.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vyGIzLqApDVJzH2m84rY6z9BSuUPqlB_0 2024-08-27T03:58:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6055404584345587305', time=2024-08-27T05:25:14.013238+0000, chain.objs.size()=1 2024-08-27T03:58:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gvKbeNdj4PZu1P_MNF7f6c69BRyAR0R_0 2024-08-27T03:58:29.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1736106160018138027', time=2024-08-27T05:26:57.681447+0000, chain.objs.size()=1 2024-08-27T03:58:29.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LIQ6hxiRxnSY4qtoa086h7MQpwkOHrg_0 2024-08-27T03:58:29.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6776695959736073705', time=2024-08-27T05:26:58.816084+0000, chain.objs.size()=1 2024-08-27T03:58:29.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xrQFbGOOKPamYRu5rVkAIVqYtJDZUQY_0 2024-08-27T03:58:29.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16577113495282485070', time=2024-08-27T05:26:58.999649+0000, chain.objs.size()=1 2024-08-27T03:58:29.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.67jSWuTtzZ3_X5J5V_gYNsJ3zz23SCO_0 2024-08-27T03:58:29.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5076021383924162022', time=2024-08-27T05:26:59.003504+0000, chain.objs.size()=1 2024-08-27T03:58:29.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3V6FC3lbkCPiPpDfnKxJDLndDyc_uDT_0 2024-08-27T03:58:29.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14667559975038751140', time=2024-08-27T05:26:59.519900+0000, chain.objs.size()=1 2024-08-27T03:58:29.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NC29-psD-5KSxNAlGM8k01uwPFrBNvh_0 2024-08-27T03:58:30.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2018657847705207310', time=2024-08-27T05:27:00.066473+0000, chain.objs.size()=1 2024-08-27T03:58:30.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._k4JiU7Se2yPyP2i9i4lIzoKqNkRoDs_0 2024-08-27T03:58:30.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3139513498857915273', time=2024-08-27T05:27:00.504065+0000, chain.objs.size()=1 2024-08-27T03:58:30.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0Hq-ZG1vFLkLvUevCal7QWXd1-N1Et0_0 2024-08-27T03:58:30.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12856269723223940171', time=2024-08-27T05:27:01.674082+0000, chain.objs.size()=1 2024-08-27T03:58:30.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RYbsT7icfvRNl_ooIEArt8B9-N1qCAf_0 2024-08-27T03:58:30.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8547194096843539487', time=2024-08-27T05:27:02.716109+0000, chain.objs.size()=1 2024-08-27T03:58:30.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KVpKPF5hYuTHWtelPwUn0B5UufOMpj9_0 2024-08-27T03:58:30.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5769819517908446602', time=2024-08-27T05:27:04.525041+0000, chain.objs.size()=1 2024-08-27T03:58:30.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Q4VzPLQBDb_Tw0UOr6LgfQxXobTxU1m_0 2024-08-27T03:58:30.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2832208471102774998', time=2024-08-27T05:27:05.787861+0000, chain.objs.size()=1 2024-08-27T03:58:30.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bj2NSZzMvvK_EtdHGV-eUTr06dIW27Z_0 2024-08-27T03:58:30.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2535565942012468679', time=2024-08-27T05:27:05.797949+0000, chain.objs.size()=1 2024-08-27T03:58:30.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.yORdqvTgex_Lt76Edx-5N5WYOogyatn_0 2024-08-27T03:58:30.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13349595395642711469', time=2024-08-27T05:27:06.268499+0000, chain.objs.size()=1 2024-08-27T03:58:30.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lRvc45Oqm3gBtPQxhgM9wYX8H_6zbq0_0 2024-08-27T03:58:30.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11073199457033699789', time=2024-08-27T05:27:06.382593+0000, chain.objs.size()=1 2024-08-27T03:58:30.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EbgXWjohzyoEd3KQmJRHIkObQvpcQ5p_0 2024-08-27T03:58:30.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11742003711571673300', time=2024-08-27T05:27:08.036677+0000, chain.objs.size()=1 2024-08-27T03:58:30.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gIQPXvaccYjkPTUqjjEt4rGbGG-dxUq_0 2024-08-27T03:58:30.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14721492692263769562', time=2024-08-27T05:27:09.533975+0000, chain.objs.size()=1 2024-08-27T03:58:30.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.e5MIQvRZJkBuQaRcEtHq4tZvONY5j9G_0 2024-08-27T03:58:30.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15269632952968650956', time=2024-08-27T05:27:10.511399+0000, chain.objs.size()=1 2024-08-27T03:58:30.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:29.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0cPhCaW4a2vdxnRM5p-KFLeZplPUX1C_0 2024-08-27T03:58:30.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12379290515014348001', time=2024-08-27T05:27:11.617429+0000, chain.objs.size()=1 2024-08-27T03:58:30.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4N4PaNpuj321u4jtYo3oymM1b__7C7P_0 2024-08-27T03:58:30.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5215868185402407872', time=2024-08-27T05:27:11.797828+0000, chain.objs.size()=1 2024-08-27T03:58:30.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.f6ouDmb0IML8I2xwH4D_QpWl-SoLsOb_0 2024-08-27T03:58:30.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8501674328608677207', time=2024-08-27T05:27:11.879805+0000, chain.objs.size()=1 2024-08-27T03:58:30.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.b6WEYgVQ4Suw_taw-gRwEGTvmVw4dvF_0 2024-08-27T03:58:30.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2413904236648849162', time=2024-08-27T05:27:15.642263+0000, chain.objs.size()=1 2024-08-27T03:58:30.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Z2RFIPl3leeFmWCcMqk7983SMTmz_OH_0 2024-08-27T03:58:30.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.007+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42207 2024-08-27T03:58:30.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-08-27T03:58:30.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.950382798099731326', time=2024-08-27T05:27:15.644220+0000, chain.objs.size()=1 2024-08-27T03:58:30.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Yf1AOJfAtiqSCSzuiMgpVai0lZkieVM_0 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15392291409930095382', time=2024-08-27T05:27:16.511284+0000, chain.objs.size()=1 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1_ydOVZJfm4iWSpT8aSspSYyXHN3YMB_0 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14685736313646530139', time=2024-08-27T05:27:16.522791+0000, chain.objs.size()=1 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qBP-82iumC0BuFUykw27i7OYuChkalU_0 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14607069474334994622', time=2024-08-27T05:27:21.509967+0000, chain.objs.size()=1 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rgR-81C35jofk-phuZaaR5ld46Wz5Xx_0 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4412684452937284171', time=2024-08-27T05:27:22.189388+0000, chain.objs.size()=1 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.tCflr-qz0UE-hjriYkph5vmcb3ILEHi_0 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10385214540203525092', time=2024-08-27T05:27:24.266444+0000, chain.objs.size()=1 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.apDXV8cQNqcXAbn2z67WcI5Ce5gWTyO_0 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6419092541442752136', time=2024-08-27T05:27:25.390385+0000, chain.objs.size()=1 2024-08-27T03:58:30.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4-i_kTmH6Q5AoFBkb1F6DHFdlYiWEJQ_0 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4414747255972552299', time=2024-08-27T05:27:25.392532+0000, chain.objs.size()=1 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nPGMciEyEhmMpds7nbSDIxHD144apXo_0 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6713569241163574458', time=2024-08-27T05:28:40.828044+0000, chain.objs.size()=1 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.371__shadow_.frhKinjKTokPZ7NxczWBCp8XBF_nh8u_0 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3452932028755525227', time=2024-08-27T05:29:01.734579+0000, chain.objs.size()=1 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.384__shadow_.6haDVWp1Weup2XByui0yOkJlig4v3Yz_0 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6459250930913850251', time=2024-08-27T05:30:11.248497+0000, chain.objs.size()=1 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.430__shadow_.3lmZ18e0lurEi2v6vEc0Ad5dcBhsz-z_0 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4709375829072928041', time=2024-08-27T05:30:17.649722+0000, chain.objs.size()=1 2024-08-27T03:58:30.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.434__shadow_.q9JfhsDswcFncsRa2ETBCzZLTciBM8N_0 2024-08-27T03:58:30.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4002366635228523717', time=2024-08-27T05:31:28.546340+0000, chain.objs.size()=1 2024-08-27T03:58:30.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.3UEDLUhg1XrOuakoGGdoKzDjO_92NLB_0 2024-08-27T03:58:30.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2535052977169228769', time=2024-08-27T05:31:39.338841+0000, chain.objs.size()=1 2024-08-27T03:58:30.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.481__shadow_.2tkShatZ9qxMlqhUNYZqEPL5MGtzDMm_0 2024-08-27T03:58:30.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6638644466489136238', time=2024-08-27T05:33:22.621488+0000, chain.objs.size()=1 2024-08-27T03:58:30.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.514__shadow:.ws7rYQDfhjk4HcPJZBAWIi4Ma-q52v_.9HuXt_MdnFCf5Diq9zzL6guV9cXXVzF_0 2024-08-27T03:58:30.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6797725952780978942', time=2024-08-27T05:33:48.855550+0000, chain.objs.size()=6 2024-08-27T03:58:30.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.WVItSKVUnN01NjvDDvOBNPQxnFZRx2t0.1 2024-08-27T03:58:30.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Qhz7JWszmmHtVXjaqpc2dcKC9xl20ua.2 2024-08-27T03:58:30.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Qhz7JWszmmHtVXjaqpc2dcKC9xl20ua.3 2024-08-27T03:58:30.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Qhz7JWszmmHtVXjaqpc2dcKC9xl20ua.4 2024-08-27T03:58:30.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Qhz7JWszmmHtVXjaqpc2dcKC9xl20ua.5 2024-08-27T03:58:30.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Qhz7JWszmmHtVXjaqpc2dcKC9xl20ua.6 2024-08-27T03:58:30.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HsmKzou0npDn0P0U-wQuUSLyqimSNPg', time=2024-08-27T05:35:44.322450+0000, chain.objs.size()=2 2024-08-27T03:58:30.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.525__multipart_mymultipart.2~HsmKzou0npDn0P0U-wQuUSLyqimSNPg.1 2024-08-27T03:58:30.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.525__multipart_mymultipart.2~HsmKzou0npDn0P0U-wQuUSLyqimSNPg.2 2024-08-27T03:58:30.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6568844776808600881', time=2024-08-27T05:37:55.520757+0000, chain.objs.size()=1 2024-08-27T03:58:30.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:pbim-x41Ehw66SVPAvvv2UEyE2VrLSb_.LiGr2m3Uy-9T82MGtDCmXCsyDucFpqf_0 2024-08-27T03:58:30.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14720187761465919629', time=2024-08-27T05:38:36.663217+0000, chain.objs.size()=1 2024-08-27T03:58:30.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:OkqwK1BLta5mLrn7CJzemHnkUclfkmH_.zgl3Ac9TVsc8-BgPny2POYKBXpXApMj_0 2024-08-27T03:58:30.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3202710363385228118', time=2024-08-27T05:38:39.381435+0000, chain.objs.size()=1 2024-08-27T03:58:30.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:N0idmPhkfx3BCVlSx5Ft9NdCkNtGI87_.Gx-ZaSeHwigBCcCSP0W-mfVwET59GH5_0 2024-08-27T03:58:30.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2013944588873193063', time=2024-08-27T05:39:06.407806+0000, chain.objs.size()=1 2024-08-27T03:58:30.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:DIRHxljWhj26rLzaEDS6IsJSQ-amSnL_.ignvJ5h1BjfYYz4EnEu8-tq5h_UZsh1_0 2024-08-27T03:58:30.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2993828436075259848', time=2024-08-27T05:40:13.111811+0000, chain.objs.size()=1 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.580__shadow:4Pir4RHKFXI2tSQfRiN.HUm4vMkQfcH_.aFDwytfnYdQMe0VsXKelxRQv6RNiPqv_0 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16967162784951999545', time=2024-08-27T05:40:45.602500+0000, chain.objs.size()=1 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.601__shadow_.JFW_NnT5jpT-yDVt0jhPvSNE3AGdyiW_0 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1046085586705921575', time=2024-08-27T05:41:30.576035+0000, chain.objs.size()=6 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.607__multipart_multipart_enc.2~8bm2XnJFajj40kNjz8DgmACam9e9La0.1 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.607__multipart_multipart_enc.2~8bm2XnJFajj40kNjz8DgmACam9e9La0.2 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.607__multipart_multipart_enc.2~8bm2XnJFajj40kNjz8DgmACam9e9La0.3 2024-08-27T03:58:30.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.607__multipart_multipart_enc.2~8bm2XnJFajj40kNjz8DgmACam9e9La0.4 2024-08-27T03:58:30.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.607__multipart_multipart_enc.2~8bm2XnJFajj40kNjz8DgmACam9e9La0.5 2024-08-27T03:58:30.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.607__multipart_multipart_enc.2~8bm2XnJFajj40kNjz8DgmACam9e9La0.6 2024-08-27T03:58:30.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7984585101228207100', time=2024-08-27T05:45:34.918695+0000, chain.objs.size()=1 2024-08-27T03:58:30.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.630__shadow_.7bnYHmubyPEfpNQD6uOBct0btsTTp_v_0 2024-08-27T03:58:30.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-08-27T03:58:30.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44636' 2024-08-27T03:58:30.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.883909743388644516', time=2024-08-27T05:13:23.773260+0000, chain.objs.size()=2 2024-08-27T03:58:30.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.LaJ5aFwNsI19EUAKSU1YdHZ8jyHoXyq_0 2024-08-27T03:58:30.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.LaJ5aFwNsI19EUAKSU1YdHZ8jyHoXyq_1 2024-08-27T03:58:30.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.141224738701512777', time=2024-08-27T05:14:32.354558+0000, chain.objs.size()=1 2024-08-27T03:58:30.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.183__shadow_.iaf58IYxlr4P2ycMHJ38MegYHajwdn__0 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12729073788932578166', time=2024-08-27T05:18:29.308732+0000, chain.objs.size()=1 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.242__shadow_.rmLF5Hh2sRAn4jOpvnzczC61ETH2lwt_0 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10078243697878895671', time=2024-08-27T05:18:31.137101+0000, chain.objs.size()=1 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.243__shadow_.7BJUHcWaUv4aUc_JKB9qGxsiq4Qj0SG_0 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6633443561844222951', time=2024-08-27T05:18:42.202846+0000, chain.objs.size()=1 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.249__shadow_.I2JcXYS_cLh5XXiJop_HK9zBczG0q5Z_0 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4086347294758791261', time=2024-08-27T05:18:49.349333+0000, chain.objs.size()=1 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.253__shadow_.IocN7UNjAgr5lKLuA6CRWg3FJmLQvxC_0 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11409317290060961753', time=2024-08-27T05:20:35.604132+0000, chain.objs.size()=1 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.UWO4y4Z5DMgM9FcBpJyKurIRLDW3WUd_0 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9960521571359037673', time=2024-08-27T05:20:35.605743+0000, chain.objs.size()=1 2024-08-27T03:58:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vpImuf5cj1KZLBNgndFQnFLpafH4ZPj_0 2024-08-27T03:58:30.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14622772592505914045', time=2024-08-27T05:20:37.545156+0000, chain.objs.size()=1 2024-08-27T03:58:30.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.H8IJRhHj4v4uf9rjDrwJxO4s7yXS1EN_0 2024-08-27T03:58:30.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11705909992845757566', time=2024-08-27T05:20:38.067620+0000, chain.objs.size()=1 2024-08-27T03:58:30.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gPdObvHf3Z0SXu4uRC7d03LTrGFSxWy_0 2024-08-27T03:58:30.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9672764885891174879', time=2024-08-27T05:20:38.069497+0000, chain.objs.size()=1 2024-08-27T03:58:30.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.c53mRcNhDuslsKY2QZGbx2QrFzggWpM_0 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11498696808680416477', time=2024-08-27T05:20:40.240903+0000, chain.objs.size()=1 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QAE2nc68k1uHBnPDI4dL5AY2FYztQxe_0 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8106391618989890572', time=2024-08-27T05:20:40.363509+0000, chain.objs.size()=1 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7erGhN2RMVbHqWpvx4VoRuG_ohn8edw_0 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10925045232590040958', time=2024-08-27T05:20:44.984076+0000, chain.objs.size()=1 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.laX79RcbKxFkv_zFFfbgYN5jkOftlsg_0 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6615701641103098128', time=2024-08-27T05:20:45.325137+0000, chain.objs.size()=1 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.r1YHrL2XEMiSJxIpPnz82WcDvkf51at_0 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18297246025087607464', time=2024-08-27T05:20:45.390347+0000, chain.objs.size()=1 2024-08-27T03:58:30.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sAhbr0QVgPWJNFCWcBW8d2gImFSv0vk_0 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3748398625252709676', time=2024-08-27T05:20:46.039551+0000, chain.objs.size()=1 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.x5_urpLvjfnJflPA5BG8UaGV-YxmFHS_0 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2420687967240249200', time=2024-08-27T05:20:47.448607+0000, chain.objs.size()=1 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6m6_sGlk0ubQGFRBW41Nx47TfDXUuEc_0 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6699184763433380114', time=2024-08-27T05:20:48.945083+0000, chain.objs.size()=1 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.G3HL6Vn7pY1OXpia6s0QSNz1lG8rRWI_0 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5116423119556592285', time=2024-08-27T05:20:49.094757+0000, chain.objs.size()=1 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-0xNCVk0tSQ79h3FQJk9--iv0GCB8Do_0 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8008529598135591136', time=2024-08-27T05:20:49.147348+0000, chain.objs.size()=1 2024-08-27T03:58:30.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZtYxC57y18MYcuU-DsZARH0yDZwnOvU_0 2024-08-27T03:58:30.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13758306646787494063', time=2024-08-27T05:20:49.577139+0000, chain.objs.size()=1 2024-08-27T03:58:30.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fVp0Mf5xK6UeKB_eRMnAN0H0k9jHXfr_0 2024-08-27T03:58:30.044 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11813223579809369288', time=2024-08-27T05:20:52.016430+0000, chain.objs.size()=1 2024-08-27T03:58:30.044 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aycu0nh4I5q8PAWxVG9yhiIunaJzc7j_0 2024-08-27T03:58:30.044 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12888511663662132097', time=2024-08-27T05:20:53.117606+0000, chain.objs.size()=1 2024-08-27T03:58:30.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hjItYduZV3H02HtIBuhfLZ1lu2po8wh_0 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8357463825537170538', time=2024-08-27T05:20:54.605378+0000, chain.objs.size()=1 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bwFLRyxNCtj-MVOX-6T9ScAgY9iUS3L_0 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6272135889954296862', time=2024-08-27T05:20:55.711107+0000, chain.objs.size()=1 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JO0lIjVlTZGzPr0Tbv28yv9WqqvoGeC_0 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3227433784476971108', time=2024-08-27T05:20:56.131121+0000, chain.objs.size()=1 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Cg1aSdeCV0-ObLjtULH3k7JNpoH4dau_0 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3022831945830126102', time=2024-08-27T05:20:56.381215+0000, chain.objs.size()=1 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hfD11VlyejfGaFODDn45xUxUgQYKzIH_0 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5000819710541297176', time=2024-08-27T05:20:58.606447+0000, chain.objs.size()=1 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-VWeGxj-QxvBx8zXFBhvzJFTVwEemT2_0 2024-08-27T03:58:30.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16901668790730005830', time=2024-08-27T05:21:00.124963+0000, chain.objs.size()=1 2024-08-27T03:58:30.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9ca5OL-2S_4OTANoIkV5JzDS0B7Fu94_0 2024-08-27T03:58:30.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12607469327341033817', time=2024-08-27T05:21:00.840893+0000, chain.objs.size()=1 2024-08-27T03:58:30.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QPxfpbJF08yDrlAjiMmHTZOeDhJkye-_0 2024-08-27T03:58:30.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16133777108629157993', time=2024-08-27T05:21:02.052251+0000, chain.objs.size()=1 2024-08-27T03:58:30.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Rk10Oy2GcqIMWpiNglA1-MYo5F-f_kr_0 2024-08-27T03:58:30.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17979833449292229746', time=2024-08-27T05:21:02.901755+0000, chain.objs.size()=1 2024-08-27T03:58:30.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LYkPTb6wM7tEHe2yCyqeatrTEmMCdII_0 2024-08-27T03:58:30.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4563200869896882025', time=2024-08-27T05:21:03.446316+0000, chain.objs.size()=1 2024-08-27T03:58:30.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fcFcBlQ09yYbne4F5Mx-xbNF_6CndTY_0 2024-08-27T03:58:30.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16699430347199353527', time=2024-08-27T05:21:12.895297+0000, chain.objs.size()=1 2024-08-27T03:58:30.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.261__shadow_.3JqOKEKHoH-9CH1Z0Q2vnMTlFDcOiwc_0 2024-08-27T03:58:30.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4456826593188961562', time=2024-08-27T05:21:25.013091+0000, chain.objs.size()=1 2024-08-27T03:58:30.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.268__shadow_.tZSr-gAQzxA4nDCvvE7lsop-95_cdf3_0 2024-08-27T03:58:30.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5320461348857014282', time=2024-08-27T05:21:26.885266+0000, chain.objs.size()=1 2024-08-27T03:58:30.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.269__shadow_.4ZZARBPiiseQa6ULQzsz0DdRy20zWo9_0 2024-08-27T03:58:30.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17366049867921338476', time=2024-08-27T05:21:37.937663+0000, chain.objs.size()=1 2024-08-27T03:58:30.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.275__shadow_.PpdqVNqpCRBU0K7PUvt07_nwqWQp4UC_0 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8576317660463730253', time=2024-08-27T05:21:52.073656+0000, chain.objs.size()=1 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.282__shadow_.tCN6GE7NiGpp6MiducnkBMb-qGWWqKN_0 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13276679060029573682', time=2024-08-27T05:22:13.744138+0000, chain.objs.size()=1 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.290__shadow_.C1U9NtIP7uTB5zRmAAecnkGGLgc0zYj_0 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18061582205159058583', time=2024-08-27T05:23:03.033525+0000, chain.objs.size()=1 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.316__shadow_.sSAxY131wVgoj9EMHwtQm7FDaEHrhgz_0 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16953304043250255908', time=2024-08-27T05:24:47.990960+0000, chain.objs.size()=1 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TgHG76g-aQHmMrWVv64hhuLPGM0qo54_0 2024-08-27T03:58:30.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6637749566542796213', time=2024-08-27T05:24:51.116969+0000, chain.objs.size()=1 2024-08-27T03:58:30.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MnAKmscLI_CN0wN71lxA0ohv1SiWer8_0 2024-08-27T03:58:30.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9144000903294758440', time=2024-08-27T05:24:53.202036+0000, chain.objs.size()=1 2024-08-27T03:58:30.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Byxmgjj5kgj_DAlWTfHT79UsqDqK71T_0 2024-08-27T03:58:30.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1910483239762418897', time=2024-08-27T05:24:54.507536+0000, chain.objs.size()=1 2024-08-27T03:58:30.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3SgJ1c2YowWkwcZIMdg8LDisW2XhZNr_0 2024-08-27T03:58:30.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8965664494145033004', time=2024-08-27T05:24:55.414795+0000, chain.objs.size()=1 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.emF6C_H5udjeqmgiSyLkKUppRJcwK___0 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16704045179643088619', time=2024-08-27T05:24:55.881290+0000, chain.objs.size()=1 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.r-v9APE8LrLjiRKL2neQLcRNhMYZRJJ_0 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17552069329312219896', time=2024-08-27T05:24:56.206901+0000, chain.objs.size()=1 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.be1lEs2lhGT5B8K2AGe6XsoIvwgg0BQ_0 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7828795264975899508', time=2024-08-27T05:24:56.439088+0000, chain.objs.size()=1 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sPm0MHPyuRtC1d4zgiVUjngRNmTQpFP_0 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15991325962483876034', time=2024-08-27T05:24:56.713494+0000, chain.objs.size()=1 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5UrWYZlfqzY05JIA9eTByUK3DMlCpvf_0 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15749896962838850427', time=2024-08-27T05:24:58.056895+0000, chain.objs.size()=1 2024-08-27T03:58:30.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dk0A6nmmffpZu3Ve5lZy_hg18tohnBe_0 2024-08-27T03:58:30.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3437596581989697093', time=2024-08-27T05:24:58.171334+0000, chain.objs.size()=1 2024-08-27T03:58:30.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.shCBCBTdBWYDxapxhDWu7GrdQAsbH0p_0 2024-08-27T03:58:30.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2187763125224636357', time=2024-08-27T05:24:58.786850+0000, chain.objs.size()=1 2024-08-27T03:58:30.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sjw__2PZUJraeO7QZ7CT7WpPEzevGjV_0 2024-08-27T03:58:30.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15276987776945552708', time=2024-08-27T05:24:59.308015+0000, chain.objs.size()=1 2024-08-27T03:58:30.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dJmnhNtB_sly0z7Yulhh7acxz8uLnQm_0 2024-08-27T03:58:30.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7433405500312013564', time=2024-08-27T05:25:00.235818+0000, chain.objs.size()=1 2024-08-27T03:58:30.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YILUkFNVQYM9UdQE8QGyL3g-HW1f64M_0 2024-08-27T03:58:30.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6244822319173512093', time=2024-08-27T05:25:00.756201+0000, chain.objs.size()=1 2024-08-27T03:58:30.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yraua9Hc2DQZvebO1mpUEnI-KZFgp7A_0 2024-08-27T03:58:30.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3988642679245212172', time=2024-08-27T05:25:00.821010+0000, chain.objs.size()=1 2024-08-27T03:58:30.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Qpz-nsd4TuuPg2fPyouse5D6jqVbKzS_0 2024-08-27T03:58:30.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17477989430708552713', time=2024-08-27T05:25:01.693494+0000, chain.objs.size()=1 2024-08-27T03:58:30.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7taWPTU-fXFqjy9xzTNZSDNqfiZ4qu8_0 2024-08-27T03:58:30.063 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15841916053722755466', time=2024-08-27T05:25:02.549987+0000, chain.objs.size()=1 2024-08-27T03:58:30.063 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cfA4DKWiq0ece-MpAKi9BWBOfAfHaz8_0 2024-08-27T03:58:30.063 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10293994390355684614', time=2024-08-27T05:25:02.765545+0000, chain.objs.size()=1 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.px81qxIDbDcZCJiwUYWT3qwWKbPOLb8_0 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14153117340101712205', time=2024-08-27T05:25:04.360632+0000, chain.objs.size()=1 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6eIrsmi43O8MdxRBwKHh9KvH_RaQp9V_0 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9294830694257993932', time=2024-08-27T05:25:06.779723+0000, chain.objs.size()=1 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0x0J7te92TmvzTEcRVJkaLNhbDFe_db_0 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1943593388863803705', time=2024-08-27T05:25:07.996692+0000, chain.objs.size()=1 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gtRK7rnlB-5QnOhjqqRxiWdsaoXaBD3_0 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3319999708433760320', time=2024-08-27T05:25:08.076150+0000, chain.objs.size()=1 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.le8dyptE8Sz5tcYjd4Bnv3_WkHstuKO_0 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9128122982881948917', time=2024-08-27T05:25:09.938872+0000, chain.objs.size()=1 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Mr9Ls1l9t7DHApcoXWi41lKu0McReLn_0 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13364182953900744211', time=2024-08-27T05:25:10.139238+0000, chain.objs.size()=1 2024-08-27T03:58:30.064 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.HRs4IwV1USlTpbODb7bUy_0edqdf5kW_0 2024-08-27T03:58:30.065 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7088885573909368567', time=2024-08-27T05:25:12.743016+0000, chain.objs.size()=1 2024-08-27T03:58:30.065 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kxBCnPjXu7vaYzi2lfj6yLNOuHkfqA3_0 2024-08-27T03:58:30.066 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12482281132025790955', time=2024-08-27T05:25:13.907282+0000, chain.objs.size()=1 2024-08-27T03:58:30.066 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Y1bgAZcO6ZuXizd0WTEAiVn5MvgFKhT_0 2024-08-27T03:58:30.066 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8567790668462000740', time=2024-08-27T05:26:57.756900+0000, chain.objs.size()=1 2024-08-27T03:58:30.066 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nIWZU9eQkOOlVUyEntiNC4npbpjhYZu_0 2024-08-27T03:58:30.067 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519115649610563962', time=2024-08-27T05:26:58.633697+0000, chain.objs.size()=1 2024-08-27T03:58:30.067 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.kiUwfWGB3dy6zuLL4hvl7C4D5FRq7t1_0 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13372172873219165242', time=2024-08-27T05:26:58.789568+0000, chain.objs.size()=1 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6lKTZsqE-SwpMSasaXFMvQVqSC7iBdj_0 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5938049519340675138', time=2024-08-27T05:26:59.973253+0000, chain.objs.size()=1 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wDNi6igSsHiZ_17-kIWQ6BLce2w-3di_0 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16450911097780753027', time=2024-08-27T05:27:00.267055+0000, chain.objs.size()=1 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.weYyCED2L8o_Oik0S9FT0-xrx_Lh_qB_0 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2025858893469670638', time=2024-08-27T05:27:00.536900+0000, chain.objs.size()=1 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.udAN5Y7L8DX29bBIGgB_DgjbbU_yGPH_0 2024-08-27T03:58:30.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4237965622118379722', time=2024-08-27T05:27:01.770317+0000, chain.objs.size()=1 2024-08-27T03:58:30.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4b3PQZtBjovnvJiLSM_4GxK_-9kVl_4_0 2024-08-27T03:58:30.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8657598742271889756', time=2024-08-27T05:27:02.089228+0000, chain.objs.size()=1 2024-08-27T03:58:30.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.WqIP27BapFdUhmS1atz2QSV4jS714w9_0 2024-08-27T03:58:30.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9741701621842125845', time=2024-08-27T05:27:02.091309+0000, chain.objs.size()=1 2024-08-27T03:58:30.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.iYgKEDsVWcyrmKOENVj7V43HtsQd7cP_0 2024-08-27T03:58:30.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4106749515438738755', time=2024-08-27T05:27:03.232794+0000, chain.objs.size()=1 2024-08-27T03:58:30.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Bcwx88zUi2nfMqmFaB5X4CtFFyzNkqB_0 2024-08-27T03:58:30.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7278007383174869955', time=2024-08-27T05:27:03.860250+0000, chain.objs.size()=1 2024-08-27T03:58:30.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3zXa7-jFtOo6mO0qTtO--L1kQ8HyY25_0 2024-08-27T03:58:30.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7819827000286053037', time=2024-08-27T05:27:06.388397+0000, chain.objs.size()=1 2024-08-27T03:58:30.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Xft0fN6FxPKvKmkKoGyBvABpPZhlmmv_0 2024-08-27T03:58:30.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4717702740604935191', time=2024-08-27T05:27:06.611548+0000, chain.objs.size()=1 2024-08-27T03:58:30.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.icP9hNaJ2S-dHnpDRR3PM7rFIpmufkz_0 2024-08-27T03:58:30.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.253086179717247780', time=2024-08-27T05:27:06.820390+0000, chain.objs.size()=1 2024-08-27T03:58:30.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gXSQP81fOAr4BPWCypSdwCZ4SGMjNHb_0 2024-08-27T03:58:30.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17102217602379124621', time=2024-08-27T05:27:07.083000+0000, chain.objs.size()=1 2024-08-27T03:58:30.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.kyTozT3u5k_FZol5zNPjIKZAI5Gcod5_0 2024-08-27T03:58:30.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10694067063227682556', time=2024-08-27T05:27:08.037945+0000, chain.objs.size()=1 2024-08-27T03:58:30.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pTW4x4Un_EIs-bernWf077e4kuP-qY9_0 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16971138959350997443', time=2024-08-27T05:27:09.604353+0000, chain.objs.size()=1 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GiRUcVA-X0NAls3ndg2-qVMv_NBGl6G_0 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13984222895586773692', time=2024-08-27T05:27:09.879695+0000, chain.objs.size()=1 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7spVrUNVPelBASFIa30jfPjq0wbaOGR_0 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11832266793482559856', time=2024-08-27T05:27:10.041020+0000, chain.objs.size()=1 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9Yz9jlCE9Ur2zlzwMklunibmpPeR7es_0 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1525488713036973347', time=2024-08-27T05:27:10.510283+0000, chain.objs.size()=1 2024-08-27T03:58:30.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nGtXKcBwmxMlSjOWqRAx5BG1IZ7WY-r_0 2024-08-27T03:58:30.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7861166160668793631', time=2024-08-27T05:27:11.141044+0000, chain.objs.size()=1 2024-08-27T03:58:30.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qjSm5n0oOJZObw5g_bTXkarJSJIyVRc_0 2024-08-27T03:58:30.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3226040591410502875', time=2024-08-27T05:27:14.115345+0000, chain.objs.size()=1 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QqO9t0w1rx6K1i0Kft5x3XnBdYVWYiq_0 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5593777889087940066', time=2024-08-27T05:27:14.188294+0000, chain.objs.size()=1 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7LIxmm183teGjwXc0H0GfwyhI47O0Xm_0 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8653848139172991331', time=2024-08-27T05:27:14.765297+0000, chain.objs.size()=1 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.o2zDGF2QzJU6Jj1JluPauG4LAcqJnQb_0 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15139158513487993040', time=2024-08-27T05:27:15.229919+0000, chain.objs.size()=1 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2frTjxr1G4jLeZEmaT8loFRYStbAGSy_0 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4777096547187267827', time=2024-08-27T05:27:15.702471+0000, chain.objs.size()=1 2024-08-27T03:58:30.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.IyYMhZhj8rTrCBlKo4UgjLEMXWuqMjV_0 2024-08-27T03:58:30.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18357437170670683529', time=2024-08-27T05:27:16.514711+0000, chain.objs.size()=1 2024-08-27T03:58:30.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JoQq1kzaW62fgdkSvM9stahHLji7Rho_0 2024-08-27T03:58:30.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16972556775657659774', time=2024-08-27T05:27:16.872194+0000, chain.objs.size()=1 2024-08-27T03:58:30.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LN7zdaJKqYIUie8Wm-9kpE6h_Z30EdA_0 2024-08-27T03:58:30.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6802164705220088011', time=2024-08-27T05:27:17.629316+0000, chain.objs.size()=1 2024-08-27T03:58:30.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cIq6eaRNkZ5Lp4XraWeTHZCOluk-EOY_0 2024-08-27T03:58:30.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13846618864124258729', time=2024-08-27T05:27:18.794572+0000, chain.objs.size()=1 2024-08-27T03:58:30.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vBb5d937qlR2jUh0s_tlT58dPWAwVC__0 2024-08-27T03:58:30.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15523218755108807351', time=2024-08-27T05:27:21.968778+0000, chain.objs.size()=1 2024-08-27T03:58:30.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p_TroOrA2YIchgW_vp1Ijy_dB4Mlyxq_0 2024-08-27T03:58:30.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6040606871693207177', time=2024-08-27T05:27:22.754318+0000, chain.objs.size()=1 2024-08-27T03:58:30.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5Uar8PySAF3f7Cs-Me-QJ-jEEwWK15y_0 2024-08-27T03:58:30.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44636 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13160203630537764810', time=2024-08-27T05:27:23.876293+0000, chain.objs.size()=1 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.E9vtn_NhvaTLpXCco2qcGVTaNShaT5t_0 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11059170613968557669', time=2024-08-27T05:27:31.752633+0000, chain.objs.size()=1 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.322__shadow_.ncxpqpmF2JFLD7bm8-luwJ0qmUId0WG_0 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9277747630950900833', time=2024-08-27T05:28:29.069822+0000, chain.objs.size()=1 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.364__shadow_.ZP3C3Kfdoo67aOiI9CRIW5Mvm8qbsX9_0 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9329304420247099650', time=2024-08-27T05:30:04.678750+0000, chain.objs.size()=1 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.426__shadow_.9YuShjqfIVpYXD3dDaQpPl2eHP81klq_0 2024-08-27T03:58:30.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~2rf-haAkv34c6Wvj6rJUODm2GzQ-ACm', time=2024-08-27T05:35:49.733458+0000, chain.objs.size()=1 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.528__multipart_mymultipart.2~2rf-haAkv34c6Wvj6rJUODm2GzQ-ACm.1 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12938832248617478340', time=2024-08-27T05:36:17.063055+0000, chain.objs.size()=1 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.531__shadow_.sgJXp66PFzlpG17S1qt2-B_RS_SZf74_0 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3397526658799777119', time=2024-08-27T05:37:11.398564+0000, chain.objs.size()=1 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.550__shadow_.ghl7jZsTWZbOKKmCgYagvXUZ7rcB9vI_0 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12694262611164772581', time=2024-08-27T05:37:15.418578+0000, chain.objs.size()=1 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.551__shadow_.bQdttDYYfThvJ5D9NXonRZ_u8ShdPaF_0 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12015876022772385449', time=2024-08-27T05:37:42.753069+0000, chain.objs.size()=1 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.559__shadow_.vv4wZlz7yYsXOMLS7dp5Fq4XNivc0sz_0 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6795366008698031016', time=2024-08-27T05:37:50.428388+0000, chain.objs.size()=1 2024-08-27T03:58:30.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:qkAJKU5AlEa8mmeBwGmCv3Pywm1a9Zh_.UStpGnVOucQVuBiunHS-McyK6Lo4aDT_0 2024-08-27T03:58:30.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16379670783191244026', time=2024-08-27T05:38:14.103464+0000, chain.objs.size()=1 2024-08-27T03:58:30.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.564__shadow:vBigF3UMMM9G.5E2lRb9J7DySWcF9x3_.OLotokfQsulZBHwbY_WcHIe3_xLCkgR_0 2024-08-27T03:58:30.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16843045307592701077', time=2024-08-27T05:38:30.297160+0000, chain.objs.size()=1 2024-08-27T03:58:30.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:DnIvTx4yw0Rh-8hZtZjM8.JF6PCjzJT_.DaU_o4SxesO6xYA3JcesXPsW3M90jaN_0 2024-08-27T03:58:30.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16147169067484920291', time=2024-08-27T05:38:56.245626+0000, chain.objs.size()=1 2024-08-27T03:58:30.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:932QFdMW4j6zWXR2yKJxFZ7qgHifRNn_.jsa-f13xbd-Sm_r1iGwcXmilUnS4xvi_0 2024-08-27T03:58:30.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10562911715778358318', time=2024-08-27T05:39:18.889747+0000, chain.objs.size()=1 2024-08-27T03:58:30.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:i758rSVr4f8pRosOEBxVjdLkwRrEI7E_.8ITa-ptWTJjcTbj5gSWyylCu1QAyI5H_0 2024-08-27T03:58:30.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11879654837719139359', time=2024-08-27T05:40:05.385018+0000, chain.objs.size()=1 2024-08-27T03:58:30.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.577__shadow:36Wqzz823qsT2uCARjLdrvvHNBA1bXQ_.XsQrf5NVDAJCnK_quNAExAiGgGKmx16_0 2024-08-27T03:58:30.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14657883402421941714', time=2024-08-27T05:48:08.644684+0000, chain.objs.size()=1 2024-08-27T03:58:30.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.707__shadow:j3gimX09VizbMC3sxcWC0ZNT6hO6IMQ_.Vv5M12P-Kh2ezJ3CArT2FQiRrVtIc2j_0 2024-08-27T03:58:30.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6295271865826078698', time=2024-08-27T05:49:17.595657+0000, chain.objs.size()=1 2024-08-27T03:58:30.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.734__shadow_.VGAdeYPj1BOdvxJMeonqveF-2yRhfnn_0 2024-08-27T03:58:30.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~qQ5nbedNbXUKowigV8tTlE58nxv8r-f', time=2024-08-27T05:49:21.995261+0000, chain.objs.size()=1 2024-08-27T03:58:30.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.736__multipart_mymultipart.2~qQ5nbedNbXUKowigV8tTlE58nxv8r-f.1 2024-08-27T03:58:30.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.099+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.099+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-08-27T03:58:30.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42426' 2024-08-27T03:58:30.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13189817906601501500', time=2024-08-27T05:12:56.551868+0000, chain.objs.size()=1 2024-08-27T03:58:30.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.145__shadow_.hbl_OOooDl8v2Xbr_mXJZ1gXNFF8eu4_0 2024-08-27T03:58:30.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9032144820292670478', time=2024-08-27T05:13:06.282572+0000, chain.objs.size()=1 2024-08-27T03:58:30.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.151__shadow:Ixjb5Y5KXTzRxYSDGlxzEPTo3NBXYIO_.O8o7QcxLMZaFDzYtRLy9UWxPoOGPNEq_0 2024-08-27T03:58:30.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_IziEsAysPjTePctErva-J2NDOuYc1MJ', time=2024-08-27T05:13:32.069638+0000, chain.objs.size()=1 2024-08-27T03:58:30.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.mkyWfvKiD27WwiB3J7cpQZ9xFnJBiT0_0 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2256140518912547619', time=2024-08-27T05:18:00.806440+0000, chain.objs.size()=1 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.228__shadow_.r1sKzH1ehiBD_OhJs-3Hez074EnvSpl_0 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18229475515027747614', time=2024-08-27T05:18:16.501265+0000, chain.objs.size()=1 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.236__shadow_.FY2c8fFEl-0ccsqtUitcr2gapBDfPQe_0 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7775092744766939515', time=2024-08-27T05:18:19.180398+0000, chain.objs.size()=1 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.237__shadow_.nOppldkwauVwzNkRXER-Ave_LMo3aSq_0 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.898342647254037204', time=2024-08-27T05:18:19.192962+0000, chain.objs.size()=1 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.237__shadow_.LKNZ1XlP9RDoi-Kl8CYQhEkV6wc0szM_0 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4764547306164338107', time=2024-08-27T05:18:23.785534+0000, chain.objs.size()=1 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.239__shadow_.o6Ez3U97kLYG-XvJXx14UfJ3AoXmrz8_0 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16247357793410156119', time=2024-08-27T05:20:37.455240+0000, chain.objs.size()=1 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.YgxQM3bgeHZyafS9oETisrAwygUbOB3_0 2024-08-27T03:58:30.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3481946248095150592', time=2024-08-27T05:20:37.865382+0000, chain.objs.size()=1 2024-08-27T03:58:30.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oXXuvHdm1HMuvgxzWUoUjomRceXQGyz_0 2024-08-27T03:58:30.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3503684748784560913', time=2024-08-27T05:20:39.643090+0000, chain.objs.size()=1 2024-08-27T03:58:30.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fu1UhiNdgTxEtmqvaX90CLzAJT7Nyew_0 2024-08-27T03:58:30.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11115036292056454933', time=2024-08-27T05:20:40.697576+0000, chain.objs.size()=1 2024-08-27T03:58:30.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ncMCB5sfBVrgiF90OAzYFEQ_fDUwYIL_0 2024-08-27T03:58:30.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.895002047089159604', time=2024-08-27T05:20:40.753835+0000, chain.objs.size()=1 2024-08-27T03:58:30.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8RKZUcisbu90xgVPX-bwGyLsRUlUTXO_0 2024-08-27T03:58:30.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9550003293072974675', time=2024-08-27T05:20:43.151898+0000, chain.objs.size()=1 2024-08-27T03:58:30.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GkHNhbjBg1szZE9PdaRnliJvlJIddkT_0 2024-08-27T03:58:30.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5549456307993394095', time=2024-08-27T05:20:43.225478+0000, chain.objs.size()=1 2024-08-27T03:58:30.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MvvublTExVDY66hogVgFXhSTZtyk5bt_0 2024-08-27T03:58:30.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7553233579593741819', time=2024-08-27T05:20:44.102894+0000, chain.objs.size()=1 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.w5iBn-na4LgDWD7PfgAppXCJvoCbkG6_0 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6763456022437379277', time=2024-08-27T05:20:45.155900+0000, chain.objs.size()=1 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.k5lbIf0T9iqbqSGRLStitbjVyZteUeF_0 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13653156075967789714', time=2024-08-27T05:20:45.494499+0000, chain.objs.size()=1 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3A6H51YIfiARdywqE6F8FIC0a8AjnIx_0 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13787472625689132032', time=2024-08-27T05:20:45.659136+0000, chain.objs.size()=1 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.j-kyOATSGSeaNL0tRnUCL8P6llId5S0_0 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4217374548101078149', time=2024-08-27T05:20:45.728483+0000, chain.objs.size()=1 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OE3V7uoKG8uj4nQasoFczZsCS7qoHD5_0 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18286536536965361415', time=2024-08-27T05:20:48.633882+0000, chain.objs.size()=1 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.29ZObhI-uowqrRCDIaqvaP_vjKJFvwP_0 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8376416245038708719', time=2024-08-27T05:20:49.104502+0000, chain.objs.size()=1 2024-08-27T03:58:30.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.frq4lGJ6gF2_vW3WzBA2w_Hgq_IZu6y_0 2024-08-27T03:58:30.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12726295543973859023', time=2024-08-27T05:20:49.434461+0000, chain.objs.size()=1 2024-08-27T03:58:30.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.1J652pATzTMinaUwpLF5p_FVUq4ESLU_0 2024-08-27T03:58:30.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4264975626530112511', time=2024-08-27T05:20:50.851757+0000, chain.objs.size()=1 2024-08-27T03:58:30.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.P6V8RuftyDmnWIGS_flNG0GmeZX51mP_0 2024-08-27T03:58:30.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8677201549465656223', time=2024-08-27T05:20:53.595496+0000, chain.objs.size()=1 2024-08-27T03:58:30.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KDxiYSOcZSDxHjQ-duT06b_zfaZI3RT_0 2024-08-27T03:58:30.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15988730227146156002', time=2024-08-27T05:20:54.599028+0000, chain.objs.size()=1 2024-08-27T03:58:30.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8s5tHo5pZn57dxKJ20k6zFSdxaSQtbX_0 2024-08-27T03:58:30.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5901279402397027576', time=2024-08-27T05:20:54.852421+0000, chain.objs.size()=1 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.u7UsD069r7be7xqqL91imHhcHxWQ0Pq_0 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2314616919743809596', time=2024-08-27T05:20:54.996543+0000, chain.objs.size()=1 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pZOE9-qaaTkFqGcoisMXZqkE9x00RcQ_0 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14921693140684403599', time=2024-08-27T05:20:55.554988+0000, chain.objs.size()=1 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dNdZGKyo9-1UQzgXzTDiWkwClBnUTgw_0 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12323268421583456029', time=2024-08-27T05:20:55.662993+0000, chain.objs.size()=1 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gLykunE1RQCqKZmvOROLMZEkcVHyLri_0 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5847158486822293240', time=2024-08-27T05:20:55.923884+0000, chain.objs.size()=1 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oY1-SQZHXsditRBuvjTMgP07GHri2Fk_0 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18220696241115284214', time=2024-08-27T05:20:56.596298+0000, chain.objs.size()=1 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mL8ovHe7ZBPYK1YYsRdRpWtxdQlzizm_0 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17769201551780516829', time=2024-08-27T05:20:56.943155+0000, chain.objs.size()=1 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.W3V5jz19Fp2w4rMlruQOvgckTmbDGYc_0 2024-08-27T03:58:30.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12261135364355613018', time=2024-08-27T05:20:58.075866+0000, chain.objs.size()=1 2024-08-27T03:58:30.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uDksk4affPIT3ypsrgKjw3ra5kWCTnn_0 2024-08-27T03:58:30.121 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13880159788931529425', time=2024-08-27T05:20:58.471027+0000, chain.objs.size()=1 2024-08-27T03:58:30.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fFPuyvlt9BMEIgnMVwpAJP9lapcxxQ5_0 2024-08-27T03:58:30.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2714939971841140067', time=2024-08-27T05:20:58.929592+0000, chain.objs.size()=1 2024-08-27T03:58:30.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HYq4xg5Y0gUxSvKXflCQzR9h5kX0adM_0 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7771186765715265634', time=2024-08-27T05:20:59.124196+0000, chain.objs.size()=1 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-d1vCi5jtCLDg3910CCMi0H40eJLpt1_0 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13321172204935309823', time=2024-08-27T05:20:59.493886+0000, chain.objs.size()=1 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PyzopdGXYf0X0qrea9RG4hGwsMRUiDB_0 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4319833227102795744', time=2024-08-27T05:20:59.495998+0000, chain.objs.size()=1 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vlkpRCt0HzhyAQ37rbaAgHkzLpF-FMW_0 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2616076902240626075', time=2024-08-27T05:21:00.075531+0000, chain.objs.size()=1 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.O_slMBbI7JOmvjWilV_gyv6x_EzbGq9_0 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10985225088763235602', time=2024-08-27T05:21:00.435262+0000, chain.objs.size()=1 2024-08-27T03:58:30.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.c--_3x6K666TKsDD873UDX39Ar3jq42_0 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1459883811154067641', time=2024-08-27T05:21:00.986000+0000, chain.objs.size()=1 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VDz42xyUFUNDOkhnoXi0Z3DXPoStkS8_0 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2718843051767202398', time=2024-08-27T05:21:02.055876+0000, chain.objs.size()=1 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0RLuXxrNJDGO7BwapFVXWULlIewp1X8_0 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7871677868294302480', time=2024-08-27T05:21:02.805418+0000, chain.objs.size()=1 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.d1ApkOi0JfFgkIpXjuY_4lZXU3tOuaT_0 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7373167403926533560', time=2024-08-27T05:21:03.794472+0000, chain.objs.size()=1 2024-08-27T03:58:30.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Z6AZH0cZl9AECrcxmGQXbCnpaQHsoB7_0 2024-08-27T03:58:30.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17200019647840772673', time=2024-08-27T05:21:03.825152+0000, chain.objs.size()=1 2024-08-27T03:58:30.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mKCQnYNu-PTPBUR-ENBKWWZtT4MesA0_0 2024-08-27T03:58:30.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12511207492826883184', time=2024-08-27T05:21:03.963425+0000, chain.objs.size()=1 2024-08-27T03:58:30.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nh1zvLA_LDbR8QD__SVlLzby2QdXw2D_0 2024-08-27T03:58:30.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12483811202476149308', time=2024-08-27T05:21:04.183753+0000, chain.objs.size()=1 2024-08-27T03:58:30.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fZ_BluGn-g3sF2Xr44DV6gICUbKEjKP_0 2024-08-27T03:58:30.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6323713842867459994', time=2024-08-27T05:21:12.887970+0000, chain.objs.size()=1 2024-08-27T03:58:30.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.261__shadow_.DnRJPMtkjfbb5thSr7rsF1nHfT59Zjy_0 2024-08-27T03:58:30.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5366410123257389178', time=2024-08-27T05:21:23.244288+0000, chain.objs.size()=1 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.267__shadow_.qRr5ufAVBfzJKwCTECtk4RfigyLYYlk_0 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2232279995715377242', time=2024-08-27T05:21:34.239582+0000, chain.objs.size()=1 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.273__shadow_.2vDUc4rNM089EWIVzLIltZegDRMXvPR_0 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14267544322598781254', time=2024-08-27T05:21:43.525959+0000, chain.objs.size()=1 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.278__shadow_.7z1QLzNcp7qPq_8P3gvNgnKSbtXUpbt_0 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18050435165966980625', time=2024-08-27T05:21:48.208207+0000, chain.objs.size()=1 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.280__shadow_.eW15Icgfxjejzaxf8FROuq_AMVxhfVP_0 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2034760147555364891', time=2024-08-27T05:22:07.820210+0000, chain.objs.size()=1 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.bsX-dwIcPVBcexArjOXrX2tUe-w8dhT_0 2024-08-27T03:58:30.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17008009738230878927', time=2024-08-27T05:22:11.853426+0000, chain.objs.size()=1 2024-08-27T03:58:30.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.289__shadow_.Tfyn8T9d8TFKJTjQ9UUtYZYyYRGcQmB_0 2024-08-27T03:58:30.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13108524560418271720', time=2024-08-27T05:24:48.144581+0000, chain.objs.size()=1 2024-08-27T03:58:30.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CaraOxrLvImxYQEhYpRObZFFk5rCLAM_0 2024-08-27T03:58:30.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1171529283035060565', time=2024-08-27T05:24:48.750023+0000, chain.objs.size()=1 2024-08-27T03:58:30.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AVUFuVx-62dM0cJQp8PqwOgXhS-2wyx_0 2024-08-27T03:58:30.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2847961606706762050', time=2024-08-27T05:24:50.480809+0000, chain.objs.size()=1 2024-08-27T03:58:30.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.z-zPhGB0tfpxlAgPfU8MR6hwnRJt3vh_0 2024-08-27T03:58:30.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11830888280729188331', time=2024-08-27T05:24:50.888854+0000, chain.objs.size()=1 2024-08-27T03:58:30.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Y4aTEUHZuF47Ak-H3DdO25fSwmzmDfF_0 2024-08-27T03:58:30.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4028477919290610594', time=2024-08-27T05:24:51.119650+0000, chain.objs.size()=1 2024-08-27T03:58:30.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eyZNlCUmDyV1dZUtHDniBkzASSUIfAx_0 2024-08-27T03:58:30.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15652549534633134275', time=2024-08-27T05:24:52.053815+0000, chain.objs.size()=1 2024-08-27T03:58:30.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KjpJGrCbPFSodOMpESxsiyfZVF7zzYr_0 2024-08-27T03:58:30.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5988100885049231489', time=2024-08-27T05:24:52.378856+0000, chain.objs.size()=1 2024-08-27T03:58:30.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.q7_GrlkZjIDEHXd4szSx0qd0dVtpkoF_0 2024-08-27T03:58:30.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16098804434532285902', time=2024-08-27T05:24:52.708080+0000, chain.objs.size()=1 2024-08-27T03:58:30.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VMfyflF2zob3NHA7o0ASKeUKsH8lYAI_0 2024-08-27T03:58:30.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7645853244749367356', time=2024-08-27T05:24:52.709832+0000, chain.objs.size()=1 2024-08-27T03:58:30.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YaqjzWV84x2yc2-3it4QHfeLXjYpQft_0 2024-08-27T03:58:30.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3586758213928411813', time=2024-08-27T05:24:53.203270+0000, chain.objs.size()=1 2024-08-27T03:58:30.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sfvisW1KXlJakq09qyNG7V9nEN4Yqil_0 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16808933555689984839', time=2024-08-27T05:24:54.367672+0000, chain.objs.size()=1 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Sw9J_JjmDF6gDWwI3uYD4EOAGeFI7DB_0 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11273974902995659094', time=2024-08-27T05:24:56.860647+0000, chain.objs.size()=1 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sfbUe8K2R_1h64-SEDAHfAx8zsb7v3G_0 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7007179061523967499', time=2024-08-27T05:24:58.172033+0000, chain.objs.size()=1 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Qo-UKNNpYrmjVQT-Km-5HaBRhePlJhC_0 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13033083092839807182', time=2024-08-27T05:24:59.580791+0000, chain.objs.size()=1 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zmBGqMd8v8XNxxbByJaZXuFKcy6eWuU_0 2024-08-27T03:58:30.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3062309631345084124', time=2024-08-27T05:24:59.582555+0000, chain.objs.size()=1 2024-08-27T03:58:30.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CooygjPzBYUTQEPx3sjNSIO94Mjg4bV_0 2024-08-27T03:58:30.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9305201764226336264', time=2024-08-27T05:25:02.549972+0000, chain.objs.size()=1 2024-08-27T03:58:30.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.s_6_UD3dBnPDvpe3BK0XcKnoHjAcs1p_0 2024-08-27T03:58:30.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13447013165225765636', time=2024-08-27T05:25:02.900895+0000, chain.objs.size()=1 2024-08-27T03:58:30.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6can5-mQ2JngKzEtTyawZISPAYbgHLN_0 2024-08-27T03:58:30.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13097206771317658473', time=2024-08-27T05:25:03.603710+0000, chain.objs.size()=1 2024-08-27T03:58:30.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-QRKUA8ISugns00OlDjtA19RH56w2ei_0 2024-08-27T03:58:30.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15567313955295583068', time=2024-08-27T05:25:04.500442+0000, chain.objs.size()=1 2024-08-27T03:58:30.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.135+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.q8Lu8i6uIY-j-_zjMo_J23UBkYMKFV4_0 2024-08-27T03:58:30.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18228703883754927048', time=2024-08-27T05:25:06.074587+0000, chain.objs.size()=1 2024-08-27T03:58:30.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.EptVAJO6vqoyGk6MSv_PCMo6nBaJF71_0 2024-08-27T03:58:30.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4387659348834386482', time=2024-08-27T05:25:06.796133+0000, chain.objs.size()=1 2024-08-27T03:58:30.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4MGnnzGEneVKfV5NlyIctxGSnU7AHb3_0 2024-08-27T03:58:30.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5107045348005346438', time=2024-08-27T05:25:07.100095+0000, chain.objs.size()=1 2024-08-27T03:58:30.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6P9khNXxl9GKG-gKVworZ99aRzKe8_z_0 2024-08-27T03:58:30.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14942563960995732476', time=2024-08-27T05:25:07.102084+0000, chain.objs.size()=1 2024-08-27T03:58:30.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QjElZBdQiqqrqDnAp24ekdYZckGFauU_0 2024-08-27T03:58:30.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14103976881807872541', time=2024-08-27T05:25:07.800237+0000, chain.objs.size()=1 2024-08-27T03:58:30.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.h3DidWVd7DzrJRd62PFjoJqw_aLND-p_0 2024-08-27T03:58:30.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11182144779266615337', time=2024-08-27T05:25:07.911496+0000, chain.objs.size()=1 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nvnxIMGlvgfty2-XqpJKECzkFGxZfm0_0 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11924007836745312720', time=2024-08-27T05:25:07.999156+0000, chain.objs.size()=1 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zc_udMbKoFH45kfH-K73gVxhulXzoEd_0 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14346455203861795691', time=2024-08-27T05:25:08.864772+0000, chain.objs.size()=1 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vO9Zoo7RnDtPJD9oYgfusl1wMnlGDhu_0 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.930500955434587498', time=2024-08-27T05:25:09.553019+0000, chain.objs.size()=1 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._H62ME-cO4hnvG6pMzj65zp0A6Wbt5R_0 2024-08-27T03:58:30.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6759522752949948672', time=2024-08-27T05:25:10.576814+0000, chain.objs.size()=1 2024-08-27T03:58:30.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FBQmoKtKwlCehXJmXgj3L--R9M_w34b_0 2024-08-27T03:58:30.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6190421126872138562', time=2024-08-27T05:25:12.741323+0000, chain.objs.size()=1 2024-08-27T03:58:30.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2Ki3OKZHa2v_NoQULTjoe6dR4khpLPx_0 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18407655049269364594', time=2024-08-27T05:25:14.374415+0000, chain.objs.size()=1 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rndpWNPFaw3jC-OpLX52tf4hug7LA-__0 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12134921608723985058', time=2024-08-27T05:26:57.679785+0000, chain.objs.size()=1 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.iGBJGQZ7VYF81o7X9yQhp_A4T9MN9G2_0 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1590349699287904905', time=2024-08-27T05:26:58.442630+0000, chain.objs.size()=1 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MA4V9RnppxW72h5UyMxNvUoPQP-HucD_0 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9806291488308349800', time=2024-08-27T05:26:59.245663+0000, chain.objs.size()=1 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vWE0X4LX3xS5AKudTWxBG1TqvtnpCsI_0 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11562821846526054517', time=2024-08-27T05:26:59.408486+0000, chain.objs.size()=1 2024-08-27T03:58:30.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Gj-o_aZeCjNVZyihZs0_wIeAB5FRZGH_0 2024-08-27T03:58:30.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2251152985617660312', time=2024-08-27T05:26:59.700366+0000, chain.objs.size()=1 2024-08-27T03:58:30.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Y-EM_yJuX0ybejYn8ZNaV9emeCwNb7w_0 2024-08-27T03:58:30.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5926453371231344031', time=2024-08-27T05:27:00.179752+0000, chain.objs.size()=1 2024-08-27T03:58:30.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vhvzoLNl8qVj9-8NmZmlXm1QDIi1uLF_0 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4984823445673506923', time=2024-08-27T05:27:02.812589+0000, chain.objs.size()=1 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.iEurXjYeAmtDCHZNVeXUBm3qoBKwx0w_0 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17122704410954432138', time=2024-08-27T05:27:03.075682+0000, chain.objs.size()=1 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dRafBiBFa1yGjdXOur-wRdRYBJdWjd5_0 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17891765780717084521', time=2024-08-27T05:27:03.583201+0000, chain.objs.size()=1 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.o8zX5kvQd-SSen_FBZzy-XV6KGAOKkw_0 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4700989743165921670', time=2024-08-27T05:27:04.093291+0000, chain.objs.size()=1 2024-08-27T03:58:30.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Tso_cVz-Ll5f0zSlb2IhhBdC0hA0xcO_0 2024-08-27T03:58:30.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1743350675486754175', time=2024-08-27T05:27:04.525041+0000, chain.objs.size()=1 2024-08-27T03:58:30.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Q4EKkLd2L9bc6LAq54y93s0m4z3IGCW_0 2024-08-27T03:58:30.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2294536411811741932', time=2024-08-27T05:27:05.562716+0000, chain.objs.size()=1 2024-08-27T03:58:30.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Fcsaa9ibdWGybSebbPXZ4PKfzG38RX6_0 2024-08-27T03:58:30.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17967687025666788307', time=2024-08-27T05:27:05.791178+0000, chain.objs.size()=1 2024-08-27T03:58:30.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.sT-NsrUay51LXPlz0NMMeiyDH1qfDyK_0 2024-08-27T03:58:30.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9349185552089593535', time=2024-08-27T05:27:06.820136+0000, chain.objs.size()=1 2024-08-27T03:58:30.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mFzJkALUeRGTWIDvMW2-bHkHghnqw-T_0 2024-08-27T03:58:30.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42426 2024-08-27T03:58:30.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-08-27T03:58:30.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15889553830787031145', time=2024-08-27T05:27:08.165661+0000, chain.objs.size()=1 2024-08-27T03:58:30.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3BIDTNGxT53KuXu9BZfWQM0YjFztd_s_0 2024-08-27T03:58:30.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.985999629990034356', time=2024-08-27T05:27:09.608112+0000, chain.objs.size()=1 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UFeDKNuXtm-1sw0h6SaSLcSwC_0vrMI_0 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8624988737436040448', time=2024-08-27T05:27:10.183613+0000, chain.objs.size()=1 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.tItl6-tOMK4wVYv4DRMVSRQIeX4CRSX_0 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1484820266438265490', time=2024-08-27T05:27:10.335714+0000, chain.objs.size()=1 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Vm4n7-VcN6gntKVq7oDrUf0o1LP8n48_0 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11528082341585884613', time=2024-08-27T05:27:10.618623+0000, chain.objs.size()=1 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.eTxuZhRutaIe4enEq3koro9b_9kK9r3_0 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7507809660746598288', time=2024-08-27T05:27:12.902874+0000, chain.objs.size()=1 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0MO3VXMaWOqxeOA6ffCfE8UcocY57Cq_0 2024-08-27T03:58:30.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6295179613501618724', time=2024-08-27T05:27:12.907278+0000, chain.objs.size()=1 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xubMEbSsGCzOieSd56Wy4_qBrG0T5ov_0 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11446338722540139352', time=2024-08-27T05:27:13.558630+0000, chain.objs.size()=1 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QZB3dGLLVqdwLfix6eSOJJIYMdOnlNU_0 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1432376915940002453', time=2024-08-27T05:27:14.458055+0000, chain.objs.size()=1 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LxRNytOVVaTDnUzttnTEDsrvfT27ODr_0 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14673935528071515403', time=2024-08-27T05:27:15.519915+0000, chain.objs.size()=1 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lBuf5cWTTsxCDMg21g6BhHNdlwoM8Az_0 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4274652027346868891', time=2024-08-27T05:27:18.431119+0000, chain.objs.size()=1 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.V8mzcXDQ8DK9E7F0MmWh4Z66cQKR_FF_0 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16720714434645374983', time=2024-08-27T05:27:19.087340+0000, chain.objs.size()=1 2024-08-27T03:58:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CrPcnTUEFqJUSxqMVGranoGEZJIUMA5_0 2024-08-27T03:58:30.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.468559694310551207', time=2024-08-27T05:27:20.628974+0000, chain.objs.size()=1 2024-08-27T03:58:30.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cfx3LsbgB7JdkCiGjFU5vYmNmVEdqr-_0 2024-08-27T03:58:30.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1707576730315809212', time=2024-08-27T05:27:20.738424+0000, chain.objs.size()=1 2024-08-27T03:58:30.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.L2Qqcg9CjxEctEwW5BscsSFw3Jhx_lT_0 2024-08-27T03:58:30.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3731771862841903629', time=2024-08-27T05:27:22.399462+0000, chain.objs.size()=1 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Bhta18MbGp0cnmBp0xbQXT-5z5j2CPN_0 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7822350555986047286', time=2024-08-27T05:27:24.262487+0000, chain.objs.size()=1 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MJ6UxzgCyEyop-dAla_YHg4nO8Ezc0m_0 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4622796305296780444', time=2024-08-27T05:27:24.266077+0000, chain.objs.size()=1 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NAdB2FCBLPznJqzM97VGeqdJYAS8e6h_0 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8460702508915958140', time=2024-08-27T05:27:24.532504+0000, chain.objs.size()=1 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.eHZg28S2ow-jdu9OuAKRxzn4DsHvkOi_0 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17664049366040471824', time=2024-08-27T05:27:24.601817+0000, chain.objs.size()=1 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.A3n_qz8JH1-XFqO_98FW4Pgnh4smzU7_0 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9165887856395500551', time=2024-08-27T05:27:28.920032+0000, chain.objs.size()=1 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.320__shadow_.1XvEIyU3m8N2UUrvqf_8CS2lqDqfhxA_0 2024-08-27T03:58:30.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11261446801967171900', time=2024-08-27T05:27:57.300174+0000, chain.objs.size()=1 2024-08-27T03:58:30.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.339__shadow_.FA6DCLefFClXBwHVgk8JMX09L-fSL2N_0 2024-08-27T03:58:30.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2041381617307520349', time=2024-08-27T05:30:07.428899+0000, chain.objs.size()=1 2024-08-27T03:58:30.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.428__shadow_.U-GbSkuqoBGGxNHVXy-7KTW_Ikn861h_0 2024-08-27T03:58:30.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16941684102983389208', time=2024-08-27T05:30:44.631488+0000, chain.objs.size()=1 2024-08-27T03:58:30.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.450__shadow_.CN94LOjvHZv1fbryQZATEQoFReO_x2q_0 2024-08-27T03:58:30.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7807110866265401616', time=2024-08-27T05:31:56.312276+0000, chain.objs.size()=1 2024-08-27T03:58:30.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.491__shadow_.ARuuQFF1O7SUN3G4kBYF2jjBwUJqBWV_0 2024-08-27T03:58:30.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14468714788384083997', time=2024-08-27T05:32:22.949333+0000, chain.objs.size()=6 2024-08-27T03:58:30.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.1 2024-08-27T03:58:30.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.2 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.3 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.4 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.5 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.6 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15379029772139323389', time=2024-08-27T05:32:42.125975+0000, chain.objs.size()=1 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.512__multipart_mymultipart.2~lIJSkt3SXBi38WeGXpyjYIZeIuRlKP0.1 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18392246933235690587', time=2024-08-27T05:33:23.248810+0000, chain.objs.size()=3 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~ZrrFeaPDY6ssrEYZPu1V7z5gQPQ0qSj.1 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~ZrrFeaPDY6ssrEYZPu1V7z5gQPQ0qSj.2 2024-08-27T03:58:30.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~ZrrFeaPDY6ssrEYZPu1V7z5gQPQ0qSj.3 2024-08-27T03:58:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14397621779440664884', time=2024-08-27T05:35:04.780247+0000, chain.objs.size()=2 2024-08-27T03:58:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~wqfd8q27ldq86oreajeiVLBvYpC1KsN.1 2024-08-27T03:58:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~wqfd8q27ldq86oreajeiVLBvYpC1KsN.2 2024-08-27T03:58:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Ytfku1Gmr4m3LFoekOo69XEcnVtWkem', time=2024-08-27T05:35:44.413733+0000, chain.objs.size()=1 2024-08-27T03:58:30.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.525__multipart_mymultipart2.2~Ytfku1Gmr4m3LFoekOo69XEcnVtWkem.1 2024-08-27T03:58:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.837368800033305358', time=2024-08-27T05:37:31.251831+0000, chain.objs.size()=1 2024-08-27T03:58:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.555__multipart_mymultipart.3xLEM53zJUXGP8OkQV49eMtKBtxarr2K.1 2024-08-27T03:58:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3371511466792960180', time=2024-08-27T05:38:54.954392+0000, chain.objs.size()=1 2024-08-27T03:58:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:Tp2iPIAk.nITOY0x-1WvxrstOq-7SzS_.YZzsGrQzY8rkshz5XmdF33GON6Gd2wl_0 2024-08-27T03:58:30.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15533411069286925610', time=2024-08-27T05:38:55.657112+0000, chain.objs.size()=1 2024-08-27T03:58:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:Qr4HjKiMuBBq3a3xfcbJp4l7yy7ym7q_.4RZb0US9umbQhlVSdaRDlsNef-aaO4k_0 2024-08-27T03:58:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5997712847967395151', time=2024-08-27T05:46:48.265813+0000, chain.objs.size()=1 2024-08-27T03:58:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.657__shadow_.laZPap9BZRW387qukn53n3zq-LaW-gI_0 2024-08-27T03:58:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11716481993693984843', time=2024-08-27T05:47:55.177777+0000, chain.objs.size()=1 2024-08-27T03:58:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.699__shadow:ORFKbiPxr.Qg1Ne2DOVMiGPFfvB6a7Z_.UWbNJ5nHmuFsazLJKI3t3DFtDvD3x1T_0 2024-08-27T03:58:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13106655691706429469', time=2024-08-27T05:48:37.574799+0000, chain.objs.size()=1 2024-08-27T03:58:30.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.713__shadow_.Uedm3SmXh9kiTNkiCo6DKKVBH8hemtE_0 2024-08-27T03:58:30.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-08-27T03:58:30.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49979' 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~10hUwzDlfF5FHNTaSdDngMhBiEy7eIR', time=2024-08-27T05:15:04.448037+0000, chain.objs.size()=1 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.195__multipart_mymultipart.2~10hUwzDlfF5FHNTaSdDngMhBiEy7eIR.1 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6927873549135174811', time=2024-08-27T05:15:10.840590+0000, chain.objs.size()=1 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.198__shadow_.d4Lao6HfD54ZLj6cdmwKkQ8rO5NDE5Q_0 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9707860474323991684', time=2024-08-27T05:17:55.188311+0000, chain.objs.size()=1 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.225__shadow_.EirikmLJ5VnH_G0YLRWX_Gq6pJGyQdW_0 2024-08-27T03:58:30.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7402564718019486854', time=2024-08-27T05:18:09.896014+0000, chain.objs.size()=1 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.232__shadow_.ux5Spd_koBICplIsPWcanFLghgh5Wak_0 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2945663965197365036', time=2024-08-27T05:18:14.666358+0000, chain.objs.size()=1 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.235__shadow_.oDNJL80HLPvau_vDyChxYyyzSQGx32Z_0 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10878276473796645748', time=2024-08-27T05:18:23.779378+0000, chain.objs.size()=1 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.239__shadow_.PO3hBpzWdwdkl1Dht-4KOV3HsbeovdS_0 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13130601685421629246', time=2024-08-27T05:18:36.653969+0000, chain.objs.size()=1 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.246__shadow_.oEyAiYPIPY3-3W60Z7Bjn_cjw9-zuVt_0 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18372907113242399406', time=2024-08-27T05:20:35.706656+0000, chain.objs.size()=1 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-_Fl8mfi99tXWE0dQ5TuaFMm6FbpDEt_0 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5876634281319318225', time=2024-08-27T05:20:41.534294+0000, chain.objs.size()=1 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.V_sa8m-qrGU0nIn-Nm8q4uNBf4dasFv_0 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14659831563293010084', time=2024-08-27T05:20:43.536193+0000, chain.objs.size()=1 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LZqZAlkAyOs2oYZTV--jieP6ylgbrdY_0 2024-08-27T03:58:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12702253735230930939', time=2024-08-27T05:20:43.726545+0000, chain.objs.size()=1 2024-08-27T03:58:30.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PhVGtglkt3xTOmks4bd7Egx4vH8MBKV_0 2024-08-27T03:58:30.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9678905285476835189', time=2024-08-27T05:20:43.934253+0000, chain.objs.size()=1 2024-08-27T03:58:30.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MUU2wdAlue3CZ8VJicxjkcoEigryEv-_0 2024-08-27T03:58:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3065443798733899387', time=2024-08-27T05:20:45.467193+0000, chain.objs.size()=1 2024-08-27T03:58:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Q0tsnHik26YojXERVo959N5gn0zSf-C_0 2024-08-27T03:58:30.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6679073024402224471', time=2024-08-27T05:20:45.585213+0000, chain.objs.size()=1 2024-08-27T03:58:30.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.761MnY0zPXvN1uHiZiOn5p_nbgdWiI4_0 2024-08-27T03:58:30.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11567013922030612029', time=2024-08-27T05:20:45.813881+0000, chain.objs.size()=1 2024-08-27T03:58:30.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gGyLfO5EIGkFEe8CsWt8nS3sSZ-Nbdw_0 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6631443974779789784', time=2024-08-27T05:20:45.816304+0000, chain.objs.size()=1 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pO3GJgKiXkyZzO7fcqIk0bGp_l4H9Lc_0 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5551589907676096274', time=2024-08-27T05:20:45.911594+0000, chain.objs.size()=1 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.F3oVUBPf0LPeiDQ2Yn-AVkMMAa6cIQj_0 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6440944535383619860', time=2024-08-27T05:20:47.483408+0000, chain.objs.size()=1 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jFj5U9vVqMf4J7FkPCtfQ92L-kF_u7j_0 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11808825767318913017', time=2024-08-27T05:20:49.730256+0000, chain.objs.size()=1 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oEwkmBYlGcqE9j5eKYy3tbUyAkf0pq0_0 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14005325701782055153', time=2024-08-27T05:20:49.927287+0000, chain.objs.size()=1 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.G9TAuRQCN-YbXicAjnv87S3o2Wl2gTg_0 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2387480940098428656', time=2024-08-27T05:20:50.740801+0000, chain.objs.size()=1 2024-08-27T03:58:30.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.g101yudNRt6Wvd_UO_Syz3dHfiGvgcv_0 2024-08-27T03:58:30.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7158943783989453776', time=2024-08-27T05:20:50.742998+0000, chain.objs.size()=1 2024-08-27T03:58:30.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LnT8okXqTBUCZnFSP_B8I9o8Cl3CQGJ_0 2024-08-27T03:58:30.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10879747500869532513', time=2024-08-27T05:20:50.826270+0000, chain.objs.size()=1 2024-08-27T03:58:30.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.tXSuPyVVsxR4j05JDjNwsj8S-noS0bJ_0 2024-08-27T03:58:30.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.667542439106735265', time=2024-08-27T05:20:50.828192+0000, chain.objs.size()=1 2024-08-27T03:58:30.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.191+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Kgwqh2vg00c1Prtw2DcdwKh1KPNA1ot_0 2024-08-27T03:58:30.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2968702646413623254', time=2024-08-27T05:20:51.313248+0000, chain.objs.size()=1 2024-08-27T03:58:30.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Pr-N5NeZQFSdNANfLyc1wEK9zO7z_dw_0 2024-08-27T03:58:30.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2041359493757853543', time=2024-08-27T05:20:51.468205+0000, chain.objs.size()=1 2024-08-27T03:58:30.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.tYxyoBNlWTXmuZrDTD1j4hsOIYMBoug_0 2024-08-27T03:58:30.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.424638503937998433', time=2024-08-27T05:20:51.871969+0000, chain.objs.size()=1 2024-08-27T03:58:30.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fGSLu30nTsBXquyvmBkTk2sJaY0pgxU_0 2024-08-27T03:58:30.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15996164399117312457', time=2024-08-27T05:20:52.027797+0000, chain.objs.size()=1 2024-08-27T03:58:30.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.T6sS-GqbUJ33v16zoBxBQyQWnGj140v_0 2024-08-27T03:58:30.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7372318396064874145', time=2024-08-27T05:20:52.031036+0000, chain.objs.size()=1 2024-08-27T03:58:30.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CLPuPHnHimXGpUsLkm20cxMgJ-2f9kA_0 2024-08-27T03:58:30.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16001124790153974297', time=2024-08-27T05:20:53.679817+0000, chain.objs.size()=1 2024-08-27T03:58:30.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qj5WycVfi8GjLD8SdoP42c_KHSYwkJj_0 2024-08-27T03:58:30.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10899364629743836843', time=2024-08-27T05:20:54.788809+0000, chain.objs.size()=1 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7Q92q1HnRJmmz1apPYNQBF3AzsTScWC_0 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16826584697291943640', time=2024-08-27T05:20:55.435234+0000, chain.objs.size()=1 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jfyXt2vC48kTQE-qSpeEqxSrSAA4W_F_0 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4397276927466234739', time=2024-08-27T05:20:58.068880+0000, chain.objs.size()=1 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4yb9xAamT3zC5GxZBD5wBeaYkS_5LM4_0 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8940357504837656823', time=2024-08-27T05:20:58.492144+0000, chain.objs.size()=1 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SHtB0xSh0FuwUZsTIZXFS242PUnjjJl_0 2024-08-27T03:58:30.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10697068134980922238', time=2024-08-27T05:20:58.923762+0000, chain.objs.size()=1 2024-08-27T03:58:30.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SpJgt_lDwiGqQzYOHILwV5AN6_IUO80_0 2024-08-27T03:58:30.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7613086536805462638', time=2024-08-27T05:20:59.066806+0000, chain.objs.size()=1 2024-08-27T03:58:30.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.up5DjkN_v7jKpaDmWyFuHEIivosfLjY_0 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4989550150005874209', time=2024-08-27T05:20:59.528983+0000, chain.objs.size()=1 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LnD0ehcWuboFUhvQogINm-sgBjtozSn_0 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8291831607448502672', time=2024-08-27T05:21:01.012970+0000, chain.objs.size()=1 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jHCnwCAODliMWoiswmki-hwS8rhE0Yr_0 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14876624800667283708', time=2024-08-27T05:21:03.273926+0000, chain.objs.size()=1 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3SbVmiuRqgNJo7JBFJ6WdeWxd22orKF_0 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1967267713034179911', time=2024-08-27T05:21:04.049027+0000, chain.objs.size()=1 2024-08-27T03:58:30.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KWKdus89sJk4yDFBiT9Zf6g00-ka5jY_0 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10429203452002863221', time=2024-08-27T05:21:30.529448+0000, chain.objs.size()=1 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.271__shadow_.z8NU7XE86mW_oU3Bu63L-sbBDydeyjw_0 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5455087810811247195', time=2024-08-27T05:21:45.860251+0000, chain.objs.size()=1 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.279__shadow_.AqY_7IK3zSpuOBHc-phHx9IAIwgHm3H_0 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14573662922926069042', time=2024-08-27T05:21:53.910554+0000, chain.objs.size()=1 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.283__shadow_.JhYhhSUC4Zt0xoiZTMWnMBNAvGxyyp1_0 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13750472487824446381', time=2024-08-27T05:22:07.750766+0000, chain.objs.size()=1 2024-08-27T03:58:30.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_._1hlot1Ly0wJA2cCk0EO6PEX9MjYILQ_0 2024-08-27T03:58:30.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5826754296884430345', time=2024-08-27T05:22:09.957510+0000, chain.objs.size()=1 2024-08-27T03:58:30.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.288__shadow_.v-mMbMXefKWdTOab7o2wFai_tluCG0__0 2024-08-27T03:58:30.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1047163507378368525', time=2024-08-27T05:22:17.610862+0000, chain.objs.size()=1 2024-08-27T03:58:30.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.292__shadow_.M3ojiMBCmVCl94ReoCBX_iajsj5VWMX_0 2024-08-27T03:58:30.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12718479555012144174', time=2024-08-27T05:24:46.521456+0000, chain.objs.size()=1 2024-08-27T03:58:30.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Rq32CTKWkFt2p2euGaluv-PH7sCqC4p_0 2024-08-27T03:58:30.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8388465653183685430', time=2024-08-27T05:24:46.822893+0000, chain.objs.size()=1 2024-08-27T03:58:30.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.axAzZlcSfSiTtobGOKFT7E80cedV98a_0 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3726323465212266645', time=2024-08-27T05:24:47.318129+0000, chain.objs.size()=1 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KfW-89JuLeqS0cLbogWajFYSmrMFdIF_0 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6358472153469113625', time=2024-08-27T05:24:47.582132+0000, chain.objs.size()=1 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xjBtmkT_k1Dvg-nHgCae04YiPEVaQpf_0 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8285233358618745503', time=2024-08-27T05:24:48.675953+0000, chain.objs.size()=1 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.n2huH_2vp2RqQ_3Hq6qyOkAsYQniHSn_0 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13614189729638228681', time=2024-08-27T05:24:50.448563+0000, chain.objs.size()=1 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hrP4pXO6vHcPAN4ok8xXHqGzMhH0kW__0 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11767999728546945402', time=2024-08-27T05:24:50.502654+0000, chain.objs.size()=1 2024-08-27T03:58:30.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nJGgqzXbYs3Lw714HC2ax8tj4M7hlv2_0 2024-08-27T03:58:30.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3843118674701547647', time=2024-08-27T05:24:50.796079+0000, chain.objs.size()=1 2024-08-27T03:58:30.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vLSwKOeBZryrpookQfq2IBUAQ05zfb3_0 2024-08-27T03:58:30.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12312966153234626911', time=2024-08-27T05:24:52.024382+0000, chain.objs.size()=1 2024-08-27T03:58:30.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6mVDXJxIKsfOw44mXgdfe8ZtpA5A2W6_0 2024-08-27T03:58:30.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12628299549156298729', time=2024-08-27T05:24:52.471680+0000, chain.objs.size()=1 2024-08-27T03:58:30.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AsQnhDxLW5Nr8dfucv2xVFAcGQS7tlp_0 2024-08-27T03:58:30.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11752511770593929308', time=2024-08-27T05:24:54.253512+0000, chain.objs.size()=1 2024-08-27T03:58:30.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nwYK1WzMZSwbZllPRHz17L0TuBDxPzp_0 2024-08-27T03:58:30.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2856152343087544017', time=2024-08-27T05:24:54.850870+0000, chain.objs.size()=1 2024-08-27T03:58:30.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1rGo-GiRE0opeLzo1ymArvgGBhBLGic_0 2024-08-27T03:58:30.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14638646155640304431', time=2024-08-27T05:24:55.100466+0000, chain.objs.size()=1 2024-08-27T03:58:30.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.z17jT8fUasFMw0CQsiG3OPUKLZhAvOi_0 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16452940146403884095', time=2024-08-27T05:24:56.145246+0000, chain.objs.size()=1 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.h11lJZrRTs6AUNdSavW3xFoOl9_L_Zo_0 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11722634148697124875', time=2024-08-27T05:24:58.806044+0000, chain.objs.size()=1 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yK_HGnHfY6Sbz1KsLhJqgA01If3qoB-_0 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12753811858124911069', time=2024-08-27T05:24:59.495240+0000, chain.objs.size()=1 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GzdjACpuepX6cPXEeNo4hFb9920GOlv_0 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.990024133886727019', time=2024-08-27T05:24:59.497161+0000, chain.objs.size()=1 2024-08-27T03:58:30.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.k-b9Zc25g4niolJrZZzCW26wh7IOMY4_0 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4099370081106645623', time=2024-08-27T05:25:00.281555+0000, chain.objs.size()=1 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eCodSFf5JR5ICn1bouHhHaB_bbQsFd5_0 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16656666388985977899', time=2024-08-27T05:25:00.757953+0000, chain.objs.size()=1 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Hmn4a1x388yaRp58hhLk2bArBlwpo95_0 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4248474310358268459', time=2024-08-27T05:25:05.249578+0000, chain.objs.size()=1 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.h-7AYTGX75CfgBb2TyovmOn2a_Iqsk1_0 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16086192172961045638', time=2024-08-27T05:25:06.768396+0000, chain.objs.size()=1 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QrGoqAhN-XD-s8nr5ExjUT6j27JzQCi_0 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3228911488128766250', time=2024-08-27T05:25:07.458906+0000, chain.objs.size()=1 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.lmKT1cR1odzqzW_vS1jJb0NDG63TGTb_0 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17240823788550621047', time=2024-08-27T05:25:07.614656+0000, chain.objs.size()=1 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QXx8dY96Q4SD-Ucs3EbqQuPpJUO4Sg5_0 2024-08-27T03:58:30.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16956660964418576308', time=2024-08-27T05:25:07.998388+0000, chain.objs.size()=1 2024-08-27T03:58:30.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.j5XKY5UQEUJdy9lRH1qqX3PN9YQL3St_0 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11749053094411627603', time=2024-08-27T05:25:12.248711+0000, chain.objs.size()=1 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dV-5MnnzEkQPRX8tGKVl_nHFOI40Ahw_0 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5500304205952098265', time=2024-08-27T05:25:13.262286+0000, chain.objs.size()=1 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.StyvdXiE7gmMh6XhBrs6rHGbjSNUNef_0 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11778409086300864271', time=2024-08-27T05:25:13.771791+0000, chain.objs.size()=1 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Eg6Yrp-mjQrUc99YO_-CQH3ElJHRQU__0 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4494802007646942122', time=2024-08-27T05:25:14.019496+0000, chain.objs.size()=1 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hgK3L78fkhp1iTYy7md5cgj-hjI2Eov_0 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6609864818624008869', time=2024-08-27T05:25:14.151959+0000, chain.objs.size()=1 2024-08-27T03:58:30.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Kkl3llghpoNL5tFN8nGtANLhW2xJslc_0 2024-08-27T03:58:30.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2294693544419887942', time=2024-08-27T05:25:14.240158+0000, chain.objs.size()=1 2024-08-27T03:58:30.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.A8gUw01-iqxCORNwtwULGkWUWYmnBqd_0 2024-08-27T03:58:30.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8826001273890512312', time=2024-08-27T05:25:14.443893+0000, chain.objs.size()=1 2024-08-27T03:58:30.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SpBCxZh8VjNLpcr3ltqRSmrpmT120VN_0 2024-08-27T03:58:30.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1792411137241219136', time=2024-08-27T05:26:57.857703+0000, chain.objs.size()=1 2024-08-27T03:58:30.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TvwnYf1QnHsqAER1nHR784BU_p6OIt2_0 2024-08-27T03:58:30.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5783557269434668219', time=2024-08-27T05:26:58.775609+0000, chain.objs.size()=1 2024-08-27T03:58:30.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.w9P6O3Q2JKSvIIHYqxWVqbHo83vXqDi_0 2024-08-27T03:58:30.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14507270562692004160', time=2024-08-27T05:26:58.869120+0000, chain.objs.size()=1 2024-08-27T03:58:30.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Jjx20TQof6N9D7MQSo0BqALt-LY7_f__0 2024-08-27T03:58:30.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.496298343478520055', time=2024-08-27T05:27:00.184674+0000, chain.objs.size()=1 2024-08-27T03:58:30.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZOSJwWE7mvJXoGoD0fDgcpLJJ7Jk9yc_0 2024-08-27T03:58:30.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8249979761397581058', time=2024-08-27T05:27:00.520347+0000, chain.objs.size()=1 2024-08-27T03:58:30.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wAh0_EqRuRlwaJs5slZlBYd8fql5t6l_0 2024-08-27T03:58:30.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16125463137934880621', time=2024-08-27T05:27:01.661788+0000, chain.objs.size()=1 2024-08-27T03:58:30.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BcSXGaP20_jaVnRP6UXJCBygx_fwsaA_0 2024-08-27T03:58:30.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2917213728869241502', time=2024-08-27T05:27:01.798753+0000, chain.objs.size()=1 2024-08-27T03:58:30.227 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.piM1EkBAHfv-RxDMoVzrKC8jhg92aQa_0 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15333644437432835715', time=2024-08-27T05:27:02.183648+0000, chain.objs.size()=1 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.02J7Cu3TKr_hIj0L392C_oeFzl_S9si_0 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16709655464446891361', time=2024-08-27T05:27:02.555341+0000, chain.objs.size()=1 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.PJ7qgy8sbBz6xIg37GS0vFycM8Sx-gu_0 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18420936811286864844', time=2024-08-27T05:27:03.528220+0000, chain.objs.size()=1 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.E4W9T57sx_s3l7Q67l0VbJgLmFRIcuX_0 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14294490483969530000', time=2024-08-27T05:27:03.828907+0000, chain.objs.size()=1 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OxgxhLs3khry2AXjIkqEOcjKYlxm6Ae_0 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16202693486275797713', time=2024-08-27T05:27:03.966299+0000, chain.objs.size()=1 2024-08-27T03:58:30.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OY9uesNyRW-5N7sIkDhww1is0NGoctr_0 2024-08-27T03:58:30.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1203188653845313139', time=2024-08-27T05:27:05.525721+0000, chain.objs.size()=1 2024-08-27T03:58:30.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7eHnBY4jKqtehooupAIGckqxyM-rmrC_0 2024-08-27T03:58:30.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3032517628143840348', time=2024-08-27T05:27:07.033897+0000, chain.objs.size()=1 2024-08-27T03:58:30.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nF525Kj0W4lGzCpNaduEykfglGW46NM_0 2024-08-27T03:58:30.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6447551393542693106', time=2024-08-27T05:27:07.134488+0000, chain.objs.size()=1 2024-08-27T03:58:30.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5m7W3VXyQ-gXFrhl_YJU32m6dIxMd7c_0 2024-08-27T03:58:30.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15208078382970369338', time=2024-08-27T05:27:09.179477+0000, chain.objs.size()=1 2024-08-27T03:58:30.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.r8wrBM5jOcy3c3HtHawYK0GCqq_BXim_0 2024-08-27T03:58:30.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14693467961675437060', time=2024-08-27T05:27:09.280020+0000, chain.objs.size()=1 2024-08-27T03:58:30.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zTuN2jby_4LjYBvfcbafzqUU7sv0d73_0 2024-08-27T03:58:30.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5939706421167787671', time=2024-08-27T05:27:09.596428+0000, chain.objs.size()=1 2024-08-27T03:58:30.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1tXBGnLblx-iC8QO0eXUX5hfnTPs3di_0 2024-08-27T03:58:30.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6167213338585208406', time=2024-08-27T05:27:09.768836+0000, chain.objs.size()=1 2024-08-27T03:58:30.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gBVM1j1IC9OCe4Ar2WdWU7PnXnDgsSy_0 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6786978058760631441', time=2024-08-27T05:27:10.054751+0000, chain.objs.size()=1 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6bBPJhSW6MM4obDZ77PnbpvebobEUA1_0 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7849254190405325273', time=2024-08-27T05:27:10.056342+0000, chain.objs.size()=1 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.j1CeSjFoepYlBV5Sh-wE_jfaFdCLQe__0 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2305646810351073998', time=2024-08-27T05:27:10.898814+0000, chain.objs.size()=1 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2B3sEZWcLGc3spCVmV7HSNHoKBoes1x_0 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12063165428018140950', time=2024-08-27T05:27:11.278276+0000, chain.objs.size()=1 2024-08-27T03:58:30.236 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.satLdE1Z3q3JXs34dzlZ2355K5wZVTl_0 2024-08-27T03:58:30.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49979 2024-08-27T03:58:30.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-08-27T03:58:30.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16162560714337620241', time=2024-08-27T05:27:13.253853+0000, chain.objs.size()=1 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fw-yXv1nwFR04gWHhhSZqMCDtw5x9K3_0 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16113183204206259366', time=2024-08-27T05:27:13.729847+0000, chain.objs.size()=1 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9W65sF7mdM7pLw5RNQNGrwSdPPlHVZV_0 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2368991289764525157', time=2024-08-27T05:27:13.873766+0000, chain.objs.size()=1 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._xHmWtnHf1NgMLFiCVGctGdCmPpYrnj_0 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16806640663013664126', time=2024-08-27T05:27:14.608216+0000, chain.objs.size()=1 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.SwRM4GBn2V-7G05C0t24kc-A1g0-LLX_0 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15243358622082153701', time=2024-08-27T05:27:15.008736+0000, chain.objs.size()=1 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ikn_e17HeNnh2P_NQNrUK2_Qxn-Gy5M_0 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11338646973631723436', time=2024-08-27T05:27:15.011090+0000, chain.objs.size()=1 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cQluUC03dta9NSFqDcjGSdRH2nyUlmW_0 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9178295181998494219', time=2024-08-27T05:27:15.559085+0000, chain.objs.size()=1 2024-08-27T03:58:30.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.u_nWWGqi88IGdK3QcLB1C_54w0BLLpb_0 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17950548814548045362', time=2024-08-27T05:27:17.237005+0000, chain.objs.size()=1 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7cHI7xj32nToQAjnHMhptseBQ1KgVU1_0 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16305716128961513062', time=2024-08-27T05:27:17.239045+0000, chain.objs.size()=1 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vU3zgZ92OjWepL1p4nk9k5aPsbNnfcY_0 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6153366418873441728', time=2024-08-27T05:27:17.491670+0000, chain.objs.size()=1 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.L0C67oAOA0kPSjkVEMCU1GfN-hQimFE_0 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11370162345946600548', time=2024-08-27T05:27:17.771523+0000, chain.objs.size()=1 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.z5Ri7NGedGKrzTLmizvPmHTUahp7nNV_0 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3112058455042287770', time=2024-08-27T05:27:20.623198+0000, chain.objs.size()=1 2024-08-27T03:58:30.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.c7mjUc7chjqqrHF-Nd-vG8m4mNCCaXz_0 2024-08-27T03:58:30.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8113506255778609733', time=2024-08-27T05:27:22.049415+0000, chain.objs.size()=1 2024-08-27T03:58:30.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.b_Bcl2OIOE9kmgx4RHFkkajtPlcfvwX_0 2024-08-27T03:58:30.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17711205033548016297', time=2024-08-27T05:27:22.420066+0000, chain.objs.size()=1 2024-08-27T03:58:30.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.md-U8_f2dfR9Gr7la91LPUqDefsy5Cv_0 2024-08-27T03:58:30.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13722269282768449149', time=2024-08-27T05:27:24.497517+0000, chain.objs.size()=1 2024-08-27T03:58:30.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FWWhUoCv2kit8Y5a4jrt4Ij9vdlKxfZ_0 2024-08-27T03:58:30.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3221130318739413149', time=2024-08-27T05:27:25.201104+0000, chain.objs.size()=1 2024-08-27T03:58:30.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.yDxT4MCyA_k1H9W68YcHmOpVqxSeMdW_0 2024-08-27T03:58:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15920314597212679075', time=2024-08-27T05:31:03.941586+0000, chain.objs.size()=1 2024-08-27T03:58:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.459__shadow_.j-SS7YobkVp-7N89mHfrYd2Mj5Qbgoj_0 2024-08-27T03:58:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7377878605453113833', time=2024-08-27T05:31:59.301322+0000, chain.objs.size()=1 2024-08-27T03:58:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.493__shadow_.CjQ6F_uQSToKg5VmEaKJgUNmkts8aYN_0 2024-08-27T03:58:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12340288475079757655', time=2024-08-27T05:32:29.636765+0000, chain.objs.size()=1 2024-08-27T03:58:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.506__shadow_.NZuFmlDtK6IfkbyqP_TPkl6yZxP5JeR_0 2024-08-27T03:58:30.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17039839822442159089', time=2024-08-27T05:33:22.559581+0000, chain.objs.size()=1 2024-08-27T03:58:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.514__shadow:nzmUBTYfuXLcMJ3qTVRs7NvuIedCgZt_.dakEOCaqkDhqR1Mr7Fe00rLmrdqVGfM_0 2024-08-27T03:58:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7064244597507533506', time=2024-08-27T05:35:04.445125+0000, chain.objs.size()=3 2024-08-27T03:58:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~xNbpZfRv3vxSgvWOjA11HTtRXGCTfJI.1 2024-08-27T03:58:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~xNbpZfRv3vxSgvWOjA11HTtRXGCTfJI.2 2024-08-27T03:58:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~xNbpZfRv3vxSgvWOjA11HTtRXGCTfJI.3 2024-08-27T03:58:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.789130867459897516', time=2024-08-27T05:37:11.631839+0000, chain.objs.size()=1 2024-08-27T03:58:30.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.550__shadow_.Xj6HC3oHJIvvlHy1AFsbZDY5aTAAGys_0 2024-08-27T03:58:30.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1321340183818284364', time=2024-08-27T05:37:32.778745+0000, chain.objs.size()=1 2024-08-27T03:58:30.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.556__shadow_.36PQJztUGgDGuXjtn1pPLHzfI4SZF0V_0 2024-08-27T03:58:30.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3333191848814855521', time=2024-08-27T05:37:57.103033+0000, chain.objs.size()=1 2024-08-27T03:58:30.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:TDpHGiAleNrATeFuAfedg6U7q-S8GVe_.DN4Z93Sn1go4ONuUNKdcUDMve8vx90F_0 2024-08-27T03:58:30.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17636386293855945405', time=2024-08-27T05:38:05.379786+0000, chain.objs.size()=1 2024-08-27T03:58:30.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:ossnAHr3Q0EhHkW.K9j6K9HTp6MVp5S_.yikfU0KAe37c9Oh9C9xiMRhGws2nxuN_0 2024-08-27T03:58:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17206692277496219950', time=2024-08-27T05:38:13.822415+0000, chain.objs.size()=1 2024-08-27T03:58:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.564__shadow:IkVDMTL6I0aM0n5tyC2nuZBuN1lSwjC_.bwFAjw5li4TIg48WJlvVE_FVzrfyvJL_0 2024-08-27T03:58:30.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14407328818646384215', time=2024-08-27T05:38:49.666191+0000, chain.objs.size()=1 2024-08-27T03:58:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:.MYuQ-s6CvnvMR6xUWQI0p.wqdWlKVH_.ntHfK5edt64BY4zMYGaSKl0GyUdufUv_0 2024-08-27T03:58:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7804601670900953384', time=2024-08-27T05:40:00.462154+0000, chain.objs.size()=1 2024-08-27T03:58:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:1triO.iW6CVZoeLCPBkNdmABxrH56dp_.bg3xwjMqcWgOWeFRLeLIvU93YXzXHUF_0 2024-08-27T03:58:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18375630669954582451', time=2024-08-27T05:40:10.459095+0000, chain.objs.size()=1 2024-08-27T03:58:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.579__shadow:0V1-wTx9GOnE69vzHs51XYwEJvAuP4f_.NwFG9QFSwK2GB2YHWLaDJPGNSjGeBi0_0 2024-08-27T03:58:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14858798463830851908', time=2024-08-27T05:49:21.756928+0000, chain.objs.size()=1 2024-08-27T03:58:30.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.736__multipart_mymultipart3.2~OT3TvLafdyxKKEghAV-TQj5tCg-ZIa2.1 2024-08-27T03:58:30.260 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.259+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.262 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.259+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-08-27T03:58:30.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46513' 2024-08-27T03:58:30.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_HhOFwa6UPucA7PDbMw5cSwAgwUWhWyW', time=2024-08-27T05:13:27.242755+0000, chain.objs.size()=2 2024-08-27T03:58:30.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.3Htr6oC7to-QAbFY4kUi_LKRx_9pk5u_0 2024-08-27T03:58:30.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.3Htr6oC7to-QAbFY4kUi_LKRx_9pk5u_1 2024-08-27T03:58:30.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7568970422111775154', time=2024-08-27T05:13:51.444629+0000, chain.objs.size()=1 2024-08-27T03:58:30.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.160__shadow_.7SpwdA5PCpgSAsoE-zRTM2XHuDGEAx5_0 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17040381387696432053', time=2024-08-27T05:13:55.570122+0000, chain.objs.size()=1 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.164__shadow_.gZcgjaeDewohHQN8Qrr1g12k2IiywzS_0 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10909912299411931630', time=2024-08-27T05:18:31.108490+0000, chain.objs.size()=1 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.243__shadow_.BzYuGWILv3hOf_kcpbv_wYN-DM_0r_y_0 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4109529319482786776', time=2024-08-27T05:18:49.351589+0000, chain.objs.size()=1 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.253__shadow_.TMsvp17K7deHpATDVYvk1uneAHyQFa3_0 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6980688449424330449', time=2024-08-27T05:20:35.199501+0000, chain.objs.size()=1 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HiIMcyYbeQNu2aAMtZccN-nuBYuCkho_0 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17857713179566845715', time=2024-08-27T05:20:35.933823+0000, chain.objs.size()=1 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kell80_BNwR40AditQtsIJPKTcOHBRu_0 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4814781499323960613', time=2024-08-27T05:20:36.524821+0000, chain.objs.size()=1 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CqbTQeK1SoP0YooNRZU0p1atTzJETJe_0 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9868365197213656897', time=2024-08-27T05:20:37.451225+0000, chain.objs.size()=1 2024-08-27T03:58:30.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hyI9QVosdTGNaHgX0DQ1_Rg17o3siyF_0 2024-08-27T03:58:30.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9592472431686643392', time=2024-08-27T05:20:41.041670+0000, chain.objs.size()=1 2024-08-27T03:58:30.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2tXmM446h8uylm8K2rHRT-f_R_PowEG_0 2024-08-27T03:58:30.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14233688438932538607', time=2024-08-27T05:20:41.368192+0000, chain.objs.size()=1 2024-08-27T03:58:30.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PikOPLF9dd8KZE-L0BtZoSR3pyFX4r7_0 2024-08-27T03:58:30.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1185133739208164472', time=2024-08-27T05:20:42.140373+0000, chain.objs.size()=1 2024-08-27T03:58:30.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xCKLQgzPlo3_3PXGEEE6xnljGf6a_Sm_0 2024-08-27T03:58:30.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1074863851580757212', time=2024-08-27T05:20:43.896669+0000, chain.objs.size()=1 2024-08-27T03:58:30.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vw2cNer10kJ6Uo3r019c_bK6r9kP0Ld_0 2024-08-27T03:58:30.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17388162995769807353', time=2024-08-27T05:20:44.659104+0000, chain.objs.size()=1 2024-08-27T03:58:30.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.M9GUxf1eq3M0-DxnfiYSEyrVWZ3YYjj_0 2024-08-27T03:58:30.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1196112689244768408', time=2024-08-27T05:20:45.818269+0000, chain.objs.size()=1 2024-08-27T03:58:30.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gsKrBZAwtmxGNMhkIUSTXP5OUKm69MW_0 2024-08-27T03:58:30.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.408155072149926965', time=2024-08-27T05:20:47.149866+0000, chain.objs.size()=1 2024-08-27T03:58:30.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ioL62hvgwlq22GSU6-ueyqkVbr0NgRu_0 2024-08-27T03:58:30.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2606507721826487079', time=2024-08-27T05:20:47.731147+0000, chain.objs.size()=1 2024-08-27T03:58:30.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.frTrAfKnD_rlffFDge5isM3mkANfnRL_0 2024-08-27T03:58:30.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12800560658049096097', time=2024-08-27T05:20:48.396763+0000, chain.objs.size()=1 2024-08-27T03:58:30.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-bvqb3FnDmnRNt9sOFFmmQEECxKGcno_0 2024-08-27T03:58:30.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4999155161465071510', time=2024-08-27T05:20:48.943786+0000, chain.objs.size()=1 2024-08-27T03:58:30.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.YYBr6pm06GPWttaG3Imjrk1Vwv0D1W7_0 2024-08-27T03:58:30.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11193414571732087228', time=2024-08-27T05:20:52.449702+0000, chain.objs.size()=1 2024-08-27T03:58:30.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QGXkgLcdy7n1cvMSC2-_XzdDrmQjZxU_0 2024-08-27T03:58:30.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4735967796751428526', time=2024-08-27T05:20:52.787187+0000, chain.objs.size()=1 2024-08-27T03:58:30.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gvtdjNUkdo-SuT3b1YSyk1JuecAbOm__0 2024-08-27T03:58:30.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12473528201501384506', time=2024-08-27T05:20:52.790212+0000, chain.objs.size()=1 2024-08-27T03:58:30.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.tSZzPYEiRg_y6pmGYUk2RZVY1pt-UOF_0 2024-08-27T03:58:30.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8774116763140166171', time=2024-08-27T05:20:53.424491+0000, chain.objs.size()=1 2024-08-27T03:58:30.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sjM1rbhzxtJzs-fbFrrqvU9Mo8q-KwA_0 2024-08-27T03:58:30.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17398729529081881292', time=2024-08-27T05:20:54.363050+0000, chain.objs.size()=1 2024-08-27T03:58:30.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EHWLKfrOzFS3S_jWQriK6YBH87g0cfe_0 2024-08-27T03:58:30.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1059802855372822478', time=2024-08-27T05:20:55.073155+0000, chain.objs.size()=1 2024-08-27T03:58:30.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FQRXUL_5aRMTUldoFg4Itar8bYUhdcb_0 2024-08-27T03:58:30.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15637991337001294949', time=2024-08-27T05:20:56.387742+0000, chain.objs.size()=1 2024-08-27T03:58:30.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9sy5njFSr9kcNyjApKcK5TxpNrcBdSw_0 2024-08-27T03:58:30.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18132825818309246586', time=2024-08-27T05:20:56.786110+0000, chain.objs.size()=1 2024-08-27T03:58:30.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NgyM-KxoiwG7V8ev3GUT-PnjKpi7IHS_0 2024-08-27T03:58:30.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7567070758243436883', time=2024-08-27T05:20:57.359827+0000, chain.objs.size()=1 2024-08-27T03:58:30.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HsE0p27Pqmc03QyOmwq2kOooV7je5HJ_0 2024-08-27T03:58:30.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5058339855190776465', time=2024-08-27T05:21:00.841069+0000, chain.objs.size()=1 2024-08-27T03:58:30.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xIuIlVplUSRcG_X8J4XgLFsOH6x_aHH_0 2024-08-27T03:58:30.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5376844583144103164', time=2024-08-27T05:21:01.719712+0000, chain.objs.size()=1 2024-08-27T03:58:30.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lmv-dyL0X5muAqz-HdtYkpiUbop1aVA_0 2024-08-27T03:58:30.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10161128515845435980', time=2024-08-27T05:21:01.779005+0000, chain.objs.size()=1 2024-08-27T03:58:30.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BmGxgInqWGJ676HrkCreTQI4VbNWyHw_0 2024-08-27T03:58:30.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11102089765597170248', time=2024-08-27T05:21:02.695446+0000, chain.objs.size()=1 2024-08-27T03:58:30.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Y0yyYty0Ad9Zf5vQx74VtyCFejaZVKM_0 2024-08-27T03:58:30.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14060890420566450379', time=2024-08-27T05:21:03.453571+0000, chain.objs.size()=1 2024-08-27T03:58:30.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-3QTYQjJSIN4TGXawwXWUPaVlk5Bm___0 2024-08-27T03:58:30.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12644858227212742864', time=2024-08-27T05:21:03.938397+0000, chain.objs.size()=1 2024-08-27T03:58:30.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hZcxGE7J96NLW9XJdUj7VFkRX_TCSZm_0 2024-08-27T03:58:30.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1820936353547659165', time=2024-08-27T05:21:04.185677+0000, chain.objs.size()=1 2024-08-27T03:58:30.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9tMNf_dw-XdMBXoZK4HIi9L644ryFsA_0 2024-08-27T03:58:30.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6627905587675673625', time=2024-08-27T05:21:28.684236+0000, chain.objs.size()=1 2024-08-27T03:58:30.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.270__shadow_.6I2lBuxWT7chET7j9emZk2HsheMPIPR_0 2024-08-27T03:58:30.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7521017628206032099', time=2024-08-27T05:22:09.991207+0000, chain.objs.size()=1 2024-08-27T03:58:30.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.288__shadow_.KaHohuJFJfpsiK_FSA_BqqR-lrOEdu__0 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8466922748273460084', time=2024-08-27T05:24:47.308353+0000, chain.objs.size()=1 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zUaN2LbDRzhUnq0aSrHnM7AVtrdDZ5Q_0 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6036717829977606107', time=2024-08-27T05:24:47.316283+0000, chain.objs.size()=1 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4qgcwVQ-r1W1wOwLgMyFmQlJRu55uOf_0 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18090119133932969274', time=2024-08-27T05:24:49.157696+0000, chain.objs.size()=1 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BGeiOkSM7ZlUPP3hLdjDzDg-4Ort8jM_0 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12348390128846731470', time=2024-08-27T05:24:52.824893+0000, chain.objs.size()=1 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x1iS2wCShqh8EXkLBSQRb6Co-AclnQL_0 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5307025666892028904', time=2024-08-27T05:24:54.723488+0000, chain.objs.size()=1 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.IGHUmq4boYlP7MaXmhyVfis3-XOxY-d_0 2024-08-27T03:58:30.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14660528221030015514', time=2024-08-27T05:24:54.906296+0000, chain.objs.size()=1 2024-08-27T03:58:30.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-5dSw4I6XBnhWUUyABEhSUWVCnMi2Wa_0 2024-08-27T03:58:30.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12778341875325840073', time=2024-08-27T05:24:55.222107+0000, chain.objs.size()=1 2024-08-27T03:58:30.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Q5UC0XPoycanVh1zZufhTpYayjl7GT9_0 2024-08-27T03:58:30.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6548053435489037534', time=2024-08-27T05:24:59.140402+0000, chain.objs.size()=1 2024-08-27T03:58:30.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Yi2w9MlXwUrc82-LCAfpXYqutCMtdsI_0 2024-08-27T03:58:30.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9905232965297903275', time=2024-08-27T05:25:00.684540+0000, chain.objs.size()=1 2024-08-27T03:58:30.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qDqo2eTio3vygWWSYlwV5Y_J1QpBgfP_0 2024-08-27T03:58:30.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11806504235576567902', time=2024-08-27T05:25:02.222930+0000, chain.objs.size()=1 2024-08-27T03:58:30.286 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jp2Li41J3wkU70m0oFyB2n85ve4H7L2_0 2024-08-27T03:58:30.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7216973790344018390', time=2024-08-27T05:25:04.023867+0000, chain.objs.size()=1 2024-08-27T03:58:30.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZgQ1g4y8uKt4_BDoCvFx9j-YoLJTf_z_0 2024-08-27T03:58:30.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14410655973310925582', time=2024-08-27T05:25:05.258450+0000, chain.objs.size()=1 2024-08-27T03:58:30.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zc-o0x4zlv_DqGGONpCk_zYjPA95twS_0 2024-08-27T03:58:30.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3098573240979353947', time=2024-08-27T05:25:05.260442+0000, chain.objs.size()=1 2024-08-27T03:58:30.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nadv_JYKORN9RzuznYVBwK4BwTHz2hk_0 2024-08-27T03:58:30.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6653229531499143047', time=2024-08-27T05:25:05.941184+0000, chain.objs.size()=1 2024-08-27T03:58:30.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.283+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.N9DOHjC2WGl4opuzK7TydFPSgXIMitT_0 2024-08-27T03:58:30.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14767205035454270970', time=2024-08-27T05:25:06.796605+0000, chain.objs.size()=1 2024-08-27T03:58:30.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jFyUZ5y8fiY4Adhhd9mg3y6LUHjKKbs_0 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13364668959023297159', time=2024-08-27T05:25:08.865921+0000, chain.objs.size()=1 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.WBvpa9xQ3-V1bhn-y6aDA4Yv3M0J1D5_0 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5679535635308172288', time=2024-08-27T05:25:09.294167+0000, chain.objs.size()=1 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.McJbPLdEuBfxpAnIPOgVL-bxHKeFtzv_0 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2628843085906835114', time=2024-08-27T05:25:09.552732+0000, chain.objs.size()=1 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Fr-2LBTHopfyk_7Nd0QOFlH6b9j6Rzs_0 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5803982129064408045', time=2024-08-27T05:25:10.851514+0000, chain.objs.size()=1 2024-08-27T03:58:30.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-bGZTqHliDXOYCmVJRT7phKBJtygKQz_0 2024-08-27T03:58:30.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2334383826037208411', time=2024-08-27T05:25:11.187327+0000, chain.objs.size()=1 2024-08-27T03:58:30.291 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Nh4NYDRCdnG3YVs3T8nzC8m4y5K7YLq_0 2024-08-27T03:58:30.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6015703779976047136', time=2024-08-27T05:25:11.434188+0000, chain.objs.size()=1 2024-08-27T03:58:30.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.zXzDwV2_dh5RTo-vv2BqcreV-xbjiOL_0 2024-08-27T03:58:30.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13260224690365132663', time=2024-08-27T05:25:12.307262+0000, chain.objs.size()=1 2024-08-27T03:58:30.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9vRhlyaf3CkfFyEg4eyN_tqOjOVnBQa_0 2024-08-27T03:58:30.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8840318311516463838', time=2024-08-27T05:25:12.309001+0000, chain.objs.size()=1 2024-08-27T03:58:30.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FKmSqDFyr2nKGSwRboxOR0Ol_KswzZT_0 2024-08-27T03:58:30.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10963126495197849435', time=2024-08-27T05:25:13.382082+0000, chain.objs.size()=1 2024-08-27T03:58:30.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Hvk5jwkgRU0EYyuUqcDe5A6_GRYmIJo_0 2024-08-27T03:58:30.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12116943312607998525', time=2024-08-27T05:25:14.254782+0000, chain.objs.size()=1 2024-08-27T03:58:30.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.oFG_v6V33g7boqEq0R3Q2rrDaYEM_td_0 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10250117197972412904', time=2024-08-27T05:25:14.478296+0000, chain.objs.size()=1 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Yt2cHzXTzbNjS4t5Jh3LjkKYUfwa6wO_0 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15524940698282139895', time=2024-08-27T05:26:57.681263+0000, chain.objs.size()=1 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.B7aTEpjwYO__yZw2RXJSelXTHDWDZdE_0 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15755847211996883046', time=2024-08-27T05:26:58.223902+0000, chain.objs.size()=1 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mkD4FT4UL15K3GMw2-PhzPqfRQ32X4T_0 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6274344611350345434', time=2024-08-27T05:26:58.503283+0000, chain.objs.size()=1 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._9TA67ti4iHjByQd3dQiCRvhyDjwP7r_0 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12378555994696855728', time=2024-08-27T05:26:58.505326+0000, chain.objs.size()=1 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.R2QK4ypyJPSQmnQjL7jJ6jK3qsXkxZm_0 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14606478862317875591', time=2024-08-27T05:26:58.537230+0000, chain.objs.size()=1 2024-08-27T03:58:30.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1FyEzNX_n_sEOLhd4t3SpyE3nBaba73_0 2024-08-27T03:58:30.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7507441600643941812', time=2024-08-27T05:26:59.883919+0000, chain.objs.size()=1 2024-08-27T03:58:30.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.PMvwU_bwC9D27Js943GQt5iYhULBp7z_0 2024-08-27T03:58:30.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17330095715249863212', time=2024-08-27T05:27:00.379275+0000, chain.objs.size()=1 2024-08-27T03:58:30.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6Yuo3ET3lRNaWRHcZ304KcujO9G3B_T_0 2024-08-27T03:58:30.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13232930779950995109', time=2024-08-27T05:27:02.178795+0000, chain.objs.size()=1 2024-08-27T03:58:30.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.odbdxTSvTErrsbD9yUNBQ-xJ28f1TGx_0 2024-08-27T03:58:30.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2896176189507727617', time=2024-08-27T05:27:02.264291+0000, chain.objs.size()=1 2024-08-27T03:58:30.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QDRJXAepi0N5F5A83mlbrJfsghR7gCC_0 2024-08-27T03:58:30.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11283251632503090838', time=2024-08-27T05:27:02.601890+0000, chain.objs.size()=1 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0DC-ElxhgjMJdIQQ9FXBhTlWPYYIi17_0 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15317083528123420913', time=2024-08-27T05:27:02.812517+0000, chain.objs.size()=1 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JYyS16-FjHgL4mi-fhNyXxqtbKilGtG_0 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3680527652974158033', time=2024-08-27T05:27:03.678856+0000, chain.objs.size()=1 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fR4CGCKPhQGPUnPIBKsMYOMWleCuiIy_0 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5578678244314352691', time=2024-08-27T05:27:04.094928+0000, chain.objs.size()=1 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dzoBIMV1vA3SsgxO1O-dYxDgrEWeZKO_0 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2060311601871826039', time=2024-08-27T05:27:04.475801+0000, chain.objs.size()=1 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.b7G-YCeZwEwLBut371LT_DGHsab_Nn-_0 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13744140228400814598', time=2024-08-27T05:27:06.490783+0000, chain.objs.size()=1 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.H9-AZeowY7-Ucm036sC36wpSX5kCbv-_0 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10518917604880423476', time=2024-08-27T05:27:06.610722+0000, chain.objs.size()=1 2024-08-27T03:58:30.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.446J6ymmBjT1rX7V0KgbS9SWH9t5dST_0 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.58951584699032258', time=2024-08-27T05:27:07.499209+0000, chain.objs.size()=1 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Lkjg-8zmL2jE4zfwRti-EzFhfiiiNe1_0 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5940997393212693104', time=2024-08-27T05:27:08.197889+0000, chain.objs.size()=1 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TCFbGjMtpEsl7YObyW0a0Y2AkyIJ3Jh_0 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18354297922295796468', time=2024-08-27T05:27:09.604187+0000, chain.objs.size()=1 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.U9sIqsr8XiATpDpOcTdaWWNx9IO8Kz-_0 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17855654920642536135', time=2024-08-27T05:27:13.256845+0000, chain.objs.size()=1 2024-08-27T03:58:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hIN_4K02FQ7i6scbS3muNbgDnH44D-r_0 2024-08-27T03:58:30.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1192233944793839473', time=2024-08-27T05:27:13.258406+0000, chain.objs.size()=1 2024-08-27T03:58:30.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NHnkAAExXgQAI-J0tGcn7EVDsn8eRms_0 2024-08-27T03:58:30.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7303585672656991791', time=2024-08-27T05:27:13.310177+0000, chain.objs.size()=1 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lxiVfyqrm-mS30nOG6n3aMaUAS3IMfv_0 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13891590676143499917', time=2024-08-27T05:27:14.115423+0000, chain.objs.size()=1 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.oKl8KTkC43uhFTMKcBAiZua3I7IuuAP_0 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2195752136150348963', time=2024-08-27T05:27:14.325101+0000, chain.objs.size()=1 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qEUVkINfFFlIE1ZW_leObzx4-vs0LAf_0 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13378425829746051835', time=2024-08-27T05:27:15.702242+0000, chain.objs.size()=1 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.P9SvJKUJX683zQ0YNuA22mii6-LUxz2_0 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7540233006990556483', time=2024-08-27T05:27:17.752175+0000, chain.objs.size()=1 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3A6PgLMo3CzC-Z-FBmOLQtozWUPIDm__0 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2294031431375186276', time=2024-08-27T05:27:17.754240+0000, chain.objs.size()=1 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.w-5qAHT7Yw2T-yvVvM-ac3ABHHLv3ER_0 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8843667293375626303', time=2024-08-27T05:27:18.215600+0000, chain.objs.size()=1 2024-08-27T03:58:30.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GfKWE8miyDC1N2M_NQNF8trKS2ejLDv_0 2024-08-27T03:58:30.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4209365277656091941', time=2024-08-27T05:27:19.278933+0000, chain.objs.size()=1 2024-08-27T03:58:30.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.f79Unp4gT2rru1o593lI-hW7KBSa2h-_0 2024-08-27T03:58:30.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12764693169905918907', time=2024-08-27T05:27:19.980045+0000, chain.objs.size()=1 2024-08-27T03:58:30.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fxNyCT1qsy1j-fE1t57Rfm3RN4hCKI7_0 2024-08-27T03:58:30.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16670622068858186762', time=2024-08-27T05:27:20.079669+0000, chain.objs.size()=1 2024-08-27T03:58:30.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9ZAwQurBTOmIjSdLsSxYQD59LEygi_4_0 2024-08-27T03:58:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.123797413891783348', time=2024-08-27T05:27:21.060627+0000, chain.objs.size()=1 2024-08-27T03:58:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KL9-iCjsPBD-h21idtARCjE-cM5OUPA_0 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3069460872279024670', time=2024-08-27T05:27:21.513064+0000, chain.objs.size()=1 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UvQyjimOsPIvnlRpmJKlM2UO_vYZkjC_0 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3543512313663357119', time=2024-08-27T05:27:21.814733+0000, chain.objs.size()=1 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.e9MQR_nvipheuM-JYj7LRAqffiNi6Jk_0 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2687640439270816559', time=2024-08-27T05:27:22.083719+0000, chain.objs.size()=1 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.j5gy35QDYEAJzzmUrKfiary-PHMlaOX_0 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16268674069740484398', time=2024-08-27T05:27:22.189502+0000, chain.objs.size()=1 2024-08-27T03:58:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wjCKnSYgoi6Cei-8qUh043FAsly15S-_0 2024-08-27T03:58:30.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.313014969464964935', time=2024-08-27T05:27:24.160967+0000, chain.objs.size()=1 2024-08-27T03:58:30.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RhjPfQRaCskhdvx83KcIpUzLb-TjhIA_0 2024-08-27T03:58:30.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46513 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1275277579008880944', time=2024-08-27T05:27:25.978778+0000, chain.objs.size()=1 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.37JQeS7Yk12Eioe0F2TvYZMouwF7ODh_0 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9579106891381453900', time=2024-08-27T05:29:01.751011+0000, chain.objs.size()=1 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.384__shadow_.vDUY33-VE6HN_0FnZyOrgemRDZ9UTxW_0 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13988155361909034875', time=2024-08-27T05:30:44.621061+0000, chain.objs.size()=1 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.450__shadow_.YRcjptno14rKHu0_YxBxWdaS1R5ciVV_0 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.185545340535852180', time=2024-08-27T05:31:30.646538+0000, chain.objs.size()=1 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.478__shadow_.AINTTZZL8_PR5V5JBPXc5ZAMjkDFrWE_0 2024-08-27T03:58:30.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14561241434557587839', time=2024-08-27T05:31:37.615674+0000, chain.objs.size()=1 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.480__shadow_.ODPi7Yx3dhfo2r1sT_7b8x_85hW6XCM_0 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.965063186359862705', time=2024-08-27T05:32:06.736965+0000, chain.objs.size()=1 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.497__shadow:nGBnVWVmI3DA67.4KlPAhM9ux0Gc029_.rEh1fYZ9-qfRs1r-giIeLw9ZBIE8vlQ_0 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7687396829995246732', time=2024-08-27T05:37:39.744464+0000, chain.objs.size()=2 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.557__shadow_.GI4irumLAzT4-r6uKCH8FtAqpwR3Gn3_0 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.557__shadow_.GI4irumLAzT4-r6uKCH8FtAqpwR3Gn3_1 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6981035857015130424', time=2024-08-27T05:38:30.840646+0000, chain.objs.size()=1 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:uzksOHu6r18fR-YnroIQ3NFlCoUnpsE_.PvuzGiRHxRBbBQM5W0M4r0VFxQ6aoVh_0 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17072112555889346582', time=2024-08-27T05:39:14.526711+0000, chain.objs.size()=1 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:74iwr4T3vYMi9ryyqLoDJCQW5Z6zA.7_.F6e9d483nOwXRgIE2FMEHt0N_tuJ_x-_0 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11467305198964146208', time=2024-08-27T05:39:24.731056+0000, chain.objs.size()=1 2024-08-27T03:58:30.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:d4.Gdb3Wgsks5EaGYy1e.Nnmr49Cgh3_.8KxMKMJ7WT6T-TTtIY5s_CHCWO89xei_0 2024-08-27T03:58:30.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16951092330386076307', time=2024-08-27T05:40:02.921662+0000, chain.objs.size()=1 2024-08-27T03:58:30.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.576__shadow:vRlqnCzieTaRK-WY9qj.jgVhK3hw35F_.9s2baZ8ZrJCbez7soQ34hM1MgWK_mhj_0 2024-08-27T03:58:30.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3308901552794510807', time=2024-08-27T05:46:48.237987+0000, chain.objs.size()=1 2024-08-27T03:58:30.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.657__shadow_.uEVMK60WrksU1uH133gPFVcjDP82nKu_0 2024-08-27T03:58:30.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6569023955656414195', time=2024-08-27T05:46:53.320937+0000, chain.objs.size()=1 2024-08-27T03:58:30.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.659__shadow_.dEO-a1XG_zCCpTueXkqayxTh56fGOX7_0 2024-08-27T03:58:30.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.323+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4311770000708911105', time=2024-08-27T05:48:23.422454+0000, chain.objs.size()=1 2024-08-27T03:58:30.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.323+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.710__shadow:zM.shIBFFTzvC76DFFEFoQMbwqGHbov_.O-gC4proxHdgvgCI2mK6DPPH0foBYfY_0 2024-08-27T03:58:30.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.332 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-08-27T03:58:30.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42201' 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_x6GA-o4p1kOhmJEXOqkGc-R-XCsemkG', time=2024-08-27T05:13:44.730270+0000, chain.objs.size()=1 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.157__shadow_.CLzkNeSUC610hYOrEoGgKj8Z2zhUjzj_0 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_JMbWjyBNw4rlvZIuVvjfM7rrnKBH4Ch', time=2024-08-27T05:13:44.798262+0000, chain.objs.size()=1 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.157__shadow_.62jIHV1m81dK-3S-vq06d3CW7syEbop_0 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8243729064041154215', time=2024-08-27T05:18:38.525791+0000, chain.objs.size()=1 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.247__shadow_.nSwG6z-RRsBUE9dnIKoEKmwYQq7PmFp_0 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8003052930809990860', time=2024-08-27T05:20:36.162070+0000, chain.objs.size()=1 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.d0xWTa3v2XZL2HgO5xW16UmFsI0vDoI_0 2024-08-27T03:58:30.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6991958710044901094', time=2024-08-27T05:20:37.574513+0000, chain.objs.size()=1 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GaoL36ZCRhvUe0EaeYGCMgBXgl-jZ0g_0 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18368627370326865881', time=2024-08-27T05:20:37.724529+0000, chain.objs.size()=1 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.l8VYolivaw3gS_WJQRZVVyWj8PAIlA__0 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16071222842809947209', time=2024-08-27T05:20:38.181190+0000, chain.objs.size()=1 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.msRU8D-LdzSC4ZBghxCUq-LPC1QyDlZ_0 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10471404717852509271', time=2024-08-27T05:20:39.259157+0000, chain.objs.size()=1 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mZGlRkfku4WyQKT3S2sirikQBzsdzR4_0 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15684680953960495750', time=2024-08-27T05:20:39.261514+0000, chain.objs.size()=1 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kYMSCl1gZbNfeb_WGjO-MSX1gq6G7Rx_0 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4969532645442096659', time=2024-08-27T05:20:39.792517+0000, chain.objs.size()=1 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.1iluO59usBIELxc6cv1vB3URe6Svzbp_0 2024-08-27T03:58:30.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17931364473587568187', time=2024-08-27T05:20:40.093210+0000, chain.objs.size()=1 2024-08-27T03:58:30.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dBU4q9Y73ASv87SDDdFAcsHH3iugjh2_0 2024-08-27T03:58:30.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14060138114650206360', time=2024-08-27T05:20:40.101547+0000, chain.objs.size()=1 2024-08-27T03:58:30.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.331+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.wEw09r4jYqcCQmMJTgpKAd1hvn-gmtf_0 2024-08-27T03:58:30.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15979418265746292340', time=2024-08-27T05:20:40.826599+0000, chain.objs.size()=1 2024-08-27T03:58:30.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jr_o8QY-of595G4E2qpW164KUhezUZr_0 2024-08-27T03:58:30.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13495288711269607773', time=2024-08-27T05:20:43.423059+0000, chain.objs.size()=1 2024-08-27T03:58:30.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Q9wpWUnMyz0qtY1cyZYf9CLXYxWjOta_0 2024-08-27T03:58:30.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8216346655133348531', time=2024-08-27T05:20:43.949327+0000, chain.objs.size()=1 2024-08-27T03:58:30.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.x3WkfK5ZzkLfqFZu83zWUUZ2QswnBge_0 2024-08-27T03:58:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14171532856572460885', time=2024-08-27T05:20:44.349222+0000, chain.objs.size()=1 2024-08-27T03:58:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qN5ztJUVtHNuIjFjEZl_Dr29YNXmUrU_0 2024-08-27T03:58:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2344400163290705585', time=2024-08-27T05:20:44.931166+0000, chain.objs.size()=1 2024-08-27T03:58:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VAz9CHdNivdQsQCiVtW8f2h12z2ANKa_0 2024-08-27T03:58:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6808209231795507783', time=2024-08-27T05:20:47.556119+0000, chain.objs.size()=1 2024-08-27T03:58:30.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZPYcBnXPtdU8xhZQalTryQLZcTlPid9_0 2024-08-27T03:58:30.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12279265782961222324', time=2024-08-27T05:20:48.911811+0000, chain.objs.size()=1 2024-08-27T03:58:30.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZWt6pBgIkLoOToGFFYPX8vlYo7am5cR_0 2024-08-27T03:58:30.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16174418264792109126', time=2024-08-27T05:20:49.118836+0000, chain.objs.size()=1 2024-08-27T03:58:30.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3pBoYx7UN1TH19TeLNPQAXhHtcVwedy_0 2024-08-27T03:58:30.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7615990122775621579', time=2024-08-27T05:20:49.270600+0000, chain.objs.size()=1 2024-08-27T03:58:30.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CDlPub35ukqw3l2qkedSSf-xJRoB3qM_0 2024-08-27T03:58:30.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.942586499569686840', time=2024-08-27T05:20:52.346448+0000, chain.objs.size()=1 2024-08-27T03:58:30.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QgyyJUQmnAvw_K9khvTBFWSJyW-Sgss_0 2024-08-27T03:58:30.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8855050695057563253', time=2024-08-27T05:20:53.340419+0000, chain.objs.size()=1 2024-08-27T03:58:30.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0sJoeg40wZ7Dh8g0phsx9hKvBzwPrLm_0 2024-08-27T03:58:30.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5566128281731253957', time=2024-08-27T05:20:54.457867+0000, chain.objs.size()=1 2024-08-27T03:58:30.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rOm5VDllPFIdP4le4qm4_ycmex6jou1_0 2024-08-27T03:58:30.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9815672077380189983', time=2024-08-27T05:20:55.222775+0000, chain.objs.size()=1 2024-08-27T03:58:30.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RsuhpVZia9Eg4NFMmZ0dPfPllnOws3y_0 2024-08-27T03:58:30.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10130704408770820760', time=2024-08-27T05:20:55.977776+0000, chain.objs.size()=1 2024-08-27T03:58:30.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sWZInqXDeUJ_QiNE3zrYRyt16SmQ4lj_0 2024-08-27T03:58:30.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18108673705353050610', time=2024-08-27T05:20:56.518729+0000, chain.objs.size()=1 2024-08-27T03:58:30.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hZO7bgWGLmIpGlWYWug7tYs-NaBJILb_0 2024-08-27T03:58:30.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8310557596649760180', time=2024-08-27T05:20:56.870800+0000, chain.objs.size()=1 2024-08-27T03:58:30.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7G5QT8Rqps6bELvJi2szaVKGRmoaXCw_0 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4394337830428568184', time=2024-08-27T05:20:57.168357+0000, chain.objs.size()=1 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.n7n499idfTUsV2YzbWFOYKdKzI4Fhl1_0 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3359683800954775243', time=2024-08-27T05:20:58.480453+0000, chain.objs.size()=1 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6HvCOIao5OE5LwIEf17mVGWgq1MBiON_0 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7595660710951032597', time=2024-08-27T05:20:59.620539+0000, chain.objs.size()=1 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uJOA6B3MeeMlKXfqPJUEC6fSa-UZt9y_0 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1278938972791461296', time=2024-08-27T05:21:00.025633+0000, chain.objs.size()=1 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JYsAGbmXPAz34xmrY7AmwCLliTdjIGB_0 2024-08-27T03:58:30.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11805386590440724552', time=2024-08-27T05:21:00.476423+0000, chain.objs.size()=1 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JVy-TFXKHZDkMfpNgrnbSzOELGyiftl_0 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.156476246117151306', time=2024-08-27T05:21:01.594820+0000, chain.objs.size()=1 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jiIJvFTBPnfnfHUqq7efjayz1BCzZ5X_0 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5789005630556797502', time=2024-08-27T05:21:01.691761+0000, chain.objs.size()=1 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sjp1GUxWVmCfPc-LY4NIqtPc4NJFhwA_0 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4186548439679146788', time=2024-08-27T05:21:02.817764+0000, chain.objs.size()=1 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ilesNgdBs_aeQDjdGBsZYQ_0nKuPEAy_0 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3017580748872104008', time=2024-08-27T05:21:02.890531+0000, chain.objs.size()=1 2024-08-27T03:58:30.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Hf-C9oXAvbw-mJmaeU0sBeywEaMAQp4_0 2024-08-27T03:58:30.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7670186868738868604', time=2024-08-27T05:21:03.393741+0000, chain.objs.size()=1 2024-08-27T03:58:30.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.perq0tBaADqaLPWxzv52dFA6t456qoD_0 2024-08-27T03:58:30.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3319542522767286632', time=2024-08-27T05:21:03.835092+0000, chain.objs.size()=1 2024-08-27T03:58:30.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gaXGofyy8w8hs55-T5W5HUsWC8gsd91_0 2024-08-27T03:58:30.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.345395415092373549', time=2024-08-27T05:21:03.837045+0000, chain.objs.size()=1 2024-08-27T03:58:30.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kZ_7LRMejLjg1IudoajI_9fIjpshjnk_0 2024-08-27T03:58:30.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15916682929131385955', time=2024-08-27T05:21:09.458706+0000, chain.objs.size()=1 2024-08-27T03:58:30.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.259__shadow_.CTDeKz3vGplOwt_EpsR4q_YMA1WCQwd_0 2024-08-27T03:58:30.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1816845180499403117', time=2024-08-27T05:21:11.213793+0000, chain.objs.size()=1 2024-08-27T03:58:30.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.260__shadow_.Snp07OG_YV-DNi70ERPsuor1s7RF7Om_0 2024-08-27T03:58:30.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18430777747145845531', time=2024-08-27T05:21:30.546608+0000, chain.objs.size()=1 2024-08-27T03:58:30.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.271__shadow_.9HmdFtUDDgLnD4HTyrs27x_i8EGkF5h_0 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15848976968640142379', time=2024-08-27T05:21:36.090033+0000, chain.objs.size()=1 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.274__shadow_.vbVSAZOPTFWwtGhSP5HBuy5t-UDogVQ_0 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16599296889345776107', time=2024-08-27T05:22:07.842130+0000, chain.objs.size()=1 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.Z_1r50IHuwMNZ-1Xu6GaGfXd6z9h0xA_0 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4153654672723423066', time=2024-08-27T05:22:17.593194+0000, chain.objs.size()=1 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.292__shadow_.NuqYcA7sjy-4Rna4394VlZuqmRL7MTY_0 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17427618465392562284', time=2024-08-27T05:22:19.585007+0000, chain.objs.size()=1 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.293__shadow_.Sgn8UDyceLZ71UyMf-8wjQxR4lBwNzN_0 2024-08-27T03:58:30.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6031196617050109252', time=2024-08-27T05:24:46.814325+0000, chain.objs.size()=1 2024-08-27T03:58:30.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8X54-hVPsPLBSfT5r0tMTukGV9J7ZhG_0 2024-08-27T03:58:30.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16265078245589252301', time=2024-08-27T05:24:47.748131+0000, chain.objs.size()=1 2024-08-27T03:58:30.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rp88ggWCkWOqjN96c-m4kKhe58-b6BM_0 2024-08-27T03:58:30.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1236865571266287319', time=2024-08-27T05:24:48.431793+0000, chain.objs.size()=1 2024-08-27T03:58:30.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TX_5EXJBAb01eWUKoBP12RCFBecm_Gx_0 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6214896485891537810', time=2024-08-27T05:24:49.195451+0000, chain.objs.size()=1 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TROKShAlfjsRcoGpvVvuL4eS2-gzyiD_0 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3903575141818108215', time=2024-08-27T05:24:50.476828+0000, chain.objs.size()=1 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.NhOXeQP7_niBAXY6PWsHS-dkomFDDq6_0 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9199816712127136138', time=2024-08-27T05:24:51.125421+0000, chain.objs.size()=1 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wXO3P_YwHmt9m-1hLXyMmfGdTrs2gLc_0 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13330463421480797505', time=2024-08-27T05:24:51.929351+0000, chain.objs.size()=1 2024-08-27T03:58:30.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DkhKU82uaoOgrnqMTj7rsnANu2Sjpgq_0 2024-08-27T03:58:30.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8830911945996686296', time=2024-08-27T05:24:52.286338+0000, chain.objs.size()=1 2024-08-27T03:58:30.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.v2LWGyvceeStXVEZeqkXXtov0oy-JDV_0 2024-08-27T03:58:30.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2743616397949476732', time=2024-08-27T05:24:52.766621+0000, chain.objs.size()=1 2024-08-27T03:58:30.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LgKMwd59lqKOgpTFK0nZCI_pRyh5zqL_0 2024-08-27T03:58:30.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7218468770636974723', time=2024-08-27T05:24:54.246592+0000, chain.objs.size()=1 2024-08-27T03:58:30.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0T-9uJt5tRSmBnhA-KNbidjbZ8_YU7e_0 2024-08-27T03:58:30.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12680641093100569589', time=2024-08-27T05:24:56.617950+0000, chain.objs.size()=1 2024-08-27T03:58:30.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eLLzuiNHAlDhhiUfJtxJ9bZ2UCFcfde_0 2024-08-27T03:58:30.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17992714517790189732', time=2024-08-27T05:24:56.850921+0000, chain.objs.size()=1 2024-08-27T03:58:30.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.50ZDC9OCEkCZ-Ag2TeNQLobxfAC1ejz_0 2024-08-27T03:58:30.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2753146818127939531', time=2024-08-27T05:24:58.345506+0000, chain.objs.size()=1 2024-08-27T03:58:30.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Gv6q8Y2Fw72-DM2T0KIU9mJlc6BVHDH_0 2024-08-27T03:58:30.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15584973450674304039', time=2024-08-27T05:24:58.764934+0000, chain.objs.size()=1 2024-08-27T03:58:30.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8jJ10YvHWo7Js_VdrL2fuAA3-Ofe7uP_0 2024-08-27T03:58:30.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15148612796185395177', time=2024-08-27T05:24:58.988279+0000, chain.objs.size()=1 2024-08-27T03:58:30.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5HVYdDfnwWHiFyiJxjv9J7RTdQAtqcl_0 2024-08-27T03:58:30.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10112822748027718774', time=2024-08-27T05:24:59.198346+0000, chain.objs.size()=1 2024-08-27T03:58:30.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.IkbdpVP6AJOiJGN9x0GN9arsDwuXcS5_0 2024-08-27T03:58:30.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.985183989990430461', time=2024-08-27T05:24:59.612124+0000, chain.objs.size()=1 2024-08-27T03:58:30.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.G6vNYEUG3lZBbK5o3mXfsej8CXCDszr_0 2024-08-27T03:58:30.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2340119419639944156', time=2024-08-27T05:25:00.286605+0000, chain.objs.size()=1 2024-08-27T03:58:30.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FrwvvWjmWqMP7k_DWPMxQDYgJUi3Jxf_0 2024-08-27T03:58:30.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13463224753521476840', time=2024-08-27T05:25:00.480412+0000, chain.objs.size()=1 2024-08-27T03:58:30.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eP388hRPMNNdqFfUtZxoeb-ys87DJNb_0 2024-08-27T03:58:30.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11155196786077980182', time=2024-08-27T05:25:02.850259+0000, chain.objs.size()=1 2024-08-27T03:58:30.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mtWFDXeonF6cAwKGebBP-qOAuTngQNE_0 2024-08-27T03:58:30.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17939827401355783804', time=2024-08-27T05:25:02.872579+0000, chain.objs.size()=1 2024-08-27T03:58:30.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1yr9aMkqONLCOleAdjmgj_qCtgCsDHx_0 2024-08-27T03:58:30.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5266123346756470276', time=2024-08-27T05:25:03.291685+0000, chain.objs.size()=1 2024-08-27T03:58:30.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dvGBV0shsQNHl8VR1b-cCx_ZOvN_Ong_0 2024-08-27T03:58:30.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15938534515047150803', time=2024-08-27T05:25:03.659983+0000, chain.objs.size()=1 2024-08-27T03:58:30.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qbwttYFtr4fXalZrUbFeU_iba0AItGF_0 2024-08-27T03:58:30.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15334783765880736200', time=2024-08-27T05:25:04.125800+0000, chain.objs.size()=1 2024-08-27T03:58:30.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.voyyHWTc-bYwy-c-ATelm-I_J-kN7Vh_0 2024-08-27T03:58:30.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7357003427863365819', time=2024-08-27T05:25:04.353762+0000, chain.objs.size()=1 2024-08-27T03:58:30.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FmeiFksE54IeoTmzzu2n3xuIujeFi2S_0 2024-08-27T03:58:30.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7183024123185509586', time=2024-08-27T05:25:04.485913+0000, chain.objs.size()=1 2024-08-27T03:58:30.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PX3CzQe7COY49-pMbrakmWC9Z_-QCfl_0 2024-08-27T03:58:30.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16088375884566818572', time=2024-08-27T05:25:07.939460+0000, chain.objs.size()=1 2024-08-27T03:58:30.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3-mla6qeQy5Asfwy1HW1p4LG96oqZ1j_0 2024-08-27T03:58:30.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8881984607085728087', time=2024-08-27T05:25:09.533059+0000, chain.objs.size()=1 2024-08-27T03:58:30.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.r8GGr-BbBcRKjgX0KGa_jwsR6F6kbrk_0 2024-08-27T03:58:30.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2900662779666927714', time=2024-08-27T05:25:09.623620+0000, chain.objs.size()=1 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mLPnlGinx6SHp674hv_Z1FvTHsanLzb_0 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18156088037142675286', time=2024-08-27T05:25:09.793086+0000, chain.objs.size()=1 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._qCtavCa5CdEWjLa_NYu1PoCS90ONwW_0 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14658541149598239237', time=2024-08-27T05:25:10.207383+0000, chain.objs.size()=1 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qyfik61RG5MFZxs0dA9qqs4mXy5AiAo_0 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12617867189525027777', time=2024-08-27T05:25:10.364442+0000, chain.objs.size()=1 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RiiBMpPWIo4z918vVQ4Lhnm72mr6bet_0 2024-08-27T03:58:30.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10552562717819688726', time=2024-08-27T05:25:10.887430+0000, chain.objs.size()=1 2024-08-27T03:58:30.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SVkNmZbyuZpXsHPqG_q5kwn1_8G4xGz_0 2024-08-27T03:58:30.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.209439905910203513', time=2024-08-27T05:25:13.115827+0000, chain.objs.size()=1 2024-08-27T03:58:30.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.JcH9cjnmyM8HRxz-nE8txGFZtCnO6Na_0 2024-08-27T03:58:30.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10059702973541718473', time=2024-08-27T05:25:13.567493+0000, chain.objs.size()=1 2024-08-27T03:58:30.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qVbulWC5Z0btlKa4y2qFVboF0ifdH5x_0 2024-08-27T03:58:30.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16516585486335816454', time=2024-08-27T05:25:13.644275+0000, chain.objs.size()=1 2024-08-27T03:58:30.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SA5li27GYNNBNhBk5W9d_fNSWy9owz9_0 2024-08-27T03:58:30.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9569221832978165875', time=2024-08-27T05:26:57.746832+0000, chain.objs.size()=1 2024-08-27T03:58:30.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-vckQMg4_x4vVSGnpjcd4fPXZ7FonFc_0 2024-08-27T03:58:30.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8338371019636002035', time=2024-08-27T05:26:57.749602+0000, chain.objs.size()=1 2024-08-27T03:58:30.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.WAf8_HXm27qnIjhAqh10oK0BDFmFg9__0 2024-08-27T03:58:30.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2370533459232435712', time=2024-08-27T05:26:58.175869+0000, chain.objs.size()=1 2024-08-27T03:58:30.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0Z2XViB5zspkxDrdRl_dJqLqjNpx_I8_0 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14690763897824865896', time=2024-08-27T05:27:02.444471+0000, chain.objs.size()=1 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.SVFUORQIwZYaqFmoYZUqNiL1e2ZB7Xd_0 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17591346627264890776', time=2024-08-27T05:27:02.446789+0000, chain.objs.size()=1 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.12volIZd1uyA47-OvU7kxjGI64SI09v_0 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10515736394346667989', time=2024-08-27T05:27:02.564331+0000, chain.objs.size()=1 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OVsZ8B8F-ymXDlAOWHiR2XcgePn3u9s_0 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12117366526964789400', time=2024-08-27T05:27:02.687002+0000, chain.objs.size()=1 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.c7W2KtfGdDcm_UVMqGri_GeVb2Iv8zz_0 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18374205141973793397', time=2024-08-27T05:27:04.184476+0000, chain.objs.size()=1 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zuvT9bKx-IukUiGLAt2EBB3oetHAEJn_0 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6194202731287576495', time=2024-08-27T05:27:05.799862+0000, chain.objs.size()=1 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bNs6oMie2lbwNteAywmMRFxN2AMQBF3_0 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14214786006799044907', time=2024-08-27T05:27:06.075557+0000, chain.objs.size()=1 2024-08-27T03:58:30.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ar_wKIfhA88_nZHzF6KTJgKJ-l8yT-f_0 2024-08-27T03:58:30.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7860325317603873328', time=2024-08-27T05:27:07.699013+0000, chain.objs.size()=1 2024-08-27T03:58:30.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uROvSASV7chnZlqXh3Qn9Y3lZRl08OY_0 2024-08-27T03:58:30.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5146991311026601087', time=2024-08-27T05:27:09.447521+0000, chain.objs.size()=1 2024-08-27T03:58:30.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.e3FLKlf89hMaFdiG-c-HWonv2MXBPBN_0 2024-08-27T03:58:30.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6350076498300088686', time=2024-08-27T05:27:10.112735+0000, chain.objs.size()=1 2024-08-27T03:58:30.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TwBIQP9ltotIKZmK60NNuBLiTqfB50n_0 2024-08-27T03:58:30.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9375994672866434539', time=2024-08-27T05:27:10.896381+0000, chain.objs.size()=1 2024-08-27T03:58:30.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KBSJhmKwlfkRqdI-OEQRgcSIxq8DK9c_0 2024-08-27T03:58:30.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12397585702739714185', time=2024-08-27T05:27:12.913985+0000, chain.objs.size()=1 2024-08-27T03:58:30.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.XPq-cPWGuMWUgvYWgqA5OA5B7viWXsb_0 2024-08-27T03:58:30.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13980294140145295293', time=2024-08-27T05:27:13.229797+0000, chain.objs.size()=1 2024-08-27T03:58:30.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.iyG_2uAYF4p2yaE-BX9dsqhfqBxJ7UL_0 2024-08-27T03:58:30.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4848910368952787714', time=2024-08-27T05:27:15.308949+0000, chain.objs.size()=1 2024-08-27T03:58:30.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4zcWcZtWfeGmvxI7qJb9_4-2Cxeoz4h_0 2024-08-27T03:58:30.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.387+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42201 2024-08-27T03:58:30.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-08-27T03:58:30.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12166456162512908366', time=2024-08-27T05:27:15.495188+0000, chain.objs.size()=1 2024-08-27T03:58:30.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8mpVegim7zWA64QJ-v8dkvcawwUd56i_0 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3826856220710089879', time=2024-08-27T05:27:16.502863+0000, chain.objs.size()=1 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2TQy19y6FAhDEL5PN1H8Csk2pan-OI6_0 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4830806154147722720', time=2024-08-27T05:27:17.125126+0000, chain.objs.size()=1 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.V-yzy7nWSSGbZDol_LFzJa9Qxi-flb9_0 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9904228001658362900', time=2024-08-27T05:27:17.193070+0000, chain.objs.size()=1 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bgQ3EO8XfQUJ2LlhYx68mA96d903hIo_0 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15067706010821224468', time=2024-08-27T05:27:17.195164+0000, chain.objs.size()=1 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CsOvXSEEHvFmiMYCHMSc72XrQtvtaUL_0 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2680810715662231426', time=2024-08-27T05:27:19.188501+0000, chain.objs.size()=1 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FH8qJ3oJOMQCNr_x7C8ag-KpCzevFgV_0 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9442673043653348126', time=2024-08-27T05:27:20.991242+0000, chain.objs.size()=1 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DkwCa0T9yb7tRzhDUOVY2IKWP7puUJa_0 2024-08-27T03:58:30.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.31851799735877704', time=2024-08-27T05:27:21.042645+0000, chain.objs.size()=1 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bCuuyeT5q1ni5myVaCny0BQgOJOTLAd_0 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11848383685598295572', time=2024-08-27T05:27:21.502796+0000, chain.objs.size()=1 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.C7Vef2dVie4VC_n5Q8cqLjXdrjfk0rK_0 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6506045629365217248', time=2024-08-27T05:27:21.918253+0000, chain.objs.size()=1 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ThfRTjBb4nuqMDZdSdK9wyINDEzZ2CT_0 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3027097255395131820', time=2024-08-27T05:27:22.181502+0000, chain.objs.size()=1 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mdI73-5CCFzcD2XUP4XJrTfZKz3KcGe_0 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5187702394099319612', time=2024-08-27T05:27:22.532722+0000, chain.objs.size()=1 2024-08-27T03:58:30.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.X3K6nyyGxUvsZE3K8Pq80NuteB5My_b_0 2024-08-27T03:58:30.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15546731975942699950', time=2024-08-27T05:27:24.070316+0000, chain.objs.size()=1 2024-08-27T03:58:30.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jrVK3MJ1dSBLxOxIUMyL3UQLrgzcNlD_0 2024-08-27T03:58:30.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1289473557739295954', time=2024-08-27T05:27:25.463318+0000, chain.objs.size()=1 2024-08-27T03:58:30.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-tiIzbit9zDKObT4c-fZmHBR6fLWG46_0 2024-08-27T03:58:30.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7205529603661759275', time=2024-08-27T05:27:25.667986+0000, chain.objs.size()=1 2024-08-27T03:58:30.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EfBIvfdVjfte6I9vQDBd_3inLRLS1NA_0 2024-08-27T03:58:30.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17253136426563624233', time=2024-08-27T05:30:55.575163+0000, chain.objs.size()=1 2024-08-27T03:58:30.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.455__shadow_.-fU6suFVyzGa95Mkf7oAQQGm9ETouAD_0 2024-08-27T03:58:30.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13715822641028189227', time=2024-08-27T05:31:28.532523+0000, chain.objs.size()=1 2024-08-27T03:58:30.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.z9-bAxZmGJMxNGhVrs0qyoXgzeSZMDc_0 2024-08-27T03:58:30.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13914083452007069658', time=2024-08-27T05:31:51.919217+0000, chain.objs.size()=1 2024-08-27T03:58:30.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.489__shadow_.1sKMXAW1LAZQNHAVIKU3cIQl9HWPqWZ_0 2024-08-27T03:58:30.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9721015542404766746', time=2024-08-27T05:34:03.435240+0000, chain.objs.size()=6 2024-08-27T03:58:30.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Bk2CaovXlMatUe0sSFnmplS0iIU27Sr.1 2024-08-27T03:58:30.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.DWMqvUGJg_TaeGC1bljRDE9rRvqGMRMZ.2 2024-08-27T03:58:30.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Bk2CaovXlMatUe0sSFnmplS0iIU27Sr.3 2024-08-27T03:58:30.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Bk2CaovXlMatUe0sSFnmplS0iIU27Sr.4 2024-08-27T03:58:30.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Bk2CaovXlMatUe0sSFnmplS0iIU27Sr.5 2024-08-27T03:58:30.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Bk2CaovXlMatUe0sSFnmplS0iIU27Sr.6 2024-08-27T03:58:30.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10410162508237651474', time=2024-08-27T05:35:22.702431+0000, chain.objs.size()=1 2024-08-27T03:58:30.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.518__shadow_.HZpPeguf2Jyl5XDfoI942rbO2vR2J_2_0 2024-08-27T03:58:30.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12917152426230445791', time=2024-08-27T05:37:59.208204+0000, chain.objs.size()=1 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:tShJJPG3KMrXrzt-g5I.XDeteGvf6i6_.3AP0P2SZjIKL3AHSNy5cy92lE8l3K0k_0 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15099502527452923787', time=2024-08-27T05:39:02.264340+0000, chain.objs.size()=1 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:h.PvtpDVTOd.cW95FBuIWauKABIQv51_.ps9kklziHn4xntpVVPXUJzjymJbSkoF_0 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2785299575019802014', time=2024-08-27T05:40:00.662749+0000, chain.objs.size()=1 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:XWKee8swCxUoOXaHfm.IP6iiKRtdu3m_.22Gb_sTmqF-9WLlZGuDlCESG17qqMPP_0 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2993399036917164333', time=2024-08-27T05:40:15.933144+0000, chain.objs.size()=1 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:DArlk0QFznowfMsSd3Y-dzKsjteTPHj_.mXF4wlK4pWCLAHBk69qRT6e3QzdF_mq_0 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8134909280389736947', time=2024-08-27T05:40:47.066980+0000, chain.objs.size()=1 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.602__shadow_.rJjpUV6UaF0o4WMw7cdoYLK1Nsf9O-x_0 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2703813348935868780', time=2024-08-27T05:42:09.872963+0000, chain.objs.size()=6 2024-08-27T03:58:30.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.608__multipart_multipart_enc.2~yzMAD04AmXhlY6eJV3oXM4e15FjfBBo.1 2024-08-27T03:58:30.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.608__multipart_multipart_enc.2~yzMAD04AmXhlY6eJV3oXM4e15FjfBBo.2 2024-08-27T03:58:30.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.608__multipart_multipart_enc.2~yzMAD04AmXhlY6eJV3oXM4e15FjfBBo.3 2024-08-27T03:58:30.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.608__multipart_multipart_enc.2~yzMAD04AmXhlY6eJV3oXM4e15FjfBBo.4 2024-08-27T03:58:30.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.608__multipart_multipart_enc.2~yzMAD04AmXhlY6eJV3oXM4e15FjfBBo.5 2024-08-27T03:58:30.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.608__multipart_multipart_enc.2~yzMAD04AmXhlY6eJV3oXM4e15FjfBBo.6 2024-08-27T03:58:30.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.407+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1939184342798477791', time=2024-08-27T05:47:13.995479+0000, chain.objs.size()=1 2024-08-27T03:58:30.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.407+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.673__shadow_.7bvj1wuQga0zeVPlL-huUbG6-6_sY4w_0 2024-08-27T03:58:30.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-08-27T03:58:30.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47467' 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7119717620170069279', time=2024-08-27T05:18:04.468351+0000, chain.objs.size()=1 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.230__shadow_.E7pXjIqsGdKgToKGFSQ5xyoz_t6h51K_0 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17331025357458515065', time=2024-08-27T05:20:35.736618+0000, chain.objs.size()=1 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CyWT6HpEoivfVpsUCE8TzFpbKe-Ss28_0 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1110414570522097378', time=2024-08-27T05:20:37.202173+0000, chain.objs.size()=1 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.j3GGVly-YnmDvzLW-AICFDKlQpfhTTX_0 2024-08-27T03:58:30.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8810626089776285060', time=2024-08-27T05:20:40.565091+0000, chain.objs.size()=1 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EUjzAGs7Zh7O0pAzYYQRku63PhTz5Lm_0 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12712031536724093879', time=2024-08-27T05:20:41.080681+0000, chain.objs.size()=1 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ChxLasncFYn1UqEGujFoM-1V7RlbDvm_0 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.761891245857228608', time=2024-08-27T05:20:43.154001+0000, chain.objs.size()=1 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.IotXYxO1WJliHrIfYKADL8s4LYxmtGM_0 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12220525662631796976', time=2024-08-27T05:20:43.746481+0000, chain.objs.size()=1 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fuj8QHqPYInlqQ-PB1igyAq-R5LxqTQ_0 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3905408795817522172', time=2024-08-27T05:20:44.458681+0000, chain.objs.size()=1 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jKLS0PPtDSN_QLrdaQVfjoBO3COJh_X_0 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9463138748741687206', time=2024-08-27T05:20:44.791482+0000, chain.objs.size()=1 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qoALMYG0JCMEBYcVmcD48MTTLGwW0s9_0 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1819311013534704373', time=2024-08-27T05:20:44.920773+0000, chain.objs.size()=1 2024-08-27T03:58:30.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.M1uE5zlfNnn8idZ54f_jL8rdFe2Vvkt_0 2024-08-27T03:58:30.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5227376165733140611', time=2024-08-27T05:20:47.051556+0000, chain.objs.size()=1 2024-08-27T03:58:30.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MVf97icbPlDZN1l7T3GGGj-15-EShIE_0 2024-08-27T03:58:30.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8011933171603752508', time=2024-08-27T05:20:47.158060+0000, chain.objs.size()=1 2024-08-27T03:58:30.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hBrlfTzm4-gB4B_ndUXhixSUe015BlN_0 2024-08-27T03:58:30.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11504668208570410693', time=2024-08-27T05:20:47.361111+0000, chain.objs.size()=1 2024-08-27T03:58:30.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Bsw1K35JVK2bvDITOIwcuVkBrdSMXdV_0 2024-08-27T03:58:30.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2325154259934725453', time=2024-08-27T05:20:49.620221+0000, chain.objs.size()=1 2024-08-27T03:58:30.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lLH07BHezAzgMS8qQ5oGfvVZHBV_mpC_0 2024-08-27T03:58:30.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11022113331116817688', time=2024-08-27T05:20:50.738081+0000, chain.objs.size()=1 2024-08-27T03:58:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ACdQOc2Z4c-3_Cv_U1s91b2rDv50c_I_0 2024-08-27T03:58:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11074025845273070949', time=2024-08-27T05:20:50.760701+0000, chain.objs.size()=1 2024-08-27T03:58:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.35jCz7MssK3XAsVHTXUvO2uJYFZEEnU_0 2024-08-27T03:58:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12402316062117835671', time=2024-08-27T05:20:51.386573+0000, chain.objs.size()=1 2024-08-27T03:58:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.72k4jcqHLeL7XrUFNCs7xj9m7uv8aIy_0 2024-08-27T03:58:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5551271579388930372', time=2024-08-27T05:20:51.582488+0000, chain.objs.size()=1 2024-08-27T03:58:30.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.GsNpdiXLcbCbVVkKPN6YBzJIiZ_4hOS_0 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2735208398947864755', time=2024-08-27T05:20:51.609069+0000, chain.objs.size()=1 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.UNzjpDu4UfKxMtXdhKKwlU_X6c2VB5j_0 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9155021332302612071', time=2024-08-27T05:20:52.255428+0000, chain.objs.size()=1 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lMegqocT2toEdqYg5NV0NgjVD5GyKxx_0 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14264794242108503206', time=2024-08-27T05:20:52.888563+0000, chain.objs.size()=1 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jDko_TveAdsgCvjR-ceq_kfHXWsLUJ9_0 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.468320759115132715', time=2024-08-27T05:20:54.568080+0000, chain.objs.size()=1 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xKAq4EGHQfLPs_0G0UgfMUz70llX7GD_0 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6416216396233381629', time=2024-08-27T05:20:55.150632+0000, chain.objs.size()=1 2024-08-27T03:58:30.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CXSpw0MCuMNxMeq8Z2Mw41eNqvfbBny_0 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8710477146296941057', time=2024-08-27T05:20:56.739217+0000, chain.objs.size()=1 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SjfhHpYvszV5AdM-k22QcBK7WURYS-B_0 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14918681795288996765', time=2024-08-27T05:20:58.166784+0000, chain.objs.size()=1 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6BiVU885-ADnzT3fI_FuE7Lx5NVUrpk_0 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2915507986439326390', time=2024-08-27T05:20:58.169036+0000, chain.objs.size()=1 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ifICgueNinTD7-kDGzMlO1dmx9fsKd2_0 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11663932651163363538', time=2024-08-27T05:20:58.728590+0000, chain.objs.size()=1 2024-08-27T03:58:30.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JekOEhmpfBsmbT8zt7pFr9tHSc1fTNa_0 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13333757369345834133', time=2024-08-27T05:20:59.871077+0000, chain.objs.size()=1 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6NdpTw3loa9UDnn7gZCitPfzPXe-Ij2_0 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9011114045557583543', time=2024-08-27T05:21:02.738035+0000, chain.objs.size()=1 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uWqYLzJwYshS8TUmva-JdJhCySbPvyC_0 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17813600056341289260', time=2024-08-27T05:21:03.026279+0000, chain.objs.size()=1 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-lsTgTojdqE1C6_dxHeZ3WqxErUrJca_0 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4878191475353727819', time=2024-08-27T05:22:03.040843+0000, chain.objs.size()=1 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.2TIz5Lps1r8nX8A24fGnGKjIo80c5JO_0 2024-08-27T03:58:30.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7270377661959963773', time=2024-08-27T05:22:23.332935+0000, chain.objs.size()=1 2024-08-27T03:58:30.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.295__shadow_.j_B01oghktiiP0SZlAqN2eAvi1t-TMD_0 2024-08-27T03:58:30.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8823906683553555684', time=2024-08-27T05:22:35.866120+0000, chain.objs.size()=1 2024-08-27T03:58:30.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.301__shadow:lYhf73o8EylpmpZz6-24ZxEhX.KBoCN_.NvmPSA7RGvekir97A_vvWoGMMaimdCp_0 2024-08-27T03:58:30.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2642585027206440534', time=2024-08-27T05:24:46.504416+0000, chain.objs.size()=1 2024-08-27T03:58:30.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-ptgUGIDoa1JP2IKwXPpaLISapjZK5G_0 2024-08-27T03:58:30.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12454670108809760703', time=2024-08-27T05:24:46.975700+0000, chain.objs.size()=1 2024-08-27T03:58:30.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RVUX_e8GnWRL1VmmCXjzG6NNUR75wE5_0 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14978296888908025139', time=2024-08-27T05:24:48.808614+0000, chain.objs.size()=1 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sb9M9jWuXIa0ZrP1WYw6J-b2jxsIxLu_0 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.607149855833650541', time=2024-08-27T05:24:49.185178+0000, chain.objs.size()=1 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.INur6ZEmSSvi2racw2LHVU6-Jj-c8Q6_0 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2176351904821814439', time=2024-08-27T05:24:51.203612+0000, chain.objs.size()=1 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0omPwBQqxLDoIz0uc7qN2CtlpsYgDv7_0 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12998160758301037058', time=2024-08-27T05:24:52.010498+0000, chain.objs.size()=1 2024-08-27T03:58:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Bx1kGkhrnaZmsgQFeVFbw0y52tND1vn_0 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6693853219893409478', time=2024-08-27T05:24:52.365047+0000, chain.objs.size()=1 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0NWv_SrZ2vH62-mCClqd-xaEecYyLyR_0 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15885501224699410524', time=2024-08-27T05:24:52.600603+0000, chain.objs.size()=1 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6ML2OhBg6aXKcYaYnh22yULDQlTgxcn_0 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9643509186568111023', time=2024-08-27T05:24:53.271627+0000, chain.objs.size()=1 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x7HIk86XW2Ilij3po0sWRS_URsZdr2L_0 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10223094463178011537', time=2024-08-27T05:24:54.346279+0000, chain.objs.size()=1 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Q-MvN_Rpn2-rVGYfQvRxmMxIWMWd0d7_0 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1117528414883149382', time=2024-08-27T05:24:56.454911+0000, chain.objs.size()=1 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dkSKqWoW8_FmmyWgyK2Beh5PP1DGVN8_0 2024-08-27T03:58:30.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3822039164591180330', time=2024-08-27T05:24:58.163811+0000, chain.objs.size()=1 2024-08-27T03:58:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.435+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SJoEV_7FyDLastFDnLky3iBbX_93Eh6_0 2024-08-27T03:58:30.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10579629463488373875', time=2024-08-27T05:24:58.168654+0000, chain.objs.size()=1 2024-08-27T03:58:30.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xkjjylk1jxcGWD-JSf2n08xyyukQr-r_0 2024-08-27T03:58:30.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16987765927921846978', time=2024-08-27T05:24:58.886722+0000, chain.objs.size()=1 2024-08-27T03:58:30.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.HFONAFfDa3MVfl76-rIMvJqc0YdgUfT_0 2024-08-27T03:58:30.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17122135142944315474', time=2024-08-27T05:24:59.610912+0000, chain.objs.size()=1 2024-08-27T03:58:30.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.aCi5fJzV58WCQU3YkmXiejKZ0eARO09_0 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6885135629364791808', time=2024-08-27T05:24:59.704914+0000, chain.objs.size()=1 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.23dyP2ChIPBN98A91ZcXj0r48nSZ_ci_0 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5409890238511883476', time=2024-08-27T05:25:01.604355+0000, chain.objs.size()=1 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.g5CnR5gopHKn5jmRpE9COjjj9GClyeh_0 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18365785930872299501', time=2024-08-27T05:25:01.606052+0000, chain.objs.size()=1 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4fWvlcW0PKe_oLsC3fULgPBikxYa5Lj_0 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18394288293478918704', time=2024-08-27T05:25:02.936610+0000, chain.objs.size()=1 2024-08-27T03:58:30.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eVz8Px6inqx4VoYQXnH48SO6ka5cWty_0 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17214347414378987387', time=2024-08-27T05:25:05.661245+0000, chain.objs.size()=1 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nFgJ5jMqnAaZz1qXrDRjj83jULDWkGd_0 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10996201719499350298', time=2024-08-27T05:25:07.451680+0000, chain.objs.size()=1 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qf2QDIoTtuklXsfsUk9czmUij1qPhJt_0 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14187263127739108040', time=2024-08-27T05:25:08.851746+0000, chain.objs.size()=1 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.v-sZBqfmt2QNt_Ab0Ku3t1nm-HHlsPA_0 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2162387811042830722', time=2024-08-27T05:25:10.804250+0000, chain.objs.size()=1 2024-08-27T03:58:30.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iQfGK0xIB2Z_FEpscV0pWEXddX_bKT3_0 2024-08-27T03:58:30.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14282450239208986240', time=2024-08-27T05:25:10.960404+0000, chain.objs.size()=1 2024-08-27T03:58:30.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-JyUfM2C6Mf0UfopKFE0TtE0IM7ktnQ_0 2024-08-27T03:58:30.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12487779081080880461', time=2024-08-27T05:25:11.479787+0000, chain.objs.size()=1 2024-08-27T03:58:30.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GJtNMAQZTxgK_luB5r1wTwB2fkHBFRt_0 2024-08-27T03:58:30.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8928537020240986718', time=2024-08-27T05:25:13.097948+0000, chain.objs.size()=1 2024-08-27T03:58:30.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.q2VqstBWEA2eDAyqRzQArLfLesSg8qi_0 2024-08-27T03:58:30.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12949609121008955429', time=2024-08-27T05:25:14.490032+0000, chain.objs.size()=1 2024-08-27T03:58:30.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XXfHaUerYjTUEdDQy1yuvBTZO4o9MBC_0 2024-08-27T03:58:30.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11131624107399045372', time=2024-08-27T05:26:57.717813+0000, chain.objs.size()=1 2024-08-27T03:58:30.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HWm9JRh8SR2nc6F2TwgGDlxKwAjOAs2_0 2024-08-27T03:58:30.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4459533012847529667', time=2024-08-27T05:26:57.719510+0000, chain.objs.size()=1 2024-08-27T03:58:30.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.E-ioZlwmemwGBmMmGddggOazTPWsmbb_0 2024-08-27T03:58:30.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7567735306553669057', time=2024-08-27T05:26:58.540233+0000, chain.objs.size()=1 2024-08-27T03:58:30.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.W54u04nzCBSxEFHI2G_lK54Ni82DwJA_0 2024-08-27T03:58:30.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4594216598313829186', time=2024-08-27T05:26:59.315675+0000, chain.objs.size()=1 2024-08-27T03:58:30.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.--DL0qWWvSZi_NIL7mudoVLhuEbu5jH_0 2024-08-27T03:58:30.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.35866824565554019', time=2024-08-27T05:27:00.204598+0000, chain.objs.size()=1 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NonC5gPi1EroCq0pR5s0UtKQppko_7u_0 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5348180724208417455', time=2024-08-27T05:27:00.252247+0000, chain.objs.size()=1 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AjPjy2uIcvskdYMj9U0XA3OthGDZid0_0 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.209858196048455659', time=2024-08-27T05:27:00.374358+0000, chain.objs.size()=1 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.a3Vt2V9-l2CjyPUGX18cb3kpylTyhhz_0 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13244596693907559633', time=2024-08-27T05:27:00.452363+0000, chain.objs.size()=1 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JMXL5JuRO_DzhVBZ7zpulOH-rWEQUgO_0 2024-08-27T03:58:30.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.393567251896838957', time=2024-08-27T05:27:02.552938+0000, chain.objs.size()=1 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3Y7ldMSXdkZJMy3NMxNdGpcY2ijiDrU_0 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17616416813844798294', time=2024-08-27T05:27:02.999639+0000, chain.objs.size()=1 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8uWLFvhUCQ80xkIipyuhDho9T1azRKd_0 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7038206858893460520', time=2024-08-27T05:27:03.212008+0000, chain.objs.size()=1 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.j_8IgZGslBiVOifoqy8ghObVyLhWzIU_0 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2912653131549430119', time=2024-08-27T05:27:03.481292+0000, chain.objs.size()=1 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.q8rZLJUOk0i15zXN9kWwKOSxltMceKf_0 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14670059564633673103', time=2024-08-27T05:27:04.178274+0000, chain.objs.size()=1 2024-08-27T03:58:30.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.651+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.aZtBxe1GlFltDxX-qitVjL4FqhtDCyj_0 2024-08-27T03:58:30.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6927046338403130152', time=2024-08-27T05:27:04.440006+0000, chain.objs.size()=1 2024-08-27T03:58:30.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QFfMmIigWfkKIhfMe9HM6I6vEwIlPtp_0 2024-08-27T03:58:30.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4229992650873550573', time=2024-08-27T05:27:04.501634+0000, chain.objs.size()=1 2024-08-27T03:58:30.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.aXxcMaNfaAWqSyA2jC8uYTyfON1mBGF_0 2024-08-27T03:58:30.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3825611318992419461', time=2024-08-27T05:27:05.463225+0000, chain.objs.size()=1 2024-08-27T03:58:30.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zNIh2H7JfmCB0ADvckKPpvAiuhVAHiO_0 2024-08-27T03:58:30.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11532316097926717596', time=2024-08-27T05:27:06.143169+0000, chain.objs.size()=1 2024-08-27T03:58:30.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lqLp5E51jZ9nLxv-ffZCL3iNCeyVLAk_0 2024-08-27T03:58:30.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17623432783725204370', time=2024-08-27T05:27:08.151015+0000, chain.objs.size()=1 2024-08-27T03:58:30.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pcq8YTFiS6UM4S9p92VVjF9JnQbGPxE_0 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18193735096633858081', time=2024-08-27T05:27:09.937665+0000, chain.objs.size()=1 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Q7NqdnF4nNzfr-m1lU5-m4dG0_vehk4_0 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.586774627086896804', time=2024-08-27T05:27:11.018617+0000, chain.objs.size()=1 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.onr4-WEyGPFg39e_QYsEBEBDVY9H71Z_0 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5192146747219593299', time=2024-08-27T05:27:11.279386+0000, chain.objs.size()=1 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fE8-2fVluHowbhNMQ3sUygTJCtWYkO-_0 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.279203747365660135', time=2024-08-27T05:27:13.380080+0000, chain.objs.size()=1 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VMQflX7-gxWwndgxrQzvuEEvBFQKWgG_0 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5645911739673399484', time=2024-08-27T05:27:13.816852+0000, chain.objs.size()=1 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.k-ZHfrWxXDMK9h9WGs9M8pFvF1Wr72m_0 2024-08-27T03:58:30.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12846748676884971523', time=2024-08-27T05:27:14.325205+0000, chain.objs.size()=1 2024-08-27T03:58:30.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.WHOOLslcNNFe2NATpyoFE33n5LC-6PU_0 2024-08-27T03:58:30.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11623932251153108986', time=2024-08-27T05:27:14.854334+0000, chain.objs.size()=1 2024-08-27T03:58:30.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.sKWrN6Fj6zQ8TE9U2qghTgDpX80GF6K_0 2024-08-27T03:58:30.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.845818177073662545', time=2024-08-27T05:27:16.485378+0000, chain.objs.size()=1 2024-08-27T03:58:30.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.r7YIUINUTJO-sr34Y6YUUaiB7unUAQ7_0 2024-08-27T03:58:30.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8494770400269422306', time=2024-08-27T05:27:16.752516+0000, chain.objs.size()=1 2024-08-27T03:58:30.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MqucFdXRr98euTBOOmxlvOaqmBjDraB_0 2024-08-27T03:58:30.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10800007353716523090', time=2024-08-27T05:27:16.796628+0000, chain.objs.size()=1 2024-08-27T03:58:30.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QOqVpIM-__0VNc6fByHnhJgJXAtGujV_0 2024-08-27T03:58:30.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5426287765986817232', time=2024-08-27T05:27:16.798628+0000, chain.objs.size()=1 2024-08-27T03:58:30.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.03UjcQuE7S9_L1c5TnHAw-NYQRlWBFs_0 2024-08-27T03:58:30.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3930468030145119390', time=2024-08-27T05:27:18.639469+0000, chain.objs.size()=1 2024-08-27T03:58:30.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4TunI98wW739K4r32nzfX7MIOuvCftq_0 2024-08-27T03:58:30.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14440020958932059414', time=2024-08-27T05:27:21.420194+0000, chain.objs.size()=1 2024-08-27T03:58:30.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AJ2RzaPaLQApnAwa5MvQJpgQi_Cltel_0 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12158212320593424162', time=2024-08-27T05:27:21.875576+0000, chain.objs.size()=1 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.XEXxiQZw1QGDvsYt-uE0gKIX8DfJ0OR_0 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2763744872451679410', time=2024-08-27T05:27:21.900080+0000, chain.objs.size()=1 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NwYqtDotJ0MKPXtQ5FdzDEzt1iJJloc_0 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11222832613499412878', time=2024-08-27T05:27:22.735045+0000, chain.objs.size()=1 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6t7My_qTwhDFpeiFN_E9NoMU5YJv1wM_0 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5008653212369189434', time=2024-08-27T05:27:24.106568+0000, chain.objs.size()=1 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8mlPfS-MKAIO4-gvZbANHqChAgZxF4b_0 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13812812153923372069', time=2024-08-27T05:27:24.493824+0000, chain.objs.size()=1 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mGTaLJ3yY6KpAqK2m9yhdOuOTtAh8S__0 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15686979337795474784', time=2024-08-27T05:27:25.188646+0000, chain.objs.size()=1 2024-08-27T03:58:30.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GWDa1wNCoY8Y_bBp3nvP0eAk_WqR7W0_0 2024-08-27T03:58:30.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8518555552643193742', time=2024-08-27T05:27:25.543775+0000, chain.objs.size()=1 2024-08-27T03:58:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UubfgP08_F80t9Y4RHy-CBDeWdNv8uh_0 2024-08-27T03:58:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10902922185436996480', time=2024-08-27T05:27:25.831273+0000, chain.objs.size()=1 2024-08-27T03:58:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0OyUbsuqdq4JLi2cQO29pYJR3p65ot__0 2024-08-27T03:58:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16622467205897301866', time=2024-08-27T05:27:25.902027+0000, chain.objs.size()=1 2024-08-27T03:58:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bw1Z6zpDN2MJpDWOslFH43P4qK_9gYp_0 2024-08-27T03:58:30.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47467 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1218777202867065012', time=2024-08-27T05:29:08.919781+0000, chain.objs.size()=1 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.388__shadow:n.-3.huf49xRcDla0lxNkpnC6uZUpRH_.VZPBDBzgsvGNVV8ZmXDfyxbAgk2CdWb_0 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.181232949170914890', time=2024-08-27T05:30:01.470448+0000, chain.objs.size()=1 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.424__shadow_.iTCELuMAPVvwvQMwZ3kYWxZTGGyIJab_0 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3651682227170155274', time=2024-08-27T05:32:06.070502+0000, chain.objs.size()=1 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.497__shadow:nGBnVWVmI3DA67.4KlPAhM9ux0Gc029_.rEh1fYZ9-qfRs1r-giIeLw9ZBIE8vlQ_0 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4786227334711414144', time=2024-08-27T05:32:22.935290+0000, chain.objs.size()=6 2024-08-27T03:58:30.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.1 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.2 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.3 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.4 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.5 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.6 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8634233327451675788', time=2024-08-27T05:32:45.399949+0000, chain.objs.size()=1 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.511__shadow_.tX_vAh5xvGgXqBmZk9XTYjMD-F3g5rQ_0 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1146225268015811789', time=2024-08-27T05:32:45.428752+0000, chain.objs.size()=1 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.511__shadow_.gfYp3HJAD24p1s68pELk-4H4G8ID6co_0 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1425778136677633393', time=2024-08-27T05:36:46.909935+0000, chain.objs.size()=1 2024-08-27T03:58:30.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.544__shadow_.IEEFg20lM7eRnmjtjiU5UI-p7cgQ5Ti_0 2024-08-27T03:58:30.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.711+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5816895687096721468', time=2024-08-27T05:36:50.959583+0000, chain.objs.size()=1 2024-08-27T03:58:30.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.545__shadow_.JWou4A76A7-WETACQUVWEN7ALuUQlYA_0 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18438562767003527667', time=2024-08-27T05:37:27.036878+0000, chain.objs.size()=1 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.553__shadow_.96VN0yRiU2lnGx-DQjOcsmQyZypxRxi_0 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11320123446478190668', time=2024-08-27T05:38:56.727650+0000, chain.objs.size()=1 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:9e9UfdqpswFv8aa4IoLPWhldKVRjelY_.Aa3nx7oOuxU_PIhCzFSghEE74zuyxun_0 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9117594088810314709', time=2024-08-27T05:39:16.627488+0000, chain.objs.size()=1 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:FASGiwGVLogNK4n-VyfmU6S9F5nkQOS_.5H7XhTVA8TkhJeCRPhgS-eLy7lLHZd-_0 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13512939801331572508', time=2024-08-27T05:40:02.949075+0000, chain.objs.size()=1 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.576__shadow:09B-Qc7KcQ.xvpyrlexrZ5m3520ex6q_.KZVTV9PYyzbB3DEK4RZGlT4m4zpjYfs_0 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15690667388501161419', time=2024-08-27T05:45:21.678859+0000, chain.objs.size()=1 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.622__shadow_.DfqmQy94K9Hah8qnt6tO41W_i3kC7Wm_0 2024-08-27T03:58:30.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2497092028274316423', time=2024-08-27T05:47:56.710430+0000, chain.objs.size()=1 2024-08-27T03:58:30.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.700__shadow_.7zej7BaM0uNNExembgHNN7egaUIRh2l_0 2024-08-27T03:58:30.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-08-27T03:58:30.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.731+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.731+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48909' 2024-08-27T03:58:30.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9161589166083453401', time=2024-08-27T05:18:07.104136+0000, chain.objs.size()=1 2024-08-27T03:58:30.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.231__shadow_.Px7y_UezXE6EpUAWMQBwoDqmzhTdnUK_0 2024-08-27T03:58:30.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14125197298012963000', time=2024-08-27T05:18:27.432627+0000, chain.objs.size()=1 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.241__shadow_.xz-Vi5vORR3sNLrfp6Z1iEi3DnZQWVX_0 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1101042777612112683', time=2024-08-27T05:18:40.368997+0000, chain.objs.size()=1 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.248__shadow_.dh4vSfGmKfT3wqLjA_sAGvVDdm_rlEL_0 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17653804732308817126', time=2024-08-27T05:18:49.333066+0000, chain.objs.size()=1 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.253__shadow_.4VWL4wc7lp_5wLyoyqi2648MviIFevF_0 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8570617951593580944', time=2024-08-27T05:20:35.594266+0000, chain.objs.size()=1 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4j19R9n1hE4jVH6vAnLjXlwHpPzA143_0 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15326142604164923395', time=2024-08-27T05:20:35.719847+0000, chain.objs.size()=1 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-3x9vhCjAEHAoEpGeQKPS9B__sejDfh_0 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14991684595712890497', time=2024-08-27T05:20:36.292324+0000, chain.objs.size()=1 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.istpo997MEh67uTb6Cejd4ryL6zgwFa_0 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10484194889098778320', time=2024-08-27T05:20:36.308992+0000, chain.objs.size()=1 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._fGp9MoILzrEPrSu8GtPd6jm2-HD0Ul_0 2024-08-27T03:58:30.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3916469095318786201', time=2024-08-27T05:20:36.310647+0000, chain.objs.size()=1 2024-08-27T03:58:30.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2G4dh3Cb2OOlSCjqCrn0sxKZdbTGrB9_0 2024-08-27T03:58:30.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7956929285447711368', time=2024-08-27T05:20:36.534513+0000, chain.objs.size()=1 2024-08-27T03:58:30.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bsOr7eZA2uHmm4Ri8prm7QIysfM98_s_0 2024-08-27T03:58:30.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13818318325757696112', time=2024-08-27T05:20:36.602277+0000, chain.objs.size()=1 2024-08-27T03:58:30.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KHTIlEPwAZL8I4R286p4L1GICFcT-Yk_0 2024-08-27T03:58:30.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.203687617638946146', time=2024-08-27T05:20:37.135283+0000, chain.objs.size()=1 2024-08-27T03:58:30.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sfRrLpnySLZrLdrmR8Epceb_mXzPBXF_0 2024-08-27T03:58:30.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2872482883580847344', time=2024-08-27T05:20:37.152703+0000, chain.objs.size()=1 2024-08-27T03:58:30.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.p4I6Ygroyyss4SxkTaJ3gdE7ZWxRefj_0 2024-08-27T03:58:30.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7980836012117128040', time=2024-08-27T05:20:39.190999+0000, chain.objs.size()=1 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kQfcqRzqXyrmajlA2acn575YJix2B1B_0 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5362703458017775939', time=2024-08-27T05:20:41.216094+0000, chain.objs.size()=1 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Z4VYMb1LIOD58jZuQi27VKZiDoX7lYL_0 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18007477402280223106', time=2024-08-27T05:20:41.865516+0000, chain.objs.size()=1 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OpajqQwOJ72_NkWXS7BR6iSZPZ9Z3EK_0 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17874867743901521449', time=2024-08-27T05:20:44.820633+0000, chain.objs.size()=1 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Nfx0WfGn3bgiNYU0OU2T6Ir07u_DjOC_0 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4793574275214136127', time=2024-08-27T05:20:45.089029+0000, chain.objs.size()=1 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.IDAMEaxDG_k1nX0eRESvct51-KuprKZ_0 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2668188049451296377', time=2024-08-27T05:20:47.084725+0000, chain.objs.size()=1 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.DqqQTNa9tj2L_gFjvQNZu5jCFqWTLSU_0 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12588565705492289155', time=2024-08-27T05:20:47.456570+0000, chain.objs.size()=1 2024-08-27T03:58:30.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mHhBHRcw79ds3PPfPQkb0Hjo_pkMOhp_0 2024-08-27T03:58:30.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6587204045947484585', time=2024-08-27T05:20:47.493925+0000, chain.objs.size()=1 2024-08-27T03:58:30.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jmt_eaOb-bVEm3a8YU58-jRSgQ_Dium_0 2024-08-27T03:58:30.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7337078549289127065', time=2024-08-27T05:20:47.836592+0000, chain.objs.size()=1 2024-08-27T03:58:30.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HJ3hUktkTuuoSUvQwfW6fw6yCX_zcVF_0 2024-08-27T03:58:30.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18424688488135989769', time=2024-08-27T05:20:47.997066+0000, chain.objs.size()=1 2024-08-27T03:58:30.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Yz45tRNH5uDgYgZFryRGr7Qln49pXnK_0 2024-08-27T03:58:30.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.751+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9985855913379683715', time=2024-08-27T05:20:50.770789+0000, chain.objs.size()=1 2024-08-27T03:58:30.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.751+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.onMAaJQOgCaPDkkU47wiDWZta_CH8iE_0 2024-08-27T03:58:30.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.751+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7279600152048454096', time=2024-08-27T05:20:51.413186+0000, chain.objs.size()=1 2024-08-27T03:58:30.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.751+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2heX2nUftMoq399HD7-g5A60ZNS6DcZ_0 2024-08-27T03:58:30.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.751+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13801354210353211036', time=2024-08-27T05:20:52.377790+0000, chain.objs.size()=1 2024-08-27T03:58:30.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.751+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hw_10krkvx622JNfUxlpCCdEpzi1qSS_0 2024-08-27T03:58:30.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16223531600155227400', time=2024-08-27T05:20:53.227175+0000, chain.objs.size()=1 2024-08-27T03:58:30.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0UnvCHGFQFotmazFqkTb16rR06i3i0B_0 2024-08-27T03:58:30.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8843878534405186101', time=2024-08-27T05:20:53.570478+0000, chain.objs.size()=1 2024-08-27T03:58:30.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.UJb1ld-6lqSXUoIOYHrRTom-tG5-K8I_0 2024-08-27T03:58:30.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6960065914525392426', time=2024-08-27T05:20:54.567972+0000, chain.objs.size()=1 2024-08-27T03:58:30.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.bL-_p_OZnb1jrdibI9oMLS0aYYcork1_0 2024-08-27T03:58:30.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16381591660069057031', time=2024-08-27T05:20:55.070164+0000, chain.objs.size()=1 2024-08-27T03:58:30.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VUfm6l9f0QH_dx7H3UsFWXE8Az6vXLm_0 2024-08-27T03:58:30.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6196589907823785720', time=2024-08-27T05:20:55.916739+0000, chain.objs.size()=1 2024-08-27T03:58:30.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iJ8kGQbF1j0AUp9NmXPW3AIiBnSmZFU_0 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14790455443035191364', time=2024-08-27T05:20:56.634451+0000, chain.objs.size()=1 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jNjZtmOUlFa3P2pKdxEBqbCfa1nVo2v_0 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12414111704429265472', time=2024-08-27T05:21:02.085688+0000, chain.objs.size()=1 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Az39MEHvkJVwnKlTO1_MFwaK4lOiCiV_0 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16269475042311994303', time=2024-08-27T05:21:03.333740+0000, chain.objs.size()=1 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.IgBU2vFRpbniT1_QbmHNWLUPqaxTUjS_0 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4863846631891894043', time=2024-08-27T05:21:09.478736+0000, chain.objs.size()=1 2024-08-27T03:58:30.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.259__shadow_.QGcCZQlav7I0lt19CiIhueKjuCpym0N_0 2024-08-27T03:58:30.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15816810572972902893', time=2024-08-27T05:21:16.335808+0000, chain.objs.size()=1 2024-08-27T03:58:30.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.263__shadow_.NlxkhXFFOMU8KdjVwFKiH0MudCnUVq9_0 2024-08-27T03:58:30.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8484117526701618696', time=2024-08-27T05:21:39.766946+0000, chain.objs.size()=1 2024-08-27T03:58:30.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.276__shadow_._91Ap_zkDmb6OrkC5o1I7oMd50BcH5z_0 2024-08-27T03:58:30.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10897105716967183949', time=2024-08-27T05:22:02.708685+0000, chain.objs.size()=1 2024-08-27T03:58:30.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.U4sNWddT5oLAnoKvaoLIG5TlflMLiKK_0 2024-08-27T03:58:30.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16154307578036175453', time=2024-08-27T05:22:02.744316+0000, chain.objs.size()=1 2024-08-27T03:58:30.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.MTUeJyg13wUN6rit6O5VHN7S-vccuJP_0 2024-08-27T03:58:30.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11762215337291416138', time=2024-08-27T05:22:03.041822+0000, chain.objs.size()=1 2024-08-27T03:58:30.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.gbI0y35YF69dhSvpkH1uKrInzSF5jo4_0 2024-08-27T03:58:30.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.883389017478767464', time=2024-08-27T05:22:15.624214+0000, chain.objs.size()=1 2024-08-27T03:58:30.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.291__shadow_.0dpskLfrKIZZWjsv4fX4JJiJUIzz6pV_0 2024-08-27T03:58:30.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7300964760023960787', time=2024-08-27T05:22:25.148400+0000, chain.objs.size()=1 2024-08-27T03:58:30.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.296__shadow_.tvYCnqmibiecacgwZRXdrtd2su5k6FV_0 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5630407046249336355', time=2024-08-27T05:22:33.007128+0000, chain.objs.size()=1 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.300__shadow_.WajSttiqsdzjVTBDRqyL7811MQ4zviP_0 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9859295686467453288', time=2024-08-27T05:22:57.647113+0000, chain.objs.size()=1 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.313__shadow:j4Z8o1xupedumkusogvdtqw3PFmm4FP_.obs_Zj73QoTvwJn8sZn0DSuOm46cNyw_0 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1175099006465786900', time=2024-08-27T05:23:03.052796+0000, chain.objs.size()=1 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.316__shadow_.zE2DoQY0YjR8mR8EVXLrkYdmf5OW0h0_0 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5547657398403826031', time=2024-08-27T05:24:46.517200+0000, chain.objs.size()=1 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.lMnrgrAAvXBax694mF8thSoxVLzJPXN_0 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3679769898849264753', time=2024-08-27T05:24:48.945236+0000, chain.objs.size()=1 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SHgXOfDmJZvUggo-olX9kvLfJ0x-PTm_0 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17586319685189190466', time=2024-08-27T05:24:49.215286+0000, chain.objs.size()=1 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DaseYhbtBgKfdq9P4iMgcfBVe_auj1x_0 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.632364773206604800', time=2024-08-27T05:24:49.362189+0000, chain.objs.size()=1 2024-08-27T03:58:30.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RQk6ydtbU-QvsFiV1VEApQfqkS3U7ky_0 2024-08-27T03:58:30.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7014595394208844077', time=2024-08-27T05:24:50.881951+0000, chain.objs.size()=1 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.W-Efgg4pMSXrVaLwNKf77exWww1ZzDv_0 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8141868650748186949', time=2024-08-27T05:24:50.884789+0000, chain.objs.size()=1 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.EDhdhmv9HObWEg-VpbuCTjHL6cYZa3d_0 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17452587373703605869', time=2024-08-27T05:24:51.650837+0000, chain.objs.size()=1 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.WTldaPgN64eWt0qhO2lCPbQU5y6lm1L_0 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2225077601320646236', time=2024-08-27T05:24:54.253006+0000, chain.objs.size()=1 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sjJps-ZJbIP63iZ6ABJzOo0G0Zk11zR_0 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6872355308703083864', time=2024-08-27T05:24:55.517362+0000, chain.objs.size()=1 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mCZywoAUn7LmZPRsIxB-YFYxH7M9_nW_0 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12512409208310443772', time=2024-08-27T05:24:55.635379+0000, chain.objs.size()=1 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.y5saHBMb-sspW_PqE2V6l4hYpZ4iYju_0 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14154737399411053070', time=2024-08-27T05:24:55.858909+0000, chain.objs.size()=1 2024-08-27T03:58:30.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.JsBopazEr-KlGgKad_8CtMLLB8rIcLl_0 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17575922127950260832', time=2024-08-27T05:24:56.311106+0000, chain.objs.size()=1 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BxG-Fx1_WaDQGcOEWTmuxANA1eWWZXW_0 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10730135943963375698', time=2024-08-27T05:24:58.649590+0000, chain.objs.size()=1 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.J-PyRlSoYOGLkVytKVuzPsrVkNE85lE_0 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17134254574636563156', time=2024-08-27T05:24:58.807848+0000, chain.objs.size()=1 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.byDwN7DawTyqRjB5gwveNMZq_inupRJ_0 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18314011535355198194', time=2024-08-27T05:25:00.008514+0000, chain.objs.size()=1 2024-08-27T03:58:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qD4rAxMTy24ffdbwh1i5wEW-sUolYdL_0 2024-08-27T03:58:30.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13254876404911613633', time=2024-08-27T05:25:00.293346+0000, chain.objs.size()=1 2024-08-27T03:58:30.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.NWzQoBr2pN6D7KDK2XWTaT8vS7NCImR_0 2024-08-27T03:58:30.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12281094177732010078', time=2024-08-27T05:25:00.382609+0000, chain.objs.size()=1 2024-08-27T03:58:30.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.EnJ6aEoqs4Jzj-mf0FSGBbT9jAx_rER_0 2024-08-27T03:58:30.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.779+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.122011958392536523', time=2024-08-27T05:25:02.269930+0000, chain.objs.size()=1 2024-08-27T03:58:30.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.oFrgjfiNGfId5ZZws8AlL1R1CNa_Bjk_0 2024-08-27T03:58:30.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.28524715938834480', time=2024-08-27T05:25:05.597932+0000, chain.objs.size()=1 2024-08-27T03:58:30.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AK6PIg3WRZ27tnL5MrZxNjNuGSWyLC2_0 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4732834389577773625', time=2024-08-27T05:25:06.472628+0000, chain.objs.size()=1 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.atdhfUcZfP82iN-mvzcvcK6ZB_xg24X_0 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2929006897260149447', time=2024-08-27T05:25:09.291269+0000, chain.objs.size()=1 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eEkx85JIM5vzsuZszm0a67tpIVmFi8R_0 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11290500717852670970', time=2024-08-27T05:25:09.959793+0000, chain.objs.size()=1 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2yciV6YZZcr0EC8T2HYdpKWi4HHtU1m_0 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8631567998066792191', time=2024-08-27T05:25:10.375541+0000, chain.objs.size()=1 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OhldNFLStaPEN8gGj7lOShZVXnFd25H_0 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16664235497000581350', time=2024-08-27T05:25:10.883968+0000, chain.objs.size()=1 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ji0NimoyObhYmJHeQTirI1RjC1ao8Fj_0 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18201183716988062320', time=2024-08-27T05:25:11.188619+0000, chain.objs.size()=1 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-4sUbGatLamvz8vhpRk_7LPbgqQlhZD_0 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9219716583058582901', time=2024-08-27T05:25:11.411247+0000, chain.objs.size()=1 2024-08-27T03:58:30.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.y-rvArJyvPw8V9DMszPX7BkRX2zFXZS_0 2024-08-27T03:58:30.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2791989412596395986', time=2024-08-27T05:25:11.499509+0000, chain.objs.size()=1 2024-08-27T03:58:30.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._E60JbcD6gZoXY1bMMzXCBgF6emhDnh_0 2024-08-27T03:58:30.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1595588975470929202', time=2024-08-27T05:25:12.211246+0000, chain.objs.size()=1 2024-08-27T03:58:30.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yXDV_PUKC7Ke1lWjTo6AeGrWuw1_sWV_0 2024-08-27T03:58:30.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6998585520630683163', time=2024-08-27T05:25:12.318800+0000, chain.objs.size()=1 2024-08-27T03:58:30.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.A0lB_VOmzUDJD-grzfHos22ige0pEvh_0 2024-08-27T03:58:30.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14617840065287629880', time=2024-08-27T05:25:13.652963+0000, chain.objs.size()=1 2024-08-27T03:58:30.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OFQvJUFlge7hDZMviYg1jXf173YVFpw_0 2024-08-27T03:58:30.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3367611971045153906', time=2024-08-27T05:25:13.769700+0000, chain.objs.size()=1 2024-08-27T03:58:30.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6n7CeFYR7TllfibBrUKR4MPrMYNIbC0_0 2024-08-27T03:58:30.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12378928197327902847', time=2024-08-27T05:25:14.167207+0000, chain.objs.size()=1 2024-08-27T03:58:30.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KwMmHlNzh2MIvdw_OoWVe4JC5jsPGiH_0 2024-08-27T03:58:30.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7438415393381617507', time=2024-08-27T05:25:14.170544+0000, chain.objs.size()=1 2024-08-27T03:58:30.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5U-kpUPv88YP8kXlU0s_7koIO5oeGvm_0 2024-08-27T03:58:30.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5635588009205043084', time=2024-08-27T05:25:14.172809+0000, chain.objs.size()=1 2024-08-27T03:58:30.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Lbll_kVA0T-pNwFqe0KvfoPBbA8ByF3_0 2024-08-27T03:58:30.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7325953403864167442', time=2024-08-27T05:26:57.749916+0000, chain.objs.size()=1 2024-08-27T03:58:30.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vu4sRbz0w37nGAA4qop3w8UEAorHssh_0 2024-08-27T03:58:30.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2559199854519320331', time=2024-08-27T05:26:58.072049+0000, chain.objs.size()=1 2024-08-27T03:58:30.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hPfy9Sevn3WhnlVUwlCpZhAl9wSJoeQ_0 2024-08-27T03:58:30.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14810099812952741999', time=2024-08-27T05:26:58.106386+0000, chain.objs.size()=1 2024-08-27T03:58:30.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Q0vyjLhj63-WcrWwoxxuktNYxnqQrm0_0 2024-08-27T03:58:30.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.473752294571212743', time=2024-08-27T05:26:58.190308+0000, chain.objs.size()=1 2024-08-27T03:58:30.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JEgDehmfhiLrJWClPGp23gbf4yNzheV_0 2024-08-27T03:58:30.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3629959592214091717', time=2024-08-27T05:26:58.193488+0000, chain.objs.size()=1 2024-08-27T03:58:30.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zpf5U05M3XKTRlWpd_9bPwu7HB2cz_2_0 2024-08-27T03:58:30.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12195545129900801302', time=2024-08-27T05:26:59.261326+0000, chain.objs.size()=1 2024-08-27T03:58:30.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Bskd9husqWod88swkvQBHaE9oaI_8o7_0 2024-08-27T03:58:30.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3476704427124106296', time=2024-08-27T05:26:59.802000+0000, chain.objs.size()=1 2024-08-27T03:58:30.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZNZn9Tn2--r1bXIwmmrvbS0gvnKbPlh_0 2024-08-27T03:58:30.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8124781316062692833', time=2024-08-27T05:27:01.994946+0000, chain.objs.size()=1 2024-08-27T03:58:30.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.G3R8_LQpq69cDgAo9XshGhBrTjg5t2j_0 2024-08-27T03:58:30.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3512631394587347033', time=2024-08-27T05:27:02.335670+0000, chain.objs.size()=1 2024-08-27T03:58:30.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5eIH2PGKOXlgo8HEXNASCODTNx_-QjC_0 2024-08-27T03:58:30.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4231223705508316853', time=2024-08-27T05:27:02.485355+0000, chain.objs.size()=1 2024-08-27T03:58:30.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.72hMZHApSY_loZgyP2i913-U_5cA7fc_0 2024-08-27T03:58:30.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15915728648650020027', time=2024-08-27T05:27:03.233813+0000, chain.objs.size()=1 2024-08-27T03:58:30.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mb51h4fNXObRmq7HqUcb9AcWEiaKKZi_0 2024-08-27T03:58:30.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18317160638609664072', time=2024-08-27T05:27:03.696089+0000, chain.objs.size()=1 2024-08-27T03:58:30.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vrVVXTS6rYlpvB2DYTZND0OJ8J5LqoG_0 2024-08-27T03:58:30.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11834785235983975512', time=2024-08-27T05:27:07.597932+0000, chain.objs.size()=1 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HA9lJ0ZIG2NuPCcklB_zh6x3HBz73xh_0 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10956287971132391102', time=2024-08-27T05:27:07.722522+0000, chain.objs.size()=1 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N_ARE5kFxpjwoFaYEl6Ji734BjpfmaE_0 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.395432280877871244', time=2024-08-27T05:27:07.724834+0000, chain.objs.size()=1 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pO05qjKG6Ou-wbLWUUg70wsljcPqPtV_0 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12000364354266850976', time=2024-08-27T05:27:09.155973+0000, chain.objs.size()=1 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-t7CvrUkDE0ZKdUw53G19B7LCiHeEFI_0 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17400205231263254238', time=2024-08-27T05:27:09.293251+0000, chain.objs.size()=1 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cejeH9ZveItyKR-utNPimJ07uHfpszV_0 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16128289008011145945', time=2024-08-27T05:27:09.295472+0000, chain.objs.size()=1 2024-08-27T03:58:30.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jkFBOEBFb0q3nXljX81lEdKDb8bAZZo_0 2024-08-27T03:58:30.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.799+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7970588361147336877', time=2024-08-27T05:27:10.789455+0000, chain.objs.size()=1 2024-08-27T03:58:30.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.799+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6CnhlP19d9xUmvojqtrcH4aIfewFko0_0 2024-08-27T03:58:30.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.799+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18067285732285030132', time=2024-08-27T05:27:11.154867+0000, chain.objs.size()=1 2024-08-27T03:58:30.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.799+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7K2c3TyteJlMKAicrH1LndIVO1slcpf_0 2024-08-27T03:58:30.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2229008439837564045', time=2024-08-27T05:27:11.162493+0000, chain.objs.size()=1 2024-08-27T03:58:30.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zTbDoXmKH9poRuMo9xUSojdlCgRQ5Jp_0 2024-08-27T03:58:30.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48909 2024-08-27T03:58:30.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-08-27T03:58:30.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6115253259441404842', time=2024-08-27T05:27:11.311886+0000, chain.objs.size()=1 2024-08-27T03:58:30.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fw2Jq7rNHdP3CNBZiDbfyjUztcX_z0W_0 2024-08-27T03:58:30.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3570491275956024987', time=2024-08-27T05:27:11.949117+0000, chain.objs.size()=1 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.kGNPAU0Pz0TqPEKVfhfAHB6x-3-Ugih_0 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2197281628923068653', time=2024-08-27T05:27:13.725244+0000, chain.objs.size()=1 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.IMsO55EcqG4W3wPqmhcNhefYNSCOq_a_0 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10391522307384490410', time=2024-08-27T05:27:14.374116+0000, chain.objs.size()=1 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wsGULTb5COmFHxlBY_sd93N-gQ4t4CW_0 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1306249053883993134', time=2024-08-27T05:27:18.103709+0000, chain.objs.size()=1 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-VYrLk4Ic8OWMApyKk1ZMhOcB7XTBOR_0 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7847124911493534530', time=2024-08-27T05:27:18.253581+0000, chain.objs.size()=1 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LMfh8dMK-D-CHiGcCjxpUDua8huw89h_0 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8114278393861520401', time=2024-08-27T05:27:19.195450+0000, chain.objs.size()=1 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HnaWW9WlhFjWOtthOMIUbzg1Yeeef-D_0 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2524462449834593461', time=2024-08-27T05:27:19.254527+0000, chain.objs.size()=1 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AL2C_EJvldXHEQjqw-DCt47IMa3XTGl_0 2024-08-27T03:58:30.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10471014207780100327', time=2024-08-27T05:27:19.279870+0000, chain.objs.size()=1 2024-08-27T03:58:30.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MXuef6Q8OjZ7ZQt74xKsuIlCmbbcTl6_0 2024-08-27T03:58:30.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17687459397330080514', time=2024-08-27T05:27:20.070097+0000, chain.objs.size()=1 2024-08-27T03:58:30.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xqHoTLykEY5bZT2j7UgGRTP5qxdfVtJ_0 2024-08-27T03:58:30.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4954262510607528808', time=2024-08-27T05:27:20.074511+0000, chain.objs.size()=1 2024-08-27T03:58:30.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.t2xkOxrfw9qYDUspmk9Cl5RvE4t5rzm_0 2024-08-27T03:58:30.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9384126896302356809', time=2024-08-27T05:27:21.274386+0000, chain.objs.size()=1 2024-08-27T03:58:30.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._-hjKha57pD_IVJ-fHQd2buaDmgPL0j_0 2024-08-27T03:58:30.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7663387442066657589', time=2024-08-27T05:27:22.526365+0000, chain.objs.size()=1 2024-08-27T03:58:30.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.YhBIR6MXZA0nNZII-fXmLFEOCU7rN0B_0 2024-08-27T03:58:30.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17104105938182573317', time=2024-08-27T05:27:22.678185+0000, chain.objs.size()=1 2024-08-27T03:58:30.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7xyTQy-JyD7ad_0GuAH-lyL3xXkhcFO_0 2024-08-27T03:58:30.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7941201700804130916', time=2024-08-27T05:27:24.563980+0000, chain.objs.size()=1 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7q8Ypj9_TUH8JzrmXp5S2jbFJSzOZoP_0 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17164362666282000355', time=2024-08-27T05:27:25.730858+0000, chain.objs.size()=1 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zNVQE5fTAZ8xzk8V-LJxkneXy30YVrA_0 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11268040500243469162', time=2024-08-27T05:27:25.975633+0000, chain.objs.size()=1 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RUYqsddx96iDJmikwEuhtpDfQjlTjWl_0 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10395973803091270775', time=2024-08-27T05:27:48.264890+0000, chain.objs.size()=1 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.333__shadow_.XKgmPGEay1YESmHq6zttkXDMR_CJKTe_0 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2091300967573212172', time=2024-08-27T05:30:51.218003+0000, chain.objs.size()=1 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.453__shadow_.ebJQd9JCBLA1-nqT9KcqQK0Od2Ljiye_0 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8629155362912712651', time=2024-08-27T05:31:02.376190+0000, chain.objs.size()=1 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.458__shadow_.Q3DGcKh0SAL0u26jcqD9Kp3Rkykon53_0 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17338413918667533447', time=2024-08-27T05:31:07.162646+0000, chain.objs.size()=1 2024-08-27T03:58:30.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.460__shadow_.Iu2eE6nvZd26zlIO8Mnn0pXPsyDyFT2_0 2024-08-27T03:58:30.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6192738093028537405', time=2024-08-27T05:31:23.213300+0000, chain.objs.size()=1 2024-08-27T03:58:30.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.475__shadow_.HGvVc2r7M0SuKk2F9dENNDXDo9kXZCp_0 2024-08-27T03:58:30.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17296450877190655946', time=2024-08-27T05:31:30.610800+0000, chain.objs.size()=1 2024-08-27T03:58:30.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.478__shadow_.g5DqYf4T1sMxDTLzndJersFgbpex82-_0 2024-08-27T03:58:30.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9626688348098832395', time=2024-08-27T05:32:31.837402+0000, chain.objs.size()=1 2024-08-27T03:58:30.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.508__shadow_.3cYont9rIDQ9CrD-VkGuISIeX_V9SKt_0 2024-08-27T03:58:30.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Bk2CaovXlMatUe0sSFnmplS0iIU27Sr', time=2024-08-27T05:33:48.801775+0000, chain.objs.size()=1 2024-08-27T03:58:30.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~Bk2CaovXlMatUe0sSFnmplS0iIU27Sr.2 2024-08-27T03:58:30.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4135834780535850719', time=2024-08-27T05:35:19.083389+0000, chain.objs.size()=3 2024-08-27T03:58:30.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~1tnPAAh-x01f3L1iHdDX3Xaqi9ElgVc.1 2024-08-27T03:58:30.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~1tnPAAh-x01f3L1iHdDX3Xaqi9ElgVc.2 2024-08-27T03:58:30.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~1tnPAAh-x01f3L1iHdDX3Xaqi9ElgVc.3 2024-08-27T03:58:30.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~5Vfq_uSrlm3SP7KsACvKFiuMdZewWoN', time=2024-08-27T05:37:30.715920+0000, chain.objs.size()=1 2024-08-27T03:58:30.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.555__multipart_mymultipart.2~5Vfq_uSrlm3SP7KsACvKFiuMdZewWoN.1 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15454404065903618087', time=2024-08-27T05:37:49.558586+0000, chain.objs.size()=1 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:cUqfRNFlOXqWph.CNDTaaafOKGFKkA6_.8YQ51R6-4RlMfzzSkDvtzYnz8TPkdTO_0 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12422909960098232939', time=2024-08-27T05:37:53.439261+0000, chain.objs.size()=1 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:rQN3vfAfjBTY2Cbids4mVZRW41m4H2u_.LEqzWhlCtDSjI-5c_IaCXmxOgCh89fL_0 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2329759353463922996', time=2024-08-27T05:38:23.832076+0000, chain.objs.size()=1 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow_.IlO28hriN7CPp4GIs3SwqfGFkXZvrm1_0 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2658313382802700419', time=2024-08-27T05:38:54.140922+0000, chain.objs.size()=1 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:ppWyZ1WyeYyM6EMMmYPYiQwRVnMPVLV_.e2pqThHcMcf5NsWBMxn24_0fR5_sPhx_0 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1523774026267671490', time=2024-08-27T05:39:05.104270+0000, chain.objs.size()=1 2024-08-27T03:58:30.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:BohJRdSOJknGAX2xJZd1KNE.khsSeJY_.rZTjkMCrAPn4nKww0YiEnkU8JSRttDC_0 2024-08-27T03:58:30.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11539695551586314805', time=2024-08-27T05:39:20.261874+0000, chain.objs.size()=1 2024-08-27T03:58:30.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:rYrYm2VOos8ZQnt12RxvHp-G6tdVZ2G_.-HiKsQwH0wfj907XkgE8hTHFWGeVebi_0 2024-08-27T03:58:30.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4874028116225244629', time=2024-08-27T05:45:53.142462+0000, chain.objs.size()=1 2024-08-27T03:58:30.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.639__shadow_.HH_hVlIvUCVfywkDm_9DBz-Q3GXc9Hh_0 2024-08-27T03:58:30.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-08-27T03:58:30.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48028' 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12347322237001416836', time=2024-08-27T05:13:11.877323+0000, chain.objs.size()=2 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.152__shadow_.aoq66RGPYxKq_K_4RqlTBLX0sRMhl6z_0 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.152__shadow_.aoq66RGPYxKq_K_4RqlTBLX0sRMhl6z_1 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1160203412890259485', time=2024-08-27T05:13:18.583867+0000, chain.objs.size()=3 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-FROZEN.2~BfG9g1xRzhCL_EZNgpTX4WUK2F0lAHU.1 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-FROZEN.2~BfG9g1xRzhCL_EZNgpTX4WUK2F0lAHU.2 2024-08-27T03:58:30.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.153__multipart_mymultipart-FROZEN.2~BfG9g1xRzhCL_EZNgpTX4WUK2F0lAHU.3 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_vzgInkxJ7gycZ9LP6tb7Qt70Gcz2j4O', time=2024-08-27T05:13:27.854373+0000, chain.objs.size()=2 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.7E3-R2sopFfJIo8umQafgRMrVwaki_K_0 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.7E3-R2sopFfJIo8umQafgRMrVwaki_K_1 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18223086941699720006', time=2024-08-27T05:18:02.622656+0000, chain.objs.size()=1 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.229__shadow_.97V9wUvmMUFI3aESDa0L7tB57A0nQy9_0 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5811534561737993951', time=2024-08-27T05:18:33.011924+0000, chain.objs.size()=1 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.244__shadow_.-9-AFo0-lk4hqhb0H8IfgCxfyXCF71J_0 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3452663943388974519', time=2024-08-27T05:20:36.251157+0000, chain.objs.size()=1 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8APId0dkXIjghD1AwHJh9xawto3Mix1_0 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9044495288673670518', time=2024-08-27T05:20:36.957816+0000, chain.objs.size()=1 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sGOWlrL0ZiVhbQNZqrm2UClxQrKfe1L_0 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14886779127709888850', time=2024-08-27T05:20:38.128460+0000, chain.objs.size()=1 2024-08-27T03:58:30.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fQup_77ydmXZcszf1pI_WUogloLTSop_0 2024-08-27T03:58:30.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17948738671383607655', time=2024-08-27T05:20:38.164066+0000, chain.objs.size()=1 2024-08-27T03:58:30.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.D9GRCHxiuLm7ccna0u2TuzxJuHTiUgg_0 2024-08-27T03:58:30.840 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4521853686452449023', time=2024-08-27T05:20:39.587298+0000, chain.objs.size()=1 2024-08-27T03:58:30.840 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8AWBOZh9P7H54fy65a-Cn6xvU5sqiaK_0 2024-08-27T03:58:30.840 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12337725963721562792', time=2024-08-27T05:20:40.276167+0000, chain.objs.size()=1 2024-08-27T03:58:30.840 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Nu_uARcVRFaRXBy3EV9pyS4lnQ1gbZY_0 2024-08-27T03:58:30.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7167462398591916136', time=2024-08-27T05:20:41.368261+0000, chain.objs.size()=1 2024-08-27T03:58:30.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ksUSuNIzn7PeQGD7Byk7c901jR-BbE2_0 2024-08-27T03:58:30.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15631250648761491196', time=2024-08-27T05:20:43.224036+0000, chain.objs.size()=1 2024-08-27T03:58:30.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ETGCjdXYlS7SqqH3mqpHTJfEddX-M2N_0 2024-08-27T03:58:30.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3199043328118957735', time=2024-08-27T05:20:43.718885+0000, chain.objs.size()=1 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Go8SyVv15AC1N5cy4jXLuvH5F8M_6HK_0 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10147482030940966410', time=2024-08-27T05:20:46.041119+0000, chain.objs.size()=1 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VjjqPzzN1NQV7ZmfBnTt0plny_iMDdx_0 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12070100548801475676', time=2024-08-27T05:20:47.906959+0000, chain.objs.size()=1 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ms1ZPxbhi6vMTgJGYOjgt3EIZ06vkef_0 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16706739693559145292', time=2024-08-27T05:20:48.064338+0000, chain.objs.size()=1 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.wkGeg_e5DN0f41mOKEZ-8CHW60f7SR5_0 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.897587296182167637', time=2024-08-27T05:20:48.684294+0000, chain.objs.size()=1 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.a6cmKM-Kzvic2KLlboDlOWSEqNjrcKe_0 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6255917051697056330', time=2024-08-27T05:20:48.945061+0000, chain.objs.size()=1 2024-08-27T03:58:30.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.U_FKzP-eFwYV3r0hgjZYZZGxBbxW2aC_0 2024-08-27T03:58:30.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15260220250175019805', time=2024-08-27T05:20:49.216531+0000, chain.objs.size()=1 2024-08-27T03:58:30.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CD23cE9P6NwzeELML8jIb528q97QZqN_0 2024-08-27T03:58:30.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2622139152137284456', time=2024-08-27T05:20:49.828892+0000, chain.objs.size()=1 2024-08-27T03:58:30.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QVCi74RJk0x_ih7sEkjNrY9703_VsMf_0 2024-08-27T03:58:30.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2277414893214020156', time=2024-08-27T05:20:52.550310+0000, chain.objs.size()=1 2024-08-27T03:58:30.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WW1JytK7CW3SvV4unHlSZFsPkTBUgyu_0 2024-08-27T03:58:30.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17291339293532101094', time=2024-08-27T05:20:53.137747+0000, chain.objs.size()=1 2024-08-27T03:58:30.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BF74ZZWsW8cGznom3olP-7qg6RqNeK4_0 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17996948634911098819', time=2024-08-27T05:20:54.602266+0000, chain.objs.size()=1 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JHW_BbijLB0CyJkdXeXRFFytsMu6V28_0 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6157887712639962305', time=2024-08-27T05:20:56.205852+0000, chain.objs.size()=1 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zi8H-rk02e_97koBJo5J8OO6dyPYJ1M_0 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11117059694900895064', time=2024-08-27T05:20:56.277623+0000, chain.objs.size()=1 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lr7dgDFzyxfy8qf4vYOgJHTKli5GU04_0 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10299611027465827330', time=2024-08-27T05:20:58.280691+0000, chain.objs.size()=1 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ya5SiQqZFXnwXJEJcwqRNhB_FnoY5at_0 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4817287048232639651', time=2024-08-27T05:21:00.251036+0000, chain.objs.size()=1 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vBczlKyGbBNWHhDs_NYy6IF6-HtLpFt_0 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12935641086566640457', time=2024-08-27T05:21:00.951488+0000, chain.objs.size()=1 2024-08-27T03:58:30.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XSpqmQQ5g5VxI35FBJkN97-xHBEncIQ_0 2024-08-27T03:58:30.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4193121560606103404', time=2024-08-27T05:21:01.720960+0000, chain.objs.size()=1 2024-08-27T03:58:30.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9VkdhEw-AO7nEN1hHrvq4i2863P85DE_0 2024-08-27T03:58:30.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10799061822152019490', time=2024-08-27T05:21:02.318256+0000, chain.objs.size()=1 2024-08-27T03:58:30.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MILK0Sf3StK_4s5wHYmqYLbnqC04bfe_0 2024-08-27T03:58:30.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4783413035367572778', time=2024-08-27T05:21:02.961232+0000, chain.objs.size()=1 2024-08-27T03:58:30.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9s6DE1536KbzWTBp3kBzpslqztf58eM_0 2024-08-27T03:58:30.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11901798790789110598', time=2024-08-27T05:21:14.583994+0000, chain.objs.size()=1 2024-08-27T03:58:30.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.262__shadow_.w1reLqm3tRCot13pk66d3YfL5Zvjnz4_0 2024-08-27T03:58:30.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15104857148032762361', time=2024-08-27T05:21:28.684234+0000, chain.objs.size()=1 2024-08-27T03:58:30.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.270__shadow_.VzhvB5kXDp0ASVDNfrZVvg8eWTy57Fp_0 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18267104621415143329', time=2024-08-27T05:21:32.379782+0000, chain.objs.size()=1 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.272__shadow_.mdCY48unaVfmyoULIsv8tL1e2UrEFay_0 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4823505638309776885', time=2024-08-27T05:21:36.114854+0000, chain.objs.size()=1 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.274__shadow_.XipJ532q7yT52FMAp641Nkq7dc9NY3e_0 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3084221132523504478', time=2024-08-27T05:21:48.190021+0000, chain.objs.size()=1 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.280__shadow_.0LjsAk3afIxEwMeqem8Q0v_wytAuFPI_0 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15579676771804187858', time=2024-08-27T05:22:02.785739+0000, chain.objs.size()=1 2024-08-27T03:58:30.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.dARmT4qqX8qZDCDQ7hjsV8JZXdgV133_0 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14212627178281037690', time=2024-08-27T05:22:17.610354+0000, chain.objs.size()=1 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.292__shadow_._HfplEKyEoDNo7oEpto9dw4m2ET-wDa_0 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17610285352156040176', time=2024-08-27T05:22:35.888540+0000, chain.objs.size()=1 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.301__shadow:GHqKZ8Lrz6DwnrzNwAbl3UfUgHyFS-g_.jSB-Ya1VocVYBFbmAygGqdzuLknS4_9_0 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8908839849729798172', time=2024-08-27T05:22:57.536500+0000, chain.objs.size()=1 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.313__shadow:cSJE6.BJtnWjGinMpBXV8kFgDrwcHHK_.f1ps2sogqOXCwspoY6np7RkYVG_wlCd_0 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2182910021163105944', time=2024-08-27T05:24:48.146394+0000, chain.objs.size()=1 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.u5S61KGJ5iQDWkQhBPT6xci20kBxUNZ_0 2024-08-27T03:58:30.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17513961411928788783', time=2024-08-27T05:24:48.453549+0000, chain.objs.size()=1 2024-08-27T03:58:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.E9tGu33zvUw3ivv7cHJNvVK0QhavLVz_0 2024-08-27T03:58:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4527470048682533755', time=2024-08-27T05:24:48.751997+0000, chain.objs.size()=1 2024-08-27T03:58:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.I5p82X7CKIL6ZuFFsaBlN5o1Q5BJUNb_0 2024-08-27T03:58:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14288384330573610487', time=2024-08-27T05:24:53.113548+0000, chain.objs.size()=1 2024-08-27T03:58:30.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.q_KKqSi3XQNuDI_0s8Wt0wihxTwAV6U_0 2024-08-27T03:58:30.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7274367284006781551', time=2024-08-27T05:24:54.362487+0000, chain.objs.size()=1 2024-08-27T03:58:30.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QeUl6RIPicnwQHoq2UKwkTdhVY1hp0w_0 2024-08-27T03:58:30.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12397623747857739533', time=2024-08-27T05:24:55.885666+0000, chain.objs.size()=1 2024-08-27T03:58:30.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.pID3mI5Vps79uB6OpAs33Kkt1EZlCzd_0 2024-08-27T03:58:30.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12942300756056853879', time=2024-08-27T05:24:56.161962+0000, chain.objs.size()=1 2024-08-27T03:58:30.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LJJhyObFvA7qcJX7Xpf_KDSgQwrf1hW_0 2024-08-27T03:58:30.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1718575602714115629', time=2024-08-27T05:24:56.302674+0000, chain.objs.size()=1 2024-08-27T03:58:30.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2zBaOgHeykn14zLJ9BVEDPQ7fFO5g92_0 2024-08-27T03:58:30.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14688386893998302532', time=2024-08-27T05:24:56.543810+0000, chain.objs.size()=1 2024-08-27T03:58:30.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QGJHzZXk8EA2tGA2T2bvfGQ2_5RR4eq_0 2024-08-27T03:58:30.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3983625211941510498', time=2024-08-27T05:24:56.741059+0000, chain.objs.size()=1 2024-08-27T03:58:30.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3398r4-ifaTyq17RQ2XrYCZIEqI91GE_0 2024-08-27T03:58:30.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4709856001584233835', time=2024-08-27T05:24:58.053230+0000, chain.objs.size()=1 2024-08-27T03:58:30.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vx-1RShrzeFn-zC_ZdDbdpkE33ieqbk_0 2024-08-27T03:58:30.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16828274387155972577', time=2024-08-27T05:24:58.588926+0000, chain.objs.size()=1 2024-08-27T03:58:30.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.L4aE1I6f6P2-l4s-w8ZJiCTtiuzwzzv_0 2024-08-27T03:58:30.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9463475936377848160', time=2024-08-27T05:24:59.215458+0000, chain.objs.size()=1 2024-08-27T03:58:30.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.tkmd9EodiDJ1Jy3NOaFns9cln5afPJ1_0 2024-08-27T03:58:30.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16863679836281669105', time=2024-08-27T05:25:02.222679+0000, chain.objs.size()=1 2024-08-27T03:58:30.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9GzT4j3AJLDMBYvWkf_-RzekOA1M6ud_0 2024-08-27T03:58:30.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8705616996286441157', time=2024-08-27T05:25:02.985252+0000, chain.objs.size()=1 2024-08-27T03:58:30.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YQZTw9otNYYhADRBwGPAzGCAJyj-APM_0 2024-08-27T03:58:30.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7422414245097813938', time=2024-08-27T05:25:03.356609+0000, chain.objs.size()=1 2024-08-27T03:58:30.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yoE8QFeU1dFi1LXFZx68jgX_QMlnmcK_0 2024-08-27T03:58:30.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.623397176389399212', time=2024-08-27T05:25:07.581838+0000, chain.objs.size()=1 2024-08-27T03:58:30.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.oo2SDwtudcDV8CbiJ86L8_SMJRxv2Ki_0 2024-08-27T03:58:30.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6372829808918633193', time=2024-08-27T05:25:07.802088+0000, chain.objs.size()=1 2024-08-27T03:58:30.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mnhzFy_PRvyHHrCVnn2l4l1nqUFSYGh_0 2024-08-27T03:58:30.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10911683987285757466', time=2024-08-27T05:25:08.056457+0000, chain.objs.size()=1 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GvWpvx9UQukmBN5hLAR1DbYaTBYNFYn_0 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16646050525440981291', time=2024-08-27T05:25:09.640550+0000, chain.objs.size()=1 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.o1gjWXzYzQLPtmJLTyqbQWX2YT4Hfe1_0 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5007489915668733016', time=2024-08-27T05:25:09.808096+0000, chain.objs.size()=1 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jamxm_0iidCjDtRhxJIutJsNltRjKe1_0 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7863563230739589827', time=2024-08-27T05:25:09.938641+0000, chain.objs.size()=1 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jLXpYnhdrVRu-Fxt18yN9a1kPDstkfu_0 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11958198326752138203', time=2024-08-27T05:25:10.144831+0000, chain.objs.size()=1 2024-08-27T03:58:30.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.WQiy_lLuNzrcwBnNXIxteK96MMtetLH_0 2024-08-27T03:58:30.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.362236755748476968', time=2024-08-27T05:25:12.407726+0000, chain.objs.size()=1 2024-08-27T03:58:30.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rSdXhbP8np0dnm_yKM92UVJXUWZY9Nk_0 2024-08-27T03:58:30.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4165690416323017338', time=2024-08-27T05:25:13.099650+0000, chain.objs.size()=1 2024-08-27T03:58:30.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YTTNtJEMujD_6j-ALuG2zhidKMwVGBY_0 2024-08-27T03:58:30.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15460173733896041583', time=2024-08-27T05:25:13.257823+0000, chain.objs.size()=1 2024-08-27T03:58:30.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Z-zqr0ieTBnn88MuzayC2tO3YNE4qSw_0 2024-08-27T03:58:30.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16501940907645755656', time=2024-08-27T05:25:14.376264+0000, chain.objs.size()=1 2024-08-27T03:58:30.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YXTvPCDlbq6QwMLK-PTf2eSHI-6Y32v_0 2024-08-27T03:58:30.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.183109428624362573', time=2024-08-27T05:26:59.519334+0000, chain.objs.size()=1 2024-08-27T03:58:30.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.IN3zmXTEd5Q_6914f16O3JU-pojFwWR_0 2024-08-27T03:58:30.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17450436398594755273', time=2024-08-27T05:26:59.885220+0000, chain.objs.size()=1 2024-08-27T03:58:30.871 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pxmEhMg36Tps2GmOeNllT4L5d-5EXgO_0 2024-08-27T03:58:30.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14058750855127489766', time=2024-08-27T05:27:00.176100+0000, chain.objs.size()=1 2024-08-27T03:58:30.872 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.867+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.il9KQzMbKhCQsGfAaEjqKoMJ7wD0hUF_0 2024-08-27T03:58:30.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581188321273169066', time=2024-08-27T05:27:04.095206+0000, chain.objs.size()=1 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Vv35HsQybSavZCABSTuSawrLrXcII9Z_0 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10349926439092582296', time=2024-08-27T05:27:04.401561+0000, chain.objs.size()=1 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Iprmz3vJz62vQQjkmp-SJ6Ee67seScA_0 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.756789723238296061', time=2024-08-27T05:27:05.463081+0000, chain.objs.size()=1 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.73U8h73v3KH3utjL0J8Mb4zYVJ71Efn_0 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17711194474288288896', time=2024-08-27T05:27:05.784640+0000, chain.objs.size()=1 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QSFIrCbI-MScOiBWxltpqDSgBF3Ij1-_0 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6658584830689124769', time=2024-08-27T05:27:06.196487+0000, chain.objs.size()=1 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3it4H6FW93oWxWaga2OmZLGFJ4fiu8e_0 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16202050960582727860', time=2024-08-27T05:27:07.736152+0000, chain.objs.size()=1 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VfC38GbA8q1vabZY2881kqXlipmW0LI_0 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14871404585698297045', time=2024-08-27T05:27:09.249198+0000, chain.objs.size()=1 2024-08-27T03:58:30.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.W9WYAYP2SyvOMtzO3qPxViRdTSDMBZ4_0 2024-08-27T03:58:30.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6907619265466433581', time=2024-08-27T05:27:09.664416+0000, chain.objs.size()=1 2024-08-27T03:58:30.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7nBoCSzBtxNtLeM3xhU-XjuNU5-Y0e6_0 2024-08-27T03:58:30.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14887426414411479810', time=2024-08-27T05:27:10.333765+0000, chain.objs.size()=1 2024-08-27T03:58:30.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Nuum0jB3tx4bAv2JZoX589JWJNlvdgr_0 2024-08-27T03:58:30.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6648648799215084336', time=2024-08-27T05:27:10.806304+0000, chain.objs.size()=1 2024-08-27T03:58:30.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.g31-Cn8ZmtUFKsWjM29ViN7nJS_Rqm__0 2024-08-27T03:58:30.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10982683459699445711', time=2024-08-27T05:27:11.839894+0000, chain.objs.size()=1 2024-08-27T03:58:30.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uQJyNZkf2eK_TePtRuE0xBEDNfJSBA9_0 2024-08-27T03:58:30.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13229132270411991160', time=2024-08-27T05:27:12.905558+0000, chain.objs.size()=1 2024-08-27T03:58:30.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KL2vVKCXQrLlGCi6WRk0JH4Ts9FE45p_0 2024-08-27T03:58:30.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7420949789376313353', time=2024-08-27T05:27:13.310707+0000, chain.objs.size()=1 2024-08-27T03:58:30.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qqSMGSv6KReJcSg_BUCvFPPZzb48Jre_0 2024-08-27T03:58:30.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10012148800817595343', time=2024-08-27T05:27:13.784153+0000, chain.objs.size()=1 2024-08-27T03:58:30.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.875+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1q6TByF7mDiTN9SQpy-sEYm4U9yvDT8_0 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9792294000897321933', time=2024-08-27T05:27:15.160300+0000, chain.objs.size()=1 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.PRiZFlNmzoeQchGm8EXRZ6Vdt5xKQVW_0 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7371551725518116815', time=2024-08-27T05:27:16.976837+0000, chain.objs.size()=1 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6iYJqFP7NMqDzqqD7LUVFST4BUOmgZL_0 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1565166440366645578', time=2024-08-27T05:27:18.433576+0000, chain.objs.size()=1 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.brCmyIGaoDfOObletwDQO8gbkbLgwJy_0 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9889686479367541119', time=2024-08-27T05:27:18.795586+0000, chain.objs.size()=1 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.yTR7vVtT30DmIvZM5jLpkrQH1wsWlnn_0 2024-08-27T03:58:30.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4132926794337263581', time=2024-08-27T05:27:20.174071+0000, chain.objs.size()=1 2024-08-27T03:58:30.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.J5bvo9Pzv5PsihXxjkWmyETw2gS-aMN_0 2024-08-27T03:58:30.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11403307091280283186', time=2024-08-27T05:27:20.175859+0000, chain.objs.size()=1 2024-08-27T03:58:30.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZQGdwacmppKPecC9z_zf6HmzQHzP2FT_0 2024-08-27T03:58:30.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6317902554168756905', time=2024-08-27T05:27:21.421751+0000, chain.objs.size()=1 2024-08-27T03:58:30.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rjizydPM3WBinITat0-jgG_JpYcMfVB_0 2024-08-27T03:58:30.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10988434880380520066', time=2024-08-27T05:27:21.522308+0000, chain.objs.size()=1 2024-08-27T03:58:30.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.879+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TYmeRkxC45DIWXjHNZHPZuu4bDrFT8d_0 2024-08-27T03:58:30.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1309741323415881118', time=2024-08-27T05:27:21.745035+0000, chain.objs.size()=1 2024-08-27T03:58:30.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.t9n1lKaVRLgdllgKeSLg4LNP0tZUumo_0 2024-08-27T03:58:30.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17359552654692894051', time=2024-08-27T05:27:21.807949+0000, chain.objs.size()=1 2024-08-27T03:58:30.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Xvs2n-FfiZsGSLb4b87MwVYl4EzPcYw_0 2024-08-27T03:58:30.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13901683247515561332', time=2024-08-27T05:27:21.811733+0000, chain.objs.size()=1 2024-08-27T03:58:30.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mxKmuY1K_UKpW_eYli8JfMwdZd0og3I_0 2024-08-27T03:58:30.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15996464299703091166', time=2024-08-27T05:27:22.289696+0000, chain.objs.size()=1 2024-08-27T03:58:30.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.L039-Q6LuuX5EhUTqZ1vMrh3XtMFEmS_0 2024-08-27T03:58:30.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14808976711018264382', time=2024-08-27T05:27:22.996661+0000, chain.objs.size()=1 2024-08-27T03:58:30.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.F52qrq_wioHgmWMe0WQRIUh3R6wXFC-_0 2024-08-27T03:58:30.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11846541497432081393', time=2024-08-27T05:27:23.030170+0000, chain.objs.size()=1 2024-08-27T03:58:30.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RPLeMUY7RpzwaNjBgMj1rV-vMs1wIEs_0 2024-08-27T03:58:30.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7300450296225421489', time=2024-08-27T05:27:23.731209+0000, chain.objs.size()=1 2024-08-27T03:58:30.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.883+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dzwj4AaJecwyUrY2s2-1wL85jFp18RE_0 2024-08-27T03:58:30.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.887+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48028 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7540508814768752985', time=2024-08-27T05:27:24.162945+0000, chain.objs.size()=1 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HHEthX20BCHL0mxa4yTJmPq5xvGnKEv_0 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7040025454619681235', time=2024-08-27T05:27:24.534527+0000, chain.objs.size()=1 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fXR_moBmTY3qCbIu_lqI05-mOf64meb_0 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.868990046268015823', time=2024-08-27T05:27:25.491780+0000, chain.objs.size()=1 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.157Q8y7Pzjn2o3p7yPqBt2W55uhQOu0_0 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15508645041786195100', time=2024-08-27T05:27:25.493559+0000, chain.objs.size()=1 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ImDGShEc09dRlBtdUuAxFCHdB5tLQq5_0 2024-08-27T03:58:30.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15222894609224154779', time=2024-08-27T05:27:25.930809+0000, chain.objs.size()=1 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZzdhpqoFDEsj6X1Aa0D7xgfQlfTjzPw_0 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4188847916591839593', time=2024-08-27T05:27:45.705841+0000, chain.objs.size()=1 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.331__shadow_.QdcJbbFnnL230jpJT2N4WKatIjZs82l_0 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15555218605673415328', time=2024-08-27T05:28:47.434834+0000, chain.objs.size()=1 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.375__shadow_.swYic17NJ6Febq3Bvs0sRP-RgA9Vi3d_0 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3009873586643362193', time=2024-08-27T05:30:15.880425+0000, chain.objs.size()=1 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.433__shadow_.FHnZzjZEwWlUk3D01tc3KTvakrL41vW_0 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8363759618255609928', time=2024-08-27T05:30:55.580631+0000, chain.objs.size()=1 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.455__shadow_.qnkq9vFBiOKQX7Wv_pgH5gKJA2d2tUe_0 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.227348889301569018', time=2024-08-27T05:31:28.497227+0000, chain.objs.size()=1 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.Yrrh9GuABEBWFqv2734TdbEK93fduH-_0 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9668343766578302199', time=2024-08-27T05:31:46.451195+0000, chain.objs.size()=1 2024-08-27T03:58:30.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.485__shadow_.lVWkuc3Cpn5562yn7sAwEwEoJzlcq1b_0 2024-08-27T03:58:30.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8441045470893235258', time=2024-08-27T05:32:21.532704+0000, chain.objs.size()=6 2024-08-27T03:58:30.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.891+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.1 2024-08-27T03:58:30.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.2 2024-08-27T03:58:30.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.3 2024-08-27T03:58:30.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.4 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.5 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.6 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK', time=2024-08-27T05:34:41.733709+0000, chain.objs.size()=1 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK.1 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK', time=2024-08-27T05:34:41.743310+0000, chain.objs.size()=1 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK.2 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK', time=2024-08-27T05:34:41.752426+0000, chain.objs.size()=1 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK.3 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK', time=2024-08-27T05:34:41.761821+0000, chain.objs.size()=1 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK.4 2024-08-27T03:58:30.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK', time=2024-08-27T05:34:41.771261+0000, chain.objs.size()=1 2024-08-27T03:58:30.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK.5 2024-08-27T03:58:30.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK', time=2024-08-27T05:34:41.780381+0000, chain.objs.size()=1 2024-08-27T03:58:30.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.895+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~HpkwoJVXFPxKTU3en7hnBjKVOqxIIyK.6 2024-08-27T03:58:30.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10876995156913777003', time=2024-08-27T05:35:02.564606+0000, chain.objs.size()=3 2024-08-27T03:58:30.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~07InxqqZL749lJvoV5Np9A23RZrehHe.1 2024-08-27T03:58:30.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~07InxqqZL749lJvoV5Np9A23RZrehHe.2 2024-08-27T03:58:30.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~07InxqqZL749lJvoV5Np9A23RZrehHe.3 2024-08-27T03:58:30.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8240169146097496278', time=2024-08-27T05:35:21.592347+0000, chain.objs.size()=3 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~NWh_DT0TAT3k5ngi473NkAHhn3mpOy4.1 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~NWh_DT0TAT3k5ngi473NkAHhn3mpOy4.2 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~NWh_DT0TAT3k5ngi473NkAHhn3mpOy4.3 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10001474514522774870', time=2024-08-27T05:37:24.551548+0000, chain.objs.size()=1 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.552__shadow_.nBdo3Ny1NOI-tRTXubzwl56zGn6Fks2_0 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5076810811533236599', time=2024-08-27T05:38:09.781257+0000, chain.objs.size()=1 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:LUrgmDZmXUFuhLi9nhuxiykYpLZjJTt_.b0ZULxiKbLLE7mW7I669NjHA5hdUr2L_0 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10232076622195788918', time=2024-08-27T05:38:18.241509+0000, chain.objs.size()=1 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.566__shadow_.pWFgftdfDkzq6PSnbV6FsQzb6kzjucW_0 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16593447800344082506', time=2024-08-27T05:38:44.632127+0000, chain.objs.size()=1 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:Kvi5LKqCU-tLUnwVlpDH.cmkpVFzUZn_.Tky8ZiHoT_ktmL-jyTJBQdglOoNy6bO_0 2024-08-27T03:58:30.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16082893238599957144', time=2024-08-27T05:39:06.887040+0000, chain.objs.size()=1 2024-08-27T03:58:30.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.903+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:ES262j7u5VcIvUZJki7PwslUsktZtYz_.nB5p3KcMPwKGX03IkARA2vifd_vd7oX_0 2024-08-27T03:58:30.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10326986323852132678', time=2024-08-27T05:39:11.320675+0000, chain.objs.size()=1 2024-08-27T03:58:30.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:C5mh9SDER.8NKv2Mlr3cyZXZYEULzT4_.Ex--Mj_Yw-9DS3Ve6lSkkaEJxAWswFO_0 2024-08-27T03:58:30.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6825602619655578453', time=2024-08-27T05:40:16.663631+0000, chain.objs.size()=1 2024-08-27T03:58:30.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:9hFuZbwX8QB9FyQ5n2OAt9nXxpHjig6_.6CD-xIZadVKbTL2rFSwLNbalR8vF93z_0 2024-08-27T03:58:30.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8709900222447709448', time=2024-08-27T05:45:31.542895+0000, chain.objs.size()=1 2024-08-27T03:58:30.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.628__shadow_.yjKe3HtH9KUh-Sc1jDtVD26eP-8m4FS_0 2024-08-27T03:58:30.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11559312326123044390', time=2024-08-27T05:46:56.607612+0000, chain.objs.size()=1 2024-08-27T03:58:30.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.660__shadow_.ieF5Ei1jvo9vNmDbtkiA9vEvTYql97U_0 2024-08-27T03:58:30.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1319842102534690705', time=2024-08-27T05:49:09.515647+0000, chain.objs.size()=10 2024-08-27T03:58:30.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.1 2024-08-27T03:58:30.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.2 2024-08-27T03:58:30.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.3 2024-08-27T03:58:30.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.4 2024-08-27T03:58:30.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.5 2024-08-27T03:58:30.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.6 2024-08-27T03:58:30.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.907+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.7 2024-08-27T03:58:30.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.8 2024-08-27T03:58:30.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.9 2024-08-27T03:58:30.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.911+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.729__multipart_foo.2~L37sLwsGF3RzugzrTFETUeSmaPrI2hw.10 2024-08-27T03:58:30.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.915+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-08-27T03:58:30.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45479' 2024-08-27T03:58:30.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3224999120263244694', time=2024-08-27T05:18:00.820981+0000, chain.objs.size()=1 2024-08-27T03:58:30.924 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.228__shadow_.Hto9hdpPWWCtQGoPiePCjxDwtjOPRQv_0 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9190438831053350382', time=2024-08-27T05:18:02.638481+0000, chain.objs.size()=1 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.229__shadow_.CSWon3l2NNbZvItE_fUelQ1llWGckdg_0 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2353309882823185564', time=2024-08-27T05:18:07.137269+0000, chain.objs.size()=1 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.231__shadow_.06xINy_yABdQ15S2JuHru9QyLrJXDbn_0 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10808809620916353567', time=2024-08-27T05:18:16.471191+0000, chain.objs.size()=1 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.236__shadow_.SK13qQCFMOiB7IJVlh1msWGzzWUQsb3_0 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17835511701402239965', time=2024-08-27T05:18:40.380342+0000, chain.objs.size()=1 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.248__shadow_.5E7VmJFqye-nIn9aFL8UHoRgkN1DDHL_0 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15352139707775407909', time=2024-08-27T05:18:47.588529+0000, chain.objs.size()=1 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.252__shadow_.32CEM0uNbC3WeSl_bJWupHoX5ktf0ni_0 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7909477950077781049', time=2024-08-27T05:20:36.054919+0000, chain.objs.size()=1 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vOIbntoVeEJLenxgDA_SUnm2kSM83os_0 2024-08-27T03:58:30.925 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5769912023637976836', time=2024-08-27T05:20:37.101812+0000, chain.objs.size()=1 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.U0XvGymMCweraFwBZAg6yoi4LKD68qv_0 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6133942163457339493', time=2024-08-27T05:20:37.313216+0000, chain.objs.size()=1 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6Pl-FcmzckgkmgE_5U61TMJIt5kIX4K_0 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7204283276003771259', time=2024-08-27T05:20:37.574075+0000, chain.objs.size()=1 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.X3MNi-Bm7yeBoIe5MqqZ1DFIgtiXX07_0 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16556065072388675381', time=2024-08-27T05:20:40.094817+0000, chain.objs.size()=1 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.A5v87-kmzLlX4J6DFbIKywE0aFNFOue_0 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7519299930641095136', time=2024-08-27T05:20:41.590388+0000, chain.objs.size()=1 2024-08-27T03:58:30.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.919+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ATK99ikXNyeSeY2sreuGjo1V9-NR31d_0 2024-08-27T03:58:30.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14118989239278030472', time=2024-08-27T05:20:43.144389+0000, chain.objs.size()=1 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RZxFdLQxglRMCpnTFN7hZmoyzahHJkV_0 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14185916662134996634', time=2024-08-27T05:20:44.349034+0000, chain.objs.size()=1 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.n-_DbhhexBfhJOts1NNUoLepWm51vl0_0 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12672667149038035231', time=2024-08-27T05:20:47.445193+0000, chain.objs.size()=1 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LKBI7JafPUeHiuKY_bBBAeOq8Nvn7Ni_0 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16119736196611470013', time=2024-08-27T05:20:48.411967+0000, chain.objs.size()=1 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9Ce-MPA36PTD2zrDu3H1zgCAL7ZmjQo_0 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15038822834106758422', time=2024-08-27T05:20:48.439774+0000, chain.objs.size()=1 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9gvJ-Lh36gmcT-JErnDQVo-yiMUxa4u_0 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1783827930120131442', time=2024-08-27T05:20:53.562205+0000, chain.objs.size()=1 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KxFJ00T0hHoZ_ZW8BhzuK1reF-LnXVF_0 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4717106274501581282', time=2024-08-27T05:20:56.210651+0000, chain.objs.size()=1 2024-08-27T03:58:30.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FaEOC3vgAlFO4wUWBHJ5UIhs5Yy4Hgr_0 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7586327802831750373', time=2024-08-27T05:20:58.590162+0000, chain.objs.size()=1 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SaieM1HHLT3lUh1s1VHwkx0C3yEipu__0 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5512543545479656461', time=2024-08-27T05:20:58.955845+0000, chain.objs.size()=1 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jCbFJG2CxME8W2xRDP-Iq7RvqP1FdAR_0 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9292129198817964556', time=2024-08-27T05:20:59.620462+0000, chain.objs.size()=1 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WSioxa5mrTIDXA-LJ150iqSjw3LmaZu_0 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9758643270096871635', time=2024-08-27T05:21:00.337532+0000, chain.objs.size()=1 2024-08-27T03:58:30.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.927+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.puJjXKuJnw8X208iy7nzvQlqsJ0jPuP_0 2024-08-27T03:58:30.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9085583803541005605', time=2024-08-27T05:21:00.476463+0000, chain.objs.size()=1 2024-08-27T03:58:30.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._kZx2Hq2je5hO2Q51rTrCee3jjsQy6u_0 2024-08-27T03:58:30.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10607447840758177607', time=2024-08-27T05:21:00.896821+0000, chain.objs.size()=1 2024-08-27T03:58:30.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qCXpNOGhmcs2EJ33iLFn4hvn_sYQmye_0 2024-08-27T03:58:30.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12270693766464978407', time=2024-08-27T05:21:00.991753+0000, chain.objs.size()=1 2024-08-27T03:58:30.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Jz_1xa3dOOMgQqxXGvu7cvKSAOb9rss_0 2024-08-27T03:58:30.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1474454064853450109', time=2024-08-27T05:21:01.691626+0000, chain.objs.size()=1 2024-08-27T03:58:30.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.o_uprTjr1SYHeG6zF7BuflFTMGNi3-b_0 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17033287291749545837', time=2024-08-27T05:21:03.013798+0000, chain.objs.size()=1 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5G-PkkJ11YdgiVdcFdp2f8cOCz3Zips_0 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15289096990830645016', time=2024-08-27T05:21:04.124589+0000, chain.objs.size()=1 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LS-QuJRhaa3yDNZ-VU6YCKw7oOBluee_0 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1744080166358185522', time=2024-08-27T05:21:04.261094+0000, chain.objs.size()=1 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.F3MZDmYc_3wfNioW33Q0lhXiUoNf_kf_0 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15619683912818347571', time=2024-08-27T05:21:18.031006+0000, chain.objs.size()=1 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.264__shadow_.dqiO6fxe86A5NBTQ601sKHLNCru3ypF_0 2024-08-27T03:58:30.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9486611220754484130', time=2024-08-27T05:21:28.680898+0000, chain.objs.size()=1 2024-08-27T03:58:30.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.270__shadow_.Gx_dLlLll14nWXr0LlB4A56kOualWqu_0 2024-08-27T03:58:30.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8649782542855130513', time=2024-08-27T05:21:55.757716+0000, chain.objs.size()=1 2024-08-27T03:58:30.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.284__shadow_.VCDEdpQmY-6KcSXV4B2cMVTrygnbr1w_0 2024-08-27T03:58:30.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10183210393267312801', time=2024-08-27T05:22:03.005149+0000, chain.objs.size()=1 2024-08-27T03:58:30.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.931+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.J3MLYZtjCi0h7fACaJVVTXpJMg34p8G_0 2024-08-27T03:58:30.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5885130175366971039', time=2024-08-27T05:22:07.930247+0000, chain.objs.size()=1 2024-08-27T03:58:30.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.yhfbRsbw24NsypHj_U5bAI3yYYuLJ1X_0 2024-08-27T03:58:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15962408165914590369', time=2024-08-27T05:22:13.723061+0000, chain.objs.size()=1 2024-08-27T03:58:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.290__shadow_.RNGTq6ECt4rdw6f_TpY7HZY5XwG58Lf_0 2024-08-27T03:58:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13940051289481380688', time=2024-08-27T05:22:35.856840+0000, chain.objs.size()=1 2024-08-27T03:58:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.301__shadow:j1mN.UFgKisYk8xKg4lzhPvZp90MKFb_.i-z_0IgEwOb95VaFYApWV14wbJIFU0O_0 2024-08-27T03:58:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16529037623830779679', time=2024-08-27T05:24:46.508262+0000, chain.objs.size()=1 2024-08-27T03:58:30.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eUatSrHcrd1YV46vW4x4D77aaO3e3VS_0 2024-08-27T03:58:30.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5446237516911302632', time=2024-08-27T05:24:48.204442+0000, chain.objs.size()=1 2024-08-27T03:58:30.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.935+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KpFRWg8LnHyw7xvFeHBcxIWVmSSwIGu_0 2024-08-27T03:58:30.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17265866901592317594', time=2024-08-27T05:24:48.660570+0000, chain.objs.size()=1 2024-08-27T03:58:30.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.aU9uKYZPYV0b2Zcue-MpoXzR_fUV-ye_0 2024-08-27T03:58:30.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8331427276638348514', time=2024-08-27T05:24:51.638194+0000, chain.objs.size()=1 2024-08-27T03:58:30.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZCLif1kIlCb6oKxq01IqKs178OJvn2B_0 2024-08-27T03:58:30.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4616934921855010224', time=2024-08-27T05:24:51.640280+0000, chain.objs.size()=1 2024-08-27T03:58:30.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.feqk6ON0xs9pUrp_oNaVbwOlSIYSoup_0 2024-08-27T03:58:30.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16434741703573942367', time=2024-08-27T05:24:51.694367+0000, chain.objs.size()=1 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.A1KcsfWQSXXQTPktAezsr3dl0YS7drJ_0 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2967335672180185698', time=2024-08-27T05:24:51.819222+0000, chain.objs.size()=1 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dAYi3xqwHSjBvd7qQn1s3KhImeppkVi_0 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3431059242715288363', time=2024-08-27T05:24:52.963345+0000, chain.objs.size()=1 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PPgDHwsSfClsWBZILyC6TkBs3EicQ4L_0 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17295274332559904971', time=2024-08-27T05:24:55.967214+0000, chain.objs.size()=1 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.k24_d3zuexgo94euGAKkkRxa8h49qwE_0 2024-08-27T03:58:30.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12087857038185673651', time=2024-08-27T05:25:00.186763+0000, chain.objs.size()=1 2024-08-27T03:58:30.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vEr6kGDpd4ZRcRsInO9lVmB13XMDkOz_0 2024-08-27T03:58:30.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.20686253384895792', time=2024-08-27T05:25:00.366762+0000, chain.objs.size()=1 2024-08-27T03:58:30.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.939+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.IPiGJkbkmr2_Z202oUpXGEq714Llxn4_0 2024-08-27T03:58:30.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3991097366753162358', time=2024-08-27T05:25:01.736982+0000, chain.objs.size()=1 2024-08-27T03:58:30.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sdp60F5TJzpIRQebhWB-WHxzmLchYIH_0 2024-08-27T03:58:30.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15529906226139885311', time=2024-08-27T05:25:01.739066+0000, chain.objs.size()=1 2024-08-27T03:58:30.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SDAEOcKU5CU9nGRxxlD8TIAnSilEcFu_0 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9864762516093478371', time=2024-08-27T05:25:02.586946+0000, chain.objs.size()=1 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-NfiKnic7yez43aMGLTQkIQry2PZOqB_0 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9904021270379737596', time=2024-08-27T05:25:03.106490+0000, chain.objs.size()=1 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wl5VoO8pSNqrFRsYxJLZdfHAWOFgP5l_0 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3035768252334738154', time=2024-08-27T05:25:03.590061+0000, chain.objs.size()=1 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OU_mz8HNXJ8K7p5DJmfgN3h1VHmoCTA_0 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15609146890457498758', time=2024-08-27T05:25:03.667587+0000, chain.objs.size()=1 2024-08-27T03:58:30.947 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Anv6o5LxiunyZgzramkYNfnkwE_1-G6_0 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14848185108566401210', time=2024-08-27T05:25:04.125454+0000, chain.objs.size()=1 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-yvZdHayRxH-wsdWHOEN3C2LApVObD5_0 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15152510034910225348', time=2024-08-27T05:25:05.996886+0000, chain.objs.size()=1 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kkhGKy8YwX7TnUi_Cx-CPFOKVon95lk_0 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16177909456278769704', time=2024-08-27T05:25:06.517495+0000, chain.objs.size()=1 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.I57lqrXQwHDxdFI5g8N8VZVFCNVgqvy_0 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18183740799177526852', time=2024-08-27T05:25:08.878188+0000, chain.objs.size()=1 2024-08-27T03:58:30.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LHM60LkTjlBWa8sNnTrK78AcsVP0eLc_0 2024-08-27T03:58:30.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15102033446931954567', time=2024-08-27T05:25:10.778572+0000, chain.objs.size()=1 2024-08-27T03:58:30.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.943+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.31vmxy50x7uhdIKk_p1Mp8EP4PvhwMv_0 2024-08-27T03:58:30.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.947+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10460381516421570817', time=2024-08-27T05:25:11.405521+0000, chain.objs.size()=1 2024-08-27T03:58:30.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.947+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.oNmCyVhFYscjwaAVhlObRiE8pZ8uwY8_0 2024-08-27T03:58:30.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.947+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.280910984455890535', time=2024-08-27T05:25:12.651279+0000, chain.objs.size()=1 2024-08-27T03:58:30.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.947+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.t61PgwDbFgdPvbTYPjFsB6cy4Nv2jtl_0 2024-08-27T03:58:30.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2616265066230317935', time=2024-08-27T05:25:13.646149+0000, chain.objs.size()=1 2024-08-27T03:58:30.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BVtgQ5vZHVxVGE_dah4obE9y83HcqpF_0 2024-08-27T03:58:30.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2460276648463620980', time=2024-08-27T05:25:13.895879+0000, chain.objs.size()=1 2024-08-27T03:58:30.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jxXx7g2cUJqL2ai8sT3UdTp9oqLzMw1_0 2024-08-27T03:58:30.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6919954729261768510', time=2024-08-27T05:26:58.100137+0000, chain.objs.size()=1 2024-08-27T03:58:30.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hsGK0lNN_djHGehTmD5SDdKc9Y0Lc-D_0 2024-08-27T03:58:30.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1106221064782254974', time=2024-08-27T05:26:58.822780+0000, chain.objs.size()=1 2024-08-27T03:58:30.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.H6kaJx8UJlYg96DnyW5iL9awIV6VvMY_0 2024-08-27T03:58:30.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11802002434671659206', time=2024-08-27T05:27:01.985679+0000, chain.objs.size()=1 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._TuLV0E4ZJis7igl65NtiU8-kGoe5jf_0 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14354110589854615676', time=2024-08-27T05:27:02.375853+0000, chain.objs.size()=1 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fjeOpG-lGAof9zQdv75anaiUPW6UjpM_0 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5292306767506273876', time=2024-08-27T05:27:02.795427+0000, chain.objs.size()=1 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-1IFQIVlMDSp9TlqdrPk-346B40bPUR_0 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2021545479894517720', time=2024-08-27T05:27:03.713570+0000, chain.objs.size()=1 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.k5SaxG09TKcHknsiy3NcR1Xy8MzQTK-_0 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17094204672593366501', time=2024-08-27T05:27:04.432795+0000, chain.objs.size()=1 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.a-PGbeMDLOa8hOzDMZTQt75WGSx08gE_0 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9868208706708146334', time=2024-08-27T05:27:04.552286+0000, chain.objs.size()=1 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UO7t7SOSOg2Wy-SfIpRMAlIvLfvuw-__0 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3710058404155275741', time=2024-08-27T05:27:06.277296+0000, chain.objs.size()=1 2024-08-27T03:58:30.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.951+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bJU7g9Wp2BtFqdXe6QWf9U81Uxfjh0A_0 2024-08-27T03:58:30.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15650534629447986665', time=2024-08-27T05:27:06.433452+0000, chain.objs.size()=1 2024-08-27T03:58:30.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9dFamXGsKJT4dZpO9oGw-TM_ftz5KJO_0 2024-08-27T03:58:30.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4744080102120666027', time=2024-08-27T05:27:06.497652+0000, chain.objs.size()=1 2024-08-27T03:58:30.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nZQf8HRqUoPVOfoWxdrEIaHR4geNsnx_0 2024-08-27T03:58:30.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.955+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16408213347006343389', time=2024-08-27T05:27:06.841758+0000, chain.objs.size()=1 2024-08-27T03:58:30.960 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.955+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zX7W0fidbPkIvu-TyLp1_FRoQRhrWtm_0 2024-08-27T03:58:30.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11508753860394985272', time=2024-08-27T05:27:08.055845+0000, chain.objs.size()=1 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p0ffvVTyWV61axC33wyKwx0VA-LZ1eI_0 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11421716510997245799', time=2024-08-27T05:27:09.268842+0000, chain.objs.size()=1 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gKsi_rBVi6zrsnEO1wDuPyqdC2lPXVj_0 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14533657377504745908', time=2024-08-27T05:27:09.876220+0000, chain.objs.size()=1 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.G8wOVxVveIlBK9qtzut0J6cBy-mFKwz_0 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6003240793308812161', time=2024-08-27T05:27:09.975711+0000, chain.objs.size()=1 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N9nE3OM9oqgjo5nAObSedkEdWnX22ff_0 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7597547601486676424', time=2024-08-27T05:27:10.037666+0000, chain.objs.size()=1 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zYdi45_D0A0ngh2VbfE1N_pBJ63pgxt_0 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17063479930487817646', time=2024-08-27T05:27:10.777039+0000, chain.objs.size()=1 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.sVMydLTk5my-HWB-zHhz4oA-icqa4Qv_0 2024-08-27T03:58:30.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3183163955995841984', time=2024-08-27T05:27:10.896322+0000, chain.objs.size()=1 2024-08-27T03:58:30.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.whc_87BeAbXj1pLp_CMe-qcZu_L22zH_0 2024-08-27T03:58:30.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9396989176318853498', time=2024-08-27T05:27:11.836399+0000, chain.objs.size()=1 2024-08-27T03:58:30.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.959+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Fh8cHKlKP_01b3563MO6wySKUVh6jmQ_0 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16730600272591327447', time=2024-08-27T05:27:11.894748+0000, chain.objs.size()=1 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0F5nI7eHIbWjiyxhQR8oqfffRe2OzYj_0 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8646020991798922694', time=2024-08-27T05:27:13.297162+0000, chain.objs.size()=1 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Bvl-VcbRiLT4E29bU22f3yKLDc6nykE_0 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7954478313115544872', time=2024-08-27T05:27:13.492208+0000, chain.objs.size()=1 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FEkCXtPUuKaBJ5t1Iyzc9Pa20cQGf62_0 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1260790850192117458', time=2024-08-27T05:27:16.502629+0000, chain.objs.size()=1 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hMxvc5v1NdQZFeji3HlQ0FHusBFt7gK_0 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10082696297400908878', time=2024-08-27T05:27:18.122743+0000, chain.objs.size()=1 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UWMtEmwNuER-57m6nia9GxRBRHJioFH_0 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9468487126537725715', time=2024-08-27T05:27:18.613038+0000, chain.objs.size()=1 2024-08-27T03:58:30.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uqeBttARyigQ98aBcATcOBMtXbY8IKd_0 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13147525646862660934', time=2024-08-27T05:27:19.016620+0000, chain.objs.size()=1 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nqOAcjz2xUIIxfGeKMQr11q61yhCW7g_0 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7653850134854242019', time=2024-08-27T05:27:20.178587+0000, chain.objs.size()=1 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-zedcI5jSL16QfEyjM4_qw44DjT2HK1_0 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18145466884304079745', time=2024-08-27T05:27:20.751974+0000, chain.objs.size()=1 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.g_456qhWWzD-zAYZiW-E0RGtfJ0nYOm_0 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3585030841873934085', time=2024-08-27T05:27:20.991136+0000, chain.objs.size()=1 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lJOKuU5CDH8ce90iuCvwQ4aOhfm6-wk_0 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5854235084935488412', time=2024-08-27T05:27:21.502597+0000, chain.objs.size()=1 2024-08-27T03:58:30.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.963+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xGRvvEl0fuSv0DxGP21ZgVRQXj9_svx_0 2024-08-27T03:58:30.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.967+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5174277608551632756', time=2024-08-27T05:27:22.616979+0000, chain.objs.size()=1 2024-08-27T03:58:30.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.967+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hbb6Nw9-TVXBP1tNzFhZrs7s5w726Ts_0 2024-08-27T03:58:30.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5479521641466886329', time=2024-08-27T05:27:23.024458+0000, chain.objs.size()=1 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RU9TsXV3ci08vLedsFmUwyP9DxLaFBX_0 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3913476793957396571', time=2024-08-27T05:27:25.310690+0000, chain.objs.size()=1 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.V_NLFWbYD5DidhBPuOpBpKpPrFIJ0yg_0 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17429618183454523084', time=2024-08-27T05:27:25.316115+0000, chain.objs.size()=1 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VwXLSUM8xfblQNh-b-cLhE15Duud29-_0 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6858489274089801839', time=2024-08-27T05:27:26.005613+0000, chain.objs.size()=1 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.itktcYO0ik_k9RJ67BuWUXWMZt6YX3M_0 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17194530570110054510', time=2024-08-27T05:27:33.045226+0000, chain.objs.size()=1 2024-08-27T03:58:30.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.971+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.323__shadow_.VIiCzsqNFznsXRql8kqj8By9b_PL6s2_0 2024-08-27T03:58:30.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45479 2024-08-27T03:58:30.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-08-27T03:58:30.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.970483509716060814', time=2024-08-27T05:27:34.950313+0000, chain.objs.size()=1 2024-08-27T03:58:30.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.324__shadow_.uHyPVqrg6ehoVMzPat6LnN__ySrReEF_0 2024-08-27T03:58:30.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8307894313832791486', time=2024-08-27T05:29:27.526163+0000, chain.objs.size()=1 2024-08-27T03:58:30.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.401__shadow_.ZyzGBJ4OIeXFsAl3NSlIetez9UHjjan_0 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15869764981334003576', time=2024-08-27T05:29:59.977017+0000, chain.objs.size()=1 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.423__shadow_.YZi0_F0OW8G3489REhXX--aVxBEueuC_0 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2361858824427045190', time=2024-08-27T05:31:39.327111+0000, chain.objs.size()=1 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.481__shadow_.2tkShatZ9qxMlqhUNYZqEPL5MGtzDMm_0 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10729002463159208732', time=2024-08-27T05:31:47.152152+0000, chain.objs.size()=1 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.485__shadow_.lVWkuc3Cpn5562yn7sAwEwEoJzlcq1b_0 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13753951623243563817', time=2024-08-27T05:32:07.374471+0000, chain.objs.size()=1 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.497__shadow:nGBnVWVmI3DA67.4KlPAhM9ux0Gc029_.rEh1fYZ9-qfRs1r-giIeLw9ZBIE8vlQ_0 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17953684251109645154', time=2024-08-27T05:33:20.941809+0000, chain.objs.size()=3 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~ICYszLfSFraPm2Axv-LxvwMJPVpsO0J.1 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~ICYszLfSFraPm2Axv-LxvwMJPVpsO0J.2 2024-08-27T03:58:30.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.515__multipart_mymultipart.2~ICYszLfSFraPm2Axv-LxvwMJPVpsO0J.3 2024-08-27T03:58:30.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5462681825536121346', time=2024-08-27T05:35:30.885978+0000, chain.objs.size()=4 2024-08-27T03:58:30.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.521__multipart_mymultipart.2~VMX5EbX_QqHLFbAuHQMjc42aFqMutDx.1 2024-08-27T03:58:30.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.521__multipart_mymultipart.2~VMX5EbX_QqHLFbAuHQMjc42aFqMutDx.2 2024-08-27T03:58:30.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.975+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.521__multipart_mymultipart.2~VMX5EbX_QqHLFbAuHQMjc42aFqMutDx.3 2024-08-27T03:58:30.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.521__multipart_mymultipart.2~VMX5EbX_QqHLFbAuHQMjc42aFqMutDx.4 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14253607345308017568', time=2024-08-27T05:37:55.996635+0000, chain.objs.size()=1 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:L2jwOKBA0kDyb0pm2SoX9kkqz7b5q1J_.vRXKrER-kfixcCB_P5PkXcscwXP6Fbn_0 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3299716034073819332', time=2024-08-27T05:38:13.962550+0000, chain.objs.size()=1 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.564__shadow:dLR4cRTBkc0a.ZYHGKhhaLJXD3nKCIU_.2QXQZBYz4OpDUIzwkCuvdeXfgvIDw4Z_0 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5520920339152185895', time=2024-08-27T05:40:15.809890+0000, chain.objs.size()=1 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:PsFNiDR1Uffwl3WlVKzLzaDyZcwOgoW_.Kqop8BNZY3Hlviqu91HKKIu-_knxeGG_0 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.369887866067895030', time=2024-08-27T05:40:37.605604+0000, chain.objs.size()=1 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.596__shadow_.E6fcH9I1GKepxNOnvs2a4LBZ2ik4YGS_0 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12987766265545270661', time=2024-08-27T05:47:13.995479+0000, chain.objs.size()=1 2024-08-27T03:58:30.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.979+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.673__shadow_.0Z7yJmOdQBoFpop4c3hBmMed2S_8kPd_0 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7477844904018913380', time=2024-08-27T05:47:30.244002+0000, chain.objs.size()=1 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.685__shadow_.nT2YSeTsJSHeGtVyIVGlKWW8W_nGa05_0 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12588835141636641606', time=2024-08-27T05:48:34.210015+0000, chain.objs.size()=1 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.711__shadow:fWA4VUakcDv5MeCZ.LOBczhnTvvxxqG_.S723wQOQovegxZbTWRA3sRoqEoST8hn_0 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.244059898155163061', time=2024-08-27T05:48:35.879975+0000, chain.objs.size()=1 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.712__shadow_.unXhw6KlPZ9qx0qPD5DxE2NhWMG8eC7_0 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8771841641030110839', time=2024-08-27T05:48:58.988907+0000, chain.objs.size()=1 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.728__shadow_.S5NJZiPrZPOVd55a1lmpSbWBTDX2LbA_0 2024-08-27T03:58:30.985 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17219663865285774339', time=2024-08-27T05:57:58.086316+0000, chain.objs.size()=1 2024-08-27T03:58:30.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.983+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.776__shadow_.4M4rwqeucgHmmZxN8JtLzHPlmLrwmFa_0 2024-08-27T03:58:30.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.991+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:30.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-08-27T03:58:30.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.991+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:30.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:30.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46460' 2024-08-27T03:58:30.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16331446732060764376', time=2024-08-27T05:13:11.807892+0000, chain.objs.size()=2 2024-08-27T03:58:30.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.152__shadow_.BiA25yKg1A1B8rOM7a6TlSV_tmO2Zsv_0 2024-08-27T03:58:30.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.152__shadow_.BiA25yKg1A1B8rOM7a6TlSV_tmO2Zsv_1 2024-08-27T03:58:30.997 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5125898812833510832', time=2024-08-27T05:18:09.911788+0000, chain.objs.size()=1 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.232__shadow_.i5RymLrtZyXLx-E7oY5lgC0XCHNS7dV_0 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7770082121547181552', time=2024-08-27T05:18:16.489882+0000, chain.objs.size()=1 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.236__shadow_.Bn3bXYpN13efeoV0h6OCgwCNTDhFxVM_0 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9417738016456951522', time=2024-08-27T05:18:27.430712+0000, chain.objs.size()=1 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.241__shadow_.bHyehQBx_PKUv2r5FkzIIWLTeH--gqX_0 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1877891018377820882', time=2024-08-27T05:18:29.272561+0000, chain.objs.size()=1 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.242__shadow_.I_uK0PEjzZaniFvo4R8xO_rfWdCU9jC_0 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9163220128252594147', time=2024-08-27T05:18:31.127942+0000, chain.objs.size()=1 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.243__shadow_.VKCs1GMUhmXeCcga_zPM5MBHm1kIz--_0 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13430402279285808618', time=2024-08-27T05:20:35.588428+0000, chain.objs.size()=1 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FihpBdAr2QEcKSK8a_2PapX7z_dnwpc_0 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3568010762607627023', time=2024-08-27T05:20:38.050875+0000, chain.objs.size()=1 2024-08-27T03:58:30.998 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.px0Vjx9Ra6I-so4CNpBH35iikBqKvKm_0 2024-08-27T03:58:30.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10286680925090023995', time=2024-08-27T05:20:39.679422+0000, chain.objs.size()=1 2024-08-27T03:58:30.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Z5Yf8z9JTUxBpoUU7ywJvnp_H8SWZC4_0 2024-08-27T03:58:30.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12994098331693861674', time=2024-08-27T05:20:40.220189+0000, chain.objs.size()=1 2024-08-27T03:58:30.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Vz2YxZPlT66e7OjSqPXqXCsXWMMRPbC_0 2024-08-27T03:58:30.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6532364630408637356', time=2024-08-27T05:20:40.493062+0000, chain.objs.size()=1 2024-08-27T03:58:30.999 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.995+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8uhNYzT-JW5vyZtCYxMOCZO0_ofzhEi_0 2024-08-27T03:58:31.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1559291669407034550', time=2024-08-27T05:20:41.795722+0000, chain.objs.size()=1 2024-08-27T03:58:31.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.yBKGrbW-H2LkfYy0_VUzcueo_Laexrk_0 2024-08-27T03:58:31.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15150636851869973020', time=2024-08-27T05:20:41.962526+0000, chain.objs.size()=1 2024-08-27T03:58:31.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VtCEwR9p2pq2XCczeskH7p4J082IEg__0 2024-08-27T03:58:31.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5986572884789309828', time=2024-08-27T05:20:41.975101+0000, chain.objs.size()=1 2024-08-27T03:58:31.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.h3_tQ5eaNO8TZwHOCVBeJUwpEwopScG_0 2024-08-27T03:58:31.001 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2883203454952931326', time=2024-08-27T05:20:42.082064+0000, chain.objs.size()=1 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LDaMuYJOZGymhMM5Vx1sA8x8SIoJxsX_0 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17215376668396168451', time=2024-08-27T05:20:43.424214+0000, chain.objs.size()=1 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PeAFUOvIHzRSshH3rHsFzWm5LrJzUpP_0 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4293747077386010779', time=2024-08-27T05:20:43.791146+0000, chain.objs.size()=1 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.V7yOr6NNEFnlbUnq6QakEFK48dqwSH__0 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3508719892164508036', time=2024-08-27T05:20:44.038375+0000, chain.objs.size()=1 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9rA1Mit8hpUg-64s17vhKi14VszA6fJ_0 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11262848696705475689', time=2024-08-27T05:20:44.595130+0000, chain.objs.size()=1 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uFq0s329rQhKNCA4vJftyrsmqOfZErh_0 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7348023001878454009', time=2024-08-27T05:20:45.727900+0000, chain.objs.size()=1 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ARwm6GCQqPBgh0CmdEiE6TlMnsn7P0T_0 2024-08-27T03:58:31.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4322976633038559813', time=2024-08-27T05:20:48.510408+0000, chain.objs.size()=1 2024-08-27T03:58:31.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qCbVXu2_gSneHSRHXthjQoHkolyHvrZ_0 2024-08-27T03:58:31.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4337914158707949312', time=2024-08-27T05:20:49.394884+0000, chain.objs.size()=1 2024-08-27T03:58:31.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:30.999+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KmH5qvzeKtW5qVhVOOEHPJDfFXAxDxG_0 2024-08-27T03:58:31.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17521566791226060210', time=2024-08-27T05:20:50.864486+0000, chain.objs.size()=1 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4AnEfravd14kkQHL5jP2T-D8_e4uzMG_0 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3940806316371546224', time=2024-08-27T05:20:52.047490+0000, chain.objs.size()=1 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NgmLzonYUZlt7jensM8dCWmLhUhNGZD_0 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6512242080860201311', time=2024-08-27T05:20:55.045054+0000, chain.objs.size()=1 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RH5R7wLOoKbaapaYIMFHOCNsCl2-gJE_0 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4235157380873333075', time=2024-08-27T05:20:55.650877+0000, chain.objs.size()=1 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xYIpqpFLtidJLGQhIX-BlUdk_JC38n7_0 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14604523500877788312', time=2024-08-27T05:20:55.887210+0000, chain.objs.size()=1 2024-08-27T03:58:31.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oNJ6lMs2pOF_zz83eW76YKRqYurZLql_0 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9905693636357612182', time=2024-08-27T05:20:56.451047+0000, chain.objs.size()=1 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2Eq1uUgAmnBt0_E-0-yTue4ijhLq2EE_0 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17453451583720972071', time=2024-08-27T05:20:56.631355+0000, chain.objs.size()=1 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0AsiWye1taHjH4epadGNW7DoNgVhRUs_0 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10713659850184352131', time=2024-08-27T05:21:00.345639+0000, chain.objs.size()=1 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.N2i1ooVgGxl9TH2DwWkyvOzpkGQb0Z2_0 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8800257070670875343', time=2024-08-27T05:21:02.412043+0000, chain.objs.size()=1 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.voJjfr7PRc73UEZyx9RczylooZppMTX_0 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8820850960061287605', time=2024-08-27T05:21:03.333659+0000, chain.objs.size()=1 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EYIZpyBp4BrNZzxXQnCW81X38Tft5uG_0 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2957913406567037338', time=2024-08-27T05:21:04.016272+0000, chain.objs.size()=1 2024-08-27T03:58:31.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.003+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.1wmaBptKdoygxMtwTyIw5r2eL-vtLqn_0 2024-08-27T03:58:31.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2398610719829349047', time=2024-08-27T05:21:04.261840+0000, chain.objs.size()=1 2024-08-27T03:58:31.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iSa_McksyyGjJ16RkaK8M_uFClrsseS_0 2024-08-27T03:58:31.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14058276987677497174', time=2024-08-27T05:21:37.946663+0000, chain.objs.size()=1 2024-08-27T03:58:31.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.275__shadow_.mQnafqbT09ZOyxP-s7bxV9ybS7hlE0p_0 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11235130487446818495', time=2024-08-27T05:21:43.543249+0000, chain.objs.size()=1 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.278__shadow_.mb7RQ_QoCVlW3UsngZ5D4XxfYSuPlmC_0 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17198258890744235801', time=2024-08-27T05:22:02.741772+0000, chain.objs.size()=1 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.AKniUYcAUKtvVcFF_q_ePlLe6Za-QTj_0 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8678100645627864604', time=2024-08-27T05:22:03.041922+0000, chain.objs.size()=1 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.VZaBTFbvkn76V0tkm8weewmqAyV8BrZ_0 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.554285041191465824', time=2024-08-27T05:22:08.036745+0000, chain.objs.size()=1 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.z24K2-eisS7AzD8jXVnrA1dCEHe6prj_0 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17343637507359731773', time=2024-08-27T05:24:47.663708+0000, chain.objs.size()=1 2024-08-27T03:58:31.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LUdS7QSsINzdI2kSqaGyqQCjYzza6qO_0 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5734431684728966033', time=2024-08-27T05:24:47.910510+0000, chain.objs.size()=1 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fQ0C0E5Sb7zJ6Wd2rMW-KdlhlzKibTz_0 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8417536523585260935', time=2024-08-27T05:24:48.335916+0000, chain.objs.size()=1 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hqY_Ydny7aOoHQbOEVK5dcIvGJRwAzu_0 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14489744474336424455', time=2024-08-27T05:24:48.446930+0000, chain.objs.size()=1 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XKYxPG8KzcLtTpFbUsw0WaT-207N-i3_0 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14245423122296109550', time=2024-08-27T05:24:52.186452+0000, chain.objs.size()=1 2024-08-27T03:58:31.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6qy_8K0E2NJJxvh5_LFbL465Asc9Yii_0 2024-08-27T03:58:31.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16819270677971149341', time=2024-08-27T05:24:54.814028+0000, chain.objs.size()=1 2024-08-27T03:58:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.011+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QkIX8ZzocjOh7GLLRNqr-vGTHBtJRuX_0 2024-08-27T03:58:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14881292448737176688', time=2024-08-27T05:24:54.902735+0000, chain.objs.size()=1 2024-08-27T03:58:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YogFWunb2IulqgIoM0KY7sAp2m5Mv0__0 2024-08-27T03:58:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11728873726296206084', time=2024-08-27T05:24:55.635635+0000, chain.objs.size()=1 2024-08-27T03:58:31.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.W-5wuelqM0ML9xoxM5gqMsZ1oXZ5L2y_0 2024-08-27T03:58:31.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8010415485788523412', time=2024-08-27T05:24:55.855680+0000, chain.objs.size()=1 2024-08-27T03:58:31.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BQsJavP48yfCMkZDvOX9SCy5IHbIefz_0 2024-08-27T03:58:31.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15614433282800445069', time=2024-08-27T05:24:56.090980+0000, chain.objs.size()=1 2024-08-27T03:58:31.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.tsXXXEBmf9fvYOm_kv6_A6OOtWa04vJ_0 2024-08-27T03:58:31.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12615829832222627246', time=2024-08-27T05:24:56.965936+0000, chain.objs.size()=1 2024-08-27T03:58:31.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.M1wVPzZWa2KOYciXEiskaEJs5uemE5x_0 2024-08-27T03:58:31.019 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6586393791879016814', time=2024-08-27T05:24:56.967448+0000, chain.objs.size()=1 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TgStsUGn9Oj1CKoCfWTIoOuwEzJC5zm_0 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18407625783133191110', time=2024-08-27T05:24:58.511349+0000, chain.objs.size()=1 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KyqZql0wLQSuxME7UPcb-IpcRFiBw0v_0 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7893497847298416880', time=2024-08-27T05:24:58.876986+0000, chain.objs.size()=1 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0LfHSlwPuaXlLPbmXKy3FHuuIPsdL2w_0 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1030488778397427464', time=2024-08-27T05:24:59.799673+0000, chain.objs.size()=1 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kTkAwYuodMhks2Fu8mdtp43dnMw1lvT_0 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9020090743481708945', time=2024-08-27T05:25:02.206730+0000, chain.objs.size()=1 2024-08-27T03:58:31.020 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.015+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.pJ4_4FL9s2qx35Ffo58S3p-ZGWHsyeV_0 2024-08-27T03:58:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5677788501954526054', time=2024-08-27T05:25:02.441347+0000, chain.objs.size()=1 2024-08-27T03:58:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yHNmRahC_O-C5JE-JSiR5fsDwOhoGrH_0 2024-08-27T03:58:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18296021447314207432', time=2024-08-27T05:25:02.880805+0000, chain.objs.size()=1 2024-08-27T03:58:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wdT8oKBhs_v7EYP-fo7cGASBA9RbeNB_0 2024-08-27T03:58:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11092649832497811863', time=2024-08-27T05:25:02.884388+0000, chain.objs.size()=1 2024-08-27T03:58:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vCY-msPmHFxphqd4M96eqSaXvM1U-EF_0 2024-08-27T03:58:31.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11894992863633028352', time=2024-08-27T05:25:02.890479+0000, chain.objs.size()=1 2024-08-27T03:58:31.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yIVVHibpmBUdgWhtec2xZZ6ZcUdbzSk_0 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2181555440154782651', time=2024-08-27T05:25:06.015282+0000, chain.objs.size()=1 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7-Wv9gFmzoBQXIhG1V2enoMs37kgY2U_0 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13392083814515447220', time=2024-08-27T05:25:06.275441+0000, chain.objs.size()=1 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.019+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0AF-Ta0yoZf5GGnpSkPxvJ3HCliLWtn_0 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1927801666971677149', time=2024-08-27T05:25:07.045555+0000, chain.objs.size()=1 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1zrBChcInD5HitqyS_dLiwHhBrp_3D9_0 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13587314682744981030', time=2024-08-27T05:25:08.885326+0000, chain.objs.size()=1 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.APBeOArhIQbRhKsmxNOTS2o0ZWCNOQz_0 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7558330102831619782', time=2024-08-27T05:25:09.441936+0000, chain.objs.size()=1 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XU69eOFkFU3F6tfh8EC5oB_yze0wcid_0 2024-08-27T03:58:31.027 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10032846107387322726', time=2024-08-27T05:25:10.088627+0000, chain.objs.size()=1 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xUd-9Bv7Y95wi4-E6Kb52nMLHU25TIW_0 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1436500627915122357', time=2024-08-27T05:25:10.375612+0000, chain.objs.size()=1 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0soYHW5qEPiDlDuboQcJc0LEmTEVJov_0 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18147749580648232808', time=2024-08-27T05:25:12.144486+0000, chain.objs.size()=1 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4_1aLkAmy_c0f0JaJvankNsYjE0oQtU_0 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5424131937526926050', time=2024-08-27T05:25:12.550362+0000, chain.objs.size()=1 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.S0yhuPRZ8AqABkP2sgkQHMSc0eCxfXr_0 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11041166605829630561', time=2024-08-27T05:25:12.749904+0000, chain.objs.size()=1 2024-08-27T03:58:31.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CQOohzJcPNwuhfKKOJ_-0TBPARzMBvY_0 2024-08-27T03:58:31.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7043754054428938222', time=2024-08-27T05:25:14.369311+0000, chain.objs.size()=1 2024-08-27T03:58:31.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.023+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.iGyqvcqVIYOOZhF5g7M4RarX3Lm15Ik_0 2024-08-27T03:58:31.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.189696201211698910', time=2024-08-27T05:26:57.749152+0000, chain.objs.size()=1 2024-08-27T03:58:31.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GOTz8HqyC8lWhm3cRMf6SJvWBLYQBsq_0 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.578298457830887989', time=2024-08-27T05:26:58.067011+0000, chain.objs.size()=1 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.f_c7LL0XndBupkvnWAlqZckdnUtBayR_0 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11805669695425477154', time=2024-08-27T05:26:59.802126+0000, chain.objs.size()=1 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.r57srGVu_0ZZsAxYA-6Qca39XXY5RFZ_0 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12263487083511842760', time=2024-08-27T05:27:01.642951+0000, chain.objs.size()=1 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DDoEWFB85caeZveUmWtymRy46lee4k6_0 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10169350470440303208', time=2024-08-27T05:27:02.102236+0000, chain.objs.size()=1 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.w-AAPQtVE0CelEJMmsnY5-fu6R7lea__0 2024-08-27T03:58:31.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.137927530930788495', time=2024-08-27T05:27:03.145966+0000, chain.objs.size()=1 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.umt2UP4E2c0Rjb9jLcvJSEvGLsUtODZ_0 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16301907246995321123', time=2024-08-27T05:27:03.148343+0000, chain.objs.size()=1 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.g6S-AIT-f1Ln8EhJxQwAQFJ7YvY7jQB_0 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7952787856593854214', time=2024-08-27T05:27:03.333038+0000, chain.objs.size()=1 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.027+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jkCxn42cWh0n4n98txr5uq2O8OoF-sG_0 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2508693637477299509', time=2024-08-27T05:27:03.496698+0000, chain.objs.size()=1 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qE8ySuYbCrFo3M8dMSmU52CfiYZNojv_0 2024-08-27T03:58:31.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7578883655721006539', time=2024-08-27T05:27:06.976927+0000, chain.objs.size()=1 2024-08-27T03:58:31.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.X7aAIRQgz0gyAwenbqhS4G8lHv9lgzP_0 2024-08-27T03:58:31.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17373069896577600722', time=2024-08-27T05:27:07.364220+0000, chain.objs.size()=1 2024-08-27T03:58:31.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rzRhq1pvnRzWYDaTpMX8NiDu4vMO88F_0 2024-08-27T03:58:31.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18259840271632326467', time=2024-08-27T05:27:07.416298+0000, chain.objs.size()=1 2024-08-27T03:58:31.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.031+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jH3e7bWr3F6GGzNtkm7RUz8QXnCSs8i_0 2024-08-27T03:58:31.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.843978525105483359', time=2024-08-27T05:27:07.789494+0000, chain.objs.size()=1 2024-08-27T03:58:31.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QSY4ulhy86FnlY-d4gJKzWxfJtIE17Z_0 2024-08-27T03:58:31.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15212305784857378700', time=2024-08-27T05:27:09.291257+0000, chain.objs.size()=1 2024-08-27T03:58:31.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RQJmMzwj5pCYjoqgh56ATYp8kfAa_pX_0 2024-08-27T03:58:31.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.42454406760561137', time=2024-08-27T05:27:09.596163+0000, chain.objs.size()=1 2024-08-27T03:58:31.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QB22adA3mhtC_4YWB5W1oE6TqcrAhKN_0 2024-08-27T03:58:31.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2194525881179095138', time=2024-08-27T05:27:13.303163+0000, chain.objs.size()=1 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZZYqpSiXNtpTHkLNKPB9F4ZfCQSLNmu_0 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10637898383563369257', time=2024-08-27T05:27:14.309972+0000, chain.objs.size()=1 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JkTGXXch-95dsLjVNb6XKhbmrIzwaV1_0 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8936619748086468244', time=2024-08-27T05:27:14.312206+0000, chain.objs.size()=1 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MsskGpv6UIk16qKTSdcQLVIib1NdNtQ_0 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9659752261515464113', time=2024-08-27T05:27:16.552357+0000, chain.objs.size()=1 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CqM9iKaoSQKgg6QhZbtstUU_X_D25Wh_0 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11540748636416022810', time=2024-08-27T05:27:17.354161+0000, chain.objs.size()=1 2024-08-27T03:58:31.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nE8RUr0dSImmn9tp-mBiveXnJZW6YWn_0 2024-08-27T03:58:31.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15189294052624305179', time=2024-08-27T05:27:17.491017+0000, chain.objs.size()=1 2024-08-27T03:58:31.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Jfd2gqE1oQjTjxVC-h4m_61Wcv0Alex_0 2024-08-27T03:58:31.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8466421072840101595', time=2024-08-27T05:27:17.785277+0000, chain.objs.size()=1 2024-08-27T03:58:31.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LVxn3Aahip1CiviQN5xiw78xkvacdUE_0 2024-08-27T03:58:31.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.546689686426309001', time=2024-08-27T05:27:18.430031+0000, chain.objs.size()=1 2024-08-27T03:58:31.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.035+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.66Lj6ky2WKTaYe7XZYOhBX3H87Ve_Jl_0 2024-08-27T03:58:31.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12733747495101249059', time=2024-08-27T05:27:19.017395+0000, chain.objs.size()=1 2024-08-27T03:58:31.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GrD3zOrV4jVuNdiVqoirZPumxrkPVxi_0 2024-08-27T03:58:31.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7671059018065392741', time=2024-08-27T05:27:19.195344+0000, chain.objs.size()=1 2024-08-27T03:58:31.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6mWTW2gwmKXehk0ud0M3N--SiF-DW2R_0 2024-08-27T03:58:31.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11380334793598028104', time=2024-08-27T05:27:24.454130+0000, chain.objs.size()=1 2024-08-27T03:58:31.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RtN79pEfIwK3H5gfnR5GVVXgQD6Ggd5_0 2024-08-27T03:58:31.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15920507863663464069', time=2024-08-27T05:27:24.821768+0000, chain.objs.size()=1 2024-08-27T03:58:31.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.039+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vCAe1VVvAvZDvBFe8UP408voBP9gSL__0 2024-08-27T03:58:31.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10931419930917624927', time=2024-08-27T05:28:40.395913+0000, chain.objs.size()=1 2024-08-27T03:58:31.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.371__shadow_.ykW0QwV_cfhwJMO0kWmzcw98j1RQRnq_0 2024-08-27T03:58:31.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16953600428377793056', time=2024-08-27T05:30:40.306523+0000, chain.objs.size()=1 2024-08-27T03:58:31.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.448__shadow_.7gD8u1oo39L2V4-qBC_rFGcZdrA88ZG_0 2024-08-27T03:58:31.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.043+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14040139828067982707', time=2024-08-27T05:31:01.809020+0000, chain.objs.size()=1 2024-08-27T03:58:31.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.043+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.458__shadow_.BUvVUecJ2kAnYyl-hesaW1AULyeWVUv_0 2024-08-27T03:58:31.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.047+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46460 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8811268956921943746', time=2024-08-27T05:31:28.464378+0000, chain.objs.size()=1 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.vFaguoHvcuR3qhkhHdoqBXy6sktaAqF_0 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18278877130851693414', time=2024-08-27T05:31:28.539548+0000, chain.objs.size()=1 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.UNYwXwVqUfMTmL9EdtCLyt5az8zz3TJ_0 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8936351596147386687', time=2024-08-27T05:31:41.108926+0000, chain.objs.size()=1 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.482__shadow_.uungdRbuOQzuG3uQlmF7-J2nt3_1JSa_0 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2641206327620529598', time=2024-08-27T05:32:06.049864+0000, chain.objs.size()=1 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.497__shadow:nGBnVWVmI3DA67.4KlPAhM9ux0Gc029_.rEh1fYZ9-qfRs1r-giIeLw9ZBIE8vlQ_0 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7465837891827879795', time=2024-08-27T05:36:55.263776+0000, chain.objs.size()=1 2024-08-27T03:58:31.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.546__shadow_.6PzUXgi6Z7UJ3UitiuEkk8152t0lou9_0 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.778194598994813761', time=2024-08-27T05:37:08.645324+0000, chain.objs.size()=2 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.549__shadow_.GCKY0FYTS_2iuEJ-m0p6HIeD0tmBO1h_0 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.549__shadow_.GCKY0FYTS_2iuEJ-m0p6HIeD0tmBO1h_1 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2939862456215724909', time=2024-08-27T05:38:00.822933+0000, chain.objs.size()=1 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:Ls00pkJ-S0FXPdfk-0H6HKbEn.a1ayX_.pW8omtuJHFh3_tEYBoQye0o2EV1R0LH_0 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10245784233553152680', time=2024-08-27T05:38:42.512583+0000, chain.objs.size()=1 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:ee-FNzqtjavU1XsDQdDeK-lxPs-yjU-_.uZffWFBY2HZ-rs2NJfCDghEnxozAg5T_0 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.199633392335983963', time=2024-08-27T05:40:13.050556+0000, chain.objs.size()=1 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.580__shadow:vDvSj4YXCFHqK0JoErJRr1eJwxxBNoe_.Pz6eWrB5H8L_JTX-ozTU-0Y_HAfiaV6_0 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12498996760152859401', time=2024-08-27T05:40:16.941587+0000, chain.objs.size()=1 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:vUPPRxZVsdiMp4VgShFWVdTvI7jlMd-_.SGchDGekpTUmg6_qKM_jZdhruxodYEX_0 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16299161347688425066', time=2024-08-27T05:42:21.562109+0000, chain.objs.size()=1 2024-08-27T03:58:31.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.051+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.610__shadow_.mHkX4CQTo1p7_ESqe2MGM1wfH6vdOly_0 2024-08-27T03:58:31.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15179388747586746270', time=2024-08-27T05:43:23.638423+0000, chain.objs.size()=1 2024-08-27T03:58:31.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.611__shadow_.bXu46tqRoHLXGs1bPBxuH46dNeOdfw4_0 2024-08-27T03:58:31.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10195333520807840096', time=2024-08-27T05:45:28.206329+0000, chain.objs.size()=1 2024-08-27T03:58:31.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.626__shadow_.NQOPHcavbEZ7ndrVQqsftqOheIbhG6__0 2024-08-27T03:58:31.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6446252615333641018', time=2024-08-27T05:45:33.375870+0000, chain.objs.size()=1 2024-08-27T03:58:31.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.629__shadow_.oag8YbAZSlRj5Oz879PSxf_LExrXcTg_0 2024-08-27T03:58:31.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10221148963060004434', time=2024-08-27T05:46:55.993444+0000, chain.objs.size()=1 2024-08-27T03:58:31.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.660__shadow_.1P9GJTfHkDEGYf6whrVK4dmZHkZicUp_0 2024-08-27T03:58:31.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7724761699336886709', time=2024-08-27T05:46:59.464138+0000, chain.objs.size()=1 2024-08-27T03:58:31.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.662__shadow_.wpfRtTihezBAM_QIJtA6tJ5ChLDtN4m_0 2024-08-27T03:58:31.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8388781941345420982', time=2024-08-27T05:47:58.262883+0000, chain.objs.size()=1 2024-08-27T03:58:31.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.055+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.701__shadow:zmh0Z0q5zm6v0MclWhK44YkDrGYZwUB_.fRr_PfECACosSbBwAo4KJpihookie6W_0 2024-08-27T03:58:31.063 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.059+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.065 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-08-27T03:58:31.066 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.067 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.067 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43141' 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Q55hlt3w-P2APYyl9zjj7IDwMDWBnkj', time=2024-08-27T05:13:36.099421+0000, chain.objs.size()=2 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.BR5CqEYEgp-Mpsu_hFNcCcZh5YS738F_0 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.BR5CqEYEgp-Mpsu_hFNcCcZh5YS738F_1 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4916917995275182365', time=2024-08-27T05:18:23.783540+0000, chain.objs.size()=1 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.239__shadow_.QzilJ_4CuzQQDkJOF5ikCMDq6NZXJf-_0 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1603345347672551512', time=2024-08-27T05:18:42.220541+0000, chain.objs.size()=1 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.249__shadow_.e18hhpprRrP2Yrq1RyEnhRwn-ZSZ06Z_0 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10370196274959604152', time=2024-08-27T05:18:44.106445+0000, chain.objs.size()=1 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.250__shadow_.1Bb-AYs8itfTjNfa5zbdXfM_tJOrarf_0 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5019613105486773448', time=2024-08-27T05:18:44.136277+0000, chain.objs.size()=1 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.250__shadow_.jry4YNbgiNiUvdnRdYBmXsEJH7PsRqc_0 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12695481811597021495', time=2024-08-27T05:18:44.138322+0000, chain.objs.size()=1 2024-08-27T03:58:31.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.250__shadow_.9BLJe6BE6a3wPjIZrcffymZJCsezBWK_0 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14404703009712337177', time=2024-08-27T05:18:45.856244+0000, chain.objs.size()=1 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.251__shadow_.-1dzrm8JEfu5dhNJKmPUqiqucZZkDcO_0 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16518105875854132683', time=2024-08-27T05:20:35.705113+0000, chain.objs.size()=1 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.24yj_jiCg_vVIu0WqdebouLhAjqQExP_0 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10302347170678165408', time=2024-08-27T05:20:36.068123+0000, chain.objs.size()=1 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Tks55nl6TTiXhOW8m7zHxKWS-wXW35O_0 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.307694309457290103', time=2024-08-27T05:20:36.071998+0000, chain.objs.size()=1 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.tLaXy2HMLO9R1Yh0b0wRNiMipraT5y8_0 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6803546746316703815', time=2024-08-27T05:20:37.637825+0000, chain.objs.size()=1 2024-08-27T03:58:31.069 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.063+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZUrqscEp1_qHDH46AsfzqZrSe2_I6pQ_0 2024-08-27T03:58:31.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4500963927334625139', time=2024-08-27T05:20:38.054528+0000, chain.objs.size()=1 2024-08-27T03:58:31.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.g1JxHxOTEdYTORY9AlxT83vzVkku-Sl_0 2024-08-27T03:58:31.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2888054413661509192', time=2024-08-27T05:20:38.056904+0000, chain.objs.size()=1 2024-08-27T03:58:31.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oXbz2V3vQRsx1rr-QHq8wrGeNbSk3Tf_0 2024-08-27T03:58:31.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14890736818572487777', time=2024-08-27T05:20:39.764346+0000, chain.objs.size()=1 2024-08-27T03:58:31.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OdzVu8UhPjsBPbJEhJtuxJdaZm8ujb7_0 2024-08-27T03:58:31.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16527612241880004623', time=2024-08-27T05:20:40.000104+0000, chain.objs.size()=1 2024-08-27T03:58:31.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9anJM05FVj9Y2yRP59lKg3LsS_5iWh0_0 2024-08-27T03:58:31.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12919516270174233171', time=2024-08-27T05:20:44.045598+0000, chain.objs.size()=1 2024-08-27T03:58:31.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.067+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TpbN-1zyht1nCZFdQUFQ3R8sfPMfljT_0 2024-08-27T03:58:31.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5693369869734763095', time=2024-08-27T05:20:44.646535+0000, chain.objs.size()=1 2024-08-27T03:58:31.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.T1RnbAJHe0vAJ6JZ0RA3N6DOnKcAdA1_0 2024-08-27T03:58:31.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4181590067292910768', time=2024-08-27T05:20:45.378343+0000, chain.objs.size()=1 2024-08-27T03:58:31.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Q1b9hcSRpaszb3KZodR0PnHtXm7dAIM_0 2024-08-27T03:58:31.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15274548499900853250', time=2024-08-27T05:20:46.031371+0000, chain.objs.size()=1 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kQcd4qKvYQuRbK5Pl8uSEfetH--3mGY_0 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1777318860541686004', time=2024-08-27T05:20:47.053022+0000, chain.objs.size()=1 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ryNPS9VjF83wOdIxFeSXimhnwzGHbkC_0 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16477810624031664425', time=2024-08-27T05:20:48.096089+0000, chain.objs.size()=1 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fy6nSlt2JLerArLe9W9fIMjVqlfS6v3_0 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9067768124749322044', time=2024-08-27T05:20:49.501597+0000, chain.objs.size()=1 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kLiyNBhi7RXY3uB_CZJtfTdFLRjEDNK_0 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7350380555793414552', time=2024-08-27T05:20:49.850796+0000, chain.objs.size()=1 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.P-7l5xAmvyMerjdzH-IBkdAVBpKmAYP_0 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3514501478784445682', time=2024-08-27T05:20:51.584592+0000, chain.objs.size()=1 2024-08-27T03:58:31.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.071+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.AtAa2bEBnR55BFFQIlg-OjDMP3pEgkq_0 2024-08-27T03:58:31.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4675689885707549902', time=2024-08-27T05:20:54.919797+0000, chain.objs.size()=1 2024-08-27T03:58:31.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.63bFmNeiIdlvMuONXETZBMl2ng7s24-_0 2024-08-27T03:58:31.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8431140097135661853', time=2024-08-27T05:20:54.985121+0000, chain.objs.size()=1 2024-08-27T03:58:31.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.afBPyXMyHrRgOzdOoHlnTVRjewfTZzG_0 2024-08-27T03:58:31.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13366156646404715104', time=2024-08-27T05:20:55.430007+0000, chain.objs.size()=1 2024-08-27T03:58:31.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.iaxEuiSpTcHH2Gq70pksW4X0I1L3KZa_0 2024-08-27T03:58:31.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7836550133927204718', time=2024-08-27T05:20:55.548827+0000, chain.objs.size()=1 2024-08-27T03:58:31.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.68bTulskQXbbYO03eajlk-B30TRXnJc_0 2024-08-27T03:58:31.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10007467576249838497', time=2024-08-27T05:20:55.816557+0000, chain.objs.size()=1 2024-08-27T03:58:31.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.075+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4Y7V7EbIQBcAriGk9tTR_Ic665nIIgB_0 2024-08-27T03:58:31.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10651845948031349427', time=2024-08-27T05:20:56.092003+0000, chain.objs.size()=1 2024-08-27T03:58:31.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.f9eykoSUikkRKJbbAKJ0vCve3YGvQXo_0 2024-08-27T03:58:31.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13076618327988411825', time=2024-08-27T05:20:56.264979+0000, chain.objs.size()=1 2024-08-27T03:58:31.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9lmIRzwti-5FBDhlWxB4XjzV-CdPed__0 2024-08-27T03:58:31.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8651361191913236179', time=2024-08-27T05:20:57.397700+0000, chain.objs.size()=1 2024-08-27T03:58:31.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xLTjvRDrQEWVfVJTcXU7EYIGPyBl452_0 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11399059496446531071', time=2024-08-27T05:20:58.831418+0000, chain.objs.size()=1 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jXGQukXXT3jP-5-FqgWfYnOoiu9Ayqp_0 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16963724434861502291', time=2024-08-27T05:20:59.082091+0000, chain.objs.size()=1 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Zxy4QjEQmfgaRUbVGt21fPj7AI5MTCV_0 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13463962192292084740', time=2024-08-27T05:21:00.495075+0000, chain.objs.size()=1 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.coelsLDLAkmrUS5L3bwB5Y04rJL0LxS_0 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14371283105145594843', time=2024-08-27T05:21:01.797977+0000, chain.objs.size()=1 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4E2isWthkODXh9YWgaBitBoJlTFJXmk_0 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12466865360153002003', time=2024-08-27T05:21:03.011392+0000, chain.objs.size()=1 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.G1PKDqdepHc_FhlpbAiD23XPu9A0uvl_0 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.603442473328886000', time=2024-08-27T05:21:03.452431+0000, chain.objs.size()=1 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.viuFjJBsNJimYT5QU9u3Ob9LQbnLFCF_0 2024-08-27T03:58:31.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13235548707558396443', time=2024-08-27T05:21:03.767682+0000, chain.objs.size()=1 2024-08-27T03:58:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sTuVMTPXY_L8mkJmMZNEdOVfhqjnUng_0 2024-08-27T03:58:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10986976970240400225', time=2024-08-27T05:21:04.212795+0000, chain.objs.size()=1 2024-08-27T03:58:31.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.079+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HCZEVrZMkCNx-pvoXSF4f5nbomTFs7z_0 2024-08-27T03:58:31.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3824661632014522500', time=2024-08-27T05:21:16.315061+0000, chain.objs.size()=1 2024-08-27T03:58:31.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.263__shadow_.G1BIzmwOHNHkB6gUvW-c1tCBZAyBYx9_0 2024-08-27T03:58:31.086 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12963375846611288922', time=2024-08-27T05:21:32.352608+0000, chain.objs.size()=1 2024-08-27T03:58:31.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.272__shadow_.mpv_q-o7Teh5idyb6e9gzzN_NcxTNbj_0 2024-08-27T03:58:31.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6297746321075698749', time=2024-08-27T05:21:34.236630+0000, chain.objs.size()=1 2024-08-27T03:58:31.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.273__shadow_.-fOSPl-AJMMF6jC7sTqFaJGHhPVA7JD_0 2024-08-27T03:58:31.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17555007951752286338', time=2024-08-27T05:21:41.628003+0000, chain.objs.size()=1 2024-08-27T03:58:31.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.277__shadow_.w3sKTUczgdr3cA04ll6bIlv7iDzJGnZ_0 2024-08-27T03:58:31.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10637867551899365536', time=2024-08-27T05:22:09.979485+0000, chain.objs.size()=1 2024-08-27T03:58:31.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.083+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.288__shadow_.2SuI64cZNhNSErLNSwYyWOnXILpOqOW_0 2024-08-27T03:58:31.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9453642637030478341', time=2024-08-27T05:22:21.462539+0000, chain.objs.size()=1 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.294__shadow_._g2SnX5Y4GwHd5kSqFIrIsFEI-gcwgl_0 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14630404577186297689', time=2024-08-27T05:23:01.007394+0000, chain.objs.size()=1 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.315__shadow_.irDpsGCWUvCuLl7kbu6x_kxuA2YSI-x_0 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16385309374198517761', time=2024-08-27T05:24:46.894339+0000, chain.objs.size()=1 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OmYsswIQwq28FE6d7eHpijrtI1j6XtY_0 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15437840706296186412', time=2024-08-27T05:24:47.052203+0000, chain.objs.size()=1 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KLIuj7tj3dIA2C9bqv5VS720lu14Z_z_0 2024-08-27T03:58:31.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18211057636306500634', time=2024-08-27T05:24:47.054193+0000, chain.objs.size()=1 2024-08-27T03:58:31.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DDkI3pZgUDGRcgIK8dxUYOaxyS4uo1V_0 2024-08-27T03:58:31.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3427875450885988370', time=2024-08-27T05:24:47.417204+0000, chain.objs.size()=1 2024-08-27T03:58:31.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.QyEQMckJzRaAZi2ZoNuFVRmTKh7s8tR_0 2024-08-27T03:58:31.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13886245558253149062', time=2024-08-27T05:24:48.057077+0000, chain.objs.size()=1 2024-08-27T03:58:31.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xnrmuuctJc60k8aVxxX-mQ_SrGezlt8_0 2024-08-27T03:58:31.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5206288937506145212', time=2024-08-27T05:24:48.059308+0000, chain.objs.size()=1 2024-08-27T03:58:31.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.087+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BQZBw7CS4z_CyHSceuQTaqYypXX9dG8_0 2024-08-27T03:58:31.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2188431652853191134', time=2024-08-27T05:24:52.792021+0000, chain.objs.size()=1 2024-08-27T03:58:31.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.aiMvN5ZzFEYNWfX8mCnNwY-Baf0ir1D_0 2024-08-27T03:58:31.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3857894059791701128', time=2024-08-27T05:24:52.793669+0000, chain.objs.size()=1 2024-08-27T03:58:31.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gZRSXQ1DI81p_h-O0SIBkO1kGQ7nFvu_0 2024-08-27T03:58:31.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9135988847541684691', time=2024-08-27T05:24:55.156805+0000, chain.objs.size()=1 2024-08-27T03:58:31.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.NpEyP_LDJfTmd72eBuN6mv9VkPMDdmo_0 2024-08-27T03:58:31.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2272175372215961023', time=2024-08-27T05:24:56.221508+0000, chain.objs.size()=1 2024-08-27T03:58:31.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.NZ3S_BLo6sn1D6SjS2re0leyReuWqX6_0 2024-08-27T03:58:31.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17383637694767441478', time=2024-08-27T05:24:56.356856+0000, chain.objs.size()=1 2024-08-27T03:58:31.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cT_5sTmpz89N9I6AZV5BRbu9Kg26XY8_0 2024-08-27T03:58:31.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14837574693230053863', time=2024-08-27T05:24:56.897534+0000, chain.objs.size()=1 2024-08-27T03:58:31.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bTRDSlsKrB4VYxRM96lWJITHsVXxFme_0 2024-08-27T03:58:31.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1085185913441244825', time=2024-08-27T05:25:00.661196+0000, chain.objs.size()=1 2024-08-27T03:58:31.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eRNGFRxZnNQZfLph-bBbpys0PitUgII_0 2024-08-27T03:58:31.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5952389120753903141', time=2024-08-27T05:25:01.754002+0000, chain.objs.size()=1 2024-08-27T03:58:31.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TzG9J0tsBYIn6YG6Pr62EAHd2fAkMtt_0 2024-08-27T03:58:31.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.125188631257834821', time=2024-08-27T05:25:05.251049+0000, chain.objs.size()=1 2024-08-27T03:58:31.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.i9puO8dBsoNYObIN9Afi4KqxtDEBlqt_0 2024-08-27T03:58:31.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13849190115809297302', time=2024-08-27T05:25:05.375163+0000, chain.objs.size()=1 2024-08-27T03:58:31.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fEY7zkQAmg0Rrw8Tv1hjZZf9CuVoqGN_0 2024-08-27T03:58:31.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9369390340167894021', time=2024-08-27T05:25:06.988951+0000, chain.objs.size()=1 2024-08-27T03:58:31.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.091+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MgSpgaWWn_qD_qTRg6y_sIA_-ApaufH_0 2024-08-27T03:58:31.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10451770277977053308', time=2024-08-27T05:25:07.037413+0000, chain.objs.size()=1 2024-08-27T03:58:31.097 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vJ44V9lAp8Te23rLTNSFmBikALkh4f-_0 2024-08-27T03:58:31.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6215685140400449307', time=2024-08-27T05:25:07.344028+0000, chain.objs.size()=1 2024-08-27T03:58:31.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bpbMDIDXOxBgMLqOm2QedGSe1GnFlgA_0 2024-08-27T03:58:31.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14051785559815273131', time=2024-08-27T05:25:07.786979+0000, chain.objs.size()=1 2024-08-27T03:58:31.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1hswWUYAbMKFAwgiCfo-9yAQ-QzV64f_0 2024-08-27T03:58:31.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8514838497796372083', time=2024-08-27T05:25:09.199622+0000, chain.objs.size()=1 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.toO9GV1e-KU_Vij_1CMv90Bm91jQmBI_0 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5890013537709884222', time=2024-08-27T05:25:09.442712+0000, chain.objs.size()=1 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cuDGS0t-jm9sotgnczf4aFnKJf-poQ8_0 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17820826369596065780', time=2024-08-27T05:25:09.928116+0000, chain.objs.size()=1 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BpQB3zKkT-q_DLYqSIVjLRBCNQnBgXk_0 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4384351942584010903', time=2024-08-27T05:25:10.606069+0000, chain.objs.size()=1 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7w8U29DA22YtSzrs4Sb9fyEewgYzfK1_0 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13271967392495378302', time=2024-08-27T05:25:12.505227+0000, chain.objs.size()=1 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.X9VwVPm94FxexcZiCdcZ387ihX38POF_0 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2791560739293436779', time=2024-08-27T05:25:12.526158+0000, chain.objs.size()=1 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ezLeSObdV9V-G9jbqjBhgskrWPEnZP3_0 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11023155352024191837', time=2024-08-27T05:25:14.349398+0000, chain.objs.size()=1 2024-08-27T03:58:31.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7an7fOmMhDONo9hmmgrCAD1Mar4dEwl_0 2024-08-27T03:58:31.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2904067549292841407', time=2024-08-27T05:26:57.616728+0000, chain.objs.size()=1 2024-08-27T03:58:31.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.095+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KWBPI6_nr2CPEcHvlIagUTe1dyuDsdP_0 2024-08-27T03:58:31.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.099+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12927015124859017180', time=2024-08-27T05:26:57.668285+0000, chain.objs.size()=1 2024-08-27T03:58:31.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.099+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.--v8iHExs0ICWJQFuz13OXlxbUtiAAR_0 2024-08-27T03:58:31.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.099+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1268308246395829475', time=2024-08-27T05:26:58.015249+0000, chain.objs.size()=1 2024-08-27T03:58:31.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.099+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uU3MuFdxxEPmUNmEc2afGBt9g1yVQAg_0 2024-08-27T03:58:31.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.099+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15187942669244156403', time=2024-08-27T05:27:02.862260+0000, chain.objs.size()=1 2024-08-27T03:58:31.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.099+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CmOUl6NLW7UtXt0V-x1jwt9Irz6KGL-_0 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18323679713392720037', time=2024-08-27T05:27:03.968333+0000, chain.objs.size()=1 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mohKBUn-aLOS3af2J00-JUp7sC0Lu8m_0 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15827201296865391081', time=2024-08-27T05:27:05.515235+0000, chain.objs.size()=1 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.K-gDw-u8v9yYueS6DMfyU46ZY18x8Ve_0 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2005175326607841549', time=2024-08-27T05:27:06.594028+0000, chain.objs.size()=1 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.70GX6d-rUwtabeXqos4k-234XsJuYU9_0 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6877835854414502258', time=2024-08-27T05:27:06.744518+0000, chain.objs.size()=1 2024-08-27T03:58:31.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ikvyYejEi2v5uvM7XdwH60jsdByAmsQ_0 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16046168758188436285', time=2024-08-27T05:27:09.219732+0000, chain.objs.size()=1 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hFXfQKnzG-_AtpfuBOAIpdwzxm3M2Fl_0 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4325545045728016326', time=2024-08-27T05:27:09.283705+0000, chain.objs.size()=1 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2jRn5Tmbonm40iiA4B0Mf1smKUpg9Yg_0 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13619138040984842396', time=2024-08-27T05:27:10.079288+0000, chain.objs.size()=1 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.B7-Km63wOzSAkFrY28SrM4GBRXUTILw_0 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17312759577604369069', time=2024-08-27T05:27:10.463672+0000, chain.objs.size()=1 2024-08-27T03:58:31.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.103+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p64JRIH1SeV20TrILUtIp6HOCS-65Uj_0 2024-08-27T03:58:31.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15441519950102515294', time=2024-08-27T05:27:11.554842+0000, chain.objs.size()=1 2024-08-27T03:58:31.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Rb-s_QP2ZzNTRAtXC4TqSWqzuvIIYEV_0 2024-08-27T03:58:31.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9125322165545968291', time=2024-08-27T05:27:11.618931+0000, chain.objs.size()=1 2024-08-27T03:58:31.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TCn9ioo5tSkcJftB7zfx-uu4Bj8msBq_0 2024-08-27T03:58:31.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13170205351903162060', time=2024-08-27T05:27:11.934289+0000, chain.objs.size()=1 2024-08-27T03:58:31.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.yYTqxW8w1CqmeaBmahUUQHwCy74QklC_0 2024-08-27T03:58:31.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10613105851612031015', time=2024-08-27T05:27:12.903663+0000, chain.objs.size()=1 2024-08-27T03:58:31.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pJwJig_-3QsVRmkYRV7Zs_BficZPzVV_0 2024-08-27T03:58:31.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16345050653506255486', time=2024-08-27T05:27:13.431847+0000, chain.objs.size()=1 2024-08-27T03:58:31.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ay-Os0NK5P2mXyNyoT0F3zLyQSuzOo2_0 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.982757447623417293', time=2024-08-27T05:27:15.277054+0000, chain.objs.size()=1 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.u5wqDPX2eh_wUTSx0pNm1NBo99eIhB0_0 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5363368096523010333', time=2024-08-27T05:27:15.591661+0000, chain.objs.size()=1 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GyizO4KDo9Wslfopbzz_USLRckamUbL_0 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14409323801469829344', time=2024-08-27T05:27:16.845456+0000, chain.objs.size()=1 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N2yefbhG2vd1-zfJ5xn1jesSMwtnbMp_0 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17427578620669157322', time=2024-08-27T05:27:16.973014+0000, chain.objs.size()=1 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AAiVY3kk4NP7IJ9KJQyUV5HIao_oT5z_0 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13852088113983294343', time=2024-08-27T05:27:17.726739+0000, chain.objs.size()=1 2024-08-27T03:58:31.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vnuqN2MBTqOW9nb5mzAQknDKsBmQcLO_0 2024-08-27T03:58:31.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15749660297551410756', time=2024-08-27T05:27:18.227560+0000, chain.objs.size()=1 2024-08-27T03:58:31.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.107+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wzTGbA2BT3Q40G-VkPkM5y5zHsf54oX_0 2024-08-27T03:58:31.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.111+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10084096953031451286', time=2024-08-27T05:27:18.761244+0000, chain.objs.size()=1 2024-08-27T03:58:31.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.111+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.S_f-MYLrpslYY_Os3sNIrCH5Et8qZu4_0 2024-08-27T03:58:31.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.111+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16703855213900516692', time=2024-08-27T05:27:19.187432+0000, chain.objs.size()=1 2024-08-27T03:58:31.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.111+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ypq7vGmBAfYs-LMY3uRleBEKjBISyIJ_0 2024-08-27T03:58:31.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.111+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8375104663431955845', time=2024-08-27T05:27:19.290746+0000, chain.objs.size()=1 2024-08-27T03:58:31.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.111+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-gqMwV8SfFtx2P04LuXcFJsOpWJo5He_0 2024-08-27T03:58:31.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.115+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43141 2024-08-27T03:58:31.121 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-08-27T03:58:31.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2446494993438138231', time=2024-08-27T05:27:20.661274+0000, chain.objs.size()=1 2024-08-27T03:58:31.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Dn0PtduKh5vtojPUY8RnPSpuqSQmiuj_0 2024-08-27T03:58:31.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2374024315709008816', time=2024-08-27T05:27:21.785823+0000, chain.objs.size()=1 2024-08-27T03:58:31.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Bvzc2OJo_BTqAJWdsuzSFaAj1GfQ0O2_0 2024-08-27T03:58:31.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6063127094760066711', time=2024-08-27T05:27:21.948469+0000, chain.objs.size()=1 2024-08-27T03:58:31.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qYx1zAalysLS-I0GHpnmbKvTrghKEP-_0 2024-08-27T03:58:31.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4907075811718438485', time=2024-08-27T05:27:22.939656+0000, chain.objs.size()=1 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NDJyHI9r2MYvridYAVIwslpss8uIQBX_0 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14783928729593040884', time=2024-08-27T05:27:23.880963+0000, chain.objs.size()=1 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vF_J5B_0dWVhzSHQeWSQzunK1vEutMJ_0 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12498284938915172144', time=2024-08-27T05:27:25.728361+0000, chain.objs.size()=1 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GVpNmrKIcLaO0f0bf_aR7IG3o2YgO9F_0 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7126382213878821430', time=2024-08-27T05:27:51.410823+0000, chain.objs.size()=1 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.335__shadow_.JHqY5bZJNUHghTQrN76N_Z7jGVPFxC__0 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12652268705811384564', time=2024-08-27T05:31:00.020151+0000, chain.objs.size()=1 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.457__shadow_.yhnPeZNsjIgZa1Xs09luVX4J2Ojfg2g_0 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14465355773402821922', time=2024-08-27T05:31:28.450530+0000, chain.objs.size()=1 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.ZalzUmJKMfK_KJ1x5RHfJBfnFSW4GOT_0 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15278218846612805353', time=2024-08-27T05:31:53.410934+0000, chain.objs.size()=1 2024-08-27T03:58:31.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.490__shadow_.V-rUJmaWkQobpKRAj2QaF3HfcDcp9Zy_0 2024-08-27T03:58:31.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10419958376652108697', time=2024-08-27T05:32:34.820598+0000, chain.objs.size()=1 2024-08-27T03:58:31.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.510__multipart_mymultipartcopy.2~Wpsv3vELiv2bIKO3iPv9tjqAPNDY-co.1 2024-08-27T03:58:31.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11568327105672702841', time=2024-08-27T05:32:44.453266+0000, chain.objs.size()=1 2024-08-27T03:58:31.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.119+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.512__multipart_mymultipart.2~_tu9mG6yiTFuOKf4xKRdpEf90_d2uz1.1 2024-08-27T03:58:31.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11800588297033272864', time=2024-08-27T05:34:57.996713+0000, chain.objs.size()=2 2024-08-27T03:58:31.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~UMFOM9mUDprGqFqFvOAug82kJFSYBZP.1 2024-08-27T03:58:31.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~UMFOM9mUDprGqFqFvOAug82kJFSYBZP.2 2024-08-27T03:58:31.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mvpjDKf-cto7XxH8aDrBC4CeIYDUayZ', time=2024-08-27T05:35:55.062678+0000, chain.objs.size()=1 2024-08-27T03:58:31.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.529__multipart_mymultipart.2~mvpjDKf-cto7XxH8aDrBC4CeIYDUayZ.3 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16520636919888189737', time=2024-08-27T05:37:02.827796+0000, chain.objs.size()=1 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.548__shadow_.w13wYcEs6XfJ7NTlryDEXObe-HzwN0i_0 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16140794880262444136', time=2024-08-27T05:38:10.406708+0000, chain.objs.size()=1 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:yXttukV4eovjDh2og2jBkyBra7EQFP3_.sYVznkSbOJNgyU4uCuSu9aCX4cef9_C_0 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16369617322097432647', time=2024-08-27T05:39:23.804149+0000, chain.objs.size()=1 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:.Xgpa0W0FUmCwO4hjOqTELI1a3BlInH_.OO3T_j1g7Jm-tWqsRa7fIlW1CyyqHS2_0 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7368078774900304019', time=2024-08-27T05:43:23.317310+0000, chain.objs.size()=1 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.611__shadow_.fwyJhrsj_llKVPvB0kqrOfxFSZihTMm_0 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18036948798696303541', time=2024-08-27T05:44:29.231774+0000, chain.objs.size()=1 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.614__shadow_.AhEEjgbfvCzenUQxxINozpgmEj0pwHm_0 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10600888957759224381', time=2024-08-27T05:46:14.536401+0000, chain.objs.size()=1 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.648__shadow_.kcwulrqE3hwJxSpBxI77t8D3Iq8-0BT_0 2024-08-27T03:58:31.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7464193327390869747', time=2024-08-27T05:47:31.957872+0000, chain.objs.size()=1 2024-08-27T03:58:31.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.686__shadow:mjNEvECILmn0m-M0vsSm9x6YMdSzCxp_.-Y1ngBxKxEVPmaoeP8vAw2UMujkKVsF_0 2024-08-27T03:58:31.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10651933123664755315', time=2024-08-27T05:47:36.804389+0000, chain.objs.size()=1 2024-08-27T03:58:31.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.123+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.689__shadow_.F8ebaODiTbOO8UTETbjLOs9lghF_8o0_0 2024-08-27T03:58:31.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.127+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13865070916020214298', time=2024-08-27T05:48:03.391662+0000, chain.objs.size()=1 2024-08-27T03:58:31.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.127+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.704__shadow:LqMhYBrtdP2L4fDs4hvQZOW-QLho2FL_.VgwuYrYR71JwV8W0GkcZ2uEeEW_EI97_0 2024-08-27T03:58:31.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.131+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.137 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-08-27T03:58:31.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.135+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43527' 2024-08-27T03:58:31.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_ag4hYazGf5UqXdmXeetokow8rY5E_Gq', time=2024-08-27T05:13:49.768738+0000, chain.objs.size()=2 2024-08-27T03:58:31.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.159__shadow_.kWBhyG-Lf4sm273K1khxfbdglL7eNG7_0 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.159__shadow_.kWBhyG-Lf4sm273K1khxfbdglL7eNG7_1 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15274013690683005424', time=2024-08-27T05:18:09.894068+0000, chain.objs.size()=1 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.232__shadow_.xOebsqgWn5JBgmb4xuJIBMUht4BM_is_0 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7467994355947905065', time=2024-08-27T05:18:36.670129+0000, chain.objs.size()=1 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.246__shadow_.BoUAEl1QvIJ5wxS-0odK7jevt02qkDm_0 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16515480822840228295', time=2024-08-27T05:20:35.129511+0000, chain.objs.size()=1 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8CsX_B7xKCbbdByywaB3Z3phK9z3cpK_0 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14213261912842464059', time=2024-08-27T05:20:36.475676+0000, chain.objs.size()=1 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0NvH_q67S1zZQdXhcYGT4IUJhcGmrln_0 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2982063569592821990', time=2024-08-27T05:20:39.188910+0000, chain.objs.size()=1 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JRZR1vf6m0jzlxZIMS3cIaJQldayIFF_0 2024-08-27T03:58:31.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14687883726052146014', time=2024-08-27T05:20:41.962383+0000, chain.objs.size()=1 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Xm2w6enBCnUmn_4lK33gEjUgZA2mgGo_0 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17183847874203460089', time=2024-08-27T05:20:41.975656+0000, chain.objs.size()=1 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LJt12OmFoeAset84Sin_vjgdzLjCEUo_0 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17290489287082747840', time=2024-08-27T05:20:43.888711+0000, chain.objs.size()=1 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PiDyND_uKB4PweZzGkbUggpde1W-j2T_0 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2499678097712480696', time=2024-08-27T05:20:45.422414+0000, chain.objs.size()=1 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2uXybNG64h_APxDR_aPc-b9qKOgCk8S_0 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14412321095769772199', time=2024-08-27T05:20:47.708463+0000, chain.objs.size()=1 2024-08-27T03:58:31.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.139+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xz2QvDwkmFUKt8-D_xw35g2Qos-nU9x_0 2024-08-27T03:58:31.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8759941140566561954', time=2024-08-27T05:20:48.127591+0000, chain.objs.size()=1 2024-08-27T03:58:31.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.tBRXgGKcjyoKwIWGV0tn509HokyvjP0_0 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4618192577577871009', time=2024-08-27T05:20:48.186521+0000, chain.objs.size()=1 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XCcshsewisb1KkoxLHmtyqXJFhjaRPc_0 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4740351040598811645', time=2024-08-27T05:20:48.411572+0000, chain.objs.size()=1 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qJrD5UHNUDt7wB70PG7GoGRyePICk8b_0 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16964829508529676973', time=2024-08-27T05:20:48.510516+0000, chain.objs.size()=1 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5apLNtWd6RsoHYOfWk2967e2qNgeXs8_0 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3247976453834062061', time=2024-08-27T05:20:48.869723+0000, chain.objs.size()=1 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3xkbCiMrMCw1WHpgciWrH_p4awroydj_0 2024-08-27T03:58:31.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6315071742693932422', time=2024-08-27T05:20:49.831398+0000, chain.objs.size()=1 2024-08-27T03:58:31.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0zCu1lfjlnN901fXRU9Ju1vwqvJvH-E_0 2024-08-27T03:58:31.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10774509389341362072', time=2024-08-27T05:20:51.762760+0000, chain.objs.size()=1 2024-08-27T03:58:31.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vG6etLHRGL2KaZykuoaUDM7eMJX95zx_0 2024-08-27T03:58:31.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7706196021044445651', time=2024-08-27T05:20:52.746271+0000, chain.objs.size()=1 2024-08-27T03:58:31.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Z0gy6vTM-W89u3-cfjjL-7tBdkBdyoR_0 2024-08-27T03:58:31.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8997560796532798227', time=2024-08-27T05:20:54.342537+0000, chain.objs.size()=1 2024-08-27T03:58:31.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OhRYhSbPMESkr_8bXlOBdfl1sqPQUTQ_0 2024-08-27T03:58:31.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7350916743706536398', time=2024-08-27T05:20:55.270341+0000, chain.objs.size()=1 2024-08-27T03:58:31.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eOP8tYpMztpWnlFAUGQIdnG0KZhNjRn_0 2024-08-27T03:58:31.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1297326842341378054', time=2024-08-27T05:20:55.315854+0000, chain.objs.size()=1 2024-08-27T03:58:31.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.143+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.M0ajTNXpH_mJUHw5dG8p3UPik4ETBSp_0 2024-08-27T03:58:31.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15315739568652338158', time=2024-08-27T05:20:55.398926+0000, chain.objs.size()=1 2024-08-27T03:58:31.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mOKumMmZdFekmw3m801ESkhEbACkMG8_0 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11166211204232065866', time=2024-08-27T05:20:55.790934+0000, chain.objs.size()=1 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.UDJkLNDre823fkn1T3n6GoLSpl5pN9y_0 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13921147985462703070', time=2024-08-27T05:20:55.918371+0000, chain.objs.size()=1 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Y6kPa_AlduA0oIpqsMAW8sP_YK7H7MB_0 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3503319338697463439', time=2024-08-27T05:20:56.072844+0000, chain.objs.size()=1 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MtaqiH9jU81uF3vhol0dBY0GCdtI1Na_0 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10034617801703649921', time=2024-08-27T05:20:56.306531+0000, chain.objs.size()=1 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PARtnvr1eHzXle9YkEYGpTZHX6O7GvW_0 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13534171663714077457', time=2024-08-27T05:20:57.408299+0000, chain.objs.size()=1 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QfCWQtbrzxUvFhtoGOaL7vlAM50Io6k_0 2024-08-27T03:58:31.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12205823784334649232', time=2024-08-27T05:20:59.013319+0000, chain.objs.size()=1 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3a755Tcg_1dZIwCpU62T3JCvaXQYkyf_0 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13129912717883762815', time=2024-08-27T05:21:00.228851+0000, chain.objs.size()=1 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zUUZGEtXv2oK54UClLbokJymHXkiRFW_0 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.197125494061809343', time=2024-08-27T05:21:00.364637+0000, chain.objs.size()=1 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MyzGVsTTJa81N1OJr0cbBbTcO02xitk_0 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18089646655915769773', time=2024-08-27T05:21:02.415858+0000, chain.objs.size()=1 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-h5aMUNBnq1t4LQR3GDjuEJ-bHF_ho__0 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11234613650660261826', time=2024-08-27T05:21:02.743002+0000, chain.objs.size()=1 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9Bp5WMveH_sr-FtnytyqcTbiOBYfSIK_0 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12104019998481127123', time=2024-08-27T05:21:04.215554+0000, chain.objs.size()=1 2024-08-27T03:58:31.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.147+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pMJd7pfy3Puesamj5bIRMYAztuadtSt_0 2024-08-27T03:58:31.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.151+0000 7f1ca0951640 0 -- 172.21.15.143:0/3782803346 >> [v2:172.21.15.143:6808/3382757569,v1:172.21.15.143:6809/3382757569] conn(0x7f1c9806ba00 msgr2=0x7f1b6c089570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:31.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.151+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6671287435456939096', time=2024-08-27T05:21:04.277964+0000, chain.objs.size()=1 2024-08-27T03:58:31.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.151+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CCg8zN4zCVisT-35vIEpTXSO2HccGJg_0 2024-08-27T03:58:31.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16104271889080942808', time=2024-08-27T05:21:06.017154+0000, chain.objs.size()=1 2024-08-27T03:58:31.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.257__shadow_.fjmeV4AHaVueKhI4xyvdgpXmTrjOXZ-_0 2024-08-27T03:58:31.156 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14901316735107384812', time=2024-08-27T05:21:14.581853+0000, chain.objs.size()=1 2024-08-27T03:58:31.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.262__shadow_.xrgRORONF_Z5ZuRi_G3shOIaNB4yWYm_0 2024-08-27T03:58:31.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17762078088764935838', time=2024-08-27T05:21:41.628391+0000, chain.objs.size()=1 2024-08-27T03:58:31.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.277__shadow_.vROWuPs9C-sYGzwUx_xXvhFWEP9phSm_0 2024-08-27T03:58:31.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1784632482574879692', time=2024-08-27T05:21:43.513412+0000, chain.objs.size()=1 2024-08-27T03:58:31.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.278__shadow_.Sn6dj4o3GVwAw_YWRiAfqE542B09aMh_0 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.660098360716005927', time=2024-08-27T05:21:45.862809+0000, chain.objs.size()=1 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.279__shadow_.nSQV-dI18P-od7ZtqaaQ_-IasUb1jLP_0 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15679263871182481218', time=2024-08-27T05:21:50.287083+0000, chain.objs.size()=1 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.281__shadow_.z2Yr46u87aSSZynZfr3xhRrxDPKGCAB_0 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17258110971775788602', time=2024-08-27T05:21:57.892517+0000, chain.objs.size()=1 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.285__shadow_.Y24Gmq0EJsFk7jh1NcenZZGa9nv0B85_0 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12344790140692121006', time=2024-08-27T05:22:02.741772+0000, chain.objs.size()=1 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.yUouT6Vo5Rr2YGgQ0ErhBdhiD05EUVc_0 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10464880974403468484', time=2024-08-27T05:22:08.123810+0000, chain.objs.size()=1 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.zRF0kLZd8r5gOl-tMBgsw1R83eRuT53_0 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17910805427392022656', time=2024-08-27T05:24:47.758889+0000, chain.objs.size()=1 2024-08-27T03:58:31.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.155+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1reuGRjiF1X3B1lGpxv1u3S9jWrWyt5_0 2024-08-27T03:58:31.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9349833190981241981', time=2024-08-27T05:24:48.946900+0000, chain.objs.size()=1 2024-08-27T03:58:31.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.C6E1Qn9gPJWP57EXTCWGiA5qDLLnBdy_0 2024-08-27T03:58:31.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7766949519686196526', time=2024-08-27T05:24:49.300995+0000, chain.objs.size()=1 2024-08-27T03:58:31.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VhXrKznN_k4HyU0uHJXLOIzpQzrQiXT_0 2024-08-27T03:58:31.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.159+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10710043772956347791', time=2024-08-27T05:24:49.302356+0000, chain.objs.size()=1 2024-08-27T03:58:31.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.159+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FsRtoJrPUTFdGbqnsCqY8mdxQKcDFT3_0 2024-08-27T03:58:31.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8289083633656169017', time=2024-08-27T05:24:50.467221+0000, chain.objs.size()=1 2024-08-27T03:58:31.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.34LDGVE5hGJ4vSbOKgp2crutfccaU1m_0 2024-08-27T03:58:31.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8428997690553601921', time=2024-08-27T05:24:50.468617+0000, chain.objs.size()=1 2024-08-27T03:58:31.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Ty0t7Hf76fcHeqWlbcO4QGoi9m3Ubtg_0 2024-08-27T03:58:31.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2687173757357356511', time=2024-08-27T05:24:51.287895+0000, chain.objs.size()=1 2024-08-27T03:58:31.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MNQwOja28Z2xo04VzXbT58CaP85ssZu_0 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9757811734298914634', time=2024-08-27T05:24:51.439987+0000, chain.objs.size()=1 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xkPZMAjBcmuCI7KwsdIkJoGO8xGrlnZ_0 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15777935443872583488', time=2024-08-27T05:24:53.087802+0000, chain.objs.size()=1 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.H26C8PgIWmweNMSXVAKo11bNGAruJJV_0 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9890806894778952033', time=2024-08-27T05:24:54.619643+0000, chain.objs.size()=1 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OCrwzTNSmUrJOgV6fhtf4OLqVdvYbZP_0 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7759135824254965481', time=2024-08-27T05:24:54.813320+0000, chain.objs.size()=1 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.tnfm5okLUD0rwxyA7Q74oBADMSx0qzu_0 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15978242625213232078', time=2024-08-27T05:24:56.955958+0000, chain.objs.size()=1 2024-08-27T03:58:31.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5nm7GfjFAZv5tF3fZka4Glj9JX6mHep_0 2024-08-27T03:58:31.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10839400653201180477', time=2024-08-27T05:24:58.508927+0000, chain.objs.size()=1 2024-08-27T03:58:31.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.163+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2R4kWm4mqXp2xhNwUhDtTxZsKsR4cKO_0 2024-08-27T03:58:31.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca1953640 0 -- 172.21.15.143:0/3782803346 >> [v2:172.21.15.143:6824/2173528226,v1:172.21.15.143:6825/2173528226] conn(0x558d81aa4aa0 msgr2=0x558d81aa6f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16373691547072096813', time=2024-08-27T05:25:03.210977+0000, chain.objs.size()=1 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.32aBHmjyCvA6e1_oASACNGIr61s3Ihj_0 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8146444407273696059', time=2024-08-27T05:25:03.309157+0000, chain.objs.size()=1 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.psO3VoiYvUZg9FA0XvqulZutF-xvb3c_0 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16348765182892544417', time=2024-08-27T05:25:05.370459+0000, chain.objs.size()=1 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.UXYwRbgKW3kqYm36EKj6_0uhoRAJYve_0 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6410873071505925835', time=2024-08-27T05:25:10.372196+0000, chain.objs.size()=1 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BbopfqJXY-xrJhlDqUUP74ji4IuGlYZ_0 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2337543007511317024', time=2024-08-27T05:25:10.990107+0000, chain.objs.size()=1 2024-08-27T03:58:31.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.167+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2Zu5npxc1L-1e3UcdNxGjUTcuwxRWb-_0 2024-08-27T03:58:31.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5472584106893042431', time=2024-08-27T05:25:11.184912+0000, chain.objs.size()=1 2024-08-27T03:58:31.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FDIE6wlEKXxj12D7-3hdO1iZk5IcB-v_0 2024-08-27T03:58:31.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8480488951020977896', time=2024-08-27T05:25:12.658292+0000, chain.objs.size()=1 2024-08-27T03:58:31.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qn0IZ8yY5Hj4YZMTYrTGVpq2jE1V09P_0 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14865288089940195884', time=2024-08-27T05:25:12.745200+0000, chain.objs.size()=1 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZyMYLIN7fdvVSGNrwoRWvxt0KrxvvfQ_0 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4831493805267828268', time=2024-08-27T05:25:13.186270+0000, chain.objs.size()=1 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x0VJcLbnmR1Q-nGJ2YE4b_jQiwe6po1_0 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13425534570073697352', time=2024-08-27T05:25:13.377714+0000, chain.objs.size()=1 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hRV5orfNP_hV8t5pEl_BEO3PY-F8FRV_0 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9655243324466550098', time=2024-08-27T05:25:14.177743+0000, chain.objs.size()=1 2024-08-27T03:58:31.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9NTqSL6tSSzmaU125xb9ZAslA4zjv80_0 2024-08-27T03:58:31.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4451648522916365024', time=2024-08-27T05:26:59.800340+0000, chain.objs.size()=1 2024-08-27T03:58:31.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.X1F8lAjgnaXw2w4D0Lgvqm4CUM2xYAe_0 2024-08-27T03:58:31.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16101773798441320233', time=2024-08-27T05:27:00.511671+0000, chain.objs.size()=1 2024-08-27T03:58:31.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wbSAkh-X9EwE4juu6ak9it1nYC10B73_0 2024-08-27T03:58:31.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5821056434864653810', time=2024-08-27T05:27:05.466397+0000, chain.objs.size()=1 2024-08-27T03:58:31.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7VjxFmxIDz5kSSXjLa0Om7SFOUuKEeb_0 2024-08-27T03:58:31.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.171+0000 7f1ca0951640 0 -- 172.21.15.143:0/3782803346 >> [v2:172.21.15.181:6824/3209286965,v1:172.21.15.181:6825/3209286965] conn(0x7f1b6c081ea0 msgr2=0x7f1b6c0842d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-08-27T03:58:31.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17003738847312212668', time=2024-08-27T05:27:05.468996+0000, chain.objs.size()=1 2024-08-27T03:58:31.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gRQAo5zXU52lKru9v2a06CPkgTuX-yq_0 2024-08-27T03:58:31.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7901752229150124408', time=2024-08-27T05:27:05.536841+0000, chain.objs.size()=1 2024-08-27T03:58:31.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ps-VHsfzHjYKjARMecjOBFWtnYTKbQM_0 2024-08-27T03:58:31.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14096978341041143013', time=2024-08-27T05:27:06.685311+0000, chain.objs.size()=1 2024-08-27T03:58:31.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Kz_iXruvAb0rLjbxaiQlJhypagCNo9i_0 2024-08-27T03:58:31.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12993617557882412234', time=2024-08-27T05:27:07.261039+0000, chain.objs.size()=1 2024-08-27T03:58:31.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6V17LAhaAjyM80e68RL_39Nn5jPA6iA_0 2024-08-27T03:58:31.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2230012795734493027', time=2024-08-27T05:27:07.366365+0000, chain.objs.size()=1 2024-08-27T03:58:31.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.175+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ybSEs1ATEhiliJgeRad9jQVDznZ8bbo_0 2024-08-27T03:58:31.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11824735436378419692', time=2024-08-27T05:27:08.226796+0000, chain.objs.size()=1 2024-08-27T03:58:31.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mT-xr2udugqYf0JB401fmynwX8aVxx6_0 2024-08-27T03:58:31.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5713164416506492473', time=2024-08-27T05:27:09.291267+0000, chain.objs.size()=1 2024-08-27T03:58:31.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._66pFvoVES233wDege-0Y5bHpGxqpBv_0 2024-08-27T03:58:31.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7247818908439976513', time=2024-08-27T05:27:09.596771+0000, chain.objs.size()=1 2024-08-27T03:58:31.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wrjTy2VIu-k1nour-HhCpRS4hHgkZEe_0 2024-08-27T03:58:31.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5800625888653731246', time=2024-08-27T05:27:10.086870+0000, chain.objs.size()=1 2024-08-27T03:58:31.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0v--KIuQJlmQmD1VRE0SwBp3CMMyYMq_0 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15135362641079545375', time=2024-08-27T05:27:10.873615+0000, chain.objs.size()=1 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bIS1RPMTEBxXdpVM4XVyE54nEQxi-jf_0 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13503038432662327142', time=2024-08-27T05:27:11.163868+0000, chain.objs.size()=1 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EzdA83VO_oIHlJ_3QE0260oW2FQpCsB_0 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4193477427201187746', time=2024-08-27T05:27:11.254991+0000, chain.objs.size()=1 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.u7VYXvZjzCKwbtQ88zaxQ4FB9nDjRnM_0 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14925554136044088489', time=2024-08-27T05:27:11.585575+0000, chain.objs.size()=1 2024-08-27T03:58:31.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-0nmx2ULVwy5sqkL6qy-0nQGUiUKeCT_0 2024-08-27T03:58:31.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2191057322199725533', time=2024-08-27T05:27:13.219207+0000, chain.objs.size()=1 2024-08-27T03:58:31.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jhd--OIJa206mS8A6OVS54KKpO50WkP_0 2024-08-27T03:58:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17016589934556331515', time=2024-08-27T05:27:13.727788+0000, chain.objs.size()=1 2024-08-27T03:58:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Yjf6zp0jbIzXJ-CurXGvP1c50uGmdva_0 2024-08-27T03:58:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11924068733415658441', time=2024-08-27T05:27:14.199097+0000, chain.objs.size()=1 2024-08-27T03:58:31.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.179+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8UgPUdCnay_gJ4vQ9hAH9RZhLwXthf9_0 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4006181397050955970', time=2024-08-27T05:27:14.464175+0000, chain.objs.size()=1 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZcTu86V6NPCWPbRczkVztPn2yNA7OY8_0 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12651135018847174110', time=2024-08-27T05:27:14.467920+0000, chain.objs.size()=1 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qwCFJbl9wvQe-8GvBbmqRfxnXKZc8zK_0 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15389819336258477708', time=2024-08-27T05:27:14.873804+0000, chain.objs.size()=1 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.PkfEM7J0AJzg57N2OEfQddXkH8px_9B_0 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.815159406182029850', time=2024-08-27T05:27:15.570632+0000, chain.objs.size()=1 2024-08-27T03:58:31.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.M1JQGpG7STJ6FgAqktAqQlfuEHg0rHW_0 2024-08-27T03:58:31.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16963932334380357221', time=2024-08-27T05:27:16.549307+0000, chain.objs.size()=1 2024-08-27T03:58:31.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Hj7LqP0PldMMzhcQC9uO9vpofF3cvBH_0 2024-08-27T03:58:31.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2281043236964628838', time=2024-08-27T05:27:17.172121+0000, chain.objs.size()=1 2024-08-27T03:58:31.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.183+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.je4eQRNExjDgHtd1yhD0Rn4_ImhHrdT_0 2024-08-27T03:58:31.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15531847555812012688', time=2024-08-27T05:27:17.548233+0000, chain.objs.size()=1 2024-08-27T03:58:31.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6RdT--He560dHn12iRRAVq7O7-gEY8l_0 2024-08-27T03:58:31.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6570725970025542899', time=2024-08-27T05:27:17.683243+0000, chain.objs.size()=1 2024-08-27T03:58:31.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.IboLXfo4oY0R2n54Sty3hwisvbOgIp4_0 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.698314894377348874', time=2024-08-27T05:27:18.093789+0000, chain.objs.size()=1 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hhQv_B3h4bYaxfAWnOVkJjJ7EvueDyR_0 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2231426978470388882', time=2024-08-27T05:27:19.252985+0000, chain.objs.size()=1 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.PsnsIfG8uh5BqvSS5UlBgERn4DC4Vbw_0 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.677208714458872556', time=2024-08-27T05:27:22.859161+0000, chain.objs.size()=1 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QYQBYG_yfLl3kmrzIkTS6ydnnyyVDvL_0 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14783526979503260938', time=2024-08-27T05:27:22.995736+0000, chain.objs.size()=1 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.26RhsZeg-jj4MTTaf5wTz4xTdvZxfCc_0 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7533157403170087856', time=2024-08-27T05:27:25.916008+0000, chain.objs.size()=1 2024-08-27T03:58:31.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.187+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5fHSrkmEMQRE20yCo-s1iN1oWLLGZii_0 2024-08-27T03:58:31.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43527 2024-08-27T03:58:31.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-08-27T03:58:31.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2995404018502718630', time=2024-08-27T05:27:42.686651+0000, chain.objs.size()=1 2024-08-27T03:58:31.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.329__shadow_.wqJ7GaXWCyNORnWtZnO3FVfCH1I8Mmk_0 2024-08-27T03:58:31.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13023923069244493723', time=2024-08-27T05:28:43.850438+0000, chain.objs.size()=1 2024-08-27T03:58:31.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.373__shadow_.D93vJqMuoQHo3kqCtlfWsTz23RJO-K6_0 2024-08-27T03:58:31.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17734512059978396842', time=2024-08-27T05:31:04.173583+0000, chain.objs.size()=1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.459__shadow_.9VWVxKMGcPC5-XvoFoUiLGtOm1r-Vvu_0 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2775595209452146668', time=2024-08-27T05:31:30.649408+0000, chain.objs.size()=1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.478__shadow_.JQ0gpGUCpy1jIpQnzWbLVIAYSWZpGd4_0 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oyr7LxM-T1aNQiQ9Rr_uQ0fEgEC8yQh', time=2024-08-27T05:35:48.192081+0000, chain.objs.size()=1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.527__multipart_mymultipart.2~oyr7LxM-T1aNQiQ9Rr_uQ0fEgEC8yQh.1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16538838410021274272', time=2024-08-27T05:37:41.260954+0000, chain.objs.size()=1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.558__shadow_.vwiq7v4hfP6eFU5w0xLtiI5zlOMHqI0_0 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12572436263383906107', time=2024-08-27T05:39:03.300521+0000, chain.objs.size()=1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:HezBK4mZYnoPm356vHIwHwuWmljM2V4_.6uXEeBjRP2_kM1lLEVCBPrJAqolgq7__0 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11807622544290034423', time=2024-08-27T05:39:55.437436+0000, chain.objs.size()=1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:Zuw8.8-K8VAzsoD0uO-3tU6uKT1f.Pz_.OMeZfoLixaeRvYIK8oeFVc9JbuU6YpE_0 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12069034160206461336', time=2024-08-27T05:39:55.902122+0000, chain.objs.size()=1 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:3WIMA9s5CmFKieQ4ETsLblTPtgvrFfj_._UQkA2A2ipFR27zIWIiSz2I3HQBPeQz_0 2024-08-27T03:58:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17937850378078627114', time=2024-08-27T05:40:15.880329+0000, chain.objs.size()=1 2024-08-27T03:58:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:-PWHDRQ.Xo1NpRemXqNq5-EZhQ4QFDF_.r8glgiAIRBDotFSYoZ7396NgsNjykeU_0 2024-08-27T03:58:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8545028774284145592', time=2024-08-27T05:40:29.633039+0000, chain.objs.size()=1 2024-08-27T03:58:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.590__shadow_.jzESs1Mn4Q9FSLRy4KRbAPYS742lcCB_0 2024-08-27T03:58:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12159212937692064471', time=2024-08-27T05:40:39.128564+0000, chain.objs.size()=1 2024-08-27T03:58:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.195+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.597__shadow_.r0fAKDGjF8qGQ47ryGZ_sgjzYvOVVWM_0 2024-08-27T03:58:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.199+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12286998459642846232', time=2024-08-27T05:47:42.376422+0000, chain.objs.size()=1 2024-08-27T03:58:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.199+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.692__shadow:cdN7o1wU6lhq5z3a0C-amHsa7qDbfQ-_.jn7QO1Law5WsH5di1XJxDpn3q733QCZ_0 2024-08-27T03:58:31.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.203+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-08-27T03:58:31.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44175' 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10030894413877992365', time=2024-08-27T05:15:08.925381+0000, chain.objs.size()=1 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.197__shadow_.uRYx5qfGgSybUpcqkwsEznohZyKEmrf_0 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10296701988992001416', time=2024-08-27T05:17:55.175823+0000, chain.objs.size()=1 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.225__shadow_.EzhXQDWo_NZ9RPwBrtxjcgM8ueRBicD_0 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15857138694437304769', time=2024-08-27T05:17:58.955162+0000, chain.objs.size()=1 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.227__shadow_.xrFwUHwl4vs5gZOwVlAuHgnfytcX1nV_0 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6780553035907431870', time=2024-08-27T05:18:00.810965+0000, chain.objs.size()=1 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.228__shadow_.4gqkILZKtnhtSZPe3oh68EeB6QGQ5Is_0 2024-08-27T03:58:31.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11715076607119944476', time=2024-08-27T05:18:47.600859+0000, chain.objs.size()=1 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.252__shadow_.nZXh2Yos6MYjAEUWpPu6EmD2OMn1uEM_0 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10409022675127144534', time=2024-08-27T05:20:38.054154+0000, chain.objs.size()=1 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vucvLdta-7wHt3Uj0qGyr708qE5W411_0 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12364439997473329056', time=2024-08-27T05:20:39.267293+0000, chain.objs.size()=1 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Cm00DhqyRboNYaGeBjmgSn-mbinnK84_0 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14025190508326105332', time=2024-08-27T05:20:39.269354+0000, chain.objs.size()=1 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.622cyTGKZBwOSdgW1nSAMuugUHSz7BA_0 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1964994405562007364', time=2024-08-27T05:20:40.575113+0000, chain.objs.size()=1 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WSJGuvCAdSAjFwKMXTNeJXiJvECFI-f_0 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13096757312357831485', time=2024-08-27T05:20:41.153066+0000, chain.objs.size()=1 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7mqLWjVhVRPgMYsjVJDo_M0O15Fh8gT_0 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12342299802529150567', time=2024-08-27T05:20:42.078562+0000, chain.objs.size()=1 2024-08-27T03:58:31.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PSZwB7ewqFM1RCRkV5Iz-7Tm8DueiNx_0 2024-08-27T03:58:31.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12375004965257572758', time=2024-08-27T05:20:43.510550+0000, chain.objs.size()=1 2024-08-27T03:58:31.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.207+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Otx4uy5ZfiL0JgEKZoXMqC0JADb-vyd_0 2024-08-27T03:58:31.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2770674128411276993', time=2024-08-27T05:20:44.901550+0000, chain.objs.size()=1 2024-08-27T03:58:31.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Y8IH0AnQbcdVpb50BlZ58eTEqf8GTiy_0 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4726829815100781465', time=2024-08-27T05:20:46.036014+0000, chain.objs.size()=1 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.v9bgmcv68w_QCwZ3-MHOIF1_Xk_2yTB_0 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17702566062282648746', time=2024-08-27T05:20:47.606158+0000, chain.objs.size()=1 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ckUIFfNnmv3eZ8caAhaCTugXb40NiI4_0 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17208279598161154830', time=2024-08-27T05:20:47.808403+0000, chain.objs.size()=1 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.O6xtL0iST1kGWRwqAlrJu-qwzekFgfX_0 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6165861306659922824', time=2024-08-27T05:20:47.939240+0000, chain.objs.size()=1 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.VHgoQGD4_76dTGwN8YFr5y1wMBfrq8h_0 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6389869692434117821', time=2024-08-27T05:20:48.193024+0000, chain.objs.size()=1 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TmjSwdeW4VpW6PehvzuW4OEg9Flh9a1_0 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12470915047787506997', time=2024-08-27T05:20:50.774223+0000, chain.objs.size()=1 2024-08-27T03:58:31.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.P4VdqGtk-XTYZ_4zQ4hpFRLnOKYJRO0_0 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3213782139128912979', time=2024-08-27T05:20:51.105110+0000, chain.objs.size()=1 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.p-LRkiRcUTraE67NMCN-KQq97I7tlVB_0 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9048776358744483997', time=2024-08-27T05:20:52.733160+0000, chain.objs.size()=1 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.luoy3wV9zkJTo3NX0HQgigxLoP0acDA_0 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5406354059038233001', time=2024-08-27T05:20:53.033133+0000, chain.objs.size()=1 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-krqN9K-pkviD7rPPT5eGs7St0GOSr3_0 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9748318072885722642', time=2024-08-27T05:20:58.642874+0000, chain.objs.size()=1 2024-08-27T03:58:31.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.211+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.YLougIVAxdt2N3GMxf3p_hT1q5epph7_0 2024-08-27T03:58:31.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6664500152899789796', time=2024-08-27T05:20:58.787075+0000, chain.objs.size()=1 2024-08-27T03:58:31.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.X-UscH31aRuYe8jG4M72t7RE4-bqoX5_0 2024-08-27T03:58:31.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3981044867739537117', time=2024-08-27T05:20:59.137891+0000, chain.objs.size()=1 2024-08-27T03:58:31.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.DEo4aERDUL5VYfKTVRYACtLojfZQpNv_0 2024-08-27T03:58:31.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2989416755026878103', time=2024-08-27T05:21:00.484746+0000, chain.objs.size()=1 2024-08-27T03:58:31.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SGd647856cI6m_W8dCx7TfXedhjhaDp_0 2024-08-27T03:58:31.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2260796291304935509', time=2024-08-27T05:21:00.555039+0000, chain.objs.size()=1 2024-08-27T03:58:31.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.215+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kNYJ-K7mCd8tg_SLC5YNKDIej8VxsaD_0 2024-08-27T03:58:31.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12228225289281449214', time=2024-08-27T05:21:02.419763+0000, chain.objs.size()=1 2024-08-27T03:58:31.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.TmD3VGHToEDsvY5eC3pKyg7JgPJ_o6P_0 2024-08-27T03:58:31.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16854849896391018076', time=2024-08-27T05:21:03.113127+0000, chain.objs.size()=1 2024-08-27T03:58:31.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KdG_kK2aJ4pHDPjeAcVFOXlOpU-aT9x_0 2024-08-27T03:58:31.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5407087497015480156', time=2024-08-27T05:21:03.329495+0000, chain.objs.size()=1 2024-08-27T03:58:31.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.S393Da-JXZ271ZQPuojx60n68JAkPiW_0 2024-08-27T03:58:31.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12395561878985168460', time=2024-08-27T05:21:03.703395+0000, chain.objs.size()=1 2024-08-27T03:58:31.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rKtBooAVdhOez5PexxnyLP76O21KG-C_0 2024-08-27T03:58:31.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11143282754214060138', time=2024-08-27T05:22:02.740807+0000, chain.objs.size()=1 2024-08-27T03:58:31.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.o574KSvq-ra1mePlns_QU4gArKBEw1W_0 2024-08-27T03:58:31.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.986598065351303666', time=2024-08-27T05:22:03.027755+0000, chain.objs.size()=1 2024-08-27T03:58:31.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.TtxVmWB7-cY0km131g5m6HUlxAXHA2w_0 2024-08-27T03:58:31.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13926271809873856828', time=2024-08-27T05:22:08.037667+0000, chain.objs.size()=1 2024-08-27T03:58:31.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.Byjsq8NF1Nnopp1Daszl8Fb4KHKZ1R4_0 2024-08-27T03:58:31.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10738115840897165772', time=2024-08-27T05:24:46.761329+0000, chain.objs.size()=1 2024-08-27T03:58:31.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.219+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TDchc7TQfCCK2xE8sWhq2QfSs_otq2n_0 2024-08-27T03:58:31.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18319179780813222257', time=2024-08-27T05:24:50.757731+0000, chain.objs.size()=1 2024-08-27T03:58:31.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7-BRtQw2hEsxuESIowUSmBZ5b4DBOwh_0 2024-08-27T03:58:31.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11109765728939330879', time=2024-08-27T05:24:51.443965+0000, chain.objs.size()=1 2024-08-27T03:58:31.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Kk-SojQkdh9zXuOszd2dOVoLrXrW1fc_0 2024-08-27T03:58:31.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4466834359768150813', time=2024-08-27T05:24:51.697407+0000, chain.objs.size()=1 2024-08-27T03:58:31.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qYf0782_nJCdONVqre6685VVZ6iBnoD_0 2024-08-27T03:58:31.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7964191927967651289', time=2024-08-27T05:24:51.815253+0000, chain.objs.size()=1 2024-08-27T03:58:31.226 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.223+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._rJneUAfPnq7bfUmr8q-O5Nb4umAPrd_0 2024-08-27T03:58:31.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1741388862955306084', time=2024-08-27T05:24:52.622221+0000, chain.objs.size()=1 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FnQgE6TFBXoaHHQtbbBdUdBOH5chpof_0 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4113033950027282228', time=2024-08-27T05:24:52.697403+0000, chain.objs.size()=1 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.I5TygTtuA6qRP5u7OiO9v-0NHGw917E_0 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.980764335272866727', time=2024-08-27T05:24:53.084322+0000, chain.objs.size()=1 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7R1j0e776nly68IppKUSpE5qMPw-gpE_0 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14799925003050816143', time=2024-08-27T05:24:53.150568+0000, chain.objs.size()=1 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fDQcplviN9M5lYN4vl0QZnLUxX4i_SV_0 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12794826385159138947', time=2024-08-27T05:24:54.255387+0000, chain.objs.size()=1 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.WBpBvcZ8QamIXYh--AM93o9eWfwQpD3_0 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9294837053006835265', time=2024-08-27T05:24:54.379054+0000, chain.objs.size()=1 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GTist28-nIRPLAHNNrFqNoT1tuCl2_p_0 2024-08-27T03:58:31.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4087202706466784716', time=2024-08-27T05:24:54.762293+0000, chain.objs.size()=1 2024-08-27T03:58:31.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.qLh_ORQpuIswQ8lrg5kLyGMI0hqydwn_0 2024-08-27T03:58:31.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16878114370099922426', time=2024-08-27T05:24:55.139017+0000, chain.objs.size()=1 2024-08-27T03:58:31.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.227+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.v7KKsgErbt_88W-aXAlrnku2zjuOQak_0 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.64737378272357331', time=2024-08-27T05:24:56.228119+0000, chain.objs.size()=1 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Sins-m4L7GkElDJFkAxIbUcoJYKothV_0 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14741116255049431080', time=2024-08-27T05:24:56.952641+0000, chain.objs.size()=1 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mfkPWS1skUaNMdUEguQNBGxuVwtYkYQ_0 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5327930630313060028', time=2024-08-27T05:24:57.080239+0000, chain.objs.size()=1 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.B9InxEXC62kHOCuezfhwE4Fc0U75BrD_0 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10220383329755949097', time=2024-08-27T05:24:59.639292+0000, chain.objs.size()=1 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AvPAJa6L2ysfyOmzADYnvjZn9wZsVHO_0 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18088482330562596368', time=2024-08-27T05:25:00.011481+0000, chain.objs.size()=1 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nqTrmqOFo7T1knhn_omKAvXDJrUBLh4_0 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.96763945890101081', time=2024-08-27T05:25:00.061865+0000, chain.objs.size()=1 2024-08-27T03:58:31.234 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.co0C-CswnYiWYni0jVlx7CN4bzYGBrj_0 2024-08-27T03:58:31.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9645991321279351002', time=2024-08-27T05:25:00.118867+0000, chain.objs.size()=1 2024-08-27T03:58:31.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8nQHKW6vte4G6aqt9KbyRCNiA8v_Dtz_0 2024-08-27T03:58:31.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6096636421245671965', time=2024-08-27T05:25:01.586827+0000, chain.objs.size()=1 2024-08-27T03:58:31.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.scc31NdomN4zxhRQVx3X5MD3gvzGdj8_0 2024-08-27T03:58:31.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12726236575758903290', time=2024-08-27T05:25:02.573337+0000, chain.objs.size()=1 2024-08-27T03:58:31.235 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.231+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AlVQMgmoWGrrrfhpxdNJlnXdR1hd_8i_0 2024-08-27T03:58:31.237 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1636506781232254413', time=2024-08-27T05:25:03.366691+0000, chain.objs.size()=1 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.K6qN-2NwHY0m6GSu69bNYp-PFvb7wZm_0 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17345982313712003308', time=2024-08-27T05:25:03.450865+0000, chain.objs.size()=1 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rjUvq9v3yezpSw95QYwMrIqSLdcdO0M_0 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5570859326162019950', time=2024-08-27T05:25:03.955641+0000, chain.objs.size()=1 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nctn8sXukn-YwFt-r1L-ykNj1ucIkda_0 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17051212879614430744', time=2024-08-27T05:25:05.913304+0000, chain.objs.size()=1 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.G3fdM5iTEwVZ9ieuRpf_y61pof10_8u_0 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12196696499383758564', time=2024-08-27T05:25:06.191022+0000, chain.objs.size()=1 2024-08-27T03:58:31.238 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.unc33H9Ica1Ba3JI-_Ik9AS6wynJw9B_0 2024-08-27T03:58:31.239 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7815081082267149566', time=2024-08-27T05:25:08.886405+0000, chain.objs.size()=1 2024-08-27T03:58:31.240 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.235+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.z06jttIJkZC-oFJbuFHKdgGZhvcZG6W_0 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13299336903515463268', time=2024-08-27T05:25:09.852789+0000, chain.objs.size()=1 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GUWQiqdcSbztQfFRGGVawdE3NoeFZWG_0 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6197513197726097599', time=2024-08-27T05:25:11.219392+0000, chain.objs.size()=1 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Lbkr7X4ukqTq4BnpV5TBmQw-QYD0ddz_0 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6942186092042678208', time=2024-08-27T05:25:12.853950+0000, chain.objs.size()=1 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.s3L9NPPqKAzQnkqu-rIEwoNgI-aHBJ0_0 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7367427994215492834', time=2024-08-27T05:25:13.145075+0000, chain.objs.size()=1 2024-08-27T03:58:31.241 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.s0licCXTNglLk7blhWKZ4h2wiv-vrXa_0 2024-08-27T03:58:31.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.239944900736881431', time=2024-08-27T05:25:13.538123+0000, chain.objs.size()=1 2024-08-27T03:58:31.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0wDYpt5mpadawgw3VZWiKP2AzUCxv-R_0 2024-08-27T03:58:31.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11302647751368241061', time=2024-08-27T05:26:58.773452+0000, chain.objs.size()=1 2024-08-27T03:58:31.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9ja_X2gI4tpqsV-gadZ8YYsztO58Png_0 2024-08-27T03:58:31.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13688797775913321678', time=2024-08-27T05:26:59.802127+0000, chain.objs.size()=1 2024-08-27T03:58:31.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5QERBmNc2R2RL3fiXImnKdsIl83w2iT_0 2024-08-27T03:58:31.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11525912681075575658', time=2024-08-27T05:27:00.471472+0000, chain.objs.size()=1 2024-08-27T03:58:31.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.54-RGzrXii13PfCaegFlQWuHMpKlEjP_0 2024-08-27T03:58:31.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13719014406526671209', time=2024-08-27T05:27:03.699517+0000, chain.objs.size()=1 2024-08-27T03:58:31.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zZyGwIedpyI69jtuUUP8mozvsiU-NxP_0 2024-08-27T03:58:31.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12149015149535291515', time=2024-08-27T05:27:04.087353+0000, chain.objs.size()=1 2024-08-27T03:58:31.243 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.239+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LNOWjBdaG58CKxWUCYNFiNEgmIVrjdg_0 2024-08-27T03:58:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2127441811049085344', time=2024-08-27T05:27:04.399518+0000, chain.objs.size()=1 2024-08-27T03:58:31.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Ys9NBMU9EgzFsJtRsY6ZfJV4Kx50bQu_0 2024-08-27T03:58:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11351541569235036869', time=2024-08-27T05:27:04.477021+0000, chain.objs.size()=1 2024-08-27T03:58:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.n1lhGVgD_cLN0O7iNum68WmJ51vdLpX_0 2024-08-27T03:58:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18104342828304230702', time=2024-08-27T05:27:05.464024+0000, chain.objs.size()=1 2024-08-27T03:58:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GdP9ZoFai_egeJlSk5Cl-SS57niX3Fg_0 2024-08-27T03:58:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3321095470539970794', time=2024-08-27T05:27:05.940846+0000, chain.objs.size()=1 2024-08-27T03:58:31.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RNsx8uwcf4aD2v79ztkJNn_erp4TS___0 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7934038135365090603', time=2024-08-27T05:27:06.431389+0000, chain.objs.size()=1 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zZLqHXdbsXpwEhMf5P9LLnO5UlphQpA_0 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6882161193059670685', time=2024-08-27T05:27:06.490237+0000, chain.objs.size()=1 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dHZ-K53Cd1ECfU3PfFBYu6_qMo3_sWT_0 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8869479325397071277', time=2024-08-27T05:27:07.259692+0000, chain.objs.size()=1 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pc2NnmrLqJT2C9VgbOei8_eRXF_oabJ_0 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4926882526227734561', time=2024-08-27T05:27:08.161168+0000, chain.objs.size()=1 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.B0qomAdhc5kmJOqNFJbtjdYxBbcoh6e_0 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14220255400540610872', time=2024-08-27T05:27:08.216089+0000, chain.objs.size()=1 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.J9NtLumEM79cSdk6GC4G9mk6vir2VP__0 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3963927736485257626', time=2024-08-27T05:27:10.078993+0000, chain.objs.size()=1 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.owM-9loWL2Kr5Hayy15VflcmMeHzHPw_0 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18318658848743301717', time=2024-08-27T05:27:10.367696+0000, chain.objs.size()=1 2024-08-27T03:58:31.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.243+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Z9m-tceysJilCEiyTp_ruxdZll90cSG_0 2024-08-27T03:58:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.247+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1264936904761950374', time=2024-08-27T05:27:10.874696+0000, chain.objs.size()=1 2024-08-27T03:58:31.251 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.247+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.o1K40_KNBs1BBL8_wyCifAhZXc7X-u4_0 2024-08-27T03:58:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7346613618806070609', time=2024-08-27T05:27:11.061371+0000, chain.objs.size()=1 2024-08-27T03:58:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CkevQAuL8jbsKVJ1xPvUGRZP6X08YMy_0 2024-08-27T03:58:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7957073331188113602', time=2024-08-27T05:27:12.885778+0000, chain.objs.size()=1 2024-08-27T03:58:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LMdiJZFfNldssDrJ7TX72djGp-IH0D2_0 2024-08-27T03:58:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6190093660970545145', time=2024-08-27T05:27:14.470909+0000, chain.objs.size()=1 2024-08-27T03:58:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.psZQ2-4nzbbgDLHZ_KT_O_7Nc2jx1F__0 2024-08-27T03:58:31.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15394396958961863669', time=2024-08-27T05:27:14.473396+0000, chain.objs.size()=1 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NlMCLUc6SIC7NKAd8xB_DB8n2Lfq6QC_0 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11608193832369743149', time=2024-08-27T05:27:14.940772+0000, chain.objs.size()=1 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NsK_H98pVypn4FbR3gA66b82EB3Nscv_0 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6777533785562857543', time=2024-08-27T05:27:18.519989+0000, chain.objs.size()=1 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.c3JoQopmH5Sw8sk35q8MNZM_EmK4cXf_0 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5585428357933644661', time=2024-08-27T05:27:18.877554+0000, chain.objs.size()=1 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nbWXQ_Nj9lH5RB65kp3-E1GCoaSnukY_0 2024-08-27T03:58:31.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.43700989971103060', time=2024-08-27T05:27:18.881253+0000, chain.objs.size()=1 2024-08-27T03:58:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GGUWHP4qsjnkkW9FJHW5TFOykp1P3Fv_0 2024-08-27T03:58:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1557513423066825252', time=2024-08-27T05:27:22.422398+0000, chain.objs.size()=1 2024-08-27T03:58:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BYMx-ko2yrOopnN1qysIjJqs6zVUfWJ_0 2024-08-27T03:58:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8722230893022033281', time=2024-08-27T05:27:24.659404+0000, chain.objs.size()=1 2024-08-27T03:58:31.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.251+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2luU7xQeetOSVA2PmqZ9iJUJttt1q_B_0 2024-08-27T03:58:31.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10391585048757725258', time=2024-08-27T05:27:25.824308+0000, chain.objs.size()=1 2024-08-27T03:58:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.muElOXldTBRyMe7VTjRX95ObTJq5MA4_0 2024-08-27T03:58:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11192780666105835717', time=2024-08-27T05:27:26.012785+0000, chain.objs.size()=1 2024-08-27T03:58:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UkndoKfSUi7eeCrMxo9det3g-QgcEsQ_0 2024-08-27T03:58:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.958038259255067166', time=2024-08-27T05:28:24.930705+0000, chain.objs.size()=1 2024-08-27T03:58:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.361__shadow_.f6jxncXY9A9pUCdebwJfjnBjfnm9j8X_0 2024-08-27T03:58:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8906108482558467566', time=2024-08-27T05:30:06.194347+0000, chain.objs.size()=1 2024-08-27T03:58:31.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.427__shadow_.Maa2w7MygTmfLjPLHZiDjZ26QLQJVkZ_0 2024-08-27T03:58:31.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7431242235058053643', time=2024-08-27T05:30:22.653982+0000, chain.objs.size()=1 2024-08-27T03:58:31.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.437__shadow_.WvNQZq051HCg1EZw5NxtxGMVNp-serh_0 2024-08-27T03:58:31.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16891644217812271401', time=2024-08-27T05:31:02.377426+0000, chain.objs.size()=1 2024-08-27T03:58:31.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.255+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.458__shadow_.AgOASvxBkF0kUp5bK29E8MXjTclngiG_0 2024-08-27T03:58:31.263 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.259+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44175 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4401573940580428096', time=2024-08-27T05:31:41.115538+0000, chain.objs.size()=1 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.482__shadow_.uungdRbuOQzuG3uQlmF7-J2nt3_1JSa_0 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15701389499631070202', time=2024-08-27T05:31:42.832832+0000, chain.objs.size()=1 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.483__shadow_.HOXX48QhAnBP5nlHllT-g57uau4GD2x_0 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15605363147131609637', time=2024-08-27T05:36:15.468565+0000, chain.objs.size()=1 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.530__multipart_mymultipart.2~ygzqC43cD9hK85gnqTtjF0Am8FUBoni.1 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10417186153284659766', time=2024-08-27T05:38:24.977070+0000, chain.objs.size()=1 2024-08-27T03:58:31.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:jT0us1Vj0BLe8qzFYRfijDMuq56cHE3_.4FDs4WrB7aMRNn5Y5bL1qb99V-Qn1A1_0 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13556389873054712530', time=2024-08-27T05:39:10.063017+0000, chain.objs.size()=1 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:fRN7uI5aOxCpSzs1y9BOt.HgGzSqIto_.tV7Bb41zQoEIbGqQwwnnVTv9rhdj1hl_0 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13192787242593046748', time=2024-08-27T05:39:56.117005+0000, chain.objs.size()=1 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:7k8vscpsKy8yZfdovf2JPR4HL9fb46g_.7cw9GrvXk6VuDH33rcPfSZVFUvCLRpK_0 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4840410044611683555', time=2024-08-27T05:40:01.303440+0000, chain.objs.size()=1 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:XWKee8swCxUoOXaHfm.IP6iiKRtdu3m_.22Gb_sTmqF-9WLlZGuDlCESG17qqMPP_0 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7092416118341830370', time=2024-08-27T05:40:05.316513+0000, chain.objs.size()=1 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.577__shadow:zUlpVmavhPxEtzF6fJYFIzrs7DyOSvd_.TUoDcZlmBxeaVZ1L00YSadihSiHfPWE_0 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12155361840161967458', time=2024-08-27T05:40:17.017776+0000, chain.objs.size()=1 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:WQqS0Zf1V4SF0KDhpl2Cbba..ZTnMLo_.5r3FtHXVOo9YpC4UVmeO_ZtSkhn2hVI_0 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3393158724483123437', time=2024-08-27T05:40:41.039879+0000, chain.objs.size()=1 2024-08-27T03:58:31.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.598__shadow_.Sr7VIBmBsqxizD3-nrr3FlWReHzAyOI_0 2024-08-27T03:58:31.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11286245785009870954', time=2024-08-27T05:45:36.582497+0000, chain.objs.size()=1 2024-08-27T03:58:31.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.631__shadow_.ovf0XY_wetk3hrOzuhzrIylKd1N0vNP_0 2024-08-27T03:58:31.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9292348834426811937', time=2024-08-27T05:45:38.611372+0000, chain.objs.size()=1 2024-08-27T03:58:31.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.263+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.632__shadow_.grUwLSSfHR7sHOu0POYa6DgyUvgFhKJ_0 2024-08-27T03:58:31.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2162882730439764073', time=2024-08-27T05:47:40.641655+0000, chain.objs.size()=1 2024-08-27T03:58:31.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.691__shadow:rn993xQrbwrs7akcCm7-aTM0Hcnacke_.dyct57Jl5lSG9vZ0tP6oo8ZQBt68z_S_0 2024-08-27T03:58:31.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.267+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HOPgbLUq5SpbOu-OzlWvjRl3N2klyOj', time=2024-08-27T05:49:22.033939+0000, chain.objs.size()=1 2024-08-27T03:58:31.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.267+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.736__multipart_mymultipart2.2~HOPgbLUq5SpbOu-OzlWvjRl3N2klyOj.1 2024-08-27T03:58:31.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.271+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-08-27T03:58:31.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=99, truncated=0, next_marker='' 2024-08-27T03:58:31.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_S2Q68u6LRgn1UHNGMYU3iv374Ou3hVj', time=2024-08-27T05:13:41.235838+0000, chain.objs.size()=2 2024-08-27T03:58:31.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.QjP-RZ9i6VNf5CvVCf87Jec1LR97iRg_0 2024-08-27T03:58:31.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.QjP-RZ9i6VNf5CvVCf87Jec1LR97iRg_1 2024-08-27T03:58:31.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3754262643677552533', time=2024-08-27T05:14:56.912137+0000, chain.objs.size()=1 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.191__shadow_.RRSwCQG9W50f40QexCFshkiH9ZcWeIm_0 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13893798617996884050', time=2024-08-27T05:17:55.200844+0000, chain.objs.size()=1 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.225__shadow_.VTusQBnRFajrYZhOirh_woOyIGD1Awp_0 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7662942091275197190', time=2024-08-27T05:18:04.466328+0000, chain.objs.size()=1 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.230__shadow_.J07sWlfghIgGU_NLw90I9JTTVuKXpWO_0 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11447830457959894396', time=2024-08-27T05:18:33.018344+0000, chain.objs.size()=1 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.244__shadow_.rtkYWOF7vIHEd_zGK1gDFn7wrRaMpsv_0 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16356107480499287014', time=2024-08-27T05:18:51.175989+0000, chain.objs.size()=1 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.254__shadow_.ICF4sNrAVvXoqvPF9nD1kDl3GJ95_-l_0 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11733197815096094059', time=2024-08-27T05:20:36.146980+0000, chain.objs.size()=1 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ji9PSIw-owFmIMQ3BXbC2gOzWneZv-r_0 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3209469142168847943', time=2024-08-27T05:20:36.255118+0000, chain.objs.size()=1 2024-08-27T03:58:31.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xEKL0oJOnU5DeZMgElWHuXusBvDiSn4_0 2024-08-27T03:58:31.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4562509260933441598', time=2024-08-27T05:20:37.012164+0000, chain.objs.size()=1 2024-08-27T03:58:31.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.04A6vehKwIGqu9nFphNp21woDDExxGw_0 2024-08-27T03:58:31.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6386381380745564716', time=2024-08-27T05:20:43.661718+0000, chain.objs.size()=1 2024-08-27T03:58:31.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.i9YbjTOrHKi7ue1IiQ0MS7UA6VWTmHN_0 2024-08-27T03:58:31.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14816539105946451755', time=2024-08-27T05:20:44.147087+0000, chain.objs.size()=1 2024-08-27T03:58:31.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.275+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BcKRXiLkPh5akJ_VUIjXzSyFfj7KZFU_0 2024-08-27T03:58:31.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3939979979672185936', time=2024-08-27T05:20:45.080401+0000, chain.objs.size()=1 2024-08-27T03:58:31.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0MQc0pzBjodNaJXOsPcQlBrAgRt56L-_0 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14885012121387050554', time=2024-08-27T05:20:47.344439+0000, chain.objs.size()=1 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.wHVgfXY3OqlUM1APC45vvo25lhHlgoZ_0 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8513393427561460729', time=2024-08-27T05:20:47.562109+0000, chain.objs.size()=1 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.AKZXGfcYg08ToptqupER4yTe_4DyjEH_0 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14693304996456043896', time=2024-08-27T05:20:55.931333+0000, chain.objs.size()=1 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3j_3zGNXgFnKxQaOEFEOjMCLtGVpOsj_0 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.363341649026613598', time=2024-08-27T05:20:56.968129+0000, chain.objs.size()=1 2024-08-27T03:58:31.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nET7-Rcf8A27qwuzQB9I9qMoNaGdF3e_0 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4813517300167202731', time=2024-08-27T05:20:59.775612+0000, chain.objs.size()=1 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qs_Zc6ko763qAH__JLS8KxabRV7U-if_0 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2515032317927285762', time=2024-08-27T05:21:00.717696+0000, chain.objs.size()=1 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ftvZf5XELDZ4gB4vpBSLV_HpaFOEb_3_0 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5400768391032122998', time=2024-08-27T05:21:00.719592+0000, chain.objs.size()=1 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7qRu2k6SYaUcZtLUwzCbKgAQDEPeF65_0 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.87837301906551009', time=2024-08-27T05:21:00.890405+0000, chain.objs.size()=1 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hBkZdOXn-rN6wLeRRVg38oxLYhITf7M_0 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9884563221896506953', time=2024-08-27T05:21:02.282603+0000, chain.objs.size()=1 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.v8wQtOM0LK-ODQ6IeNm98exZd21p6b8_0 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13068211132151969270', time=2024-08-27T05:21:02.510236+0000, chain.objs.size()=1 2024-08-27T03:58:31.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.279+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.E81_AJm2ISBdG6m3YWOqZHAi04KJhek_0 2024-08-27T03:58:31.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18218819175394212862', time=2024-08-27T05:21:03.710903+0000, chain.objs.size()=1 2024-08-27T03:58:31.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vHIgqzdjTtyU7Bfq9LdbOeqO_Yum5T3_0 2024-08-27T03:58:31.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8438519295242705155', time=2024-08-27T05:21:04.091295+0000, chain.objs.size()=1 2024-08-27T03:58:31.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BQAnPhAzr_EItM7AbMjq8H5SwgdbsZd_0 2024-08-27T03:58:31.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8838331807024807153', time=2024-08-27T05:21:18.034106+0000, chain.objs.size()=1 2024-08-27T03:58:31.288 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.264__shadow_.sRgesHY3P5-3wBQRVD3E9QveA2qLvd8_0 2024-08-27T03:58:31.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12390434786078342042', time=2024-08-27T05:21:25.013996+0000, chain.objs.size()=1 2024-08-27T03:58:31.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.268__shadow_.hzvK3oU9aAZ97nGeK8OZDJlWRrWJDeP_0 2024-08-27T03:58:31.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17827656191989688557', time=2024-08-27T05:21:50.284277+0000, chain.objs.size()=1 2024-08-27T03:58:31.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.281__shadow_.XGduVE4LlArS-DoqCv-2AZCvEnr4eaE_0 2024-08-27T03:58:31.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3945172451082803486', time=2024-08-27T05:21:53.910554+0000, chain.objs.size()=1 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.283__shadow_.sMp_ijjgPdh0la6XJS8xJ1tiCCyEWuF_0 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15018136829831915178', time=2024-08-27T05:22:02.759877+0000, chain.objs.size()=1 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.WSdYL0PvOZ9_6hwJhA9QTohiJYfcEgj_0 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5078643589352448926', time=2024-08-27T05:22:08.059294+0000, chain.objs.size()=1 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.noWgEiqbtYMHOU73okA5L7puioZNjW-_0 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18362845186701802301', time=2024-08-27T05:22:57.770928+0000, chain.objs.size()=1 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.313__shadow:ZTTMxcIOmDRICXmIHINniDAUdMag1oM_.AilVlxfouuJxIb_peDqqToLvVcf8nEJ_0 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4276792127513442301', time=2024-08-27T05:24:46.427900+0000, chain.objs.size()=1 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3zeJRzP2qu6aEo1ejbg5ceDjcFMBBTE_0 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14109047553435297290', time=2024-08-27T05:24:46.521390+0000, chain.objs.size()=1 2024-08-27T03:58:31.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.287+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x06MzRn95L8nQ_OwqJzmoPU-8ga5oyz_0 2024-08-27T03:58:31.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4820020335269375239', time=2024-08-27T05:24:48.011915+0000, chain.objs.size()=1 2024-08-27T03:58:31.293 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.IrwREL-NPc85RfE3vRKBMJGXmY3NE25_0 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15897894125541861391', time=2024-08-27T05:24:48.527682+0000, chain.objs.size()=1 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._NrcoJGORCUzS4JY_vzW0-2fF7Fj9Cx_0 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.605317402287006617', time=2024-08-27T05:24:50.725473+0000, chain.objs.size()=1 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YBw68P3QnLbd6aRGKs0518IqTbrhXqJ_0 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10235131366427850429', time=2024-08-27T05:24:51.525509+0000, chain.objs.size()=1 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SK0pa-LAg5gCi34qVkJKGBx7gVwBo8H_0 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9984668330596604320', time=2024-08-27T05:24:51.900955+0000, chain.objs.size()=1 2024-08-27T03:58:31.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.osPnOm-MTrFzEK7UfboDAcup7lV3cRz_0 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15512638061178729524', time=2024-08-27T05:24:54.599919+0000, chain.objs.size()=1 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.TfM3J6D1lTjU_QVsvw9esMI1HF_2gjo_0 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16249530913543694857', time=2024-08-27T05:24:55.189634+0000, chain.objs.size()=1 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.txw7H7efnkOs1t050qP-hXBj5ZDh_nB_0 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3285887975858548159', time=2024-08-27T05:24:55.596857+0000, chain.objs.size()=1 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9OHT3ePBrsKBlUCUiFhqld802AxBidb_0 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11303755088501893205', time=2024-08-27T05:24:58.897232+0000, chain.objs.size()=1 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dhZ38njKVbLU7pu9qev5TtX8fGr5uTd_0 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12025492785354061566', time=2024-08-27T05:24:59.283617+0000, chain.objs.size()=1 2024-08-27T03:58:31.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bZuiUb1mZrzh-C_Px4sLJBOppM4Rq7q_0 2024-08-27T03:58:31.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10432971398315420074', time=2024-08-27T05:25:00.110095+0000, chain.objs.size()=1 2024-08-27T03:58:31.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.291+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ehBSfnBjPfMp1n3pCsktAg8U-IjbXc8_0 2024-08-27T03:58:31.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7650410867781051334', time=2024-08-27T05:25:02.990648+0000, chain.objs.size()=1 2024-08-27T03:58:31.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.C2BKAKOYSXd9SEAN9EOo3IQ6NT0a52f_0 2024-08-27T03:58:31.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11752918161432171381', time=2024-08-27T05:25:05.569438+0000, chain.objs.size()=1 2024-08-27T03:58:31.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.oaX25tJXMq3EoV9yPC6JhHuv87by9ip_0 2024-08-27T03:58:31.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14374757662093729677', time=2024-08-27T05:25:06.352320+0000, chain.objs.size()=1 2024-08-27T03:58:31.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eBDHLozASuIWn-vPeCvbqsKFoTMffLn_0 2024-08-27T03:58:31.299 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6218263328511967876', time=2024-08-27T05:25:07.868963+0000, chain.objs.size()=1 2024-08-27T03:58:31.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.295+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0GE0GVIN3dFTUHS_nPtYHuL8LUqBFr-_0 2024-08-27T03:58:31.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4934362648266067051', time=2024-08-27T05:25:08.700909+0000, chain.objs.size()=1 2024-08-27T03:58:31.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jHBFtZJz6sbMMCBVaZvYRpEhgyYEfiH_0 2024-08-27T03:58:31.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12981607096805651131', time=2024-08-27T05:25:08.761423+0000, chain.objs.size()=1 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bthSHPs_xFPr2k3WwOGojUlrL2Eotas_0 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7122015396262403308', time=2024-08-27T05:25:10.117572+0000, chain.objs.size()=1 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.leQ3D-MOROYNkVmgavu24bhMQPn7_TM_0 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16863645295884383053', time=2024-08-27T05:25:11.347724+0000, chain.objs.size()=1 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.d7QxEbfr3W_M1XcuAqSYPzVKwUdJhxY_0 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11310132782592625915', time=2024-08-27T05:25:13.437012+0000, chain.objs.size()=1 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mBZ__wUZ3jA6XL-BR3byxtdUITAT81z_0 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16647731893740754853', time=2024-08-27T05:25:13.915347+0000, chain.objs.size()=1 2024-08-27T03:58:31.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.tNtAIfoa7NojUMsBhC1BWA48tOVH27o_0 2024-08-27T03:58:31.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9914986785653507564', time=2024-08-27T05:26:59.370597+0000, chain.objs.size()=1 2024-08-27T03:58:31.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7SRUeN8PcW9NJai19ilfuf1N2P006Fr_0 2024-08-27T03:58:31.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14704009442247226301', time=2024-08-27T05:27:02.484721+0000, chain.objs.size()=1 2024-08-27T03:58:31.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.o6DjFImTBQ3aT_C8bfdFVkzimvWkppq_0 2024-08-27T03:58:31.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14024500106257936297', time=2024-08-27T05:27:03.045354+0000, chain.objs.size()=1 2024-08-27T03:58:31.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.J0O1-iBzqfxzaTGbfXxDUogivjAc-XG_0 2024-08-27T03:58:31.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17408590730902636940', time=2024-08-27T05:27:03.309783+0000, chain.objs.size()=1 2024-08-27T03:58:31.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.SWYy3xTh_PkQa-m0I8m5W0zW9WW1g84_0 2024-08-27T03:58:31.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2120193457997142879', time=2024-08-27T05:27:03.311989+0000, chain.objs.size()=1 2024-08-27T03:58:31.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.299+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bZIfd6F-1MQaNFP4UbddGqUSJ2xbPvK_0 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10700556620617012036', time=2024-08-27T05:27:03.703074+0000, chain.objs.size()=1 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LUy4MYcA7vcgL534eEVVWaomkc6qsE9_0 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2949295420676113309', time=2024-08-27T05:27:04.510724+0000, chain.objs.size()=1 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EFSwBIqfx3vNWuMev0NQDlwEVEin1nw_0 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1344080160606516194', time=2024-08-27T05:27:05.426742+0000, chain.objs.size()=1 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.feW1GviPfi7FXJ09_HA0gVnW9i07px__0 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6475989187253191958', time=2024-08-27T05:27:05.481188+0000, chain.objs.size()=1 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jgSDIMjL0aeSicY6_e75NAzxry1NY5a_0 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.871700075874845421', time=2024-08-27T05:27:06.909023+0000, chain.objs.size()=1 2024-08-27T03:58:31.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.e5lXaTR7A9EGNaaZnquZuHYX0sWeos0_0 2024-08-27T03:58:31.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6090874209374821285', time=2024-08-27T05:27:10.764640+0000, chain.objs.size()=1 2024-08-27T03:58:31.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.303+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VkRvJ12IJGUZ6J2Oi2RxTg3qYJjCgTZ_0 2024-08-27T03:58:31.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4831807419791499835', time=2024-08-27T05:27:11.163190+0000, chain.objs.size()=1 2024-08-27T03:58:31.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pdPH-cPJNbvlynaJpj2iesnpyhOF39y_0 2024-08-27T03:58:31.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4963401022690787760', time=2024-08-27T05:27:11.189739+0000, chain.objs.size()=1 2024-08-27T03:58:31.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nNw7BOOolsG5GH_J3bd34o5B4lY44HA_0 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4359598924641024667', time=2024-08-27T05:27:12.892481+0000, chain.objs.size()=1 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Ob8sMtJmLJqBfYKn27Q5QYeoL6p86jZ_0 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3039421668153118805', time=2024-08-27T05:27:13.473065+0000, chain.objs.size()=1 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qXEy89_Dk3XO1_pyFwm-iATDlXhiK5b_0 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5981463289716174454', time=2024-08-27T05:27:14.093646+0000, chain.objs.size()=1 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.e9iFYbv-0TfZYNEga4bB_zraTlFJgcV_0 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5205422013048223224', time=2024-08-27T05:27:14.479190+0000, chain.objs.size()=1 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.nuGRC6__-fivkx--PULohSZ-fyKS31I_0 2024-08-27T03:58:31.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7413927722742121210', time=2024-08-27T05:27:15.143141+0000, chain.objs.size()=1 2024-08-27T03:58:31.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.307+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5HZ0J3XbI2UBtyZT2scjR_hmm4TNN0I_0 2024-08-27T03:58:31.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17001910559916430758', time=2024-08-27T05:27:15.659608+0000, chain.objs.size()=1 2024-08-27T03:58:31.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KUsj9H8VrmxgeJip1Cz0YrTbS0Ty_UX_0 2024-08-27T03:58:31.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15538426298895155258', time=2024-08-27T05:27:16.440678+0000, chain.objs.size()=1 2024-08-27T03:58:31.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._GOJjZu-BEKKS6dLXjCS_4-bodBkjLY_0 2024-08-27T03:58:31.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2379669982730275186', time=2024-08-27T05:27:16.854128+0000, chain.objs.size()=1 2024-08-27T03:58:31.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4iPoHRx9mse4N17xSAdHnYqCYgzeLxj_0 2024-08-27T03:58:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8014431792675986974', time=2024-08-27T05:27:17.130279+0000, chain.objs.size()=1 2024-08-27T03:58:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.G7baM5eIT5Wkt8mUMe6qmqGHlHS4I1b_0 2024-08-27T03:58:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12022376946881595852', time=2024-08-27T05:27:17.892800+0000, chain.objs.size()=1 2024-08-27T03:58:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4_6JMu52cFSYP-oBpPYfDs-h9t_ORD0_0 2024-08-27T03:58:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9411004243168589623', time=2024-08-27T05:27:19.205542+0000, chain.objs.size()=1 2024-08-27T03:58:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.311+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.r-1LfAuHFRfnB8RNx9DoUUseVCcWRPf_0 2024-08-27T03:58:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3692339017136404247', time=2024-08-27T05:27:19.257581+0000, chain.objs.size()=1 2024-08-27T03:58:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EZgH3I1Zg6ll09LBe4-CrBKD6X9Ik0L_0 2024-08-27T03:58:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12250350584867484789', time=2024-08-27T05:27:21.036015+0000, chain.objs.size()=1 2024-08-27T03:58:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uVrcYw53ee-XII3WqTiWoGH32RRAZ-T_0 2024-08-27T03:58:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6217894690731672737', time=2024-08-27T05:27:24.275042+0000, chain.objs.size()=1 2024-08-27T03:58:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7J1KpTRdIhAcr3b-8XhUSelz-kJWQoN_0 2024-08-27T03:58:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12625715726003591488', time=2024-08-27T05:27:24.277090+0000, chain.objs.size()=1 2024-08-27T03:58:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p-skTaUJdsQ36boCuNYxw8qAy9vLgTZ_0 2024-08-27T03:58:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10400577163587602747', time=2024-08-27T05:27:24.706350+0000, chain.objs.size()=1 2024-08-27T03:58:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BZS_LgnDbGu1P0cYN4lmAATurylteb__0 2024-08-27T03:58:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2486299588652072343', time=2024-08-27T05:27:24.707931+0000, chain.objs.size()=1 2024-08-27T03:58:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.k8AKg_tuT_ekkchmvvxJRbcN5jWWY81_0 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2165351829823254342', time=2024-08-27T05:27:33.258038+0000, chain.objs.size()=1 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.323__shadow_.omytTITsbmBEDsbG9GSVhhCIAElr1g3_0 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18274012039442634355', time=2024-08-27T05:31:07.140514+0000, chain.objs.size()=1 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.460__shadow_.yyxCiHcROJzTAV_Iqsvr3nCEBrYlGa-_0 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15156763795217778026', time=2024-08-27T05:31:28.540765+0000, chain.objs.size()=1 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.9Fbj-EIpMj0CC2-dZx2t6nZj59uZ7Gr_0 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8888347116200757634', time=2024-08-27T05:37:23.035141+0000, chain.objs.size()=1 2024-08-27T03:58:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.552__shadow_.j9DT51ZeInScD8_q_3GwJGBxNVIVR08_0 2024-08-27T03:58:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10675125091315848220', time=2024-08-27T05:37:54.196644+0000, chain.objs.size()=1 2024-08-27T03:58:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.315+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:QKrTFGqwuwsZtyjWNvSioMbrsfppegW_.QUE3CU1ozdw-fHD09veXCGyE0zPL_gU_0 2024-08-27T03:58:31.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2701703908633279657', time=2024-08-27T05:37:59.688703+0000, chain.objs.size()=1 2024-08-27T03:58:31.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:6.owYvHfxX8HxmId0MR2xfQhwpzM30k_.RIovnT1JLyk3Z1QvwLzsgGoRWDN-iW9_0 2024-08-27T03:58:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17513167283441222589', time=2024-08-27T05:38:02.927126+0000, chain.objs.size()=1 2024-08-27T03:58:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:DNaEvXLx3kBZsA-JmCEXt6rxC22qF0I_.futMJMwz8zZ1jvQl7JOB-05Uftj4VUN_0 2024-08-27T03:58:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17656439311634714216', time=2024-08-27T05:38:08.266809+0000, chain.objs.size()=1 2024-08-27T03:58:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:oaPM2OdsLqgjW.3GgxO7K3p.ELpWRzE_.wF0156DiDLoT5d7LhwZlGVtM9c0u72Q_0 2024-08-27T03:58:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16973751103739662042', time=2024-08-27T05:38:33.404115+0000, chain.objs.size()=1 2024-08-27T03:58:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.569__shadow_.oo_2MXT2c0uhw2ASReYG5N1TQ3mWVYR_0 2024-08-27T03:58:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2178812459301002221', time=2024-08-27T05:38:48.191831+0000, chain.objs.size()=1 2024-08-27T03:58:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:FQS7GshTO.AwYwfO67lpkXGMlDuFqlj_.bNmht53X1ldfvawCScCtOK4EMs9aLFA_0 2024-08-27T03:58:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9692908240424016394', time=2024-08-27T05:39:15.337151+0000, chain.objs.size()=1 2024-08-27T03:58:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:2i-DvKNJvPeLxhEWEmBaqF8wRer0Px3_.393PHHODxfUEmkV_dHIJGUcHi7nSMIn_0 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4924728499520723446', time=2024-08-27T05:40:00.462425+0000, chain.objs.size()=1 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:A.1zT7kMJ3t.oYi1gvmbRwYRKatiVrJ_.yxaAqDWj2jDej5alUViZhF4qu-qi0fx_0 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2223758819144874453', time=2024-08-27T05:45:29.765911+0000, chain.objs.size()=1 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.627__shadow_.hZ5E0itxgRpfeRefuiCM06dN1-0Nh21_0 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9833322078659408241', time=2024-08-27T05:47:03.778063+0000, chain.objs.size()=1 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.666__shadow_.2paAQ7Mlue_xlWBoPE2vtK0rJOSbt-Z_0 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16100978072213433813', time=2024-08-27T05:49:28.119610+0000, chain.objs.size()=3 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.737__multipart_mymultipart3.2~e6jRMITToa_trQfhADgc5WVd64gyXpp.1 2024-08-27T03:58:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.319+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.737__multipart_mymultipart3.2~e6jRMITToa_trQfhADgc5WVd64gyXpp.2 2024-08-27T03:58:31.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.737__multipart_mymultipart3.2~e6jRMITToa_trQfhADgc5WVd64gyXpp.3 2024-08-27T03:58:31.332 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.327+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-08-27T03:58:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.331+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48512' 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9024237633429218078', time=2024-08-27T05:18:11.361889+0000, chain.objs.size()=1 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.233__shadow_.B-LwGIY4MkSc-TxBzVEyhMe8LQaiL_M_0 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13426399656271231572', time=2024-08-27T05:18:23.785731+0000, chain.objs.size()=1 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.239__shadow_.MsE1KcEKAPwF6NkzSK3WM__k4-K_p4L_0 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6887090516207278974', time=2024-08-27T05:20:35.198519+0000, chain.objs.size()=1 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.LbIgBo-V4MoMHhcM7EcLCh2Rnxw4z9Y_0 2024-08-27T03:58:31.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16964793241542026709', time=2024-08-27T05:20:35.605520+0000, chain.objs.size()=1 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QcSoRqaA_JVx-8OHvvCc9Qs7L8wsq7O_0 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4645471444751335298', time=2024-08-27T05:20:36.719884+0000, chain.objs.size()=1 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NLk-ORHLianopa0CgrRNFAIyVhMwcAB_0 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4635873981756230292', time=2024-08-27T05:20:36.721913+0000, chain.objs.size()=1 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PjkZ83d3o5MezIpkdD-jJsC938yPwzE_0 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5958088724396530253', time=2024-08-27T05:20:36.842229+0000, chain.objs.size()=1 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uDVtSoGrDb2M0OHJJJHwhZznzzzjOiO_0 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16244593137834303560', time=2024-08-27T05:20:40.186161+0000, chain.objs.size()=1 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Cv-BW6arwXXigKWwSgPs_Eu25fpLIaP_0 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10894312549027816909', time=2024-08-27T05:20:41.366653+0000, chain.objs.size()=1 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hAKZcMkoqDCqjzQ_WHHbiOI4nT2l4ke_0 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7154251682331902485', time=2024-08-27T05:20:41.598458+0000, chain.objs.size()=1 2024-08-27T03:58:31.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jTlGbxFNNetmcQxJr1Xbmhq9vWbKe7L_0 2024-08-27T03:58:31.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8645394011861632108', time=2024-08-27T05:20:44.747309+0000, chain.objs.size()=1 2024-08-27T03:58:31.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.21hX3_2jh-ju401TOegXTXyOk61G7lW_0 2024-08-27T03:58:31.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9156964687067666627', time=2024-08-27T05:20:45.494277+0000, chain.objs.size()=1 2024-08-27T03:58:31.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.335+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gJyr-9wFFppC9wapXyeOSjpZch1Qf3k_0 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6781534267519466142', time=2024-08-27T05:20:45.660369+0000, chain.objs.size()=1 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sbslGL46Af5UZd3b3qIhKhezDeW1XYf_0 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12070913302560470739', time=2024-08-27T05:20:48.397049+0000, chain.objs.size()=1 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BBOKDTJq2ikdjsEE0nvrnHx91_yTF4P_0 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18340157746364652663', time=2024-08-27T05:20:48.625541+0000, chain.objs.size()=1 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dnM4e8Ku58HJri6vnaXbBhgZLzB2JJa_0 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1455223376538196288', time=2024-08-27T05:20:48.932607+0000, chain.objs.size()=1 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8ni_DNVENs8nfbYhxCVsYrgP5DzLTdz_0 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10497072330468473189', time=2024-08-27T05:20:49.559137+0000, chain.objs.size()=1 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.L64icXDSMLcIuLNNsMf9ILkFzEGfckC_0 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7035234043951181412', time=2024-08-27T05:20:51.211698+0000, chain.objs.size()=1 2024-08-27T03:58:31.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZazNJXJA516GPDtCVNTKGEBMTBGtIQS_0 2024-08-27T03:58:31.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1971873186670957635', time=2024-08-27T05:20:51.213690+0000, chain.objs.size()=1 2024-08-27T03:58:31.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MG3Z1EkiP5xBTZaH1Fyaykm_qBILncY_0 2024-08-27T03:58:31.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8320676247267339633', time=2024-08-27T05:20:52.786009+0000, chain.objs.size()=1 2024-08-27T03:58:31.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0nY2CK6Hd-YtrTciJgFajZ4mwWz2qzy_0 2024-08-27T03:58:31.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18350239045506853087', time=2024-08-27T05:20:53.684545+0000, chain.objs.size()=1 2024-08-27T03:58:31.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4yadrN7KyUjXeW8Qh5f0hvaoZ1bn5K5_0 2024-08-27T03:58:31.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7574738380693838062', time=2024-08-27T05:20:54.996239+0000, chain.objs.size()=1 2024-08-27T03:58:31.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JyzYoExkeClLNKzKlYl0H5pja-LQjui_0 2024-08-27T03:58:31.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11654752709501365310', time=2024-08-27T05:20:55.445686+0000, chain.objs.size()=1 2024-08-27T03:58:31.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.339+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gRAXDG4giAtzMdfJ52pEGv2yE4HuQW7_0 2024-08-27T03:58:31.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11539963447972842455', time=2024-08-27T05:20:56.277583+0000, chain.objs.size()=1 2024-08-27T03:58:31.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.J_s5AByDRZx4yHprNUA7bThcXBeDP49_0 2024-08-27T03:58:31.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13526662112329537055', time=2024-08-27T05:20:57.360798+0000, chain.objs.size()=1 2024-08-27T03:58:31.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8cExtxCsm30j65yhzkfWEByVMxOfDXW_0 2024-08-27T03:58:31.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17057438975205651213', time=2024-08-27T05:20:59.528690+0000, chain.objs.size()=1 2024-08-27T03:58:31.347 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._gH_E9jAHBKywnQO7jYa8Wx0fnsmWkJ_0 2024-08-27T03:58:31.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.774418878730617048', time=2024-08-27T05:20:59.877306+0000, chain.objs.size()=1 2024-08-27T03:58:31.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-WqGUsc0k9eLt1BaqLVwzSJVtw65EDs_0 2024-08-27T03:58:31.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.332553856307747857', time=2024-08-27T05:21:01.778913+0000, chain.objs.size()=1 2024-08-27T03:58:31.348 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.343+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kYQDlrsasniSkxw28gRJYvWvgAaCqIk_0 2024-08-27T03:58:31.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18165014210823642957', time=2024-08-27T05:21:01.855377+0000, chain.objs.size()=1 2024-08-27T03:58:31.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xciabCFk1X2Ig7LVUDXHRGx53P_J9cS_0 2024-08-27T03:58:31.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2716787178715912907', time=2024-08-27T05:21:03.123862+0000, chain.objs.size()=1 2024-08-27T03:58:31.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OLRAly0cqMlP90lWihxWy5r66kgTM8l_0 2024-08-27T03:58:31.350 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11406949780333901102', time=2024-08-27T05:21:03.403664+0000, chain.objs.size()=1 2024-08-27T03:58:31.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WYg6aXKSoFcZo-d7UOc9QFz1Uk9_LFU_0 2024-08-27T03:58:31.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15022838301033942908', time=2024-08-27T05:21:30.531395+0000, chain.objs.size()=1 2024-08-27T03:58:31.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.271__shadow_.wkK5hoF-9U0IU6qfcMOfsQ_rnK7JXKc_0 2024-08-27T03:58:31.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15794146248330629347', time=2024-08-27T05:21:30.548163+0000, chain.objs.size()=1 2024-08-27T03:58:31.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.271__shadow_.Sw8x5WzPI7Jl0a5qYxAnTcbsHK64IBP_0 2024-08-27T03:58:31.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5270649180338931689', time=2024-08-27T05:21:45.888570+0000, chain.objs.size()=1 2024-08-27T03:58:31.351 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.279__shadow_.68zFtSR_Ft2cnf-n-KCyTytUK23zrIM_0 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6442591792786197970', time=2024-08-27T05:22:08.158374+0000, chain.objs.size()=1 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_._j9xNBtT8ccF37DmOyhHe3dejCvwIZk_0 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5517671997754269628', time=2024-08-27T05:22:08.190991+0000, chain.objs.size()=1 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.yfs46ZSImHz8uDU9CKy9P0r5JrhLi3c_0 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15301182554293248435', time=2024-08-27T05:24:46.490295+0000, chain.objs.size()=1 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cK58GTNmHK8jHFIMiilPivCqrDuRnit_0 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8069242305006220470', time=2024-08-27T05:24:46.820226+0000, chain.objs.size()=1 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.347+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.x8fPxKGfFxEu9aQUAZGVWdWMpSu9cDA_0 2024-08-27T03:58:31.352 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3046123699237284911', time=2024-08-27T05:24:47.312540+0000, chain.objs.size()=1 2024-08-27T03:58:31.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4SrEsaPJwYPmKsBggTXy1hU812FpZMX_0 2024-08-27T03:58:31.355 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6485142736134622816', time=2024-08-27T05:24:47.656998+0000, chain.objs.size()=1 2024-08-27T03:58:31.355 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._lQKEG8pq0hOWKpGqy9mu6MnyyZUdF9_0 2024-08-27T03:58:31.355 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16605234347991093852', time=2024-08-27T05:24:47.772493+0000, chain.objs.size()=1 2024-08-27T03:58:31.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.sHM1IrZ4JydFKEkRB3qyZWIa3_UAyso_0 2024-08-27T03:58:31.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13121869793959160838', time=2024-08-27T05:24:47.990798+0000, chain.objs.size()=1 2024-08-27T03:58:31.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3jmEgOW5spDvuRCpuhH1cdvASPh0N0H_0 2024-08-27T03:58:31.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4672348849600080343', time=2024-08-27T05:24:48.324972+0000, chain.objs.size()=1 2024-08-27T03:58:31.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.WWDYScbSkgjDq8d2NdFk7_trm_AfQUC_0 2024-08-27T03:58:31.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9590598799818796387', time=2024-08-27T05:24:49.099442+0000, chain.objs.size()=1 2024-08-27T03:58:31.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.351+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.k54ulDcjnzbPjRHoeVu2nFbSkQiedJ8_0 2024-08-27T03:58:31.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13465281154857894575', time=2024-08-27T05:24:49.157700+0000, chain.objs.size()=1 2024-08-27T03:58:31.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._6n-E_fiVbXZwThbU9m9feNBqqGQ-EE_0 2024-08-27T03:58:31.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7446419973685631169', time=2024-08-27T05:24:50.900735+0000, chain.objs.size()=1 2024-08-27T03:58:31.358 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PzJu7hs4tGj2ek2t2euy3ohb5g7pgZK_0 2024-08-27T03:58:31.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10265773382520932012', time=2024-08-27T05:24:51.119643+0000, chain.objs.size()=1 2024-08-27T03:58:31.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.w2RhvuTKLjL-CN8nMDw0qAF_Q5dcq2h_0 2024-08-27T03:58:31.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1532162876007744066', time=2024-08-27T05:24:52.050631+0000, chain.objs.size()=1 2024-08-27T03:58:31.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._dn-kHmC2YR84kgbJet849WI_u1ZSFb_0 2024-08-27T03:58:31.359 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1380662832973106845', time=2024-08-27T05:24:54.626484+0000, chain.objs.size()=1 2024-08-27T03:58:31.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gMZH49oL-yO0QePG_t1Fg-axcDUZqu5_0 2024-08-27T03:58:31.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16620670018603080302', time=2024-08-27T05:24:54.628171+0000, chain.objs.size()=1 2024-08-27T03:58:31.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.n24qAPJLdfGZVWlrY551BX6Mue6-SqQ_0 2024-08-27T03:58:31.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.355+0000 7f1ca1152640 0 -- 172.21.15.143:0/3782803346 >> [v2:172.21.15.181:6800/2843441581,v1:172.21.15.181:6801/2843441581] conn(0x558d81aa8f60 msgr2=0x558d81aab350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-08-27T03:58:31.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17556596608162486178', time=2024-08-27T05:24:54.720037+0000, chain.objs.size()=1 2024-08-27T03:58:31.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.HLw9Jt62SW_H8LAH0GM8qgQMvPPcgfg_0 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8121667073183063698', time=2024-08-27T05:24:55.882932+0000, chain.objs.size()=1 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.docB3j21mjYlfbxMfQpRTUe84lSEYL7_0 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7367153122747493840', time=2024-08-27T05:24:56.304735+0000, chain.objs.size()=1 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fFbxTz0ODVI0SIJfg94TT154w7WI0uw_0 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9576344542221087863', time=2024-08-27T05:24:58.418018+0000, chain.objs.size()=1 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.poLeJdh9WZ-PBKqMHImPrIJZbrVGwgf_0 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7920071853283145279', time=2024-08-27T05:25:01.792901+0000, chain.objs.size()=1 2024-08-27T03:58:31.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YPhcFvEFrgLVZZDYY5ftBOJ3JvnvC_y_0 2024-08-27T03:58:31.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10512712730888662747', time=2024-08-27T05:25:02.054091+0000, chain.objs.size()=1 2024-08-27T03:58:31.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.l2cdIo-jHVdZwdsL5XpFsbbSFIXC8tP_0 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13820122906895977355', time=2024-08-27T05:25:04.287439+0000, chain.objs.size()=1 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZEDLrmeBdRikm5ap3MuZa8VDTjDyPbx_0 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18199770322384815910', time=2024-08-27T05:25:04.428607+0000, chain.objs.size()=1 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8QfgZkrfmtN52Vnp7K50QWnSMRNcOJV_0 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11191990310776565444', time=2024-08-27T05:25:04.438544+0000, chain.objs.size()=1 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ziESwRKEkRFpj9TTwpv5GDBXcBo34X8_0 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10798251587411055796', time=2024-08-27T05:25:05.250608+0000, chain.objs.size()=1 2024-08-27T03:58:31.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.359+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.EoNrVPcNR5uyTMZxaKnLgbgy8Zb9Ty__0 2024-08-27T03:58:31.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17354580538303758831', time=2024-08-27T05:25:05.368990+0000, chain.objs.size()=1 2024-08-27T03:58:31.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fvwjMhdHgoMDVNbwlxaTOExNNQv2ehC_0 2024-08-27T03:58:31.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.363+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5604656952435956807', time=2024-08-27T05:25:06.796630+0000, chain.objs.size()=1 2024-08-27T03:58:31.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.363+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hWwchrjaXivvPkfg7QhDw3gTzuaq2JN_0 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1718186338191969425', time=2024-08-27T05:25:07.733362+0000, chain.objs.size()=1 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mFUhcSeDhYtOMz_o9cqv2_pYDyLl75o_0 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4369657647110945896', time=2024-08-27T05:25:07.734840+0000, chain.objs.size()=1 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.90SRBVi1xMXZwXsIglOS_h7G68F8o2f_0 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15709318586704142296', time=2024-08-27T05:25:09.640612+0000, chain.objs.size()=1 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rxsyW-U0zOPUw4BsbWfyIIIBigqNsoa_0 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4945273232625749732', time=2024-08-27T05:25:09.733146+0000, chain.objs.size()=1 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.n6wO79QTNqrAqBFCnFQVKauKf7k0iv8_0 2024-08-27T03:58:31.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.219776618018781492', time=2024-08-27T05:25:11.187868+0000, chain.objs.size()=1 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1_OvxhdNafwnlErmjhVNakFhW7dYjQF_0 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5756211829747177736', time=2024-08-27T05:25:13.907213+0000, chain.objs.size()=1 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.HHqEwfARq-AzikiFkYbv_31ui8WDpUn_0 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2606964748577910439', time=2024-08-27T05:25:14.478384+0000, chain.objs.size()=1 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1QwcVyK5WcOd4_XACwOcyu-y_FIBZop_0 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16930688965088370558', time=2024-08-27T05:26:57.681272+0000, chain.objs.size()=1 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wv5_0r1qOarW30A9jrRjzGG16XaPk9P_0 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1711668103081607389', time=2024-08-27T05:26:58.502518+0000, chain.objs.size()=1 2024-08-27T03:58:31.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6TV5wPH2WM7lEXOrcFBiKa3S_jZ0OfQ_0 2024-08-27T03:58:31.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7475813572602800773', time=2024-08-27T05:26:58.817474+0000, chain.objs.size()=1 2024-08-27T03:58:31.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xGqFzTGinHSt7zYxthsU5ViP4BW8t9L_0 2024-08-27T03:58:31.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16238760921743685986', time=2024-08-27T05:26:59.003352+0000, chain.objs.size()=1 2024-08-27T03:58:31.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.367+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xV41XNfHRl5tWcnh49Bz8FEzvXshaTS_0 2024-08-27T03:58:31.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2943575168816613796', time=2024-08-27T05:26:59.005476+0000, chain.objs.size()=1 2024-08-27T03:58:31.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Fe-3LGK6pUfNN3W-GCPpmlXPm_PxQd5_0 2024-08-27T03:58:31.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9225917950182120688', time=2024-08-27T05:26:59.133858+0000, chain.objs.size()=1 2024-08-27T03:58:31.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RQZ-U7XOL9m9KfBQ57o8QrAh43yUL2F_0 2024-08-27T03:58:31.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16828214755363393673', time=2024-08-27T05:26:59.309898+0000, chain.objs.size()=1 2024-08-27T03:58:31.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.rVUyim8jOdmucFvbJDr26vM65EOoFDQ_0 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4328513741764409774', time=2024-08-27T05:26:59.627663+0000, chain.objs.size()=1 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2Na5ofNKiNHaTjoYeepv9hiMP4PiEGC_0 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4023255647016189957', time=2024-08-27T05:26:59.700511+0000, chain.objs.size()=1 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uR2DHJVWebpGd4roVyXeI4t3lH9UNy4_0 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16619947756218190559', time=2024-08-27T05:27:00.056333+0000, chain.objs.size()=1 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NPWE6r6NNxtybDU4kanDv3I6AU0NMa1_0 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14383463289625657895', time=2024-08-27T05:27:00.265825+0000, chain.objs.size()=1 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.k2qh9g_mFm5HkKdZvrhz939-zkAPn6P_0 2024-08-27T03:58:31.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3011136228862274844', time=2024-08-27T05:27:00.503828+0000, chain.objs.size()=1 2024-08-27T03:58:31.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OcmimaqbIaI8emvZ0t4NEobZOQ7326X_0 2024-08-27T03:58:31.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8479804609199087227', time=2024-08-27T05:27:01.673960+0000, chain.objs.size()=1 2024-08-27T03:58:31.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.XjczV34g1GtRprrhRmdBIl2PsiiIAjF_0 2024-08-27T03:58:31.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10687533941644180324', time=2024-08-27T05:27:03.679536+0000, chain.objs.size()=1 2024-08-27T03:58:31.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.371+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hpdXG7LuGe7Q79Rdotaq4iTFi8L0TFf_0 2024-08-27T03:58:31.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9646217476699573691', time=2024-08-27T05:27:04.095028+0000, chain.objs.size()=1 2024-08-27T03:58:31.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wdr7Hqi7VixX_GkajpT5jxYJEp6hjlV_0 2024-08-27T03:58:31.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15672675447167296524', time=2024-08-27T05:27:05.462991+0000, chain.objs.size()=1 2024-08-27T03:58:31.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CpLB0Uzpe35Jo1JblW8oLrhS-s69AiL_0 2024-08-27T03:58:31.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.375+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10526512555915495135', time=2024-08-27T05:27:05.841048+0000, chain.objs.size()=1 2024-08-27T03:58:31.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.375+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cTwOZD1eFzdUu8bPH4IwH9BGX9kd-rS_0 2024-08-27T03:58:31.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16555733491876214016', time=2024-08-27T05:27:05.919654+0000, chain.objs.size()=1 2024-08-27T03:58:31.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5imDUg0yTb7jS76xanqQCli7OuC_90P_0 2024-08-27T03:58:31.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10225993410547191998', time=2024-08-27T05:27:06.390242+0000, chain.objs.size()=1 2024-08-27T03:58:31.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LEsjsRwCVTrM_zqC2cHCwzbbjn0P_Rs_0 2024-08-27T03:58:31.380 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8167849270145211041', time=2024-08-27T05:27:07.409186+0000, chain.objs.size()=1 2024-08-27T03:58:31.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mc7CQoQy8xz9tlMOA3c9VprCSUANrCs_0 2024-08-27T03:58:31.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1480324100574545466', time=2024-08-27T05:27:07.926878+0000, chain.objs.size()=1 2024-08-27T03:58:31.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uqFPDSpeh6iWT-u5-2Zq1s3tmCM2Bgb_0 2024-08-27T03:58:31.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6750444551269411772', time=2024-08-27T05:27:11.314912+0000, chain.objs.size()=1 2024-08-27T03:58:31.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.tsApny55eAvBIWWBumIgI3XelL4U3wR_0 2024-08-27T03:58:31.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17456850724748198451', time=2024-08-27T05:27:11.617434+0000, chain.objs.size()=1 2024-08-27T03:58:31.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.X08YYm500TDa0vll__qb5pJPIxo2DpD_0 2024-08-27T03:58:31.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17734622003411588630', time=2024-08-27T05:27:14.603018+0000, chain.objs.size()=1 2024-08-27T03:58:31.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Q20S6tyUsVuSA66RVrVr5O0Csm6zHZT_0 2024-08-27T03:58:31.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3499504091539928808', time=2024-08-27T05:27:14.765449+0000, chain.objs.size()=1 2024-08-27T03:58:31.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CbncEx1IK3bPy2rhojWpS-iXVdd52ct_0 2024-08-27T03:58:31.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8285902253469877743', time=2024-08-27T05:27:15.520163+0000, chain.objs.size()=1 2024-08-27T03:58:31.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.D9H0_TnDTrJUmKOK3IO6Rr3Q5PekGnA_0 2024-08-27T03:58:31.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5790934616396321035', time=2024-08-27T05:27:17.629389+0000, chain.objs.size()=1 2024-08-27T03:58:31.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.379+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.kX60udfmcEuWy540t6AVkOtacpTXO9t_0 2024-08-27T03:58:31.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8466969999725927443', time=2024-08-27T05:27:18.377142+0000, chain.objs.size()=1 2024-08-27T03:58:31.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.omL3yInHUsJ6hWh7X8oG0nYBFcHbGuD_0 2024-08-27T03:58:31.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8452946074436822693', time=2024-08-27T05:27:18.886784+0000, chain.objs.size()=1 2024-08-27T03:58:31.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ft2LnOZaFmkjjVNtpn6N5hOMIaQGVaQ_0 2024-08-27T03:58:31.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15048750468854027625', time=2024-08-27T05:27:20.079697+0000, chain.objs.size()=1 2024-08-27T03:58:31.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8qcU-utXMYEiTWI-HUfKUKBBXZn2MRD_0 2024-08-27T03:58:31.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16503876870714250986', time=2024-08-27T05:27:21.681945+0000, chain.objs.size()=1 2024-08-27T03:58:31.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.383+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lS6O4y04BxZw62ulueAKb2dTCKretVw_0 2024-08-27T03:58:31.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.387+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48512 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16159178136981387850', time=2024-08-27T05:27:21.803863+0000, chain.objs.size()=1 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8k_dqS2wTY082DU5SWopM0x4xI5IZVM_0 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18164238267369912767', time=2024-08-27T05:27:22.543967+0000, chain.objs.size()=1 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pGfjKIU66Ea5YCJag3EQElGOUcz4c3n_0 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11218508193984455141', time=2024-08-27T05:27:22.912824+0000, chain.objs.size()=1 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OTu-Z5Sl7xLqsH2gpo43eUMbhpc-kQU_0 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13141755749087688967', time=2024-08-27T05:27:22.956666+0000, chain.objs.size()=1 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.a-xl15o3cUu8AznMc_ti6r4EvlTmQI6_0 2024-08-27T03:58:31.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4185207939831293816', time=2024-08-27T05:27:23.030168+0000, chain.objs.size()=1 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0x7FzbCyAJews3Olm7-bPV1G9BfYweQ_0 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6120399194517222688', time=2024-08-27T05:27:23.755778+0000, chain.objs.size()=1 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cUET5oPQi3yXGkKRxoco7MqzBHPOvXH_0 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4966222733058692429', time=2024-08-27T05:27:24.443329+0000, chain.objs.size()=1 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.q5lmWC3kGqv1z225jryBpws-E7UA2Zl_0 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12162427604135377245', time=2024-08-27T05:27:58.823765+0000, chain.objs.size()=1 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.340__shadow_.bbmPbiGrqYg48fZV4ldC2Cf_jedkj06_0 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2754849268439660194', time=2024-08-27T05:30:19.312347+0000, chain.objs.size()=1 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.435__shadow_.SvzvdJmEG0tkYrMXqYx_RI74N3A3MFw_0 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4885652622078057601', time=2024-08-27T05:30:57.836417+0000, chain.objs.size()=1 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.456__shadow_.HImxQbJ2PLlg_5g4B8l9muCKyRbpo-a_0 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5455265194348681801', time=2024-08-27T05:31:28.546191+0000, chain.objs.size()=1 2024-08-27T03:58:31.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.nENSf0zNrhpi3WQ0cDW5Jj0iH6u9Qc4_0 2024-08-27T03:58:31.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4687074876539822072', time=2024-08-27T05:32:45.413357+0000, chain.objs.size()=2 2024-08-27T03:58:31.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.511__shadow_.jgo8CsrELIm6OGjYsJLNtr9sgJE1pyQ_0 2024-08-27T03:58:31.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.511__shadow_.jgo8CsrELIm6OGjYsJLNtr9sgJE1pyQ_1 2024-08-27T03:58:31.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17254218423191930977', time=2024-08-27T05:37:51.855156+0000, chain.objs.size()=1 2024-08-27T03:58:31.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:9qwjwS6E8BpHgaaaDSCARG7Lv80EOEE_.Hx_Y7-Vb4GZ-sf1G2eYcIggZo0P4XwX_0 2024-08-27T03:58:31.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6875847266847406163', time=2024-08-27T05:38:01.610932+0000, chain.objs.size()=1 2024-08-27T03:58:31.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.391+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:VJq5OdYFv1FIKH2-SaC4sK7txOmw5m3_.gESivLaChE42aKJCCMYwQEOLNNxladw_0 2024-08-27T03:58:31.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11202265514177168597', time=2024-08-27T05:38:27.240646+0000, chain.objs.size()=1 2024-08-27T03:58:31.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:WJO6deaOzSzfpC3C.yqAkYCzueBTetk_.APWT7_iWjcIUpbu82dHwoCXFezo3idV_0 2024-08-27T03:58:31.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17852819638071785312', time=2024-08-27T05:44:26.086932+0000, chain.objs.size()=1 2024-08-27T03:58:31.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.612__shadow_.GAhd6xrLfCJJfzmjsUQPjt_8K9HIgPK_0 2024-08-27T03:58:31.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17334660394968035748', time=2024-08-27T05:45:39.194668+0000, chain.objs.size()=1 2024-08-27T03:58:31.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.633__shadow_.v18kQbB-lQgNcbjjOzgc11OV5dP052x_0 2024-08-27T03:58:31.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8749141390852759056', time=2024-08-27T05:45:55.740762+0000, chain.objs.size()=1 2024-08-27T03:58:31.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.640__shadow_.XtaOsKUG1I2IvliioFvyO7q0zEo0oOz_0 2024-08-27T03:58:31.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8398551154984255569', time=2024-08-27T05:49:30.127406+0000, chain.objs.size()=1 2024-08-27T03:58:31.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.395+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.738__shadow_.QZBqGfw7ayTUjHUh4W4hxVMr19ypFTb_0 2024-08-27T03:58:31.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.399+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-08-27T03:58:31.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50174' 2024-08-27T03:58:31.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7550137886823042504', time=2024-08-27T05:17:58.980977+0000, chain.objs.size()=1 2024-08-27T03:58:31.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.227__shadow_.CWD_9FJw6jfQBYujwG2JFWFc8QRTSSp_0 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.734314707203472630', time=2024-08-27T05:18:00.803323+0000, chain.objs.size()=1 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.228__shadow_.p7ohumLh5Lg9ZduxJnRXLu7BYHKeZFA_0 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6512039339637417681', time=2024-08-27T05:18:19.212907+0000, chain.objs.size()=1 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.237__shadow_.ZhdaQE7mfP3vG4MUvtOchBimD6sDnfP_0 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.112501290923257224', time=2024-08-27T05:18:25.622295+0000, chain.objs.size()=1 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.240__shadow_.m-rgJpYRjV2_it6Xwb4OLxZ49LD-n86_0 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1990965208734443987', time=2024-08-27T05:20:35.487039+0000, chain.objs.size()=1 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SmyKdGT9Bn4LPyC3Yu55iTLqd1u26F3_0 2024-08-27T03:58:31.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1391268330533416822', time=2024-08-27T05:20:36.632828+0000, chain.objs.size()=1 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5j8B4rGw9ZR05rVm7-IwhMNjk5aL-71_0 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15458836444561365846', time=2024-08-27T05:20:37.092924+0000, chain.objs.size()=1 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.cv9txbtjGpi_TNDw7gPAbXiUEX0D9V1_0 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14912888994421693553', time=2024-08-27T05:20:39.158047+0000, chain.objs.size()=1 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pwUfJZ0LhFmLzG01mskYhlri0su5HHP_0 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4896287585492083191', time=2024-08-27T05:20:39.652770+0000, chain.objs.size()=1 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rgp5G9NrIbaQ-Uuts7x2IHhzQJq2w0L_0 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15948536197757556705', time=2024-08-27T05:20:40.028488+0000, chain.objs.size()=1 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.srqQNel4pjI209UoS8V8cikcWN8turJ_0 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10386874102783698892', time=2024-08-27T05:20:40.806704+0000, chain.objs.size()=1 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.tpCkFRfNo6Sg0CSbDz5Nq5yWDxUUReD_0 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7981187590153807741', time=2024-08-27T05:20:41.255129+0000, chain.objs.size()=1 2024-08-27T03:58:31.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.403+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.YZnfcbBZwChZdBuKj-F66FVL3Fpyo33_0 2024-08-27T03:58:31.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15340049593759344583', time=2024-08-27T05:20:41.257143+0000, chain.objs.size()=1 2024-08-27T03:58:31.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._uuauIiEtUXqb8kYwn2BDaJZ4YTL4Q__0 2024-08-27T03:58:31.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11136297515065153298', time=2024-08-27T05:20:41.347595+0000, chain.objs.size()=1 2024-08-27T03:58:31.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ept2bpHE49_La1jWZBm9aeffTReBbtL_0 2024-08-27T03:58:31.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3862950461278632498', time=2024-08-27T05:20:41.646921+0000, chain.objs.size()=1 2024-08-27T03:58:31.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oI_lMLKR-wSoPL6VT0QGHRs_2HBgQv7_0 2024-08-27T03:58:31.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8210752276865417966', time=2024-08-27T05:20:41.871818+0000, chain.objs.size()=1 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ypye0b9fgf4Eiwl3Lo9Oi04QVHAcHp1_0 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3940517078125499854', time=2024-08-27T05:20:42.142969+0000, chain.objs.size()=1 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fwyAM3Vu_9oZr-w4or7F7i1rnp5W1KB_0 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2429410877855806356', time=2024-08-27T05:20:45.948055+0000, chain.objs.size()=1 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.M6Rg5SwZ2g7iL_7W6r-N6AoJakJ5oth_0 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14534553376971301063', time=2024-08-27T05:20:47.058160+0000, chain.objs.size()=1 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7HAoGNZsD62O7E35dRmhdtyPw8Nzk4z_0 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11031159023935497074', time=2024-08-27T05:20:48.287038+0000, chain.objs.size()=1 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.veM1X8Wv_KNMMllD-tVRgEAre7f3cbQ_0 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8838076645315965793', time=2024-08-27T05:20:49.012209+0000, chain.objs.size()=1 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.U-JNjty6340RNX402I8homMBKLJHrt-_0 2024-08-27T03:58:31.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13525288094294613659', time=2024-08-27T05:20:49.014579+0000, chain.objs.size()=1 2024-08-27T03:58:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eYoMzAmuslfRhZ9Av0jU5XwtNdaHGD__0 2024-08-27T03:58:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8841166196235386334', time=2024-08-27T05:20:49.315689+0000, chain.objs.size()=1 2024-08-27T03:58:31.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.411+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dD6F5kLAqrTj9YhK-gs9i_3DIr0Zhv-_0 2024-08-27T03:58:31.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9409364903600181724', time=2024-08-27T05:20:49.317572+0000, chain.objs.size()=1 2024-08-27T03:58:31.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uvItFkDbwYZ4xKFojhxe5BAS7e1TLG6_0 2024-08-27T03:58:31.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5284581364408684279', time=2024-08-27T05:20:51.070474+0000, chain.objs.size()=1 2024-08-27T03:58:31.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nQ9hlHlUicQbYbb2ftIpS2M5nZZOwim_0 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18428296784969852890', time=2024-08-27T05:20:51.763955+0000, chain.objs.size()=1 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.yE3AlXGfuk_W1FZaR-xNLFlLM7k9tdu_0 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4222701575447612932', time=2024-08-27T05:20:52.972928+0000, chain.objs.size()=1 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qEHxmZEMRR7AJJ48HTiny5VKFieQNix_0 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3973281956399035422', time=2024-08-27T05:20:53.141875+0000, chain.objs.size()=1 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xqemJ8SJrkNG5B02ARWk_nPZ55-cNVA_0 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16210964519846017803', time=2024-08-27T05:20:54.558938+0000, chain.objs.size()=1 2024-08-27T03:58:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.A8g9qcO4XCF7MoWgVedQsxoyT-5xlaA_0 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10881414543193784112', time=2024-08-27T05:20:54.560725+0000, chain.objs.size()=1 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.aIYKlJOlhjMZsHeOr95jdkVSGFAYJXe_0 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3957607477294157207', time=2024-08-27T05:20:54.562534+0000, chain.objs.size()=1 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HzTdp-c7eddPWJIUckJpUlbfxyEPAvX_0 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3268104750093710334', time=2024-08-27T05:20:55.230195+0000, chain.objs.size()=1 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.mSy0CkJtoS_BPZlR6dc7PVAlGfbScPX_0 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2675004838664653091', time=2024-08-27T05:20:59.262207+0000, chain.objs.size()=1 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BxphTGO_28PTy9gDOU1l85rfGmzdHaM_0 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17172200559748335804', time=2024-08-27T05:21:00.768509+0000, chain.objs.size()=1 2024-08-27T03:58:31.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.415+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EsxgJw1oCmxIOB4WuSj1GGzVy60NuSg_0 2024-08-27T03:58:31.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.983746244879564290', time=2024-08-27T05:21:01.610669+0000, chain.objs.size()=1 2024-08-27T03:58:31.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3cW6cFEzOLd6IZqexxXw9OEgzQLdyqn_0 2024-08-27T03:58:31.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3501625796217621820', time=2024-08-27T05:21:02.282828+0000, chain.objs.size()=1 2024-08-27T03:58:31.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qjVDstAsOKF22-Sx236J0uUFi9s7Wjc_0 2024-08-27T03:58:31.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8526676224674179325', time=2024-08-27T05:21:02.567685+0000, chain.objs.size()=1 2024-08-27T03:58:31.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.wNhItewNGxWeRQssVlRCXRM1G308VxX_0 2024-08-27T03:58:31.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11972081028116452767', time=2024-08-27T05:21:03.227949+0000, chain.objs.size()=1 2024-08-27T03:58:31.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.419+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.H5PSMY2X3X7oQ7KQjpSA1LpEFgBjFmO_0 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17749405527528475787', time=2024-08-27T05:21:07.698582+0000, chain.objs.size()=1 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.258__shadow_.AQQrcGPxuoXw2n6niHGStaDaWsK2B5a_0 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17388789352931966569', time=2024-08-27T05:21:19.781800+0000, chain.objs.size()=1 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.265__shadow_.DEx5P7TMC12iXYA5slSD4Diy0eUA2ym_0 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7077965705905244373', time=2024-08-27T05:21:26.877050+0000, chain.objs.size()=1 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.269__shadow_.p1-6vo0YV-cRmpAcItGRizv4M2EDmQ2_0 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4132150494398458193', time=2024-08-27T05:21:28.668784+0000, chain.objs.size()=1 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.270__shadow_.z3RcspAmfCGNb_NdYtTvN8nZYhnrW1f_0 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6525729371556073185', time=2024-08-27T05:22:08.014340+0000, chain.objs.size()=1 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.B6t4Bqv-FQTRJz3nggkIDRWyayQzyVJ_0 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1701426033465476767', time=2024-08-27T05:22:30.704590+0000, chain.objs.size()=1 2024-08-27T03:58:31.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.299__shadow_.TUEDJGW3YSIw3JRBBx3vpjMkNy6-PD4_0 2024-08-27T03:58:31.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8948999319393624146', time=2024-08-27T05:24:46.382511+0000, chain.objs.size()=1 2024-08-27T03:58:31.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dLjTgeqQz21x4z1m4btdh3IeWMZxfjm_0 2024-08-27T03:58:31.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17922625263443555955', time=2024-08-27T05:24:46.991747+0000, chain.objs.size()=1 2024-08-27T03:58:31.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.423+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.pvvVIwTDxP_tDZMjWu810GQD3oPAMrW_0 2024-08-27T03:58:31.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3948641712294838028', time=2024-08-27T05:24:48.969052+0000, chain.objs.size()=1 2024-08-27T03:58:31.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.nF19G_6RBw_lJSeSS4eDax25S7eX485_0 2024-08-27T03:58:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15755664229925767469', time=2024-08-27T05:24:49.311650+0000, chain.objs.size()=1 2024-08-27T03:58:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5V8Wx9lglVFXmmuD5UpxmswBvng86x0_0 2024-08-27T03:58:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4328149448377547860', time=2024-08-27T05:24:50.442013+0000, chain.objs.size()=1 2024-08-27T03:58:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fEzPywuwz-aAtKCqtD_Uyxlvz5Kx3US_0 2024-08-27T03:58:31.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9866601987671619505', time=2024-08-27T05:24:50.444397+0000, chain.objs.size()=1 2024-08-27T03:58:31.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RocLqEVPED-P_7gKoz5qngLG2Rmiejo_0 2024-08-27T03:58:31.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18326039674655688393', time=2024-08-27T05:24:50.446737+0000, chain.objs.size()=1 2024-08-27T03:58:31.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.SX5qPKde8M_2Um3Q-K3IlilytyMSKMx_0 2024-08-27T03:58:31.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5906997897601156535', time=2024-08-27T05:24:50.872211+0000, chain.objs.size()=1 2024-08-27T03:58:31.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.l30TeNkgOkzKNDEnRiMH4wjSOiSSn6r_0 2024-08-27T03:58:31.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12962256440525090918', time=2024-08-27T05:24:51.411922+0000, chain.objs.size()=1 2024-08-27T03:58:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.AvHq3ivGTDSx6ZA1X1jItQtni9xmkWw_0 2024-08-27T03:58:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8999575390330380152', time=2024-08-27T05:24:51.602996+0000, chain.objs.size()=1 2024-08-27T03:58:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yJIW5qMjZktRAIHXWPc6rRtGLTCqe_t_0 2024-08-27T03:58:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4444418107935723274', time=2024-08-27T05:24:51.719160+0000, chain.objs.size()=1 2024-08-27T03:58:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.71n2I9Ce0sItCdeXS_PlyT8fzlTSmoa_0 2024-08-27T03:58:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10467349637844366794', time=2024-08-27T05:24:52.805598+0000, chain.objs.size()=1 2024-08-27T03:58:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.427+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wruI255-slMr_B2C1R7U-rrVExeMNXT_0 2024-08-27T03:58:31.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3349046636352785328', time=2024-08-27T05:24:53.239182+0000, chain.objs.size()=1 2024-08-27T03:58:31.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OcXyR6IMKcdEGuJhxk0EQW-EhwONqC5_0 2024-08-27T03:58:31.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3484991193282645064', time=2024-08-27T05:24:54.357298+0000, chain.objs.size()=1 2024-08-27T03:58:31.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.EzohzxrvLnI5V8hgazOceZb8yPOZ_Q0_0 2024-08-27T03:58:31.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6867994169077863474', time=2024-08-27T05:24:54.811966+0000, chain.objs.size()=1 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.So2H4LufiDnZGDcyTtHM5kBE_4Hd0Ku_0 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8186008871134459358', time=2024-08-27T05:24:55.100436+0000, chain.objs.size()=1 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ibGwULXByd58GsQ3_I_vAEP7l-vqdjy_0 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7830945039632013683', time=2024-08-27T05:24:55.928040+0000, chain.objs.size()=1 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.I7ggE9qhdc0RwyePdNsAoqe5nX-7tAE_0 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7819365822416254028', time=2024-08-27T05:24:56.330215+0000, chain.objs.size()=1 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3ymICc4niqMfPWkdjpyNC3NDTQpozcZ_0 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10924748362127401432', time=2024-08-27T05:24:58.445996+0000, chain.objs.size()=1 2024-08-27T03:58:31.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.NDyORfa9bGkAp5CQWy5duTOGqdoTFkW_0 2024-08-27T03:58:31.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16701082354872933673', time=2024-08-27T05:24:59.187544+0000, chain.objs.size()=1 2024-08-27T03:58:31.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Cc3Eg67qPHG-hOcaR7J4jFJ7OL7C5jv_0 2024-08-27T03:58:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18430950081909715134', time=2024-08-27T05:25:00.757278+0000, chain.objs.size()=1 2024-08-27T03:58:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DDkQ3B5xBrwZ6d3emvzTiI5Jk2b9oAq_0 2024-08-27T03:58:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2183838366281484185', time=2024-08-27T05:25:00.812727+0000, chain.objs.size()=1 2024-08-27T03:58:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LNrzx6OoiVFB7fCEhy93KBKeLFjroPN_0 2024-08-27T03:58:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10076185063142023622', time=2024-08-27T05:25:03.632240+0000, chain.objs.size()=1 2024-08-27T03:58:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.431+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FskOoC2pdsFGPBAuOWanhdISQgkbNZX_0 2024-08-27T03:58:31.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5954093316983492093', time=2024-08-27T05:25:03.989986+0000, chain.objs.size()=1 2024-08-27T03:58:31.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1SWdi4x-SHp60-F4z5dQpGfMrKliMQL_0 2024-08-27T03:58:31.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17382391377846972533', time=2024-08-27T05:25:04.223514+0000, chain.objs.size()=1 2024-08-27T03:58:31.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.B0_ycs5MC55j1mN2Xh0P9yPOBrx2eTz_0 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1808647430382141652', time=2024-08-27T05:25:06.637777+0000, chain.objs.size()=1 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.kpWKaGBcE-FK-jsQ8lxhsnezRWoh3Dt_0 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10054726486989161398', time=2024-08-27T05:25:07.038942+0000, chain.objs.size()=1 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eDLui8oFvLIlkRRw3hBCB8qa1PE77Dt_0 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.828633841940190066', time=2024-08-27T05:25:07.296755+0000, chain.objs.size()=1 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1kzz4OaGKKxbO38d-ukQcXbwyiTI7o5_0 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.341022824994737763', time=2024-08-27T05:25:07.458826+0000, chain.objs.size()=1 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cZoikWrHwasn5sqdP1xqL8v-fCZP1rL_0 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5668259578583878996', time=2024-08-27T05:25:09.746539+0000, chain.objs.size()=1 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.tGPJ0_eAXfPOprhWgcm5dk0GnHRHtjF_0 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6658414289088150227', time=2024-08-27T05:25:10.598254+0000, chain.objs.size()=1 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.gFdGrDSNZeAmmCoXeBLmGrOenTRozqg_0 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17364209455737998928', time=2024-08-27T05:25:12.247851+0000, chain.objs.size()=1 2024-08-27T03:58:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.CSllSwRCIjeS48ipbuKsFz0iyRWPfS2_0 2024-08-27T03:58:31.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4571140602129699640', time=2024-08-27T05:25:12.263695+0000, chain.objs.size()=1 2024-08-27T03:58:31.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MK6IztqxF9ZOX4x0rNgKjEtax2m72EQ_0 2024-08-27T03:58:31.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13889510600762088310', time=2024-08-27T05:25:12.655995+0000, chain.objs.size()=1 2024-08-27T03:58:31.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.439+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LjIuVU0H1Nikxg16j2MAklgE93U9P88_0 2024-08-27T03:58:31.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6507445224130535874', time=2024-08-27T05:25:13.436947+0000, chain.objs.size()=1 2024-08-27T03:58:31.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.XG_0J900FGB_QcfdLA_XH5AAg4FVFld_0 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13612876951873723486', time=2024-08-27T05:25:13.532271+0000, chain.objs.size()=1 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LghIawutCWF8S9bxnX4M5M9NuS_wgJY_0 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18222188150482575951', time=2024-08-27T05:26:57.976962+0000, chain.objs.size()=1 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FiF3BLSSiR5Th4EsQKs21lePMoWCYIa_0 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12920215305194223266', time=2024-08-27T05:26:58.384594+0000, chain.objs.size()=1 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Am93TB69gFVzCD33-HC_ZpiWnD1jGeG_0 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12085621898239052273', time=2024-08-27T05:26:59.717934+0000, chain.objs.size()=1 2024-08-27T03:58:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EMAfIJ3QWMT69jHu-mDWUmypgUIoZpS_0 2024-08-27T03:58:31.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12716929897210170814', time=2024-08-27T05:26:59.831763+0000, chain.objs.size()=1 2024-08-27T03:58:31.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Y4Cqz9SlhqJA8oUWe1F-j1qjWJqQGRt_0 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11203024863894898456', time=2024-08-27T05:27:00.100703+0000, chain.objs.size()=1 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.T3S8lvbSHTXRspi8pEgdVqN1fEPOluW_0 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8202909508573054207', time=2024-08-27T05:27:02.129664+0000, chain.objs.size()=1 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jMG8l6FYPnuj-cbNIKMLzn-3bpDe_dj_0 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16257062015095281114', time=2024-08-27T05:27:03.739590+0000, chain.objs.size()=1 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MNPW_xGWekw8Gdiui4Da40kIgTPpDJw_0 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16843958572962898352', time=2024-08-27T05:27:05.839627+0000, chain.objs.size()=1 2024-08-27T03:58:31.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.443+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._TLc0Tjv_VOgu2kICTKN3m8gQPAUtMT_0 2024-08-27T03:58:31.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6598681679949315981', time=2024-08-27T05:27:06.273302+0000, chain.objs.size()=1 2024-08-27T03:58:31.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.fC01c1pW4qYWGIdRsDsoXz653Gvg4sD_0 2024-08-27T03:58:31.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16517451251143493822', time=2024-08-27T05:27:07.725453+0000, chain.objs.size()=1 2024-08-27T03:58:31.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.JaPWFkvSWYgOH7ajVPWqD3E7V0TCKhS_0 2024-08-27T03:58:31.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.447+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14201156751290726562', time=2024-08-27T05:27:09.279926+0000, chain.objs.size()=1 2024-08-27T03:58:31.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.447+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8dFu5ieMgsXBxtlepia5_47hjQO3ho1_0 2024-08-27T03:58:31.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15692842074162530394', time=2024-08-27T05:27:10.056161+0000, chain.objs.size()=1 2024-08-27T03:58:31.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DkKNe4xLP2ES0AuIV8XIYLZWgr8OXTb_0 2024-08-27T03:58:31.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13329833301897827827', time=2024-08-27T05:27:10.368326+0000, chain.objs.size()=1 2024-08-27T03:58:31.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jVFGbnAsvEXjolXz8Dv9eRbx4NZIC63_0 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5786472696722341808', time=2024-08-27T05:27:10.764758+0000, chain.objs.size()=1 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2z_0dgRLufjHLXBDnHww3au6dVlFDkY_0 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6081521909326448471', time=2024-08-27T05:27:11.278264+0000, chain.objs.size()=1 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xSY6H2i6JZDFnWC9p8i2FZmXQ9qkveR_0 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2154145240443614694', time=2024-08-27T05:27:11.946808+0000, chain.objs.size()=1 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wWSwX-hgn1U_-5ktz059L-x-MAISA4Y_0 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8414194134552505986', time=2024-08-27T05:27:14.093756+0000, chain.objs.size()=1 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.C3QyY4hkipivE-VvjIFHNmqzln0Ku_7_0 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10537215747566412988', time=2024-08-27T05:27:14.095526+0000, chain.objs.size()=1 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.x8HqeKj9B_4otGRbGj9JBeBSGGQoM1J_0 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11398679365243811476', time=2024-08-27T05:27:14.097112+0000, chain.objs.size()=1 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jOwIQf-92OlcyM3qLwMVGAMqyD6WZ7n_0 2024-08-27T03:58:31.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6516715725886653918', time=2024-08-27T05:27:15.629515+0000, chain.objs.size()=1 2024-08-27T03:58:31.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.451+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wvVl1A8ldSLFVi2F2PM0ZCA_GP2bYw6_0 2024-08-27T03:58:31.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.455+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50174 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4530734955898927658', time=2024-08-27T05:27:15.702032+0000, chain.objs.size()=1 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.aG3JWXK33vkZom_Qn2Xhaelexmh5iL0_0 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12700283418597688968', time=2024-08-27T05:27:16.448244+0000, chain.objs.size()=1 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NuX_xQ4-Yods8-PzDRK78fFwCAOAcSQ_0 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3947498904896203683', time=2024-08-27T05:27:16.854050+0000, chain.objs.size()=1 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bzu--gN1p8Ap-VO0zRguZfOWWHBmmkb_0 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.451754556217101268', time=2024-08-27T05:27:16.989997+0000, chain.objs.size()=1 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.u6xOx6fSf-VDn5M4n4H5H4rwPOVeCCX_0 2024-08-27T03:58:31.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4755820607357965053', time=2024-08-27T05:27:21.603732+0000, chain.objs.size()=1 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Eu4FSHLaZfhSW18LyRP_IIqDZLEnjaJ_0 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17553745754065950652', time=2024-08-27T05:27:21.839837+0000, chain.objs.size()=1 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lsECWwU3kOmTXhSUbFM8ZwJsSlgx3Hf_0 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4804043823110768486', time=2024-08-27T05:27:22.287262+0000, chain.objs.size()=1 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7vI5X1NG3cMK6KbMP0OywFrCin_Jo10_0 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.532898953916411421', time=2024-08-27T05:27:22.512922+0000, chain.objs.size()=1 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.agWxE0KRua0sTWIJCrR8UPdpRUZL88u_0 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12754360188005610983', time=2024-08-27T05:27:22.957098+0000, chain.objs.size()=1 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vV5ClebncdZr4bP9auIZE9-X1pt-Cjv_0 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14391850984010503563', time=2024-08-27T05:27:23.745318+0000, chain.objs.size()=1 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UmYvjgy9giVl5bN1IRkBS97NlW60JiA_0 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13436707671331272918', time=2024-08-27T05:27:24.967792+0000, chain.objs.size()=1 2024-08-27T03:58:31.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.94_DOXmVFqGZdR5GXoqqMdkGD5r2pDB_0 2024-08-27T03:58:31.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5742677210288805389', time=2024-08-27T05:27:25.200832+0000, chain.objs.size()=1 2024-08-27T03:58:31.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.463+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Uci-uhvdl2BVbH9VuL6AkBMuw_UNLPZ_0 2024-08-27T03:58:31.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5778662686401888111', time=2024-08-27T05:27:25.343563+0000, chain.objs.size()=1 2024-08-27T03:58:31.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Wzs-S9Vzi146ELPcQC-4XS1Kbq0fRcC_0 2024-08-27T03:58:31.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9870708545413120845', time=2024-08-27T05:27:25.738644+0000, chain.objs.size()=1 2024-08-27T03:58:31.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.faz3RWYUbhmo4TUf8ht4lmx-llFCJX8_0 2024-08-27T03:58:31.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3152090833481787945', time=2024-08-27T05:28:30.606549+0000, chain.objs.size()=1 2024-08-27T03:58:31.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.365__shadow_.Jq6J055uwae9aAByeSvaiD_G9NR6gOo_0 2024-08-27T03:58:31.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10973708219928127896', time=2024-08-27T05:31:01.581729+0000, chain.objs.size()=1 2024-08-27T03:58:31.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.458__shadow_.etW1D5U_06gwIs9V69sUJulC7nUZjUU_0 2024-08-27T03:58:31.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16476580716162140047', time=2024-08-27T05:35:16.273847+0000, chain.objs.size()=2 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~5QTtq82tb8VoVQEVLAH-xxnQRQ8U5LI.1 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~5QTtq82tb8VoVQEVLAH-xxnQRQ8U5LI.2 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12812604162715327511', time=2024-08-27T05:36:11.159833+0000, chain.objs.size()=4 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.529__multipart_mymultipart.2~mvpjDKf-cto7XxH8aDrBC4CeIYDUayZ.1 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.529__multipart_mymultipart.2~mvpjDKf-cto7XxH8aDrBC4CeIYDUayZ.2 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.529__multipart_mymultipart.8Y7rdLYrnikZX-rrMqFbzF2uxzeam59z.3 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.529__multipart_mymultipart.2~mvpjDKf-cto7XxH8aDrBC4CeIYDUayZ.4 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1111325278219271936', time=2024-08-27T05:36:58.463780+0000, chain.objs.size()=1 2024-08-27T03:58:31.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.467+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.547__shadow_.mhQKxqlQ-ZuVh975ca62IPhiYzG_48R_0 2024-08-27T03:58:31.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.471+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9111073336829404951', time=2024-08-27T05:37:44.184857+0000, chain.objs.size()=1 2024-08-27T03:58:31.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.471+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.560__shadow_.ROMPphopy_0XlYGKiJxfZc_KpMMgJGL_0 2024-08-27T03:58:31.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.471+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10782614814119131355', time=2024-08-27T05:37:57.921817+0000, chain.objs.size()=1 2024-08-27T03:58:31.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.471+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:3Y73WVt.nWH8dMXzVDfVz6blrj56w.A_.FppjKLcqCg66csR3lluXw4zyd7qkIb6_0 2024-08-27T03:58:31.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.471+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.180033608822855320', time=2024-08-27T05:38:03.409430+0000, chain.objs.size()=1 2024-08-27T03:58:31.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.471+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:KOaAR2n-jMZD7TpdosTNZTgWjwR11Nn_.eFm8owGBqeAatQMjkFyFoHcK7oC9hPI_0 2024-08-27T03:58:31.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13987888805562789897', time=2024-08-27T05:38:44.035879+0000, chain.objs.size()=1 2024-08-27T03:58:31.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.570__shadow:panp1R.pmgUzcG3OdLfwGLvBnHBtVv9_.I_3Ux_RGk-gDsxcTDuGyHy8LQGQztxj_0 2024-08-27T03:58:31.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16978159731042399621', time=2024-08-27T05:39:05.807157+0000, chain.objs.size()=1 2024-08-27T03:58:31.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:LVpsTmoJLMNJCMd-dTMbIlBbcVpz1p0_.sIqmZvRL8stjnzwlrVBMSBIk4ZShsrP_0 2024-08-27T03:58:31.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16883187760462920673', time=2024-08-27T05:39:21.539988+0000, chain.objs.size()=1 2024-08-27T03:58:31.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:4miThXwYyvYMAFSNbbZv1V48jXWKMut_.egd9y0Hu6X_j-SnsIVM39FSD-ZgB9Zu_0 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15636813222547712831', time=2024-08-27T05:44:27.739635+0000, chain.objs.size()=1 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.613__shadow_.3lcsEJWF0FYXPlz3TWQi49dPh_0BmtD_0 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17495788477109227789', time=2024-08-27T05:46:08.178083+0000, chain.objs.size()=1 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.645__shadow_.ftopj9lTod6gUjF4A2hBkGxFvBh_9R3_0 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5032132970851023387', time=2024-08-27T05:46:11.269514+0000, chain.objs.size()=1 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.647__shadow_.QXAiArvdamsoR40Pytjc-x8rmVYGhjj_0 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18187839028912271458', time=2024-08-27T05:46:17.128409+0000, chain.objs.size()=1 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.649__shadow_.t6so4xdrWGV-C1yTbsqNacZicHGsEZV_0 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17702802117679959765', time=2024-08-27T05:46:53.316546+0000, chain.objs.size()=1 2024-08-27T03:58:31.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.659__shadow_.vqx387YRo7osHyuFAu80RMJD-Tw46mg_0 2024-08-27T03:58:31.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14776279814019085788', time=2024-08-27T05:47:14.006562+0000, chain.objs.size()=1 2024-08-27T03:58:31.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.475+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.673__shadow_.HGnWbEkLelRK9nRVQI29dq4jfcIBeJB_0 2024-08-27T03:58:31.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.479+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5173985406754978052', time=2024-08-27T05:49:19.148936+0000, chain.objs.size()=1 2024-08-27T03:58:31.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.479+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.735__shadow_.h818Fcetb3P2b_LnIAY7Lz_rAn0tyPX_0 2024-08-27T03:58:31.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.483+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.483+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-08-27T03:58:31.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59324' 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17383118420567870654', time=2024-08-27T05:14:17.216501+0000, chain.objs.size()=1 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.172__shadow_.DXFCridNmDythA1g9fuIA6_WgWl-KLN_0 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1046201976935473269', time=2024-08-27T05:14:21.394082+0000, chain.objs.size()=1 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.175__shadow_.YM6RNVc08pvNpjOG3vM6OpsEGVbIpxN_0 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7531194439578380151', time=2024-08-27T05:14:24.105068+0000, chain.objs.size()=1 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.177__shadow_.cI0mdMa19t66o8I-9HdiePPnz3jwl41_0 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1780869546380896494', time=2024-08-27T05:17:53.389542+0000, chain.objs.size()=1 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.224__shadow_.yZVmw2P3a9Avs90dTst1YVgavI53bZ5_0 2024-08-27T03:58:31.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9415293278318600085', time=2024-08-27T05:18:02.638494+0000, chain.objs.size()=1 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.229__shadow_.C3FUQSw6NxA4do3XrD7eYel6wpjp06s_0 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13698993753727229561', time=2024-08-27T05:18:04.499701+0000, chain.objs.size()=1 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.230__shadow_.Jb6qvknkW8UCVFYvp8iuArrl5rreW6f_0 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16698362139671455496', time=2024-08-27T05:18:07.114011+0000, chain.objs.size()=1 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.231__shadow_.FPODT7YwuHuBcpXftxSdE8HyoJjbVtN_0 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1132328391001006972', time=2024-08-27T05:18:34.870013+0000, chain.objs.size()=1 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.245__shadow_.m7Da3ImXnRSN82d-dI8XQpCSNwDOnnG_0 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9671347226352045617', time=2024-08-27T05:18:42.218086+0000, chain.objs.size()=1 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.249__shadow_.WJ1PEPhS90WlDHTiU6xxjCbriYmmm_7_0 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12095362288126806694', time=2024-08-27T05:20:35.351903+0000, chain.objs.size()=1 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ddYVTHrX0VK4jvE78dX-8TOC9fBJzLB_0 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4667041463292688698', time=2024-08-27T05:20:37.185178+0000, chain.objs.size()=1 2024-08-27T03:58:31.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MNQiivqF50YMg4-Ib29fYuCmiQov-8v_0 2024-08-27T03:58:31.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11235708358343749877', time=2024-08-27T05:20:37.573956+0000, chain.objs.size()=1 2024-08-27T03:58:31.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.487+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vM9iz5AHjJmOSLRulIj1bbIhlx-0p49_0 2024-08-27T03:58:31.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9536178052378297838', time=2024-08-27T05:20:39.258980+0000, chain.objs.size()=1 2024-08-27T03:58:31.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HaG7ooAvn_IHtV51i-g3cX8xJJek2-w_0 2024-08-27T03:58:31.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12198572184262021831', time=2024-08-27T05:20:39.395110+0000, chain.objs.size()=1 2024-08-27T03:58:31.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qOoA2x91Plz6Y5m4MQwLgdGTe5Lcpag_0 2024-08-27T03:58:31.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10654371803704328839', time=2024-08-27T05:20:39.716923+0000, chain.objs.size()=1 2024-08-27T03:58:31.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lbPkSPcWMwocKh1Tef3j2U1fKOe5zeu_0 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.770589026422501564', time=2024-08-27T05:20:40.093053+0000, chain.objs.size()=1 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.DUNyEQb82MVC3-Vjqi2r64ghKvTG7Nx_0 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10633135231853313655', time=2024-08-27T05:20:40.097503+0000, chain.objs.size()=1 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.rr87_2UGk5nrreOBoLZJeG9VL-mGYLS_0 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8692490902281777971', time=2024-08-27T05:20:40.696595+0000, chain.objs.size()=1 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.onLkR58SWBTvePLszkCdb36tSOhQRxh_0 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11960448456251938327', time=2024-08-27T05:20:41.155907+0000, chain.objs.size()=1 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.nuv8q-4PFyUQNH3AkMeh1YHJwjtMI3v_0 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18395835537490399698', time=2024-08-27T05:20:42.173947+0000, chain.objs.size()=1 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8J9msTFmv1MkO-_X6pnRexEaPfYhfMR_0 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15131553134190721613', time=2024-08-27T05:20:43.211789+0000, chain.objs.size()=1 2024-08-27T03:58:31.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9Xrefu9YacFI261s9bScpvz1qHVU6OS_0 2024-08-27T03:58:31.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15246210431816390812', time=2024-08-27T05:20:45.034420+0000, chain.objs.size()=1 2024-08-27T03:58:31.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZcYuJt6Yu1iMAeNgw4WePdvjhieQNXH_0 2024-08-27T03:58:31.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5238949726432723870', time=2024-08-27T05:20:45.066598+0000, chain.objs.size()=1 2024-08-27T03:58:31.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.491+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7aRZj8xhfEvY02FPEDwz4MO_1FZmMDM_0 2024-08-27T03:58:31.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.495+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3590949849195359654', time=2024-08-27T05:20:47.074380+0000, chain.objs.size()=1 2024-08-27T03:58:31.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.495+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0_sx-W5br5I0X2QoW1NrxBg_WICpp2j_0 2024-08-27T03:58:31.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16427694577756964167', time=2024-08-27T05:20:47.075769+0000, chain.objs.size()=1 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OFcXUOT3ETktGww6DiMCd0z5xZADLPi_0 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8636850793346479727', time=2024-08-27T05:20:47.174719+0000, chain.objs.size()=1 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XFnjvJlpItlaVbA2kCFAGzKGFqQPOCz_0 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12494822485279573612', time=2024-08-27T05:20:47.399137+0000, chain.objs.size()=1 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Fc3e_naV1BmXvxKT06MBeZjH0wPS6xI_0 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12360555575031202389', time=2024-08-27T05:20:48.057768+0000, chain.objs.size()=1 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.-dsfPKQJRpBRLsGv0MSj_I9K1Z53vqX_0 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3419478217304147282', time=2024-08-27T05:20:51.097365+0000, chain.objs.size()=1 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CbU3Wz_PJdHROeovouNadMVl0_OLnZ__0 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17790747980029410830', time=2024-08-27T05:20:52.915202+0000, chain.objs.size()=1 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lVeucnjG3pM_O198HLEkVc_4O5vC-8t_0 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8248265654453401511', time=2024-08-27T05:20:53.496205+0000, chain.objs.size()=1 2024-08-27T03:58:31.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ovzgmy0CHHCATmoNZsyJsaX2ERciaGn_0 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2256252388653645748', time=2024-08-27T05:20:53.498339+0000, chain.objs.size()=1 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ko2QJyEakSCu8fK-9x4L3ZlzJF0kHmC_0 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11926114289874771720', time=2024-08-27T05:20:53.562208+0000, chain.objs.size()=1 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7Hg0QjtGnWoOrnGb6BhEUn0Dld0beVV_0 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14540050402601195779', time=2024-08-27T05:20:54.593255+0000, chain.objs.size()=1 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.q752hqruS1PiMtpY1sK342oZuK3ldfa_0 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.64997277367198009', time=2024-08-27T05:20:54.933196+0000, chain.objs.size()=1 2024-08-27T03:58:31.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.499+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.AEVPgdnhtj4t7m3XXhyXpsvCi-WbikG_0 2024-08-27T03:58:31.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17365787144863402103', time=2024-08-27T05:20:55.630582+0000, chain.objs.size()=1 2024-08-27T03:58:31.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5RjpY-fFAl60mCEbpn5jOJrZyRt-Wl7_0 2024-08-27T03:58:31.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7248689043411075736', time=2024-08-27T05:20:55.745980+0000, chain.objs.size()=1 2024-08-27T03:58:31.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OwCZ2ursQ0Ot2svX9wHoz0pv3Vk4GDS_0 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5390171648831176708', time=2024-08-27T05:20:57.035637+0000, chain.objs.size()=1 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RiNm6VS1D4b0ThpUfH4E_gIOUnpqkSv_0 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16986268944010984802', time=2024-08-27T05:20:57.975299+0000, chain.objs.size()=1 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Udt1FNFYaStKYp34MrriklriPup71GT_0 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13187794155861987983', time=2024-08-27T05:20:58.478360+0000, chain.objs.size()=1 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JlM7wlquGiy2K02MMPmK73Ffi5GBGLi_0 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3235130338053475103', time=2024-08-27T05:20:59.772947+0000, chain.objs.size()=1 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sc9XhcqfGvT_b_bT3QxX9J0SfAvpECb_0 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11096705659836111984', time=2024-08-27T05:21:00.119299+0000, chain.objs.size()=1 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.xgir3PJFHrHbfkttag8mUNS9dgGHA0J_0 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10293673358365448385', time=2024-08-27T05:21:00.951140+0000, chain.objs.size()=1 2024-08-27T03:58:31.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.76681xFhCm8p6-n1BW6ODltvJRmn4Yc_0 2024-08-27T03:58:31.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13158562450561468690', time=2024-08-27T05:21:01.692205+0000, chain.objs.size()=1 2024-08-27T03:58:31.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2UcXUh_ZQEP8RS7aJHi-a0On5RQwOMd_0 2024-08-27T03:58:31.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12153073882441704545', time=2024-08-27T05:21:01.964720+0000, chain.objs.size()=1 2024-08-27T03:58:31.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.el-yvc-0UZkBZDBZvgQx7a7CQZshKRz_0 2024-08-27T03:58:31.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14035244989482648692', time=2024-08-27T05:21:02.408783+0000, chain.objs.size()=1 2024-08-27T03:58:31.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.503+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PZYz6syIwVwg8QZuFrsgREWMNYnnubH_0 2024-08-27T03:58:31.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8116829950819921317', time=2024-08-27T05:21:02.453256+0000, chain.objs.size()=1 2024-08-27T03:58:31.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.k9D9Lu42BNS3HedSmsmGi7CG8geMrjj_0 2024-08-27T03:58:31.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8018562118952502118', time=2024-08-27T05:21:03.013838+0000, chain.objs.size()=1 2024-08-27T03:58:31.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.t3mnLdDWKbpR84690LSvr1ISF4KGhe7_0 2024-08-27T03:58:31.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.507+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11375907502368853502', time=2024-08-27T05:21:03.324079+0000, chain.objs.size()=1 2024-08-27T03:58:31.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.507+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.UlNea2sJ1JxvNBYKcLPCVhT-VR6SXuM_0 2024-08-27T03:58:31.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9906779642369264677', time=2024-08-27T05:21:03.547612+0000, chain.objs.size()=1 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.IOYB0N0mUnKyMnMWdQoYT0RPj437Jgo_0 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11623998752799637037', time=2024-08-27T05:21:18.031003+0000, chain.objs.size()=1 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.264__shadow_.GU0Db0ie98ebSGuyknk8A5XqMY8SNoy_0 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5064984200117774085', time=2024-08-27T05:21:34.253683+0000, chain.objs.size()=1 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.273__shadow_.e55S8nTa7TMCt0i7YNM9PzazT8nDoxj_0 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10587728684137351247', time=2024-08-27T05:22:07.926671+0000, chain.objs.size()=1 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.LXCmCfXloGihcg0--eY-AjJDSwPyRy5_0 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14277214233669168668', time=2024-08-27T05:22:08.187486+0000, chain.objs.size()=1 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.ZZiN5s371qV7Byw0incOtjx_JC6zL8N_0 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10743157695216011714', time=2024-08-27T05:22:13.744708+0000, chain.objs.size()=1 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.290__shadow_.RuqQ336mGpNwoioLJmWeLEGJKVYVHdE_0 2024-08-27T03:58:31.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3529681195259923615', time=2024-08-27T05:24:46.891698+0000, chain.objs.size()=1 2024-08-27T03:58:31.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7jJVbw43F1ya-9sS31rny07hatqLKvu_0 2024-08-27T03:58:31.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8768723474667170879', time=2024-08-27T05:24:47.057438+0000, chain.objs.size()=1 2024-08-27T03:58:31.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Cd0ElnfqSkDdvEZfXvsxDbxR9iwomKi_0 2024-08-27T03:58:31.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317690178883952928', time=2024-08-27T05:24:47.341323+0000, chain.objs.size()=1 2024-08-27T03:58:31.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.b9olRgJNqUU7MN_7MqqOfC41g4aX7eV_0 2024-08-27T03:58:31.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12889851645962375896', time=2024-08-27T05:24:47.343564+0000, chain.objs.size()=1 2024-08-27T03:58:31.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.511+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hFRrxmGY-3uz1b2kag14B-aU8GZM_Rn_0 2024-08-27T03:58:31.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17481948283368879907', time=2024-08-27T05:24:47.750478+0000, chain.objs.size()=1 2024-08-27T03:58:31.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KlboDhltwysvl25mR5fxaYrBAWLwCe__0 2024-08-27T03:58:31.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5536111418052577457', time=2024-08-27T05:24:49.289104+0000, chain.objs.size()=1 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Q6oH1pd3SJFDi6ubGWZdSa6zk7MUa-T_0 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8292563587272942240', time=2024-08-27T05:24:51.417187+0000, chain.objs.size()=1 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LzvWVYTz1gx1vCtb75O0R8DxsBrNZ2Z_0 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7993704807649999131', time=2024-08-27T05:24:51.492500+0000, chain.objs.size()=1 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.J4mA_YmzNR3-srFIKLMeCF_QiBWKb-n_0 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8034532036137217708', time=2024-08-27T05:24:51.495133+0000, chain.objs.size()=1 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2wycEFnRtuJLilHnw8ViH-7yGpGdBgA_0 2024-08-27T03:58:31.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17841366820585188784', time=2024-08-27T05:24:51.497465+0000, chain.objs.size()=1 2024-08-27T03:58:31.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.lxPYtGIhUbsa_hJxYA8EdWD468tS_en_0 2024-08-27T03:58:31.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2166077517471383426', time=2024-08-27T05:24:52.197347+0000, chain.objs.size()=1 2024-08-27T03:58:31.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xoriqOSAw-nVpJm2qb4tSrixTfoCH1e_0 2024-08-27T03:58:31.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10051204015010902422', time=2024-08-27T05:24:52.336151+0000, chain.objs.size()=1 2024-08-27T03:58:31.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.acZZGzoDFoV_JkyCFwlQ4mBhDWr5uHt_0 2024-08-27T03:58:31.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11024525075058209233', time=2024-08-27T05:24:52.662143+0000, chain.objs.size()=1 2024-08-27T03:58:31.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.515+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.padMHM6KGj7I1V2Ipz0pAaYgs1aZGS4_0 2024-08-27T03:58:31.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16962937799003016614', time=2024-08-27T05:24:53.253229+0000, chain.objs.size()=1 2024-08-27T03:58:31.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0eg9SYVU8tz4V3B57rk8UlihNn2thy6_0 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14589548728960541981', time=2024-08-27T05:24:54.910982+0000, chain.objs.size()=1 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-qJ0jRyo-rOp-hYAr9MhyOVknBdvOAf_0 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17227137128207676753', time=2024-08-27T05:24:57.152062+0000, chain.objs.size()=1 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VmE20pnLJFnu7eOrm40kptf3ZR6z001_0 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12127205057623262727', time=2024-08-27T05:25:00.231549+0000, chain.objs.size()=1 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.IjPb-bd7CoQgqTHFE1fvWN_sDm0YtAO_0 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5120207054010021723', time=2024-08-27T05:25:00.571548+0000, chain.objs.size()=1 2024-08-27T03:58:31.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RiCV0Ar3OaBjKAIMGlHEpufMLMhpN88_0 2024-08-27T03:58:31.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9663975851589152594', time=2024-08-27T05:25:00.676486+0000, chain.objs.size()=1 2024-08-27T03:58:31.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.519+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.711wTyDPQZMQPQZLmcy7KHXzwwAvaT7_0 2024-08-27T03:58:31.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11600747634396066700', time=2024-08-27T05:25:02.115038+0000, chain.objs.size()=1 2024-08-27T03:58:31.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LQ8UBHUAYuQE-1tnf8a5rr7Iir7VGa5_0 2024-08-27T03:58:31.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7815119894042836635', time=2024-08-27T05:25:02.208749+0000, chain.objs.size()=1 2024-08-27T03:58:31.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2K41-4awRnUO3YWtMSb19PcFtwqTIZT_0 2024-08-27T03:58:31.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18416183151528828308', time=2024-08-27T05:25:02.586962+0000, chain.objs.size()=1 2024-08-27T03:58:31.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BvIPxxnuhe66czPHc64OL0oTqq5WbUd_0 2024-08-27T03:58:31.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16485097273459168433', time=2024-08-27T05:25:03.291290+0000, chain.objs.size()=1 2024-08-27T03:58:31.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VRH96iN94qyaWL0HIHNkFw0JNRE6hFp_0 2024-08-27T03:58:31.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14244536180986465149', time=2024-08-27T05:25:04.438643+0000, chain.objs.size()=1 2024-08-27T03:58:31.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PVDndMVzo0J17igolAGTKbrVvwjzT36_0 2024-08-27T03:58:31.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17253788948871319607', time=2024-08-27T05:25:05.826268+0000, chain.objs.size()=1 2024-08-27T03:58:31.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LUqe3bfoqWhSpJ0x_QHqoDkzffQKcos_0 2024-08-27T03:58:31.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17195173252570657432', time=2024-08-27T05:25:06.626637+0000, chain.objs.size()=1 2024-08-27T03:58:31.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PFrgkhWudhtLy37CA7DwCxSaOyUVy59_0 2024-08-27T03:58:31.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14895971490514524036', time=2024-08-27T05:25:07.552815+0000, chain.objs.size()=1 2024-08-27T03:58:31.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._Pj2CGkDEVjmD7Yj5TmcLhmi2ZaZR4k_0 2024-08-27T03:58:31.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13694435550870423273', time=2024-08-27T05:25:10.041403+0000, chain.objs.size()=1 2024-08-27T03:58:31.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.biT12pLjMpQIVhcRyxvfr5tKnaJlY43_0 2024-08-27T03:58:31.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16507579601733034329', time=2024-08-27T05:25:13.115769+0000, chain.objs.size()=1 2024-08-27T03:58:31.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6P2HjyfxxTH3iHlN7MvQt1JOFnTpn_Y_0 2024-08-27T03:58:31.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5878412695164562857', time=2024-08-27T05:25:13.268270+0000, chain.objs.size()=1 2024-08-27T03:58:31.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dvQPGrTSwXw2lhTxGT6nRPK1bOD8zsf_0 2024-08-27T03:58:31.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15656917655782327368', time=2024-08-27T05:26:58.146499+0000, chain.objs.size()=1 2024-08-27T03:58:31.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.523+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mU3kyE04Gu4j9kyPg7MytBb1z61dzzm_0 2024-08-27T03:58:31.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3921150133054003636', time=2024-08-27T05:26:58.917054+0000, chain.objs.size()=1 2024-08-27T03:58:31.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uqq5CsgXwLCTthpMMj7jjM0WfEXN5Ve_0 2024-08-27T03:58:31.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13776866859691265430', time=2024-08-27T05:26:59.106265+0000, chain.objs.size()=1 2024-08-27T03:58:31.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2KRg9N2W1furf41jnLPqHcyzjrvZUuJ_0 2024-08-27T03:58:31.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13061093173180049318', time=2024-08-27T05:26:59.787182+0000, chain.objs.size()=1 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.pRv6_ezj0FuJ6hPb7_-JkcRleXfTN5b_0 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12658619803108990063', time=2024-08-27T05:27:01.684370+0000, chain.objs.size()=1 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KUsNEwa4f8UKqlxc_7yRVqEqZYm1Zoy_0 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3829033406061986146', time=2024-08-27T05:27:02.267119+0000, chain.objs.size()=1 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4KVvatSDiUQxYx6TyI4bPXadLXLB9eB_0 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4070511252752315691', time=2024-08-27T05:27:02.696325+0000, chain.objs.size()=1 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.XFtED9jv4IA99B3MBgirdy3OVDaNFpp_0 2024-08-27T03:58:31.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13825891900573258609', time=2024-08-27T05:27:03.505014+0000, chain.objs.size()=1 2024-08-27T03:58:31.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hm_rn2BQ8iqRBmAGV9AqKHJR2V2LhRp_0 2024-08-27T03:58:31.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8292915805264773741', time=2024-08-27T05:27:04.236583+0000, chain.objs.size()=1 2024-08-27T03:58:31.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p7kCAwZZryPKvptNic7C6uWmUQ76YHd_0 2024-08-27T03:58:31.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13154490272154719427', time=2024-08-27T05:27:06.730311+0000, chain.objs.size()=1 2024-08-27T03:58:31.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.527+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9l1AUAKT99gUiruvjn9SqodwvJSNJEf_0 2024-08-27T03:58:31.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9536520123430472108', time=2024-08-27T05:27:06.934494+0000, chain.objs.size()=1 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hZpm27NSantKdJz6ONQE3eQKfZWS60S_0 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3101477421807155175', time=2024-08-27T05:27:07.698977+0000, chain.objs.size()=1 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.XRbG6bmbw-p-Mr939HfBD5Zgcr7JG02_0 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10884971974331917475', time=2024-08-27T05:27:09.168770+0000, chain.objs.size()=1 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.BugJURdobyy70VwP4DPhWaz5Dt0Ioys_0 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17983554595127397564', time=2024-08-27T05:27:10.500973+0000, chain.objs.size()=1 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.C1E0hOKz5JVLw31G-QczLZhvjPIP0XY_0 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16468506715758499513', time=2024-08-27T05:27:10.502625+0000, chain.objs.size()=1 2024-08-27T03:58:31.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.531+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZqB7cug9bvJmxYpo-9vIg9YIdPF78oR_0 2024-08-27T03:58:31.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.539+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/59324 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13237019610076256934', time=2024-08-27T05:27:11.269129+0000, chain.objs.size()=1 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.mvyoI_q2aVY8dMEaX2Gk04GVnSntFWo_0 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7011366863502606735', time=2024-08-27T05:27:11.588041+0000, chain.objs.size()=1 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9ABSEZ-uj7QxphJ9PlASswK2zEu5vcm_0 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13213779446072480544', time=2024-08-27T05:27:13.380985+0000, chain.objs.size()=1 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ndih6QIJNRd-2-SNbzwpRYcpkhzpTop_0 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14428624143962293026', time=2024-08-27T05:27:14.938079+0000, chain.objs.size()=1 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DhAqIfeAZ3_qQpYkcQGp356HKON1hAh_0 2024-08-27T03:58:31.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6571414237478278458', time=2024-08-27T05:27:16.804340+0000, chain.objs.size()=1 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.WxMBxa4lSJax-uNC5a2fo9ZNmLgh03K_0 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13308155785926281800', time=2024-08-27T05:27:17.294997+0000, chain.objs.size()=1 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.F5A9bUuChJxMkIBsgpK6F42T7xLtzNe_0 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12072355368442248346', time=2024-08-27T05:27:18.428171+0000, chain.objs.size()=1 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FZM-Eo-wOAxyRDS6qXIQX-IshKGQaee_0 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5160377160243574600', time=2024-08-27T05:27:19.966339+0000, chain.objs.size()=1 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.kERNpIVAFO1P8dULoTlS-iJbGMC5yqu_0 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17559350174045999445', time=2024-08-27T05:27:20.047313+0000, chain.objs.size()=1 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Y3XJ3D-DJ5uO4eOM4Bg0vo_68YhvXSU_0 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9667175507004298898', time=2024-08-27T05:27:20.049410+0000, chain.objs.size()=1 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4_LbccXxlTsq4OLK2lSQfOCyGCmwjhd_0 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3262431586476643752', time=2024-08-27T05:27:21.356773+0000, chain.objs.size()=1 2024-08-27T03:58:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.huHmWnEB30VWHEcMNVFWBecj55jYyMp_0 2024-08-27T03:58:31.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7485627407006047794', time=2024-08-27T05:27:21.918642+0000, chain.objs.size()=1 2024-08-27T03:58:31.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.543+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QsNvaxsQemiwuicdx0j2GATFB2FkasQ_0 2024-08-27T03:58:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11114557356505393261', time=2024-08-27T05:27:22.302242+0000, chain.objs.size()=1 2024-08-27T03:58:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.elOreGPkvZ2VBCktB0O_R1q7QOxrqMS_0 2024-08-27T03:58:31.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17482633589418490779', time=2024-08-27T05:27:22.724848+0000, chain.objs.size()=1 2024-08-27T03:58:31.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TAB67UJGeKlspu-Q8FfVbpQKBVqe-wS_0 2024-08-27T03:58:31.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12285758795678763875', time=2024-08-27T05:27:23.728703+0000, chain.objs.size()=1 2024-08-27T03:58:31.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.lKTgb71Gjofc2u1yYuggAa84zuCNMBE_0 2024-08-27T03:58:31.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.197685398969950927', time=2024-08-27T05:27:24.822071+0000, chain.objs.size()=1 2024-08-27T03:58:31.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CHWkve4ACRXQMGPBls_F4fW1ekdm5IS_0 2024-08-27T03:58:31.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13260747538005440473', time=2024-08-27T05:27:24.946458+0000, chain.objs.size()=1 2024-08-27T03:58:31.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QD_xXcUOBySyJTbPTxmMbMG8C3SbZXB_0 2024-08-27T03:58:31.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7741918301649492340', time=2024-08-27T05:27:26.030092+0000, chain.objs.size()=1 2024-08-27T03:58:31.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.YMkat5Ukd6MeQ2E-JAuHikxNyTp4-YD_0 2024-08-27T03:58:31.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11004745633804666257', time=2024-08-27T05:27:30.337630+0000, chain.objs.size()=1 2024-08-27T03:58:31.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.321__shadow_.HBpgB_wfl2MJNJJs9SlnXzGwLQM_xCD_0 2024-08-27T03:58:31.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5317713057234613583', time=2024-08-27T05:28:36.175877+0000, chain.objs.size()=1 2024-08-27T03:58:31.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.368__shadow_.37wLz86YBswN96JSLobtANUQCbjGzzu_0 2024-08-27T03:58:31.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12630782381805185933', time=2024-08-27T05:28:42.548193+0000, chain.objs.size()=1 2024-08-27T03:58:31.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.372__shadow_.wJupuOLUMLQWbaeXAKuuv1KFJBlEv2M_0 2024-08-27T03:58:31.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5109250272620594106', time=2024-08-27T05:30:34.281666+0000, chain.objs.size()=1 2024-08-27T03:58:31.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.444__shadow_.BGle1pAcHAjtlef6dVJBXt4JnYem2aA_0 2024-08-27T03:58:31.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6144232313461112332', time=2024-08-27T05:30:35.827741+0000, chain.objs.size()=1 2024-08-27T03:58:31.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.547+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.445__shadow_.KMz8Jyum_1kwKNrL2LsR9EIYRj9dcvN_0 2024-08-27T03:58:31.557 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12707152656214626107', time=2024-08-27T05:31:59.921717+0000, chain.objs.size()=1 2024-08-27T03:58:31.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.494__shadow_.arB3ne_p3Nw5RY8WloDsmB9GVf5hfir_0 2024-08-27T03:58:31.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2166289226656041978', time=2024-08-27T05:35:10.525256+0000, chain.objs.size()=1 2024-08-27T03:58:31.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.519__multipart_mymultipart.2~kqzfOcLO6aBVrE5HzOXeqea-zdL_RL-.1 2024-08-27T03:58:31.558 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.551+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17222217017837011834', time=2024-08-27T05:37:16.857982+0000, chain.objs.size()=1 2024-08-27T03:58:31.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.551+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.551__shadow_._PIm_QLcPkKV3UacKYpXiiz_1lu99t0_0 2024-08-27T03:58:31.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12596544331105811053', time=2024-08-27T05:38:26.188287+0000, chain.objs.size()=1 2024-08-27T03:58:31.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:EcoOYKD2P5nrmzIjiVcjd1RhX4xXm9T_.UWuUiyXoYEMkeabMO0laiHHWM4QVcX1_0 2024-08-27T03:58:31.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7673861430994209946', time=2024-08-27T05:39:16.040215+0000, chain.objs.size()=1 2024-08-27T03:58:31.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:7aNTnMl2R09KnIHkcKvPbJJQ62rT6in_.us3z-NhUk9D8_KfWcgU9Iq730Cj5ElF_0 2024-08-27T03:58:31.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16213282589817649488', time=2024-08-27T05:39:55.770300+0000, chain.objs.size()=1 2024-08-27T03:58:31.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:Ta3mOzgVA75q1vdGltZSnkWfx9JWhJo_.fKsscXONKF11HhOI4mFSBBkkavtzVvl_0 2024-08-27T03:58:31.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10503258920641377076', time=2024-08-27T05:39:55.895199+0000, chain.objs.size()=1 2024-08-27T03:58:31.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:JqI3iL1gaPMcHzFDmQhznXVq2X2T1fz_.v62aS5d4bcvicglrV_sqHZvwVrRyF_z_0 2024-08-27T03:58:31.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1784888640723931244', time=2024-08-27T05:47:28.316130+0000, chain.objs.size()=1 2024-08-27T03:58:31.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.684__shadow:jNye2P3UUo8htPaoJiTg-1FTAST3JLH_.gig1wTRUcF1VoHo3DTrnjdD9OwGZ_VN_0 2024-08-27T03:58:31.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12655522639300480443', time=2024-08-27T05:47:44.041095+0000, chain.objs.size()=1 2024-08-27T03:58:31.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.555+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.693__shadow:2UttGA1DZxPYKl0A4cmFgrm66dSfqfm_.O6pWXo2C4WOkOweXfiOJUmcqQiFHlHZ_0 2024-08-27T03:58:31.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.559+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-08-27T03:58:31.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.567 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/66592' 2024-08-27T03:58:31.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_bHYGr-u3ynBKYtgPU-BAuSLmiIh35oh', time=2024-08-27T05:13:40.574583+0000, chain.objs.size()=2 2024-08-27T03:58:31.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.pcaU9id-Abcyl8xHAE3YZ6HJPIJhdD9_0 2024-08-27T03:58:31.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.pcaU9id-Abcyl8xHAE3YZ6HJPIJhdD9_1 2024-08-27T03:58:31.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17540470475352318009', time=2024-08-27T05:18:34.833840+0000, chain.objs.size()=1 2024-08-27T03:58:31.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.245__shadow_.chsHVh773aUSlqKr2iwf3feBjmuwp8q_0 2024-08-27T03:58:31.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12845628916461198774', time=2024-08-27T05:18:52.987151+0000, chain.objs.size()=1 2024-08-27T03:58:31.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.255__shadow_.3FAATbZZjrpqIgACAgadbGC8x-yiJKW_0 2024-08-27T03:58:31.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10835666892948334931', time=2024-08-27T05:20:35.584028+0000, chain.objs.size()=1 2024-08-27T03:58:31.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.026UtSMCJtL9LmZwyB6pRgo39izhKEB_0 2024-08-27T03:58:31.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16284351909683571558', time=2024-08-27T05:20:36.779213+0000, chain.objs.size()=1 2024-08-27T03:58:31.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.RTakXJb0g5LLw9rrBjoSJhV5uUi204o_0 2024-08-27T03:58:31.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11969142236023850538', time=2024-08-27T05:20:40.566111+0000, chain.objs.size()=1 2024-08-27T03:58:31.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.g64hgaCvqGRGzfzzJs3WD-zMrSUw-Q7_0 2024-08-27T03:58:31.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.686268232885468356', time=2024-08-27T05:20:40.906965+0000, chain.objs.size()=1 2024-08-27T03:58:31.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dYOknuNzyIWd47fzddHxkK7_PCSagHo_0 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17387268377146026671', time=2024-08-27T05:20:41.009807+0000, chain.objs.size()=1 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.K4tKong9hRNGCzTVUR4VJGC0cIrmsal_0 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8567003772755960250', time=2024-08-27T05:20:41.647262+0000, chain.objs.size()=1 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2hyHGAkHaKfplD-zrNQeClKr2MBkIiC_0 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4225399712196933816', time=2024-08-27T05:20:42.143145+0000, chain.objs.size()=1 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.1r9uAq1t96ZYwIfor7bLCf_Qbinf-wo_0 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11899470024117722520', time=2024-08-27T05:20:42.218240+0000, chain.objs.size()=1 2024-08-27T03:58:31.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.563+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.HE-s0Opon5ldVoTz9pF2bOq4f2zHS2E_0 2024-08-27T03:58:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18238244364973012152', time=2024-08-27T05:20:43.934182+0000, chain.objs.size()=1 2024-08-27T03:58:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0vZiOi6ZoORI_LVx4P3w6ILWZdJUoPl_0 2024-08-27T03:58:31.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10553392009479672342', time=2024-08-27T05:20:44.074068+0000, chain.objs.size()=1 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.4ZSc4ES8VrsOEAaolNg5ZsmawecPB9j_0 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10017369522596688914', time=2024-08-27T05:20:44.147136+0000, chain.objs.size()=1 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.svXdRqodpZsSsw8SP6hLrdsFGfsXmRV_0 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8986114324910040314', time=2024-08-27T05:20:47.968053+0000, chain.objs.size()=1 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.F6j0PLFyZomi-EuICnOzknhsyCOQ7Ic_0 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14149847785694321204', time=2024-08-27T05:20:48.067374+0000, chain.objs.size()=1 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9sMplC4sreUnMdv5-xbNam9jC7eL9jl_0 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6141506076668363943', time=2024-08-27T05:20:48.724086+0000, chain.objs.size()=1 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.65kFxWpZbl6Jv93W3t99DYYdsv-8gA8_0 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12499930980832493856', time=2024-08-27T05:20:48.838681+0000, chain.objs.size()=1 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.567+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.x9fwQ1vFWYfbzuLla2Bkc-NgJWR0zH4_0 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13607743495923038023', time=2024-08-27T05:20:49.012436+0000, chain.objs.size()=1 2024-08-27T03:58:31.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.FrymuA2ISYh9qah607vK7eD6t34FJ0s_0 2024-08-27T03:58:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2216129714262598282', time=2024-08-27T05:20:51.070298+0000, chain.objs.size()=1 2024-08-27T03:58:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.AQqyT4DNh5D0Hxc5cYFA-LbPLIXSY8R_0 2024-08-27T03:58:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6600402663189946034', time=2024-08-27T05:20:53.070946+0000, chain.objs.size()=1 2024-08-27T03:58:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.B-ISm6crVFSE9dL2betKVisbr7_lgl3_0 2024-08-27T03:58:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15576916561554273009', time=2024-08-27T05:20:53.266805+0000, chain.objs.size()=1 2024-08-27T03:58:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Ifzqnhl81dA3-sY4OxqZYvss8-AAJxN_0 2024-08-27T03:58:31.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2070022278943329558', time=2024-08-27T05:20:53.341302+0000, chain.objs.size()=1 2024-08-27T03:58:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.571+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OW34Zxe_lZ1Fh2GcQRQcw3-GD-PytUI_0 2024-08-27T03:58:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15393353933024294322', time=2024-08-27T05:20:53.536179+0000, chain.objs.size()=1 2024-08-27T03:58:31.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.d1Zq7zQ72a1PzqIdYtg3Ol8JnvqBMHi_0 2024-08-27T03:58:31.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15303164789554004556', time=2024-08-27T05:20:55.931547+0000, chain.objs.size()=1 2024-08-27T03:58:31.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fdom1IXbCZRoY70lK9y3FNcC0FOVh3v_0 2024-08-27T03:58:31.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5858494860391809943', time=2024-08-27T05:20:56.067510+0000, chain.objs.size()=1 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eoqS9Ki1-auugB1Vz6lmlNJCuRoVpGl_0 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11435697138382217163', time=2024-08-27T05:20:57.023322+0000, chain.objs.size()=1 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ms7EY1mepwRWfN_isuCa6F83Br00vm2_0 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3292163607842734785', time=2024-08-27T05:20:57.179031+0000, chain.objs.size()=1 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.R9Z0n_FoX9FofBZIitE7i4zwZ1Ul13F_0 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18311679109343038204', time=2024-08-27T05:20:58.463087+0000, chain.objs.size()=1 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.1AKhVoxho8ioVhU-V8UTGH9ZePrbtrN_0 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2671343131347023407', time=2024-08-27T05:21:01.697549+0000, chain.objs.size()=1 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eZDNbpzoqMwdVevZ-ijf1IIonW75SqN_0 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2607215202965758823', time=2024-08-27T05:21:01.930457+0000, chain.objs.size()=1 2024-08-27T03:58:31.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.UwE5qMBoOxzk3E-MWMFTSkPIACplcAL_0 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2998879657791098582', time=2024-08-27T05:21:02.984402+0000, chain.objs.size()=1 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5XMe67PNMrmPy0bhLYyif9uRJBTU7Cr_0 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4006498801912927082', time=2024-08-27T05:21:03.710828+0000, chain.objs.size()=1 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.weiW8bhrGL8GAkCZCJqb5gG8HkXB1HV_0 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.575+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.352730342477578256', time=2024-08-27T05:21:03.826883+0000, chain.objs.size()=1 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PrkKlgdyF4BSIan6kI7whzamPDe4lhd_0 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4194665063671795272', time=2024-08-27T05:21:04.188960+0000, chain.objs.size()=1 2024-08-27T03:58:31.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.z_sVkR1lhxHjfdviMdlrWJcv7_Hwzc5_0 2024-08-27T03:58:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.579+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5398790008387179559', time=2024-08-27T05:21:21.530354+0000, chain.objs.size()=1 2024-08-27T03:58:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.579+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.266__shadow_.FhXuyG15UYMh5ERfZbEEom4wgA62mNP_0 2024-08-27T03:58:31.584 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.941657727098701646', time=2024-08-27T05:21:39.737675+0000, chain.objs.size()=1 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.276__shadow_.YQNs1XaXs-gbbouhLd4XeWjDgylFc5W_0 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6051729599032656722', time=2024-08-27T05:22:27.061177+0000, chain.objs.size()=1 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.297__shadow_.uPhVVxPjh73bCN6Y43G9jM9-Jr_HhNv_0 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7454931830104167938', time=2024-08-27T05:22:57.770715+0000, chain.objs.size()=1 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.313__shadow:vfhPJ3X5RzHlEXfoZphTExg8BWUVaiJ_.kTgyr4UH1MGAo5y6QxR8Ol5_OIZYX8M_0 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16065215717102416885', time=2024-08-27T05:23:01.001557+0000, chain.objs.size()=1 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.315__shadow_.-l9BfjAX8IBRX6VNw21eWt5XWKr8iJa_0 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17672179044688374095', time=2024-08-27T05:24:46.521412+0000, chain.objs.size()=1 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DUfavfFvz8kwbva_KdoPakG8ELlmAxm_0 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4171175948530487598', time=2024-08-27T05:24:46.822797+0000, chain.objs.size()=1 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5l-dwRU8nKmz2m2M4EcI-IQ8qxh6UrK_0 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5412089639755966028', time=2024-08-27T05:24:50.872250+0000, chain.objs.size()=1 2024-08-27T03:58:31.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0UsoBAFZQ29MNiwALg-82YbLZrgFV2M_0 2024-08-27T03:58:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12663964124276672855', time=2024-08-27T05:24:51.602701+0000, chain.objs.size()=1 2024-08-27T03:58:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.c10iGHvc-ThxMUxC5Rka0CzauEXEOIj_0 2024-08-27T03:58:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1485289091557194438', time=2024-08-27T05:24:51.604001+0000, chain.objs.size()=1 2024-08-27T03:58:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5ONWRCYhRzOnbdJ3t3zr1DjN5qXRdhb_0 2024-08-27T03:58:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16039039116814052013', time=2024-08-27T05:24:51.804412+0000, chain.objs.size()=1 2024-08-27T03:58:31.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.583+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YbRNw7K2smArVhD535ApTdsPbzn6RUm_0 2024-08-27T03:58:31.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17560851221027735503', time=2024-08-27T05:24:52.201898+0000, chain.objs.size()=1 2024-08-27T03:58:31.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.A5J9gkHNGdM4VXeP6zDbqYXSWgZl_UW_0 2024-08-27T03:58:31.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6894888921435267853', time=2024-08-27T05:24:54.357457+0000, chain.objs.size()=1 2024-08-27T03:58:31.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mFrVcASV73EWlH2FKLId6Jy5GYk5yvJ_0 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3752360905323776664', time=2024-08-27T05:24:55.189841+0000, chain.objs.size()=1 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cUMckkMFlsco4xl1_1Mzk2UNf5aqJ0q_0 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3613643472186313479', time=2024-08-27T05:24:55.751432+0000, chain.objs.size()=1 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BLPSvpHdnSwlr93npzBekQFeBriIz0N_0 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15899653705808150019', time=2024-08-27T05:24:56.443064+0000, chain.objs.size()=1 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.IGIp8Nsm_ZCaNC1uIwnbKvpPwBrRnPu_0 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.611734732793583542', time=2024-08-27T05:24:58.160970+0000, chain.objs.size()=1 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.aTr_1IhsyEgZND72qUTSFfs1AOqSuKO_0 2024-08-27T03:58:31.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1789442486302318395', time=2024-08-27T05:24:58.163174+0000, chain.objs.size()=1 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.COC6dI8Gw5Lql9mHQ8XrXx5DL05xGzy_0 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2269595854801678853', time=2024-08-27T05:24:58.550675+0000, chain.objs.size()=1 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Yps4QyCVo74GKG5IsnJoV662eIrDAxZ_0 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11830051575897640959', time=2024-08-27T05:24:59.911725+0000, chain.objs.size()=1 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.H9MsFttD09wHV7bUg8Ac5faWc7pMc4-_0 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.46609382047275815', time=2024-08-27T05:25:01.600377+0000, chain.objs.size()=1 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5eYdGeLqdQZkdpm7dhVWvVKxAkHa0wx_0 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.669286628237277242', time=2024-08-27T05:25:02.876582+0000, chain.objs.size()=1 2024-08-27T03:58:31.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.587+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.GUDbrBN1sN80F3GEiCA_2mtex8tGoAc_0 2024-08-27T03:58:31.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17049459458379441320', time=2024-08-27T05:25:04.052791+0000, chain.objs.size()=1 2024-08-27T03:58:31.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7L_IhNHlDqEtdRJPEVx_1TVmIW7unIs_0 2024-08-27T03:58:31.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15967405446714050649', time=2024-08-27T05:25:05.405340+0000, chain.objs.size()=1 2024-08-27T03:58:31.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.37Zvl4OBY7Cd50tzggyIr0AoSnz6CAJ_0 2024-08-27T03:58:31.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16088364277326870107', time=2024-08-27T05:25:05.406737+0000, chain.objs.size()=1 2024-08-27T03:58:31.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.McjIz6LEWEbiBUwjI81BiWFVdQX-y8c_0 2024-08-27T03:58:31.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4746637594770302229', time=2024-08-27T05:25:05.667573+0000, chain.objs.size()=1 2024-08-27T03:58:31.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.591+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.UD1Zs6K6k6VOrgMjmMVLYS7Oo9hfWVR_0 2024-08-27T03:58:31.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18103859945647336416', time=2024-08-27T05:25:06.179358+0000, chain.objs.size()=1 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.J1bpszkWEEJq96SixwP7KF0ijLaoHo1_0 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8145776861052831497', time=2024-08-27T05:25:06.352266+0000, chain.objs.size()=1 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.DMd7TInB5nWsHcjA86ZXuNDmQH7OV-T_0 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.504975602529464143', time=2024-08-27T05:25:06.451113+0000, chain.objs.size()=1 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vM1pii8_Mrj8dj9c5SYbTBUN6OhevoZ_0 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5983341779230029339', time=2024-08-27T05:25:06.768367+0000, chain.objs.size()=1 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.f47wAve7GBTBDYBGtaJ4wmQQXQ4iEl8_0 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11020616866901048332', time=2024-08-27T05:25:08.089556+0000, chain.objs.size()=1 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PzPEiEMNwiBVyU5HubM_ksuA6GHBcz1_0 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1382638398097455948', time=2024-08-27T05:25:08.700488+0000, chain.objs.size()=1 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6NyyyW8Pbg25KozWkcmPrah4SnGMGy3_0 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10710279624341098969', time=2024-08-27T05:25:08.702446+0000, chain.objs.size()=1 2024-08-27T03:58:31.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.D2GKqiwjOBKldqj-Dd2uc-SdDKHMSND_0 2024-08-27T03:58:31.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1965254603159411009', time=2024-08-27T05:25:08.761407+0000, chain.objs.size()=1 2024-08-27T03:58:31.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cWbGh0D_h-a4zpXRX1bQEpPn0nVkU3J_0 2024-08-27T03:58:31.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13991032271628583456', time=2024-08-27T05:25:09.153985+0000, chain.objs.size()=1 2024-08-27T03:58:31.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.f3S_TxmrImsa2h4SvDXdgyEuvmsaApc_0 2024-08-27T03:58:31.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18081414096963665631', time=2024-08-27T05:25:12.699770+0000, chain.objs.size()=1 2024-08-27T03:58:31.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.595+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.P9whyoywBJ2jB7N4-2DzPQWmPSi5gnv_0 2024-08-27T03:58:31.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5231765624446834712', time=2024-08-27T05:25:14.240257+0000, chain.objs.size()=1 2024-08-27T03:58:31.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.goL2xDzJyrwSScO8TyspvPZYXDy5J_X_0 2024-08-27T03:58:31.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17251834878079004581', time=2024-08-27T05:26:59.370659+0000, chain.objs.size()=1 2024-08-27T03:58:31.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.e4C0T0taXuIOigIQTMU-BrKKadCOUXb_0 2024-08-27T03:58:31.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2428492960999627883', time=2024-08-27T05:27:00.414485+0000, chain.objs.size()=1 2024-08-27T03:58:31.603 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.EWt1nBr-Ry5_HKTybOltJ0s4pAobvJv_0 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11220516068253119629', time=2024-08-27T05:27:04.196776+0000, chain.objs.size()=1 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.5HdR4VZkTxHPbnmpkt3RpDqSa2zZVNP_0 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4110522349462326636', time=2024-08-27T05:27:04.470833+0000, chain.objs.size()=1 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.eI_VvAT37W-z6Ox9Q-lghaICTTlfEUO_0 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11066293005381412613', time=2024-08-27T05:27:06.148684+0000, chain.objs.size()=1 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.xaJJbkpI0vmsqTIfaztyriXwWBri54E_0 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6597621538433119418', time=2024-08-27T05:27:07.134433+0000, chain.objs.size()=1 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3ELHwDcGjPt3rMFASFbTpedDY8TpRmu_0 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6116678506099634553', time=2024-08-27T05:27:07.238903+0000, chain.objs.size()=1 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.M65ldUU2xAcXflLX5Z8tCnuU_nGg4JY_0 2024-08-27T03:58:31.604 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15623408597734278739', time=2024-08-27T05:27:07.497206+0000, chain.objs.size()=1 2024-08-27T03:58:31.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OWRC1ceIc8nYpB3V623zQIlb79QiLK6_0 2024-08-27T03:58:31.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15363196463900941294', time=2024-08-27T05:27:07.613012+0000, chain.objs.size()=1 2024-08-27T03:58:31.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VIu5gJAI9F3W6EOBMWqFwxi9Cv12xM6_0 2024-08-27T03:58:31.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7665969482793988840', time=2024-08-27T05:27:08.195606+0000, chain.objs.size()=1 2024-08-27T03:58:31.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.599+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.dCzhp2_xcHWA18sOGjjPjf8g7YdpQM2_0 2024-08-27T03:58:31.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5520476571068559357', time=2024-08-27T05:27:09.596497+0000, chain.objs.size()=1 2024-08-27T03:58:31.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.m49XlIcYRjWaR0ryCXrpQiqU5u54bh8_0 2024-08-27T03:58:31.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.603+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10929355592419549710', time=2024-08-27T05:27:09.768953+0000, chain.objs.size()=1 2024-08-27T03:58:31.607 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.603+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.CJDhB0J6iKxk1Yr1z20eXpj4orMvSqf_0 2024-08-27T03:58:31.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6279963587088464661', time=2024-08-27T05:27:10.418644+0000, chain.objs.size()=1 2024-08-27T03:58:31.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vx3vLBjvaYv8bF80PbafCbcjZ3zKuiq_0 2024-08-27T03:58:31.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17216100182773822293', time=2024-08-27T05:27:10.764605+0000, chain.objs.size()=1 2024-08-27T03:58:31.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.piClZGk-GdkPtgvzr8-4GtBCAhaaefc_0 2024-08-27T03:58:31.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1812620658410501228', time=2024-08-27T05:27:11.470009+0000, chain.objs.size()=1 2024-08-27T03:58:31.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4belZ4XLj87YdGq0izII-_iiZBq827T_0 2024-08-27T03:58:31.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13945736178450920650', time=2024-08-27T05:27:11.586406+0000, chain.objs.size()=1 2024-08-27T03:58:31.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DPLfzAo6w9z3BRnPIS4l8u8sRMkDDl7_0 2024-08-27T03:58:31.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1156466154359176002', time=2024-08-27T05:27:11.642988+0000, chain.objs.size()=1 2024-08-27T03:58:31.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LnrfuTZ4tqZtkUlP0pznUoiJMluBhBJ_0 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2578235010770828049', time=2024-08-27T05:27:14.608207+0000, chain.objs.size()=1 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KuL2bCigVhvF-y4-DHFHrtSfwkgwUM3_0 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6012626388204208287', time=2024-08-27T05:27:14.748556+0000, chain.objs.size()=1 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Y2vA8OzV5lQ5CMutXcooM34yMYtWuUV_0 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3395656492997661256', time=2024-08-27T05:27:14.750453+0000, chain.objs.size()=1 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.sK7YbPji6Mk5ungJoX2xDqERt1d8Uwd_0 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15384219361604349819', time=2024-08-27T05:27:16.440562+0000, chain.objs.size()=1 2024-08-27T03:58:31.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.607+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zYiasN5X8-v3LiGgzetqRpPylKslg74_0 2024-08-27T03:58:31.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8638544604263877971', time=2024-08-27T05:27:16.854055+0000, chain.objs.size()=1 2024-08-27T03:58:31.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HaI4_MUqnyCkdkcII-uFc91Ry3KpasY_0 2024-08-27T03:58:31.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15950797605929719179', time=2024-08-27T05:27:17.491587+0000, chain.objs.size()=1 2024-08-27T03:58:31.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DUpbwzGhMCODfVq-8RYlz2_ZAStffy7_0 2024-08-27T03:58:31.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3497151652971064117', time=2024-08-27T05:27:18.055053+0000, chain.objs.size()=1 2024-08-27T03:58:31.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gekFc9lfuQBZbO0-Kn_uD9q0Q1EiRFh_0 2024-08-27T03:58:31.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5887419857530114517', time=2024-08-27T05:27:18.852875+0000, chain.objs.size()=1 2024-08-27T03:58:31.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cJmFGxUEn_mdi-5f5bQwGDrg65BKd--_0 2024-08-27T03:58:31.614 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7393324025717156903', time=2024-08-27T05:27:18.855711+0000, chain.objs.size()=1 2024-08-27T03:58:31.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.asC7yUJCGCBeqpL7rPcaD1Ln1HtKkgJ_0 2024-08-27T03:58:31.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3865251658339188156', time=2024-08-27T05:27:20.744968+0000, chain.objs.size()=1 2024-08-27T03:58:31.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.WYwc12yvNV2npZL5OCVzB3OPpPVmizn_0 2024-08-27T03:58:31.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12600705426768816781', time=2024-08-27T05:27:20.947627+0000, chain.objs.size()=1 2024-08-27T03:58:31.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.611+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Uer9XyC2MJQdLF_a_EETU-Ul-d5LuW1_0 2024-08-27T03:58:31.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/66592 2024-08-27T03:58:31.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-08-27T03:58:31.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3318547502054843647', time=2024-08-27T05:27:22.907802+0000, chain.objs.size()=1 2024-08-27T03:58:31.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.01yjjJJfaBtQ9wMJ-WnDzr0vdxL4D5A_0 2024-08-27T03:58:31.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13342598673808882438', time=2024-08-27T05:27:24.386594+0000, chain.objs.size()=1 2024-08-27T03:58:31.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.9nuXrsPBGU4sez8awrdYm2T0upekyIz_0 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10484793908580187652', time=2024-08-27T05:27:25.457706+0000, chain.objs.size()=1 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.io6r3Gd4ujzuoMrFkFpF4G8IwXROYXv_0 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10935185596584700694', time=2024-08-27T05:27:39.279965+0000, chain.objs.size()=1 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.327__shadow_.-ePLiNTVwrWonihrYHwq8Jwc3GMMuJG_0 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8235964451880293744', time=2024-08-27T05:28:32.114376+0000, chain.objs.size()=1 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.366__shadow_.yjhwILFKL9opsjoBhdSfEF8ZI6qGD0V_0 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13743473283480093682', time=2024-08-27T05:28:37.616403+0000, chain.objs.size()=1 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.369__shadow_.6r6k1KKiLePT1B1cM2jvbNbr0mNGUke_0 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6499068567898035432', time=2024-08-27T05:29:01.729124+0000, chain.objs.size()=1 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.384__shadow_.8V_WlCKpGQ7urzsD5_h_cJH2qsLH0Jc_0 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6265249921161330400', time=2024-08-27T05:30:12.921855+0000, chain.objs.size()=1 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.431__shadow_.gX95JwEG9UXLOgJsqIwvZO_D7BRpRRe_0 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1087563497092930499', time=2024-08-27T05:31:56.897356+0000, chain.objs.size()=1 2024-08-27T03:58:31.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.492__shadow_.B1QugGToai23lw1chl5Zm26LlYFW7vh_0 2024-08-27T03:58:31.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn', time=2024-08-27T05:34:18.278939+0000, chain.objs.size()=1 2024-08-27T03:58:31.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn.2 2024-08-27T03:58:31.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn', time=2024-08-27T05:34:18.289164+0000, chain.objs.size()=1 2024-08-27T03:58:31.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~dMReJZYWz8AM4xN2w2l8vTtDVbdfAfn.3 2024-08-27T03:58:31.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16754428729311733628', time=2024-08-27T05:34:18.341187+0000, chain.objs.size()=6 2024-08-27T03:58:31.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.619+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~-hg-l_vQZ8hV5h8NbipZgLCHnp-o9PO.1 2024-08-27T03:58:31.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~-hg-l_vQZ8hV5h8NbipZgLCHnp-o9PO.2 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.UKkMjZa_kGXuLH1GTrz3OX5M5NDy9maM.3 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~-hg-l_vQZ8hV5h8NbipZgLCHnp-o9PO.4 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~-hg-l_vQZ8hV5h8NbipZgLCHnp-o9PO.5 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~-hg-l_vQZ8hV5h8NbipZgLCHnp-o9PO.6 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14995168732660546164', time=2024-08-27T05:37:20.886938+0000, chain.objs.size()=1 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.552__shadow_.oh55liV-7ARdignYSyg6zT0oNR6A21p_0 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7402953997574119423', time=2024-08-27T05:37:54.910514+0000, chain.objs.size()=1 2024-08-27T03:58:31.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.623+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:cWRVpLv4uOyTUVWHLNLqg2a17tU4mgB_.b5SJbgAEfmYjko01fZB3oLkBTHCzaTL_0 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12955411452483269055', time=2024-08-27T05:38:20.696824+0000, chain.objs.size()=1 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.567__shadow_.xjd9_6jQXoJopIWLQzvKuKBs7t25LWa_0 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9744541418458828874', time=2024-08-27T05:38:24.113133+0000, chain.objs.size()=1 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow_.jWEX5WZXqxRXVnLcFkr9znrbZOHaS4O_0 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2414339732560730744', time=2024-08-27T05:39:04.274019+0000, chain.objs.size()=1 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:Qfw-N56wwJWMsLeceqDrq2j7qmpAzIh_.X0KGz3d1bmLPK09IHL9tajpjw_uaaI2_0 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5409438131683981133', time=2024-08-27T05:39:22.720277+0000, chain.objs.size()=1 2024-08-27T03:58:31.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:MKXGGBWibjKKXaUxxAJOHTJGwTJj85-_.TH69NhXVLJgNRWtQinIjs8EvEvntzkk_0 2024-08-27T03:58:31.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18202461763227724340', time=2024-08-27T05:39:56.022778+0000, chain.objs.size()=1 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:fkrjDBDmcD2E6B63-Es.Xbt2AyTPVgj_._Q5BNDh0vt8_orMncXoSCxLWcqc6sbO_0 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12820785398554105406', time=2024-08-27T05:40:01.312003+0000, chain.objs.size()=1 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:1triO.iW6CVZoeLCPBkNdmABxrH56dp_.bg3xwjMqcWgOWeFRLeLIvU93YXzXHUF_0 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17466551972145196041', time=2024-08-27T05:40:10.580780+0000, chain.objs.size()=1 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.579__shadow:CaIVqRQYqu6ZgdOu-lt8Ff71ew5Qjv4_.DhuAAii0bOlI6JjFz1TZsTcPqbvi7Wd_0 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1246954736702647082', time=2024-08-27T05:44:59.321579+0000, chain.objs.size()=6 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.617__multipart_multipart_enc.2~McRK2qc02ZXY4VkPzhZ6ypXmIppuTb0.1 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.617__multipart_multipart_enc.2~McRK2qc02ZXY4VkPzhZ6ypXmIppuTb0.2 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.617__multipart_multipart_enc.2~McRK2qc02ZXY4VkPzhZ6ypXmIppuTb0.3 2024-08-27T03:58:31.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.631+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.617__multipart_multipart_enc.2~McRK2qc02ZXY4VkPzhZ6ypXmIppuTb0.4 2024-08-27T03:58:31.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.635+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.617__multipart_multipart_enc.2~McRK2qc02ZXY4VkPzhZ6ypXmIppuTb0.5 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.635+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.617__multipart_multipart_enc.2~McRK2qc02ZXY4VkPzhZ6ypXmIppuTb0.6 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.635+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10774767196770744722', time=2024-08-27T05:45:20.165197+0000, chain.objs.size()=1 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.635+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.621__shadow_.sT3JBNRL8LyM-Acl_qSIbWMEYjDE7Vg_0 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.635+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14105891019829264032', time=2024-08-27T05:46:01.280672+0000, chain.objs.size()=1 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.635+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.642__shadow_.hsz33bfTuYOA5DcI9W8gpvWesa1FKRT_0 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16363013945036576908', time=2024-08-27T05:46:09.692472+0000, chain.objs.size()=1 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.646__shadow_.jNNr4f-AgyFWGW5W5tz3T7wVonkZlob_0 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5897689314219505442', time=2024-08-27T05:46:50.759433+0000, chain.objs.size()=1 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.658__shadow_.p6LK0NqvZbVfn48Q_2ksFjxqn0EQH30_0 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7867174089541493377', time=2024-08-27T05:46:56.594739+0000, chain.objs.size()=1 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.660__shadow_.1P9GJTfHkDEGYf6whrVK4dmZHkZicUp_0 2024-08-27T03:58:31.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16013010679024440970', time=2024-08-27T05:47:35.046152+0000, chain.objs.size()=1 2024-08-27T03:58:31.644 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.639+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.688__shadow:JT-tTDQc6a4hKEs2uFDh1YM9fKz2w4m_.bS_FHHt7Wd8Ik3lICODRm737PPpQ_sA_0 2024-08-27T03:58:31.646 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.643+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-08-27T03:58:31.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.650 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41157' 2024-08-27T03:58:31.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7124439202713839354', time=2024-08-27T05:13:26.464826+0000, chain.objs.size()=2 2024-08-27T03:58:31.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.4mlrXk1GJaBUTgFg3GRq_iNdXltk_nI_0 2024-08-27T03:58:31.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.154__shadow_.4mlrXk1GJaBUTgFg3GRq_iNdXltk_nI_1 2024-08-27T03:58:31.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17008586610540099664', time=2024-08-27T05:13:49.240161+0000, chain.objs.size()=2 2024-08-27T03:58:31.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.158__multipart_foo.2~nAZbTfAmoIGxYNaI_oFqTBQXbZcU5D6.1 2024-08-27T03:58:31.652 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.158__multipart_foo.2~nAZbTfAmoIGxYNaI_oFqTBQXbZcU5D6.2 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14743176036551545031', time=2024-08-27T05:18:21.895666+0000, chain.objs.size()=1 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.238__shadow_.mj7C82dpk7dwe1K6ylo7816Igf7ailQ_0 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13067830595071664058', time=2024-08-27T05:18:21.929475+0000, chain.objs.size()=1 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.238__shadow_.b30mH4mhl5qntJLj7nd3yTvZp2WsQGk_0 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11684715484086132099', time=2024-08-27T05:18:27.431195+0000, chain.objs.size()=1 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.241__shadow_.G0h5eeyyKBEak634Bz21czniKk7FKwR_0 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17109897467729608353', time=2024-08-27T05:20:35.305058+0000, chain.objs.size()=1 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.cql9-Osxw5t9ufOlI_e4R0Xb3jzErWz_0 2024-08-27T03:58:31.653 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4834319157796484419', time=2024-08-27T05:20:35.809170+0000, chain.objs.size()=1 2024-08-27T03:58:31.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QEVScmX1np6eRdIol2tejic7rHA_AHI_0 2024-08-27T03:58:31.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3016278199652256452', time=2024-08-27T05:20:37.115945+0000, chain.objs.size()=1 2024-08-27T03:58:31.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pJXi2cpuZiKlPIfUHf13si_VoOXB1wq_0 2024-08-27T03:58:31.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3484435128105313444', time=2024-08-27T05:20:39.598316+0000, chain.objs.size()=1 2024-08-27T03:58:31.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PvhZWUjyzG1nqOaK2DSXLX2CViwJooM_0 2024-08-27T03:58:31.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.635681903339031563', time=2024-08-27T05:20:40.038379+0000, chain.objs.size()=1 2024-08-27T03:58:31.654 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.647+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Gd3Jwlo7RL9XL7zkhSlY-8Oz2VwfNaA_0 2024-08-27T03:58:31.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7704287475114233772', time=2024-08-27T05:20:40.215134+0000, chain.objs.size()=1 2024-08-27T03:58:31.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.JJfGMdySkuF191B96XQnXWNSDDAnpmb_0 2024-08-27T03:58:31.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5155973981149486282', time=2024-08-27T05:20:43.218413+0000, chain.objs.size()=1 2024-08-27T03:58:31.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._itobXUBIOHm6uNrv3LbLZvxNuzoGZD_0 2024-08-27T03:58:31.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8874328342765222825', time=2024-08-27T05:20:43.496654+0000, chain.objs.size()=1 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hE1cTSkPCggPRTxisrc8WUaODmxyEIR_0 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14656210237573898612', time=2024-08-27T05:20:43.663997+0000, chain.objs.size()=1 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.D5PK-1UjcnD6RtgTSWESIQM-A7XiMB-_0 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16409434920426609674', time=2024-08-27T05:20:47.063654+0000, chain.objs.size()=1 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PdW9WhCFnFjHKnF1vxhy4oDmbD8Rp61_0 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5876145782948739344', time=2024-08-27T05:20:48.565655+0000, chain.objs.size()=1 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5dknObnKHVPv1GIGi2yqoTTFWmMbe5t_0 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5668777486973161712', time=2024-08-27T05:20:49.904486+0000, chain.objs.size()=1 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NSuvYGLDAOclZXzlveICTKqF7vvZ2Pu_0 2024-08-27T03:58:31.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2649612080336684543', time=2024-08-27T05:20:50.946548+0000, chain.objs.size()=1 2024-08-27T03:58:31.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.8dQhFBjMK-PZyBVWZDa_Y9YIGCRelDu_0 2024-08-27T03:58:31.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10545286281904322380', time=2024-08-27T05:20:51.353630+0000, chain.objs.size()=1 2024-08-27T03:58:31.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.hW11WXGn5tn4H4SgzpVD4cB50TfPc73_0 2024-08-27T03:58:31.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17178091153491267730', time=2024-08-27T05:20:51.358550+0000, chain.objs.size()=1 2024-08-27T03:58:31.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ZzHHhyZ1fn2IMyF1YxnqxnVGCUI-fec_0 2024-08-27T03:58:31.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12698948248845960342', time=2024-08-27T05:20:51.715057+0000, chain.objs.size()=1 2024-08-27T03:58:31.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.655+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.vTvYM2SSvoxtHH5UMQdt20ASgzVZiYB_0 2024-08-27T03:58:31.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1424539900801352281', time=2024-08-27T05:20:52.472871+0000, chain.objs.size()=1 2024-08-27T03:58:31.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.KNOq72gdwxLlYRE99dV6y8fdBabnqxu_0 2024-08-27T03:58:31.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4702737780617258617', time=2024-08-27T05:20:52.527900+0000, chain.objs.size()=1 2024-08-27T03:58:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.c-uyZZyVDndzPnLYkPeQLgPWIPp7SB9_0 2024-08-27T03:58:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16273124257619488886', time=2024-08-27T05:20:52.585949+0000, chain.objs.size()=1 2024-08-27T03:58:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.OHkaoMGoyyOlgoO1EkllepoatZ9-HQy_0 2024-08-27T03:58:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3163468404700011806', time=2024-08-27T05:20:52.669018+0000, chain.objs.size()=1 2024-08-27T03:58:31.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.pHgYqVMJVN7RiR5FcdmDZnL4zCDZWin_0 2024-08-27T03:58:31.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.624680625740217786', time=2024-08-27T05:20:56.307370+0000, chain.objs.size()=1 2024-08-27T03:58:31.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.dCjtja_kCy3btx7uEW0l0M3HNiepeJh_0 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8183940950605611731', time=2024-08-27T05:20:57.168713+0000, chain.objs.size()=1 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.NNKGwxFDJNGnJOFcsMqMo3Wdh1CZ05I_0 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17442583071042664113', time=2024-08-27T05:20:58.089958+0000, chain.objs.size()=1 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3LEjcYpPdd-nXoH_8JxcK24WVawYChz_0 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12161826482251041232', time=2024-08-27T05:21:01.638659+0000, chain.objs.size()=1 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.AFd87JRPe1VBh3G_BgsAMaWcNoDZwqs_0 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18039342688318928844', time=2024-08-27T05:21:02.686192+0000, chain.objs.size()=1 2024-08-27T03:58:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.sz8UHrY5MVnrrA4yrhioyyPA83xYNlY_0 2024-08-27T03:58:31.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9215614582313042827', time=2024-08-27T05:21:50.282594+0000, chain.objs.size()=1 2024-08-27T03:58:31.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.281__shadow_.p6gdSAtEmTbhCWcr8KUtmsR_h8In1CH_0 2024-08-27T03:58:31.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3122286183650376452', time=2024-08-27T05:22:03.022211+0000, chain.objs.size()=1 2024-08-27T03:58:31.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.659+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.EYRjiQKkC--pwXCtYPGu0SLMmGN7St7_0 2024-08-27T03:58:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11675273102836240488', time=2024-08-27T05:22:07.827037+0000, chain.objs.size()=1 2024-08-27T03:58:31.665 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.yAsk0TNj9XNFX_AAvlZH0OuNlnU46qf_0 2024-08-27T03:58:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2422985986000134418', time=2024-08-27T05:24:46.721619+0000, chain.objs.size()=1 2024-08-27T03:58:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rU3sK1SdgaluDwGsnLSW2ikYx3Af8gU_0 2024-08-27T03:58:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5519839158574051291', time=2024-08-27T05:24:47.747767+0000, chain.objs.size()=1 2024-08-27T03:58:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._erbrhZVBxBSBJkCPqOmY9uf8TZGT3O_0 2024-08-27T03:58:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17001610204060556013', time=2024-08-27T05:24:49.366132+0000, chain.objs.size()=1 2024-08-27T03:58:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZHDF2SGbfzZPUU39SerQpOcz2n7WMff_0 2024-08-27T03:58:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4745763295795824639', time=2024-08-27T05:24:50.366549+0000, chain.objs.size()=1 2024-08-27T03:58:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.G4iz48MGRmzZ3trlQZn9fBxkRpWG88j_0 2024-08-27T03:58:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4421541906603755842', time=2024-08-27T05:24:50.798581+0000, chain.objs.size()=1 2024-08-27T03:58:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YqO9FmFhs-VKzrq5g6wNlhVTsrY2GLu_0 2024-08-27T03:58:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4720189052204556255', time=2024-08-27T05:24:51.239868+0000, chain.objs.size()=1 2024-08-27T03:58:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.663+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3VqntXuEvAIqpXHP4gt_g-8lR6Cv63S_0 2024-08-27T03:58:31.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16753236694760215164', time=2024-08-27T05:24:52.202912+0000, chain.objs.size()=1 2024-08-27T03:58:31.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jhcXDE10d5DC5D2pjMyeIIPEe3RbU9__0 2024-08-27T03:58:31.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17818288026207968979', time=2024-08-27T05:24:55.243925+0000, chain.objs.size()=1 2024-08-27T03:58:31.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.LOr0gmaLbOr4qg2A_VIW8JjwSJML0h-_0 2024-08-27T03:58:31.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6530658875093719526', time=2024-08-27T05:24:55.565917+0000, chain.objs.size()=1 2024-08-27T03:58:31.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4clfLPpAGXMitRs9N_K6m1jRWAeRGOy_0 2024-08-27T03:58:31.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12411212379099988477', time=2024-08-27T05:24:56.752920+0000, chain.objs.size()=1 2024-08-27T03:58:31.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yr0Iv92SqMQlLm-geENfGpl1-7pqWtd_0 2024-08-27T03:58:31.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3509472741398366664', time=2024-08-27T05:24:56.799304+0000, chain.objs.size()=1 2024-08-27T03:58:31.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.m56hN9b7cpAWetuJvDExPQgriFLK7lM_0 2024-08-27T03:58:31.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4598424198099144629', time=2024-08-27T05:24:58.522980+0000, chain.objs.size()=1 2024-08-27T03:58:31.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.667+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.tVpCyaByI7BDU-AwDgE2tth7Gmlu1kt_0 2024-08-27T03:58:31.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13803138134684618066', time=2024-08-27T05:24:58.745955+0000, chain.objs.size()=1 2024-08-27T03:58:31.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ovHgtEzI5Ke1L92v2IoQqYmji_bkF3l_0 2024-08-27T03:58:31.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1081185126539571900', time=2024-08-27T05:25:00.344815+0000, chain.objs.size()=1 2024-08-27T03:58:31.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.q749jeO0iuMCMgcSbQstRG4Itc6FWfs_0 2024-08-27T03:58:31.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2312428863744620243', time=2024-08-27T05:25:02.578439+0000, chain.objs.size()=1 2024-08-27T03:58:31.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6B3MPkTv70NgThTuTEDVtK7qW_SmgKs_0 2024-08-27T03:58:31.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15996086436260849939', time=2024-08-27T05:25:02.990585+0000, chain.objs.size()=1 2024-08-27T03:58:31.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.E08f81fXiWUGR2yAZlwxdabyr4VerCf_0 2024-08-27T03:58:31.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8298886309647062250', time=2024-08-27T05:25:04.314082+0000, chain.objs.size()=1 2024-08-27T03:58:31.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.671+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.44YYEpjOeNpiD25gj-I9ieDVjT9U_Pi_0 2024-08-27T03:58:31.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12271844066492693269', time=2024-08-27T05:25:05.571109+0000, chain.objs.size()=1 2024-08-27T03:58:31.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.mUkjL1bysf2xhhmYvGE8WemNVVnfSGg_0 2024-08-27T03:58:31.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5185329766878679462', time=2024-08-27T05:25:06.325603+0000, chain.objs.size()=1 2024-08-27T03:58:31.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.w4BXK23H4yHADkwTw2Si1-S9n5KDgUu_0 2024-08-27T03:58:31.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12351058685924812732', time=2024-08-27T05:25:07.375430+0000, chain.objs.size()=1 2024-08-27T03:58:31.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.J9QOUcon1Feok9NqDb1R9h6nqCu1q0A_0 2024-08-27T03:58:31.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16695474445204631949', time=2024-08-27T05:25:07.855416+0000, chain.objs.size()=1 2024-08-27T03:58:31.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.VOI3ur_FWj5vdqQArPYzeQIwvgyK13a_0 2024-08-27T03:58:31.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1782842903874779913', time=2024-08-27T05:25:10.521793+0000, chain.objs.size()=1 2024-08-27T03:58:31.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.toMvbBmFrxfwh7lKXMo_JiBdYQeUFBK_0 2024-08-27T03:58:31.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10512321793463680462', time=2024-08-27T05:25:12.766886+0000, chain.objs.size()=1 2024-08-27T03:58:31.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZRxmIijqUb_xED674PS1NfRFyR8dB2z_0 2024-08-27T03:58:31.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15266755063988895807', time=2024-08-27T05:25:12.967303+0000, chain.objs.size()=1 2024-08-27T03:58:31.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rZmQqlWOEVE-MQ7gQ9sPj1u3eyWG_7q_0 2024-08-27T03:58:31.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17703266933415542962', time=2024-08-27T05:25:13.465461+0000, chain.objs.size()=1 2024-08-27T03:58:31.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.UPvgvoByJJehiInVAFou89RQGCpH_10_0 2024-08-27T03:58:31.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5026083376174534535', time=2024-08-27T05:25:14.241795+0000, chain.objs.size()=1 2024-08-27T03:58:31.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.675+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.6hWMlDVroxnniK-k5Ghjw17DESET7-I_0 2024-08-27T03:58:31.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3301341298924258269', time=2024-08-27T05:26:58.500732+0000, chain.objs.size()=1 2024-08-27T03:58:31.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.qHZmD_I_eggeQlmUC5iLFDooenWhZrl_0 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7912340359874270974', time=2024-08-27T05:26:58.740743+0000, chain.objs.size()=1 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ujTESUlmgF61_Et7EAUVk8JExGEYE7s_0 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11024009647031949732', time=2024-08-27T05:26:59.021901+0000, chain.objs.size()=1 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jZI46KBuIlvF0x5R2NcYpV3hDBWp0JF_0 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.224785984950791256', time=2024-08-27T05:26:59.189290+0000, chain.objs.size()=1 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.KcsZSKqst2WsgjQNv9XrNOJq5t7UIXY_0 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7668262096295233857', time=2024-08-27T05:27:00.135657+0000, chain.objs.size()=1 2024-08-27T03:58:31.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.679+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.3PbDSrrd66j75-gEELMryUv4oNUeBBx_0 2024-08-27T03:58:31.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11914800351242487508', time=2024-08-27T05:27:00.218863+0000, chain.objs.size()=1 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.GtD-hoUZ7nJwIfHnJE4eCndlSEMGC0K_0 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11846805760247842567', time=2024-08-27T05:27:00.552596+0000, chain.objs.size()=1 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DpJJnCEO2BRicJi7RzT0BJ2LUX898T4_0 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11911841168633084044', time=2024-08-27T05:27:01.701495+0000, chain.objs.size()=1 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.7RZakK94ZgnxpCqQGK4hYhssM8JwIrW_0 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16633616338902321499', time=2024-08-27T05:27:01.752765+0000, chain.objs.size()=1 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.2e8Nxh2862ciM7Lo7kFoWpkLcHX1BTF_0 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7891092255945823180', time=2024-08-27T05:27:03.284803+0000, chain.objs.size()=1 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N9gPikzJES78_nchGB6F9BTM7fHPvdf_0 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14510323580333701459', time=2024-08-27T05:27:03.286517+0000, chain.objs.size()=1 2024-08-27T03:58:31.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.U2k78BWbA0OGcRetLDKGGTqkzPu6P5M_0 2024-08-27T03:58:31.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5750012373899059926', time=2024-08-27T05:27:07.496075+0000, chain.objs.size()=1 2024-08-27T03:58:31.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VCPUQ0HDWNpCsS2dgt_Xge_8XhLWdY8_0 2024-08-27T03:58:31.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1964405550200258887', time=2024-08-27T05:27:08.042865+0000, chain.objs.size()=1 2024-08-27T03:58:31.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.z2vVIXS_Is60kAmMZt_R9PkkssWadrn_0 2024-08-27T03:58:31.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7383841411046278337', time=2024-08-27T05:27:09.147229+0000, chain.objs.size()=1 2024-08-27T03:58:31.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VXuUgZbcJ9WUPctuggZtm6X99XiEnQY_0 2024-08-27T03:58:31.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10727468104150445738', time=2024-08-27T05:27:10.867182+0000, chain.objs.size()=1 2024-08-27T03:58:31.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.o0v3MtBesptJdHLlNe06ahzKNsmdIuV_0 2024-08-27T03:58:31.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1423818417959126977', time=2024-08-27T05:27:11.450400+0000, chain.objs.size()=1 2024-08-27T03:58:31.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.683+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_._X5byEzBB_f4T1Y2cr6rYpjZdDKcoqm_0 2024-08-27T03:58:31.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7426775702553101372', time=2024-08-27T05:27:11.863239+0000, chain.objs.size()=1 2024-08-27T03:58:31.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.YebxXfGCqEdRQWWm-xwkGzVvdRYE6pG_0 2024-08-27T03:58:31.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15326918768811183438', time=2024-08-27T05:27:13.720585+0000, chain.objs.size()=1 2024-08-27T03:58:31.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.-v3dWSfBgox47OovpFdL1kztpYnKNxg_0 2024-08-27T03:58:31.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18215204874149083153', time=2024-08-27T05:27:14.624666+0000, chain.objs.size()=1 2024-08-27T03:58:31.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.071ICGhFhdo_suu4Zve32_mIWSXH_su_0 2024-08-27T03:58:31.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12295941703804897994', time=2024-08-27T05:27:14.790216+0000, chain.objs.size()=1 2024-08-27T03:58:31.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UIJkrAZ4zro65dQr237nXx4hpErxtOJ_0 2024-08-27T03:58:31.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9207812025966678299', time=2024-08-27T05:27:17.120281+0000, chain.objs.size()=1 2024-08-27T03:58:31.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.U4BI_Sv6MSkKwBSMQIal6_4rOxrFBHB_0 2024-08-27T03:58:31.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15097861996021764473', time=2024-08-27T05:27:18.093671+0000, chain.objs.size()=1 2024-08-27T03:58:31.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HzoOR828vVsa1uaVzCiIri_xBzTLjrh_0 2024-08-27T03:58:31.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3070021992672422652', time=2024-08-27T05:27:18.876904+0000, chain.objs.size()=1 2024-08-27T03:58:31.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p0M816FFJuC4PC8IVhDoJhB_gp2o10a_0 2024-08-27T03:58:31.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12155081737382864956', time=2024-08-27T05:27:21.422613+0000, chain.objs.size()=1 2024-08-27T03:58:31.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.eQche14W2756tFFghptJnz5AN-PCDai_0 2024-08-27T03:58:31.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7391311326014974524', time=2024-08-27T05:27:21.504989+0000, chain.objs.size()=1 2024-08-27T03:58:31.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LjuX0UNLXser1RioPaQqegxnIrk9zoY_0 2024-08-27T03:58:31.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6947368431546175310', time=2024-08-27T05:27:21.617057+0000, chain.objs.size()=1 2024-08-27T03:58:31.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.687+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Rzj-ztxigB67KDjBB_4IBT3gHyr6mzi_0 2024-08-27T03:58:31.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14319943887710308074', time=2024-08-27T05:27:22.415422+0000, chain.objs.size()=1 2024-08-27T03:58:31.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gmNB0N-NJO2whO72FbSAIGMDO5DzGKq_0 2024-08-27T03:58:31.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16287838806169326136', time=2024-08-27T05:27:22.679580+0000, chain.objs.size()=1 2024-08-27T03:58:31.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.SBvUv4CCNVvl4hINEDh3cchqe_wO03y_0 2024-08-27T03:58:31.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.691+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10971242191470302223', time=2024-08-27T05:27:22.899062+0000, chain.objs.size()=1 2024-08-27T03:58:31.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.691+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6G2ziPAiVAbiflw7r-DuLq3cOBX_ARp_0 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10632731222593073959', time=2024-08-27T05:27:23.870985+0000, chain.objs.size()=1 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N_9zP8oD7M1ts84xZiIUpHaBlWYZ5zm_0 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1029073474666295143', time=2024-08-27T05:27:24.173832+0000, chain.objs.size()=1 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.10P5k3UdJjINSaE7AHn0ZTIpyLciFX5_0 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13645995081086774836', time=2024-08-27T05:27:24.255689+0000, chain.objs.size()=1 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0wxoa1aItD1XkQgMHxGSZD2SAsEwdbS_0 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3266405398625143350', time=2024-08-27T05:27:24.730717+0000, chain.objs.size()=1 2024-08-27T03:58:31.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.q_Y3SvvPdyQu6ekvRrqvvk9sgiWg5p1_0 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10511578807699402463', time=2024-08-27T05:27:25.012384+0000, chain.objs.size()=1 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cpfY1DWOXugZAnCUWVoWPj1PCcw4YdC_0 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6063611304572240951', time=2024-08-27T05:27:25.895313+0000, chain.objs.size()=1 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ipwL4D7KdDtMZ8mPqEvGOZBy0X3iyr4_0 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7523341464216380089', time=2024-08-27T05:30:03.144029+0000, chain.objs.size()=1 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.425__shadow_.zzBhaCh85l2711j0FSy-U7glpWmo0It_0 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6060971977122825472', time=2024-08-27T05:30:24.600068+0000, chain.objs.size()=1 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.438__shadow_.tvGDEO_Lc9Oa0SUoDH_hRdzdX_3rEj-_0 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10025143938097134136', time=2024-08-27T05:31:07.158484+0000, chain.objs.size()=1 2024-08-27T03:58:31.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.460__shadow_.D4N6StrORT40INg1BP_xLRVIbtGHD2S_0 2024-08-27T03:58:31.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16189451221086629039', time=2024-08-27T05:31:30.634665+0000, chain.objs.size()=1 2024-08-27T03:58:31.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.695+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.478__shadow_.jQBVa6ilApmjXtAAYWa2JdSymVR6JIw_0 2024-08-27T03:58:31.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.699+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9317278993239681590', time=2024-08-27T05:31:51.923924+0000, chain.objs.size()=1 2024-08-27T03:58:31.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.699+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.489__shadow_.1sKMXAW1LAZQNHAVIKU3cIQl9HWPqWZ_0 2024-08-27T03:58:31.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.699+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8545160439684436281', time=2024-08-27T05:31:59.312934+0000, chain.objs.size()=1 2024-08-27T03:58:31.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.699+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.493__shadow_.CjQ6F_uQSToKg5VmEaKJgUNmkts8aYN_0 2024-08-27T03:58:31.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/41157 2024-08-27T03:58:31.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-08-27T03:58:31.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1836614174163242248', time=2024-08-27T05:35:00.129509+0000, chain.objs.size()=2 2024-08-27T03:58:31.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~VHPuW3F5Sgk3qDxu62nyUStLogABcbp.1 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~VHPuW3F5Sgk3qDxu62nyUStLogABcbp.2 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14091773691155439694', time=2024-08-27T05:37:23.912239+0000, chain.objs.size()=2 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.552__shadow_.9kwhWK3K93k9sDWCm4zC5B-kNOtc7s7_0 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.552__shadow_.9kwhWK3K93k9sDWCm4zC5B-kNOtc7s7_1 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2031485518604403451', time=2024-08-27T05:38:10.886874+0000, chain.objs.size()=1 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:Y84o-xifnOu7YtEGJv.7mLBi33aTVx4_.u3bu5EP1tvLD5EUnHdYI2g7rYB3Fqin_0 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.57690486532945314', time=2024-08-27T05:38:28.164493+0000, chain.objs.size()=1 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:Ca04HZ1H.OGAMbVXO2GraxRKp8KK5Kl_.bVo9-bWQIpRFYAFkuO5l_XhN6wjPARj_0 2024-08-27T03:58:31.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17306981276660124513', time=2024-08-27T05:39:25.547778+0000, chain.objs.size()=1 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:VgXhrQShFdZDrPXhVWQSJeq5WSvi7Fr_.AU0DNTHnU_E9gf120uSQWrAL5xj6Gsp_0 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2055149152517524623', time=2024-08-27T05:39:55.637994+0000, chain.objs.size()=1 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.573__shadow:xnoiPaY3AH-e2Qvl0uO2QWcv.8uy.2W_.AbiqHTl7IO_EJkSMNU0otlHp_VqQonq_0 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7897345010607683997', time=2024-08-27T05:40:00.478077+0000, chain.objs.size()=1 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.574__shadow:XWKee8swCxUoOXaHfm.IP6iiKRtdu3m_.22Gb_sTmqF-9WLlZGuDlCESG17qqMPP_0 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2551210476371030262', time=2024-08-27T05:45:47.554134+0000, chain.objs.size()=1 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.637__shadow_.ZYSBcDjPwiVLnUxamqplupXXHeSEc4A_0 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7903359216624207862', time=2024-08-27T05:46:58.864532+0000, chain.objs.size()=1 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.662__shadow_.wpfRtTihezBAM_QIJtA6tJ5ChLDtN4m_0 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14601059625596889894', time=2024-08-27T05:47:39.011048+0000, chain.objs.size()=1 2024-08-27T03:58:31.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.703+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.690__shadow:orLEwC3Tm0KP8fAYkJQ0rAkG54DSsY3_.gqNao2isc_qAGYjzyqPYrZ7mZB3H_HD_0 2024-08-27T03:58:31.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5864223766678135046', time=2024-08-27T05:47:53.230581+0000, chain.objs.size()=1 2024-08-27T03:58:31.710 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.698__shadow:z.1KHRmZvbkAwBVZU-9tC1CKKx2zU3h_.0IfwxbSYSI-zCbe8jWET6EkvcB0XY7N_0 2024-08-27T03:58:31.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.707+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13169069004185890339', time=2024-08-27T05:48:37.574186+0000, chain.objs.size()=1 2024-08-27T03:58:31.711 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.707+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.713__shadow_.Uedm3SmXh9kiTNkiCo6DKKVBH8hemtE_0 2024-08-27T03:58:31.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.711+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-08-27T03:58:31.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47141' 2024-08-27T03:58:31.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7881215388109262897', time=2024-08-27T05:12:54.034017+0000, chain.objs.size()=1 2024-08-27T03:58:31.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.142__shadow_.mSN4EQlChd3GDXQOWfIyCAGd7kucVbW_0 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_kRxMO1xNCO52hne_iD_j6bOoL0qyHqb', time=2024-08-27T05:13:41.305727+0000, chain.objs.size()=1 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.155__shadow_.sWrcoS3_spknqsY3w8qhV-o47pW_ZNf_0 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16056056808059855339', time=2024-08-27T05:13:44.197732+0000, chain.objs.size()=1 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.156__shadow_.Kzc3dg0zcx7bL7hg47i15AwmpG1Rthb_0 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15544146658129677421', time=2024-08-27T05:15:02.175376+0000, chain.objs.size()=1 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.194__shadow_.eaXpctBzZE66sLkFEAJJP-RjWUlz0zN_0 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16627393823194339375', time=2024-08-27T05:17:51.040641+0000, chain.objs.size()=1 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.222__shadow_.w6Qs7GtqNKnh9HFer5UJE2oOf6a3BU6_0 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.974576490959698288', time=2024-08-27T05:17:53.372659+0000, chain.objs.size()=1 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.224__shadow_.aUe4kQRnvYlu--Ry-eyf8Gt67k2BFN7_0 2024-08-27T03:58:31.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3882045313747715904', time=2024-08-27T05:18:04.488078+0000, chain.objs.size()=1 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.230__shadow_.jNZCEw6rNZ3UxPD9Aw9YMtZ-VMhD7kH_0 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8642693650301841916', time=2024-08-27T05:18:33.007727+0000, chain.objs.size()=1 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.244__shadow_.oEUm6-cZEdgxaNeVkZyM8n1OHqWqpid_0 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10665230994083153518', time=2024-08-27T05:18:52.989528+0000, chain.objs.size()=1 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.255__shadow_.O6c2vNxefY0bjxK_PidYR5Otn-YLOlN_0 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9787999075153568892', time=2024-08-27T05:20:35.912910+0000, chain.objs.size()=1 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.gP8Ln0aAN92k_LPNz8vwJJIAuo113oo_0 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14599400456009298993', time=2024-08-27T05:20:37.384787+0000, chain.objs.size()=1 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7eEFZOkCmZlRAG3HMR2vZ7ArqAFO_la_0 2024-08-27T03:58:31.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.349081058450069177', time=2024-08-27T05:20:37.526170+0000, chain.objs.size()=1 2024-08-27T03:58:31.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.715+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Fx5Vz9tqleAM4u8PQPhOzXOQiPgC_2__0 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.719+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4851244092055221316', time=2024-08-27T05:20:38.124776+0000, chain.objs.size()=1 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.J0SRUosLCWGEKJnHfzf7iRQTpTMCluS_0 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.719+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9467828632031270548', time=2024-08-27T05:20:39.676737+0000, chain.objs.size()=1 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.719+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_._FLboyTt43W1WKMVmvEyWHBGRA5Uw30_0 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.719+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16212107567764719690', time=2024-08-27T05:20:40.564951+0000, chain.objs.size()=1 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5XsWnnfsyzfLbA013sEtWykFgFPZmvf_0 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4313182665162003495', time=2024-08-27T05:20:40.770689+0000, chain.objs.size()=1 2024-08-27T03:58:31.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.2cJBGRP3i5NYI66kr6hWBwOXoXlxAwB_0 2024-08-27T03:58:31.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12288383262425044594', time=2024-08-27T05:20:41.020281+0000, chain.objs.size()=1 2024-08-27T03:58:31.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Sg87XjZSUIGjtyX68KgGwlv4e1gdXMB_0 2024-08-27T03:58:31.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9801834780617970004', time=2024-08-27T05:20:41.463899+0000, chain.objs.size()=1 2024-08-27T03:58:31.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eG9q-PnNGxROXbL9nD47ho7xmb7WSrK_0 2024-08-27T03:58:31.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14438368285533338838', time=2024-08-27T05:20:41.637264+0000, chain.objs.size()=1 2024-08-27T03:58:31.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.20VBUIeL7pMRV24fKw-FQx8TozfezeK_0 2024-08-27T03:58:31.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11237882850730078082', time=2024-08-27T05:20:42.203681+0000, chain.objs.size()=1 2024-08-27T03:58:31.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.ENEKM3ZXjD9KuhnAfDjxDq3PDIdusia_0 2024-08-27T03:58:31.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.791214011619456460', time=2024-08-27T05:20:44.334558+0000, chain.objs.size()=1 2024-08-27T03:58:31.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.1th3opUzc-nzSE-aK3uFHHDRDlhdFnc_0 2024-08-27T03:58:31.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12437280942935563825', time=2024-08-27T05:20:44.501907+0000, chain.objs.size()=1 2024-08-27T03:58:31.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.IGAM9QW6hO1DoRG2NxFtCojGV2rs4uD_0 2024-08-27T03:58:31.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15201220778363386100', time=2024-08-27T05:20:44.572235+0000, chain.objs.size()=1 2024-08-27T03:58:31.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.723+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.9paa1l1vI22ZOlJxVCKVg-CLagHvXVJ_0 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9135412902952659650', time=2024-08-27T05:20:45.195699+0000, chain.objs.size()=1 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uSKFdo_sj00JGUXAoDNWjjS2NMGJvTe_0 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6441963017538528676', time=2024-08-27T05:20:46.031260+0000, chain.objs.size()=1 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.qYYwFg_qTpwKu7HufXEGKopjPQGd684_0 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11924004426514593356', time=2024-08-27T05:20:49.620501+0000, chain.objs.size()=1 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.J72BUZBwxIqnPaC6QH7yIy7CrbI-vOD_0 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11027022482792670948', time=2024-08-27T05:20:49.711921+0000, chain.objs.size()=1 2024-08-27T03:58:31.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.i7CLhiabo29Wc7ThFWehnGMFO5TuVWR_0 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9183445231685180013', time=2024-08-27T05:20:53.423086+0000, chain.objs.size()=1 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.O-oeDbZdai754E9n6XRxwcsZzdjxeMm_0 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15719281702453895965', time=2024-08-27T05:20:56.369103+0000, chain.objs.size()=1 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Xf180-JbHVVv7UVuYPRtunTM_hlbA7N_0 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2511246809356041081', time=2024-08-27T05:20:56.672220+0000, chain.objs.size()=1 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.QnTaog92nAo2lDDgmx9fKi7YKKhvFGv_0 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14793068738484115577', time=2024-08-27T05:20:57.259215+0000, chain.objs.size()=1 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.u1tiNCBI0GOBMkUMGeDjamp3kPCIAqo_0 2024-08-27T03:58:31.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17043432055972633770', time=2024-08-27T05:20:58.278156+0000, chain.objs.size()=1 2024-08-27T03:58:31.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.oV6RqbOScdxYQHxVxyHLh4ihAsG_mAc_0 2024-08-27T03:58:31.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10847124241660887289', time=2024-08-27T05:20:58.515270+0000, chain.objs.size()=1 2024-08-27T03:58:31.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PPsMqjI_8cQzrjhwedy59HAy7VstZQb_0 2024-08-27T03:58:31.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1949625485706601513', time=2024-08-27T05:21:00.124268+0000, chain.objs.size()=1 2024-08-27T03:58:31.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.727+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.J9wfHkgxfLNGbmoxJZrYI21POq7a_-t_0 2024-08-27T03:58:31.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9339233120154593541', time=2024-08-27T05:21:00.170036+0000, chain.objs.size()=1 2024-08-27T03:58:31.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.o8RYYIsjZ1uzt1ZJuyZXt3z675QR9r9_0 2024-08-27T03:58:31.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14756550340806083216', time=2024-08-27T05:21:01.880390+0000, chain.objs.size()=1 2024-08-27T03:58:31.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MhqeTIv1Vyqj75MzuorUdIO5egf3Ba__0 2024-08-27T03:58:31.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9870084952084027834', time=2024-08-27T05:21:02.283136+0000, chain.objs.size()=1 2024-08-27T03:58:31.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.uukXM9RvHT89yp8LMvFgu7h0n2xCH23_0 2024-08-27T03:58:31.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1148979138844389382', time=2024-08-27T05:21:02.740203+0000, chain.objs.size()=1 2024-08-27T03:58:31.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.MqGxYAWFzAFYSyAWhedZwwbgRjZEF80_0 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10370997060698574646', time=2024-08-27T05:21:02.928390+0000, chain.objs.size()=1 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.731+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7Y-AB_39OPu9TcweUZhGKEfNBxKJKht_0 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6471375093549595892', time=2024-08-27T05:21:04.133932+0000, chain.objs.size()=1 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.Pt17ZuzZTkEbL788aYFcL8DhuGaDq9W_0 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9601337393014681945', time=2024-08-27T05:21:21.541079+0000, chain.objs.size()=1 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.266__shadow_.yFi_9Vpypf9WNIYAsqhWN9Tec7vBu9a_0 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.122584305918302789', time=2024-08-27T05:21:26.884882+0000, chain.objs.size()=1 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.269__shadow_.ppqNeXfMCwsPtT4-krrChe9NGCV9wkD_0 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3125848719397086596', time=2024-08-27T05:21:39.748734+0000, chain.objs.size()=1 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.276__shadow_.DMkezASMgd9glwvg7ViKlhQEi6mPAMR_0 2024-08-27T03:58:31.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17110604704053845261', time=2024-08-27T05:21:52.081929+0000, chain.objs.size()=1 2024-08-27T03:58:31.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.282__shadow_.H7Y3a_Fra08mOjzRzqBBETuFOvMXRYn_0 2024-08-27T03:58:31.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14031714301167656538', time=2024-08-27T05:22:02.966715+0000, chain.objs.size()=1 2024-08-27T03:58:31.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.735+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.5EAeyKcLsrRVBp7Rrsd2QXjOzUUPdqW_0 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15393209294573767060', time=2024-08-27T05:22:07.770474+0000, chain.objs.size()=1 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.-BI_bl2hR30ggfVtvcW8qSdjQpHwNn5_0 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5004247071871976429', time=2024-08-27T05:22:07.835695+0000, chain.objs.size()=1 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.ATrpk1zWu1akLH0QBra1d58VxC9D6MD_0 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10878686373650628023', time=2024-08-27T05:22:08.058978+0000, chain.objs.size()=1 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.FRueTTo-pmU5QYQSkvyJUrjzMgo8OiZ_0 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1992600622672023802', time=2024-08-27T05:22:28.868266+0000, chain.objs.size()=1 2024-08-27T03:58:31.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.298__shadow_.0sbUoMx1_qrUGnfRT5WFFL2pPxzpT4Q_0 2024-08-27T03:58:31.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10620022007818882104', time=2024-08-27T05:22:28.870048+0000, chain.objs.size()=1 2024-08-27T03:58:31.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.298__shadow_.x0CP0Hw6zX-N_-2ebMgo85y337K2s7f_0 2024-08-27T03:58:31.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4248238523398514065', time=2024-08-27T05:24:46.432648+0000, chain.objs.size()=1 2024-08-27T03:58:31.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8wT6NDC53hsQrFRseQovPlZSy4Sz-gE_0 2024-08-27T03:58:31.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4081576648272171495', time=2024-08-27T05:24:48.373534+0000, chain.objs.size()=1 2024-08-27T03:58:31.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.-duE51ClZC3zAAy5d1vzzvaZibLjLhW_0 2024-08-27T03:58:31.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11867148540262768280', time=2024-08-27T05:24:48.806272+0000, chain.objs.size()=1 2024-08-27T03:58:31.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cmlzF-rvV54r82xk5_4fLoVgpJCuOzF_0 2024-08-27T03:58:31.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10457540381912068763', time=2024-08-27T05:24:48.807675+0000, chain.objs.size()=1 2024-08-27T03:58:31.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1IgIxNGpQcEbcRcQV2a-UkPEsiTdnmH_0 2024-08-27T03:58:31.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14246268571749501538', time=2024-08-27T05:24:49.306449+0000, chain.objs.size()=1 2024-08-27T03:58:31.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.rjKljURZZy8yISA-Wes7B8gz-J7iHP2_0 2024-08-27T03:58:31.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9998537809800629763', time=2024-08-27T05:24:50.403173+0000, chain.objs.size()=1 2024-08-27T03:58:31.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.739+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.53HFcTeJf2gy30v1K7zoXNP6GnjcWGd_0 2024-08-27T03:58:31.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4949917865933287911', time=2024-08-27T05:24:50.478978+0000, chain.objs.size()=1 2024-08-27T03:58:31.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jm-0XqQD8THf91ujgDBw9G_drzwNZpX_0 2024-08-27T03:58:31.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17942566044258649174', time=2024-08-27T05:24:50.775530+0000, chain.objs.size()=1 2024-08-27T03:58:31.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.RJiFZeLUuI_WtFIsGXLrClCsflm39r9_0 2024-08-27T03:58:31.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9283625807846213513', time=2024-08-27T05:24:51.031550+0000, chain.objs.size()=1 2024-08-27T03:58:31.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FD7318dW3ibp33VgUr1RrGdZuk3K85X_0 2024-08-27T03:58:31.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7364460047656740677', time=2024-08-27T05:24:51.312798+0000, chain.objs.size()=1 2024-08-27T03:58:31.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.di6xfDzXmn9WcnCO2eLw4UT8ht9Yu4P_0 2024-08-27T03:58:31.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14472968142814051058', time=2024-08-27T05:24:52.399082+0000, chain.objs.size()=1 2024-08-27T03:58:31.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.YVPgTozYq1QqTL25Zg4PDap81sAiD0L_0 2024-08-27T03:58:31.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17823968452671567607', time=2024-08-27T05:24:52.858701+0000, chain.objs.size()=1 2024-08-27T03:58:31.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.OYGUI8fLThJOcRnd8oMf0Ds4tG0y_QG_0 2024-08-27T03:58:31.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5344253036074647391', time=2024-08-27T05:24:52.943274+0000, chain.objs.size()=1 2024-08-27T03:58:31.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.743+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.4TJp_benml1QSizjwAO7EG7nVEUdltv_0 2024-08-27T03:58:31.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15790364686865200474', time=2024-08-27T05:24:54.617236+0000, chain.objs.size()=1 2024-08-27T03:58:31.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.jvf1srHB-U1xubvO7tmmELKDm5QAlJ6_0 2024-08-27T03:58:31.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1272542002736662458', time=2024-08-27T05:24:55.685117+0000, chain.objs.size()=1 2024-08-27T03:58:31.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0i24JlysOwUg6xsi8-gFqjachKivfst_0 2024-08-27T03:58:31.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14066509396304569606', time=2024-08-27T05:24:55.960839+0000, chain.objs.size()=1 2024-08-27T03:58:31.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.7b3iq0ekGGbo3QsGY_AhzXPvuE1yKGZ_0 2024-08-27T03:58:31.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16829914282926997803', time=2024-08-27T05:24:56.022725+0000, chain.objs.size()=1 2024-08-27T03:58:31.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.9Oh3mZv3Z6ZHwZy2Y4E5wWMwWg-giHO_0 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7147730094973316510', time=2024-08-27T05:24:58.501702+0000, chain.objs.size()=1 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.dqHInx-zAeOuXBYfwmUx-953ZMBzNKS_0 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8989314021127678419', time=2024-08-27T05:24:59.888965+0000, chain.objs.size()=1 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.28jltwTScfn8MJ4D5YcsGPx_PC11po1_0 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3839370208365599957', time=2024-08-27T05:25:00.216314+0000, chain.objs.size()=1 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KOlBsSas-JAsvC72P8uQPQmmCZpsSK8_0 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16060470909341247615', time=2024-08-27T05:25:01.604224+0000, chain.objs.size()=1 2024-08-27T03:58:31.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.747+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.PxPTHqJnrkO5tURhEb9UMQzU5cyUx01_0 2024-08-27T03:58:31.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16794392761401816625', time=2024-08-27T05:25:01.692416+0000, chain.objs.size()=1 2024-08-27T03:58:31.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.R5Tj7zuty-FdVR-sUXqf1OXDkFWjaXZ_0 2024-08-27T03:58:31.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5042003305991205644', time=2024-08-27T05:25:02.028332+0000, chain.objs.size()=1 2024-08-27T03:58:31.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.vVlGVdqKu41Z9o_vAiNKpc5RUYwTh5z_0 2024-08-27T03:58:31.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4322599415993971745', time=2024-08-27T05:25:02.223927+0000, chain.objs.size()=1 2024-08-27T03:58:31.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.wWzC9FC1vgKuA7K3fiMjZCAbY0re-mA_0 2024-08-27T03:58:31.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14130413662513637434', time=2024-08-27T05:25:02.512736+0000, chain.objs.size()=1 2024-08-27T03:58:31.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.751+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.js_8gyQjhVlTQbL6YhFtMummD3P3KVD_0 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9154084427247428172', time=2024-08-27T05:25:03.592199+0000, chain.objs.size()=1 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.HjS2jjSnGhp-laFxTH2kvmm8_uzGaco_0 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4498595968779969811', time=2024-08-27T05:25:03.657899+0000, chain.objs.size()=1 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hAxpGz7Z8QsZcrj-cvUkg09gsLVS57r_0 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17095955450255298282', time=2024-08-27T05:25:04.028575+0000, chain.objs.size()=1 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KEgbiCRANeJpa4cPQeKMHNSoVKVBnp9_0 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14760484209446140208', time=2024-08-27T05:25:06.217096+0000, chain.objs.size()=1 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0aje9jpWWL-MzRIwgdxzyj64J4gXJ_5_0 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9543012925692969265', time=2024-08-27T05:25:06.340772+0000, chain.objs.size()=1 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.djO_a_AiYr0XY7pK_rlNfZthRdL_tTo_0 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15787283743127612363', time=2024-08-27T05:25:06.457095+0000, chain.objs.size()=1 2024-08-27T03:58:31.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eLuNXanjBD57tyYKf15agVczGEsBIFe_0 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14225617305442002828', time=2024-08-27T05:25:08.031322+0000, chain.objs.size()=1 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.JhL7aKSwV1nReEfIVm66qeLSUusLSN6_0 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3294958901807550295', time=2024-08-27T05:25:10.606150+0000, chain.objs.size()=1 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8-JIb24h5LfSKZ7bV-L5-G_ww9EMVpz_0 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18321564361021366999', time=2024-08-27T05:25:10.697989+0000, chain.objs.size()=1 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Dooc-2rEXpW5DkcjKnF0rnMikrZuVp9_0 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16369263502070263208', time=2024-08-27T05:25:10.877349+0000, chain.objs.size()=1 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.buHQN45CHTbG2QNVxY-NY9jX0Z8GdAh_0 2024-08-27T03:58:31.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7098013331310375701', time=2024-08-27T05:25:11.051066+0000, chain.objs.size()=1 2024-08-27T03:58:31.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.755+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.33ViVujxmweSSsU5cpav6oq61s_4jXb_0 2024-08-27T03:58:31.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18026424386458114744', time=2024-08-27T05:25:11.090432+0000, chain.objs.size()=1 2024-08-27T03:58:31.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.1on10iG8DZ7Q_TV6gRORNQtzv6uU7fK_0 2024-08-27T03:58:31.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6349024573120625301', time=2024-08-27T05:25:11.151869+0000, chain.objs.size()=1 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.KWggim2hD3Z38OepHtWUYx3K4T8J9yl_0 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8190599563525619083', time=2024-08-27T05:25:12.335476+0000, chain.objs.size()=1 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xFNLpEwoSODg8cPumL4rV0oJl3XgpLK_0 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6372642351456573564', time=2024-08-27T05:26:58.154034+0000, chain.objs.size()=1 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.UM1pTU0BO5bBZe_5V8WMo-Fk0mbMmMz_0 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13413617177371585169', time=2024-08-27T05:27:00.173790+0000, chain.objs.size()=1 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.Ds00wrH-4Bg5LD8WtEWfK9mCH397ObU_0 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11645798184519417133', time=2024-08-27T05:27:00.204475+0000, chain.objs.size()=1 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.X7FaSsaHm5kuX55z381Lvf910ivvJuz_0 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10661206818754046970', time=2024-08-27T05:27:05.488519+0000, chain.objs.size()=1 2024-08-27T03:58:31.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.759+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.AzVGPTSMpfxgd_thXJ2N1okWrIZN4n7_0 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13118063759578569577', time=2024-08-27T05:27:05.750855+0000, chain.objs.size()=1 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.IdPteVSpJFu8n11jgHg5l5D5A12aYMC_0 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15145938067191011993', time=2024-08-27T05:27:05.976586+0000, chain.objs.size()=1 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.VjjM-FqidWYEeKQkCvYR_ziuAt2NJX-_0 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3697295145384666882', time=2024-08-27T05:27:05.978217+0000, chain.objs.size()=1 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.4elHUFLFJViU7Hy0koMsIDjozVyOL_o_0 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7806509649891045671', time=2024-08-27T05:27:06.929740+0000, chain.objs.size()=1 2024-08-27T03:58:31.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.HdrVLupmB-TWqXnxrvlMPVhpProzFZN_0 2024-08-27T03:58:31.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10271935381666148596', time=2024-08-27T05:27:06.983617+0000, chain.objs.size()=1 2024-08-27T03:58:31.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LeGMTFYC8Rsx-hTNY4LPWvhoqfsoL9r_0 2024-08-27T03:58:31.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11633378510788818715', time=2024-08-27T05:27:09.626731+0000, chain.objs.size()=1 2024-08-27T03:58:31.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.zL0-5aHG3lxCzQtBiGjzr7Jghzk_1Bl_0 2024-08-27T03:58:31.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3361083745762667708', time=2024-08-27T05:27:11.554975+0000, chain.objs.size()=1 2024-08-27T03:58:31.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.763+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ywe0aNUIKoHO6--bK6OdOHj4RlvdTIU_0 2024-08-27T03:58:31.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.767+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47141 2024-08-27T03:58:31.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-08-27T03:58:31.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15983986697147756267', time=2024-08-27T05:27:12.792057+0000, chain.objs.size()=1 2024-08-27T03:58:31.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.jo7LQFT5OHOFuZ1J_DOlNZABiBCX2nv_0 2024-08-27T03:58:31.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4675786868975507835', time=2024-08-27T05:27:12.842664+0000, chain.objs.size()=1 2024-08-27T03:58:31.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.i9hbqglnbUdENzOTWxWbmPCBkY0vDE-_0 2024-08-27T03:58:31.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5571450724164304779', time=2024-08-27T05:27:12.903498+0000, chain.objs.size()=1 2024-08-27T03:58:31.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.0o9cqKol5xphG4dTMmkxmlGcunDopZF_0 2024-08-27T03:58:31.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7617310723884277053', time=2024-08-27T05:27:12.905842+0000, chain.objs.size()=1 2024-08-27T03:58:31.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.FtiEyhmzPKP5HO_KgQGVf8a4QFaAdNd_0 2024-08-27T03:58:31.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15155650180940301763', time=2024-08-27T05:27:13.134791+0000, chain.objs.size()=1 2024-08-27T03:58:31.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.h8NPYj-NpkkEaXehV6LkXPldor1k1jA_0 2024-08-27T03:58:31.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13832340447146437148', time=2024-08-27T05:27:14.854174+0000, chain.objs.size()=1 2024-08-27T03:58:31.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hUybOve8dELdy9djReYvbAGYB8IOxFy_0 2024-08-27T03:58:31.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4873293550810242843', time=2024-08-27T05:27:15.675516+0000, chain.objs.size()=1 2024-08-27T03:58:31.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.iBSUWJUnEln0tmdTs7mRUGgQJvVstyd_0 2024-08-27T03:58:31.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14310533864997242267', time=2024-08-27T05:27:17.225161+0000, chain.objs.size()=1 2024-08-27T03:58:31.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.1K6IacrXWLmC8P2Ic_U0b-J4OXObyde_0 2024-08-27T03:58:31.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16611376487052121092', time=2024-08-27T05:27:17.635528+0000, chain.objs.size()=1 2024-08-27T03:58:31.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.W0CuuhUKrRqj0z4D1OXBZaxOIrE1p6o_0 2024-08-27T03:58:31.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6060793867730254558', time=2024-08-27T05:27:19.038385+0000, chain.objs.size()=1 2024-08-27T03:58:31.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.54wnqchU6NFVNblBNg1BUBayP_Wg040_0 2024-08-27T03:58:31.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14069390594582522828', time=2024-08-27T05:27:21.834700+0000, chain.objs.size()=1 2024-08-27T03:58:31.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N2CIN0wMDjhgg6if5aa9xMZtZpxCReK_0 2024-08-27T03:58:31.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13446863338414160732', time=2024-08-27T05:27:22.274565+0000, chain.objs.size()=1 2024-08-27T03:58:31.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.771+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.6Mvi1o4KUzKmGhbYWlTlSOnf2S7_X1h_0 2024-08-27T03:58:31.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11155460630131153021', time=2024-08-27T05:27:22.835707+0000, chain.objs.size()=1 2024-08-27T03:58:31.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.89msURimuc3dicaVJ411Lm-lPRSwDWG_0 2024-08-27T03:58:31.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13186474793861093890', time=2024-08-27T05:27:23.878644+0000, chain.objs.size()=1 2024-08-27T03:58:31.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.8NU_4S56dpXMDlDmno6-odo_xSvleyn_0 2024-08-27T03:58:31.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11985393039825350781', time=2024-08-27T05:28:44.266928+0000, chain.objs.size()=1 2024-08-27T03:58:31.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.373__shadow_.WA7fJupx92EAS8b5AvCdXm7dGI3-hbk_0 2024-08-27T03:58:31.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10912961339882789973', time=2024-08-27T05:28:50.871165+0000, chain.objs.size()=1 2024-08-27T03:58:31.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.377__shadow_.kZmYq3xaxGN8PWWIaBk99eeg1wiqkRb_0 2024-08-27T03:58:31.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9184577460496582880', time=2024-08-27T05:31:28.481979+0000, chain.objs.size()=1 2024-08-27T03:58:31.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.477__shadow_.wDB1Q1cLnQf_ALW5IJ-UksTb5vJ3Xak_0 2024-08-27T03:58:31.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15935617021864058234', time=2024-08-27T05:31:56.300489+0000, chain.objs.size()=1 2024-08-27T03:58:31.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.491__shadow_.ARuuQFF1O7SUN3G4kBYF2jjBwUJqBWV_0 2024-08-27T03:58:31.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11287116630803620120', time=2024-08-27T05:32:21.557623+0000, chain.objs.size()=6 2024-08-27T03:58:31.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.1 2024-08-27T03:58:31.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.775+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.2 2024-08-27T03:58:31.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.3 2024-08-27T03:58:31.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.4 2024-08-27T03:58:31.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.779+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.5 2024-08-27T03:58:31.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.6 2024-08-27T03:58:31.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5003305186763242023', time=2024-08-27T05:32:21.580020+0000, chain.objs.size()=6 2024-08-27T03:58:31.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.1 2024-08-27T03:58:31.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.2 2024-08-27T03:58:31.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.3 2024-08-27T03:58:31.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.4 2024-08-27T03:58:31.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.5 2024-08-27T03:58:31.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.501__multipart_srcmultipart.2~fRcnJTztGaH2AbaDt3I2AvOXjgJnUUI.6 2024-08-27T03:58:31.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7260404246798037516', time=2024-08-27T05:34:56.218633+0000, chain.objs.size()=1 2024-08-27T03:58:31.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.517__multipart_mymultipart.2~KLScb-Z_9Fc-onqzkCNMQ8KzgEdxinv.1 2024-08-27T03:58:31.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6919703963486354441', time=2024-08-27T05:37:09.252628+0000, chain.objs.size()=1 2024-08-27T03:58:31.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.549__shadow_.4ZY32dlhzAsotya1gGaaOtVOFlLDddU_0 2024-08-27T03:58:31.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3114528029023378152', time=2024-08-27T05:37:58.617537+0000, chain.objs.size()=1 2024-08-27T03:58:31.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.783+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:oQlLJHez-57STR0UueFsHG7Px0ySBeu_.KvpiqoaG2DkMnGL0XZJg_nhuR0HNLUj_0 2024-08-27T03:58:31.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11774748313145931642', time=2024-08-27T05:38:07.169239+0000, chain.objs.size()=1 2024-08-27T03:58:31.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.563__shadow:jAAGbddK0014MP1qr3fuUTPj8U6GL8z_.Aek1uXJrIkm28olqdu5A4DHdt-wZfVn_0 2024-08-27T03:58:31.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12124419238430445853', time=2024-08-27T05:38:15.802422+0000, chain.objs.size()=1 2024-08-27T03:58:31.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.565__shadow_.EDxuk9MMmMcanFNwyslXpMawdHLk0TV_0 2024-08-27T03:58:31.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3602387337823722668', time=2024-08-27T05:38:17.986043+0000, chain.objs.size()=1 2024-08-27T03:58:31.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.566__shadow:nvj.KIjU1W60ankFJkfM9H8ZiEZ3LRL_.4HRzAZQUbAOPrcGTPqw4bDlPs5MxFnS_0 2024-08-27T03:58:31.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1990868624901570312', time=2024-08-27T05:38:53.144529+0000, chain.objs.size()=1 2024-08-27T03:58:31.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.787+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:Zhfs3haDDebpxhQdey1lTwSrmc3YAOu_.ccQS5CUU3s_A0HSELtBOIVaUuC13dvY_0 2024-08-27T03:58:31.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11306751871696728246', time=2024-08-27T05:39:26.853414+0000, chain.objs.size()=1 2024-08-27T03:58:31.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.571__shadow:Ag74umOFcihneQ72c..3WB.oiEmIpYp_.21VpS_9K8vc8EeqlaLDQICvKSj7oVzl_0 2024-08-27T03:58:31.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15625303403956592324', time=2024-08-27T05:45:25.095669+0000, chain.objs.size()=1 2024-08-27T03:58:31.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.624__shadow_.A3nEqnDcAJttZ2edoQ4FqNo2kmAo7Gj_0 2024-08-27T03:58:31.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17848275398262924430', time=2024-08-27T05:46:03.977064+0000, chain.objs.size()=1 2024-08-27T03:58:31.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.643__shadow_.hp0Q8FucjF9Lx-_8V1nK_KtS8DM5lS__0 2024-08-27T03:58:31.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16819438268906518267', time=2024-08-27T05:46:58.862629+0000, chain.objs.size()=1 2024-08-27T03:58:31.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.662__shadow_.xIXEldN3daQB-EfNWfqEl2KWQ6Zdhwl_0 2024-08-27T03:58:31.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12607023156204383566', time=2024-08-27T05:47:01.099177+0000, chain.objs.size()=1 2024-08-27T03:58:31.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.664__shadow_.ZCztjkWB_3RR2G_FM9n2ilYDADNc0An_0 2024-08-27T03:58:31.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12105969293232434677', time=2024-08-27T05:47:45.867252+0000, chain.objs.size()=1 2024-08-27T03:58:31.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.694__shadow:7ghbuUZWGA.Rdo9b4FasGQkNCH73LD9_.Tt0kqZgHcdm5YnPdLpoSJEfZ7bMPDW3_0 2024-08-27T03:58:31.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.18269638077092209102', time=2024-08-27T05:48:10.311137+0000, chain.objs.size()=1 2024-08-27T03:58:31.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.791+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.708__shadow:dinNnc6oMdD0FdOtHA3T9ujS7UvA7XY_.cGP2US10UL4TMyjDuUETwhMPhiaOnum_0 2024-08-27T03:58:31.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.795+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2225106375679215983', time=2024-08-27T05:49:15.162023+0000, chain.objs.size()=1 2024-08-27T03:58:31.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.795+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.733__shadow_.O5pZlGW1zvblLa1W2xlJ-3qMcAl031z_0 2024-08-27T03:58:31.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.799+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.799+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-08-27T03:58:31.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-08-27T03:58:31.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-08-27T03:58:31.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44310' 2024-08-27T03:58:31.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8864578465220467050', time=2024-08-27T05:13:56.619015+0000, chain.objs.size()=1 2024-08-27T03:58:31.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.165__shadow_.R2ZNq9tXhGew8EwZSK4o2ejsSauolb5_0 2024-08-27T03:58:31.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13917153082712271365', time=2024-08-27T05:18:16.489884+0000, chain.objs.size()=1 2024-08-27T03:58:31.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.236__shadow_.Vj_TrYPPc9NQxU5m7jDWI7sipZXRJpp_0 2024-08-27T03:58:31.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2686080245831620781', time=2024-08-27T05:18:19.195228+0000, chain.objs.size()=1 2024-08-27T03:58:31.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.237__shadow_.xobApk2F2T9DH_Ebq_floAmVLiid5yJ_0 2024-08-27T03:58:31.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2798185499016286233', time=2024-08-27T05:18:21.911155+0000, chain.objs.size()=1 2024-08-27T03:58:31.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.238__shadow_.r2KPnCe6jQjWRKqUemp6FhQkZe7H8I2_0 2024-08-27T03:58:31.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5219283986738165432', time=2024-08-27T05:18:29.294597+0000, chain.objs.size()=1 2024-08-27T03:58:31.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.242__shadow_.R8yM8fBQd7VzLCtSNDPbjS1g0JH3cT7_0 2024-08-27T03:58:31.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11974585136052327842', time=2024-08-27T05:20:35.195145+0000, chain.objs.size()=1 2024-08-27T03:58:31.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.eUSXpg-EhBrhP2bKr07nQ4Si-ZPhor5_0 2024-08-27T03:58:31.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9631070022123384371', time=2024-08-27T05:20:35.359190+0000, chain.objs.size()=1 2024-08-27T03:58:31.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zBFw76yvvgBDlXwukXFBsGIiUGmAqwL_0 2024-08-27T03:58:31.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2929993001550728382', time=2024-08-27T05:20:42.188253+0000, chain.objs.size()=1 2024-08-27T03:58:31.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.R38wrkzunJs6YRdMdsXsnP2BjNBPLIq_0 2024-08-27T03:58:31.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8024910804607098898', time=2024-08-27T05:20:44.318329+0000, chain.objs.size()=1 2024-08-27T03:58:31.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.l3Ds3bx97SNqWG5NkvslFY-nEIovSMi_0 2024-08-27T03:58:31.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2463071680433381224', time=2024-08-27T05:20:44.822603+0000, chain.objs.size()=1 2024-08-27T03:58:31.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.O1Ka1qb_heorD0IZloSW5uKeVbiBOvC_0 2024-08-27T03:58:31.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9042913504264903472', time=2024-08-27T05:20:45.270323+0000, chain.objs.size()=1 2024-08-27T03:58:31.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XKmVwETEmU7b4VimMyKluUSYNpm7p9l_0 2024-08-27T03:58:31.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11103148723840617208', time=2024-08-27T05:20:45.969401+0000, chain.objs.size()=1 2024-08-27T03:58:31.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.803+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.SjJHEoHmm5CaVxLFExmY_A83kxtO-jq_0 2024-08-27T03:58:31.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8780514542802635790', time=2024-08-27T05:20:47.499449+0000, chain.objs.size()=1 2024-08-27T03:58:31.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.EJbPhxy7oLUjkAad1oKB_Y40XqX1y-o_0 2024-08-27T03:58:31.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17790233499050851102', time=2024-08-27T05:20:47.998492+0000, chain.objs.size()=1 2024-08-27T03:58:31.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0SfEaDumlPkcuu5-Q2BM3p_NFfyV9oE_0 2024-08-27T03:58:31.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7010906067887871554', time=2024-08-27T05:20:48.334753+0000, chain.objs.size()=1 2024-08-27T03:58:31.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.lbr90bo4yapjraoBbk1jOGJgF5pDEpw_0 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13991423022221026330', time=2024-08-27T05:20:49.109856+0000, chain.objs.size()=1 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.kMSP5j9HmevBbiwf_LgYUwOSpUtqhKD_0 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.737609844783760220', time=2024-08-27T05:20:49.215879+0000, chain.objs.size()=1 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.807+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.fyCcXXQODhxZZMA4TbVSdR5ENRlz_mh_0 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14798469291951160174', time=2024-08-27T05:20:50.775114+0000, chain.objs.size()=1 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.B9f7f3vKQ3BqMRampvwoFmZaWDDbcce_0 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2797929658697301725', time=2024-08-27T05:20:51.001721+0000, chain.objs.size()=1 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.XupUcam21NdUwgUlKOBrp5L4v3TFBy2_0 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17541984321436737141', time=2024-08-27T05:20:51.647201+0000, chain.objs.size()=1 2024-08-27T03:58:31.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.joUO_V066xIBBb4mnz7WtarmNJivnuk_0 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9027165980079600109', time=2024-08-27T05:20:52.932667+0000, chain.objs.size()=1 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.CPhGMUAxdsM4iC4rPVSoVs1d7FtqZcL_0 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5865405014334894897', time=2024-08-27T05:20:52.934486+0000, chain.objs.size()=1 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zCc_4scLFFcO68T5VL8QrJK9zHU_kp-_0 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1757126384083482567', time=2024-08-27T05:20:53.628117+0000, chain.objs.size()=1 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.0YHut1NMizmXwE7rZhHeLLZjl1VXRDa_0 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13443711144906526181', time=2024-08-27T05:20:56.301234+0000, chain.objs.size()=1 2024-08-27T03:58:31.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.7ikq5DZRktzaHeqUcdmMRiAs8sGQkZR_0 2024-08-27T03:58:31.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9019109539787163756', time=2024-08-27T05:20:56.859913+0000, chain.objs.size()=1 2024-08-27T03:58:31.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.5MjZQceLYYaeWp43XeoFUZVh88eGSBZ_0 2024-08-27T03:58:31.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7062459921550951120', time=2024-08-27T05:20:58.371610+0000, chain.objs.size()=1 2024-08-27T03:58:31.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.6IlSishpfP0hG-C9jJAqhWN7SPZAdDx_0 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13771116903605500021', time=2024-08-27T05:20:58.611475+0000, chain.objs.size()=1 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.zl59eVCIpDqSOosey26Q-dx8OV-K7m6_0 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11139572448961179064', time=2024-08-27T05:20:58.939001+0000, chain.objs.size()=1 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.811+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.J_9lBxdcttUiIssZBEot-1is8Njhe8l_0 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5047217256701370906', time=2024-08-27T05:20:59.322280+0000, chain.objs.size()=1 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.3nmHSTwZdJIZRWB7ClIJ0OIzz4o7sSX_0 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16187270041383890192', time=2024-08-27T05:21:00.004250+0000, chain.objs.size()=1 2024-08-27T03:58:31.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.PLf0gWJfiX1N97vDTbiufiUPy80RWWh_0 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8721778537084078390', time=2024-08-27T05:21:00.352090+0000, chain.objs.size()=1 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.WnVjC8-7gZV7a4WZrWq154DFgvoXeUH_0 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.641969479720737775', time=2024-08-27T05:21:01.702481+0000, chain.objs.size()=1 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.jBJBdDMEEwhLqCl7UNmRz9yFQgOi8hs_0 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1855578918169880196', time=2024-08-27T05:21:02.738654+0000, chain.objs.size()=1 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.256__shadow_.BPUFvjCz_WFOsFtG4NbSamq0je1Duyq_0 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14864150831682732091', time=2024-08-27T05:21:19.732618+0000, chain.objs.size()=1 2024-08-27T03:58:31.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.265__shadow_.xeUaYBWIRnr9ykoABZXK2y82z7putnd_0 2024-08-27T03:58:31.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5142896210200016502', time=2024-08-27T05:22:02.836509+0000, chain.objs.size()=1 2024-08-27T03:58:31.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.286__shadow_.9OFmYif-UPu13TL-QtW8GjXdnjtZMmx_0 2024-08-27T03:58:31.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8425284224180054031', time=2024-08-27T05:22:08.112962+0000, chain.objs.size()=1 2024-08-27T03:58:31.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.287__shadow_.zExdER08eIGnH9rWF2_BHer7C6_xThw_0 2024-08-27T03:58:31.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.226423643026344456', time=2024-08-27T05:22:17.584776+0000, chain.objs.size()=1 2024-08-27T03:58:31.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.292__shadow_.G_xZ_WB95nFyHKBRkBE0oIov_Ttqqqh_0 2024-08-27T03:58:31.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17010555076027951149', time=2024-08-27T05:22:27.064073+0000, chain.objs.size()=1 2024-08-27T03:58:31.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.815+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.297__shadow_.v0TlVVgSEFwztCahKnhwla3uei8I1mr_0 2024-08-27T03:58:31.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4287657904276173137', time=2024-08-27T05:24:46.520761+0000, chain.objs.size()=1 2024-08-27T03:58:31.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.eTAfS4LMpt5HN9uuHZRUHpcUUS2h0-o_0 2024-08-27T03:58:31.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13354843208140019635', time=2024-08-27T05:24:46.821119+0000, chain.objs.size()=1 2024-08-27T03:58:31.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5o-cnA-zLQcx8dHSk4c8LnAlxnt3dTh_0 2024-08-27T03:58:31.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1923073790104079331', time=2024-08-27T05:24:47.468822+0000, chain.objs.size()=1 2024-08-27T03:58:31.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xi5Oc5ZYuv034qVPRCFKt1nze5uYvai_0 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1841135669794788601', time=2024-08-27T05:24:49.125876+0000, chain.objs.size()=1 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.819+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.L7qVrvMpK0YHFRfdTQRIvvlRnVK1ziS_0 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11459826498571113604', time=2024-08-27T05:24:50.463758+0000, chain.objs.size()=1 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.fHWKhb_bN4Q9sx9rXSP5wWQdbn8jlIN_0 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12052324753388205231', time=2024-08-27T05:24:52.290595+0000, chain.objs.size()=1 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Af6Hbssf5MXsq52aJD5h5J-hcfGj5Gp_0 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13303015378516646782', time=2024-08-27T05:24:52.377051+0000, chain.objs.size()=1 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.U8ylkgVF-QNzLrYQ32yURGJSvlGWQX-_0 2024-08-27T03:58:31.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15994794195043193589', time=2024-08-27T05:24:52.810767+0000, chain.objs.size()=1 2024-08-27T03:58:31.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.MrImuSkqzdSmpBorYLjNDJfMzeyUdR6_0 2024-08-27T03:58:31.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2905402096269438663', time=2024-08-27T05:24:52.955714+0000, chain.objs.size()=1 2024-08-27T03:58:31.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Ch3tIRocXG4KaePJG5ev1IfZD_Sp4vi_0 2024-08-27T03:58:31.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9914915510113472494', time=2024-08-27T05:24:53.204698+0000, chain.objs.size()=1 2024-08-27T03:58:31.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.BfJ6y7kkmdnvEZPAdxAfpIgXRPxgVzF_0 2024-08-27T03:58:31.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1890950724553480026', time=2024-08-27T05:24:57.080215+0000, chain.objs.size()=1 2024-08-27T03:58:31.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ZAwFhVu0Aq_DEwzNZuyZIQ6PE0Qhpyu_0 2024-08-27T03:58:31.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8062301493346685294', time=2024-08-27T05:24:57.082300+0000, chain.objs.size()=1 2024-08-27T03:58:31.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.823+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.hTSftQhwlItQAHgeadtDfVEXxEmCpeo_0 2024-08-27T03:58:31.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5109521323685287213', time=2024-08-27T05:24:57.139930+0000, chain.objs.size()=1 2024-08-27T03:58:31.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0hgKG7AErIl_bk0nHjyo8A3VcR6Gapx_0 2024-08-27T03:58:31.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15708413623570696319', time=2024-08-27T05:24:57.141296+0000, chain.objs.size()=1 2024-08-27T03:58:31.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.FJxNXsgDLcTaizJ2acOxAZV50c-NPWK_0 2024-08-27T03:58:31.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6443249670960023126', time=2024-08-27T05:24:57.167050+0000, chain.objs.size()=1 2024-08-27T03:58:31.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.8gcTG6V1-FR37v-ZC4yl174mvnr0Tpd_0 2024-08-27T03:58:31.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6822725971931085138', time=2024-08-27T05:24:58.809547+0000, chain.objs.size()=1 2024-08-27T03:58:31.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.0hK5QZ9NG1Zn30WmH8uex4akSAuArI__0 2024-08-27T03:58:31.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13972303383301714398', time=2024-08-27T05:25:00.026363+0000, chain.objs.size()=1 2024-08-27T03:58:31.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.waAazrwSMyziXdMcb4t0z5baUPQIhhv_0 2024-08-27T03:58:31.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12765526264789204786', time=2024-08-27T05:25:00.846329+0000, chain.objs.size()=1 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Q_qk_figYTurlpYZ1TKuP01kQ26mC4f_0 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17704343563440217659', time=2024-08-27T05:25:01.740713+0000, chain.objs.size()=1 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_._AjwdYPJjDjS4lhr8cJ7IcojqaN5BnA_0 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17337555715208951092', time=2024-08-27T05:25:03.304993+0000, chain.objs.size()=1 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.Gli2Wb5U7iMtU7RmGDw_Iv-JqZuCl9L_0 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12815101338519740302', time=2024-08-27T05:25:04.099836+0000, chain.objs.size()=1 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.bl93nYni00VlnDmjc6vGBEsfAobOnBb_0 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10048698541264739239', time=2024-08-27T05:25:05.599542+0000, chain.objs.size()=1 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.82lIGHneiKWsYLYzPoUCrClgmk-QtVJ_0 2024-08-27T03:58:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5949714050306947930', time=2024-08-27T05:25:06.664075+0000, chain.objs.size()=1 2024-08-27T03:58:31.833 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.827+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.cNrcA3deNIT9YB9f8gDydrHbZcK8Qlf_0 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16428029929280221000', time=2024-08-27T05:25:07.174435+0000, chain.objs.size()=1 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.yRDRW8aKsce-Qh8xwoe6Xfzh1gndjFm_0 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17855986541957522913', time=2024-08-27T05:25:08.032922+0000, chain.objs.size()=1 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.__83G6UZFMf8rIUELfkQlMzBLpqO74h_0 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15009726803589875569', time=2024-08-27T05:25:09.117085+0000, chain.objs.size()=1 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.2XKdyMEenpt102RhIJkLH_jcsjINvUD_0 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17171783281082780215', time=2024-08-27T05:25:09.293355+0000, chain.objs.size()=1 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5aQ-7gJmB3Y30IT0KZA3gAOEa-PhCVU_0 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15403385994276091556', time=2024-08-27T05:25:09.954377+0000, chain.objs.size()=1 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.3vElqGCHe-VcsxrxX5Dr7FfyZPCX9LM_0 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12156547185249574827', time=2024-08-27T05:25:10.267404+0000, chain.objs.size()=1 2024-08-27T03:58:31.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.EvbxD7QtnhfbcCCjx02Nn6c2tWg9K8O_0 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.17504683634441135975', time=2024-08-27T05:25:10.804770+0000, chain.objs.size()=1 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.831+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.xaNX9q4oxPl87whGyoQJ6zfF_JdBMpV_0 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16809124786310323583', time=2024-08-27T05:25:10.987820+0000, chain.objs.size()=1 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.34zu3fDvzlDyKV-7XM0sj6IjfdyyaZc_0 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9988728521655824937', time=2024-08-27T05:25:11.186618+0000, chain.objs.size()=1 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.ujvip4aB0ZGd3fvXFTOwBHAaUjmWtf2_0 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8033778022958113554', time=2024-08-27T05:25:13.145075+0000, chain.objs.size()=1 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.T7gXNJUvFTEuxD4Em0_klQOTXNobQ0C_0 2024-08-27T03:58:31.837 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9719968902223918194', time=2024-08-27T05:25:13.374766+0000, chain.objs.size()=1 2024-08-27T03:58:31.838 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.835+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.w-R3B6wh06H2Mzf4qfj07xWVb2L39Nk_0 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16463940266499953705', time=2024-08-27T05:25:14.470851+0000, chain.objs.size()=1 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.317__shadow_.5xa4lwta5OsdRz_Gy8B_cKMBfWisr9l_0 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6658114676267432220', time=2024-08-27T05:26:57.836843+0000, chain.objs.size()=1 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZF-yFgBErdq65HCHRLq2jVkrs1lk_Og_0 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9476246870315059235', time=2024-08-27T05:26:58.188992+0000, chain.objs.size()=1 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.RoiwP9kutURUcDHrTYFqxAUlus0QLrx_0 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4682350895238045996', time=2024-08-27T05:26:58.875249+0000, chain.objs.size()=1 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.sHEUt9kOt5qsMjjZkRoVzcMFh9LxAim_0 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9225885447762764533', time=2024-08-27T05:26:59.305367+0000, chain.objs.size()=1 2024-08-27T03:58:31.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QGW2jllUm8-TDrjGrrJ5dTscgXTdQRK_0 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.119433276355930570', time=2024-08-27T05:27:05.755726+0000, chain.objs.size()=1 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.wV2bJlt0Ekhp1MB4wUpxps-LfV_STuy_0 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15344418026296103361', time=2024-08-27T05:27:07.364470+0000, chain.objs.size()=1 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LeBB27zsY17ceqsH3K_vBlfuFZSp_oD_0 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5139066093749362105', time=2024-08-27T05:27:07.932602+0000, chain.objs.size()=1 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.bkL6L2AP-C6sp67vmCxocrwUx25njXL_0 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3266123032380563386', time=2024-08-27T05:27:08.161152+0000, chain.objs.size()=1 2024-08-27T03:58:31.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.S6KYJG-FjfBJfYYj9-SKzDhdPACSkUm_0 2024-08-27T03:58:31.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.1556856960095798623', time=2024-08-27T05:27:08.163056+0000, chain.objs.size()=1 2024-08-27T03:58:31.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.DmiLdnSZ2ZB91FW8L5_XiHPbByISGRR_0 2024-08-27T03:58:31.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2045849657357790626', time=2024-08-27T05:27:09.158263+0000, chain.objs.size()=1 2024-08-27T03:58:31.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.839+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.OBfXhAa3Elfszxk0cDK_n-FgEQp1ljq_0 2024-08-27T03:58:31.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14737313431182017054', time=2024-08-27T05:27:09.658339+0000, chain.objs.size()=1 2024-08-27T03:58:31.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.gR3g-rnX6Og6NFNX-i-ooBYQ7A2kTwn_0 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5891785816146351439', time=2024-08-27T05:27:09.981882+0000, chain.objs.size()=1 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.NaSooo1nra2Te7qHGHCbI-maUix_CDx_0 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10089011832091012697', time=2024-08-27T05:27:10.791293+0000, chain.objs.size()=1 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.idQRA3XcURx1KT8_0fjU7Q9yn4Syif3_0 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7395345195161125914', time=2024-08-27T05:27:13.388224+0000, chain.objs.size()=1 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.cjyv5wy-uEFqJUlvbt3F_dnne424_vh_0 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3593492573484397381', time=2024-08-27T05:27:14.071884+0000, chain.objs.size()=1 2024-08-27T03:58:31.848 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.843+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.uf9C6u_hcTRnERl3YdB6tn47Xi0lmGN_0 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10934502712915617612', time=2024-08-27T05:27:14.933533+0000, chain.objs.size()=1 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N8V2GL2G-n7b1DyRuPfwLUDpbCn_JcT_0 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.10908560286814150125', time=2024-08-27T05:27:16.551245+0000, chain.objs.size()=1 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.vVNSLjLMuWKi7pJT5rPxDAi3YX98fs5_0 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.84288162267666679', time=2024-08-27T05:27:17.155494+0000, chain.objs.size()=1 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.i8hm9e7hvw8WQ8Bgq7JNgP2fA6a8FF5_0 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16247325540100852512', time=2024-08-27T05:27:17.894075+0000, chain.objs.size()=1 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.LkPs7TmjhmS0tHOlsTsQVfPpVWznxO4_0 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.14853477423715596895', time=2024-08-27T05:27:18.090041+0000, chain.objs.size()=1 2024-08-27T03:58:31.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.evjHf_8fr5WDR4nRWdHUo-YBrMNI-Gn_0 2024-08-27T03:58:31.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16638396374260921781', time=2024-08-27T05:27:20.696748+0000, chain.objs.size()=1 2024-08-27T03:58:31.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.847+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.35c-5TFWv4FXq1n55tWzzQmN2Kej0Bo_0 2024-08-27T03:58:31.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13244243672750558710', time=2024-08-27T05:27:20.737646+0000, chain.objs.size()=1 2024-08-27T03:58:31.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.w0a2JDTkDFcLl4gvY9K5ii8m-8au7OQ_0 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.8670420262729771699', time=2024-08-27T05:27:22.614639+0000, chain.objs.size()=1 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.MyP69LJnX40Y89_S52uJEWxj4NUIkWr_0 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2660703915882100877', time=2024-08-27T05:27:23.873771+0000, chain.objs.size()=1 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.QFjGNhzqGADstzVuoBnigxFESu3iOxU_0 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7182718353480976022', time=2024-08-27T05:27:23.875363+0000, chain.objs.size()=1 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.TSnRA8iFezsq1MGV-QP-lX7FslByjbs_0 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16253737441726284253', time=2024-08-27T05:27:24.194945+0000, chain.objs.size()=1 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.ZrEIJGCRa8E8qCPtEP97hOYYPfpUJ2A_0 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7292887529779638941', time=2024-08-27T05:27:24.901182+0000, chain.objs.size()=1 2024-08-27T03:58:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.851+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.s7dlpFYwT_ua2BEjSQF_IbTxNIja2Qd_0 2024-08-27T03:58:31.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.855+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44310 2024-08-27T03:58:31.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-08-27T03:58:31.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.9215144745721417322', time=2024-08-27T05:27:24.968993+0000, chain.objs.size()=1 2024-08-27T03:58:31.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.hFz6F3eZZBoBpMeWifbtYBq4f-AzvD2_0 2024-08-27T03:58:31.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5755251851947109999', time=2024-08-27T05:27:25.333672+0000, chain.objs.size()=1 2024-08-27T03:58:31.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.p-vS9u1DcEtlrimJrcyn8JW4gWxidZf_0 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11849947368725744281', time=2024-08-27T05:27:25.337295+0000, chain.objs.size()=1 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.N5IQg_mgxHiWXMsAQusXAsu-gQb0rpg_0 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12817761816701117378', time=2024-08-27T05:27:25.417478+0000, chain.objs.size()=1 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.318__shadow_.s2T7K7rvKSQDDOAMP2nMJMGaz2-XaRX_0 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.7320743198394792212', time=2024-08-27T05:27:38.037559+0000, chain.objs.size()=1 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.326__shadow_.mlX-FkF8DwctjfEIPqkPi29GLRNdRL7_0 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.11011356417594567587', time=2024-08-27T05:28:47.009615+0000, chain.objs.size()=1 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.375__shadow_.ZkFr-FvXHSaVybzGU7Jrm8InCusj1un_0 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.13351198867658553362', time=2024-08-27T05:32:25.994777+0000, chain.objs.size()=1 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.505__multipart_mymultipart.2~g1JrMJDVfejnwEpGW1Legir50OwBB8B.1 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-hg-l_vQZ8hV5h8NbipZgLCHnp-o9PO', time=2024-08-27T05:34:03.382518+0000, chain.objs.size()=1 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.516__multipart_mymultipart.2~-hg-l_vQZ8hV5h8NbipZgLCHnp-o9PO.3 2024-08-27T03:58:31.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.4373791630580749305', time=2024-08-27T05:37:12.100465+0000, chain.objs.size()=1 2024-08-27T03:58:31.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.550__shadow_.Az5Ae9Z7dUtP5j2qf39iGZ925AQW11N_0 2024-08-27T03:58:31.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.2531000824204220537', time=2024-08-27T05:38:28.987319+0000, chain.objs.size()=1 2024-08-27T03:58:31.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.568__shadow:wrGdPs4WCyGfyBdnJ8LKZI4Qkc5ScZw_.n3Mn5IlG88D2IZOICtO38VXep2x0eNa_0 2024-08-27T03:58:31.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.15557086553107546436', time=2024-08-27T05:39:47.368150+0000, chain.objs.size()=4 2024-08-27T03:58:31.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~wJLON0qlz-ou5QZ2O1B6o71miedl1-e.1 2024-08-27T03:58:31.862 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.859+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~wJLON0qlz-ou5QZ2O1B6o71miedl1-e.2 2024-08-27T03:58:31.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~wJLON0qlz-ou5QZ2O1B6o71miedl1-e.3 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.572__multipart_testobj.2~wJLON0qlz-ou5QZ2O1B6o71miedl1-e.4 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.3184722326207169971', time=2024-08-27T05:40:16.523072+0000, chain.objs.size()=1 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.581__shadow:s1Eednor52DeN48jphdOkk.oRnUHAEh_.ewBqSsdfHvTta_5EaV7lslL_rJGg4vf_0 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.6156703641020106759', time=2024-08-27T05:40:42.526600+0000, chain.objs.size()=1 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.599__shadow_.yC4TsEWvLmGgsJmAbaGjZrNNX0gvXDa_0 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.12472793286043825687', time=2024-08-27T05:40:44.087107+0000, chain.objs.size()=1 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.600__shadow_.RkKnmKtmlfxNFXan7U4UnXKsfhcKPbT_0 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.5072685609192802313', time=2024-08-27T05:45:26.600857+0000, chain.objs.size()=1 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.625__shadow_.o8hBHSATcHVWCK2mOabNJNsUu4LmfIW_0 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 20 garbage collection: RGWGC::process iterating over entry tag='3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.16626646087159059340', time=2024-08-27T05:47:03.204395+0000, chain.objs.size()=1 2024-08-27T03:58:31.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.863+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3a884aa2-81b8-4172-8e69-44ac4b13efc2.4528.665__shadow_.3KDt97TUyryIAhd6vOGAf5MnCoaVoGw_0 2024-08-27T03:58:31.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.871+0000 7f1ca364c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-08-27T03:58:31.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.875+0000 7f1b57fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-08-27T03:58:31.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.875+0000 7f1ca364c9c0 20 remove_watcher() i=0 2024-08-27T03:58:31.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.875+0000 7f1ca364c9c0 2 removed watcher, disabling cache 2024-08-27T03:58:31.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.875+0000 7f1ca364c9c0 20 remove_watcher() i=1 2024-08-27T03:58:31.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.879+0000 7f1ca364c9c0 20 remove_watcher() i=2 2024-08-27T03:58:31.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.879+0000 7f1ca364c9c0 20 remove_watcher() i=3 2024-08-27T03:58:31.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.879+0000 7f1ca364c9c0 20 remove_watcher() i=4 2024-08-27T03:58:31.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.879+0000 7f1ca364c9c0 20 remove_watcher() i=5 2024-08-27T03:58:31.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.883+0000 7f1ca364c9c0 20 remove_watcher() i=6 2024-08-27T03:58:31.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-08-27T03:58:31.883+0000 7f1ca364c9c0 20 remove_watcher() i=7 2024-08-27T03:58:31.897 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-08-27T03:58:31.909 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-27T03:58:31.928 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-27T03:58:31.929 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T03:58:32.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-08-27T03:58:32.271 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:58:32.286 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T03:58:32.293 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2892,"stamp":"2024-08-27T03:58:31.279856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":340716903,"num_objects":3195,"num_object_clones":0,"num_object_copies":11764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3195,"num_whiteouts":0,"num_read":285234,"num_read_kb":2573635,"num_write":157223,"num_write_kb":2372713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13502,"ondisk_log_size":13502,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2507492,"kb_used_data":841788,"kb_used_omap":12,"kb_used_meta":1665203,"kb_avail":752467228,"statfs":{"total":773094113280,"available":770526441472,"internally_reserved":0,"allocated":861990912,"data_stored":845835519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1705168433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-332165186,"num_objects":-1734,"num_object_clones":0,"num_object_copies":-6884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1734,"num_whiteouts":0,"num_read":1976,"num_read_kb":1992,"num_write":1855,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008003"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875576+0000","last_change":"2024-08-27T03:10:45.291800+0000","last_active":"2024-08-27T03:55:44.875576+0000","last_peered":"2024-08-27T03:55:44.875576+0000","last_clean":"2024-08-27T03:55:44.875576+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:55:44.875576+0000","last_undegraded":"2024-08-27T03:55:44.875576+0000","last_fullsized":"2024-08-27T03:55:44.875576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:23:36.039939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.913854+0000","last_change":"2024-08-27T02:50:55.799193+0000","last_active":"2024-08-27T03:58:24.913854+0000","last_peered":"2024-08-27T03:58:24.913854+0000","last_clean":"2024-08-27T03:58:24.913854+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:58:24.913854+0000","last_undegraded":"2024-08-27T03:58:24.913854+0000","last_fullsized":"2024-08-27T03:58:24.913854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:21:44.106748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.896443+0000","last_change":"2024-08-27T02:50:51.735635+0000","last_active":"2024-08-27T03:55:54.896443+0000","last_peered":"2024-08-27T03:55:54.896443+0000","last_clean":"2024-08-27T03:55:54.896443+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:55:54.896443+0000","last_undegraded":"2024-08-27T03:55:54.896443+0000","last_fullsized":"2024-08-27T03:55:54.896443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:41.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.292121+0000","last_change":"2024-08-27T02:46:49.663999+0000","last_active":"2024-08-27T03:55:35.292121+0000","last_peered":"2024-08-27T03:55:35.292121+0000","last_clean":"2024-08-27T03:55:35.292121+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:55:35.292121+0000","last_undegraded":"2024-08-27T03:55:35.292121+0000","last_fullsized":"2024-08-27T03:55:35.292121+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:06:26.935384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073515+0000","last_change":"2024-08-27T03:10:45.296108+0000","last_active":"2024-08-27T03:55:45.073515+0000","last_peered":"2024-08-27T03:55:45.073515+0000","last_clean":"2024-08-27T03:55:45.073515+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:55:45.073515+0000","last_undegraded":"2024-08-27T03:55:45.073515+0000","last_fullsized":"2024-08-27T03:55:45.073515+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:12.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128164+0000","last_change":"2024-08-27T02:50:55.775244+0000","last_active":"2024-08-27T03:58:25.128164+0000","last_peered":"2024-08-27T03:58:25.128164+0000","last_clean":"2024-08-27T03:58:25.128164+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:58:25.128164+0000","last_undegraded":"2024-08-27T03:58:25.128164+0000","last_fullsized":"2024-08-27T03:58:25.128164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:30.406512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076691+0000","last_change":"2024-08-27T02:50:51.735266+0000","last_active":"2024-08-27T03:55:51.076691+0000","last_peered":"2024-08-27T03:55:51.076691+0000","last_clean":"2024-08-27T03:55:51.076691+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:55:51.076691+0000","last_undegraded":"2024-08-27T03:55:51.076691+0000","last_fullsized":"2024-08-27T03:55:51.076691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:50:41.400577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064603+0000","last_change":"2024-08-27T02:46:49.676761+0000","last_active":"2024-08-27T03:55:05.064603+0000","last_peered":"2024-08-27T03:55:05.064603+0000","last_clean":"2024-08-27T03:55:05.064603+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:55:05.064603+0000","last_undegraded":"2024-08-27T03:55:05.064603+0000","last_fullsized":"2024-08-27T03:55:05.064603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:59:06.352477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.436334+0000","last_change":"2024-08-27T03:10:45.294573+0000","last_active":"2024-08-27T03:54:15.436334+0000","last_peered":"2024-08-27T03:54:15.436334+0000","last_clean":"2024-08-27T03:54:15.436334+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:54:15.436334+0000","last_undegraded":"2024-08-27T03:54:15.436334+0000","last_fullsized":"2024-08-27T03:54:15.436334+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:54.922215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290928+0000","last_change":"2024-08-27T02:50:55.791602+0000","last_active":"2024-08-27T03:55:30.290928+0000","last_peered":"2024-08-27T03:55:30.290928+0000","last_clean":"2024-08-27T03:55:30.290928+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:55:30.290928+0000","last_undegraded":"2024-08-27T03:55:30.290928+0000","last_fullsized":"2024-08-27T03:55:30.290928+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:05.925142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'10","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.880591+0000","last_change":"2024-08-27T02:50:51.729715+0000","last_active":"2024-08-27T03:58:29.880591+0000","last_peered":"2024-08-27T03:58:29.880591+0000","last_clean":"2024-08-27T03:58:29.880591+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:58:29.880591+0000","last_undegraded":"2024-08-27T03:58:29.880591+0000","last_fullsized":"2024-08-27T03:58:29.880591+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:26.531591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60362,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":21563,"num_write":15,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494185+0000","last_change":"2024-08-27T02:46:49.653398+0000","last_active":"2024-08-27T03:54:20.494185+0000","last_peered":"2024-08-27T03:54:20.494185+0000","last_clean":"2024-08-27T03:54:20.494185+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:54:20.494185+0000","last_undegraded":"2024-08-27T03:54:20.494185+0000","last_fullsized":"2024-08-27T03:54:20.494185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:50.129103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871224+0000","last_change":"2024-08-27T03:10:45.281316+0000","last_active":"2024-08-27T03:54:29.871224+0000","last_peered":"2024-08-27T03:54:29.871224+0000","last_clean":"2024-08-27T03:54:29.871224+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:54:29.871224+0000","last_undegraded":"2024-08-27T03:54:29.871224+0000","last_fullsized":"2024-08-27T03:54:29.871224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:26.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.887006+0000","last_change":"2024-08-27T02:50:55.794295+0000","last_active":"2024-08-27T03:55:14.887006+0000","last_peered":"2024-08-27T03:55:14.887006+0000","last_clean":"2024-08-27T03:55:14.887006+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:55:14.887006+0000","last_undegraded":"2024-08-27T03:55:14.887006+0000","last_fullsized":"2024-08-27T03:55:14.887006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:10.976998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.087490+0000","last_change":"2024-08-27T02:50:51.720342+0000","last_active":"2024-08-27T03:55:30.087490+0000","last_peered":"2024-08-27T03:55:30.087490+0000","last_clean":"2024-08-27T03:55:30.087490+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:55:30.087490+0000","last_undegraded":"2024-08-27T03:55:30.087490+0000","last_fullsized":"2024-08-27T03:55:30.087490+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:16:13.056385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868989+0000","last_change":"2024-08-27T02:46:49.680620+0000","last_active":"2024-08-27T03:54:19.868989+0000","last_peered":"2024-08-27T03:54:19.868989+0000","last_clean":"2024-08-27T03:54:19.868989+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:54:19.868989+0000","last_undegraded":"2024-08-27T03:54:19.868989+0000","last_fullsized":"2024-08-27T03:54:19.868989+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:46:31.779704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:59.882198+0000","last_change":"2024-08-27T03:10:45.289727+0000","last_active":"2024-08-27T03:54:59.882198+0000","last_peered":"2024-08-27T03:54:59.882198+0000","last_clean":"2024-08-27T03:54:59.882198+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:54:59.882198+0000","last_undegraded":"2024-08-27T03:54:59.882198+0000","last_fullsized":"2024-08-27T03:54:59.882198+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:30:10.424523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:04.852380+0000","last_change":"2024-08-27T02:50:55.806362+0000","last_active":"2024-08-27T03:54:04.852380+0000","last_peered":"2024-08-27T03:54:04.852380+0000","last_clean":"2024-08-27T03:54:04.852380+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:54:04.852380+0000","last_undegraded":"2024-08-27T03:54:04.852380+0000","last_fullsized":"2024-08-27T03:54:04.852380+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:25.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.486004+0000","last_change":"2024-08-27T02:50:51.720059+0000","last_active":"2024-08-27T03:53:45.486004+0000","last_peered":"2024-08-27T03:53:45.486004+0000","last_clean":"2024-08-27T03:53:45.486004+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:53:45.486004+0000","last_undegraded":"2024-08-27T03:53:45.486004+0000","last_fullsized":"2024-08-27T03:53:45.486004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:07.906082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868908+0000","last_change":"2024-08-27T02:46:49.675252+0000","last_active":"2024-08-27T03:54:19.868908+0000","last_peered":"2024-08-27T03:54:19.868908+0000","last_clean":"2024-08-27T03:54:19.868908+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:54:19.868908+0000","last_undegraded":"2024-08-27T03:54:19.868908+0000","last_fullsized":"2024-08-27T03:54:19.868908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:11.184532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058881+0000","last_change":"2024-08-27T03:10:45.303346+0000","last_active":"2024-08-27T03:54:31.058881+0000","last_peered":"2024-08-27T03:54:31.058881+0000","last_clean":"2024-08-27T03:54:31.058881+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:54:31.058881+0000","last_undegraded":"2024-08-27T03:54:31.058881+0000","last_fullsized":"2024-08-27T03:54:31.058881+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:17:17.630708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.429653+0000","last_change":"2024-08-27T02:50:55.789996+0000","last_active":"2024-08-27T03:53:45.429653+0000","last_peered":"2024-08-27T03:53:45.429653+0000","last_clean":"2024-08-27T03:53:45.429653+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:53:45.429653+0000","last_undegraded":"2024-08-27T03:53:45.429653+0000","last_fullsized":"2024-08-27T03:53:45.429653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:53.367346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:25.100608+0000","last_change":"2024-08-27T02:50:51.707799+0000","last_active":"2024-08-27T03:56:25.100608+0000","last_peered":"2024-08-27T03:56:25.100608+0000","last_clean":"2024-08-27T03:56:25.100608+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:56:25.100608+0000","last_undegraded":"2024-08-27T03:56:25.100608+0000","last_fullsized":"2024-08-27T03:56:25.100608+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:38.856713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437440+0000","last_change":"2024-08-27T02:46:49.657662+0000","last_active":"2024-08-27T03:54:20.437440+0000","last_peered":"2024-08-27T03:54:20.437440+0000","last_clean":"2024-08-27T03:54:20.437440+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:54:20.437440+0000","last_undegraded":"2024-08-27T03:54:20.437440+0000","last_fullsized":"2024-08-27T03:54:20.437440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:37:52.995296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299701+0000","last_change":"2024-08-27T03:10:45.293045+0000","last_active":"2024-08-27T03:55:45.299701+0000","last_peered":"2024-08-27T03:55:45.299701+0000","last_clean":"2024-08-27T03:55:45.299701+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:55:45.299701+0000","last_undegraded":"2024-08-27T03:55:45.299701+0000","last_fullsized":"2024-08-27T03:55:45.299701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:53:47.782276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.490696+0000","last_change":"2024-08-27T02:50:55.766901+0000","last_active":"2024-08-27T03:58:25.490696+0000","last_peered":"2024-08-27T03:58:25.490696+0000","last_clean":"2024-08-27T03:58:25.490696+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:58:25.490696+0000","last_undegraded":"2024-08-27T03:58:25.490696+0000","last_fullsized":"2024-08-27T03:58:25.490696+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:30:21.583051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":18432,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093324+0000","last_change":"2024-08-27T02:50:51.738475+0000","last_active":"2024-08-27T03:55:55.093324+0000","last_peered":"2024-08-27T03:55:55.093324+0000","last_clean":"2024-08-27T03:55:55.093324+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:55:55.093324+0000","last_undegraded":"2024-08-27T03:55:55.093324+0000","last_fullsized":"2024-08-27T03:55:55.093324+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:26:56.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.497953+0000","last_change":"2024-08-27T02:46:49.647868+0000","last_active":"2024-08-27T03:54:40.497953+0000","last_peered":"2024-08-27T03:54:40.497953+0000","last_clean":"2024-08-27T03:54:40.497953+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:54:40.497953+0000","last_undegraded":"2024-08-27T03:54:40.497953+0000","last_fullsized":"2024-08-27T03:54:40.497953+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:28:45.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299830+0000","last_change":"2024-08-27T03:10:45.284842+0000","last_active":"2024-08-27T03:55:45.299830+0000","last_peered":"2024-08-27T03:55:45.299830+0000","last_clean":"2024-08-27T03:55:45.299830+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:55:45.299830+0000","last_undegraded":"2024-08-27T03:55:45.299830+0000","last_fullsized":"2024-08-27T03:55:45.299830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:45:04.454859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930510+0000","last_change":"2024-08-27T02:50:55.778273+0000","last_active":"2024-08-27T03:58:24.930510+0000","last_peered":"2024-08-27T03:58:24.930510+0000","last_clean":"2024-08-27T03:58:24.930510+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:58:24.930510+0000","last_undegraded":"2024-08-27T03:58:24.930510+0000","last_fullsized":"2024-08-27T03:58:24.930510+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:39.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.296625+0000","last_change":"2024-08-27T02:50:51.714543+0000","last_active":"2024-08-27T03:55:55.296625+0000","last_peered":"2024-08-27T03:55:55.296625+0000","last_clean":"2024-08-27T03:55:55.296625+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:55:55.296625+0000","last_undegraded":"2024-08-27T03:55:55.296625+0000","last_fullsized":"2024-08-27T03:55:55.296625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:34.299020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058666+0000","last_change":"2024-08-27T02:46:49.667902+0000","last_active":"2024-08-27T03:54:31.058666+0000","last_peered":"2024-08-27T03:54:31.058666+0000","last_clean":"2024-08-27T03:54:31.058666+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:54:31.058666+0000","last_undegraded":"2024-08-27T03:54:31.058666+0000","last_fullsized":"2024-08-27T03:54:31.058666+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:38.299301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065781+0000","last_change":"2024-08-27T03:10:45.298717+0000","last_active":"2024-08-27T03:55:06.065781+0000","last_peered":"2024-08-27T03:55:06.065781+0000","last_clean":"2024-08-27T03:55:06.065781+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:55:06.065781+0000","last_undegraded":"2024-08-27T03:55:06.065781+0000","last_fullsized":"2024-08-27T03:55:06.065781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:23:22.104053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.114116+0000","last_change":"2024-08-27T02:50:55.800701+0000","last_active":"2024-08-27T03:58:29.114116+0000","last_peered":"2024-08-27T03:58:29.114116+0000","last_clean":"2024-08-27T03:58:29.114116+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:58:29.114116+0000","last_undegraded":"2024-08-27T03:58:29.114116+0000","last_fullsized":"2024-08-27T03:58:29.114116+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:22.225737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'1","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.854797+0000","last_change":"2024-08-27T02:50:51.725068+0000","last_active":"2024-08-27T03:54:14.854797+0000","last_peered":"2024-08-27T03:54:14.854797+0000","last_clean":"2024-08-27T03:54:14.854797+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:54:14.854797+0000","last_undegraded":"2024-08-27T03:54:14.854797+0000","last_fullsized":"2024-08-27T03:54:14.854797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:06:25.729104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495980+0000","last_change":"2024-08-27T02:46:49.654801+0000","last_active":"2024-08-27T03:54:30.495980+0000","last_peered":"2024-08-27T03:54:30.495980+0000","last_clean":"2024-08-27T03:54:30.495980+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:54:30.495980+0000","last_undegraded":"2024-08-27T03:54:30.495980+0000","last_fullsized":"2024-08-27T03:54:30.495980+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:08.448754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064497+0000","last_change":"2024-08-27T03:10:45.296344+0000","last_active":"2024-08-27T03:55:05.064497+0000","last_peered":"2024-08-27T03:55:05.064497+0000","last_clean":"2024-08-27T03:55:05.064497+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:55:05.064497+0000","last_undegraded":"2024-08-27T03:55:05.064497+0000","last_fullsized":"2024-08-27T03:55:05.064497+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:28.938702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.499627+0000","last_change":"2024-08-27T02:51:41.064218+0000","last_active":"2024-08-27T03:54:50.499627+0000","last_peered":"2024-08-27T03:54:50.499627+0000","last_clean":"2024-08-27T03:54:50.499627+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:54:50.499627+0000","last_undegraded":"2024-08-27T03:54:50.499627+0000","last_fullsized":"2024-08-27T03:54:50.499627+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:59:05.157815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.270244+0000","last_change":"2024-08-27T02:50:51.728712+0000","last_active":"2024-08-27T03:53:45.270244+0000","last_peered":"2024-08-27T03:53:45.270244+0000","last_clean":"2024-08-27T03:53:45.270244+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:53:45.270244+0000","last_undegraded":"2024-08-27T03:53:45.270244+0000","last_fullsized":"2024-08-27T03:53:45.270244+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:43:32.708072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":308,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871387+0000","last_change":"2024-08-27T02:46:49.674700+0000","last_active":"2024-08-27T03:54:29.871387+0000","last_peered":"2024-08-27T03:54:29.871387+0000","last_clean":"2024-08-27T03:54:29.871387+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:54:29.871387+0000","last_undegraded":"2024-08-27T03:54:29.871387+0000","last_fullsized":"2024-08-27T03:54:29.871387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:39:28.639475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.289661+0000","last_change":"2024-08-27T03:10:45.293007+0000","last_active":"2024-08-27T03:55:05.289661+0000","last_peered":"2024-08-27T03:55:05.289661+0000","last_clean":"2024-08-27T03:55:05.289661+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:55:05.289661+0000","last_undegraded":"2024-08-27T03:55:05.289661+0000","last_fullsized":"2024-08-27T03:55:05.289661+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:23:00.597660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.860865+0000","last_change":"2024-08-27T02:50:55.799828+0000","last_active":"2024-08-27T03:53:44.860865+0000","last_peered":"2024-08-27T03:53:44.860865+0000","last_clean":"2024-08-27T03:53:44.860865+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:53:44.860865+0000","last_undegraded":"2024-08-27T03:53:44.860865+0000","last_fullsized":"2024-08-27T03:53:44.860865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:54.431380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.048186+0000","last_change":"2024-08-27T02:50:51.720595+0000","last_active":"2024-08-27T03:53:45.048186+0000","last_peered":"2024-08-27T03:53:45.048186+0000","last_clean":"2024-08-27T03:53:45.048186+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:53:45.048186+0000","last_undegraded":"2024-08-27T03:53:45.048186+0000","last_fullsized":"2024-08-27T03:53:45.048186+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:42:21.827378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057603+0000","last_change":"2024-08-27T02:46:49.678450+0000","last_active":"2024-08-27T03:54:30.057603+0000","last_peered":"2024-08-27T03:54:30.057603+0000","last_clean":"2024-08-27T03:54:30.057603+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:54:30.057603+0000","last_undegraded":"2024-08-27T03:54:30.057603+0000","last_fullsized":"2024-08-27T03:54:30.057603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:37.128746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:04.866169+0000","last_change":"2024-08-27T03:10:45.298256+0000","last_active":"2024-08-27T03:55:04.866169+0000","last_peered":"2024-08-27T03:55:04.866169+0000","last_clean":"2024-08-27T03:55:04.866169+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:55:04.866169+0000","last_undegraded":"2024-08-27T03:55:04.866169+0000","last_fullsized":"2024-08-27T03:55:04.866169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:20:23.614816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.096796+0000","last_change":"2024-08-27T02:50:55.769990+0000","last_active":"2024-08-27T03:56:10.096796+0000","last_peered":"2024-08-27T03:56:10.096796+0000","last_clean":"2024-08-27T03:56:10.096796+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:56:10.096796+0000","last_undegraded":"2024-08-27T03:56:10.096796+0000","last_fullsized":"2024-08-27T03:56:10.096796+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:30.128153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300910+0000","last_change":"2024-08-27T02:50:51.699776+0000","last_active":"2024-08-27T03:56:10.300910+0000","last_peered":"2024-08-27T03:56:10.300910+0000","last_clean":"2024-08-27T03:56:10.300910+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:56:10.300910+0000","last_undegraded":"2024-08-27T03:56:10.300910+0000","last_fullsized":"2024-08-27T03:56:10.300910+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:07:34.952020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.286162+0000","last_change":"2024-08-27T02:46:49.665181+0000","last_active":"2024-08-27T03:54:50.286162+0000","last_peered":"2024-08-27T03:54:50.286162+0000","last_clean":"2024-08-27T03:54:50.286162+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:54:50.286162+0000","last_undegraded":"2024-08-27T03:54:50.286162+0000","last_fullsized":"2024-08-27T03:54:50.286162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:42.937470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867848+0000","last_change":"2024-08-27T03:10:45.289487+0000","last_active":"2024-08-27T03:54:14.867848+0000","last_peered":"2024-08-27T03:54:14.867848+0000","last_clean":"2024-08-27T03:54:14.867848+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:54:14.867848+0000","last_undegraded":"2024-08-27T03:54:14.867848+0000","last_fullsized":"2024-08-27T03:54:14.867848+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:39.767865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082072+0000","last_change":"2024-08-27T02:50:55.787899+0000","last_active":"2024-08-27T03:56:16.082072+0000","last_peered":"2024-08-27T03:56:16.082072+0000","last_clean":"2024-08-27T03:56:16.082072+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:56:16.082072+0000","last_undegraded":"2024-08-27T03:56:16.082072+0000","last_fullsized":"2024-08-27T03:56:16.082072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:02.349021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:55.064852+0000","last_change":"2024-08-27T02:50:51.710484+0000","last_active":"2024-08-27T03:53:55.064852+0000","last_peered":"2024-08-27T03:53:55.064852+0000","last_clean":"2024-08-27T03:53:55.064852+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:53:55.064852+0000","last_undegraded":"2024-08-27T03:53:55.064852+0000","last_fullsized":"2024-08-27T03:53:55.064852+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:35:36.294957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281022+0000","last_change":"2024-08-27T02:46:49.668229+0000","last_active":"2024-08-27T03:54:30.281022+0000","last_peered":"2024-08-27T03:54:30.281022+0000","last_clean":"2024-08-27T03:54:30.281022+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:54:30.281022+0000","last_undegraded":"2024-08-27T03:54:30.281022+0000","last_fullsized":"2024-08-27T03:54:30.281022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:15.719694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.493101+0000","last_change":"2024-08-27T03:10:45.282295+0000","last_active":"2024-08-27T03:54:15.493101+0000","last_peered":"2024-08-27T03:54:15.493101+0000","last_clean":"2024-08-27T03:54:15.493101+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:54:15.493101+0000","last_undegraded":"2024-08-27T03:54:15.493101+0000","last_fullsized":"2024-08-27T03:54:15.493101+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:10:06.995285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082002+0000","last_change":"2024-08-27T02:50:55.769855+0000","last_active":"2024-08-27T03:56:16.082002+0000","last_peered":"2024-08-27T03:56:16.082002+0000","last_clean":"2024-08-27T03:56:16.082002+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:56:16.082002+0000","last_undegraded":"2024-08-27T03:56:16.082002+0000","last_fullsized":"2024-08-27T03:56:16.082002+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:05.548730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.862920+0000","last_change":"2024-08-27T02:50:51.730019+0000","last_active":"2024-08-27T03:53:54.862920+0000","last_peered":"2024-08-27T03:53:54.862920+0000","last_clean":"2024-08-27T03:53:54.862920+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:53:54.862920+0000","last_undegraded":"2024-08-27T03:53:54.862920+0000","last_fullsized":"2024-08-27T03:53:54.862920+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:46.716300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495770+0000","last_change":"2024-08-27T02:46:49.666192+0000","last_active":"2024-08-27T03:54:30.495770+0000","last_peered":"2024-08-27T03:54:30.495770+0000","last_clean":"2024-08-27T03:54:30.495770+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:54:30.495770+0000","last_undegraded":"2024-08-27T03:54:30.495770+0000","last_fullsized":"2024-08-27T03:54:30.495770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:05.105406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287223+0000","last_change":"2024-08-27T03:10:45.283329+0000","last_active":"2024-08-27T03:55:15.287223+0000","last_peered":"2024-08-27T03:55:15.287223+0000","last_clean":"2024-08-27T03:55:15.287223+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:55:15.287223+0000","last_undegraded":"2024-08-27T03:55:15.287223+0000","last_fullsized":"2024-08-27T03:55:15.287223+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:08.644016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.863049+0000","last_change":"2024-08-27T02:50:55.783336+0000","last_active":"2024-08-27T03:53:54.863049+0000","last_peered":"2024-08-27T03:53:54.863049+0000","last_clean":"2024-08-27T03:53:54.863049+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:53:54.863049+0000","last_undegraded":"2024-08-27T03:53:54.863049+0000","last_fullsized":"2024-08-27T03:53:54.863049+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:19.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:55.431875+0000","last_change":"2024-08-27T02:50:51.738540+0000","last_active":"2024-08-27T03:53:55.431875+0000","last_peered":"2024-08-27T03:53:55.431875+0000","last_clean":"2024-08-27T03:53:55.431875+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:53:55.431875+0000","last_undegraded":"2024-08-27T03:53:55.431875+0000","last_fullsized":"2024-08-27T03:53:55.431875+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:28.212686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072847+0000","last_change":"2024-08-27T02:46:49.654783+0000","last_active":"2024-08-27T03:54:30.072847+0000","last_peered":"2024-08-27T03:54:30.072847+0000","last_clean":"2024-08-27T03:54:30.072847+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:54:30.072847+0000","last_undegraded":"2024-08-27T03:54:30.072847+0000","last_fullsized":"2024-08-27T03:54:30.072847+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:07.533650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867790+0000","last_change":"2024-08-27T03:10:45.266598+0000","last_active":"2024-08-27T03:54:14.867790+0000","last_peered":"2024-08-27T03:54:14.867790+0000","last_clean":"2024-08-27T03:54:14.867790+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:54:14.867790+0000","last_undegraded":"2024-08-27T03:54:14.867790+0000","last_fullsized":"2024-08-27T03:54:14.867790+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:16.790039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462591+0000","last_change":"2024-08-27T02:50:55.778741+0000","last_active":"2024-08-27T03:56:15.462591+0000","last_peered":"2024-08-27T03:56:15.462591+0000","last_clean":"2024-08-27T03:56:15.462591+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:56:15.462591+0000","last_undegraded":"2024-08-27T03:56:15.462591+0000","last_fullsized":"2024-08-27T03:56:15.462591+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:56:17.118596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.850206+0000","last_change":"2024-08-27T02:50:51.722290+0000","last_active":"2024-08-27T03:53:54.850206+0000","last_peered":"2024-08-27T03:53:54.850206+0000","last_clean":"2024-08-27T03:53:54.850206+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:53:54.850206+0000","last_undegraded":"2024-08-27T03:53:54.850206+0000","last_fullsized":"2024-08-27T03:53:54.850206+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:01.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871100+0000","last_change":"2024-08-27T02:46:49.673825+0000","last_active":"2024-08-27T03:54:29.871100+0000","last_peered":"2024-08-27T03:54:29.871100+0000","last_clean":"2024-08-27T03:54:29.871100+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:54:29.871100+0000","last_undegraded":"2024-08-27T03:54:29.871100+0000","last_fullsized":"2024-08-27T03:54:29.871100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:03.488183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.054649+0000","last_change":"2024-08-27T03:10:45.296440+0000","last_active":"2024-08-27T03:54:15.054649+0000","last_peered":"2024-08-27T03:54:15.054649+0000","last_clean":"2024-08-27T03:54:15.054649+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:54:15.054649+0000","last_undegraded":"2024-08-27T03:54:15.054649+0000","last_fullsized":"2024-08-27T03:54:15.054649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:09.800699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'1","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900422+0000","last_change":"2024-08-27T02:50:55.782955+0000","last_active":"2024-08-27T03:56:09.900422+0000","last_peered":"2024-08-27T03:56:09.900422+0000","last_clean":"2024-08-27T03:56:09.900422+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:56:09.900422+0000","last_undegraded":"2024-08-27T03:56:09.900422+0000","last_fullsized":"2024-08-27T03:56:09.900422+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:13.729427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306233+0000","last_change":"2024-08-27T02:50:51.737202+0000","last_active":"2024-08-27T03:56:10.306233+0000","last_peered":"2024-08-27T03:56:10.306233+0000","last_clean":"2024-08-27T03:56:10.306233+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:56:10.306233+0000","last_undegraded":"2024-08-27T03:56:10.306233+0000","last_fullsized":"2024-08-27T03:56:10.306233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:36.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'155","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:39.874246+0000","last_change":"2024-08-27T02:46:49.680563+0000","last_active":"2024-08-27T03:54:39.874246+0000","last_peered":"2024-08-27T03:54:39.874246+0000","last_clean":"2024-08-27T03:54:39.874246+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:54:39.874246+0000","last_undegraded":"2024-08-27T03:54:39.874246+0000","last_fullsized":"2024-08-27T03:54:39.874246+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:31.769992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299565+0000","last_change":"2024-08-27T03:10:45.284394+0000","last_active":"2024-08-27T03:55:45.299565+0000","last_peered":"2024-08-27T03:55:45.299565+0000","last_clean":"2024-08-27T03:55:45.299565+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:55:45.299565+0000","last_undegraded":"2024-08-27T03:55:45.299565+0000","last_fullsized":"2024-08-27T03:55:45.299565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:56.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930627+0000","last_change":"2024-08-27T02:50:55.783274+0000","last_active":"2024-08-27T03:58:24.930627+0000","last_peered":"2024-08-27T03:58:24.930627+0000","last_clean":"2024-08-27T03:58:24.930627+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:58:24.930627+0000","last_undegraded":"2024-08-27T03:58:24.930627+0000","last_fullsized":"2024-08-27T03:58:24.930627+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:45:25.580491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079012+0000","last_change":"2024-08-27T02:50:51.720906+0000","last_active":"2024-08-27T03:56:10.079012+0000","last_peered":"2024-08-27T03:56:10.079012+0000","last_clean":"2024-08-27T03:56:10.079012+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:56:10.079012+0000","last_undegraded":"2024-08-27T03:56:10.079012+0000","last_fullsized":"2024-08-27T03:56:10.079012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:53.550807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.856027+0000","last_change":"2024-08-27T02:46:49.663826+0000","last_active":"2024-08-27T03:54:19.856027+0000","last_peered":"2024-08-27T03:54:19.856027+0000","last_clean":"2024-08-27T03:54:19.856027+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:54:19.856027+0000","last_undegraded":"2024-08-27T03:54:19.856027+0000","last_fullsized":"2024-08-27T03:54:19.856027+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:54.422893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462512+0000","last_change":"2024-08-27T03:10:45.287877+0000","last_active":"2024-08-27T03:56:15.462512+0000","last_peered":"2024-08-27T03:56:15.462512+0000","last_clean":"2024-08-27T03:56:15.462512+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:56:15.462512+0000","last_undegraded":"2024-08-27T03:56:15.462512+0000","last_fullsized":"2024-08-27T03:56:15.462512+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:39:37.167338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:06.053303+0000","last_change":"2024-08-27T02:50:55.796569+0000","last_active":"2024-08-27T03:54:06.053303+0000","last_peered":"2024-08-27T03:54:06.053303+0000","last_clean":"2024-08-27T03:54:06.053303+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:54:06.053303+0000","last_undegraded":"2024-08-27T03:54:06.053303+0000","last_fullsized":"2024-08-27T03:54:06.053303+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:41.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300859+0000","last_change":"2024-08-27T02:50:51.714350+0000","last_active":"2024-08-27T03:56:10.300859+0000","last_peered":"2024-08-27T03:56:10.300859+0000","last_clean":"2024-08-27T03:56:10.300859+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:56:10.300859+0000","last_undegraded":"2024-08-27T03:56:10.300859+0000","last_fullsized":"2024-08-27T03:56:10.300859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:27:51.967867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'95","reported_seq":424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437556+0000","last_change":"2024-08-27T02:46:49.668269+0000","last_active":"2024-08-27T03:54:20.437556+0000","last_peered":"2024-08-27T03:54:20.437556+0000","last_clean":"2024-08-27T03:54:20.437556+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:54:20.437556+0000","last_undegraded":"2024-08-27T03:54:20.437556+0000","last_fullsized":"2024-08-27T03:54:20.437556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:35:55.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307291+0000","last_change":"2024-08-27T03:10:45.299758+0000","last_active":"2024-08-27T03:56:15.307291+0000","last_peered":"2024-08-27T03:56:15.307291+0000","last_clean":"2024-08-27T03:56:15.307291+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:56:15.307291+0000","last_undegraded":"2024-08-27T03:56:15.307291+0000","last_fullsized":"2024-08-27T03:56:15.307291+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.273910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930815+0000","last_change":"2024-08-27T02:50:55.792739+0000","last_active":"2024-08-27T03:58:24.930815+0000","last_peered":"2024-08-27T03:58:24.930815+0000","last_clean":"2024-08-27T03:58:24.930815+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:58:24.930815+0000","last_undegraded":"2024-08-27T03:58:24.930815+0000","last_fullsized":"2024-08-27T03:58:24.930815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:53.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082281+0000","last_change":"2024-08-27T02:50:51.725905+0000","last_active":"2024-08-27T03:56:16.082281+0000","last_peered":"2024-08-27T03:56:16.082281+0000","last_clean":"2024-08-27T03:56:16.082281+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:56:16.082281+0000","last_undegraded":"2024-08-27T03:56:16.082281+0000","last_fullsized":"2024-08-27T03:56:16.082281+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:12.890510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.055617+0000","last_change":"2024-08-27T02:46:49.680856+0000","last_active":"2024-08-27T03:54:20.055617+0000","last_peered":"2024-08-27T03:54:20.055617+0000","last_clean":"2024-08-27T03:54:20.055617+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:54:20.055617+0000","last_undegraded":"2024-08-27T03:54:20.055617+0000","last_fullsized":"2024-08-27T03:54:20.055617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:18:48.246298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.894119+0000","last_change":"2024-08-27T03:10:45.290159+0000","last_active":"2024-08-27T03:55:44.894119+0000","last_peered":"2024-08-27T03:55:44.894119+0000","last_clean":"2024-08-27T03:55:44.894119+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:55:44.894119+0000","last_undegraded":"2024-08-27T03:55:44.894119+0000","last_fullsized":"2024-08-27T03:55:44.894119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:46:58.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093241+0000","last_change":"2024-08-27T02:50:55.801909+0000","last_active":"2024-08-27T03:55:55.093241+0000","last_peered":"2024-08-27T03:55:55.093241+0000","last_clean":"2024-08-27T03:55:55.093241+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:55:55.093241+0000","last_undegraded":"2024-08-27T03:55:55.093241+0000","last_fullsized":"2024-08-27T03:55:55.093241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:21:22.557931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.326037+0000","last_change":"2024-08-27T02:50:51.714694+0000","last_active":"2024-08-27T03:58:05.326037+0000","last_peered":"2024-08-27T03:58:05.326037+0000","last_clean":"2024-08-27T03:58:05.326037+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:58:05.326037+0000","last_undegraded":"2024-08-27T03:58:05.326037+0000","last_fullsized":"2024-08-27T03:58:05.326037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:09.799135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494067+0000","last_change":"2024-08-27T02:46:49.660909+0000","last_active":"2024-08-27T03:54:20.494067+0000","last_peered":"2024-08-27T03:54:20.494067+0000","last_clean":"2024-08-27T03:54:20.494067+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:54:20.494067+0000","last_undegraded":"2024-08-27T03:54:20.494067+0000","last_fullsized":"2024-08-27T03:54:20.494067+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:08:11.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302508+0000","last_change":"2024-08-27T03:10:45.301566+0000","last_active":"2024-08-27T03:55:55.302508+0000","last_peered":"2024-08-27T03:55:55.302508+0000","last_clean":"2024-08-27T03:55:55.302508+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:55:55.302508+0000","last_undegraded":"2024-08-27T03:55:55.302508+0000","last_fullsized":"2024-08-27T03:55:55.302508+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:57:00.105752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302217+0000","last_change":"2024-08-27T02:50:55.793032+0000","last_active":"2024-08-27T03:55:55.302217+0000","last_peered":"2024-08-27T03:55:55.302217+0000","last_clean":"2024-08-27T03:55:55.302217+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:55:55.302217+0000","last_undegraded":"2024-08-27T03:55:55.302217+0000","last_fullsized":"2024-08-27T03:55:55.302217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:41:51.131027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076538+0000","last_change":"2024-08-27T02:50:51.736002+0000","last_active":"2024-08-27T03:55:51.076538+0000","last_peered":"2024-08-27T03:55:51.076538+0000","last_clean":"2024-08-27T03:55:51.076538+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:55:51.076538+0000","last_undegraded":"2024-08-27T03:55:51.076538+0000","last_fullsized":"2024-08-27T03:55:51.076538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:07.337806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.278542+0000","last_change":"2024-08-27T02:46:49.656326+0000","last_active":"2024-08-27T03:54:20.278542+0000","last_peered":"2024-08-27T03:54:20.278542+0000","last_clean":"2024-08-27T03:54:20.278542+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:54:20.278542+0000","last_undegraded":"2024-08-27T03:54:20.278542+0000","last_fullsized":"2024-08-27T03:54:20.278542+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:12:37.739208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299649+0000","last_change":"2024-08-27T03:10:45.282178+0000","last_active":"2024-08-27T03:55:45.299649+0000","last_peered":"2024-08-27T03:55:45.299649+0000","last_clean":"2024-08-27T03:55:45.299649+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:55:45.299649+0000","last_undegraded":"2024-08-27T03:55:45.299649+0000","last_fullsized":"2024-08-27T03:55:45.299649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:24:50.331973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:26.109697+0000","last_change":"2024-08-27T02:50:55.769877+0000","last_active":"2024-08-27T03:58:26.109697+0000","last_peered":"2024-08-27T03:58:26.109697+0000","last_clean":"2024-08-27T03:58:26.109697+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:58:26.109697+0000","last_undegraded":"2024-08-27T03:58:26.109697+0000","last_fullsized":"2024-08-27T03:58:26.109697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:43:34.441494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'11","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.743519+0000","last_change":"2024-08-27T02:50:51.706023+0000","last_active":"2024-08-27T03:58:29.743519+0000","last_peered":"2024-08-27T03:58:29.743519+0000","last_clean":"2024-08-27T03:58:29.743519+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:58:29.743519+0000","last_undegraded":"2024-08-27T03:58:29.743519+0000","last_fullsized":"2024-08-27T03:58:29.743519+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:01:06.191127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900237+0000","last_change":"2024-08-27T02:46:49.681215+0000","last_active":"2024-08-27T03:56:09.900237+0000","last_peered":"2024-08-27T03:56:09.900237+0000","last_clean":"2024-08-27T03:56:09.900237+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:56:09.900237+0000","last_undegraded":"2024-08-27T03:56:09.900237+0000","last_fullsized":"2024-08-27T03:56:09.900237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:59.655983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294482+0000","last_change":"2024-08-27T03:10:45.266749+0000","last_active":"2024-08-27T03:55:45.294482+0000","last_peered":"2024-08-27T03:55:45.294482+0000","last_clean":"2024-08-27T03:55:45.294482+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:55:45.294482+0000","last_undegraded":"2024-08-27T03:55:45.294482+0000","last_fullsized":"2024-08-27T03:55:45.294482+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:25:14.767363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307348+0000","last_change":"2024-08-27T02:50:55.806234+0000","last_active":"2024-08-27T03:56:15.307348+0000","last_peered":"2024-08-27T03:56:15.307348+0000","last_clean":"2024-08-27T03:56:15.307348+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:56:15.307348+0000","last_undegraded":"2024-08-27T03:56:15.307348+0000","last_fullsized":"2024-08-27T03:56:15.307348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:26.269206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128113+0000","last_change":"2024-08-27T02:50:51.727708+0000","last_active":"2024-08-27T03:58:25.128113+0000","last_peered":"2024-08-27T03:58:25.128113+0000","last_clean":"2024-08-27T03:58:25.128113+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:58:25.128113+0000","last_undegraded":"2024-08-27T03:58:25.128113+0000","last_fullsized":"2024-08-27T03:58:25.128113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:26:00.265762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461291+0000","last_change":"2024-08-27T02:46:49.658797+0000","last_active":"2024-08-27T03:56:10.461291+0000","last_peered":"2024-08-27T03:56:10.461291+0000","last_clean":"2024-08-27T03:56:10.461291+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:56:10.461291+0000","last_undegraded":"2024-08-27T03:56:10.461291+0000","last_fullsized":"2024-08-27T03:56:10.461291+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:21.705436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.280973+0000","last_change":"2024-08-27T03:10:45.299158+0000","last_active":"2024-08-27T03:54:30.280973+0000","last_peered":"2024-08-27T03:54:30.280973+0000","last_clean":"2024-08-27T03:54:30.280973+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:54:30.280973+0000","last_undegraded":"2024-08-27T03:54:30.280973+0000","last_fullsized":"2024-08-27T03:54:30.280973+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:52:58.039454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294519+0000","last_change":"2024-08-27T02:50:55.778021+0000","last_active":"2024-08-27T03:55:45.294519+0000","last_peered":"2024-08-27T03:55:45.294519+0000","last_clean":"2024-08-27T03:55:45.294519+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:55:45.294519+0000","last_undegraded":"2024-08-27T03:55:45.294519+0000","last_fullsized":"2024-08-27T03:55:45.294519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:18:53.906397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.295971+0000","last_change":"2024-08-27T02:50:51.715619+0000","last_active":"2024-08-27T03:55:30.295971+0000","last_peered":"2024-08-27T03:55:30.295971+0000","last_clean":"2024-08-27T03:55:30.295971+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:55:30.295971+0000","last_undegraded":"2024-08-27T03:55:30.295971+0000","last_fullsized":"2024-08-27T03:55:30.295971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:22:37.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300942+0000","last_change":"2024-08-27T02:46:49.677851+0000","last_active":"2024-08-27T03:56:10.300942+0000","last_peered":"2024-08-27T03:56:10.300942+0000","last_clean":"2024-08-27T03:56:10.300942+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:56:10.300942+0000","last_undegraded":"2024-08-27T03:56:10.300942+0000","last_fullsized":"2024-08-27T03:56:10.300942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:32.601632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858095+0000","last_change":"2024-08-27T03:10:45.277501+0000","last_active":"2024-08-27T03:54:29.858095+0000","last_peered":"2024-08-27T03:54:29.858095+0000","last_clean":"2024-08-27T03:54:29.858095+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:54:29.858095+0000","last_undegraded":"2024-08-27T03:54:29.858095+0000","last_fullsized":"2024-08-27T03:54:29.858095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:52:19.885914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290804+0000","last_change":"2024-08-27T02:50:55.775204+0000","last_active":"2024-08-27T03:55:30.290804+0000","last_peered":"2024-08-27T03:55:30.290804+0000","last_clean":"2024-08-27T03:55:30.290804+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:55:30.290804+0000","last_undegraded":"2024-08-27T03:55:30.290804+0000","last_fullsized":"2024-08-27T03:55:30.290804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:27:44.097101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:50.097883+0000","last_change":"2024-08-27T02:50:51.712535+0000","last_active":"2024-08-27T03:57:50.097883+0000","last_peered":"2024-08-27T03:57:50.097883+0000","last_clean":"2024-08-27T03:57:50.097883+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:57:50.097883+0000","last_undegraded":"2024-08-27T03:57:50.097883+0000","last_fullsized":"2024-08-27T03:57:50.097883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:06.145410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461503+0000","last_change":"2024-08-27T02:46:49.657230+0000","last_active":"2024-08-27T03:56:10.461503+0000","last_peered":"2024-08-27T03:56:10.461503+0000","last_clean":"2024-08-27T03:56:10.461503+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:56:10.461503+0000","last_undegraded":"2024-08-27T03:56:10.461503+0000","last_fullsized":"2024-08-27T03:56:10.461503+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:31.912789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:51.062718+0000","last_change":"2024-08-27T03:10:45.304634+0000","last_active":"2024-08-27T03:54:51.062718+0000","last_peered":"2024-08-27T03:54:51.062718+0000","last_clean":"2024-08-27T03:54:51.062718+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:54:51.062718+0000","last_undegraded":"2024-08-27T03:54:51.062718+0000","last_fullsized":"2024-08-27T03:54:51.062718+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:40.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302531+0000","last_change":"2024-08-27T02:50:55.800079+0000","last_active":"2024-08-27T03:55:55.302531+0000","last_peered":"2024-08-27T03:55:55.302531+0000","last_clean":"2024-08-27T03:55:55.302531+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:55:55.302531+0000","last_undegraded":"2024-08-27T03:55:55.302531+0000","last_fullsized":"2024-08-27T03:55:55.302531+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:24:12.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.878104+0000","last_change":"2024-08-27T02:50:51.722487+0000","last_active":"2024-08-27T03:55:54.878104+0000","last_peered":"2024-08-27T03:55:54.878104+0000","last_clean":"2024-08-27T03:55:54.878104+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:55:54.878104+0000","last_undegraded":"2024-08-27T03:55:54.878104+0000","last_fullsized":"2024-08-27T03:55:54.878104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:03.625739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302418+0000","last_change":"2024-08-27T02:46:49.670647+0000","last_active":"2024-08-27T03:55:55.302418+0000","last_peered":"2024-08-27T03:55:55.302418+0000","last_clean":"2024-08-27T03:55:55.302418+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:55:55.302418+0000","last_undegraded":"2024-08-27T03:55:55.302418+0000","last_fullsized":"2024-08-27T03:55:55.302418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:21:10.983060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072751+0000","last_change":"2024-08-27T03:10:45.294675+0000","last_active":"2024-08-27T03:54:30.072751+0000","last_peered":"2024-08-27T03:54:30.072751+0000","last_clean":"2024-08-27T03:54:30.072751+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:54:30.072751+0000","last_undegraded":"2024-08-27T03:54:30.072751+0000","last_fullsized":"2024-08-27T03:54:30.072751+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:48.670669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093451+0000","last_change":"2024-08-27T02:50:55.767291+0000","last_active":"2024-08-27T03:55:55.093451+0000","last_peered":"2024-08-27T03:55:55.093451+0000","last_clean":"2024-08-27T03:55:55.093451+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:55:55.093451+0000","last_undegraded":"2024-08-27T03:55:55.093451+0000","last_fullsized":"2024-08-27T03:55:55.093451+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:34.369306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302551+0000","last_change":"2024-08-27T02:50:51.715173+0000","last_active":"2024-08-27T03:55:55.302551+0000","last_peered":"2024-08-27T03:55:55.302551+0000","last_clean":"2024-08-27T03:55:55.302551+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:55:55.302551+0000","last_undegraded":"2024-08-27T03:55:55.302551+0000","last_fullsized":"2024-08-27T03:55:55.302551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:01:41.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.072924+0000","last_change":"2024-08-27T02:46:49.659905+0000","last_active":"2024-08-27T03:55:36.072924+0000","last_peered":"2024-08-27T03:55:36.072924+0000","last_clean":"2024-08-27T03:55:36.072924+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:55:36.072924+0000","last_undegraded":"2024-08-27T03:55:36.072924+0000","last_fullsized":"2024-08-27T03:55:36.072924+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:42:58.919137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.080081+0000","last_change":"2024-08-27T03:10:45.302257+0000","last_active":"2024-08-27T03:56:15.080081+0000","last_peered":"2024-08-27T03:56:15.080081+0000","last_clean":"2024-08-27T03:56:15.080081+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:56:15.080081+0000","last_undegraded":"2024-08-27T03:56:15.080081+0000","last_fullsized":"2024-08-27T03:56:15.080081+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:49:38.342418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.039145+0000","last_change":"2024-08-27T02:50:55.776653+0000","last_active":"2024-08-27T03:58:30.039145+0000","last_peered":"2024-08-27T03:58:30.039145+0000","last_clean":"2024-08-27T03:58:30.039145+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:58:30.039145+0000","last_undegraded":"2024-08-27T03:58:30.039145+0000","last_fullsized":"2024-08-27T03:58:30.039145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:30:47.655678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292165+0000","last_change":"2024-08-27T02:50:51.712698+0000","last_active":"2024-08-27T03:55:15.292165+0000","last_peered":"2024-08-27T03:55:15.292165+0000","last_clean":"2024-08-27T03:55:15.292165+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:55:15.292165+0000","last_undegraded":"2024-08-27T03:55:15.292165+0000","last_fullsized":"2024-08-27T03:55:15.292165+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:54.805987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873157+0000","last_change":"2024-08-27T02:46:49.666166+0000","last_active":"2024-08-27T03:55:34.873157+0000","last_peered":"2024-08-27T03:55:34.873157+0000","last_clean":"2024-08-27T03:55:34.873157+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:55:34.873157+0000","last_undegraded":"2024-08-27T03:55:34.873157+0000","last_fullsized":"2024-08-27T03:55:34.873157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:59:52.040406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.302157+0000","last_change":"2024-08-27T03:10:45.289668+0000","last_active":"2024-08-27T03:56:15.302157+0000","last_peered":"2024-08-27T03:56:15.302157+0000","last_clean":"2024-08-27T03:56:15.302157+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:56:15.302157+0000","last_undegraded":"2024-08-27T03:56:15.302157+0000","last_fullsized":"2024-08-27T03:56:15.302157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:24.929800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.868290+0000","last_change":"2024-08-27T02:50:55.777558+0000","last_active":"2024-08-27T03:55:14.868290+0000","last_peered":"2024-08-27T03:55:14.868290+0000","last_clean":"2024-08-27T03:55:14.868290+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:55:14.868290+0000","last_undegraded":"2024-08-27T03:55:14.868290+0000","last_fullsized":"2024-08-27T03:55:14.868290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:52.030335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.295837+0000","last_change":"2024-08-27T02:50:51.718684+0000","last_active":"2024-08-27T03:55:30.295837+0000","last_peered":"2024-08-27T03:55:30.295837+0000","last_clean":"2024-08-27T03:55:30.295837+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:55:30.295837+0000","last_undegraded":"2024-08-27T03:55:30.295837+0000","last_fullsized":"2024-08-27T03:55:30.295837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:58:00.220312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21053,"num_write":11,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.088488+0000","last_change":"2024-08-27T02:46:49.666930+0000","last_active":"2024-08-27T03:55:35.088488+0000","last_peered":"2024-08-27T03:55:35.088488+0000","last_clean":"2024-08-27T03:55:35.088488+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:55:35.088488+0000","last_undegraded":"2024-08-27T03:55:35.088488+0000","last_fullsized":"2024-08-27T03:55:35.088488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:46.255173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495870+0000","last_change":"2024-08-27T03:10:45.281649+0000","last_active":"2024-08-27T03:54:30.495870+0000","last_peered":"2024-08-27T03:54:30.495870+0000","last_clean":"2024-08-27T03:54:30.495870+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:54:30.495870+0000","last_undegraded":"2024-08-27T03:54:30.495870+0000","last_fullsized":"2024-08-27T03:54:30.495870+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:51:40.495289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.480110+0000","last_change":"2024-08-27T02:50:55.790207+0000","last_active":"2024-08-27T03:57:35.480110+0000","last_peered":"2024-08-27T03:57:35.480110+0000","last_clean":"2024-08-27T03:57:35.480110+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:57:35.480110+0000","last_undegraded":"2024-08-27T03:57:35.480110+0000","last_fullsized":"2024-08-27T03:57:35.480110+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:29.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070538+0000","last_change":"2024-08-27T02:50:51.740655+0000","last_active":"2024-08-27T03:55:26.070538+0000","last_peered":"2024-08-27T03:55:26.070538+0000","last_clean":"2024-08-27T03:55:26.070538+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:55:26.070538+0000","last_undegraded":"2024-08-27T03:55:26.070538+0000","last_fullsized":"2024-08-27T03:55:26.070538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.497115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.453720+0000","last_change":"2024-08-27T02:46:49.638555+0000","last_active":"2024-08-27T03:55:35.453720+0000","last_peered":"2024-08-27T03:55:35.453720+0000","last_clean":"2024-08-27T03:55:35.453720+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:55:35.453720+0000","last_undegraded":"2024-08-27T03:55:35.453720+0000","last_fullsized":"2024-08-27T03:55:35.453720+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:10.855684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.283538+0000","last_change":"2024-08-27T03:10:45.290709+0000","last_active":"2024-08-27T03:54:40.283538+0000","last_peered":"2024-08-27T03:54:40.283538+0000","last_clean":"2024-08-27T03:54:40.283538+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:54:40.283538+0000","last_undegraded":"2024-08-27T03:54:40.283538+0000","last_fullsized":"2024-08-27T03:54:40.283538+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:12:15.082820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.116553+0000","last_change":"2024-08-27T02:50:55.772109+0000","last_active":"2024-08-27T03:57:35.116553+0000","last_peered":"2024-08-27T03:57:35.116553+0000","last_clean":"2024-08-27T03:57:35.116553+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:57:35.116553+0000","last_undegraded":"2024-08-27T03:57:35.116553+0000","last_fullsized":"2024-08-27T03:57:35.116553+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:34.257753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.452715+0000","last_change":"2024-08-27T02:50:51.705872+0000","last_active":"2024-08-27T03:55:30.452715+0000","last_peered":"2024-08-27T03:55:30.452715+0000","last_clean":"2024-08-27T03:55:30.452715+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:55:30.452715+0000","last_undegraded":"2024-08-27T03:55:30.452715+0000","last_fullsized":"2024-08-27T03:55:30.452715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:55.217217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290820+0000","last_change":"2024-08-27T02:46:49.667612+0000","last_active":"2024-08-27T03:55:10.290820+0000","last_peered":"2024-08-27T03:55:10.290820+0000","last_clean":"2024-08-27T03:55:10.290820+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:55:10.290820+0000","last_undegraded":"2024-08-27T03:55:10.290820+0000","last_fullsized":"2024-08-27T03:55:10.290820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:31.706212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'281","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.198532+0000","last_change":"2024-08-27T02:31:04.495209+0000","last_active":"2024-08-27T03:58:30.198532+0000","last_peered":"2024-08-27T03:58:30.198532+0000","last_clean":"2024-08-27T03:58:30.198532+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:30.198532+0000","last_undegraded":"2024-08-27T03:58:30.198532+0000","last_fullsized":"2024-08-27T03:58:30.198532+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:38:11.148447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6300018,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":391,"num_read_kb":22191,"num_write":976,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'457","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.605860+0000","last_change":"2024-08-27T02:31:06.459589+0000","last_active":"2024-08-27T03:56:42.605860+0000","last_peered":"2024-08-27T03:56:42.605860+0000","last_clean":"2024-08-27T03:56:42.605860+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:56:42.605860+0000","last_undegraded":"2024-08-27T03:56:42.605860+0000","last_fullsized":"2024-08-27T03:56:42.605860+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:09.070330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'343","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.019124+0000","last_change":"2024-08-27T02:31:04.454947+0000","last_active":"2024-08-27T03:58:31.019124+0000","last_peered":"2024-08-27T03:58:31.019124+0000","last_clean":"2024-08-27T03:58:31.019124+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:31.019124+0000","last_undegraded":"2024-08-27T03:58:31.019124+0000","last_fullsized":"2024-08-27T03:58:31.019124+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:49.691799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910763,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":605,"num_read_kb":39942,"num_write":1259,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'825","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.450685+0000","last_change":"2024-08-27T02:31:06.453930+0000","last_active":"2024-08-27T03:56:44.450685+0000","last_peered":"2024-08-27T03:56:44.450685+0000","last_clean":"2024-08-27T03:56:44.450685+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:56:44.450685+0000","last_undegraded":"2024-08-27T03:56:44.450685+0000","last_fullsized":"2024-08-27T03:56:44.450685+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:09.257638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'252","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.275414+0000","last_change":"2024-08-27T02:31:04.493891+0000","last_active":"2024-08-27T03:58:30.275414+0000","last_peered":"2024-08-27T03:58:30.275414+0000","last_clean":"2024-08-27T03:58:30.275414+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:30.275414+0000","last_undegraded":"2024-08-27T03:58:30.275414+0000","last_fullsized":"2024-08-27T03:58:30.275414+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:19:06.244262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292671,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":380,"num_read_kb":449,"num_write":890,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1216","reported_seq":2730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.360305+0000","last_change":"2024-08-27T02:31:06.464864+0000","last_active":"2024-08-27T03:54:25.360305+0000","last_peered":"2024-08-27T03:54:25.360305+0000","last_clean":"2024-08-27T03:54:25.360305+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:54:25.360305+0000","last_undegraded":"2024-08-27T03:54:25.360305+0000","last_fullsized":"2024-08-27T03:54:25.360305+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:57:06.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'281","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.838765+0000","last_change":"2024-08-27T02:31:04.469467+0000","last_active":"2024-08-27T03:58:29.838765+0000","last_peered":"2024-08-27T03:58:29.838765+0000","last_clean":"2024-08-27T03:58:29.838765+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:29.838765+0000","last_undegraded":"2024-08-27T03:58:29.838765+0000","last_fullsized":"2024-08-27T03:58:29.838765+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:20:36.614222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185945,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":522,"num_read_kb":3870,"num_write":1052,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'480","reported_seq":2134,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.441763+0000","last_change":"2024-08-27T02:31:06.457144+0000","last_active":"2024-08-27T03:56:44.441763+0000","last_peered":"2024-08-27T03:56:44.441763+0000","last_clean":"2024-08-27T03:56:44.441763+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:56:44.441763+0000","last_undegraded":"2024-08-27T03:56:44.441763+0000","last_fullsized":"2024-08-27T03:56:44.441763+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:55:40.220861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'353","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.236717+0000","last_change":"2024-08-27T02:31:04.489890+0000","last_active":"2024-08-27T03:58:30.236717+0000","last_peered":"2024-08-27T03:58:30.236717+0000","last_clean":"2024-08-27T03:58:30.236717+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:30.236717+0000","last_undegraded":"2024-08-27T03:58:30.236717+0000","last_fullsized":"2024-08-27T03:58:30.236717+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:07:25.086829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5744857,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":497,"num_read_kb":17279,"num_write":1167,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'493","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.525387+0000","last_change":"2024-08-27T02:31:06.469894+0000","last_active":"2024-08-27T03:56:44.525387+0000","last_peered":"2024-08-27T03:56:44.525387+0000","last_clean":"2024-08-27T03:56:44.525387+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:56:44.525387+0000","last_undegraded":"2024-08-27T03:56:44.525387+0000","last_fullsized":"2024-08-27T03:56:44.525387+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:32:27.240233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'274","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.722139+0000","last_change":"2024-08-27T02:31:04.451736+0000","last_active":"2024-08-27T03:58:29.722139+0000","last_peered":"2024-08-27T03:58:29.722139+0000","last_clean":"2024-08-27T03:58:29.722139+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:29.722139+0000","last_undegraded":"2024-08-27T03:58:29.722139+0000","last_fullsized":"2024-08-27T03:58:29.722139+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:49:13.433050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6967334,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":427,"num_read_kb":18973,"num_write":890,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.073015+0000","last_change":"2024-08-27T02:31:06.464775+0000","last_active":"2024-08-27T03:54:30.073015+0000","last_peered":"2024-08-27T03:54:30.073015+0000","last_clean":"2024-08-27T03:54:30.073015+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:54:30.073015+0000","last_undegraded":"2024-08-27T03:54:30.073015+0000","last_fullsized":"2024-08-27T03:54:30.073015+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:49:58.791418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'315","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.083172+0000","last_change":"2024-08-27T02:31:39.748095+0000","last_active":"2024-08-27T03:58:30.083172+0000","last_peered":"2024-08-27T03:58:30.083172+0000","last_clean":"2024-08-27T03:58:30.083172+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:30.083172+0000","last_undegraded":"2024-08-27T03:58:30.083172+0000","last_fullsized":"2024-08-27T03:58:30.083172+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:23:44.181903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10895133,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":497,"num_read_kb":18874,"num_write":1110,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'903","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.948193+0000","last_change":"2024-08-27T02:31:06.441463+0000","last_active":"2024-08-27T03:58:02.948193+0000","last_peered":"2024-08-27T03:58:02.948193+0000","last_clean":"2024-08-27T03:58:02.948193+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:02.948193+0000","last_undegraded":"2024-08-27T03:58:02.948193+0000","last_fullsized":"2024-08-27T03:58:02.948193+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:32:21.433480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'307","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.866449+0000","last_change":"2024-08-27T02:31:04.460911+0000","last_active":"2024-08-27T03:58:29.866449+0000","last_peered":"2024-08-27T03:58:29.866449+0000","last_clean":"2024-08-27T03:58:29.866449+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:29.866449+0000","last_undegraded":"2024-08-27T03:58:29.866449+0000","last_fullsized":"2024-08-27T03:58:29.866449+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:09.211873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612034,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":537,"num_read_kb":6557,"num_write":1011,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'920","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057701+0000","last_change":"2024-08-27T02:31:06.459200+0000","last_active":"2024-08-27T03:54:30.057701+0000","last_peered":"2024-08-27T03:54:30.057701+0000","last_clean":"2024-08-27T03:54:30.057701+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:54:30.057701+0000","last_undegraded":"2024-08-27T03:54:30.057701+0000","last_fullsized":"2024-08-27T03:54:30.057701+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:09:01.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'768","reported_seq":2529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677234+0000","last_change":"2024-08-27T02:31:06.466669+0000","last_active":"2024-08-27T03:56:42.677234+0000","last_peered":"2024-08-27T03:56:42.677234+0000","last_clean":"2024-08-27T03:56:42.677234+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:56:42.677234+0000","last_undegraded":"2024-08-27T03:56:42.677234+0000","last_fullsized":"2024-08-27T03:56:42.677234+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:23:04.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'282","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.300827+0000","last_change":"2024-08-27T02:31:04.495961+0000","last_active":"2024-08-27T03:58:30.300827+0000","last_peered":"2024-08-27T03:58:30.300827+0000","last_clean":"2024-08-27T03:58:30.300827+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:30.300827+0000","last_undegraded":"2024-08-27T03:58:30.300827+0000","last_fullsized":"2024-08-27T03:58:30.300827+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.777645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325230,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":355,"num_read_kb":9002,"num_write":922,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'787","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290995+0000","last_change":"2024-08-27T02:31:06.454274+0000","last_active":"2024-08-27T03:55:10.290995+0000","last_peered":"2024-08-27T03:55:10.290995+0000","last_clean":"2024-08-27T03:55:10.290995+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:55:10.290995+0000","last_undegraded":"2024-08-27T03:55:10.290995+0000","last_fullsized":"2024-08-27T03:55:10.290995+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:09:59.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.355537+0000","last_change":"2024-08-27T02:31:04.457818+0000","last_active":"2024-08-27T03:58:30.355537+0000","last_peered":"2024-08-27T03:58:30.355537+0000","last_clean":"2024-08-27T03:58:30.355537+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:30.355537+0000","last_undegraded":"2024-08-27T03:58:30.355537+0000","last_fullsized":"2024-08-27T03:58:30.355537+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:01:36.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087207,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":630,"num_read_kb":8370,"num_write":1156,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'487","reported_seq":2244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873079+0000","last_change":"2024-08-27T02:31:06.447246+0000","last_active":"2024-08-27T03:55:34.873079+0000","last_peered":"2024-08-27T03:55:34.873079+0000","last_clean":"2024-08-27T03:55:34.873079+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:55:34.873079+0000","last_undegraded":"2024-08-27T03:55:34.873079+0000","last_fullsized":"2024-08-27T03:55:34.873079+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:18:22.098121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'304","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.402385+0000","last_change":"2024-08-27T02:31:39.807510+0000","last_active":"2024-08-27T03:58:30.402385+0000","last_peered":"2024-08-27T03:58:30.402385+0000","last_clean":"2024-08-27T03:58:30.402385+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:30.402385+0000","last_undegraded":"2024-08-27T03:58:30.402385+0000","last_fullsized":"2024-08-27T03:58:30.402385+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:54.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894162,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":496,"num_read_kb":11494,"num_write":1092,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'683","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.996353+0000","last_change":"2024-08-27T02:31:06.453083+0000","last_active":"2024-08-27T03:58:02.996353+0000","last_peered":"2024-08-27T03:58:02.996353+0000","last_clean":"2024-08-27T03:58:02.996353+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:02.996353+0000","last_undegraded":"2024-08-27T03:58:02.996353+0000","last_fullsized":"2024-08-27T03:58:02.996353+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:51:51.420652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'334","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.096602+0000","last_change":"2024-08-27T02:31:04.464917+0000","last_active":"2024-08-27T03:58:30.096602+0000","last_peered":"2024-08-27T03:58:30.096602+0000","last_clean":"2024-08-27T03:58:30.096602+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:30.096602+0000","last_undegraded":"2024-08-27T03:58:30.096602+0000","last_fullsized":"2024-08-27T03:58:30.096602+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:42.233736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319598,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":735,"num_read_kb":144736,"num_write":1160,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'477","reported_seq":2100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.520780+0000","last_change":"2024-08-27T02:31:06.456023+0000","last_active":"2024-08-27T03:56:44.520780+0000","last_peered":"2024-08-27T03:56:44.520780+0000","last_clean":"2024-08-27T03:56:44.520780+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:56:44.520780+0000","last_undegraded":"2024-08-27T03:56:44.520780+0000","last_fullsized":"2024-08-27T03:56:44.520780+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:57:03.958056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'285","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.820355+0000","last_change":"2024-08-27T02:31:04.450019+0000","last_active":"2024-08-27T03:58:29.820355+0000","last_peered":"2024-08-27T03:58:29.820355+0000","last_clean":"2024-08-27T03:58:29.820355+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:29.820355+0000","last_undegraded":"2024-08-27T03:58:29.820355+0000","last_fullsized":"2024-08-27T03:58:29.820355+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:26.736946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7210638,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":521,"num_read_kb":47085,"num_write":1015,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'764","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090961+0000","last_change":"2024-08-27T02:31:06.457069+0000","last_active":"2024-08-27T03:55:45.090961+0000","last_peered":"2024-08-27T03:55:45.090961+0000","last_clean":"2024-08-27T03:55:45.090961+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:55:45.090961+0000","last_undegraded":"2024-08-27T03:55:45.090961+0000","last_fullsized":"2024-08-27T03:55:45.090961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:48.523132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'295","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.231200+0000","last_change":"2024-08-27T02:31:04.456657+0000","last_active":"2024-08-27T03:58:30.231200+0000","last_peered":"2024-08-27T03:58:30.231200+0000","last_clean":"2024-08-27T03:58:30.231200+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:30.231200+0000","last_undegraded":"2024-08-27T03:58:30.231200+0000","last_fullsized":"2024-08-27T03:58:30.231200+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:01:15.039976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276318,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":435,"num_read_kb":14802,"num_write":958,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.850365+0000","last_change":"2024-08-27T02:31:14.508871+0000","last_active":"2024-08-27T03:56:44.850365+0000","last_peered":"2024-08-27T03:56:44.850365+0000","last_clean":"2024-08-27T03:56:44.850365+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:56:44.850365+0000","last_undegraded":"2024-08-27T03:56:44.850365+0000","last_fullsized":"2024-08-27T03:56:44.850365+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:53:01.791364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'626","reported_seq":2345,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.935016+0000","last_change":"2024-08-27T02:31:06.447319+0000","last_active":"2024-08-27T03:58:02.935016+0000","last_peered":"2024-08-27T03:58:02.935016+0000","last_clean":"2024-08-27T03:58:02.935016+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:02.935016+0000","last_undegraded":"2024-08-27T03:58:02.935016+0000","last_fullsized":"2024-08-27T03:58:02.935016+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:57.126762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'309","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.315319+0000","last_change":"2024-08-27T02:31:04.493003+0000","last_active":"2024-08-27T03:58:30.315319+0000","last_peered":"2024-08-27T03:58:30.315319+0000","last_clean":"2024-08-27T03:58:30.315319+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:30.315319+0000","last_undegraded":"2024-08-27T03:58:30.315319+0000","last_fullsized":"2024-08-27T03:58:30.315319+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:12:45.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973430,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":450,"num_read_kb":48225,"num_write":1093,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875703+0000","last_change":"2024-08-27T02:31:08.475606+0000","last_active":"2024-08-27T03:55:44.875703+0000","last_peered":"2024-08-27T03:55:44.875703+0000","last_clean":"2024-08-27T03:55:44.875703+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:55:44.875703+0000","last_undegraded":"2024-08-27T03:55:44.875703+0000","last_fullsized":"2024-08-27T03:55:44.875703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:10.435910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'368","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:10.327416+0000","last_change":"2024-08-27T02:31:10.474061+0000","last_active":"2024-08-27T03:58:10.327416+0000","last_peered":"2024-08-27T03:58:10.327416+0000","last_clean":"2024-08-27T03:58:10.327416+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:10.327416+0000","last_undegraded":"2024-08-27T03:58:10.327416+0000","last_fullsized":"2024-08-27T03:58:10.327416+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:14.597433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":1072,"num_write":454,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.301263+0000","last_change":"2024-08-27T02:31:12.513470+0000","last_active":"2024-08-27T03:55:50.301263+0000","last_peered":"2024-08-27T03:55:50.301263+0000","last_clean":"2024-08-27T03:55:50.301263+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:55:50.301263+0000","last_undegraded":"2024-08-27T03:55:50.301263+0000","last_fullsized":"2024-08-27T03:55:50.301263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.177108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'139","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.610770+0000","last_change":"2024-08-27T02:31:14.508729+0000","last_active":"2024-08-27T03:54:25.610770+0000","last_peered":"2024-08-27T03:54:25.610770+0000","last_clean":"2024-08-27T03:54:25.610770+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:54:25.610770+0000","last_undegraded":"2024-08-27T03:54:25.610770+0000","last_fullsized":"2024-08-27T03:54:25.610770+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:18.167802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'817","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875663+0000","last_change":"2024-08-27T02:31:06.451014+0000","last_active":"2024-08-27T03:55:44.875663+0000","last_peered":"2024-08-27T03:55:44.875663+0000","last_clean":"2024-08-27T03:55:44.875663+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:55:44.875663+0000","last_undegraded":"2024-08-27T03:55:44.875663+0000","last_fullsized":"2024-08-27T03:55:44.875663+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:34:38.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'278","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.325266+0000","last_change":"2024-08-27T02:31:04.492617+0000","last_active":"2024-08-27T03:58:30.325266+0000","last_peered":"2024-08-27T03:58:30.325266+0000","last_clean":"2024-08-27T03:58:30.325266+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:30.325266+0000","last_undegraded":"2024-08-27T03:58:30.325266+0000","last_fullsized":"2024-08-27T03:58:30.325266+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:51.730290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325188,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":355,"num_read_kb":13671,"num_write":912,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.892074+0000","last_change":"2024-08-27T02:31:08.444125+0000","last_active":"2024-08-27T03:55:34.892074+0000","last_peered":"2024-08-27T03:55:34.892074+0000","last_clean":"2024-08-27T03:55:34.892074+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:55:34.892074+0000","last_undegraded":"2024-08-27T03:55:34.892074+0000","last_fullsized":"2024-08-27T03:55:34.892074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:50.658905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'118","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.091053+0000","last_change":"2024-08-27T02:31:10.463462+0000","last_active":"2024-08-27T03:55:45.091053+0000","last_peered":"2024-08-27T03:55:45.091053+0000","last_clean":"2024-08-27T03:55:45.091053+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:55:45.091053+0000","last_undegraded":"2024-08-27T03:55:45.091053+0000","last_fullsized":"2024-08-27T03:55:45.091053+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:05.726630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.092259+0000","last_change":"2024-08-27T02:31:12.524180+0000","last_active":"2024-08-27T03:55:50.092259+0000","last_peered":"2024-08-27T03:55:50.092259+0000","last_clean":"2024-08-27T03:55:50.092259+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:55:50.092259+0000","last_undegraded":"2024-08-27T03:55:50.092259+0000","last_fullsized":"2024-08-27T03:55:50.092259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'140","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.401306+0000","last_change":"2024-08-27T02:31:14.511765+0000","last_active":"2024-08-27T03:56:44.401306+0000","last_peered":"2024-08-27T03:56:44.401306+0000","last_clean":"2024-08-27T03:56:44.401306+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:56:44.401306+0000","last_undegraded":"2024-08-27T03:56:44.401306+0000","last_fullsized":"2024-08-27T03:56:44.401306+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:18:47.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.523863+0000","last_change":"2024-08-27T02:31:06.450475+0000","last_active":"2024-08-27T03:56:44.523863+0000","last_peered":"2024-08-27T03:56:44.523863+0000","last_clean":"2024-08-27T03:56:44.523863+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:56:44.523863+0000","last_undegraded":"2024-08-27T03:56:44.523863+0000","last_fullsized":"2024-08-27T03:56:44.523863+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:57:34.146161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'335","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.050215+0000","last_change":"2024-08-27T02:31:38.759396+0000","last_active":"2024-08-27T03:58:30.050215+0000","last_peered":"2024-08-27T03:58:30.050215+0000","last_clean":"2024-08-27T03:58:30.050215+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:30.050215+0000","last_undegraded":"2024-08-27T03:58:30.050215+0000","last_fullsized":"2024-08-27T03:58:30.050215+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:50.384706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6417572,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":618,"num_read_kb":34085,"num_write":1208,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727614+0000","last_change":"2024-08-27T02:31:08.475047+0000","last_active":"2024-08-27T03:58:28.727614+0000","last_peered":"2024-08-27T03:58:28.727614+0000","last_clean":"2024-08-27T03:58:28.727614+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:58:28.727614+0000","last_undegraded":"2024-08-27T03:58:28.727614+0000","last_fullsized":"2024-08-27T03:58:28.727614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:00:07.644027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'154","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.068764+0000","last_change":"2024-08-27T02:31:10.464314+0000","last_active":"2024-08-27T03:55:25.068764+0000","last_peered":"2024-08-27T03:55:25.068764+0000","last_clean":"2024-08-27T03:55:25.068764+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:55:25.068764+0000","last_undegraded":"2024-08-27T03:55:25.068764+0000","last_fullsized":"2024-08-27T03:55:25.068764+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:19.772117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'697","reported_seq":2535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.988503+0000","last_change":"2024-08-27T02:31:12.509703+0000","last_active":"2024-08-27T03:58:28.988503+0000","last_peered":"2024-08-27T03:58:28.988503+0000","last_clean":"2024-08-27T03:58:28.988503+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:58:28.988503+0000","last_undegraded":"2024-08-27T03:58:28.988503+0000","last_fullsized":"2024-08-27T03:58:28.988503+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":601,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:41.710475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'177","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.636112+0000","last_change":"2024-08-27T02:31:15.025741+0000","last_active":"2024-08-27T03:58:02.636112+0000","last_peered":"2024-08-27T03:58:02.636112+0000","last_clean":"2024-08-27T03:58:02.636112+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:58:02.636112+0000","last_undegraded":"2024-08-27T03:58:02.636112+0000","last_fullsized":"2024-08-27T03:58:02.636112+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:42:35.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'582","reported_seq":2233,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.527277+0000","last_change":"2024-08-27T02:31:06.461256+0000","last_active":"2024-08-27T03:56:44.527277+0000","last_peered":"2024-08-27T03:56:44.527277+0000","last_clean":"2024-08-27T03:56:44.527277+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:56:44.527277+0000","last_undegraded":"2024-08-27T03:56:44.527277+0000","last_fullsized":"2024-08-27T03:56:44.527277+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:25:53.064370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'309","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.362891+0000","last_change":"2024-08-27T02:31:04.481742+0000","last_active":"2024-08-27T03:58:30.362891+0000","last_peered":"2024-08-27T03:58:30.362891+0000","last_clean":"2024-08-27T03:58:30.362891+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:30.362891+0000","last_undegraded":"2024-08-27T03:58:30.362891+0000","last_fullsized":"2024-08-27T03:58:30.362891+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:44:24.122491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":412,"num_read_kb":7479,"num_write":1086,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875767+0000","last_change":"2024-08-27T02:31:08.476876+0000","last_active":"2024-08-27T03:55:44.875767+0000","last_peered":"2024-08-27T03:55:44.875767+0000","last_clean":"2024-08-27T03:55:44.875767+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:55:44.875767+0000","last_undegraded":"2024-08-27T03:55:44.875767+0000","last_fullsized":"2024-08-27T03:55:44.875767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:49:16.770918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'290","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.333168+0000","last_change":"2024-08-27T02:31:10.638091+0000","last_active":"2024-08-27T03:58:30.333168+0000","last_peered":"2024-08-27T03:58:30.333168+0000","last_clean":"2024-08-27T03:58:30.333168+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:58:30.333168+0000","last_undegraded":"2024-08-27T03:58:30.333168+0000","last_fullsized":"2024-08-27T03:58:30.333168+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:14.620860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'728","reported_seq":2829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.998721+0000","last_change":"2024-08-27T02:31:12.505687+0000","last_active":"2024-08-27T03:58:28.998721+0000","last_peered":"2024-08-27T03:58:28.998721+0000","last_clean":"2024-08-27T03:58:28.998721+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:58:28.998721+0000","last_undegraded":"2024-08-27T03:58:28.998721+0000","last_fullsized":"2024-08-27T03:58:28.998721+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:36:59.690511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1267","reported_seq":2829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874236+0000","last_change":"2024-08-27T02:31:06.443724+0000","last_active":"2024-08-27T03:55:39.874236+0000","last_peered":"2024-08-27T03:55:39.874236+0000","last_clean":"2024-08-27T03:55:39.874236+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:55:39.874236+0000","last_undegraded":"2024-08-27T03:55:39.874236+0000","last_fullsized":"2024-08-27T03:55:39.874236+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:12:39.506534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'320","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.300512+0000","last_change":"2024-08-27T02:31:04.500120+0000","last_active":"2024-08-27T03:58:30.300512+0000","last_peered":"2024-08-27T03:58:30.300512+0000","last_clean":"2024-08-27T03:58:30.300512+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:30.300512+0000","last_undegraded":"2024-08-27T03:58:30.300512+0000","last_fullsized":"2024-08-27T03:58:30.300512+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:28:33.060344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6380157,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":489,"num_read_kb":34000,"num_write":1055,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.298359+0000","last_change":"2024-08-27T02:31:08.468116+0000","last_active":"2024-08-27T03:55:40.298359+0000","last_peered":"2024-08-27T03:55:40.298359+0000","last_clean":"2024-08-27T03:55:40.298359+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:55:40.298359+0000","last_undegraded":"2024-08-27T03:55:40.298359+0000","last_fullsized":"2024-08-27T03:55:40.298359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:43.021123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'395","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:14.911227+0000","last_change":"2024-08-27T02:31:10.633487+0000","last_active":"2024-08-27T03:58:14.911227+0000","last_peered":"2024-08-27T03:58:14.911227+0000","last_clean":"2024-08-27T03:58:14.911227+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:58:14.911227+0000","last_undegraded":"2024-08-27T03:58:14.911227+0000","last_fullsized":"2024-08-27T03:58:14.911227+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:27:37.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49315,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":621,"num_read_kb":1077,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058784+0000","last_change":"2024-08-27T02:31:12.508561+0000","last_active":"2024-08-27T03:54:31.058784+0000","last_peered":"2024-08-27T03:54:31.058784+0000","last_clean":"2024-08-27T03:54:31.058784+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:54:31.058784+0000","last_undegraded":"2024-08-27T03:54:31.058784+0000","last_fullsized":"2024-08-27T03:54:31.058784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:32:48.985390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'588","reported_seq":1428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929629+0000","last_change":"2024-08-27T02:31:14.510230+0000","last_active":"2024-08-27T03:58:03.929629+0000","last_peered":"2024-08-27T03:58:03.929629+0000","last_clean":"2024-08-27T03:58:03.929629+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:58:03.929629+0000","last_undegraded":"2024-08-27T03:58:03.929629+0000","last_fullsized":"2024-08-27T03:58:03.929629+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:05:59.246892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1455","reported_seq":2950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217533+0000","last_change":"2024-08-27T02:31:06.455483+0000","last_active":"2024-08-27T03:55:54.217533+0000","last_peered":"2024-08-27T03:55:54.217533+0000","last_clean":"2024-08-27T03:55:54.217533+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:55:54.217533+0000","last_undegraded":"2024-08-27T03:55:54.217533+0000","last_fullsized":"2024-08-27T03:55:54.217533+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:08.735623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'341","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.235733+0000","last_change":"2024-08-27T02:31:04.495144+0000","last_active":"2024-08-27T03:58:30.235733+0000","last_peered":"2024-08-27T03:58:30.235733+0000","last_clean":"2024-08-27T03:58:30.235733+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:30.235733+0000","last_undegraded":"2024-08-27T03:58:30.235733+0000","last_fullsized":"2024-08-27T03:58:30.235733+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:04:23.814829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2500262,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":612,"num_read_kb":2850,"num_write":1239,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072095+0000","last_change":"2024-08-27T02:31:08.461348+0000","last_active":"2024-08-27T03:55:40.072095+0000","last_peered":"2024-08-27T03:55:40.072095+0000","last_clean":"2024-08-27T03:55:40.072095+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:55:40.072095+0000","last_undegraded":"2024-08-27T03:55:40.072095+0000","last_fullsized":"2024-08-27T03:55:40.072095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:50.304151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'307","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.550654+0000","last_change":"2024-08-27T02:31:10.465779+0000","last_active":"2024-08-27T03:58:29.550654+0000","last_peered":"2024-08-27T03:58:29.550654+0000","last_clean":"2024-08-27T03:58:29.550654+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:58:29.550654+0000","last_undegraded":"2024-08-27T03:58:29.550654+0000","last_fullsized":"2024-08-27T03:58:29.550654+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:24:14.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900276+0000","last_change":"2024-08-27T02:31:12.506224+0000","last_active":"2024-08-27T03:56:09.900276+0000","last_peered":"2024-08-27T03:56:09.900276+0000","last_clean":"2024-08-27T03:56:09.900276+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:56:09.900276+0000","last_undegraded":"2024-08-27T03:56:09.900276+0000","last_fullsized":"2024-08-27T03:56:09.900276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:37.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2395","reported_seq":4229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:50.470481+0000","last_change":"2024-08-27T02:31:14.514506+0000","last_active":"2024-08-27T03:56:50.470481+0000","last_peered":"2024-08-27T03:56:50.470481+0000","last_clean":"2024-08-27T03:56:50.470481+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:56:50.470481+0000","last_undegraded":"2024-08-27T03:56:50.470481+0000","last_fullsized":"2024-08-27T03:56:50.470481+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":2300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:49.198563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'439","reported_seq":1936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.457107+0000","last_change":"2024-08-27T02:31:06.473831+0000","last_active":"2024-08-27T03:55:50.457107+0000","last_peered":"2024-08-27T03:55:50.457107+0000","last_clean":"2024-08-27T03:55:50.457107+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:55:50.457107+0000","last_undegraded":"2024-08-27T03:55:50.457107+0000","last_fullsized":"2024-08-27T03:55:50.457107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:34:41.312642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'308","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.250566+0000","last_change":"2024-08-27T02:31:04.501562+0000","last_active":"2024-08-27T03:58:30.250566+0000","last_peered":"2024-08-27T03:58:30.250566+0000","last_clean":"2024-08-27T03:58:30.250566+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:30.250566+0000","last_undegraded":"2024-08-27T03:58:30.250566+0000","last_fullsized":"2024-08-27T03:58:30.250566+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11452309,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":470,"num_read_kb":51263,"num_write":1101,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056621+0000","last_change":"2024-08-27T02:31:08.463300+0000","last_active":"2024-08-27T03:54:25.056621+0000","last_peered":"2024-08-27T03:54:25.056621+0000","last_clean":"2024-08-27T03:54:25.056621+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:54:25.056621+0000","last_undegraded":"2024-08-27T03:54:25.056621+0000","last_fullsized":"2024-08-27T03:54:25.056621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:03.773202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'357","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.903629+0000","last_change":"2024-08-27T02:31:10.476799+0000","last_active":"2024-08-27T03:58:03.903629+0000","last_peered":"2024-08-27T03:58:03.903629+0000","last_clean":"2024-08-27T03:58:03.903629+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:58:03.903629+0000","last_undegraded":"2024-08-27T03:58:03.903629+0000","last_fullsized":"2024-08-27T03:58:03.903629+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:52:11.386500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55253,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":570,"num_read_kb":1090,"num_write":450,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'718","reported_seq":4949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.002965+0000","last_change":"2024-08-27T02:31:12.515783+0000","last_active":"2024-08-27T03:58:29.002965+0000","last_peered":"2024-08-27T03:58:29.002965+0000","last_clean":"2024-08-27T03:58:29.002965+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:58:29.002965+0000","last_undegraded":"2024-08-27T03:58:29.002965+0000","last_fullsized":"2024-08-27T03:58:29.002965+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:57.983153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'170","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.633450+0000","last_change":"2024-08-27T02:31:14.512105+0000","last_active":"2024-08-27T03:58:02.633450+0000","last_peered":"2024-08-27T03:58:02.633450+0000","last_clean":"2024-08-27T03:58:02.633450+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:58:02.633450+0000","last_undegraded":"2024-08-27T03:58:02.633450+0000","last_fullsized":"2024-08-27T03:58:02.633450+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:45:04.697202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'798","reported_seq":2339,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.931076+0000","last_change":"2024-08-27T02:31:06.448300+0000","last_active":"2024-08-27T03:58:02.931076+0000","last_peered":"2024-08-27T03:58:02.931076+0000","last_clean":"2024-08-27T03:58:02.931076+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:02.931076+0000","last_undegraded":"2024-08-27T03:58:02.931076+0000","last_fullsized":"2024-08-27T03:58:02.931076+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:17.328531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'264","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.893918+0000","last_change":"2024-08-27T02:31:04.451589+0000","last_active":"2024-08-27T03:58:29.893918+0000","last_peered":"2024-08-27T03:58:29.893918+0000","last_clean":"2024-08-27T03:58:29.893918+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:29.893918+0000","last_undegraded":"2024-08-27T03:58:29.893918+0000","last_fullsized":"2024-08-27T03:58:29.893918+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:25.923987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6738883,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":331,"num_read_kb":7344,"num_write":921,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.075921+0000","last_change":"2024-08-27T02:31:08.455579+0000","last_active":"2024-08-27T03:55:55.075921+0000","last_peered":"2024-08-27T03:55:55.075921+0000","last_clean":"2024-08-27T03:55:55.075921+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:55:55.075921+0000","last_undegraded":"2024-08-27T03:55:55.075921+0000","last_fullsized":"2024-08-27T03:55:55.075921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:50:22.765293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'492","reported_seq":1164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.800742+0000","last_change":"2024-08-27T02:31:10.476948+0000","last_active":"2024-08-27T03:58:29.800742+0000","last_peered":"2024-08-27T03:58:29.800742+0000","last_clean":"2024-08-27T03:58:29.800742+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:58:29.800742+0000","last_undegraded":"2024-08-27T03:58:29.800742+0000","last_fullsized":"2024-08-27T03:58:29.800742+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:15:08.613306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":857,"num_read_kb":1955,"num_write":696,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073445+0000","last_change":"2024-08-27T02:31:12.497480+0000","last_active":"2024-08-27T03:55:45.073445+0000","last_peered":"2024-08-27T03:55:45.073445+0000","last_clean":"2024-08-27T03:55:45.073445+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:55:45.073445+0000","last_undegraded":"2024-08-27T03:55:45.073445+0000","last_fullsized":"2024-08-27T03:55:45.073445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:37:27.672439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'129","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.500987+0000","last_change":"2024-08-27T02:31:14.509810+0000","last_active":"2024-08-27T03:56:44.500987+0000","last_peered":"2024-08-27T03:56:44.500987+0000","last_clean":"2024-08-27T03:56:44.500987+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:56:44.500987+0000","last_undegraded":"2024-08-27T03:56:44.500987+0000","last_fullsized":"2024-08-27T03:56:44.500987+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:19:36.713125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'442","reported_seq":1971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071688+0000","last_change":"2024-08-27T02:31:06.467597+0000","last_active":"2024-08-27T03:54:25.071688+0000","last_peered":"2024-08-27T03:54:25.071688+0000","last_clean":"2024-08-27T03:54:25.071688+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:54:25.071688+0000","last_undegraded":"2024-08-27T03:54:25.071688+0000","last_fullsized":"2024-08-27T03:54:25.071688+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:25.304915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'283","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.864676+0000","last_change":"2024-08-27T02:31:04.477417+0000","last_active":"2024-08-27T03:58:29.864676+0000","last_peered":"2024-08-27T03:58:29.864676+0000","last_clean":"2024-08-27T03:58:29.864676+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:29.864676+0000","last_undegraded":"2024-08-27T03:58:29.864676+0000","last_fullsized":"2024-08-27T03:58:29.864676+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:14.347972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490767,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":410,"num_read_kb":3132,"num_write":1030,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056667+0000","last_change":"2024-08-27T02:31:08.455739+0000","last_active":"2024-08-27T03:54:25.056667+0000","last_peered":"2024-08-27T03:54:25.056667+0000","last_clean":"2024-08-27T03:54:25.056667+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:54:25.056667+0000","last_undegraded":"2024-08-27T03:54:25.056667+0000","last_fullsized":"2024-08-27T03:54:25.056667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:28.350091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.873334+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.873334+0000","last_peered":"2024-08-27T03:58:29.873334+0000","last_clean":"2024-08-27T03:58:29.873334+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:58:29.873334+0000","last_undegraded":"2024-08-27T03:58:29.873334+0000","last_fullsized":"2024-08-27T03:58:29.873334+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:05:17.996037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498208+0000","last_change":"2024-08-27T02:31:12.518013+0000","last_active":"2024-08-27T03:54:40.498208+0000","last_peered":"2024-08-27T03:54:40.498208+0000","last_clean":"2024-08-27T03:54:40.498208+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:54:40.498208+0000","last_undegraded":"2024-08-27T03:54:40.498208+0000","last_fullsized":"2024-08-27T03:54:40.498208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:06.086496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'122","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:39.920813+0000","last_change":"2024-08-27T02:31:14.508708+0000","last_active":"2024-08-27T03:57:39.920813+0000","last_peered":"2024-08-27T03:57:39.920813+0000","last_clean":"2024-08-27T03:57:39.920813+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:57:39.920813+0000","last_undegraded":"2024-08-27T03:57:39.920813+0000","last_fullsized":"2024-08-27T03:57:39.920813+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:18.139046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'303","reported_seq":1695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217612+0000","last_change":"2024-08-27T02:31:06.455458+0000","last_active":"2024-08-27T03:55:54.217612+0000","last_peered":"2024-08-27T03:55:54.217612+0000","last_clean":"2024-08-27T03:55:54.217612+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:55:54.217612+0000","last_undegraded":"2024-08-27T03:55:54.217612+0000","last_fullsized":"2024-08-27T03:55:54.217612+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:15.294777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'289","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.424136+0000","last_change":"2024-08-27T02:31:38.753790+0000","last_active":"2024-08-27T03:58:30.424136+0000","last_peered":"2024-08-27T03:58:30.424136+0000","last_clean":"2024-08-27T03:58:30.424136+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:30.424136+0000","last_undegraded":"2024-08-27T03:58:30.424136+0000","last_fullsized":"2024-08-27T03:58:30.424136+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:17:03.166739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1921,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":415,"num_read_kb":5526,"num_write":974,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:26.057616+0000","last_change":"2024-08-27T02:31:08.473152+0000","last_active":"2024-08-27T03:54:26.057616+0000","last_peered":"2024-08-27T03:54:26.057616+0000","last_clean":"2024-08-27T03:54:26.057616+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:54:26.057616+0000","last_undegraded":"2024-08-27T03:54:26.057616+0000","last_fullsized":"2024-08-27T03:54:26.057616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:14.881514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'377","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.317872+0000","last_change":"2024-08-27T02:31:10.462797+0000","last_active":"2024-08-27T03:58:29.317872+0000","last_peered":"2024-08-27T03:58:29.317872+0000","last_clean":"2024-08-27T03:58:29.317872+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:29.317872+0000","last_undegraded":"2024-08-27T03:58:29.317872+0000","last_fullsized":"2024-08-27T03:58:29.317872+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:33.566956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'670","reported_seq":2559,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.989770+0000","last_change":"2024-08-27T02:31:12.508008+0000","last_active":"2024-08-27T03:58:28.989770+0000","last_peered":"2024-08-27T03:58:28.989770+0000","last_clean":"2024-08-27T03:58:28.989770+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:28.989770+0000","last_undegraded":"2024-08-27T03:58:28.989770+0000","last_fullsized":"2024-08-27T03:58:28.989770+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:20.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'97","reported_seq":609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.307427+0000","last_change":"2024-08-27T02:31:14.503409+0000","last_active":"2024-08-27T03:56:40.307427+0000","last_peered":"2024-08-27T03:56:40.307427+0000","last_clean":"2024-08-27T03:56:40.307427+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:56:40.307427+0000","last_undegraded":"2024-08-27T03:56:40.307427+0000","last_fullsized":"2024-08-27T03:56:40.307427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:06:36.783130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'835","reported_seq":2581,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071793+0000","last_change":"2024-08-27T02:31:06.471655+0000","last_active":"2024-08-27T03:54:25.071793+0000","last_peered":"2024-08-27T03:54:25.071793+0000","last_clean":"2024-08-27T03:54:25.071793+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:54:25.071793+0000","last_undegraded":"2024-08-27T03:54:25.071793+0000","last_fullsized":"2024-08-27T03:54:25.071793+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:48:58.542463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'288","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.080550+0000","last_change":"2024-08-27T02:31:04.484468+0000","last_active":"2024-08-27T03:58:30.080550+0000","last_peered":"2024-08-27T03:58:30.080550+0000","last_clean":"2024-08-27T03:58:30.080550+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:30.080550+0000","last_undegraded":"2024-08-27T03:58:30.080550+0000","last_fullsized":"2024-08-27T03:58:30.080550+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:45:11.647025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6451730,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":762,"num_read_kb":112858,"num_write":1039,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.741436+0000","last_change":"2024-08-27T02:31:08.472253+0000","last_active":"2024-08-27T03:58:28.741436+0000","last_peered":"2024-08-27T03:58:28.741436+0000","last_clean":"2024-08-27T03:58:28.741436+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:28.741436+0000","last_undegraded":"2024-08-27T03:58:28.741436+0000","last_fullsized":"2024-08-27T03:58:28.741436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:32:23.121770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'117","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.870144+0000","last_change":"2024-08-27T02:31:10.637623+0000","last_active":"2024-08-27T03:54:24.870144+0000","last_peered":"2024-08-27T03:54:24.870144+0000","last_clean":"2024-08-27T03:54:24.870144+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:54:24.870144+0000","last_undegraded":"2024-08-27T03:54:24.870144+0000","last_fullsized":"2024-08-27T03:54:24.870144+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:20:41.856144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'691","reported_seq":3063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.994322+0000","last_change":"2024-08-27T02:31:12.491000+0000","last_active":"2024-08-27T03:58:28.994322+0000","last_peered":"2024-08-27T03:58:28.994322+0000","last_clean":"2024-08-27T03:58:28.994322+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:28.994322+0000","last_undegraded":"2024-08-27T03:58:28.994322+0000","last_fullsized":"2024-08-27T03:58:28.994322+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:38.876627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074108+0000","last_change":"2024-08-27T02:31:14.511270+0000","last_active":"2024-08-27T03:54:35.074108+0000","last_peered":"2024-08-27T03:54:35.074108+0000","last_clean":"2024-08-27T03:54:35.074108+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:54:35.074108+0000","last_undegraded":"2024-08-27T03:54:35.074108+0000","last_fullsized":"2024-08-27T03:54:35.074108+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:43.076037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2340,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:36.059935+0000","last_change":"2024-08-27T02:31:06.459516+0000","last_active":"2024-08-27T03:54:36.059935+0000","last_peered":"2024-08-27T03:54:36.059935+0000","last_clean":"2024-08-27T03:54:36.059935+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:54:36.059935+0000","last_undegraded":"2024-08-27T03:54:36.059935+0000","last_fullsized":"2024-08-27T03:54:36.059935+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:49:12.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'331","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.827904+0000","last_change":"2024-08-27T02:31:04.475738+0000","last_active":"2024-08-27T03:58:29.827904+0000","last_peered":"2024-08-27T03:58:29.827904+0000","last_clean":"2024-08-27T03:58:29.827904+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:29.827904+0000","last_undegraded":"2024-08-27T03:58:29.827904+0000","last_fullsized":"2024-08-27T03:58:29.827904+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:44:38.581586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426989,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":688,"num_read_kb":1676,"num_write":1165,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071772+0000","last_change":"2024-08-27T02:31:08.477595+0000","last_active":"2024-08-27T03:54:25.071772+0000","last_peered":"2024-08-27T03:54:25.071772+0000","last_clean":"2024-08-27T03:54:25.071772+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:54:25.071772+0000","last_undegraded":"2024-08-27T03:54:25.071772+0000","last_fullsized":"2024-08-27T03:54:25.071772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:59.236199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'398","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.890122+0000","last_change":"2024-08-27T02:31:10.469889+0000","last_active":"2024-08-27T03:58:03.890122+0000","last_peered":"2024-08-27T03:58:03.890122+0000","last_clean":"2024-08-27T03:58:03.890122+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:58:03.890122+0000","last_undegraded":"2024-08-27T03:58:03.890122+0000","last_fullsized":"2024-08-27T03:58:03.890122+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:10:03.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52725,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":1098,"num_write":480,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439768+0000","last_change":"2024-08-27T02:31:12.497988+0000","last_active":"2024-08-27T03:54:30.439768+0000","last_peered":"2024-08-27T03:54:30.439768+0000","last_clean":"2024-08-27T03:54:30.439768+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:54:30.439768+0000","last_undegraded":"2024-08-27T03:54:30.439768+0000","last_fullsized":"2024-08-27T03:54:30.439768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:13:47.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'228","reported_seq":770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:41.905788+0000","last_change":"2024-08-27T02:31:14.492927+0000","last_active":"2024-08-27T03:56:41.905788+0000","last_peered":"2024-08-27T03:56:41.905788+0000","last_clean":"2024-08-27T03:56:41.905788+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:56:41.905788+0000","last_undegraded":"2024-08-27T03:56:41.905788+0000","last_fullsized":"2024-08-27T03:56:41.905788+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:13.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'523","reported_seq":2133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.924936+0000","last_change":"2024-08-27T02:31:06.467157+0000","last_active":"2024-08-27T03:58:02.924936+0000","last_peered":"2024-08-27T03:58:02.924936+0000","last_clean":"2024-08-27T03:58:02.924936+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:02.924936+0000","last_undegraded":"2024-08-27T03:58:02.924936+0000","last_fullsized":"2024-08-27T03:58:02.924936+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:37.085886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290875+0000","last_change":"2024-08-27T02:30:47.729098+0000","last_active":"2024-08-27T03:55:10.290875+0000","last_peered":"2024-08-27T03:55:10.290875+0000","last_clean":"2024-08-27T03:55:10.290875+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:55:10.290875+0000","last_undegraded":"2024-08-27T03:55:10.290875+0000","last_fullsized":"2024-08-27T03:55:10.290875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_clean_scrub_stamp":"2024-08-27T02:30:46.155361+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:24.032204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884146+0000","last_change":"2024-08-27T02:30:54.230879+0000","last_active":"2024-08-27T03:56:19.884146+0000","last_peered":"2024-08-27T03:56:19.884146+0000","last_clean":"2024-08-27T03:56:19.884146+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:56:19.884146+0000","last_undegraded":"2024-08-27T03:56:19.884146+0000","last_fullsized":"2024-08-27T03:56:19.884146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:44:20.045106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'265","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.786697+0000","last_change":"2024-08-27T02:31:04.461391+0000","last_active":"2024-08-27T03:58:29.786697+0000","last_peered":"2024-08-27T03:58:29.786697+0000","last_clean":"2024-08-27T03:58:29.786697+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:29.786697+0000","last_undegraded":"2024-08-27T03:58:29.786697+0000","last_fullsized":"2024-08-27T03:58:29.786697+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:42:05.833893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10545208,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":686,"num_read_kb":118351,"num_write":983,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281099+0000","last_change":"2024-08-27T02:31:08.459311+0000","last_active":"2024-08-27T03:54:30.281099+0000","last_peered":"2024-08-27T03:54:30.281099+0000","last_clean":"2024-08-27T03:54:30.281099+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:54:30.281099+0000","last_undegraded":"2024-08-27T03:54:30.281099+0000","last_fullsized":"2024-08-27T03:54:30.281099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:59.553379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'721","reported_seq":1448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.071686+0000","last_change":"2024-08-27T02:31:10.463138+0000","last_active":"2024-08-27T03:58:29.071686+0000","last_peered":"2024-08-27T03:58:29.071686+0000","last_clean":"2024-08-27T03:58:29.071686+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:58:29.071686+0000","last_undegraded":"2024-08-27T03:58:29.071686+0000","last_fullsized":"2024-08-27T03:58:29.071686+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:46:40.351745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159854,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":2935,"num_write":1332,"num_write_kb":1163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294607+0000","last_change":"2024-08-27T02:31:12.521459+0000","last_active":"2024-08-27T03:55:45.294607+0000","last_peered":"2024-08-27T03:55:45.294607+0000","last_clean":"2024-08-27T03:55:45.294607+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:55:45.294607+0000","last_undegraded":"2024-08-27T03:55:45.294607+0000","last_fullsized":"2024-08-27T03:55:45.294607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:35:48.852493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'207","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.606155+0000","last_change":"2024-08-27T02:31:14.512251+0000","last_active":"2024-08-27T03:56:44.606155+0000","last_peered":"2024-08-27T03:56:44.606155+0000","last_clean":"2024-08-27T03:56:44.606155+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:56:44.606155+0000","last_undegraded":"2024-08-27T03:56:44.606155+0000","last_fullsized":"2024-08-27T03:56:44.606155+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:31.795991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1517","reported_seq":3073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.293279+0000","last_change":"2024-08-27T02:31:06.451054+0000","last_active":"2024-08-27T03:55:40.293279+0000","last_peered":"2024-08-27T03:55:40.293279+0000","last_clean":"2024-08-27T03:55:40.293279+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:55:40.293279+0000","last_undegraded":"2024-08-27T03:55:40.293279+0000","last_fullsized":"2024-08-27T03:55:40.293279+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:15:15.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292215+0000","last_change":"2024-08-27T02:30:54.329044+0000","last_active":"2024-08-27T03:55:15.292215+0000","last_peered":"2024-08-27T03:55:15.292215+0000","last_clean":"2024-08-27T03:55:15.292215+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:55:15.292215+0000","last_undegraded":"2024-08-27T03:55:15.292215+0000","last_fullsized":"2024-08-27T03:55:15.292215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:29.700171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.306400+0000","last_change":"2024-08-27T02:31:04.457791+0000","last_active":"2024-08-27T03:58:30.306400+0000","last_peered":"2024-08-27T03:58:30.306400+0000","last_clean":"2024-08-27T03:58:30.306400+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:30.306400+0000","last_undegraded":"2024-08-27T03:58:30.306400+0000","last_fullsized":"2024-08-27T03:58:30.306400+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:56.441080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750723,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":787,"num_read_kb":13511,"num_write":1080,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'5","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727332+0000","last_change":"2024-08-27T02:31:08.472147+0000","last_active":"2024-08-27T03:58:28.727332+0000","last_peered":"2024-08-27T03:58:28.727332+0000","last_clean":"2024-08-27T03:58:28.727332+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:28.727332+0000","last_undegraded":"2024-08-27T03:58:28.727332+0000","last_fullsized":"2024-08-27T03:58:28.727332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:05:58.557262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1334","reported_seq":3319,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.067019+0000","last_change":"2024-08-27T02:31:10.466706+0000","last_active":"2024-08-27T03:58:31.067019+0000","last_peered":"2024-08-27T03:58:31.067019+0000","last_clean":"2024-08-27T03:58:31.067019+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:31.067019+0000","last_undegraded":"2024-08-27T03:58:31.067019+0000","last_fullsized":"2024-08-27T03:58:31.067019+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:35.321692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145784,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2069,"num_read_kb":3907,"num_write":1257,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:55.287626+0000","last_change":"2024-08-27T02:31:12.508877+0000","last_active":"2024-08-27T03:54:55.287626+0000","last_peered":"2024-08-27T03:54:55.287626+0000","last_clean":"2024-08-27T03:54:55.287626+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:54:55.287626+0000","last_undegraded":"2024-08-27T03:54:55.287626+0000","last_fullsized":"2024-08-27T03:54:55.287626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:12.131410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'164","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929974+0000","last_change":"2024-08-27T02:31:15.023823+0000","last_active":"2024-08-27T03:58:03.929974+0000","last_peered":"2024-08-27T03:58:03.929974+0000","last_clean":"2024-08-27T03:58:03.929974+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:58:03.929974+0000","last_undegraded":"2024-08-27T03:58:03.929974+0000","last_fullsized":"2024-08-27T03:58:03.929974+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:40:47.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079130+0000","last_change":"2024-08-27T02:31:39.754692+0000","last_active":"2024-08-27T03:56:10.079130+0000","last_peered":"2024-08-27T03:56:10.079130+0000","last_clean":"2024-08-27T03:56:10.079130+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:56:10.079130+0000","last_undegraded":"2024-08-27T03:56:10.079130+0000","last_fullsized":"2024-08-27T03:56:10.079130+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:08:56.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:20.081115+0000","last_change":"2024-08-27T02:30:54.225706+0000","last_active":"2024-08-27T03:56:20.081115+0000","last_peered":"2024-08-27T03:56:20.081115+0000","last_clean":"2024-08-27T03:56:20.081115+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:56:20.081115+0000","last_undegraded":"2024-08-27T03:56:20.081115+0000","last_fullsized":"2024-08-27T03:56:20.081115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'379","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.074267+0000","last_change":"2024-08-27T02:31:04.461095+0000","last_active":"2024-08-27T03:58:31.074267+0000","last_peered":"2024-08-27T03:58:31.074267+0000","last_clean":"2024-08-27T03:58:31.074267+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:31.074267+0000","last_undegraded":"2024-08-27T03:58:31.074267+0000","last_fullsized":"2024-08-27T03:58:31.074267+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:26:18.748313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6616429,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":642,"num_read_kb":29599,"num_write":1249,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072448+0000","last_change":"2024-08-27T02:31:08.479508+0000","last_active":"2024-08-27T03:55:40.072448+0000","last_peered":"2024-08-27T03:55:40.072448+0000","last_clean":"2024-08-27T03:55:40.072448+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:55:40.072448+0000","last_undegraded":"2024-08-27T03:55:40.072448+0000","last_fullsized":"2024-08-27T03:55:40.072448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:21.994771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'327","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.502580+0000","last_change":"2024-08-27T02:31:10.637428+0000","last_active":"2024-08-27T03:58:03.502580+0000","last_peered":"2024-08-27T03:58:03.502580+0000","last_clean":"2024-08-27T03:58:03.502580+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:03.502580+0000","last_undegraded":"2024-08-27T03:58:03.502580+0000","last_fullsized":"2024-08-27T03:58:03.502580+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:29.250940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.496951+0000","last_change":"2024-08-27T02:31:12.518266+0000","last_active":"2024-08-27T03:54:35.496951+0000","last_peered":"2024-08-27T03:54:35.496951+0000","last_clean":"2024-08-27T03:54:35.496951+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:54:35.496951+0000","last_undegraded":"2024-08-27T03:54:35.496951+0000","last_fullsized":"2024-08-27T03:54:35.496951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:31:54.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'259","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.909802+0000","last_change":"2024-08-27T02:31:14.514321+0000","last_active":"2024-08-27T03:56:44.909802+0000","last_peered":"2024-08-27T03:56:44.909802+0000","last_clean":"2024-08-27T03:56:44.909802+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:56:44.909802+0000","last_undegraded":"2024-08-27T03:56:44.909802+0000","last_fullsized":"2024-08-27T03:56:44.909802+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:43:02.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.620203+0000","last_change":"2024-08-27T02:31:06.453284+0000","last_active":"2024-08-27T03:56:42.620203+0000","last_peered":"2024-08-27T03:56:42.620203+0000","last_clean":"2024-08-27T03:56:42.620203+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:56:42.620203+0000","last_undegraded":"2024-08-27T03:56:42.620203+0000","last_fullsized":"2024-08-27T03:56:42.620203+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:06:48.027363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884076+0000","last_change":"2024-08-27T02:30:54.233089+0000","last_active":"2024-08-27T03:56:19.884076+0000","last_peered":"2024-08-27T03:56:19.884076+0000","last_clean":"2024-08-27T03:56:19.884076+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:56:19.884076+0000","last_undegraded":"2024-08-27T03:56:19.884076+0000","last_fullsized":"2024-08-27T03:56:19.884076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'298","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.952485+0000","last_change":"2024-08-27T02:31:04.451624+0000","last_active":"2024-08-27T03:58:29.952485+0000","last_peered":"2024-08-27T03:58:29.952485+0000","last_clean":"2024-08-27T03:58:29.952485+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:29.952485+0000","last_undegraded":"2024-08-27T03:58:29.952485+0000","last_fullsized":"2024-08-27T03:58:29.952485+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:25:39.692713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5774713,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":378,"num_read_kb":9569,"num_write":1035,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498104+0000","last_change":"2024-08-27T02:31:08.469937+0000","last_active":"2024-08-27T03:54:40.498104+0000","last_peered":"2024-08-27T03:54:40.498104+0000","last_clean":"2024-08-27T03:54:40.498104+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:54:40.498104+0000","last_undegraded":"2024-08-27T03:54:40.498104+0000","last_fullsized":"2024-08-27T03:54:40.498104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:03.713631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'172","reported_seq":758,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:01.706772+0000","last_change":"2024-08-27T02:31:10.467429+0000","last_active":"2024-08-27T03:58:01.706772+0000","last_peered":"2024-08-27T03:58:01.706772+0000","last_clean":"2024-08-27T03:58:01.706772+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:58:01.706772+0000","last_undegraded":"2024-08-27T03:58:01.706772+0000","last_fullsized":"2024-08-27T03:58:01.706772+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.607849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.456113+0000","last_change":"2024-08-27T02:31:12.523339+0000","last_active":"2024-08-27T03:55:45.456113+0000","last_peered":"2024-08-27T03:55:45.456113+0000","last_clean":"2024-08-27T03:55:45.456113+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:55:45.456113+0000","last_undegraded":"2024-08-27T03:55:45.456113+0000","last_fullsized":"2024-08-27T03:55:45.456113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:50:38.396815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875506+0000","last_change":"2024-08-27T02:31:14.502543+0000","last_active":"2024-08-27T03:55:44.875506+0000","last_peered":"2024-08-27T03:55:44.875506+0000","last_clean":"2024-08-27T03:55:44.875506+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:55:44.875506+0000","last_undegraded":"2024-08-27T03:55:44.875506+0000","last_fullsized":"2024-08-27T03:55:44.875506+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:40:33.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1261","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:26.057489+0000","last_change":"2024-08-27T02:31:06.436150+0000","last_active":"2024-08-27T03:54:26.057489+0000","last_peered":"2024-08-27T03:54:26.057489+0000","last_clean":"2024-08-27T03:54:26.057489+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:54:26.057489+0000","last_undegraded":"2024-08-27T03:54:26.057489+0000","last_fullsized":"2024-08-27T03:54:26.057489+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:19:53.560315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'294","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.829572+0000","last_change":"2024-08-27T02:31:04.450049+0000","last_active":"2024-08-27T03:58:29.829572+0000","last_peered":"2024-08-27T03:58:29.829572+0000","last_clean":"2024-08-27T03:58:29.829572+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:29.829572+0000","last_undegraded":"2024-08-27T03:58:29.829572+0000","last_fullsized":"2024-08-27T03:58:29.829572+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:23:00.868698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55139,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":426,"num_read_kb":946,"num_write":1062,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:21.083627+0000","last_change":"2024-08-27T02:30:54.235714+0000","last_active":"2024-08-27T03:56:21.083627+0000","last_peered":"2024-08-27T03:56:21.083627+0000","last_clean":"2024-08-27T03:56:21.083627+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:56:21.083627+0000","last_undegraded":"2024-08-27T03:56:21.083627+0000","last_fullsized":"2024-08-27T03:56:21.083627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:03:53.967353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495848+0000","last_change":"2024-08-27T02:31:08.472606+0000","last_active":"2024-08-27T03:54:30.495848+0000","last_peered":"2024-08-27T03:54:30.495848+0000","last_clean":"2024-08-27T03:54:30.495848+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:54:30.495848+0000","last_undegraded":"2024-08-27T03:54:30.495848+0000","last_fullsized":"2024-08-27T03:54:30.495848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:53.292285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'660","reported_seq":1379,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.217500+0000","last_change":"2024-08-27T02:31:10.465002+0000","last_active":"2024-08-27T03:58:29.217500+0000","last_peered":"2024-08-27T03:58:29.217500+0000","last_clean":"2024-08-27T03:58:29.217500+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:29.217500+0000","last_undegraded":"2024-08-27T03:58:29.217500+0000","last_fullsized":"2024-08-27T03:58:29.217500+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:48:12.137313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102880,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1767,"num_read_kb":2826,"num_write":2346,"num_write_kb":2122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074054+0000","last_change":"2024-08-27T02:31:12.500222+0000","last_active":"2024-08-27T03:54:35.074054+0000","last_peered":"2024-08-27T03:54:35.074054+0000","last_clean":"2024-08-27T03:54:35.074054+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:54:35.074054+0000","last_undegraded":"2024-08-27T03:54:35.074054+0000","last_fullsized":"2024-08-27T03:54:35.074054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:27:56.971452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'145","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.589165+0000","last_change":"2024-08-27T02:31:15.026476+0000","last_active":"2024-08-27T03:56:38.589165+0000","last_peered":"2024-08-27T03:56:38.589165+0000","last_clean":"2024-08-27T03:56:38.589165+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:56:38.589165+0000","last_undegraded":"2024-08-27T03:56:38.589165+0000","last_fullsized":"2024-08-27T03:56:38.589165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:06.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'759","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495829+0000","last_change":"2024-08-27T02:31:06.443554+0000","last_active":"2024-08-27T03:54:30.495829+0000","last_peered":"2024-08-27T03:54:30.495829+0000","last_clean":"2024-08-27T03:54:30.495829+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:54:30.495829+0000","last_undegraded":"2024-08-27T03:54:30.495829+0000","last_fullsized":"2024-08-27T03:54:30.495829+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:41.381628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'351","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.061321+0000","last_change":"2024-08-27T02:31:04.460588+0000","last_active":"2024-08-27T03:58:31.061321+0000","last_peered":"2024-08-27T03:58:31.061321+0000","last_clean":"2024-08-27T03:58:31.061321+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:31.061321+0000","last_undegraded":"2024-08-27T03:58:31.061321+0000","last_fullsized":"2024-08-27T03:58:31.061321+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:03:48.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255012,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":601,"num_read_kb":96021,"num_write":1165,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.282226+0000","last_change":"2024-08-27T02:30:54.329145+0000","last_active":"2024-08-27T03:54:35.282226+0000","last_peered":"2024-08-27T03:54:35.282226+0000","last_clean":"2024-08-27T03:54:35.282226+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:54:35.282226+0000","last_undegraded":"2024-08-27T03:54:35.282226+0000","last_fullsized":"2024-08-27T03:54:35.282226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:09:53.126738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439720+0000","last_change":"2024-08-27T02:31:08.465815+0000","last_active":"2024-08-27T03:54:30.439720+0000","last_peered":"2024-08-27T03:54:30.439720+0000","last_clean":"2024-08-27T03:54:30.439720+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:54:30.439720+0000","last_undegraded":"2024-08-27T03:54:30.439720+0000","last_fullsized":"2024-08-27T03:54:30.439720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:07:29.803901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'213","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058735+0000","last_change":"2024-08-27T02:31:10.635979+0000","last_active":"2024-08-27T03:54:31.058735+0000","last_peered":"2024-08-27T03:54:31.058735+0000","last_clean":"2024-08-27T03:54:31.058735+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:54:31.058735+0000","last_undegraded":"2024-08-27T03:54:31.058735+0000","last_fullsized":"2024-08-27T03:54:31.058735+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:42.747005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'718","reported_seq":2957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.985171+0000","last_change":"2024-08-27T02:31:12.507006+0000","last_active":"2024-08-27T03:58:28.985171+0000","last_peered":"2024-08-27T03:58:28.985171+0000","last_clean":"2024-08-27T03:58:28.985171+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:58:28.985171+0000","last_undegraded":"2024-08-27T03:58:28.985171+0000","last_fullsized":"2024-08-27T03:58:28.985171+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:59.445792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:09.915872+0000","last_change":"2024-08-27T02:31:15.023353+0000","last_active":"2024-08-27T03:57:09.915872+0000","last_peered":"2024-08-27T03:57:09.915872+0000","last_clean":"2024-08-27T03:57:09.915872+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:57:09.915872+0000","last_undegraded":"2024-08-27T03:57:09.915872+0000","last_fullsized":"2024-08-27T03:57:09.915872+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:35:33.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'409","reported_seq":1935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891884+0000","last_change":"2024-08-27T02:31:06.459269+0000","last_active":"2024-08-27T03:55:34.891884+0000","last_peered":"2024-08-27T03:55:34.891884+0000","last_clean":"2024-08-27T03:55:34.891884+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:55:34.891884+0000","last_undegraded":"2024-08-27T03:55:34.891884+0000","last_fullsized":"2024-08-27T03:55:34.891884+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.224368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'287","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.926929+0000","last_change":"2024-08-27T02:31:04.477646+0000","last_active":"2024-08-27T03:58:29.926929+0000","last_peered":"2024-08-27T03:58:29.926929+0000","last_clean":"2024-08-27T03:58:29.926929+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:29.926929+0000","last_undegraded":"2024-08-27T03:58:29.926929+0000","last_fullsized":"2024-08-27T03:58:29.926929+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:45.643961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114302,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":459,"num_read_kb":4604,"num_write":975,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070645+0000","last_change":"2024-08-27T02:30:54.235830+0000","last_active":"2024-08-27T03:55:26.070645+0000","last_peered":"2024-08-27T03:55:26.070645+0000","last_clean":"2024-08-27T03:55:26.070645+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:55:26.070645+0000","last_undegraded":"2024-08-27T03:55:26.070645+0000","last_fullsized":"2024-08-27T03:55:26.070645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:16.134185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072798+0000","last_change":"2024-08-27T02:31:08.458894+0000","last_active":"2024-08-27T03:54:30.072798+0000","last_peered":"2024-08-27T03:54:30.072798+0000","last_clean":"2024-08-27T03:54:30.072798+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:54:30.072798+0000","last_undegraded":"2024-08-27T03:54:30.072798+0000","last_fullsized":"2024-08-27T03:54:30.072798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:30.416824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'160","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072928+0000","last_change":"2024-08-27T02:31:10.461453+0000","last_active":"2024-08-27T03:54:30.072928+0000","last_peered":"2024-08-27T03:54:30.072928+0000","last_clean":"2024-08-27T03:54:30.072928+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:54:30.072928+0000","last_undegraded":"2024-08-27T03:54:30.072928+0000","last_fullsized":"2024-08-27T03:54:30.072928+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:13.247299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'729","reported_seq":4712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.995663+0000","last_change":"2024-08-27T02:31:12.506051+0000","last_active":"2024-08-27T03:58:28.995663+0000","last_peered":"2024-08-27T03:58:28.995663+0000","last_clean":"2024-08-27T03:58:28.995663+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:58:28.995663+0000","last_undegraded":"2024-08-27T03:58:28.995663+0000","last_fullsized":"2024-08-27T03:58:28.995663+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:23:19.155039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'206","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.485251+0000","last_change":"2024-08-27T02:31:14.511228+0000","last_active":"2024-08-27T03:56:44.485251+0000","last_peered":"2024-08-27T03:56:44.485251+0000","last_clean":"2024-08-27T03:56:44.485251+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:56:44.485251+0000","last_undegraded":"2024-08-27T03:56:44.485251+0000","last_fullsized":"2024-08-27T03:56:44.485251+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:49:37.070870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'395","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217585+0000","last_change":"2024-08-27T02:31:06.439611+0000","last_active":"2024-08-27T03:55:54.217585+0000","last_peered":"2024-08-27T03:55:54.217585+0000","last_clean":"2024-08-27T03:55:54.217585+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:55:54.217585+0000","last_undegraded":"2024-08-27T03:55:54.217585+0000","last_fullsized":"2024-08-27T03:55:54.217585+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:00:53.658025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'311","reported_seq":967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.136785+0000","last_change":"2024-08-27T02:31:04.493690+0000","last_active":"2024-08-27T03:58:30.136785+0000","last_peered":"2024-08-27T03:58:30.136785+0000","last_clean":"2024-08-27T03:58:30.136785+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:30.136785+0000","last_undegraded":"2024-08-27T03:58:30.136785+0000","last_fullsized":"2024-08-27T03:58:30.136785+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:56.655781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2081743,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":421,"num_read_kb":35253,"num_write":1065,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.451652+0000","last_change":"2024-08-27T02:30:54.326308+0000","last_active":"2024-08-27T03:55:25.451652+0000","last_peered":"2024-08-27T03:55:25.451652+0000","last_clean":"2024-08-27T03:55:25.451652+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:55:25.451652+0000","last_undegraded":"2024-08-27T03:55:25.451652+0000","last_fullsized":"2024-08-27T03:55:25.451652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:39.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891808+0000","last_change":"2024-08-27T02:31:08.470557+0000","last_active":"2024-08-27T03:55:34.891808+0000","last_peered":"2024-08-27T03:55:34.891808+0000","last_clean":"2024-08-27T03:55:34.891808+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:55:34.891808+0000","last_undegraded":"2024-08-27T03:55:34.891808+0000","last_fullsized":"2024-08-27T03:55:34.891808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:16.200643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'793","reported_seq":1544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.184483+0000","last_change":"2024-08-27T02:31:10.635066+0000","last_active":"2024-08-27T03:58:30.184483+0000","last_peered":"2024-08-27T03:58:30.184483+0000","last_clean":"2024-08-27T03:58:30.184483+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:30.184483+0000","last_undegraded":"2024-08-27T03:58:30.184483+0000","last_fullsized":"2024-08-27T03:58:30.184483+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:14:49.402084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1403,"num_read_kb":3271,"num_write":1144,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:34.872717+0000","last_change":"2024-08-27T02:31:12.504645+0000","last_active":"2024-08-27T03:54:34.872717+0000","last_peered":"2024-08-27T03:54:34.872717+0000","last_clean":"2024-08-27T03:54:34.872717+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:54:34.872717+0000","last_undegraded":"2024-08-27T03:54:34.872717+0000","last_fullsized":"2024-08-27T03:54:34.872717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:57.439347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858183+0000","last_change":"2024-08-27T02:31:14.522454+0000","last_active":"2024-08-27T03:54:29.858183+0000","last_peered":"2024-08-27T03:54:29.858183+0000","last_clean":"2024-08-27T03:54:29.858183+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:54:29.858183+0000","last_undegraded":"2024-08-27T03:54:29.858183+0000","last_fullsized":"2024-08-27T03:54:29.858183+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:07.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'163","reported_seq":747,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.991063+0000","last_change":"2024-08-27T02:31:14.511332+0000","last_active":"2024-08-27T03:56:42.991063+0000","last_peered":"2024-08-27T03:56:42.991063+0000","last_clean":"2024-08-27T03:56:42.991063+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:56:42.991063+0000","last_undegraded":"2024-08-27T03:56:42.991063+0000","last_fullsized":"2024-08-27T03:56:42.991063+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:05:01.793333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'935","reported_seq":2440,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677370+0000","last_change":"2024-08-27T02:31:06.457663+0000","last_active":"2024-08-27T03:56:42.677370+0000","last_peered":"2024-08-27T03:56:42.677370+0000","last_clean":"2024-08-27T03:56:42.677370+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:56:42.677370+0000","last_undegraded":"2024-08-27T03:56:42.677370+0000","last_fullsized":"2024-08-27T03:56:42.677370+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:41.288217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'338","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.023357+0000","last_change":"2024-08-27T02:31:04.463717+0000","last_active":"2024-08-27T03:58:30.023357+0000","last_peered":"2024-08-27T03:58:30.023357+0000","last_clean":"2024-08-27T03:58:30.023357+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:30.023357+0000","last_undegraded":"2024-08-27T03:58:30.023357+0000","last_fullsized":"2024-08-27T03:58:30.023357+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:55:39.806434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263718,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":571,"num_read_kb":506,"num_write":1104,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:11.067136+0000","last_change":"2024-08-27T02:31:08.470840+0000","last_active":"2024-08-27T03:55:11.067136+0000","last_peered":"2024-08-27T03:55:11.067136+0000","last_clean":"2024-08-27T03:55:11.067136+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:55:11.067136+0000","last_undegraded":"2024-08-27T03:55:11.067136+0000","last_fullsized":"2024-08-27T03:55:11.067136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:02.714442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'277","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.899420+0000","last_change":"2024-08-27T02:31:10.463641+0000","last_active":"2024-08-27T03:58:03.899420+0000","last_peered":"2024-08-27T03:58:03.899420+0000","last_clean":"2024-08-27T03:58:03.899420+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:58:03.899420+0000","last_undegraded":"2024-08-27T03:58:03.899420+0000","last_fullsized":"2024-08-27T03:58:03.899420+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:35:43.609652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":874,"num_write":346,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.886578+0000","last_change":"2024-08-27T02:31:12.505279+0000","last_active":"2024-08-27T03:55:14.886578+0000","last_peered":"2024-08-27T03:55:14.886578+0000","last_clean":"2024-08-27T03:55:14.886578+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:55:14.886578+0000","last_undegraded":"2024-08-27T03:55:14.886578+0000","last_fullsized":"2024-08-27T03:55:14.886578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:41.364605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.893070+0000","last_change":"2024-08-27T02:31:14.521163+0000","last_active":"2024-08-27T03:55:39.893070+0000","last_peered":"2024-08-27T03:55:39.893070+0000","last_clean":"2024-08-27T03:55:39.893070+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:55:39.893070+0000","last_undegraded":"2024-08-27T03:55:39.893070+0000","last_fullsized":"2024-08-27T03:55:39.893070+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:59:46.536741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'377","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065840+0000","last_change":"2024-08-27T02:31:06.474269+0000","last_active":"2024-08-27T03:55:06.065840+0000","last_peered":"2024-08-27T03:55:06.065840+0000","last_clean":"2024-08-27T03:55:06.065840+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:55:06.065840+0000","last_undegraded":"2024-08-27T03:55:06.065840+0000","last_fullsized":"2024-08-27T03:55:06.065840+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:31:44.710331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'288","reported_seq":895,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.148282+0000","last_change":"2024-08-27T02:31:04.501132+0000","last_active":"2024-08-27T03:58:30.148282+0000","last_peered":"2024-08-27T03:58:30.148282+0000","last_clean":"2024-08-27T03:58:30.148282+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:30.148282+0000","last_undegraded":"2024-08-27T03:58:30.148282+0000","last_fullsized":"2024-08-27T03:58:30.148282+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:51.438866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31307,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":399,"num_read_kb":2061,"num_write":936,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.885122+0000","last_change":"2024-08-27T02:31:08.461957+0000","last_active":"2024-08-27T03:55:09.885122+0000","last_peered":"2024-08-27T03:55:09.885122+0000","last_clean":"2024-08-27T03:55:09.885122+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:55:09.885122+0000","last_undegraded":"2024-08-27T03:55:09.885122+0000","last_fullsized":"2024-08-27T03:55:09.885122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:42.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'55","reported_seq":585,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.285806+0000","last_change":"2024-08-27T02:31:10.464843+0000","last_active":"2024-08-27T03:55:10.285806+0000","last_peered":"2024-08-27T03:55:10.285806+0000","last_clean":"2024-08-27T03:55:10.285806+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:55:10.285806+0000","last_undegraded":"2024-08-27T03:55:10.285806+0000","last_fullsized":"2024-08-27T03:55:10.285806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:47:45.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292286+0000","last_change":"2024-08-27T02:31:12.506193+0000","last_active":"2024-08-27T03:55:15.292286+0000","last_peered":"2024-08-27T03:55:15.292286+0000","last_clean":"2024-08-27T03:55:15.292286+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:55:15.292286+0000","last_undegraded":"2024-08-27T03:55:15.292286+0000","last_fullsized":"2024-08-27T03:55:15.292286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:31:44.393834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'182","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.584739+0000","last_change":"2024-08-27T02:31:14.517907+0000","last_active":"2024-08-27T03:56:42.584739+0000","last_peered":"2024-08-27T03:56:42.584739+0000","last_clean":"2024-08-27T03:56:42.584739+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:56:42.584739+0000","last_undegraded":"2024-08-27T03:56:42.584739+0000","last_fullsized":"2024-08-27T03:56:42.584739+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:28.044838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'411","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.884819+0000","last_change":"2024-08-27T02:31:06.459463+0000","last_active":"2024-08-27T03:55:09.884819+0000","last_peered":"2024-08-27T03:55:09.884819+0000","last_clean":"2024-08-27T03:55:09.884819+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:55:09.884819+0000","last_undegraded":"2024-08-27T03:55:09.884819+0000","last_fullsized":"2024-08-27T03:55:09.884819+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:50:28.320442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'282","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.834385+0000","last_change":"2024-08-27T02:31:04.477014+0000","last_active":"2024-08-27T03:58:29.834385+0000","last_peered":"2024-08-27T03:58:29.834385+0000","last_clean":"2024-08-27T03:58:29.834385+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:29.834385+0000","last_undegraded":"2024-08-27T03:58:29.834385+0000","last_fullsized":"2024-08-27T03:58:29.834385+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:53:15.700336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11011652,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":411,"num_read_kb":30350,"num_write":983,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290942+0000","last_change":"2024-08-27T02:31:08.450903+0000","last_active":"2024-08-27T03:55:10.290942+0000","last_peered":"2024-08-27T03:55:10.290942+0000","last_clean":"2024-08-27T03:55:10.290942+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:55:10.290942+0000","last_undegraded":"2024-08-27T03:55:10.290942+0000","last_fullsized":"2024-08-27T03:55:10.290942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:21.462233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'337","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.871493+0000","last_change":"2024-08-27T02:31:10.467565+0000","last_active":"2024-08-27T03:58:03.871493+0000","last_peered":"2024-08-27T03:58:03.871493+0000","last_clean":"2024-08-27T03:58:03.871493+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:58:03.871493+0000","last_undegraded":"2024-08-27T03:58:03.871493+0000","last_fullsized":"2024-08-27T03:58:03.871493+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:04:40.132706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60998,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":557,"num_read_kb":1116,"num_write":444,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449445+0000","last_change":"2024-08-27T02:31:12.502528+0000","last_active":"2024-08-27T03:55:15.449445+0000","last_peered":"2024-08-27T03:55:15.449445+0000","last_clean":"2024-08-27T03:55:15.449445+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:55:15.449445+0000","last_undegraded":"2024-08-27T03:55:15.449445+0000","last_fullsized":"2024-08-27T03:55:15.449445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:14.781588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'114","reported_seq":626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847662+0000","last_change":"2024-08-27T02:31:14.521917+0000","last_active":"2024-08-27T03:53:44.847662+0000","last_peered":"2024-08-27T03:53:44.847662+0000","last_clean":"2024-08-27T03:53:44.847662+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:53:44.847662+0000","last_undegraded":"2024-08-27T03:53:44.847662+0000","last_fullsized":"2024-08-27T03:53:44.847662+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:08:19.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'418","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.908107+0000","last_change":"2024-08-27T02:31:06.451606+0000","last_active":"2024-08-27T03:58:02.908107+0000","last_peered":"2024-08-27T03:58:02.908107+0000","last_clean":"2024-08-27T03:58:02.908107+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:02.908107+0000","last_undegraded":"2024-08-27T03:58:02.908107+0000","last_fullsized":"2024-08-27T03:58:02.908107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:09:38.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'298","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.010900+0000","last_change":"2024-08-27T02:31:04.453573+0000","last_active":"2024-08-27T03:58:30.010900+0000","last_peered":"2024-08-27T03:58:30.010900+0000","last_clean":"2024-08-27T03:58:30.010900+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:30.010900+0000","last_undegraded":"2024-08-27T03:58:30.010900+0000","last_fullsized":"2024-08-27T03:58:30.010900+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:04.196182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1025086,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":416,"num_read_kb":16403,"num_write":1095,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.448286+0000","last_change":"2024-08-27T02:31:08.465448+0000","last_active":"2024-08-27T03:55:10.448286+0000","last_peered":"2024-08-27T03:55:10.448286+0000","last_clean":"2024-08-27T03:55:10.448286+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:55:10.448286+0000","last_undegraded":"2024-08-27T03:55:10.448286+0000","last_fullsized":"2024-08-27T03:55:10.448286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:16:51.893136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'281","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.033952+0000","last_change":"2024-08-27T02:31:10.476895+0000","last_active":"2024-08-27T03:58:30.033952+0000","last_peered":"2024-08-27T03:58:30.033952+0000","last_clean":"2024-08-27T03:58:30.033952+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:58:30.033952+0000","last_undegraded":"2024-08-27T03:58:30.033952+0000","last_fullsized":"2024-08-27T03:58:30.033952+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:34:48.785917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287158+0000","last_change":"2024-08-27T02:31:12.521407+0000","last_active":"2024-08-27T03:55:15.287158+0000","last_peered":"2024-08-27T03:55:15.287158+0000","last_clean":"2024-08-27T03:55:15.287158+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:55:15.287158+0000","last_undegraded":"2024-08-27T03:55:15.287158+0000","last_fullsized":"2024-08-27T03:55:15.287158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:41:44.290066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'836","reported_seq":2411,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215749+0000","last_change":"2024-08-27T02:31:06.459141+0000","last_active":"2024-08-27T03:55:54.215749+0000","last_peered":"2024-08-27T03:55:54.215749+0000","last_clean":"2024-08-27T03:55:54.215749+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:55:54.215749+0000","last_undegraded":"2024-08-27T03:55:54.215749+0000","last_fullsized":"2024-08-27T03:55:54.215749+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:38:51.610195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'373","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.886416+0000","last_change":"2024-08-27T02:31:04.437260+0000","last_active":"2024-08-27T03:58:29.886416+0000","last_peered":"2024-08-27T03:58:29.886416+0000","last_clean":"2024-08-27T03:58:29.886416+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:29.886416+0000","last_undegraded":"2024-08-27T03:58:29.886416+0000","last_fullsized":"2024-08-27T03:58:29.886416+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:58.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130642,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":717,"num_read_kb":11072,"num_write":1329,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.289681+0000","last_change":"2024-08-27T02:31:08.460233+0000","last_active":"2024-08-27T03:55:25.289681+0000","last_peered":"2024-08-27T03:55:25.289681+0000","last_clean":"2024-08-27T03:55:25.289681+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:55:25.289681+0000","last_undegraded":"2024-08-27T03:55:25.289681+0000","last_fullsized":"2024-08-27T03:55:25.289681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:26.664269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'547","reported_seq":1203,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.953613+0000","last_change":"2024-08-27T02:31:10.471987+0000","last_active":"2024-08-27T03:58:29.953613+0000","last_peered":"2024-08-27T03:58:29.953613+0000","last_clean":"2024-08-27T03:58:29.953613+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:29.953613+0000","last_undegraded":"2024-08-27T03:58:29.953613+0000","last_fullsized":"2024-08-27T03:58:29.953613+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:10:16.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":977,"num_read_kb":2264,"num_write":852,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847691+0000","last_change":"2024-08-27T02:31:12.513046+0000","last_active":"2024-08-27T03:53:44.847691+0000","last_peered":"2024-08-27T03:53:44.847691+0000","last_clean":"2024-08-27T03:53:44.847691+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:53:44.847691+0000","last_undegraded":"2024-08-27T03:53:44.847691+0000","last_fullsized":"2024-08-27T03:53:44.847691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:14.240422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'140","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.320188+0000","last_change":"2024-08-27T02:31:15.026496+0000","last_active":"2024-08-27T03:56:39.320188+0000","last_peered":"2024-08-27T03:56:39.320188+0000","last_clean":"2024-08-27T03:56:39.320188+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:56:39.320188+0000","last_undegraded":"2024-08-27T03:56:39.320188+0000","last_fullsized":"2024-08-27T03:56:39.320188+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:25.778670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1179","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.212577+0000","last_change":"2024-08-27T02:31:06.444819+0000","last_active":"2024-08-27T03:55:54.212577+0000","last_peered":"2024-08-27T03:55:54.212577+0000","last_clean":"2024-08-27T03:55:54.212577+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:55:54.212577+0000","last_undegraded":"2024-08-27T03:55:54.212577+0000","last_fullsized":"2024-08-27T03:55:54.212577+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:12.874709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'328","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.080251+0000","last_change":"2024-08-27T02:31:04.452002+0000","last_active":"2024-08-27T03:58:31.080251+0000","last_peered":"2024-08-27T03:58:31.080251+0000","last_clean":"2024-08-27T03:58:31.080251+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:31.080251+0000","last_undegraded":"2024-08-27T03:58:31.080251+0000","last_fullsized":"2024-08-27T03:58:31.080251+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:54.064616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5598635,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":512,"num_read_kb":41676,"num_write":1072,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439838+0000","last_change":"2024-08-27T02:31:08.468006+0000","last_active":"2024-08-27T03:54:30.439838+0000","last_peered":"2024-08-27T03:54:30.439838+0000","last_clean":"2024-08-27T03:54:30.439838+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:54:30.439838+0000","last_undegraded":"2024-08-27T03:54:30.439838+0000","last_fullsized":"2024-08-27T03:54:30.439838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:40:17.372181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'350","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.104104+0000","last_change":"2024-08-27T02:31:10.477408+0000","last_active":"2024-08-27T03:58:30.104104+0000","last_peered":"2024-08-27T03:58:30.104104+0000","last_clean":"2024-08-27T03:58:30.104104+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:58:30.104104+0000","last_undegraded":"2024-08-27T03:58:30.104104+0000","last_fullsized":"2024-08-27T03:58:30.104104+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:59:29.617560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:46.048972+0000","last_change":"2024-08-27T02:31:12.493945+0000","last_active":"2024-08-27T03:53:46.048972+0000","last_peered":"2024-08-27T03:53:46.048972+0000","last_clean":"2024-08-27T03:53:46.048972+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:53:46.048972+0000","last_undegraded":"2024-08-27T03:53:46.048972+0000","last_fullsized":"2024-08-27T03:53:46.048972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449386+0000","last_change":"2024-08-27T02:31:14.521472+0000","last_active":"2024-08-27T03:55:15.449386+0000","last_peered":"2024-08-27T03:55:15.449386+0000","last_clean":"2024-08-27T03:55:15.449386+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:55:15.449386+0000","last_undegraded":"2024-08-27T03:55:15.449386+0000","last_fullsized":"2024-08-27T03:55:15.449386+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:13.751034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'696","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.472769+0000","last_change":"2024-08-27T02:31:06.446538+0000","last_active":"2024-08-27T03:56:44.472769+0000","last_peered":"2024-08-27T03:56:44.472769+0000","last_clean":"2024-08-27T03:56:44.472769+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:56:44.472769+0000","last_undegraded":"2024-08-27T03:56:44.472769+0000","last_fullsized":"2024-08-27T03:56:44.472769+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:59:31.607194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'296","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.096874+0000","last_change":"2024-08-27T02:31:04.486015+0000","last_active":"2024-08-27T03:58:30.096874+0000","last_peered":"2024-08-27T03:58:30.096874+0000","last_clean":"2024-08-27T03:58:30.096874+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:30.096874+0000","last_undegraded":"2024-08-27T03:58:30.096874+0000","last_fullsized":"2024-08-27T03:58:30.096874+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:24.013613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5264007,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":435,"num_read_kb":27839,"num_write":1080,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.061200+0000","last_change":"2024-08-27T02:31:08.461902+0000","last_active":"2024-08-27T03:53:40.061200+0000","last_peered":"2024-08-27T03:53:40.061200+0000","last_clean":"2024-08-27T03:53:40.061200+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:53:40.061200+0000","last_undegraded":"2024-08-27T03:53:40.061200+0000","last_fullsized":"2024-08-27T03:53:40.061200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:54:08.973943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'319","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.910261+0000","last_change":"2024-08-27T02:31:10.636027+0000","last_active":"2024-08-27T03:58:03.910261+0000","last_peered":"2024-08-27T03:58:03.910261+0000","last_clean":"2024-08-27T03:58:03.910261+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:58:03.910261+0000","last_undegraded":"2024-08-27T03:58:03.910261+0000","last_fullsized":"2024-08-27T03:58:03.910261+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:09:14.223534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79082,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":1091,"num_write":420,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:31.071793+0000","last_change":"2024-08-27T02:31:12.498318+0000","last_active":"2024-08-27T03:55:31.071793+0000","last_peered":"2024-08-27T03:55:31.071793+0000","last_clean":"2024-08-27T03:55:31.071793+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:55:31.071793+0000","last_undegraded":"2024-08-27T03:55:31.071793+0000","last_fullsized":"2024-08-27T03:55:31.071793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:41.474651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.928313+0000","last_change":"2024-08-27T02:31:14.521960+0000","last_active":"2024-08-27T03:58:03.928313+0000","last_peered":"2024-08-27T03:58:03.928313+0000","last_clean":"2024-08-27T03:58:03.928313+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:58:03.928313+0000","last_undegraded":"2024-08-27T03:58:03.928313+0000","last_fullsized":"2024-08-27T03:58:03.928313+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:38:31.904177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'789","reported_seq":2418,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:50.098393+0000","last_change":"2024-08-27T02:31:06.453981+0000","last_active":"2024-08-27T03:53:50.098393+0000","last_peered":"2024-08-27T03:53:50.098393+0000","last_clean":"2024-08-27T03:53:50.098393+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:53:50.098393+0000","last_undegraded":"2024-08-27T03:53:50.098393+0000","last_fullsized":"2024-08-27T03:53:50.098393+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:08.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'290","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.293948+0000","last_change":"2024-08-27T02:31:04.466853+0000","last_active":"2024-08-27T03:58:30.293948+0000","last_peered":"2024-08-27T03:58:30.293948+0000","last_clean":"2024-08-27T03:58:30.293948+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:30.293948+0000","last_undegraded":"2024-08-27T03:58:30.293948+0000","last_fullsized":"2024-08-27T03:58:30.293948+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:53:03.083121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432855,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":441,"num_read_kb":2807,"num_write":1035,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:41.048008+0000","last_change":"2024-08-27T02:31:08.471391+0000","last_active":"2024-08-27T03:53:41.048008+0000","last_peered":"2024-08-27T03:53:41.048008+0000","last_clean":"2024-08-27T03:53:41.048008+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:53:41.048008+0000","last_undegraded":"2024-08-27T03:53:41.048008+0000","last_fullsized":"2024-08-27T03:53:41.048008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:57.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'131","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.086304+0000","last_change":"2024-08-27T02:31:10.635520+0000","last_active":"2024-08-27T03:55:25.086304+0000","last_peered":"2024-08-27T03:55:25.086304+0000","last_clean":"2024-08-27T03:55:25.086304+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:55:25.086304+0000","last_undegraded":"2024-08-27T03:55:25.086304+0000","last_fullsized":"2024-08-27T03:55:25.086304+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:36:27.001114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'692","reported_seq":2817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.982163+0000","last_change":"2024-08-27T02:31:12.490737+0000","last_active":"2024-08-27T03:58:28.982163+0000","last_peered":"2024-08-27T03:58:28.982163+0000","last_clean":"2024-08-27T03:58:28.982163+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:28.982163+0000","last_undegraded":"2024-08-27T03:58:28.982163+0000","last_fullsized":"2024-08-27T03:58:28.982163+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:40.803189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'112","reported_seq":615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.583823+0000","last_change":"2024-08-27T02:31:14.516613+0000","last_active":"2024-08-27T03:56:38.583823+0000","last_peered":"2024-08-27T03:56:38.583823+0000","last_clean":"2024-08-27T03:56:38.583823+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:56:38.583823+0000","last_undegraded":"2024-08-27T03:56:38.583823+0000","last_fullsized":"2024-08-27T03:56:38.583823+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:26:30.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'786","reported_seq":2382,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:02.876625+0000","last_change":"2024-08-27T02:31:06.467671+0000","last_active":"2024-08-27T03:54:02.876625+0000","last_peered":"2024-08-27T03:54:02.876625+0000","last_clean":"2024-08-27T03:54:02.876625+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:54:02.876625+0000","last_undegraded":"2024-08-27T03:54:02.876625+0000","last_fullsized":"2024-08-27T03:54:02.876625+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:18:26.329266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'259","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.905414+0000","last_change":"2024-08-27T02:31:04.463606+0000","last_active":"2024-08-27T03:58:29.905414+0000","last_peered":"2024-08-27T03:58:29.905414+0000","last_clean":"2024-08-27T03:58:29.905414+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:29.905414+0000","last_undegraded":"2024-08-27T03:58:29.905414+0000","last_fullsized":"2024-08-27T03:58:29.905414+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:15.431577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555320,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":465,"num_read_kb":12943,"num_write":951,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.268711+0000","last_change":"2024-08-27T02:31:08.447203+0000","last_active":"2024-08-27T03:53:40.268711+0000","last_peered":"2024-08-27T03:53:40.268711+0000","last_clean":"2024-08-27T03:53:40.268711+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:53:40.268711+0000","last_undegraded":"2024-08-27T03:53:40.268711+0000","last_fullsized":"2024-08-27T03:53:40.268711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:41.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'379","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.396807+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.396807+0000","last_peered":"2024-08-27T03:58:29.396807+0000","last_clean":"2024-08-27T03:58:29.396807+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:58:29.396807+0000","last_undegraded":"2024-08-27T03:58:29.396807+0000","last_fullsized":"2024-08-27T03:58:29.396807+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:12.752267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.295363+0000","last_change":"2024-08-27T02:31:12.517594+0000","last_active":"2024-08-27T03:55:50.295363+0000","last_peered":"2024-08-27T03:55:50.295363+0000","last_clean":"2024-08-27T03:55:50.295363+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:55:50.295363+0000","last_undegraded":"2024-08-27T03:55:50.295363+0000","last_fullsized":"2024-08-27T03:55:50.295363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:58:27.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'112","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.818594+0000","last_change":"2024-08-27T02:31:14.523873+0000","last_active":"2024-08-27T03:56:44.818594+0000","last_peered":"2024-08-27T03:56:44.818594+0000","last_clean":"2024-08-27T03:56:44.818594+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:56:44.818594+0000","last_undegraded":"2024-08-27T03:56:44.818594+0000","last_fullsized":"2024-08-27T03:56:44.818594+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:56.720396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'372","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:53.153842+0000","last_change":"2024-08-27T02:31:06.465894+0000","last_active":"2024-08-27T03:53:53.153842+0000","last_peered":"2024-08-27T03:53:53.153842+0000","last_clean":"2024-08-27T03:53:53.153842+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:53:53.153842+0000","last_undegraded":"2024-08-27T03:53:53.153842+0000","last_fullsized":"2024-08-27T03:53:53.153842+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:23:38.612022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'289","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.843276+0000","last_change":"2024-08-27T02:31:04.450156+0000","last_active":"2024-08-27T03:58:29.843276+0000","last_peered":"2024-08-27T03:58:29.843276+0000","last_clean":"2024-08-27T03:58:29.843276+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:29.843276+0000","last_undegraded":"2024-08-27T03:58:29.843276+0000","last_fullsized":"2024-08-27T03:58:29.843276+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:04:33.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":438,"num_read_kb":8306,"num_write":1009,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:39.846494+0000","last_change":"2024-08-27T02:31:08.463927+0000","last_active":"2024-08-27T03:53:39.846494+0000","last_peered":"2024-08-27T03:53:39.846494+0000","last_clean":"2024-08-27T03:53:39.846494+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:53:39.846494+0000","last_undegraded":"2024-08-27T03:53:39.846494+0000","last_fullsized":"2024-08-27T03:53:39.846494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:31:34.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'268","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.468339+0000","last_change":"2024-08-27T02:31:10.470453+0000","last_active":"2024-08-27T03:58:29.468339+0000","last_peered":"2024-08-27T03:58:29.468339+0000","last_clean":"2024-08-27T03:58:29.468339+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:58:29.468339+0000","last_undegraded":"2024-08-27T03:58:29.468339+0000","last_fullsized":"2024-08-27T03:58:29.468339+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:46.212245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.459171+0000","last_change":"2024-08-27T02:31:12.494052+0000","last_active":"2024-08-27T03:56:00.459171+0000","last_peered":"2024-08-27T03:56:00.459171+0000","last_clean":"2024-08-27T03:56:00.459171+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:56:00.459171+0000","last_undegraded":"2024-08-27T03:56:00.459171+0000","last_fullsized":"2024-08-27T03:56:00.459171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:24.014947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'135","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.343269+0000","last_change":"2024-08-27T02:31:15.027895+0000","last_active":"2024-08-27T03:56:39.343269+0000","last_peered":"2024-08-27T03:56:39.343269+0000","last_clean":"2024-08-27T03:56:39.343269+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:56:39.343269+0000","last_undegraded":"2024-08-27T03:56:39.343269+0000","last_fullsized":"2024-08-27T03:56:39.343269+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:31:36.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'733","reported_seq":2227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.476464+0000","last_change":"2024-08-27T02:31:06.447002+0000","last_active":"2024-08-27T03:56:44.476464+0000","last_peered":"2024-08-27T03:56:44.476464+0000","last_clean":"2024-08-27T03:56:44.476464+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:56:44.476464+0000","last_undegraded":"2024-08-27T03:56:44.476464+0000","last_fullsized":"2024-08-27T03:56:44.476464+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:04.399827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'279","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.891388+0000","last_change":"2024-08-27T02:31:04.476828+0000","last_active":"2024-08-27T03:58:29.891388+0000","last_peered":"2024-08-27T03:58:29.891388+0000","last_clean":"2024-08-27T03:58:29.891388+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:29.891388+0000","last_undegraded":"2024-08-27T03:58:29.891388+0000","last_fullsized":"2024-08-27T03:58:29.891388+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:42:38.137890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54920,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":459,"num_read_kb":19461,"num_write":1068,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090711+0000","last_change":"2024-08-27T02:31:08.468289+0000","last_active":"2024-08-27T03:55:45.090711+0000","last_peered":"2024-08-27T03:55:45.090711+0000","last_clean":"2024-08-27T03:55:45.090711+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:55:45.090711+0000","last_undegraded":"2024-08-27T03:55:45.090711+0000","last_fullsized":"2024-08-27T03:55:45.090711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:51:14.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'275","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.904700+0000","last_change":"2024-08-27T02:31:10.474659+0000","last_active":"2024-08-27T03:58:03.904700+0000","last_peered":"2024-08-27T03:58:03.904700+0000","last_clean":"2024-08-27T03:58:03.904700+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:58:03.904700+0000","last_undegraded":"2024-08-27T03:58:03.904700+0000","last_fullsized":"2024-08-27T03:58:03.904700+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:14.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62250,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":458,"num_read_kb":1041,"num_write":384,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.062348+0000","last_change":"2024-08-27T02:31:12.494960+0000","last_active":"2024-08-27T03:53:45.062348+0000","last_peered":"2024-08-27T03:53:45.062348+0000","last_clean":"2024-08-27T03:53:45.062348+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:53:45.062348+0000","last_undegraded":"2024-08-27T03:53:45.062348+0000","last_fullsized":"2024-08-27T03:53:45.062348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:23.135684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'178","reported_seq":1652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.531902+0000","last_change":"2024-08-27T02:31:14.521123+0000","last_active":"2024-08-27T03:56:38.531902+0000","last_peered":"2024-08-27T03:56:38.531902+0000","last_clean":"2024-08-27T03:56:38.531902+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:56:38.531902+0000","last_undegraded":"2024-08-27T03:56:38.531902+0000","last_fullsized":"2024-08-27T03:56:38.531902+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:15.425652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'548","reported_seq":2365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090765+0000","last_change":"2024-08-27T02:31:06.457635+0000","last_active":"2024-08-27T03:55:45.090765+0000","last_peered":"2024-08-27T03:55:45.090765+0000","last_clean":"2024-08-27T03:55:45.090765+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:55:45.090765+0000","last_undegraded":"2024-08-27T03:55:45.090765+0000","last_fullsized":"2024-08-27T03:55:45.090765+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:15:48.872076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'267","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.221760+0000","last_change":"2024-08-27T02:31:38.758741+0000","last_active":"2024-08-27T03:58:30.221760+0000","last_peered":"2024-08-27T03:58:30.221760+0000","last_clean":"2024-08-27T03:58:30.221760+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:30.221760+0000","last_undegraded":"2024-08-27T03:58:30.221760+0000","last_fullsized":"2024-08-27T03:58:30.221760+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:08.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586726,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":462,"num_read_kb":5169,"num_write":992,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:01.078719+0000","last_change":"2024-08-27T02:31:08.471579+0000","last_active":"2024-08-27T03:56:01.078719+0000","last_peered":"2024-08-27T03:56:01.078719+0000","last_clean":"2024-08-27T03:56:01.078719+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:56:01.078719+0000","last_undegraded":"2024-08-27T03:56:01.078719+0000","last_fullsized":"2024-08-27T03:56:01.078719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:24.013362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'300","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.914655+0000","last_change":"2024-08-27T02:31:10.462249+0000","last_active":"2024-08-27T03:58:03.914655+0000","last_peered":"2024-08-27T03:58:03.914655+0000","last_clean":"2024-08-27T03:58:03.914655+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:58:03.914655+0000","last_undegraded":"2024-08-27T03:58:03.914655+0000","last_fullsized":"2024-08-27T03:58:03.914655+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:52:58.552884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":928,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.486117+0000","last_change":"2024-08-27T02:31:12.523057+0000","last_active":"2024-08-27T03:53:45.486117+0000","last_peered":"2024-08-27T03:53:45.486117+0000","last_clean":"2024-08-27T03:53:45.486117+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:53:45.486117+0000","last_undegraded":"2024-08-27T03:53:45.486117+0000","last_fullsized":"2024-08-27T03:53:45.486117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:12:26.836037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'144","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.904543+0000","last_change":"2024-08-27T02:31:14.506679+0000","last_active":"2024-08-27T03:58:02.904543+0000","last_peered":"2024-08-27T03:58:02.904543+0000","last_clean":"2024-08-27T03:58:02.904543+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:58:02.904543+0000","last_undegraded":"2024-08-27T03:58:02.904543+0000","last_fullsized":"2024-08-27T03:58:02.904543+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:33.099195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'732","reported_seq":2154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073279+0000","last_change":"2024-08-27T02:31:06.469294+0000","last_active":"2024-08-27T03:55:36.073279+0000","last_peered":"2024-08-27T03:55:36.073279+0000","last_clean":"2024-08-27T03:55:36.073279+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:55:36.073279+0000","last_undegraded":"2024-08-27T03:55:36.073279+0000","last_fullsized":"2024-08-27T03:55:36.073279+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:14.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'292","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.355463+0000","last_change":"2024-08-27T02:31:04.482354+0000","last_active":"2024-08-27T03:58:30.355463+0000","last_peered":"2024-08-27T03:58:30.355463+0000","last_clean":"2024-08-27T03:58:30.355463+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:30.355463+0000","last_undegraded":"2024-08-27T03:58:30.355463+0000","last_fullsized":"2024-08-27T03:58:30.355463+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:41:12.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5309852,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":458,"num_read_kb":48183,"num_write":1046,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'437","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073216+0000","last_change":"2024-08-27T02:31:06.449966+0000","last_active":"2024-08-27T03:55:36.073216+0000","last_peered":"2024-08-27T03:55:36.073216+0000","last_clean":"2024-08-27T03:55:36.073216+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:55:36.073216+0000","last_undegraded":"2024-08-27T03:55:36.073216+0000","last_fullsized":"2024-08-27T03:55:36.073216+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:00:38.353825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'328","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.971557+0000","last_change":"2024-08-27T02:31:04.478639+0000","last_active":"2024-08-27T03:58:29.971557+0000","last_peered":"2024-08-27T03:58:29.971557+0000","last_clean":"2024-08-27T03:58:29.971557+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:29.971557+0000","last_undegraded":"2024-08-27T03:58:29.971557+0000","last_fullsized":"2024-08-27T03:58:29.971557+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:22:20.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4933358,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":495,"num_read_kb":9917,"num_write":1115,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'473","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874461+0000","last_change":"2024-08-27T02:31:06.450216+0000","last_active":"2024-08-27T03:55:39.874461+0000","last_peered":"2024-08-27T03:55:39.874461+0000","last_clean":"2024-08-27T03:55:39.874461+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:55:39.874461+0000","last_undegraded":"2024-08-27T03:55:39.874461+0000","last_fullsized":"2024-08-27T03:55:39.874461+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:14.184039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'373","reported_seq":1073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.016676+0000","last_change":"2024-08-27T02:31:38.749882+0000","last_active":"2024-08-27T03:58:30.016676+0000","last_peered":"2024-08-27T03:58:30.016676+0000","last_clean":"2024-08-27T03:58:30.016676+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:30.016676+0000","last_undegraded":"2024-08-27T03:58:30.016676+0000","last_fullsized":"2024-08-27T03:58:30.016676+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:33:03.649537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11540651,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":788,"num_read_kb":15883,"num_write":1148,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'570","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524113+0000","last_change":"2024-08-27T02:31:06.443475+0000","last_active":"2024-08-27T03:56:44.524113+0000","last_peered":"2024-08-27T03:56:44.524113+0000","last_clean":"2024-08-27T03:56:44.524113+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:56:44.524113+0000","last_undegraded":"2024-08-27T03:56:44.524113+0000","last_fullsized":"2024-08-27T03:56:44.524113+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:36:38.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'271","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.305882+0000","last_change":"2024-08-27T02:31:04.457012+0000","last_active":"2024-08-27T03:58:30.305882+0000","last_peered":"2024-08-27T03:58:30.305882+0000","last_clean":"2024-08-27T03:58:30.305882+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:30.305882+0000","last_undegraded":"2024-08-27T03:58:30.305882+0000","last_fullsized":"2024-08-27T03:58:30.305882+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:51:49.178714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7300249,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":591,"num_read_kb":27255,"num_write":970,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'606","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.938985+0000","last_change":"2024-08-27T02:31:06.461548+0000","last_active":"2024-08-27T03:58:02.938985+0000","last_peered":"2024-08-27T03:58:02.938985+0000","last_clean":"2024-08-27T03:58:02.938985+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:02.938985+0000","last_undegraded":"2024-08-27T03:58:02.938985+0000","last_fullsized":"2024-08-27T03:58:02.938985+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:54:26.910185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'312","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.858995+0000","last_change":"2024-08-27T02:31:04.476105+0000","last_active":"2024-08-27T03:58:29.858995+0000","last_peered":"2024-08-27T03:58:29.858995+0000","last_clean":"2024-08-27T03:58:29.858995+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:29.858995+0000","last_undegraded":"2024-08-27T03:58:29.858995+0000","last_fullsized":"2024-08-27T03:58:29.858995+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:19:35.578103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11437427,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":422,"num_read_kb":45250,"num_write":1008,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'437","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072894+0000","last_change":"2024-08-27T02:31:06.461180+0000","last_active":"2024-08-27T03:54:30.072894+0000","last_peered":"2024-08-27T03:54:30.072894+0000","last_clean":"2024-08-27T03:54:30.072894+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:54:30.072894+0000","last_undegraded":"2024-08-27T03:54:30.072894+0000","last_fullsized":"2024-08-27T03:54:30.072894+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:35:29.428642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'333","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.046535+0000","last_change":"2024-08-27T02:31:04.469464+0000","last_active":"2024-08-27T03:58:31.046535+0000","last_peered":"2024-08-27T03:58:31.046535+0000","last_clean":"2024-08-27T03:58:31.046535+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:31.046535+0000","last_undegraded":"2024-08-27T03:58:31.046535+0000","last_fullsized":"2024-08-27T03:58:31.046535+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:55:43.726324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109793,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":583,"num_read_kb":26118,"num_write":1288,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'574","reported_seq":2441,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.915919+0000","last_change":"2024-08-27T02:31:06.447514+0000","last_active":"2024-08-27T03:58:02.915919+0000","last_peered":"2024-08-27T03:58:02.915919+0000","last_clean":"2024-08-27T03:58:02.915919+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:02.915919+0000","last_undegraded":"2024-08-27T03:58:02.915919+0000","last_fullsized":"2024-08-27T03:58:02.915919+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:41:53.347545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'274","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.010651+0000","last_change":"2024-08-27T02:31:40.468497+0000","last_active":"2024-08-27T03:58:30.010651+0000","last_peered":"2024-08-27T03:58:30.010651+0000","last_clean":"2024-08-27T03:58:30.010651+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:30.010651+0000","last_undegraded":"2024-08-27T03:58:30.010651+0000","last_fullsized":"2024-08-27T03:58:30.010651+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:27.567253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11803400,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":511,"num_read_kb":100247,"num_write":996,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'445","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215939+0000","last_change":"2024-08-27T02:31:06.469696+0000","last_active":"2024-08-27T03:55:54.215939+0000","last_peered":"2024-08-27T03:55:54.215939+0000","last_clean":"2024-08-27T03:55:54.215939+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:55:54.215939+0000","last_undegraded":"2024-08-27T03:55:54.215939+0000","last_fullsized":"2024-08-27T03:55:54.215939+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:20.988932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'312","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.921673+0000","last_change":"2024-08-27T02:31:04.455655+0000","last_active":"2024-08-27T03:58:29.921673+0000","last_peered":"2024-08-27T03:58:29.921673+0000","last_clean":"2024-08-27T03:58:29.921673+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:29.921673+0000","last_undegraded":"2024-08-27T03:58:29.921673+0000","last_fullsized":"2024-08-27T03:58:29.921673+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:53:08.178860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23165461,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":520,"num_read_kb":99962,"num_write":1172,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'357","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.942738+0000","last_change":"2024-08-27T02:31:06.462059+0000","last_active":"2024-08-27T03:58:02.942738+0000","last_peered":"2024-08-27T03:58:02.942738+0000","last_clean":"2024-08-27T03:58:02.942738+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:02.942738+0000","last_undegraded":"2024-08-27T03:58:02.942738+0000","last_fullsized":"2024-08-27T03:58:02.942738+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:59.170394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'240","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.836375+0000","last_change":"2024-08-27T02:31:04.446192+0000","last_active":"2024-08-27T03:58:29.836375+0000","last_peered":"2024-08-27T03:58:29.836375+0000","last_clean":"2024-08-27T03:58:29.836375+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:29.836375+0000","last_undegraded":"2024-08-27T03:58:29.836375+0000","last_fullsized":"2024-08-27T03:58:29.836375+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:44.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1076308,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":356,"num_read_kb":6749,"num_write":893,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'639","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524102+0000","last_change":"2024-08-27T02:31:06.456393+0000","last_active":"2024-08-27T03:56:44.524102+0000","last_peered":"2024-08-27T03:56:44.524102+0000","last_clean":"2024-08-27T03:56:44.524102+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:56:44.524102+0000","last_undegraded":"2024-08-27T03:56:44.524102+0000","last_fullsized":"2024-08-27T03:56:44.524102+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:03.541422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'308","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.914602+0000","last_change":"2024-08-27T02:31:04.455660+0000","last_active":"2024-08-27T03:58:29.914602+0000","last_peered":"2024-08-27T03:58:29.914602+0000","last_clean":"2024-08-27T03:58:29.914602+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:29.914602+0000","last_undegraded":"2024-08-27T03:58:29.914602+0000","last_fullsized":"2024-08-27T03:58:29.914602+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:59:36.250505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4895758,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":522,"num_read_kb":2752,"num_write":1231,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'437","reported_seq":1952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.059524+0000","last_change":"2024-08-27T02:31:06.469100+0000","last_active":"2024-08-27T03:54:40.059524+0000","last_peered":"2024-08-27T03:54:40.059524+0000","last_clean":"2024-08-27T03:54:40.059524+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:54:40.059524+0000","last_undegraded":"2024-08-27T03:54:40.059524+0000","last_fullsized":"2024-08-27T03:54:40.059524+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:54:14.589392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'273","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.899218+0000","last_change":"2024-08-27T02:31:04.474597+0000","last_active":"2024-08-27T03:58:29.899218+0000","last_peered":"2024-08-27T03:58:29.899218+0000","last_clean":"2024-08-27T03:58:29.899218+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:29.899218+0000","last_undegraded":"2024-08-27T03:58:29.899218+0000","last_fullsized":"2024-08-27T03:58:29.899218+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:19:48.419717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172637,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":379,"num_read_kb":2564,"num_write":1008,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'612","reported_seq":2444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.590756+0000","last_change":"2024-08-27T02:31:06.473076+0000","last_active":"2024-08-27T03:56:42.590756+0000","last_peered":"2024-08-27T03:56:42.590756+0000","last_clean":"2024-08-27T03:56:42.590756+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:56:42.590756+0000","last_undegraded":"2024-08-27T03:56:42.590756+0000","last_fullsized":"2024-08-27T03:56:42.590756+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:19.460348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'278","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.253362+0000","last_change":"2024-08-27T02:31:04.466914+0000","last_active":"2024-08-27T03:58:30.253362+0000","last_peered":"2024-08-27T03:58:30.253362+0000","last_clean":"2024-08-27T03:58:30.253362+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:30.253362+0000","last_undegraded":"2024-08-27T03:58:30.253362+0000","last_fullsized":"2024-08-27T03:58:30.253362+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:32.345511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":718000,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":786,"num_read_kb":79613,"num_write":995,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'502","reported_seq":2126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.279816+0000","last_change":"2024-08-27T02:31:06.453414+0000","last_active":"2024-08-27T03:54:25.279816+0000","last_peered":"2024-08-27T03:54:25.279816+0000","last_clean":"2024-08-27T03:54:25.279816+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:54:25.279816+0000","last_undegraded":"2024-08-27T03:54:25.279816+0000","last_fullsized":"2024-08-27T03:54:25.279816+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:58:00.941444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'280","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.367297+0000","last_change":"2024-08-27T02:31:04.493288+0000","last_active":"2024-08-27T03:58:30.367297+0000","last_peered":"2024-08-27T03:58:30.367297+0000","last_clean":"2024-08-27T03:58:30.367297+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:30.367297+0000","last_undegraded":"2024-08-27T03:58:30.367297+0000","last_fullsized":"2024-08-27T03:58:30.367297+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:54:10.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911854,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":576,"num_read_kb":25476,"num_write":954,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'802","reported_seq":2696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.912104+0000","last_change":"2024-08-27T02:31:06.446787+0000","last_active":"2024-08-27T03:58:02.912104+0000","last_peered":"2024-08-27T03:58:02.912104+0000","last_clean":"2024-08-27T03:58:02.912104+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:02.912104+0000","last_undegraded":"2024-08-27T03:58:02.912104+0000","last_fullsized":"2024-08-27T03:58:02.912104+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:54.168779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'285","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.308721+0000","last_change":"2024-08-27T02:31:04.498684+0000","last_active":"2024-08-27T03:58:30.308721+0000","last_peered":"2024-08-27T03:58:30.308721+0000","last_clean":"2024-08-27T03:58:30.308721+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:30.308721+0000","last_undegraded":"2024-08-27T03:58:30.308721+0000","last_fullsized":"2024-08-27T03:58:30.308721+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:33:00.705755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11798001,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":493,"num_read_kb":75812,"num_write":963,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'417","reported_seq":1897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.869970+0000","last_change":"2024-08-27T02:31:06.460970+0000","last_active":"2024-08-27T03:54:24.869970+0000","last_peered":"2024-08-27T03:54:24.869970+0000","last_clean":"2024-08-27T03:54:24.869970+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:54:24.869970+0000","last_undegraded":"2024-08-27T03:54:24.869970+0000","last_fullsized":"2024-08-27T03:54:24.869970+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:33.950629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'371","reported_seq":1290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.061637+0000","last_change":"2024-08-27T02:31:04.477605+0000","last_active":"2024-08-27T03:58:30.061637+0000","last_peered":"2024-08-27T03:58:30.061637+0000","last_clean":"2024-08-27T03:58:30.061637+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:30.061637+0000","last_undegraded":"2024-08-27T03:58:30.061637+0000","last_fullsized":"2024-08-27T03:58:30.061637+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:54.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29877,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":954,"num_read_kb":143554,"num_write":1147,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'385","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.303474+0000","last_change":"2024-08-27T02:31:06.448211+0000","last_active":"2024-08-27T03:56:00.303474+0000","last_peered":"2024-08-27T03:56:00.303474+0000","last_clean":"2024-08-27T03:56:00.303474+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:56:00.303474+0000","last_undegraded":"2024-08-27T03:56:00.303474+0000","last_fullsized":"2024-08-27T03:56:00.303474+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:44.911262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'329","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.760740+0000","last_change":"2024-08-27T02:31:04.468993+0000","last_active":"2024-08-27T03:58:29.760740+0000","last_peered":"2024-08-27T03:58:29.760740+0000","last_clean":"2024-08-27T03:58:29.760740+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:29.760740+0000","last_undegraded":"2024-08-27T03:58:29.760740+0000","last_fullsized":"2024-08-27T03:58:29.760740+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:42.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2148831,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":566,"num_read_kb":11843,"num_write":1238,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'301","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.843384+0000","last_change":"2024-08-27T02:31:04.470311+0000","last_active":"2024-08-27T03:58:29.843384+0000","last_peered":"2024-08-27T03:58:29.843384+0000","last_clean":"2024-08-27T03:58:29.843384+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:29.843384+0000","last_undegraded":"2024-08-27T03:58:29.843384+0000","last_fullsized":"2024-08-27T03:58:29.843384+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:46.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54971,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":482,"num_read_kb":4946,"num_write":1023,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'381","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.298368+0000","last_change":"2024-08-27T02:31:39.753199+0000","last_active":"2024-08-27T03:56:00.298368+0000","last_peered":"2024-08-27T03:56:00.298368+0000","last_clean":"2024-08-27T03:56:00.298368+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:56:00.298368+0000","last_undegraded":"2024-08-27T03:56:00.298368+0000","last_fullsized":"2024-08-27T03:56:00.298368+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:20:26.815028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'324","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.051291+0000","last_change":"2024-08-27T02:31:04.468743+0000","last_active":"2024-08-27T03:58:31.051291+0000","last_peered":"2024-08-27T03:58:31.051291+0000","last_clean":"2024-08-27T03:58:31.051291+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:31.051291+0000","last_undegraded":"2024-08-27T03:58:31.051291+0000","last_fullsized":"2024-08-27T03:58:31.051291+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:32:18.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7430147,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":603,"num_read_kb":18082,"num_write":1112,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.999344+0000","last_change":"2024-08-27T02:31:06.441369+0000","last_active":"2024-08-27T03:58:02.999344+0000","last_peered":"2024-08-27T03:58:02.999344+0000","last_clean":"2024-08-27T03:58:02.999344+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:02.999344+0000","last_undegraded":"2024-08-27T03:58:02.999344+0000","last_fullsized":"2024-08-27T03:58:02.999344+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:46.354455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1592,"ondisk_log_size":1592,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1623887,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19235,"num_read_kb":37371,"num_write":16116,"num_write_kb":11765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1908736,"data_stored":1489439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1889,"ondisk_log_size":1889,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3951,"ondisk_log_size":3951,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":280168786,"num_objects":2687,"num_object_clones":0,"num_object_copies":10748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":0,"num_read":33251,"num_read_kb":1916386,"num_write":68056,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":433528832,"data_stored":433528832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4307,"ondisk_log_size":4307,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":15728640,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":208074,"num_write":158,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35188736,"data_stored":35187371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":42587765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":128,"num_read_kb":198799,"num_write":150,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79351808,"data_stored":79348287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510495,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223448,"kb_used_data":47932,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94148392,"statfs":{"total":96636764160,"available":96407953408,"internally_reserved":0,"allocated":49082368,"data_stored":47081822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543204,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387652,"kb_used_data":71660,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93984188,"statfs":{"total":96636764160,"available":96239808512,"internally_reserved":0,"allocated":73379840,"data_stored":71344196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323353034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543205,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381640,"kb_used_data":119956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93990200,"statfs":{"total":96636764160,"available":96245964800,"internally_reserved":0,"allocated":122834944,"data_stored":120855804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543202,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252180,"kb_used_data":112772,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94119660,"statfs":{"total":96636764160,"available":96378531840,"internally_reserved":0,"allocated":115478528,"data_stored":113383684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543201,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238456,"kb_used_data":130908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94133384,"statfs":{"total":96636764160,"available":96392585216,"internally_reserved":0,"allocated":134049792,"data_stored":132092224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543203,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394180,"kb_used_data":128372,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93977660,"statfs":{"total":96636764160,"available":96233123840,"internally_reserved":0,"allocated":131452928,"data_stored":129397494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543205,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211752,"kb_used_data":104160,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94160088,"statfs":{"total":96636764160,"available":96419930112,"internally_reserved":0,"allocated":106659840,"data_stored":104687967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543203,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":418184,"kb_used_data":126028,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93953656,"statfs":{"total":96636764160,"available":96208543744,"internally_reserved":0,"allocated":129052672,"data_stored":126992328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48959488,"data_stored":48959488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33320960,"data_stored":33320960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53968896,"data_stored":53968896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62959616,"data_stored":62959616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73605120,"data_stored":73605120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":70320128,"data_stored":70320128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":47345664,"data_stored":47345664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":43048960,"data_stored":43048960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":165537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":90823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":40312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":339243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":458355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":134672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":221561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5304320,"data_stored":5303242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4255744,"data_stored":4254666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T03:58:32.311 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T03:58:32.679 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:58:32.691 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T03:58:32.699 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2892,"stamp":"2024-08-27T03:58:31.279856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":340716903,"num_objects":3195,"num_object_clones":0,"num_object_copies":11764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3195,"num_whiteouts":0,"num_read":285234,"num_read_kb":2573635,"num_write":157223,"num_write_kb":2372713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13502,"ondisk_log_size":13502,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2507492,"kb_used_data":841788,"kb_used_omap":12,"kb_used_meta":1665203,"kb_avail":752467228,"statfs":{"total":773094113280,"available":770526441472,"internally_reserved":0,"allocated":861990912,"data_stored":845835519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1705168433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-332165186,"num_objects":-1734,"num_object_clones":0,"num_object_copies":-6884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1734,"num_whiteouts":0,"num_read":1976,"num_read_kb":1992,"num_write":1855,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008003"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875576+0000","last_change":"2024-08-27T03:10:45.291800+0000","last_active":"2024-08-27T03:55:44.875576+0000","last_peered":"2024-08-27T03:55:44.875576+0000","last_clean":"2024-08-27T03:55:44.875576+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:55:44.875576+0000","last_undegraded":"2024-08-27T03:55:44.875576+0000","last_fullsized":"2024-08-27T03:55:44.875576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:23:36.039939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.913854+0000","last_change":"2024-08-27T02:50:55.799193+0000","last_active":"2024-08-27T03:58:24.913854+0000","last_peered":"2024-08-27T03:58:24.913854+0000","last_clean":"2024-08-27T03:58:24.913854+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:58:24.913854+0000","last_undegraded":"2024-08-27T03:58:24.913854+0000","last_fullsized":"2024-08-27T03:58:24.913854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:21:44.106748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.896443+0000","last_change":"2024-08-27T02:50:51.735635+0000","last_active":"2024-08-27T03:55:54.896443+0000","last_peered":"2024-08-27T03:55:54.896443+0000","last_clean":"2024-08-27T03:55:54.896443+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:55:54.896443+0000","last_undegraded":"2024-08-27T03:55:54.896443+0000","last_fullsized":"2024-08-27T03:55:54.896443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:41.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.292121+0000","last_change":"2024-08-27T02:46:49.663999+0000","last_active":"2024-08-27T03:55:35.292121+0000","last_peered":"2024-08-27T03:55:35.292121+0000","last_clean":"2024-08-27T03:55:35.292121+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:55:35.292121+0000","last_undegraded":"2024-08-27T03:55:35.292121+0000","last_fullsized":"2024-08-27T03:55:35.292121+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:06:26.935384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073515+0000","last_change":"2024-08-27T03:10:45.296108+0000","last_active":"2024-08-27T03:55:45.073515+0000","last_peered":"2024-08-27T03:55:45.073515+0000","last_clean":"2024-08-27T03:55:45.073515+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:55:45.073515+0000","last_undegraded":"2024-08-27T03:55:45.073515+0000","last_fullsized":"2024-08-27T03:55:45.073515+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:12.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128164+0000","last_change":"2024-08-27T02:50:55.775244+0000","last_active":"2024-08-27T03:58:25.128164+0000","last_peered":"2024-08-27T03:58:25.128164+0000","last_clean":"2024-08-27T03:58:25.128164+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:58:25.128164+0000","last_undegraded":"2024-08-27T03:58:25.128164+0000","last_fullsized":"2024-08-27T03:58:25.128164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:30.406512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076691+0000","last_change":"2024-08-27T02:50:51.735266+0000","last_active":"2024-08-27T03:55:51.076691+0000","last_peered":"2024-08-27T03:55:51.076691+0000","last_clean":"2024-08-27T03:55:51.076691+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:55:51.076691+0000","last_undegraded":"2024-08-27T03:55:51.076691+0000","last_fullsized":"2024-08-27T03:55:51.076691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:50:41.400577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064603+0000","last_change":"2024-08-27T02:46:49.676761+0000","last_active":"2024-08-27T03:55:05.064603+0000","last_peered":"2024-08-27T03:55:05.064603+0000","last_clean":"2024-08-27T03:55:05.064603+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:55:05.064603+0000","last_undegraded":"2024-08-27T03:55:05.064603+0000","last_fullsized":"2024-08-27T03:55:05.064603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:59:06.352477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.436334+0000","last_change":"2024-08-27T03:10:45.294573+0000","last_active":"2024-08-27T03:54:15.436334+0000","last_peered":"2024-08-27T03:54:15.436334+0000","last_clean":"2024-08-27T03:54:15.436334+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:54:15.436334+0000","last_undegraded":"2024-08-27T03:54:15.436334+0000","last_fullsized":"2024-08-27T03:54:15.436334+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:54.922215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290928+0000","last_change":"2024-08-27T02:50:55.791602+0000","last_active":"2024-08-27T03:55:30.290928+0000","last_peered":"2024-08-27T03:55:30.290928+0000","last_clean":"2024-08-27T03:55:30.290928+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:55:30.290928+0000","last_undegraded":"2024-08-27T03:55:30.290928+0000","last_fullsized":"2024-08-27T03:55:30.290928+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:05.925142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'10","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.880591+0000","last_change":"2024-08-27T02:50:51.729715+0000","last_active":"2024-08-27T03:58:29.880591+0000","last_peered":"2024-08-27T03:58:29.880591+0000","last_clean":"2024-08-27T03:58:29.880591+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:58:29.880591+0000","last_undegraded":"2024-08-27T03:58:29.880591+0000","last_fullsized":"2024-08-27T03:58:29.880591+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:26.531591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60362,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":21563,"num_write":15,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494185+0000","last_change":"2024-08-27T02:46:49.653398+0000","last_active":"2024-08-27T03:54:20.494185+0000","last_peered":"2024-08-27T03:54:20.494185+0000","last_clean":"2024-08-27T03:54:20.494185+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:54:20.494185+0000","last_undegraded":"2024-08-27T03:54:20.494185+0000","last_fullsized":"2024-08-27T03:54:20.494185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:50.129103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871224+0000","last_change":"2024-08-27T03:10:45.281316+0000","last_active":"2024-08-27T03:54:29.871224+0000","last_peered":"2024-08-27T03:54:29.871224+0000","last_clean":"2024-08-27T03:54:29.871224+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:54:29.871224+0000","last_undegraded":"2024-08-27T03:54:29.871224+0000","last_fullsized":"2024-08-27T03:54:29.871224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:26.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.887006+0000","last_change":"2024-08-27T02:50:55.794295+0000","last_active":"2024-08-27T03:55:14.887006+0000","last_peered":"2024-08-27T03:55:14.887006+0000","last_clean":"2024-08-27T03:55:14.887006+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:55:14.887006+0000","last_undegraded":"2024-08-27T03:55:14.887006+0000","last_fullsized":"2024-08-27T03:55:14.887006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:10.976998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.087490+0000","last_change":"2024-08-27T02:50:51.720342+0000","last_active":"2024-08-27T03:55:30.087490+0000","last_peered":"2024-08-27T03:55:30.087490+0000","last_clean":"2024-08-27T03:55:30.087490+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:55:30.087490+0000","last_undegraded":"2024-08-27T03:55:30.087490+0000","last_fullsized":"2024-08-27T03:55:30.087490+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:16:13.056385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868989+0000","last_change":"2024-08-27T02:46:49.680620+0000","last_active":"2024-08-27T03:54:19.868989+0000","last_peered":"2024-08-27T03:54:19.868989+0000","last_clean":"2024-08-27T03:54:19.868989+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:54:19.868989+0000","last_undegraded":"2024-08-27T03:54:19.868989+0000","last_fullsized":"2024-08-27T03:54:19.868989+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:46:31.779704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:59.882198+0000","last_change":"2024-08-27T03:10:45.289727+0000","last_active":"2024-08-27T03:54:59.882198+0000","last_peered":"2024-08-27T03:54:59.882198+0000","last_clean":"2024-08-27T03:54:59.882198+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:54:59.882198+0000","last_undegraded":"2024-08-27T03:54:59.882198+0000","last_fullsized":"2024-08-27T03:54:59.882198+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:30:10.424523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:04.852380+0000","last_change":"2024-08-27T02:50:55.806362+0000","last_active":"2024-08-27T03:54:04.852380+0000","last_peered":"2024-08-27T03:54:04.852380+0000","last_clean":"2024-08-27T03:54:04.852380+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:54:04.852380+0000","last_undegraded":"2024-08-27T03:54:04.852380+0000","last_fullsized":"2024-08-27T03:54:04.852380+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:25.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.486004+0000","last_change":"2024-08-27T02:50:51.720059+0000","last_active":"2024-08-27T03:53:45.486004+0000","last_peered":"2024-08-27T03:53:45.486004+0000","last_clean":"2024-08-27T03:53:45.486004+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:53:45.486004+0000","last_undegraded":"2024-08-27T03:53:45.486004+0000","last_fullsized":"2024-08-27T03:53:45.486004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:07.906082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868908+0000","last_change":"2024-08-27T02:46:49.675252+0000","last_active":"2024-08-27T03:54:19.868908+0000","last_peered":"2024-08-27T03:54:19.868908+0000","last_clean":"2024-08-27T03:54:19.868908+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:54:19.868908+0000","last_undegraded":"2024-08-27T03:54:19.868908+0000","last_fullsized":"2024-08-27T03:54:19.868908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:11.184532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058881+0000","last_change":"2024-08-27T03:10:45.303346+0000","last_active":"2024-08-27T03:54:31.058881+0000","last_peered":"2024-08-27T03:54:31.058881+0000","last_clean":"2024-08-27T03:54:31.058881+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:54:31.058881+0000","last_undegraded":"2024-08-27T03:54:31.058881+0000","last_fullsized":"2024-08-27T03:54:31.058881+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:17:17.630708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.429653+0000","last_change":"2024-08-27T02:50:55.789996+0000","last_active":"2024-08-27T03:53:45.429653+0000","last_peered":"2024-08-27T03:53:45.429653+0000","last_clean":"2024-08-27T03:53:45.429653+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:53:45.429653+0000","last_undegraded":"2024-08-27T03:53:45.429653+0000","last_fullsized":"2024-08-27T03:53:45.429653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:53.367346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:25.100608+0000","last_change":"2024-08-27T02:50:51.707799+0000","last_active":"2024-08-27T03:56:25.100608+0000","last_peered":"2024-08-27T03:56:25.100608+0000","last_clean":"2024-08-27T03:56:25.100608+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:56:25.100608+0000","last_undegraded":"2024-08-27T03:56:25.100608+0000","last_fullsized":"2024-08-27T03:56:25.100608+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:38.856713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437440+0000","last_change":"2024-08-27T02:46:49.657662+0000","last_active":"2024-08-27T03:54:20.437440+0000","last_peered":"2024-08-27T03:54:20.437440+0000","last_clean":"2024-08-27T03:54:20.437440+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:54:20.437440+0000","last_undegraded":"2024-08-27T03:54:20.437440+0000","last_fullsized":"2024-08-27T03:54:20.437440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:37:52.995296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299701+0000","last_change":"2024-08-27T03:10:45.293045+0000","last_active":"2024-08-27T03:55:45.299701+0000","last_peered":"2024-08-27T03:55:45.299701+0000","last_clean":"2024-08-27T03:55:45.299701+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:55:45.299701+0000","last_undegraded":"2024-08-27T03:55:45.299701+0000","last_fullsized":"2024-08-27T03:55:45.299701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:53:47.782276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.490696+0000","last_change":"2024-08-27T02:50:55.766901+0000","last_active":"2024-08-27T03:58:25.490696+0000","last_peered":"2024-08-27T03:58:25.490696+0000","last_clean":"2024-08-27T03:58:25.490696+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:58:25.490696+0000","last_undegraded":"2024-08-27T03:58:25.490696+0000","last_fullsized":"2024-08-27T03:58:25.490696+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:30:21.583051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":18432,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093324+0000","last_change":"2024-08-27T02:50:51.738475+0000","last_active":"2024-08-27T03:55:55.093324+0000","last_peered":"2024-08-27T03:55:55.093324+0000","last_clean":"2024-08-27T03:55:55.093324+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:55:55.093324+0000","last_undegraded":"2024-08-27T03:55:55.093324+0000","last_fullsized":"2024-08-27T03:55:55.093324+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:26:56.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.497953+0000","last_change":"2024-08-27T02:46:49.647868+0000","last_active":"2024-08-27T03:54:40.497953+0000","last_peered":"2024-08-27T03:54:40.497953+0000","last_clean":"2024-08-27T03:54:40.497953+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:54:40.497953+0000","last_undegraded":"2024-08-27T03:54:40.497953+0000","last_fullsized":"2024-08-27T03:54:40.497953+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:28:45.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299830+0000","last_change":"2024-08-27T03:10:45.284842+0000","last_active":"2024-08-27T03:55:45.299830+0000","last_peered":"2024-08-27T03:55:45.299830+0000","last_clean":"2024-08-27T03:55:45.299830+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:55:45.299830+0000","last_undegraded":"2024-08-27T03:55:45.299830+0000","last_fullsized":"2024-08-27T03:55:45.299830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:45:04.454859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930510+0000","last_change":"2024-08-27T02:50:55.778273+0000","last_active":"2024-08-27T03:58:24.930510+0000","last_peered":"2024-08-27T03:58:24.930510+0000","last_clean":"2024-08-27T03:58:24.930510+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:58:24.930510+0000","last_undegraded":"2024-08-27T03:58:24.930510+0000","last_fullsized":"2024-08-27T03:58:24.930510+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:39.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.296625+0000","last_change":"2024-08-27T02:50:51.714543+0000","last_active":"2024-08-27T03:55:55.296625+0000","last_peered":"2024-08-27T03:55:55.296625+0000","last_clean":"2024-08-27T03:55:55.296625+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:55:55.296625+0000","last_undegraded":"2024-08-27T03:55:55.296625+0000","last_fullsized":"2024-08-27T03:55:55.296625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:34.299020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058666+0000","last_change":"2024-08-27T02:46:49.667902+0000","last_active":"2024-08-27T03:54:31.058666+0000","last_peered":"2024-08-27T03:54:31.058666+0000","last_clean":"2024-08-27T03:54:31.058666+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:54:31.058666+0000","last_undegraded":"2024-08-27T03:54:31.058666+0000","last_fullsized":"2024-08-27T03:54:31.058666+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:38.299301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065781+0000","last_change":"2024-08-27T03:10:45.298717+0000","last_active":"2024-08-27T03:55:06.065781+0000","last_peered":"2024-08-27T03:55:06.065781+0000","last_clean":"2024-08-27T03:55:06.065781+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:55:06.065781+0000","last_undegraded":"2024-08-27T03:55:06.065781+0000","last_fullsized":"2024-08-27T03:55:06.065781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:23:22.104053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.114116+0000","last_change":"2024-08-27T02:50:55.800701+0000","last_active":"2024-08-27T03:58:29.114116+0000","last_peered":"2024-08-27T03:58:29.114116+0000","last_clean":"2024-08-27T03:58:29.114116+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:58:29.114116+0000","last_undegraded":"2024-08-27T03:58:29.114116+0000","last_fullsized":"2024-08-27T03:58:29.114116+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:22.225737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'1","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.854797+0000","last_change":"2024-08-27T02:50:51.725068+0000","last_active":"2024-08-27T03:54:14.854797+0000","last_peered":"2024-08-27T03:54:14.854797+0000","last_clean":"2024-08-27T03:54:14.854797+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:54:14.854797+0000","last_undegraded":"2024-08-27T03:54:14.854797+0000","last_fullsized":"2024-08-27T03:54:14.854797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:06:25.729104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495980+0000","last_change":"2024-08-27T02:46:49.654801+0000","last_active":"2024-08-27T03:54:30.495980+0000","last_peered":"2024-08-27T03:54:30.495980+0000","last_clean":"2024-08-27T03:54:30.495980+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:54:30.495980+0000","last_undegraded":"2024-08-27T03:54:30.495980+0000","last_fullsized":"2024-08-27T03:54:30.495980+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:08.448754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064497+0000","last_change":"2024-08-27T03:10:45.296344+0000","last_active":"2024-08-27T03:55:05.064497+0000","last_peered":"2024-08-27T03:55:05.064497+0000","last_clean":"2024-08-27T03:55:05.064497+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:55:05.064497+0000","last_undegraded":"2024-08-27T03:55:05.064497+0000","last_fullsized":"2024-08-27T03:55:05.064497+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:28.938702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.499627+0000","last_change":"2024-08-27T02:51:41.064218+0000","last_active":"2024-08-27T03:54:50.499627+0000","last_peered":"2024-08-27T03:54:50.499627+0000","last_clean":"2024-08-27T03:54:50.499627+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:54:50.499627+0000","last_undegraded":"2024-08-27T03:54:50.499627+0000","last_fullsized":"2024-08-27T03:54:50.499627+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:59:05.157815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.270244+0000","last_change":"2024-08-27T02:50:51.728712+0000","last_active":"2024-08-27T03:53:45.270244+0000","last_peered":"2024-08-27T03:53:45.270244+0000","last_clean":"2024-08-27T03:53:45.270244+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:53:45.270244+0000","last_undegraded":"2024-08-27T03:53:45.270244+0000","last_fullsized":"2024-08-27T03:53:45.270244+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:43:32.708072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":308,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871387+0000","last_change":"2024-08-27T02:46:49.674700+0000","last_active":"2024-08-27T03:54:29.871387+0000","last_peered":"2024-08-27T03:54:29.871387+0000","last_clean":"2024-08-27T03:54:29.871387+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:54:29.871387+0000","last_undegraded":"2024-08-27T03:54:29.871387+0000","last_fullsized":"2024-08-27T03:54:29.871387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:39:28.639475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.289661+0000","last_change":"2024-08-27T03:10:45.293007+0000","last_active":"2024-08-27T03:55:05.289661+0000","last_peered":"2024-08-27T03:55:05.289661+0000","last_clean":"2024-08-27T03:55:05.289661+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:55:05.289661+0000","last_undegraded":"2024-08-27T03:55:05.289661+0000","last_fullsized":"2024-08-27T03:55:05.289661+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:23:00.597660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.860865+0000","last_change":"2024-08-27T02:50:55.799828+0000","last_active":"2024-08-27T03:53:44.860865+0000","last_peered":"2024-08-27T03:53:44.860865+0000","last_clean":"2024-08-27T03:53:44.860865+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:53:44.860865+0000","last_undegraded":"2024-08-27T03:53:44.860865+0000","last_fullsized":"2024-08-27T03:53:44.860865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:54.431380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.048186+0000","last_change":"2024-08-27T02:50:51.720595+0000","last_active":"2024-08-27T03:53:45.048186+0000","last_peered":"2024-08-27T03:53:45.048186+0000","last_clean":"2024-08-27T03:53:45.048186+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:53:45.048186+0000","last_undegraded":"2024-08-27T03:53:45.048186+0000","last_fullsized":"2024-08-27T03:53:45.048186+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:42:21.827378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057603+0000","last_change":"2024-08-27T02:46:49.678450+0000","last_active":"2024-08-27T03:54:30.057603+0000","last_peered":"2024-08-27T03:54:30.057603+0000","last_clean":"2024-08-27T03:54:30.057603+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:54:30.057603+0000","last_undegraded":"2024-08-27T03:54:30.057603+0000","last_fullsized":"2024-08-27T03:54:30.057603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:37.128746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:04.866169+0000","last_change":"2024-08-27T03:10:45.298256+0000","last_active":"2024-08-27T03:55:04.866169+0000","last_peered":"2024-08-27T03:55:04.866169+0000","last_clean":"2024-08-27T03:55:04.866169+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:55:04.866169+0000","last_undegraded":"2024-08-27T03:55:04.866169+0000","last_fullsized":"2024-08-27T03:55:04.866169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:20:23.614816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.096796+0000","last_change":"2024-08-27T02:50:55.769990+0000","last_active":"2024-08-27T03:56:10.096796+0000","last_peered":"2024-08-27T03:56:10.096796+0000","last_clean":"2024-08-27T03:56:10.096796+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:56:10.096796+0000","last_undegraded":"2024-08-27T03:56:10.096796+0000","last_fullsized":"2024-08-27T03:56:10.096796+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:30.128153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300910+0000","last_change":"2024-08-27T02:50:51.699776+0000","last_active":"2024-08-27T03:56:10.300910+0000","last_peered":"2024-08-27T03:56:10.300910+0000","last_clean":"2024-08-27T03:56:10.300910+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:56:10.300910+0000","last_undegraded":"2024-08-27T03:56:10.300910+0000","last_fullsized":"2024-08-27T03:56:10.300910+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:07:34.952020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.286162+0000","last_change":"2024-08-27T02:46:49.665181+0000","last_active":"2024-08-27T03:54:50.286162+0000","last_peered":"2024-08-27T03:54:50.286162+0000","last_clean":"2024-08-27T03:54:50.286162+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:54:50.286162+0000","last_undegraded":"2024-08-27T03:54:50.286162+0000","last_fullsized":"2024-08-27T03:54:50.286162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:42.937470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867848+0000","last_change":"2024-08-27T03:10:45.289487+0000","last_active":"2024-08-27T03:54:14.867848+0000","last_peered":"2024-08-27T03:54:14.867848+0000","last_clean":"2024-08-27T03:54:14.867848+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:54:14.867848+0000","last_undegraded":"2024-08-27T03:54:14.867848+0000","last_fullsized":"2024-08-27T03:54:14.867848+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:39.767865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082072+0000","last_change":"2024-08-27T02:50:55.787899+0000","last_active":"2024-08-27T03:56:16.082072+0000","last_peered":"2024-08-27T03:56:16.082072+0000","last_clean":"2024-08-27T03:56:16.082072+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:56:16.082072+0000","last_undegraded":"2024-08-27T03:56:16.082072+0000","last_fullsized":"2024-08-27T03:56:16.082072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:02.349021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:55.064852+0000","last_change":"2024-08-27T02:50:51.710484+0000","last_active":"2024-08-27T03:53:55.064852+0000","last_peered":"2024-08-27T03:53:55.064852+0000","last_clean":"2024-08-27T03:53:55.064852+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:53:55.064852+0000","last_undegraded":"2024-08-27T03:53:55.064852+0000","last_fullsized":"2024-08-27T03:53:55.064852+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:35:36.294957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281022+0000","last_change":"2024-08-27T02:46:49.668229+0000","last_active":"2024-08-27T03:54:30.281022+0000","last_peered":"2024-08-27T03:54:30.281022+0000","last_clean":"2024-08-27T03:54:30.281022+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:54:30.281022+0000","last_undegraded":"2024-08-27T03:54:30.281022+0000","last_fullsized":"2024-08-27T03:54:30.281022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:15.719694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.493101+0000","last_change":"2024-08-27T03:10:45.282295+0000","last_active":"2024-08-27T03:54:15.493101+0000","last_peered":"2024-08-27T03:54:15.493101+0000","last_clean":"2024-08-27T03:54:15.493101+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:54:15.493101+0000","last_undegraded":"2024-08-27T03:54:15.493101+0000","last_fullsized":"2024-08-27T03:54:15.493101+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:10:06.995285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082002+0000","last_change":"2024-08-27T02:50:55.769855+0000","last_active":"2024-08-27T03:56:16.082002+0000","last_peered":"2024-08-27T03:56:16.082002+0000","last_clean":"2024-08-27T03:56:16.082002+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:56:16.082002+0000","last_undegraded":"2024-08-27T03:56:16.082002+0000","last_fullsized":"2024-08-27T03:56:16.082002+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:05.548730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.862920+0000","last_change":"2024-08-27T02:50:51.730019+0000","last_active":"2024-08-27T03:53:54.862920+0000","last_peered":"2024-08-27T03:53:54.862920+0000","last_clean":"2024-08-27T03:53:54.862920+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:53:54.862920+0000","last_undegraded":"2024-08-27T03:53:54.862920+0000","last_fullsized":"2024-08-27T03:53:54.862920+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:46.716300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495770+0000","last_change":"2024-08-27T02:46:49.666192+0000","last_active":"2024-08-27T03:54:30.495770+0000","last_peered":"2024-08-27T03:54:30.495770+0000","last_clean":"2024-08-27T03:54:30.495770+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:54:30.495770+0000","last_undegraded":"2024-08-27T03:54:30.495770+0000","last_fullsized":"2024-08-27T03:54:30.495770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:05.105406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287223+0000","last_change":"2024-08-27T03:10:45.283329+0000","last_active":"2024-08-27T03:55:15.287223+0000","last_peered":"2024-08-27T03:55:15.287223+0000","last_clean":"2024-08-27T03:55:15.287223+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:55:15.287223+0000","last_undegraded":"2024-08-27T03:55:15.287223+0000","last_fullsized":"2024-08-27T03:55:15.287223+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:08.644016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.863049+0000","last_change":"2024-08-27T02:50:55.783336+0000","last_active":"2024-08-27T03:53:54.863049+0000","last_peered":"2024-08-27T03:53:54.863049+0000","last_clean":"2024-08-27T03:53:54.863049+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:53:54.863049+0000","last_undegraded":"2024-08-27T03:53:54.863049+0000","last_fullsized":"2024-08-27T03:53:54.863049+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:19.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:55.431875+0000","last_change":"2024-08-27T02:50:51.738540+0000","last_active":"2024-08-27T03:53:55.431875+0000","last_peered":"2024-08-27T03:53:55.431875+0000","last_clean":"2024-08-27T03:53:55.431875+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:53:55.431875+0000","last_undegraded":"2024-08-27T03:53:55.431875+0000","last_fullsized":"2024-08-27T03:53:55.431875+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:28.212686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072847+0000","last_change":"2024-08-27T02:46:49.654783+0000","last_active":"2024-08-27T03:54:30.072847+0000","last_peered":"2024-08-27T03:54:30.072847+0000","last_clean":"2024-08-27T03:54:30.072847+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:54:30.072847+0000","last_undegraded":"2024-08-27T03:54:30.072847+0000","last_fullsized":"2024-08-27T03:54:30.072847+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:07.533650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867790+0000","last_change":"2024-08-27T03:10:45.266598+0000","last_active":"2024-08-27T03:54:14.867790+0000","last_peered":"2024-08-27T03:54:14.867790+0000","last_clean":"2024-08-27T03:54:14.867790+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:54:14.867790+0000","last_undegraded":"2024-08-27T03:54:14.867790+0000","last_fullsized":"2024-08-27T03:54:14.867790+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:16.790039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462591+0000","last_change":"2024-08-27T02:50:55.778741+0000","last_active":"2024-08-27T03:56:15.462591+0000","last_peered":"2024-08-27T03:56:15.462591+0000","last_clean":"2024-08-27T03:56:15.462591+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:56:15.462591+0000","last_undegraded":"2024-08-27T03:56:15.462591+0000","last_fullsized":"2024-08-27T03:56:15.462591+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:56:17.118596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.850206+0000","last_change":"2024-08-27T02:50:51.722290+0000","last_active":"2024-08-27T03:53:54.850206+0000","last_peered":"2024-08-27T03:53:54.850206+0000","last_clean":"2024-08-27T03:53:54.850206+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:53:54.850206+0000","last_undegraded":"2024-08-27T03:53:54.850206+0000","last_fullsized":"2024-08-27T03:53:54.850206+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:01.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871100+0000","last_change":"2024-08-27T02:46:49.673825+0000","last_active":"2024-08-27T03:54:29.871100+0000","last_peered":"2024-08-27T03:54:29.871100+0000","last_clean":"2024-08-27T03:54:29.871100+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:54:29.871100+0000","last_undegraded":"2024-08-27T03:54:29.871100+0000","last_fullsized":"2024-08-27T03:54:29.871100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:03.488183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.054649+0000","last_change":"2024-08-27T03:10:45.296440+0000","last_active":"2024-08-27T03:54:15.054649+0000","last_peered":"2024-08-27T03:54:15.054649+0000","last_clean":"2024-08-27T03:54:15.054649+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:54:15.054649+0000","last_undegraded":"2024-08-27T03:54:15.054649+0000","last_fullsized":"2024-08-27T03:54:15.054649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:09.800699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'1","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900422+0000","last_change":"2024-08-27T02:50:55.782955+0000","last_active":"2024-08-27T03:56:09.900422+0000","last_peered":"2024-08-27T03:56:09.900422+0000","last_clean":"2024-08-27T03:56:09.900422+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:56:09.900422+0000","last_undegraded":"2024-08-27T03:56:09.900422+0000","last_fullsized":"2024-08-27T03:56:09.900422+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:13.729427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306233+0000","last_change":"2024-08-27T02:50:51.737202+0000","last_active":"2024-08-27T03:56:10.306233+0000","last_peered":"2024-08-27T03:56:10.306233+0000","last_clean":"2024-08-27T03:56:10.306233+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:56:10.306233+0000","last_undegraded":"2024-08-27T03:56:10.306233+0000","last_fullsized":"2024-08-27T03:56:10.306233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:36.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'155","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:39.874246+0000","last_change":"2024-08-27T02:46:49.680563+0000","last_active":"2024-08-27T03:54:39.874246+0000","last_peered":"2024-08-27T03:54:39.874246+0000","last_clean":"2024-08-27T03:54:39.874246+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:54:39.874246+0000","last_undegraded":"2024-08-27T03:54:39.874246+0000","last_fullsized":"2024-08-27T03:54:39.874246+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:31.769992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299565+0000","last_change":"2024-08-27T03:10:45.284394+0000","last_active":"2024-08-27T03:55:45.299565+0000","last_peered":"2024-08-27T03:55:45.299565+0000","last_clean":"2024-08-27T03:55:45.299565+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:55:45.299565+0000","last_undegraded":"2024-08-27T03:55:45.299565+0000","last_fullsized":"2024-08-27T03:55:45.299565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:56.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930627+0000","last_change":"2024-08-27T02:50:55.783274+0000","last_active":"2024-08-27T03:58:24.930627+0000","last_peered":"2024-08-27T03:58:24.930627+0000","last_clean":"2024-08-27T03:58:24.930627+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:58:24.930627+0000","last_undegraded":"2024-08-27T03:58:24.930627+0000","last_fullsized":"2024-08-27T03:58:24.930627+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:45:25.580491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079012+0000","last_change":"2024-08-27T02:50:51.720906+0000","last_active":"2024-08-27T03:56:10.079012+0000","last_peered":"2024-08-27T03:56:10.079012+0000","last_clean":"2024-08-27T03:56:10.079012+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:56:10.079012+0000","last_undegraded":"2024-08-27T03:56:10.079012+0000","last_fullsized":"2024-08-27T03:56:10.079012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:53.550807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.856027+0000","last_change":"2024-08-27T02:46:49.663826+0000","last_active":"2024-08-27T03:54:19.856027+0000","last_peered":"2024-08-27T03:54:19.856027+0000","last_clean":"2024-08-27T03:54:19.856027+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:54:19.856027+0000","last_undegraded":"2024-08-27T03:54:19.856027+0000","last_fullsized":"2024-08-27T03:54:19.856027+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:54.422893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462512+0000","last_change":"2024-08-27T03:10:45.287877+0000","last_active":"2024-08-27T03:56:15.462512+0000","last_peered":"2024-08-27T03:56:15.462512+0000","last_clean":"2024-08-27T03:56:15.462512+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:56:15.462512+0000","last_undegraded":"2024-08-27T03:56:15.462512+0000","last_fullsized":"2024-08-27T03:56:15.462512+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:39:37.167338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:06.053303+0000","last_change":"2024-08-27T02:50:55.796569+0000","last_active":"2024-08-27T03:54:06.053303+0000","last_peered":"2024-08-27T03:54:06.053303+0000","last_clean":"2024-08-27T03:54:06.053303+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:54:06.053303+0000","last_undegraded":"2024-08-27T03:54:06.053303+0000","last_fullsized":"2024-08-27T03:54:06.053303+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:41.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300859+0000","last_change":"2024-08-27T02:50:51.714350+0000","last_active":"2024-08-27T03:56:10.300859+0000","last_peered":"2024-08-27T03:56:10.300859+0000","last_clean":"2024-08-27T03:56:10.300859+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:56:10.300859+0000","last_undegraded":"2024-08-27T03:56:10.300859+0000","last_fullsized":"2024-08-27T03:56:10.300859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:27:51.967867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'95","reported_seq":424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437556+0000","last_change":"2024-08-27T02:46:49.668269+0000","last_active":"2024-08-27T03:54:20.437556+0000","last_peered":"2024-08-27T03:54:20.437556+0000","last_clean":"2024-08-27T03:54:20.437556+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:54:20.437556+0000","last_undegraded":"2024-08-27T03:54:20.437556+0000","last_fullsized":"2024-08-27T03:54:20.437556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:35:55.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307291+0000","last_change":"2024-08-27T03:10:45.299758+0000","last_active":"2024-08-27T03:56:15.307291+0000","last_peered":"2024-08-27T03:56:15.307291+0000","last_clean":"2024-08-27T03:56:15.307291+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:56:15.307291+0000","last_undegraded":"2024-08-27T03:56:15.307291+0000","last_fullsized":"2024-08-27T03:56:15.307291+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.273910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930815+0000","last_change":"2024-08-27T02:50:55.792739+0000","last_active":"2024-08-27T03:58:24.930815+0000","last_peered":"2024-08-27T03:58:24.930815+0000","last_clean":"2024-08-27T03:58:24.930815+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:58:24.930815+0000","last_undegraded":"2024-08-27T03:58:24.930815+0000","last_fullsized":"2024-08-27T03:58:24.930815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:53.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082281+0000","last_change":"2024-08-27T02:50:51.725905+0000","last_active":"2024-08-27T03:56:16.082281+0000","last_peered":"2024-08-27T03:56:16.082281+0000","last_clean":"2024-08-27T03:56:16.082281+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:56:16.082281+0000","last_undegraded":"2024-08-27T03:56:16.082281+0000","last_fullsized":"2024-08-27T03:56:16.082281+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:12.890510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.055617+0000","last_change":"2024-08-27T02:46:49.680856+0000","last_active":"2024-08-27T03:54:20.055617+0000","last_peered":"2024-08-27T03:54:20.055617+0000","last_clean":"2024-08-27T03:54:20.055617+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:54:20.055617+0000","last_undegraded":"2024-08-27T03:54:20.055617+0000","last_fullsized":"2024-08-27T03:54:20.055617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:18:48.246298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.894119+0000","last_change":"2024-08-27T03:10:45.290159+0000","last_active":"2024-08-27T03:55:44.894119+0000","last_peered":"2024-08-27T03:55:44.894119+0000","last_clean":"2024-08-27T03:55:44.894119+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:55:44.894119+0000","last_undegraded":"2024-08-27T03:55:44.894119+0000","last_fullsized":"2024-08-27T03:55:44.894119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:46:58.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093241+0000","last_change":"2024-08-27T02:50:55.801909+0000","last_active":"2024-08-27T03:55:55.093241+0000","last_peered":"2024-08-27T03:55:55.093241+0000","last_clean":"2024-08-27T03:55:55.093241+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:55:55.093241+0000","last_undegraded":"2024-08-27T03:55:55.093241+0000","last_fullsized":"2024-08-27T03:55:55.093241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:21:22.557931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.326037+0000","last_change":"2024-08-27T02:50:51.714694+0000","last_active":"2024-08-27T03:58:05.326037+0000","last_peered":"2024-08-27T03:58:05.326037+0000","last_clean":"2024-08-27T03:58:05.326037+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:58:05.326037+0000","last_undegraded":"2024-08-27T03:58:05.326037+0000","last_fullsized":"2024-08-27T03:58:05.326037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:09.799135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494067+0000","last_change":"2024-08-27T02:46:49.660909+0000","last_active":"2024-08-27T03:54:20.494067+0000","last_peered":"2024-08-27T03:54:20.494067+0000","last_clean":"2024-08-27T03:54:20.494067+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:54:20.494067+0000","last_undegraded":"2024-08-27T03:54:20.494067+0000","last_fullsized":"2024-08-27T03:54:20.494067+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:08:11.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302508+0000","last_change":"2024-08-27T03:10:45.301566+0000","last_active":"2024-08-27T03:55:55.302508+0000","last_peered":"2024-08-27T03:55:55.302508+0000","last_clean":"2024-08-27T03:55:55.302508+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:55:55.302508+0000","last_undegraded":"2024-08-27T03:55:55.302508+0000","last_fullsized":"2024-08-27T03:55:55.302508+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:57:00.105752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302217+0000","last_change":"2024-08-27T02:50:55.793032+0000","last_active":"2024-08-27T03:55:55.302217+0000","last_peered":"2024-08-27T03:55:55.302217+0000","last_clean":"2024-08-27T03:55:55.302217+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:55:55.302217+0000","last_undegraded":"2024-08-27T03:55:55.302217+0000","last_fullsized":"2024-08-27T03:55:55.302217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:41:51.131027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076538+0000","last_change":"2024-08-27T02:50:51.736002+0000","last_active":"2024-08-27T03:55:51.076538+0000","last_peered":"2024-08-27T03:55:51.076538+0000","last_clean":"2024-08-27T03:55:51.076538+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:55:51.076538+0000","last_undegraded":"2024-08-27T03:55:51.076538+0000","last_fullsized":"2024-08-27T03:55:51.076538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:07.337806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.278542+0000","last_change":"2024-08-27T02:46:49.656326+0000","last_active":"2024-08-27T03:54:20.278542+0000","last_peered":"2024-08-27T03:54:20.278542+0000","last_clean":"2024-08-27T03:54:20.278542+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:54:20.278542+0000","last_undegraded":"2024-08-27T03:54:20.278542+0000","last_fullsized":"2024-08-27T03:54:20.278542+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:12:37.739208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299649+0000","last_change":"2024-08-27T03:10:45.282178+0000","last_active":"2024-08-27T03:55:45.299649+0000","last_peered":"2024-08-27T03:55:45.299649+0000","last_clean":"2024-08-27T03:55:45.299649+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:55:45.299649+0000","last_undegraded":"2024-08-27T03:55:45.299649+0000","last_fullsized":"2024-08-27T03:55:45.299649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:24:50.331973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:26.109697+0000","last_change":"2024-08-27T02:50:55.769877+0000","last_active":"2024-08-27T03:58:26.109697+0000","last_peered":"2024-08-27T03:58:26.109697+0000","last_clean":"2024-08-27T03:58:26.109697+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:58:26.109697+0000","last_undegraded":"2024-08-27T03:58:26.109697+0000","last_fullsized":"2024-08-27T03:58:26.109697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:43:34.441494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'11","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.743519+0000","last_change":"2024-08-27T02:50:51.706023+0000","last_active":"2024-08-27T03:58:29.743519+0000","last_peered":"2024-08-27T03:58:29.743519+0000","last_clean":"2024-08-27T03:58:29.743519+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:58:29.743519+0000","last_undegraded":"2024-08-27T03:58:29.743519+0000","last_fullsized":"2024-08-27T03:58:29.743519+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:01:06.191127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900237+0000","last_change":"2024-08-27T02:46:49.681215+0000","last_active":"2024-08-27T03:56:09.900237+0000","last_peered":"2024-08-27T03:56:09.900237+0000","last_clean":"2024-08-27T03:56:09.900237+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:56:09.900237+0000","last_undegraded":"2024-08-27T03:56:09.900237+0000","last_fullsized":"2024-08-27T03:56:09.900237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:59.655983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294482+0000","last_change":"2024-08-27T03:10:45.266749+0000","last_active":"2024-08-27T03:55:45.294482+0000","last_peered":"2024-08-27T03:55:45.294482+0000","last_clean":"2024-08-27T03:55:45.294482+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:55:45.294482+0000","last_undegraded":"2024-08-27T03:55:45.294482+0000","last_fullsized":"2024-08-27T03:55:45.294482+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:25:14.767363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307348+0000","last_change":"2024-08-27T02:50:55.806234+0000","last_active":"2024-08-27T03:56:15.307348+0000","last_peered":"2024-08-27T03:56:15.307348+0000","last_clean":"2024-08-27T03:56:15.307348+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:56:15.307348+0000","last_undegraded":"2024-08-27T03:56:15.307348+0000","last_fullsized":"2024-08-27T03:56:15.307348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:26.269206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128113+0000","last_change":"2024-08-27T02:50:51.727708+0000","last_active":"2024-08-27T03:58:25.128113+0000","last_peered":"2024-08-27T03:58:25.128113+0000","last_clean":"2024-08-27T03:58:25.128113+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:58:25.128113+0000","last_undegraded":"2024-08-27T03:58:25.128113+0000","last_fullsized":"2024-08-27T03:58:25.128113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:26:00.265762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461291+0000","last_change":"2024-08-27T02:46:49.658797+0000","last_active":"2024-08-27T03:56:10.461291+0000","last_peered":"2024-08-27T03:56:10.461291+0000","last_clean":"2024-08-27T03:56:10.461291+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:56:10.461291+0000","last_undegraded":"2024-08-27T03:56:10.461291+0000","last_fullsized":"2024-08-27T03:56:10.461291+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:21.705436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.280973+0000","last_change":"2024-08-27T03:10:45.299158+0000","last_active":"2024-08-27T03:54:30.280973+0000","last_peered":"2024-08-27T03:54:30.280973+0000","last_clean":"2024-08-27T03:54:30.280973+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:54:30.280973+0000","last_undegraded":"2024-08-27T03:54:30.280973+0000","last_fullsized":"2024-08-27T03:54:30.280973+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:52:58.039454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294519+0000","last_change":"2024-08-27T02:50:55.778021+0000","last_active":"2024-08-27T03:55:45.294519+0000","last_peered":"2024-08-27T03:55:45.294519+0000","last_clean":"2024-08-27T03:55:45.294519+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:55:45.294519+0000","last_undegraded":"2024-08-27T03:55:45.294519+0000","last_fullsized":"2024-08-27T03:55:45.294519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:18:53.906397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.295971+0000","last_change":"2024-08-27T02:50:51.715619+0000","last_active":"2024-08-27T03:55:30.295971+0000","last_peered":"2024-08-27T03:55:30.295971+0000","last_clean":"2024-08-27T03:55:30.295971+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:55:30.295971+0000","last_undegraded":"2024-08-27T03:55:30.295971+0000","last_fullsized":"2024-08-27T03:55:30.295971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:22:37.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300942+0000","last_change":"2024-08-27T02:46:49.677851+0000","last_active":"2024-08-27T03:56:10.300942+0000","last_peered":"2024-08-27T03:56:10.300942+0000","last_clean":"2024-08-27T03:56:10.300942+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:56:10.300942+0000","last_undegraded":"2024-08-27T03:56:10.300942+0000","last_fullsized":"2024-08-27T03:56:10.300942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:32.601632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858095+0000","last_change":"2024-08-27T03:10:45.277501+0000","last_active":"2024-08-27T03:54:29.858095+0000","last_peered":"2024-08-27T03:54:29.858095+0000","last_clean":"2024-08-27T03:54:29.858095+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:54:29.858095+0000","last_undegraded":"2024-08-27T03:54:29.858095+0000","last_fullsized":"2024-08-27T03:54:29.858095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:52:19.885914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290804+0000","last_change":"2024-08-27T02:50:55.775204+0000","last_active":"2024-08-27T03:55:30.290804+0000","last_peered":"2024-08-27T03:55:30.290804+0000","last_clean":"2024-08-27T03:55:30.290804+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:55:30.290804+0000","last_undegraded":"2024-08-27T03:55:30.290804+0000","last_fullsized":"2024-08-27T03:55:30.290804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:27:44.097101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:50.097883+0000","last_change":"2024-08-27T02:50:51.712535+0000","last_active":"2024-08-27T03:57:50.097883+0000","last_peered":"2024-08-27T03:57:50.097883+0000","last_clean":"2024-08-27T03:57:50.097883+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:57:50.097883+0000","last_undegraded":"2024-08-27T03:57:50.097883+0000","last_fullsized":"2024-08-27T03:57:50.097883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:06.145410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461503+0000","last_change":"2024-08-27T02:46:49.657230+0000","last_active":"2024-08-27T03:56:10.461503+0000","last_peered":"2024-08-27T03:56:10.461503+0000","last_clean":"2024-08-27T03:56:10.461503+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:56:10.461503+0000","last_undegraded":"2024-08-27T03:56:10.461503+0000","last_fullsized":"2024-08-27T03:56:10.461503+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:31.912789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:51.062718+0000","last_change":"2024-08-27T03:10:45.304634+0000","last_active":"2024-08-27T03:54:51.062718+0000","last_peered":"2024-08-27T03:54:51.062718+0000","last_clean":"2024-08-27T03:54:51.062718+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:54:51.062718+0000","last_undegraded":"2024-08-27T03:54:51.062718+0000","last_fullsized":"2024-08-27T03:54:51.062718+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:40.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302531+0000","last_change":"2024-08-27T02:50:55.800079+0000","last_active":"2024-08-27T03:55:55.302531+0000","last_peered":"2024-08-27T03:55:55.302531+0000","last_clean":"2024-08-27T03:55:55.302531+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:55:55.302531+0000","last_undegraded":"2024-08-27T03:55:55.302531+0000","last_fullsized":"2024-08-27T03:55:55.302531+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:24:12.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.878104+0000","last_change":"2024-08-27T02:50:51.722487+0000","last_active":"2024-08-27T03:55:54.878104+0000","last_peered":"2024-08-27T03:55:54.878104+0000","last_clean":"2024-08-27T03:55:54.878104+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:55:54.878104+0000","last_undegraded":"2024-08-27T03:55:54.878104+0000","last_fullsized":"2024-08-27T03:55:54.878104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:03.625739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302418+0000","last_change":"2024-08-27T02:46:49.670647+0000","last_active":"2024-08-27T03:55:55.302418+0000","last_peered":"2024-08-27T03:55:55.302418+0000","last_clean":"2024-08-27T03:55:55.302418+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:55:55.302418+0000","last_undegraded":"2024-08-27T03:55:55.302418+0000","last_fullsized":"2024-08-27T03:55:55.302418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:21:10.983060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072751+0000","last_change":"2024-08-27T03:10:45.294675+0000","last_active":"2024-08-27T03:54:30.072751+0000","last_peered":"2024-08-27T03:54:30.072751+0000","last_clean":"2024-08-27T03:54:30.072751+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:54:30.072751+0000","last_undegraded":"2024-08-27T03:54:30.072751+0000","last_fullsized":"2024-08-27T03:54:30.072751+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:48.670669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093451+0000","last_change":"2024-08-27T02:50:55.767291+0000","last_active":"2024-08-27T03:55:55.093451+0000","last_peered":"2024-08-27T03:55:55.093451+0000","last_clean":"2024-08-27T03:55:55.093451+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:55:55.093451+0000","last_undegraded":"2024-08-27T03:55:55.093451+0000","last_fullsized":"2024-08-27T03:55:55.093451+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:34.369306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302551+0000","last_change":"2024-08-27T02:50:51.715173+0000","last_active":"2024-08-27T03:55:55.302551+0000","last_peered":"2024-08-27T03:55:55.302551+0000","last_clean":"2024-08-27T03:55:55.302551+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:55:55.302551+0000","last_undegraded":"2024-08-27T03:55:55.302551+0000","last_fullsized":"2024-08-27T03:55:55.302551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:01:41.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.072924+0000","last_change":"2024-08-27T02:46:49.659905+0000","last_active":"2024-08-27T03:55:36.072924+0000","last_peered":"2024-08-27T03:55:36.072924+0000","last_clean":"2024-08-27T03:55:36.072924+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:55:36.072924+0000","last_undegraded":"2024-08-27T03:55:36.072924+0000","last_fullsized":"2024-08-27T03:55:36.072924+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:42:58.919137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.080081+0000","last_change":"2024-08-27T03:10:45.302257+0000","last_active":"2024-08-27T03:56:15.080081+0000","last_peered":"2024-08-27T03:56:15.080081+0000","last_clean":"2024-08-27T03:56:15.080081+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:56:15.080081+0000","last_undegraded":"2024-08-27T03:56:15.080081+0000","last_fullsized":"2024-08-27T03:56:15.080081+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:49:38.342418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.039145+0000","last_change":"2024-08-27T02:50:55.776653+0000","last_active":"2024-08-27T03:58:30.039145+0000","last_peered":"2024-08-27T03:58:30.039145+0000","last_clean":"2024-08-27T03:58:30.039145+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:58:30.039145+0000","last_undegraded":"2024-08-27T03:58:30.039145+0000","last_fullsized":"2024-08-27T03:58:30.039145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:30:47.655678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292165+0000","last_change":"2024-08-27T02:50:51.712698+0000","last_active":"2024-08-27T03:55:15.292165+0000","last_peered":"2024-08-27T03:55:15.292165+0000","last_clean":"2024-08-27T03:55:15.292165+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:55:15.292165+0000","last_undegraded":"2024-08-27T03:55:15.292165+0000","last_fullsized":"2024-08-27T03:55:15.292165+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:54.805987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873157+0000","last_change":"2024-08-27T02:46:49.666166+0000","last_active":"2024-08-27T03:55:34.873157+0000","last_peered":"2024-08-27T03:55:34.873157+0000","last_clean":"2024-08-27T03:55:34.873157+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:55:34.873157+0000","last_undegraded":"2024-08-27T03:55:34.873157+0000","last_fullsized":"2024-08-27T03:55:34.873157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:59:52.040406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.302157+0000","last_change":"2024-08-27T03:10:45.289668+0000","last_active":"2024-08-27T03:56:15.302157+0000","last_peered":"2024-08-27T03:56:15.302157+0000","last_clean":"2024-08-27T03:56:15.302157+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:56:15.302157+0000","last_undegraded":"2024-08-27T03:56:15.302157+0000","last_fullsized":"2024-08-27T03:56:15.302157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:24.929800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.868290+0000","last_change":"2024-08-27T02:50:55.777558+0000","last_active":"2024-08-27T03:55:14.868290+0000","last_peered":"2024-08-27T03:55:14.868290+0000","last_clean":"2024-08-27T03:55:14.868290+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:55:14.868290+0000","last_undegraded":"2024-08-27T03:55:14.868290+0000","last_fullsized":"2024-08-27T03:55:14.868290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:52.030335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.295837+0000","last_change":"2024-08-27T02:50:51.718684+0000","last_active":"2024-08-27T03:55:30.295837+0000","last_peered":"2024-08-27T03:55:30.295837+0000","last_clean":"2024-08-27T03:55:30.295837+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:55:30.295837+0000","last_undegraded":"2024-08-27T03:55:30.295837+0000","last_fullsized":"2024-08-27T03:55:30.295837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:58:00.220312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21053,"num_write":11,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.088488+0000","last_change":"2024-08-27T02:46:49.666930+0000","last_active":"2024-08-27T03:55:35.088488+0000","last_peered":"2024-08-27T03:55:35.088488+0000","last_clean":"2024-08-27T03:55:35.088488+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:55:35.088488+0000","last_undegraded":"2024-08-27T03:55:35.088488+0000","last_fullsized":"2024-08-27T03:55:35.088488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:46.255173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495870+0000","last_change":"2024-08-27T03:10:45.281649+0000","last_active":"2024-08-27T03:54:30.495870+0000","last_peered":"2024-08-27T03:54:30.495870+0000","last_clean":"2024-08-27T03:54:30.495870+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:54:30.495870+0000","last_undegraded":"2024-08-27T03:54:30.495870+0000","last_fullsized":"2024-08-27T03:54:30.495870+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:51:40.495289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.480110+0000","last_change":"2024-08-27T02:50:55.790207+0000","last_active":"2024-08-27T03:57:35.480110+0000","last_peered":"2024-08-27T03:57:35.480110+0000","last_clean":"2024-08-27T03:57:35.480110+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:57:35.480110+0000","last_undegraded":"2024-08-27T03:57:35.480110+0000","last_fullsized":"2024-08-27T03:57:35.480110+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:29.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070538+0000","last_change":"2024-08-27T02:50:51.740655+0000","last_active":"2024-08-27T03:55:26.070538+0000","last_peered":"2024-08-27T03:55:26.070538+0000","last_clean":"2024-08-27T03:55:26.070538+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:55:26.070538+0000","last_undegraded":"2024-08-27T03:55:26.070538+0000","last_fullsized":"2024-08-27T03:55:26.070538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.497115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.453720+0000","last_change":"2024-08-27T02:46:49.638555+0000","last_active":"2024-08-27T03:55:35.453720+0000","last_peered":"2024-08-27T03:55:35.453720+0000","last_clean":"2024-08-27T03:55:35.453720+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:55:35.453720+0000","last_undegraded":"2024-08-27T03:55:35.453720+0000","last_fullsized":"2024-08-27T03:55:35.453720+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:10.855684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.283538+0000","last_change":"2024-08-27T03:10:45.290709+0000","last_active":"2024-08-27T03:54:40.283538+0000","last_peered":"2024-08-27T03:54:40.283538+0000","last_clean":"2024-08-27T03:54:40.283538+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:54:40.283538+0000","last_undegraded":"2024-08-27T03:54:40.283538+0000","last_fullsized":"2024-08-27T03:54:40.283538+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:12:15.082820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.116553+0000","last_change":"2024-08-27T02:50:55.772109+0000","last_active":"2024-08-27T03:57:35.116553+0000","last_peered":"2024-08-27T03:57:35.116553+0000","last_clean":"2024-08-27T03:57:35.116553+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:57:35.116553+0000","last_undegraded":"2024-08-27T03:57:35.116553+0000","last_fullsized":"2024-08-27T03:57:35.116553+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:34.257753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.452715+0000","last_change":"2024-08-27T02:50:51.705872+0000","last_active":"2024-08-27T03:55:30.452715+0000","last_peered":"2024-08-27T03:55:30.452715+0000","last_clean":"2024-08-27T03:55:30.452715+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:55:30.452715+0000","last_undegraded":"2024-08-27T03:55:30.452715+0000","last_fullsized":"2024-08-27T03:55:30.452715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:55.217217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290820+0000","last_change":"2024-08-27T02:46:49.667612+0000","last_active":"2024-08-27T03:55:10.290820+0000","last_peered":"2024-08-27T03:55:10.290820+0000","last_clean":"2024-08-27T03:55:10.290820+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:55:10.290820+0000","last_undegraded":"2024-08-27T03:55:10.290820+0000","last_fullsized":"2024-08-27T03:55:10.290820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:31.706212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'281","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.198532+0000","last_change":"2024-08-27T02:31:04.495209+0000","last_active":"2024-08-27T03:58:30.198532+0000","last_peered":"2024-08-27T03:58:30.198532+0000","last_clean":"2024-08-27T03:58:30.198532+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:30.198532+0000","last_undegraded":"2024-08-27T03:58:30.198532+0000","last_fullsized":"2024-08-27T03:58:30.198532+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:38:11.148447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6300018,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":391,"num_read_kb":22191,"num_write":976,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'457","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.605860+0000","last_change":"2024-08-27T02:31:06.459589+0000","last_active":"2024-08-27T03:56:42.605860+0000","last_peered":"2024-08-27T03:56:42.605860+0000","last_clean":"2024-08-27T03:56:42.605860+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:56:42.605860+0000","last_undegraded":"2024-08-27T03:56:42.605860+0000","last_fullsized":"2024-08-27T03:56:42.605860+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:09.070330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'343","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.019124+0000","last_change":"2024-08-27T02:31:04.454947+0000","last_active":"2024-08-27T03:58:31.019124+0000","last_peered":"2024-08-27T03:58:31.019124+0000","last_clean":"2024-08-27T03:58:31.019124+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:31.019124+0000","last_undegraded":"2024-08-27T03:58:31.019124+0000","last_fullsized":"2024-08-27T03:58:31.019124+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:49.691799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910763,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":605,"num_read_kb":39942,"num_write":1259,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'825","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.450685+0000","last_change":"2024-08-27T02:31:06.453930+0000","last_active":"2024-08-27T03:56:44.450685+0000","last_peered":"2024-08-27T03:56:44.450685+0000","last_clean":"2024-08-27T03:56:44.450685+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:56:44.450685+0000","last_undegraded":"2024-08-27T03:56:44.450685+0000","last_fullsized":"2024-08-27T03:56:44.450685+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:09.257638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'252","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.275414+0000","last_change":"2024-08-27T02:31:04.493891+0000","last_active":"2024-08-27T03:58:30.275414+0000","last_peered":"2024-08-27T03:58:30.275414+0000","last_clean":"2024-08-27T03:58:30.275414+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:30.275414+0000","last_undegraded":"2024-08-27T03:58:30.275414+0000","last_fullsized":"2024-08-27T03:58:30.275414+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:19:06.244262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292671,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":380,"num_read_kb":449,"num_write":890,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1216","reported_seq":2730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.360305+0000","last_change":"2024-08-27T02:31:06.464864+0000","last_active":"2024-08-27T03:54:25.360305+0000","last_peered":"2024-08-27T03:54:25.360305+0000","last_clean":"2024-08-27T03:54:25.360305+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:54:25.360305+0000","last_undegraded":"2024-08-27T03:54:25.360305+0000","last_fullsized":"2024-08-27T03:54:25.360305+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:57:06.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'281","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.838765+0000","last_change":"2024-08-27T02:31:04.469467+0000","last_active":"2024-08-27T03:58:29.838765+0000","last_peered":"2024-08-27T03:58:29.838765+0000","last_clean":"2024-08-27T03:58:29.838765+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:29.838765+0000","last_undegraded":"2024-08-27T03:58:29.838765+0000","last_fullsized":"2024-08-27T03:58:29.838765+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:20:36.614222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185945,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":522,"num_read_kb":3870,"num_write":1052,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'480","reported_seq":2134,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.441763+0000","last_change":"2024-08-27T02:31:06.457144+0000","last_active":"2024-08-27T03:56:44.441763+0000","last_peered":"2024-08-27T03:56:44.441763+0000","last_clean":"2024-08-27T03:56:44.441763+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:56:44.441763+0000","last_undegraded":"2024-08-27T03:56:44.441763+0000","last_fullsized":"2024-08-27T03:56:44.441763+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:55:40.220861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'353","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.236717+0000","last_change":"2024-08-27T02:31:04.489890+0000","last_active":"2024-08-27T03:58:30.236717+0000","last_peered":"2024-08-27T03:58:30.236717+0000","last_clean":"2024-08-27T03:58:30.236717+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:30.236717+0000","last_undegraded":"2024-08-27T03:58:30.236717+0000","last_fullsized":"2024-08-27T03:58:30.236717+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:07:25.086829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5744857,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":497,"num_read_kb":17279,"num_write":1167,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'493","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.525387+0000","last_change":"2024-08-27T02:31:06.469894+0000","last_active":"2024-08-27T03:56:44.525387+0000","last_peered":"2024-08-27T03:56:44.525387+0000","last_clean":"2024-08-27T03:56:44.525387+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:56:44.525387+0000","last_undegraded":"2024-08-27T03:56:44.525387+0000","last_fullsized":"2024-08-27T03:56:44.525387+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:32:27.240233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'274","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.722139+0000","last_change":"2024-08-27T02:31:04.451736+0000","last_active":"2024-08-27T03:58:29.722139+0000","last_peered":"2024-08-27T03:58:29.722139+0000","last_clean":"2024-08-27T03:58:29.722139+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:29.722139+0000","last_undegraded":"2024-08-27T03:58:29.722139+0000","last_fullsized":"2024-08-27T03:58:29.722139+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:49:13.433050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6967334,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":427,"num_read_kb":18973,"num_write":890,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.073015+0000","last_change":"2024-08-27T02:31:06.464775+0000","last_active":"2024-08-27T03:54:30.073015+0000","last_peered":"2024-08-27T03:54:30.073015+0000","last_clean":"2024-08-27T03:54:30.073015+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:54:30.073015+0000","last_undegraded":"2024-08-27T03:54:30.073015+0000","last_fullsized":"2024-08-27T03:54:30.073015+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:49:58.791418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'315","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.083172+0000","last_change":"2024-08-27T02:31:39.748095+0000","last_active":"2024-08-27T03:58:30.083172+0000","last_peered":"2024-08-27T03:58:30.083172+0000","last_clean":"2024-08-27T03:58:30.083172+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:30.083172+0000","last_undegraded":"2024-08-27T03:58:30.083172+0000","last_fullsized":"2024-08-27T03:58:30.083172+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:23:44.181903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10895133,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":497,"num_read_kb":18874,"num_write":1110,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'903","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.948193+0000","last_change":"2024-08-27T02:31:06.441463+0000","last_active":"2024-08-27T03:58:02.948193+0000","last_peered":"2024-08-27T03:58:02.948193+0000","last_clean":"2024-08-27T03:58:02.948193+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:02.948193+0000","last_undegraded":"2024-08-27T03:58:02.948193+0000","last_fullsized":"2024-08-27T03:58:02.948193+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:32:21.433480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'307","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.866449+0000","last_change":"2024-08-27T02:31:04.460911+0000","last_active":"2024-08-27T03:58:29.866449+0000","last_peered":"2024-08-27T03:58:29.866449+0000","last_clean":"2024-08-27T03:58:29.866449+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:29.866449+0000","last_undegraded":"2024-08-27T03:58:29.866449+0000","last_fullsized":"2024-08-27T03:58:29.866449+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:09.211873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612034,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":537,"num_read_kb":6557,"num_write":1011,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'920","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057701+0000","last_change":"2024-08-27T02:31:06.459200+0000","last_active":"2024-08-27T03:54:30.057701+0000","last_peered":"2024-08-27T03:54:30.057701+0000","last_clean":"2024-08-27T03:54:30.057701+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:54:30.057701+0000","last_undegraded":"2024-08-27T03:54:30.057701+0000","last_fullsized":"2024-08-27T03:54:30.057701+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:09:01.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'768","reported_seq":2529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677234+0000","last_change":"2024-08-27T02:31:06.466669+0000","last_active":"2024-08-27T03:56:42.677234+0000","last_peered":"2024-08-27T03:56:42.677234+0000","last_clean":"2024-08-27T03:56:42.677234+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:56:42.677234+0000","last_undegraded":"2024-08-27T03:56:42.677234+0000","last_fullsized":"2024-08-27T03:56:42.677234+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:23:04.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'282","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.300827+0000","last_change":"2024-08-27T02:31:04.495961+0000","last_active":"2024-08-27T03:58:30.300827+0000","last_peered":"2024-08-27T03:58:30.300827+0000","last_clean":"2024-08-27T03:58:30.300827+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:30.300827+0000","last_undegraded":"2024-08-27T03:58:30.300827+0000","last_fullsized":"2024-08-27T03:58:30.300827+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.777645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325230,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":355,"num_read_kb":9002,"num_write":922,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'787","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290995+0000","last_change":"2024-08-27T02:31:06.454274+0000","last_active":"2024-08-27T03:55:10.290995+0000","last_peered":"2024-08-27T03:55:10.290995+0000","last_clean":"2024-08-27T03:55:10.290995+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:55:10.290995+0000","last_undegraded":"2024-08-27T03:55:10.290995+0000","last_fullsized":"2024-08-27T03:55:10.290995+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:09:59.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.355537+0000","last_change":"2024-08-27T02:31:04.457818+0000","last_active":"2024-08-27T03:58:30.355537+0000","last_peered":"2024-08-27T03:58:30.355537+0000","last_clean":"2024-08-27T03:58:30.355537+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:30.355537+0000","last_undegraded":"2024-08-27T03:58:30.355537+0000","last_fullsized":"2024-08-27T03:58:30.355537+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:01:36.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087207,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":630,"num_read_kb":8370,"num_write":1156,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'487","reported_seq":2244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873079+0000","last_change":"2024-08-27T02:31:06.447246+0000","last_active":"2024-08-27T03:55:34.873079+0000","last_peered":"2024-08-27T03:55:34.873079+0000","last_clean":"2024-08-27T03:55:34.873079+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:55:34.873079+0000","last_undegraded":"2024-08-27T03:55:34.873079+0000","last_fullsized":"2024-08-27T03:55:34.873079+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:18:22.098121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'304","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.402385+0000","last_change":"2024-08-27T02:31:39.807510+0000","last_active":"2024-08-27T03:58:30.402385+0000","last_peered":"2024-08-27T03:58:30.402385+0000","last_clean":"2024-08-27T03:58:30.402385+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:30.402385+0000","last_undegraded":"2024-08-27T03:58:30.402385+0000","last_fullsized":"2024-08-27T03:58:30.402385+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:54.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894162,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":496,"num_read_kb":11494,"num_write":1092,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'683","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.996353+0000","last_change":"2024-08-27T02:31:06.453083+0000","last_active":"2024-08-27T03:58:02.996353+0000","last_peered":"2024-08-27T03:58:02.996353+0000","last_clean":"2024-08-27T03:58:02.996353+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:02.996353+0000","last_undegraded":"2024-08-27T03:58:02.996353+0000","last_fullsized":"2024-08-27T03:58:02.996353+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:51:51.420652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'334","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.096602+0000","last_change":"2024-08-27T02:31:04.464917+0000","last_active":"2024-08-27T03:58:30.096602+0000","last_peered":"2024-08-27T03:58:30.096602+0000","last_clean":"2024-08-27T03:58:30.096602+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:30.096602+0000","last_undegraded":"2024-08-27T03:58:30.096602+0000","last_fullsized":"2024-08-27T03:58:30.096602+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:42.233736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319598,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":735,"num_read_kb":144736,"num_write":1160,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'477","reported_seq":2100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.520780+0000","last_change":"2024-08-27T02:31:06.456023+0000","last_active":"2024-08-27T03:56:44.520780+0000","last_peered":"2024-08-27T03:56:44.520780+0000","last_clean":"2024-08-27T03:56:44.520780+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:56:44.520780+0000","last_undegraded":"2024-08-27T03:56:44.520780+0000","last_fullsized":"2024-08-27T03:56:44.520780+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:57:03.958056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'285","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.820355+0000","last_change":"2024-08-27T02:31:04.450019+0000","last_active":"2024-08-27T03:58:29.820355+0000","last_peered":"2024-08-27T03:58:29.820355+0000","last_clean":"2024-08-27T03:58:29.820355+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:29.820355+0000","last_undegraded":"2024-08-27T03:58:29.820355+0000","last_fullsized":"2024-08-27T03:58:29.820355+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:26.736946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7210638,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":521,"num_read_kb":47085,"num_write":1015,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'764","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090961+0000","last_change":"2024-08-27T02:31:06.457069+0000","last_active":"2024-08-27T03:55:45.090961+0000","last_peered":"2024-08-27T03:55:45.090961+0000","last_clean":"2024-08-27T03:55:45.090961+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:55:45.090961+0000","last_undegraded":"2024-08-27T03:55:45.090961+0000","last_fullsized":"2024-08-27T03:55:45.090961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:48.523132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'295","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.231200+0000","last_change":"2024-08-27T02:31:04.456657+0000","last_active":"2024-08-27T03:58:30.231200+0000","last_peered":"2024-08-27T03:58:30.231200+0000","last_clean":"2024-08-27T03:58:30.231200+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:30.231200+0000","last_undegraded":"2024-08-27T03:58:30.231200+0000","last_fullsized":"2024-08-27T03:58:30.231200+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:01:15.039976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276318,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":435,"num_read_kb":14802,"num_write":958,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.850365+0000","last_change":"2024-08-27T02:31:14.508871+0000","last_active":"2024-08-27T03:56:44.850365+0000","last_peered":"2024-08-27T03:56:44.850365+0000","last_clean":"2024-08-27T03:56:44.850365+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:56:44.850365+0000","last_undegraded":"2024-08-27T03:56:44.850365+0000","last_fullsized":"2024-08-27T03:56:44.850365+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:53:01.791364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'626","reported_seq":2345,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.935016+0000","last_change":"2024-08-27T02:31:06.447319+0000","last_active":"2024-08-27T03:58:02.935016+0000","last_peered":"2024-08-27T03:58:02.935016+0000","last_clean":"2024-08-27T03:58:02.935016+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:02.935016+0000","last_undegraded":"2024-08-27T03:58:02.935016+0000","last_fullsized":"2024-08-27T03:58:02.935016+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:57.126762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'309","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.315319+0000","last_change":"2024-08-27T02:31:04.493003+0000","last_active":"2024-08-27T03:58:30.315319+0000","last_peered":"2024-08-27T03:58:30.315319+0000","last_clean":"2024-08-27T03:58:30.315319+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:30.315319+0000","last_undegraded":"2024-08-27T03:58:30.315319+0000","last_fullsized":"2024-08-27T03:58:30.315319+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:12:45.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973430,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":450,"num_read_kb":48225,"num_write":1093,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875703+0000","last_change":"2024-08-27T02:31:08.475606+0000","last_active":"2024-08-27T03:55:44.875703+0000","last_peered":"2024-08-27T03:55:44.875703+0000","last_clean":"2024-08-27T03:55:44.875703+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:55:44.875703+0000","last_undegraded":"2024-08-27T03:55:44.875703+0000","last_fullsized":"2024-08-27T03:55:44.875703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:10.435910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'368","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:10.327416+0000","last_change":"2024-08-27T02:31:10.474061+0000","last_active":"2024-08-27T03:58:10.327416+0000","last_peered":"2024-08-27T03:58:10.327416+0000","last_clean":"2024-08-27T03:58:10.327416+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:10.327416+0000","last_undegraded":"2024-08-27T03:58:10.327416+0000","last_fullsized":"2024-08-27T03:58:10.327416+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:14.597433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":1072,"num_write":454,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.301263+0000","last_change":"2024-08-27T02:31:12.513470+0000","last_active":"2024-08-27T03:55:50.301263+0000","last_peered":"2024-08-27T03:55:50.301263+0000","last_clean":"2024-08-27T03:55:50.301263+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:55:50.301263+0000","last_undegraded":"2024-08-27T03:55:50.301263+0000","last_fullsized":"2024-08-27T03:55:50.301263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.177108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'139","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.610770+0000","last_change":"2024-08-27T02:31:14.508729+0000","last_active":"2024-08-27T03:54:25.610770+0000","last_peered":"2024-08-27T03:54:25.610770+0000","last_clean":"2024-08-27T03:54:25.610770+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:54:25.610770+0000","last_undegraded":"2024-08-27T03:54:25.610770+0000","last_fullsized":"2024-08-27T03:54:25.610770+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:18.167802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'817","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875663+0000","last_change":"2024-08-27T02:31:06.451014+0000","last_active":"2024-08-27T03:55:44.875663+0000","last_peered":"2024-08-27T03:55:44.875663+0000","last_clean":"2024-08-27T03:55:44.875663+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:55:44.875663+0000","last_undegraded":"2024-08-27T03:55:44.875663+0000","last_fullsized":"2024-08-27T03:55:44.875663+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:34:38.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'278","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.325266+0000","last_change":"2024-08-27T02:31:04.492617+0000","last_active":"2024-08-27T03:58:30.325266+0000","last_peered":"2024-08-27T03:58:30.325266+0000","last_clean":"2024-08-27T03:58:30.325266+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:30.325266+0000","last_undegraded":"2024-08-27T03:58:30.325266+0000","last_fullsized":"2024-08-27T03:58:30.325266+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:51.730290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325188,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":355,"num_read_kb":13671,"num_write":912,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.892074+0000","last_change":"2024-08-27T02:31:08.444125+0000","last_active":"2024-08-27T03:55:34.892074+0000","last_peered":"2024-08-27T03:55:34.892074+0000","last_clean":"2024-08-27T03:55:34.892074+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:55:34.892074+0000","last_undegraded":"2024-08-27T03:55:34.892074+0000","last_fullsized":"2024-08-27T03:55:34.892074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:50.658905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'118","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.091053+0000","last_change":"2024-08-27T02:31:10.463462+0000","last_active":"2024-08-27T03:55:45.091053+0000","last_peered":"2024-08-27T03:55:45.091053+0000","last_clean":"2024-08-27T03:55:45.091053+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:55:45.091053+0000","last_undegraded":"2024-08-27T03:55:45.091053+0000","last_fullsized":"2024-08-27T03:55:45.091053+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:05.726630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.092259+0000","last_change":"2024-08-27T02:31:12.524180+0000","last_active":"2024-08-27T03:55:50.092259+0000","last_peered":"2024-08-27T03:55:50.092259+0000","last_clean":"2024-08-27T03:55:50.092259+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:55:50.092259+0000","last_undegraded":"2024-08-27T03:55:50.092259+0000","last_fullsized":"2024-08-27T03:55:50.092259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'140","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.401306+0000","last_change":"2024-08-27T02:31:14.511765+0000","last_active":"2024-08-27T03:56:44.401306+0000","last_peered":"2024-08-27T03:56:44.401306+0000","last_clean":"2024-08-27T03:56:44.401306+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:56:44.401306+0000","last_undegraded":"2024-08-27T03:56:44.401306+0000","last_fullsized":"2024-08-27T03:56:44.401306+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:18:47.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.523863+0000","last_change":"2024-08-27T02:31:06.450475+0000","last_active":"2024-08-27T03:56:44.523863+0000","last_peered":"2024-08-27T03:56:44.523863+0000","last_clean":"2024-08-27T03:56:44.523863+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:56:44.523863+0000","last_undegraded":"2024-08-27T03:56:44.523863+0000","last_fullsized":"2024-08-27T03:56:44.523863+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:57:34.146161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'335","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.050215+0000","last_change":"2024-08-27T02:31:38.759396+0000","last_active":"2024-08-27T03:58:30.050215+0000","last_peered":"2024-08-27T03:58:30.050215+0000","last_clean":"2024-08-27T03:58:30.050215+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:30.050215+0000","last_undegraded":"2024-08-27T03:58:30.050215+0000","last_fullsized":"2024-08-27T03:58:30.050215+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:50.384706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6417572,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":618,"num_read_kb":34085,"num_write":1208,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727614+0000","last_change":"2024-08-27T02:31:08.475047+0000","last_active":"2024-08-27T03:58:28.727614+0000","last_peered":"2024-08-27T03:58:28.727614+0000","last_clean":"2024-08-27T03:58:28.727614+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:58:28.727614+0000","last_undegraded":"2024-08-27T03:58:28.727614+0000","last_fullsized":"2024-08-27T03:58:28.727614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:00:07.644027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'154","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.068764+0000","last_change":"2024-08-27T02:31:10.464314+0000","last_active":"2024-08-27T03:55:25.068764+0000","last_peered":"2024-08-27T03:55:25.068764+0000","last_clean":"2024-08-27T03:55:25.068764+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:55:25.068764+0000","last_undegraded":"2024-08-27T03:55:25.068764+0000","last_fullsized":"2024-08-27T03:55:25.068764+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:19.772117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'697","reported_seq":2535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.988503+0000","last_change":"2024-08-27T02:31:12.509703+0000","last_active":"2024-08-27T03:58:28.988503+0000","last_peered":"2024-08-27T03:58:28.988503+0000","last_clean":"2024-08-27T03:58:28.988503+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:58:28.988503+0000","last_undegraded":"2024-08-27T03:58:28.988503+0000","last_fullsized":"2024-08-27T03:58:28.988503+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":601,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:41.710475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'177","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.636112+0000","last_change":"2024-08-27T02:31:15.025741+0000","last_active":"2024-08-27T03:58:02.636112+0000","last_peered":"2024-08-27T03:58:02.636112+0000","last_clean":"2024-08-27T03:58:02.636112+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:58:02.636112+0000","last_undegraded":"2024-08-27T03:58:02.636112+0000","last_fullsized":"2024-08-27T03:58:02.636112+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:42:35.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'582","reported_seq":2233,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.527277+0000","last_change":"2024-08-27T02:31:06.461256+0000","last_active":"2024-08-27T03:56:44.527277+0000","last_peered":"2024-08-27T03:56:44.527277+0000","last_clean":"2024-08-27T03:56:44.527277+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:56:44.527277+0000","last_undegraded":"2024-08-27T03:56:44.527277+0000","last_fullsized":"2024-08-27T03:56:44.527277+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:25:53.064370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'309","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.362891+0000","last_change":"2024-08-27T02:31:04.481742+0000","last_active":"2024-08-27T03:58:30.362891+0000","last_peered":"2024-08-27T03:58:30.362891+0000","last_clean":"2024-08-27T03:58:30.362891+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:30.362891+0000","last_undegraded":"2024-08-27T03:58:30.362891+0000","last_fullsized":"2024-08-27T03:58:30.362891+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:44:24.122491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":412,"num_read_kb":7479,"num_write":1086,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875767+0000","last_change":"2024-08-27T02:31:08.476876+0000","last_active":"2024-08-27T03:55:44.875767+0000","last_peered":"2024-08-27T03:55:44.875767+0000","last_clean":"2024-08-27T03:55:44.875767+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:55:44.875767+0000","last_undegraded":"2024-08-27T03:55:44.875767+0000","last_fullsized":"2024-08-27T03:55:44.875767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:49:16.770918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'290","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.333168+0000","last_change":"2024-08-27T02:31:10.638091+0000","last_active":"2024-08-27T03:58:30.333168+0000","last_peered":"2024-08-27T03:58:30.333168+0000","last_clean":"2024-08-27T03:58:30.333168+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:58:30.333168+0000","last_undegraded":"2024-08-27T03:58:30.333168+0000","last_fullsized":"2024-08-27T03:58:30.333168+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:14.620860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'728","reported_seq":2829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.998721+0000","last_change":"2024-08-27T02:31:12.505687+0000","last_active":"2024-08-27T03:58:28.998721+0000","last_peered":"2024-08-27T03:58:28.998721+0000","last_clean":"2024-08-27T03:58:28.998721+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:58:28.998721+0000","last_undegraded":"2024-08-27T03:58:28.998721+0000","last_fullsized":"2024-08-27T03:58:28.998721+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:36:59.690511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1267","reported_seq":2829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874236+0000","last_change":"2024-08-27T02:31:06.443724+0000","last_active":"2024-08-27T03:55:39.874236+0000","last_peered":"2024-08-27T03:55:39.874236+0000","last_clean":"2024-08-27T03:55:39.874236+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:55:39.874236+0000","last_undegraded":"2024-08-27T03:55:39.874236+0000","last_fullsized":"2024-08-27T03:55:39.874236+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:12:39.506534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'320","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.300512+0000","last_change":"2024-08-27T02:31:04.500120+0000","last_active":"2024-08-27T03:58:30.300512+0000","last_peered":"2024-08-27T03:58:30.300512+0000","last_clean":"2024-08-27T03:58:30.300512+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:30.300512+0000","last_undegraded":"2024-08-27T03:58:30.300512+0000","last_fullsized":"2024-08-27T03:58:30.300512+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:28:33.060344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6380157,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":489,"num_read_kb":34000,"num_write":1055,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.298359+0000","last_change":"2024-08-27T02:31:08.468116+0000","last_active":"2024-08-27T03:55:40.298359+0000","last_peered":"2024-08-27T03:55:40.298359+0000","last_clean":"2024-08-27T03:55:40.298359+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:55:40.298359+0000","last_undegraded":"2024-08-27T03:55:40.298359+0000","last_fullsized":"2024-08-27T03:55:40.298359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:43.021123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'395","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:14.911227+0000","last_change":"2024-08-27T02:31:10.633487+0000","last_active":"2024-08-27T03:58:14.911227+0000","last_peered":"2024-08-27T03:58:14.911227+0000","last_clean":"2024-08-27T03:58:14.911227+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:58:14.911227+0000","last_undegraded":"2024-08-27T03:58:14.911227+0000","last_fullsized":"2024-08-27T03:58:14.911227+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:27:37.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49315,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":621,"num_read_kb":1077,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058784+0000","last_change":"2024-08-27T02:31:12.508561+0000","last_active":"2024-08-27T03:54:31.058784+0000","last_peered":"2024-08-27T03:54:31.058784+0000","last_clean":"2024-08-27T03:54:31.058784+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:54:31.058784+0000","last_undegraded":"2024-08-27T03:54:31.058784+0000","last_fullsized":"2024-08-27T03:54:31.058784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:32:48.985390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'588","reported_seq":1428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929629+0000","last_change":"2024-08-27T02:31:14.510230+0000","last_active":"2024-08-27T03:58:03.929629+0000","last_peered":"2024-08-27T03:58:03.929629+0000","last_clean":"2024-08-27T03:58:03.929629+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:58:03.929629+0000","last_undegraded":"2024-08-27T03:58:03.929629+0000","last_fullsized":"2024-08-27T03:58:03.929629+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:05:59.246892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1455","reported_seq":2950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217533+0000","last_change":"2024-08-27T02:31:06.455483+0000","last_active":"2024-08-27T03:55:54.217533+0000","last_peered":"2024-08-27T03:55:54.217533+0000","last_clean":"2024-08-27T03:55:54.217533+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:55:54.217533+0000","last_undegraded":"2024-08-27T03:55:54.217533+0000","last_fullsized":"2024-08-27T03:55:54.217533+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:08.735623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'341","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.235733+0000","last_change":"2024-08-27T02:31:04.495144+0000","last_active":"2024-08-27T03:58:30.235733+0000","last_peered":"2024-08-27T03:58:30.235733+0000","last_clean":"2024-08-27T03:58:30.235733+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:30.235733+0000","last_undegraded":"2024-08-27T03:58:30.235733+0000","last_fullsized":"2024-08-27T03:58:30.235733+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:04:23.814829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2500262,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":612,"num_read_kb":2850,"num_write":1239,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072095+0000","last_change":"2024-08-27T02:31:08.461348+0000","last_active":"2024-08-27T03:55:40.072095+0000","last_peered":"2024-08-27T03:55:40.072095+0000","last_clean":"2024-08-27T03:55:40.072095+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:55:40.072095+0000","last_undegraded":"2024-08-27T03:55:40.072095+0000","last_fullsized":"2024-08-27T03:55:40.072095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:50.304151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'307","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.550654+0000","last_change":"2024-08-27T02:31:10.465779+0000","last_active":"2024-08-27T03:58:29.550654+0000","last_peered":"2024-08-27T03:58:29.550654+0000","last_clean":"2024-08-27T03:58:29.550654+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:58:29.550654+0000","last_undegraded":"2024-08-27T03:58:29.550654+0000","last_fullsized":"2024-08-27T03:58:29.550654+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:24:14.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900276+0000","last_change":"2024-08-27T02:31:12.506224+0000","last_active":"2024-08-27T03:56:09.900276+0000","last_peered":"2024-08-27T03:56:09.900276+0000","last_clean":"2024-08-27T03:56:09.900276+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:56:09.900276+0000","last_undegraded":"2024-08-27T03:56:09.900276+0000","last_fullsized":"2024-08-27T03:56:09.900276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:37.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2395","reported_seq":4229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:50.470481+0000","last_change":"2024-08-27T02:31:14.514506+0000","last_active":"2024-08-27T03:56:50.470481+0000","last_peered":"2024-08-27T03:56:50.470481+0000","last_clean":"2024-08-27T03:56:50.470481+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:56:50.470481+0000","last_undegraded":"2024-08-27T03:56:50.470481+0000","last_fullsized":"2024-08-27T03:56:50.470481+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":2300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:49.198563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'439","reported_seq":1936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.457107+0000","last_change":"2024-08-27T02:31:06.473831+0000","last_active":"2024-08-27T03:55:50.457107+0000","last_peered":"2024-08-27T03:55:50.457107+0000","last_clean":"2024-08-27T03:55:50.457107+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:55:50.457107+0000","last_undegraded":"2024-08-27T03:55:50.457107+0000","last_fullsized":"2024-08-27T03:55:50.457107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:34:41.312642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'308","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.250566+0000","last_change":"2024-08-27T02:31:04.501562+0000","last_active":"2024-08-27T03:58:30.250566+0000","last_peered":"2024-08-27T03:58:30.250566+0000","last_clean":"2024-08-27T03:58:30.250566+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:30.250566+0000","last_undegraded":"2024-08-27T03:58:30.250566+0000","last_fullsized":"2024-08-27T03:58:30.250566+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11452309,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":470,"num_read_kb":51263,"num_write":1101,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056621+0000","last_change":"2024-08-27T02:31:08.463300+0000","last_active":"2024-08-27T03:54:25.056621+0000","last_peered":"2024-08-27T03:54:25.056621+0000","last_clean":"2024-08-27T03:54:25.056621+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:54:25.056621+0000","last_undegraded":"2024-08-27T03:54:25.056621+0000","last_fullsized":"2024-08-27T03:54:25.056621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:03.773202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'357","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.903629+0000","last_change":"2024-08-27T02:31:10.476799+0000","last_active":"2024-08-27T03:58:03.903629+0000","last_peered":"2024-08-27T03:58:03.903629+0000","last_clean":"2024-08-27T03:58:03.903629+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:58:03.903629+0000","last_undegraded":"2024-08-27T03:58:03.903629+0000","last_fullsized":"2024-08-27T03:58:03.903629+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:52:11.386500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55253,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":570,"num_read_kb":1090,"num_write":450,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'718","reported_seq":4949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.002965+0000","last_change":"2024-08-27T02:31:12.515783+0000","last_active":"2024-08-27T03:58:29.002965+0000","last_peered":"2024-08-27T03:58:29.002965+0000","last_clean":"2024-08-27T03:58:29.002965+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:58:29.002965+0000","last_undegraded":"2024-08-27T03:58:29.002965+0000","last_fullsized":"2024-08-27T03:58:29.002965+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:57.983153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'170","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.633450+0000","last_change":"2024-08-27T02:31:14.512105+0000","last_active":"2024-08-27T03:58:02.633450+0000","last_peered":"2024-08-27T03:58:02.633450+0000","last_clean":"2024-08-27T03:58:02.633450+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:58:02.633450+0000","last_undegraded":"2024-08-27T03:58:02.633450+0000","last_fullsized":"2024-08-27T03:58:02.633450+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:45:04.697202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'798","reported_seq":2339,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.931076+0000","last_change":"2024-08-27T02:31:06.448300+0000","last_active":"2024-08-27T03:58:02.931076+0000","last_peered":"2024-08-27T03:58:02.931076+0000","last_clean":"2024-08-27T03:58:02.931076+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:02.931076+0000","last_undegraded":"2024-08-27T03:58:02.931076+0000","last_fullsized":"2024-08-27T03:58:02.931076+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:17.328531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'264","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.893918+0000","last_change":"2024-08-27T02:31:04.451589+0000","last_active":"2024-08-27T03:58:29.893918+0000","last_peered":"2024-08-27T03:58:29.893918+0000","last_clean":"2024-08-27T03:58:29.893918+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:29.893918+0000","last_undegraded":"2024-08-27T03:58:29.893918+0000","last_fullsized":"2024-08-27T03:58:29.893918+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:25.923987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6738883,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":331,"num_read_kb":7344,"num_write":921,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.075921+0000","last_change":"2024-08-27T02:31:08.455579+0000","last_active":"2024-08-27T03:55:55.075921+0000","last_peered":"2024-08-27T03:55:55.075921+0000","last_clean":"2024-08-27T03:55:55.075921+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:55:55.075921+0000","last_undegraded":"2024-08-27T03:55:55.075921+0000","last_fullsized":"2024-08-27T03:55:55.075921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:50:22.765293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'492","reported_seq":1164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.800742+0000","last_change":"2024-08-27T02:31:10.476948+0000","last_active":"2024-08-27T03:58:29.800742+0000","last_peered":"2024-08-27T03:58:29.800742+0000","last_clean":"2024-08-27T03:58:29.800742+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:58:29.800742+0000","last_undegraded":"2024-08-27T03:58:29.800742+0000","last_fullsized":"2024-08-27T03:58:29.800742+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:15:08.613306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":857,"num_read_kb":1955,"num_write":696,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073445+0000","last_change":"2024-08-27T02:31:12.497480+0000","last_active":"2024-08-27T03:55:45.073445+0000","last_peered":"2024-08-27T03:55:45.073445+0000","last_clean":"2024-08-27T03:55:45.073445+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:55:45.073445+0000","last_undegraded":"2024-08-27T03:55:45.073445+0000","last_fullsized":"2024-08-27T03:55:45.073445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:37:27.672439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'129","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.500987+0000","last_change":"2024-08-27T02:31:14.509810+0000","last_active":"2024-08-27T03:56:44.500987+0000","last_peered":"2024-08-27T03:56:44.500987+0000","last_clean":"2024-08-27T03:56:44.500987+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:56:44.500987+0000","last_undegraded":"2024-08-27T03:56:44.500987+0000","last_fullsized":"2024-08-27T03:56:44.500987+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:19:36.713125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'442","reported_seq":1971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071688+0000","last_change":"2024-08-27T02:31:06.467597+0000","last_active":"2024-08-27T03:54:25.071688+0000","last_peered":"2024-08-27T03:54:25.071688+0000","last_clean":"2024-08-27T03:54:25.071688+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:54:25.071688+0000","last_undegraded":"2024-08-27T03:54:25.071688+0000","last_fullsized":"2024-08-27T03:54:25.071688+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:25.304915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'283","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.864676+0000","last_change":"2024-08-27T02:31:04.477417+0000","last_active":"2024-08-27T03:58:29.864676+0000","last_peered":"2024-08-27T03:58:29.864676+0000","last_clean":"2024-08-27T03:58:29.864676+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:29.864676+0000","last_undegraded":"2024-08-27T03:58:29.864676+0000","last_fullsized":"2024-08-27T03:58:29.864676+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:14.347972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490767,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":410,"num_read_kb":3132,"num_write":1030,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056667+0000","last_change":"2024-08-27T02:31:08.455739+0000","last_active":"2024-08-27T03:54:25.056667+0000","last_peered":"2024-08-27T03:54:25.056667+0000","last_clean":"2024-08-27T03:54:25.056667+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:54:25.056667+0000","last_undegraded":"2024-08-27T03:54:25.056667+0000","last_fullsized":"2024-08-27T03:54:25.056667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:28.350091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.873334+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.873334+0000","last_peered":"2024-08-27T03:58:29.873334+0000","last_clean":"2024-08-27T03:58:29.873334+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:58:29.873334+0000","last_undegraded":"2024-08-27T03:58:29.873334+0000","last_fullsized":"2024-08-27T03:58:29.873334+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:05:17.996037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498208+0000","last_change":"2024-08-27T02:31:12.518013+0000","last_active":"2024-08-27T03:54:40.498208+0000","last_peered":"2024-08-27T03:54:40.498208+0000","last_clean":"2024-08-27T03:54:40.498208+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:54:40.498208+0000","last_undegraded":"2024-08-27T03:54:40.498208+0000","last_fullsized":"2024-08-27T03:54:40.498208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:06.086496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'122","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:39.920813+0000","last_change":"2024-08-27T02:31:14.508708+0000","last_active":"2024-08-27T03:57:39.920813+0000","last_peered":"2024-08-27T03:57:39.920813+0000","last_clean":"2024-08-27T03:57:39.920813+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:57:39.920813+0000","last_undegraded":"2024-08-27T03:57:39.920813+0000","last_fullsized":"2024-08-27T03:57:39.920813+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:18.139046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'303","reported_seq":1695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217612+0000","last_change":"2024-08-27T02:31:06.455458+0000","last_active":"2024-08-27T03:55:54.217612+0000","last_peered":"2024-08-27T03:55:54.217612+0000","last_clean":"2024-08-27T03:55:54.217612+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:55:54.217612+0000","last_undegraded":"2024-08-27T03:55:54.217612+0000","last_fullsized":"2024-08-27T03:55:54.217612+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:15.294777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'289","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.424136+0000","last_change":"2024-08-27T02:31:38.753790+0000","last_active":"2024-08-27T03:58:30.424136+0000","last_peered":"2024-08-27T03:58:30.424136+0000","last_clean":"2024-08-27T03:58:30.424136+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:30.424136+0000","last_undegraded":"2024-08-27T03:58:30.424136+0000","last_fullsized":"2024-08-27T03:58:30.424136+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:17:03.166739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1921,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":415,"num_read_kb":5526,"num_write":974,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:26.057616+0000","last_change":"2024-08-27T02:31:08.473152+0000","last_active":"2024-08-27T03:54:26.057616+0000","last_peered":"2024-08-27T03:54:26.057616+0000","last_clean":"2024-08-27T03:54:26.057616+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:54:26.057616+0000","last_undegraded":"2024-08-27T03:54:26.057616+0000","last_fullsized":"2024-08-27T03:54:26.057616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:14.881514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'377","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.317872+0000","last_change":"2024-08-27T02:31:10.462797+0000","last_active":"2024-08-27T03:58:29.317872+0000","last_peered":"2024-08-27T03:58:29.317872+0000","last_clean":"2024-08-27T03:58:29.317872+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:29.317872+0000","last_undegraded":"2024-08-27T03:58:29.317872+0000","last_fullsized":"2024-08-27T03:58:29.317872+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:33.566956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'670","reported_seq":2559,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.989770+0000","last_change":"2024-08-27T02:31:12.508008+0000","last_active":"2024-08-27T03:58:28.989770+0000","last_peered":"2024-08-27T03:58:28.989770+0000","last_clean":"2024-08-27T03:58:28.989770+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:28.989770+0000","last_undegraded":"2024-08-27T03:58:28.989770+0000","last_fullsized":"2024-08-27T03:58:28.989770+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:20.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'97","reported_seq":609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.307427+0000","last_change":"2024-08-27T02:31:14.503409+0000","last_active":"2024-08-27T03:56:40.307427+0000","last_peered":"2024-08-27T03:56:40.307427+0000","last_clean":"2024-08-27T03:56:40.307427+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:56:40.307427+0000","last_undegraded":"2024-08-27T03:56:40.307427+0000","last_fullsized":"2024-08-27T03:56:40.307427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:06:36.783130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'835","reported_seq":2581,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071793+0000","last_change":"2024-08-27T02:31:06.471655+0000","last_active":"2024-08-27T03:54:25.071793+0000","last_peered":"2024-08-27T03:54:25.071793+0000","last_clean":"2024-08-27T03:54:25.071793+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:54:25.071793+0000","last_undegraded":"2024-08-27T03:54:25.071793+0000","last_fullsized":"2024-08-27T03:54:25.071793+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:48:58.542463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'288","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.080550+0000","last_change":"2024-08-27T02:31:04.484468+0000","last_active":"2024-08-27T03:58:30.080550+0000","last_peered":"2024-08-27T03:58:30.080550+0000","last_clean":"2024-08-27T03:58:30.080550+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:30.080550+0000","last_undegraded":"2024-08-27T03:58:30.080550+0000","last_fullsized":"2024-08-27T03:58:30.080550+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:45:11.647025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6451730,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":762,"num_read_kb":112858,"num_write":1039,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.741436+0000","last_change":"2024-08-27T02:31:08.472253+0000","last_active":"2024-08-27T03:58:28.741436+0000","last_peered":"2024-08-27T03:58:28.741436+0000","last_clean":"2024-08-27T03:58:28.741436+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:28.741436+0000","last_undegraded":"2024-08-27T03:58:28.741436+0000","last_fullsized":"2024-08-27T03:58:28.741436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:32:23.121770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'117","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.870144+0000","last_change":"2024-08-27T02:31:10.637623+0000","last_active":"2024-08-27T03:54:24.870144+0000","last_peered":"2024-08-27T03:54:24.870144+0000","last_clean":"2024-08-27T03:54:24.870144+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:54:24.870144+0000","last_undegraded":"2024-08-27T03:54:24.870144+0000","last_fullsized":"2024-08-27T03:54:24.870144+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:20:41.856144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'691","reported_seq":3063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.994322+0000","last_change":"2024-08-27T02:31:12.491000+0000","last_active":"2024-08-27T03:58:28.994322+0000","last_peered":"2024-08-27T03:58:28.994322+0000","last_clean":"2024-08-27T03:58:28.994322+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:28.994322+0000","last_undegraded":"2024-08-27T03:58:28.994322+0000","last_fullsized":"2024-08-27T03:58:28.994322+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:38.876627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074108+0000","last_change":"2024-08-27T02:31:14.511270+0000","last_active":"2024-08-27T03:54:35.074108+0000","last_peered":"2024-08-27T03:54:35.074108+0000","last_clean":"2024-08-27T03:54:35.074108+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:54:35.074108+0000","last_undegraded":"2024-08-27T03:54:35.074108+0000","last_fullsized":"2024-08-27T03:54:35.074108+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:43.076037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2340,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:36.059935+0000","last_change":"2024-08-27T02:31:06.459516+0000","last_active":"2024-08-27T03:54:36.059935+0000","last_peered":"2024-08-27T03:54:36.059935+0000","last_clean":"2024-08-27T03:54:36.059935+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:54:36.059935+0000","last_undegraded":"2024-08-27T03:54:36.059935+0000","last_fullsized":"2024-08-27T03:54:36.059935+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:49:12.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'331","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.827904+0000","last_change":"2024-08-27T02:31:04.475738+0000","last_active":"2024-08-27T03:58:29.827904+0000","last_peered":"2024-08-27T03:58:29.827904+0000","last_clean":"2024-08-27T03:58:29.827904+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:29.827904+0000","last_undegraded":"2024-08-27T03:58:29.827904+0000","last_fullsized":"2024-08-27T03:58:29.827904+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:44:38.581586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426989,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":688,"num_read_kb":1676,"num_write":1165,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071772+0000","last_change":"2024-08-27T02:31:08.477595+0000","last_active":"2024-08-27T03:54:25.071772+0000","last_peered":"2024-08-27T03:54:25.071772+0000","last_clean":"2024-08-27T03:54:25.071772+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:54:25.071772+0000","last_undegraded":"2024-08-27T03:54:25.071772+0000","last_fullsized":"2024-08-27T03:54:25.071772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:59.236199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'398","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.890122+0000","last_change":"2024-08-27T02:31:10.469889+0000","last_active":"2024-08-27T03:58:03.890122+0000","last_peered":"2024-08-27T03:58:03.890122+0000","last_clean":"2024-08-27T03:58:03.890122+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:58:03.890122+0000","last_undegraded":"2024-08-27T03:58:03.890122+0000","last_fullsized":"2024-08-27T03:58:03.890122+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:10:03.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52725,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":1098,"num_write":480,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439768+0000","last_change":"2024-08-27T02:31:12.497988+0000","last_active":"2024-08-27T03:54:30.439768+0000","last_peered":"2024-08-27T03:54:30.439768+0000","last_clean":"2024-08-27T03:54:30.439768+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:54:30.439768+0000","last_undegraded":"2024-08-27T03:54:30.439768+0000","last_fullsized":"2024-08-27T03:54:30.439768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:13:47.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'228","reported_seq":770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:41.905788+0000","last_change":"2024-08-27T02:31:14.492927+0000","last_active":"2024-08-27T03:56:41.905788+0000","last_peered":"2024-08-27T03:56:41.905788+0000","last_clean":"2024-08-27T03:56:41.905788+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:56:41.905788+0000","last_undegraded":"2024-08-27T03:56:41.905788+0000","last_fullsized":"2024-08-27T03:56:41.905788+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:13.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'523","reported_seq":2133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.924936+0000","last_change":"2024-08-27T02:31:06.467157+0000","last_active":"2024-08-27T03:58:02.924936+0000","last_peered":"2024-08-27T03:58:02.924936+0000","last_clean":"2024-08-27T03:58:02.924936+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:02.924936+0000","last_undegraded":"2024-08-27T03:58:02.924936+0000","last_fullsized":"2024-08-27T03:58:02.924936+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:37.085886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290875+0000","last_change":"2024-08-27T02:30:47.729098+0000","last_active":"2024-08-27T03:55:10.290875+0000","last_peered":"2024-08-27T03:55:10.290875+0000","last_clean":"2024-08-27T03:55:10.290875+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:55:10.290875+0000","last_undegraded":"2024-08-27T03:55:10.290875+0000","last_fullsized":"2024-08-27T03:55:10.290875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_clean_scrub_stamp":"2024-08-27T02:30:46.155361+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:24.032204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884146+0000","last_change":"2024-08-27T02:30:54.230879+0000","last_active":"2024-08-27T03:56:19.884146+0000","last_peered":"2024-08-27T03:56:19.884146+0000","last_clean":"2024-08-27T03:56:19.884146+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:56:19.884146+0000","last_undegraded":"2024-08-27T03:56:19.884146+0000","last_fullsized":"2024-08-27T03:56:19.884146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:44:20.045106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'265","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.786697+0000","last_change":"2024-08-27T02:31:04.461391+0000","last_active":"2024-08-27T03:58:29.786697+0000","last_peered":"2024-08-27T03:58:29.786697+0000","last_clean":"2024-08-27T03:58:29.786697+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:29.786697+0000","last_undegraded":"2024-08-27T03:58:29.786697+0000","last_fullsized":"2024-08-27T03:58:29.786697+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:42:05.833893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10545208,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":686,"num_read_kb":118351,"num_write":983,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281099+0000","last_change":"2024-08-27T02:31:08.459311+0000","last_active":"2024-08-27T03:54:30.281099+0000","last_peered":"2024-08-27T03:54:30.281099+0000","last_clean":"2024-08-27T03:54:30.281099+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:54:30.281099+0000","last_undegraded":"2024-08-27T03:54:30.281099+0000","last_fullsized":"2024-08-27T03:54:30.281099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:59.553379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'721","reported_seq":1448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.071686+0000","last_change":"2024-08-27T02:31:10.463138+0000","last_active":"2024-08-27T03:58:29.071686+0000","last_peered":"2024-08-27T03:58:29.071686+0000","last_clean":"2024-08-27T03:58:29.071686+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:58:29.071686+0000","last_undegraded":"2024-08-27T03:58:29.071686+0000","last_fullsized":"2024-08-27T03:58:29.071686+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:46:40.351745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159854,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":2935,"num_write":1332,"num_write_kb":1163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294607+0000","last_change":"2024-08-27T02:31:12.521459+0000","last_active":"2024-08-27T03:55:45.294607+0000","last_peered":"2024-08-27T03:55:45.294607+0000","last_clean":"2024-08-27T03:55:45.294607+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:55:45.294607+0000","last_undegraded":"2024-08-27T03:55:45.294607+0000","last_fullsized":"2024-08-27T03:55:45.294607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:35:48.852493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'207","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.606155+0000","last_change":"2024-08-27T02:31:14.512251+0000","last_active":"2024-08-27T03:56:44.606155+0000","last_peered":"2024-08-27T03:56:44.606155+0000","last_clean":"2024-08-27T03:56:44.606155+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:56:44.606155+0000","last_undegraded":"2024-08-27T03:56:44.606155+0000","last_fullsized":"2024-08-27T03:56:44.606155+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:31.795991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1517","reported_seq":3073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.293279+0000","last_change":"2024-08-27T02:31:06.451054+0000","last_active":"2024-08-27T03:55:40.293279+0000","last_peered":"2024-08-27T03:55:40.293279+0000","last_clean":"2024-08-27T03:55:40.293279+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:55:40.293279+0000","last_undegraded":"2024-08-27T03:55:40.293279+0000","last_fullsized":"2024-08-27T03:55:40.293279+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:15:15.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292215+0000","last_change":"2024-08-27T02:30:54.329044+0000","last_active":"2024-08-27T03:55:15.292215+0000","last_peered":"2024-08-27T03:55:15.292215+0000","last_clean":"2024-08-27T03:55:15.292215+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:55:15.292215+0000","last_undegraded":"2024-08-27T03:55:15.292215+0000","last_fullsized":"2024-08-27T03:55:15.292215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:29.700171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.306400+0000","last_change":"2024-08-27T02:31:04.457791+0000","last_active":"2024-08-27T03:58:30.306400+0000","last_peered":"2024-08-27T03:58:30.306400+0000","last_clean":"2024-08-27T03:58:30.306400+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:30.306400+0000","last_undegraded":"2024-08-27T03:58:30.306400+0000","last_fullsized":"2024-08-27T03:58:30.306400+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:56.441080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750723,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":787,"num_read_kb":13511,"num_write":1080,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'5","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727332+0000","last_change":"2024-08-27T02:31:08.472147+0000","last_active":"2024-08-27T03:58:28.727332+0000","last_peered":"2024-08-27T03:58:28.727332+0000","last_clean":"2024-08-27T03:58:28.727332+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:28.727332+0000","last_undegraded":"2024-08-27T03:58:28.727332+0000","last_fullsized":"2024-08-27T03:58:28.727332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:05:58.557262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1334","reported_seq":3319,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.067019+0000","last_change":"2024-08-27T02:31:10.466706+0000","last_active":"2024-08-27T03:58:31.067019+0000","last_peered":"2024-08-27T03:58:31.067019+0000","last_clean":"2024-08-27T03:58:31.067019+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:31.067019+0000","last_undegraded":"2024-08-27T03:58:31.067019+0000","last_fullsized":"2024-08-27T03:58:31.067019+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:35.321692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145784,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2069,"num_read_kb":3907,"num_write":1257,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:55.287626+0000","last_change":"2024-08-27T02:31:12.508877+0000","last_active":"2024-08-27T03:54:55.287626+0000","last_peered":"2024-08-27T03:54:55.287626+0000","last_clean":"2024-08-27T03:54:55.287626+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:54:55.287626+0000","last_undegraded":"2024-08-27T03:54:55.287626+0000","last_fullsized":"2024-08-27T03:54:55.287626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:12.131410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'164","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929974+0000","last_change":"2024-08-27T02:31:15.023823+0000","last_active":"2024-08-27T03:58:03.929974+0000","last_peered":"2024-08-27T03:58:03.929974+0000","last_clean":"2024-08-27T03:58:03.929974+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:58:03.929974+0000","last_undegraded":"2024-08-27T03:58:03.929974+0000","last_fullsized":"2024-08-27T03:58:03.929974+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:40:47.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079130+0000","last_change":"2024-08-27T02:31:39.754692+0000","last_active":"2024-08-27T03:56:10.079130+0000","last_peered":"2024-08-27T03:56:10.079130+0000","last_clean":"2024-08-27T03:56:10.079130+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:56:10.079130+0000","last_undegraded":"2024-08-27T03:56:10.079130+0000","last_fullsized":"2024-08-27T03:56:10.079130+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:08:56.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:20.081115+0000","last_change":"2024-08-27T02:30:54.225706+0000","last_active":"2024-08-27T03:56:20.081115+0000","last_peered":"2024-08-27T03:56:20.081115+0000","last_clean":"2024-08-27T03:56:20.081115+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:56:20.081115+0000","last_undegraded":"2024-08-27T03:56:20.081115+0000","last_fullsized":"2024-08-27T03:56:20.081115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'379","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.074267+0000","last_change":"2024-08-27T02:31:04.461095+0000","last_active":"2024-08-27T03:58:31.074267+0000","last_peered":"2024-08-27T03:58:31.074267+0000","last_clean":"2024-08-27T03:58:31.074267+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:31.074267+0000","last_undegraded":"2024-08-27T03:58:31.074267+0000","last_fullsized":"2024-08-27T03:58:31.074267+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:26:18.748313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6616429,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":642,"num_read_kb":29599,"num_write":1249,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072448+0000","last_change":"2024-08-27T02:31:08.479508+0000","last_active":"2024-08-27T03:55:40.072448+0000","last_peered":"2024-08-27T03:55:40.072448+0000","last_clean":"2024-08-27T03:55:40.072448+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:55:40.072448+0000","last_undegraded":"2024-08-27T03:55:40.072448+0000","last_fullsized":"2024-08-27T03:55:40.072448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:21.994771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'327","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.502580+0000","last_change":"2024-08-27T02:31:10.637428+0000","last_active":"2024-08-27T03:58:03.502580+0000","last_peered":"2024-08-27T03:58:03.502580+0000","last_clean":"2024-08-27T03:58:03.502580+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:03.502580+0000","last_undegraded":"2024-08-27T03:58:03.502580+0000","last_fullsized":"2024-08-27T03:58:03.502580+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:29.250940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.496951+0000","last_change":"2024-08-27T02:31:12.518266+0000","last_active":"2024-08-27T03:54:35.496951+0000","last_peered":"2024-08-27T03:54:35.496951+0000","last_clean":"2024-08-27T03:54:35.496951+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:54:35.496951+0000","last_undegraded":"2024-08-27T03:54:35.496951+0000","last_fullsized":"2024-08-27T03:54:35.496951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:31:54.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'259","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.909802+0000","last_change":"2024-08-27T02:31:14.514321+0000","last_active":"2024-08-27T03:56:44.909802+0000","last_peered":"2024-08-27T03:56:44.909802+0000","last_clean":"2024-08-27T03:56:44.909802+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:56:44.909802+0000","last_undegraded":"2024-08-27T03:56:44.909802+0000","last_fullsized":"2024-08-27T03:56:44.909802+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:43:02.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.620203+0000","last_change":"2024-08-27T02:31:06.453284+0000","last_active":"2024-08-27T03:56:42.620203+0000","last_peered":"2024-08-27T03:56:42.620203+0000","last_clean":"2024-08-27T03:56:42.620203+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:56:42.620203+0000","last_undegraded":"2024-08-27T03:56:42.620203+0000","last_fullsized":"2024-08-27T03:56:42.620203+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:06:48.027363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884076+0000","last_change":"2024-08-27T02:30:54.233089+0000","last_active":"2024-08-27T03:56:19.884076+0000","last_peered":"2024-08-27T03:56:19.884076+0000","last_clean":"2024-08-27T03:56:19.884076+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:56:19.884076+0000","last_undegraded":"2024-08-27T03:56:19.884076+0000","last_fullsized":"2024-08-27T03:56:19.884076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'298","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.952485+0000","last_change":"2024-08-27T02:31:04.451624+0000","last_active":"2024-08-27T03:58:29.952485+0000","last_peered":"2024-08-27T03:58:29.952485+0000","last_clean":"2024-08-27T03:58:29.952485+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:29.952485+0000","last_undegraded":"2024-08-27T03:58:29.952485+0000","last_fullsized":"2024-08-27T03:58:29.952485+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:25:39.692713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5774713,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":378,"num_read_kb":9569,"num_write":1035,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498104+0000","last_change":"2024-08-27T02:31:08.469937+0000","last_active":"2024-08-27T03:54:40.498104+0000","last_peered":"2024-08-27T03:54:40.498104+0000","last_clean":"2024-08-27T03:54:40.498104+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:54:40.498104+0000","last_undegraded":"2024-08-27T03:54:40.498104+0000","last_fullsized":"2024-08-27T03:54:40.498104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:03.713631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'172","reported_seq":758,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:01.706772+0000","last_change":"2024-08-27T02:31:10.467429+0000","last_active":"2024-08-27T03:58:01.706772+0000","last_peered":"2024-08-27T03:58:01.706772+0000","last_clean":"2024-08-27T03:58:01.706772+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:58:01.706772+0000","last_undegraded":"2024-08-27T03:58:01.706772+0000","last_fullsized":"2024-08-27T03:58:01.706772+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.607849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.456113+0000","last_change":"2024-08-27T02:31:12.523339+0000","last_active":"2024-08-27T03:55:45.456113+0000","last_peered":"2024-08-27T03:55:45.456113+0000","last_clean":"2024-08-27T03:55:45.456113+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:55:45.456113+0000","last_undegraded":"2024-08-27T03:55:45.456113+0000","last_fullsized":"2024-08-27T03:55:45.456113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:50:38.396815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875506+0000","last_change":"2024-08-27T02:31:14.502543+0000","last_active":"2024-08-27T03:55:44.875506+0000","last_peered":"2024-08-27T03:55:44.875506+0000","last_clean":"2024-08-27T03:55:44.875506+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:55:44.875506+0000","last_undegraded":"2024-08-27T03:55:44.875506+0000","last_fullsized":"2024-08-27T03:55:44.875506+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:40:33.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1261","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:26.057489+0000","last_change":"2024-08-27T02:31:06.436150+0000","last_active":"2024-08-27T03:54:26.057489+0000","last_peered":"2024-08-27T03:54:26.057489+0000","last_clean":"2024-08-27T03:54:26.057489+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:54:26.057489+0000","last_undegraded":"2024-08-27T03:54:26.057489+0000","last_fullsized":"2024-08-27T03:54:26.057489+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:19:53.560315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'294","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.829572+0000","last_change":"2024-08-27T02:31:04.450049+0000","last_active":"2024-08-27T03:58:29.829572+0000","last_peered":"2024-08-27T03:58:29.829572+0000","last_clean":"2024-08-27T03:58:29.829572+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:29.829572+0000","last_undegraded":"2024-08-27T03:58:29.829572+0000","last_fullsized":"2024-08-27T03:58:29.829572+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:23:00.868698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55139,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":426,"num_read_kb":946,"num_write":1062,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:21.083627+0000","last_change":"2024-08-27T02:30:54.235714+0000","last_active":"2024-08-27T03:56:21.083627+0000","last_peered":"2024-08-27T03:56:21.083627+0000","last_clean":"2024-08-27T03:56:21.083627+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:56:21.083627+0000","last_undegraded":"2024-08-27T03:56:21.083627+0000","last_fullsized":"2024-08-27T03:56:21.083627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:03:53.967353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495848+0000","last_change":"2024-08-27T02:31:08.472606+0000","last_active":"2024-08-27T03:54:30.495848+0000","last_peered":"2024-08-27T03:54:30.495848+0000","last_clean":"2024-08-27T03:54:30.495848+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:54:30.495848+0000","last_undegraded":"2024-08-27T03:54:30.495848+0000","last_fullsized":"2024-08-27T03:54:30.495848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:53.292285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'660","reported_seq":1379,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.217500+0000","last_change":"2024-08-27T02:31:10.465002+0000","last_active":"2024-08-27T03:58:29.217500+0000","last_peered":"2024-08-27T03:58:29.217500+0000","last_clean":"2024-08-27T03:58:29.217500+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:29.217500+0000","last_undegraded":"2024-08-27T03:58:29.217500+0000","last_fullsized":"2024-08-27T03:58:29.217500+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:48:12.137313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102880,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1767,"num_read_kb":2826,"num_write":2346,"num_write_kb":2122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074054+0000","last_change":"2024-08-27T02:31:12.500222+0000","last_active":"2024-08-27T03:54:35.074054+0000","last_peered":"2024-08-27T03:54:35.074054+0000","last_clean":"2024-08-27T03:54:35.074054+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:54:35.074054+0000","last_undegraded":"2024-08-27T03:54:35.074054+0000","last_fullsized":"2024-08-27T03:54:35.074054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:27:56.971452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'145","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.589165+0000","last_change":"2024-08-27T02:31:15.026476+0000","last_active":"2024-08-27T03:56:38.589165+0000","last_peered":"2024-08-27T03:56:38.589165+0000","last_clean":"2024-08-27T03:56:38.589165+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:56:38.589165+0000","last_undegraded":"2024-08-27T03:56:38.589165+0000","last_fullsized":"2024-08-27T03:56:38.589165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:06.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'759","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495829+0000","last_change":"2024-08-27T02:31:06.443554+0000","last_active":"2024-08-27T03:54:30.495829+0000","last_peered":"2024-08-27T03:54:30.495829+0000","last_clean":"2024-08-27T03:54:30.495829+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:54:30.495829+0000","last_undegraded":"2024-08-27T03:54:30.495829+0000","last_fullsized":"2024-08-27T03:54:30.495829+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:41.381628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'351","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.061321+0000","last_change":"2024-08-27T02:31:04.460588+0000","last_active":"2024-08-27T03:58:31.061321+0000","last_peered":"2024-08-27T03:58:31.061321+0000","last_clean":"2024-08-27T03:58:31.061321+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:31.061321+0000","last_undegraded":"2024-08-27T03:58:31.061321+0000","last_fullsized":"2024-08-27T03:58:31.061321+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:03:48.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255012,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":601,"num_read_kb":96021,"num_write":1165,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.282226+0000","last_change":"2024-08-27T02:30:54.329145+0000","last_active":"2024-08-27T03:54:35.282226+0000","last_peered":"2024-08-27T03:54:35.282226+0000","last_clean":"2024-08-27T03:54:35.282226+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:54:35.282226+0000","last_undegraded":"2024-08-27T03:54:35.282226+0000","last_fullsized":"2024-08-27T03:54:35.282226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:09:53.126738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439720+0000","last_change":"2024-08-27T02:31:08.465815+0000","last_active":"2024-08-27T03:54:30.439720+0000","last_peered":"2024-08-27T03:54:30.439720+0000","last_clean":"2024-08-27T03:54:30.439720+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:54:30.439720+0000","last_undegraded":"2024-08-27T03:54:30.439720+0000","last_fullsized":"2024-08-27T03:54:30.439720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:07:29.803901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'213","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058735+0000","last_change":"2024-08-27T02:31:10.635979+0000","last_active":"2024-08-27T03:54:31.058735+0000","last_peered":"2024-08-27T03:54:31.058735+0000","last_clean":"2024-08-27T03:54:31.058735+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:54:31.058735+0000","last_undegraded":"2024-08-27T03:54:31.058735+0000","last_fullsized":"2024-08-27T03:54:31.058735+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:42.747005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'718","reported_seq":2957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.985171+0000","last_change":"2024-08-27T02:31:12.507006+0000","last_active":"2024-08-27T03:58:28.985171+0000","last_peered":"2024-08-27T03:58:28.985171+0000","last_clean":"2024-08-27T03:58:28.985171+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:58:28.985171+0000","last_undegraded":"2024-08-27T03:58:28.985171+0000","last_fullsized":"2024-08-27T03:58:28.985171+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:59.445792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:09.915872+0000","last_change":"2024-08-27T02:31:15.023353+0000","last_active":"2024-08-27T03:57:09.915872+0000","last_peered":"2024-08-27T03:57:09.915872+0000","last_clean":"2024-08-27T03:57:09.915872+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:57:09.915872+0000","last_undegraded":"2024-08-27T03:57:09.915872+0000","last_fullsized":"2024-08-27T03:57:09.915872+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:35:33.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'409","reported_seq":1935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891884+0000","last_change":"2024-08-27T02:31:06.459269+0000","last_active":"2024-08-27T03:55:34.891884+0000","last_peered":"2024-08-27T03:55:34.891884+0000","last_clean":"2024-08-27T03:55:34.891884+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:55:34.891884+0000","last_undegraded":"2024-08-27T03:55:34.891884+0000","last_fullsized":"2024-08-27T03:55:34.891884+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.224368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'287","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.926929+0000","last_change":"2024-08-27T02:31:04.477646+0000","last_active":"2024-08-27T03:58:29.926929+0000","last_peered":"2024-08-27T03:58:29.926929+0000","last_clean":"2024-08-27T03:58:29.926929+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:29.926929+0000","last_undegraded":"2024-08-27T03:58:29.926929+0000","last_fullsized":"2024-08-27T03:58:29.926929+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:45.643961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114302,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":459,"num_read_kb":4604,"num_write":975,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070645+0000","last_change":"2024-08-27T02:30:54.235830+0000","last_active":"2024-08-27T03:55:26.070645+0000","last_peered":"2024-08-27T03:55:26.070645+0000","last_clean":"2024-08-27T03:55:26.070645+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:55:26.070645+0000","last_undegraded":"2024-08-27T03:55:26.070645+0000","last_fullsized":"2024-08-27T03:55:26.070645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:16.134185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072798+0000","last_change":"2024-08-27T02:31:08.458894+0000","last_active":"2024-08-27T03:54:30.072798+0000","last_peered":"2024-08-27T03:54:30.072798+0000","last_clean":"2024-08-27T03:54:30.072798+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:54:30.072798+0000","last_undegraded":"2024-08-27T03:54:30.072798+0000","last_fullsized":"2024-08-27T03:54:30.072798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:30.416824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'160","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072928+0000","last_change":"2024-08-27T02:31:10.461453+0000","last_active":"2024-08-27T03:54:30.072928+0000","last_peered":"2024-08-27T03:54:30.072928+0000","last_clean":"2024-08-27T03:54:30.072928+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:54:30.072928+0000","last_undegraded":"2024-08-27T03:54:30.072928+0000","last_fullsized":"2024-08-27T03:54:30.072928+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:13.247299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'729","reported_seq":4712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.995663+0000","last_change":"2024-08-27T02:31:12.506051+0000","last_active":"2024-08-27T03:58:28.995663+0000","last_peered":"2024-08-27T03:58:28.995663+0000","last_clean":"2024-08-27T03:58:28.995663+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:58:28.995663+0000","last_undegraded":"2024-08-27T03:58:28.995663+0000","last_fullsized":"2024-08-27T03:58:28.995663+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:23:19.155039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'206","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.485251+0000","last_change":"2024-08-27T02:31:14.511228+0000","last_active":"2024-08-27T03:56:44.485251+0000","last_peered":"2024-08-27T03:56:44.485251+0000","last_clean":"2024-08-27T03:56:44.485251+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:56:44.485251+0000","last_undegraded":"2024-08-27T03:56:44.485251+0000","last_fullsized":"2024-08-27T03:56:44.485251+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:49:37.070870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'395","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217585+0000","last_change":"2024-08-27T02:31:06.439611+0000","last_active":"2024-08-27T03:55:54.217585+0000","last_peered":"2024-08-27T03:55:54.217585+0000","last_clean":"2024-08-27T03:55:54.217585+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:55:54.217585+0000","last_undegraded":"2024-08-27T03:55:54.217585+0000","last_fullsized":"2024-08-27T03:55:54.217585+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:00:53.658025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'311","reported_seq":967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.136785+0000","last_change":"2024-08-27T02:31:04.493690+0000","last_active":"2024-08-27T03:58:30.136785+0000","last_peered":"2024-08-27T03:58:30.136785+0000","last_clean":"2024-08-27T03:58:30.136785+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:30.136785+0000","last_undegraded":"2024-08-27T03:58:30.136785+0000","last_fullsized":"2024-08-27T03:58:30.136785+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:56.655781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2081743,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":421,"num_read_kb":35253,"num_write":1065,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.451652+0000","last_change":"2024-08-27T02:30:54.326308+0000","last_active":"2024-08-27T03:55:25.451652+0000","last_peered":"2024-08-27T03:55:25.451652+0000","last_clean":"2024-08-27T03:55:25.451652+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:55:25.451652+0000","last_undegraded":"2024-08-27T03:55:25.451652+0000","last_fullsized":"2024-08-27T03:55:25.451652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:39.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891808+0000","last_change":"2024-08-27T02:31:08.470557+0000","last_active":"2024-08-27T03:55:34.891808+0000","last_peered":"2024-08-27T03:55:34.891808+0000","last_clean":"2024-08-27T03:55:34.891808+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:55:34.891808+0000","last_undegraded":"2024-08-27T03:55:34.891808+0000","last_fullsized":"2024-08-27T03:55:34.891808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:16.200643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'793","reported_seq":1544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.184483+0000","last_change":"2024-08-27T02:31:10.635066+0000","last_active":"2024-08-27T03:58:30.184483+0000","last_peered":"2024-08-27T03:58:30.184483+0000","last_clean":"2024-08-27T03:58:30.184483+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:30.184483+0000","last_undegraded":"2024-08-27T03:58:30.184483+0000","last_fullsized":"2024-08-27T03:58:30.184483+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:14:49.402084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1403,"num_read_kb":3271,"num_write":1144,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:34.872717+0000","last_change":"2024-08-27T02:31:12.504645+0000","last_active":"2024-08-27T03:54:34.872717+0000","last_peered":"2024-08-27T03:54:34.872717+0000","last_clean":"2024-08-27T03:54:34.872717+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:54:34.872717+0000","last_undegraded":"2024-08-27T03:54:34.872717+0000","last_fullsized":"2024-08-27T03:54:34.872717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:57.439347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858183+0000","last_change":"2024-08-27T02:31:14.522454+0000","last_active":"2024-08-27T03:54:29.858183+0000","last_peered":"2024-08-27T03:54:29.858183+0000","last_clean":"2024-08-27T03:54:29.858183+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:54:29.858183+0000","last_undegraded":"2024-08-27T03:54:29.858183+0000","last_fullsized":"2024-08-27T03:54:29.858183+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:07.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'163","reported_seq":747,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.991063+0000","last_change":"2024-08-27T02:31:14.511332+0000","last_active":"2024-08-27T03:56:42.991063+0000","last_peered":"2024-08-27T03:56:42.991063+0000","last_clean":"2024-08-27T03:56:42.991063+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:56:42.991063+0000","last_undegraded":"2024-08-27T03:56:42.991063+0000","last_fullsized":"2024-08-27T03:56:42.991063+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:05:01.793333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'935","reported_seq":2440,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677370+0000","last_change":"2024-08-27T02:31:06.457663+0000","last_active":"2024-08-27T03:56:42.677370+0000","last_peered":"2024-08-27T03:56:42.677370+0000","last_clean":"2024-08-27T03:56:42.677370+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:56:42.677370+0000","last_undegraded":"2024-08-27T03:56:42.677370+0000","last_fullsized":"2024-08-27T03:56:42.677370+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:41.288217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'338","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.023357+0000","last_change":"2024-08-27T02:31:04.463717+0000","last_active":"2024-08-27T03:58:30.023357+0000","last_peered":"2024-08-27T03:58:30.023357+0000","last_clean":"2024-08-27T03:58:30.023357+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:30.023357+0000","last_undegraded":"2024-08-27T03:58:30.023357+0000","last_fullsized":"2024-08-27T03:58:30.023357+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:55:39.806434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263718,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":571,"num_read_kb":506,"num_write":1104,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:11.067136+0000","last_change":"2024-08-27T02:31:08.470840+0000","last_active":"2024-08-27T03:55:11.067136+0000","last_peered":"2024-08-27T03:55:11.067136+0000","last_clean":"2024-08-27T03:55:11.067136+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:55:11.067136+0000","last_undegraded":"2024-08-27T03:55:11.067136+0000","last_fullsized":"2024-08-27T03:55:11.067136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:02.714442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'277","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.899420+0000","last_change":"2024-08-27T02:31:10.463641+0000","last_active":"2024-08-27T03:58:03.899420+0000","last_peered":"2024-08-27T03:58:03.899420+0000","last_clean":"2024-08-27T03:58:03.899420+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:58:03.899420+0000","last_undegraded":"2024-08-27T03:58:03.899420+0000","last_fullsized":"2024-08-27T03:58:03.899420+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:35:43.609652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":874,"num_write":346,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.886578+0000","last_change":"2024-08-27T02:31:12.505279+0000","last_active":"2024-08-27T03:55:14.886578+0000","last_peered":"2024-08-27T03:55:14.886578+0000","last_clean":"2024-08-27T03:55:14.886578+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:55:14.886578+0000","last_undegraded":"2024-08-27T03:55:14.886578+0000","last_fullsized":"2024-08-27T03:55:14.886578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:41.364605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.893070+0000","last_change":"2024-08-27T02:31:14.521163+0000","last_active":"2024-08-27T03:55:39.893070+0000","last_peered":"2024-08-27T03:55:39.893070+0000","last_clean":"2024-08-27T03:55:39.893070+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:55:39.893070+0000","last_undegraded":"2024-08-27T03:55:39.893070+0000","last_fullsized":"2024-08-27T03:55:39.893070+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:59:46.536741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'377","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065840+0000","last_change":"2024-08-27T02:31:06.474269+0000","last_active":"2024-08-27T03:55:06.065840+0000","last_peered":"2024-08-27T03:55:06.065840+0000","last_clean":"2024-08-27T03:55:06.065840+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:55:06.065840+0000","last_undegraded":"2024-08-27T03:55:06.065840+0000","last_fullsized":"2024-08-27T03:55:06.065840+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:31:44.710331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'288","reported_seq":895,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.148282+0000","last_change":"2024-08-27T02:31:04.501132+0000","last_active":"2024-08-27T03:58:30.148282+0000","last_peered":"2024-08-27T03:58:30.148282+0000","last_clean":"2024-08-27T03:58:30.148282+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:30.148282+0000","last_undegraded":"2024-08-27T03:58:30.148282+0000","last_fullsized":"2024-08-27T03:58:30.148282+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:51.438866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31307,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":399,"num_read_kb":2061,"num_write":936,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.885122+0000","last_change":"2024-08-27T02:31:08.461957+0000","last_active":"2024-08-27T03:55:09.885122+0000","last_peered":"2024-08-27T03:55:09.885122+0000","last_clean":"2024-08-27T03:55:09.885122+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:55:09.885122+0000","last_undegraded":"2024-08-27T03:55:09.885122+0000","last_fullsized":"2024-08-27T03:55:09.885122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:42.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'55","reported_seq":585,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.285806+0000","last_change":"2024-08-27T02:31:10.464843+0000","last_active":"2024-08-27T03:55:10.285806+0000","last_peered":"2024-08-27T03:55:10.285806+0000","last_clean":"2024-08-27T03:55:10.285806+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:55:10.285806+0000","last_undegraded":"2024-08-27T03:55:10.285806+0000","last_fullsized":"2024-08-27T03:55:10.285806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:47:45.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292286+0000","last_change":"2024-08-27T02:31:12.506193+0000","last_active":"2024-08-27T03:55:15.292286+0000","last_peered":"2024-08-27T03:55:15.292286+0000","last_clean":"2024-08-27T03:55:15.292286+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:55:15.292286+0000","last_undegraded":"2024-08-27T03:55:15.292286+0000","last_fullsized":"2024-08-27T03:55:15.292286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:31:44.393834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'182","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.584739+0000","last_change":"2024-08-27T02:31:14.517907+0000","last_active":"2024-08-27T03:56:42.584739+0000","last_peered":"2024-08-27T03:56:42.584739+0000","last_clean":"2024-08-27T03:56:42.584739+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:56:42.584739+0000","last_undegraded":"2024-08-27T03:56:42.584739+0000","last_fullsized":"2024-08-27T03:56:42.584739+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:28.044838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'411","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.884819+0000","last_change":"2024-08-27T02:31:06.459463+0000","last_active":"2024-08-27T03:55:09.884819+0000","last_peered":"2024-08-27T03:55:09.884819+0000","last_clean":"2024-08-27T03:55:09.884819+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:55:09.884819+0000","last_undegraded":"2024-08-27T03:55:09.884819+0000","last_fullsized":"2024-08-27T03:55:09.884819+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:50:28.320442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'282","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.834385+0000","last_change":"2024-08-27T02:31:04.477014+0000","last_active":"2024-08-27T03:58:29.834385+0000","last_peered":"2024-08-27T03:58:29.834385+0000","last_clean":"2024-08-27T03:58:29.834385+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:29.834385+0000","last_undegraded":"2024-08-27T03:58:29.834385+0000","last_fullsized":"2024-08-27T03:58:29.834385+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:53:15.700336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11011652,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":411,"num_read_kb":30350,"num_write":983,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290942+0000","last_change":"2024-08-27T02:31:08.450903+0000","last_active":"2024-08-27T03:55:10.290942+0000","last_peered":"2024-08-27T03:55:10.290942+0000","last_clean":"2024-08-27T03:55:10.290942+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:55:10.290942+0000","last_undegraded":"2024-08-27T03:55:10.290942+0000","last_fullsized":"2024-08-27T03:55:10.290942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:21.462233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'337","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.871493+0000","last_change":"2024-08-27T02:31:10.467565+0000","last_active":"2024-08-27T03:58:03.871493+0000","last_peered":"2024-08-27T03:58:03.871493+0000","last_clean":"2024-08-27T03:58:03.871493+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:58:03.871493+0000","last_undegraded":"2024-08-27T03:58:03.871493+0000","last_fullsized":"2024-08-27T03:58:03.871493+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:04:40.132706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60998,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":557,"num_read_kb":1116,"num_write":444,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449445+0000","last_change":"2024-08-27T02:31:12.502528+0000","last_active":"2024-08-27T03:55:15.449445+0000","last_peered":"2024-08-27T03:55:15.449445+0000","last_clean":"2024-08-27T03:55:15.449445+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:55:15.449445+0000","last_undegraded":"2024-08-27T03:55:15.449445+0000","last_fullsized":"2024-08-27T03:55:15.449445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:14.781588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'114","reported_seq":626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847662+0000","last_change":"2024-08-27T02:31:14.521917+0000","last_active":"2024-08-27T03:53:44.847662+0000","last_peered":"2024-08-27T03:53:44.847662+0000","last_clean":"2024-08-27T03:53:44.847662+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:53:44.847662+0000","last_undegraded":"2024-08-27T03:53:44.847662+0000","last_fullsized":"2024-08-27T03:53:44.847662+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:08:19.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'418","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.908107+0000","last_change":"2024-08-27T02:31:06.451606+0000","last_active":"2024-08-27T03:58:02.908107+0000","last_peered":"2024-08-27T03:58:02.908107+0000","last_clean":"2024-08-27T03:58:02.908107+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:02.908107+0000","last_undegraded":"2024-08-27T03:58:02.908107+0000","last_fullsized":"2024-08-27T03:58:02.908107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:09:38.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'298","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.010900+0000","last_change":"2024-08-27T02:31:04.453573+0000","last_active":"2024-08-27T03:58:30.010900+0000","last_peered":"2024-08-27T03:58:30.010900+0000","last_clean":"2024-08-27T03:58:30.010900+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:30.010900+0000","last_undegraded":"2024-08-27T03:58:30.010900+0000","last_fullsized":"2024-08-27T03:58:30.010900+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:04.196182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1025086,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":416,"num_read_kb":16403,"num_write":1095,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.448286+0000","last_change":"2024-08-27T02:31:08.465448+0000","last_active":"2024-08-27T03:55:10.448286+0000","last_peered":"2024-08-27T03:55:10.448286+0000","last_clean":"2024-08-27T03:55:10.448286+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:55:10.448286+0000","last_undegraded":"2024-08-27T03:55:10.448286+0000","last_fullsized":"2024-08-27T03:55:10.448286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:16:51.893136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'281","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.033952+0000","last_change":"2024-08-27T02:31:10.476895+0000","last_active":"2024-08-27T03:58:30.033952+0000","last_peered":"2024-08-27T03:58:30.033952+0000","last_clean":"2024-08-27T03:58:30.033952+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:58:30.033952+0000","last_undegraded":"2024-08-27T03:58:30.033952+0000","last_fullsized":"2024-08-27T03:58:30.033952+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:34:48.785917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287158+0000","last_change":"2024-08-27T02:31:12.521407+0000","last_active":"2024-08-27T03:55:15.287158+0000","last_peered":"2024-08-27T03:55:15.287158+0000","last_clean":"2024-08-27T03:55:15.287158+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:55:15.287158+0000","last_undegraded":"2024-08-27T03:55:15.287158+0000","last_fullsized":"2024-08-27T03:55:15.287158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:41:44.290066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'836","reported_seq":2411,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215749+0000","last_change":"2024-08-27T02:31:06.459141+0000","last_active":"2024-08-27T03:55:54.215749+0000","last_peered":"2024-08-27T03:55:54.215749+0000","last_clean":"2024-08-27T03:55:54.215749+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:55:54.215749+0000","last_undegraded":"2024-08-27T03:55:54.215749+0000","last_fullsized":"2024-08-27T03:55:54.215749+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:38:51.610195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'373","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.886416+0000","last_change":"2024-08-27T02:31:04.437260+0000","last_active":"2024-08-27T03:58:29.886416+0000","last_peered":"2024-08-27T03:58:29.886416+0000","last_clean":"2024-08-27T03:58:29.886416+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:29.886416+0000","last_undegraded":"2024-08-27T03:58:29.886416+0000","last_fullsized":"2024-08-27T03:58:29.886416+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:58.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130642,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":717,"num_read_kb":11072,"num_write":1329,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.289681+0000","last_change":"2024-08-27T02:31:08.460233+0000","last_active":"2024-08-27T03:55:25.289681+0000","last_peered":"2024-08-27T03:55:25.289681+0000","last_clean":"2024-08-27T03:55:25.289681+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:55:25.289681+0000","last_undegraded":"2024-08-27T03:55:25.289681+0000","last_fullsized":"2024-08-27T03:55:25.289681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:26.664269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'547","reported_seq":1203,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.953613+0000","last_change":"2024-08-27T02:31:10.471987+0000","last_active":"2024-08-27T03:58:29.953613+0000","last_peered":"2024-08-27T03:58:29.953613+0000","last_clean":"2024-08-27T03:58:29.953613+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:29.953613+0000","last_undegraded":"2024-08-27T03:58:29.953613+0000","last_fullsized":"2024-08-27T03:58:29.953613+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:10:16.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":977,"num_read_kb":2264,"num_write":852,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847691+0000","last_change":"2024-08-27T02:31:12.513046+0000","last_active":"2024-08-27T03:53:44.847691+0000","last_peered":"2024-08-27T03:53:44.847691+0000","last_clean":"2024-08-27T03:53:44.847691+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:53:44.847691+0000","last_undegraded":"2024-08-27T03:53:44.847691+0000","last_fullsized":"2024-08-27T03:53:44.847691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:14.240422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'140","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.320188+0000","last_change":"2024-08-27T02:31:15.026496+0000","last_active":"2024-08-27T03:56:39.320188+0000","last_peered":"2024-08-27T03:56:39.320188+0000","last_clean":"2024-08-27T03:56:39.320188+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:56:39.320188+0000","last_undegraded":"2024-08-27T03:56:39.320188+0000","last_fullsized":"2024-08-27T03:56:39.320188+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:25.778670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1179","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.212577+0000","last_change":"2024-08-27T02:31:06.444819+0000","last_active":"2024-08-27T03:55:54.212577+0000","last_peered":"2024-08-27T03:55:54.212577+0000","last_clean":"2024-08-27T03:55:54.212577+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:55:54.212577+0000","last_undegraded":"2024-08-27T03:55:54.212577+0000","last_fullsized":"2024-08-27T03:55:54.212577+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:12.874709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'328","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.080251+0000","last_change":"2024-08-27T02:31:04.452002+0000","last_active":"2024-08-27T03:58:31.080251+0000","last_peered":"2024-08-27T03:58:31.080251+0000","last_clean":"2024-08-27T03:58:31.080251+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:31.080251+0000","last_undegraded":"2024-08-27T03:58:31.080251+0000","last_fullsized":"2024-08-27T03:58:31.080251+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:54.064616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5598635,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":512,"num_read_kb":41676,"num_write":1072,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439838+0000","last_change":"2024-08-27T02:31:08.468006+0000","last_active":"2024-08-27T03:54:30.439838+0000","last_peered":"2024-08-27T03:54:30.439838+0000","last_clean":"2024-08-27T03:54:30.439838+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:54:30.439838+0000","last_undegraded":"2024-08-27T03:54:30.439838+0000","last_fullsized":"2024-08-27T03:54:30.439838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:40:17.372181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'350","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.104104+0000","last_change":"2024-08-27T02:31:10.477408+0000","last_active":"2024-08-27T03:58:30.104104+0000","last_peered":"2024-08-27T03:58:30.104104+0000","last_clean":"2024-08-27T03:58:30.104104+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:58:30.104104+0000","last_undegraded":"2024-08-27T03:58:30.104104+0000","last_fullsized":"2024-08-27T03:58:30.104104+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:59:29.617560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:46.048972+0000","last_change":"2024-08-27T02:31:12.493945+0000","last_active":"2024-08-27T03:53:46.048972+0000","last_peered":"2024-08-27T03:53:46.048972+0000","last_clean":"2024-08-27T03:53:46.048972+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:53:46.048972+0000","last_undegraded":"2024-08-27T03:53:46.048972+0000","last_fullsized":"2024-08-27T03:53:46.048972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449386+0000","last_change":"2024-08-27T02:31:14.521472+0000","last_active":"2024-08-27T03:55:15.449386+0000","last_peered":"2024-08-27T03:55:15.449386+0000","last_clean":"2024-08-27T03:55:15.449386+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:55:15.449386+0000","last_undegraded":"2024-08-27T03:55:15.449386+0000","last_fullsized":"2024-08-27T03:55:15.449386+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:13.751034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'696","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.472769+0000","last_change":"2024-08-27T02:31:06.446538+0000","last_active":"2024-08-27T03:56:44.472769+0000","last_peered":"2024-08-27T03:56:44.472769+0000","last_clean":"2024-08-27T03:56:44.472769+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:56:44.472769+0000","last_undegraded":"2024-08-27T03:56:44.472769+0000","last_fullsized":"2024-08-27T03:56:44.472769+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:59:31.607194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'296","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.096874+0000","last_change":"2024-08-27T02:31:04.486015+0000","last_active":"2024-08-27T03:58:30.096874+0000","last_peered":"2024-08-27T03:58:30.096874+0000","last_clean":"2024-08-27T03:58:30.096874+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:30.096874+0000","last_undegraded":"2024-08-27T03:58:30.096874+0000","last_fullsized":"2024-08-27T03:58:30.096874+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:24.013613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5264007,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":435,"num_read_kb":27839,"num_write":1080,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.061200+0000","last_change":"2024-08-27T02:31:08.461902+0000","last_active":"2024-08-27T03:53:40.061200+0000","last_peered":"2024-08-27T03:53:40.061200+0000","last_clean":"2024-08-27T03:53:40.061200+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:53:40.061200+0000","last_undegraded":"2024-08-27T03:53:40.061200+0000","last_fullsized":"2024-08-27T03:53:40.061200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:54:08.973943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'319","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.910261+0000","last_change":"2024-08-27T02:31:10.636027+0000","last_active":"2024-08-27T03:58:03.910261+0000","last_peered":"2024-08-27T03:58:03.910261+0000","last_clean":"2024-08-27T03:58:03.910261+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:58:03.910261+0000","last_undegraded":"2024-08-27T03:58:03.910261+0000","last_fullsized":"2024-08-27T03:58:03.910261+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:09:14.223534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79082,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":1091,"num_write":420,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:31.071793+0000","last_change":"2024-08-27T02:31:12.498318+0000","last_active":"2024-08-27T03:55:31.071793+0000","last_peered":"2024-08-27T03:55:31.071793+0000","last_clean":"2024-08-27T03:55:31.071793+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:55:31.071793+0000","last_undegraded":"2024-08-27T03:55:31.071793+0000","last_fullsized":"2024-08-27T03:55:31.071793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:41.474651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.928313+0000","last_change":"2024-08-27T02:31:14.521960+0000","last_active":"2024-08-27T03:58:03.928313+0000","last_peered":"2024-08-27T03:58:03.928313+0000","last_clean":"2024-08-27T03:58:03.928313+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:58:03.928313+0000","last_undegraded":"2024-08-27T03:58:03.928313+0000","last_fullsized":"2024-08-27T03:58:03.928313+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:38:31.904177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'789","reported_seq":2418,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:50.098393+0000","last_change":"2024-08-27T02:31:06.453981+0000","last_active":"2024-08-27T03:53:50.098393+0000","last_peered":"2024-08-27T03:53:50.098393+0000","last_clean":"2024-08-27T03:53:50.098393+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:53:50.098393+0000","last_undegraded":"2024-08-27T03:53:50.098393+0000","last_fullsized":"2024-08-27T03:53:50.098393+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:08.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'290","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.293948+0000","last_change":"2024-08-27T02:31:04.466853+0000","last_active":"2024-08-27T03:58:30.293948+0000","last_peered":"2024-08-27T03:58:30.293948+0000","last_clean":"2024-08-27T03:58:30.293948+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:30.293948+0000","last_undegraded":"2024-08-27T03:58:30.293948+0000","last_fullsized":"2024-08-27T03:58:30.293948+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:53:03.083121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432855,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":441,"num_read_kb":2807,"num_write":1035,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:41.048008+0000","last_change":"2024-08-27T02:31:08.471391+0000","last_active":"2024-08-27T03:53:41.048008+0000","last_peered":"2024-08-27T03:53:41.048008+0000","last_clean":"2024-08-27T03:53:41.048008+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:53:41.048008+0000","last_undegraded":"2024-08-27T03:53:41.048008+0000","last_fullsized":"2024-08-27T03:53:41.048008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:57.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'131","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.086304+0000","last_change":"2024-08-27T02:31:10.635520+0000","last_active":"2024-08-27T03:55:25.086304+0000","last_peered":"2024-08-27T03:55:25.086304+0000","last_clean":"2024-08-27T03:55:25.086304+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:55:25.086304+0000","last_undegraded":"2024-08-27T03:55:25.086304+0000","last_fullsized":"2024-08-27T03:55:25.086304+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:36:27.001114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'692","reported_seq":2817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.982163+0000","last_change":"2024-08-27T02:31:12.490737+0000","last_active":"2024-08-27T03:58:28.982163+0000","last_peered":"2024-08-27T03:58:28.982163+0000","last_clean":"2024-08-27T03:58:28.982163+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:28.982163+0000","last_undegraded":"2024-08-27T03:58:28.982163+0000","last_fullsized":"2024-08-27T03:58:28.982163+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:40.803189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'112","reported_seq":615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.583823+0000","last_change":"2024-08-27T02:31:14.516613+0000","last_active":"2024-08-27T03:56:38.583823+0000","last_peered":"2024-08-27T03:56:38.583823+0000","last_clean":"2024-08-27T03:56:38.583823+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:56:38.583823+0000","last_undegraded":"2024-08-27T03:56:38.583823+0000","last_fullsized":"2024-08-27T03:56:38.583823+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:26:30.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'786","reported_seq":2382,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:02.876625+0000","last_change":"2024-08-27T02:31:06.467671+0000","last_active":"2024-08-27T03:54:02.876625+0000","last_peered":"2024-08-27T03:54:02.876625+0000","last_clean":"2024-08-27T03:54:02.876625+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:54:02.876625+0000","last_undegraded":"2024-08-27T03:54:02.876625+0000","last_fullsized":"2024-08-27T03:54:02.876625+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:18:26.329266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'259","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.905414+0000","last_change":"2024-08-27T02:31:04.463606+0000","last_active":"2024-08-27T03:58:29.905414+0000","last_peered":"2024-08-27T03:58:29.905414+0000","last_clean":"2024-08-27T03:58:29.905414+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:29.905414+0000","last_undegraded":"2024-08-27T03:58:29.905414+0000","last_fullsized":"2024-08-27T03:58:29.905414+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:15.431577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555320,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":465,"num_read_kb":12943,"num_write":951,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.268711+0000","last_change":"2024-08-27T02:31:08.447203+0000","last_active":"2024-08-27T03:53:40.268711+0000","last_peered":"2024-08-27T03:53:40.268711+0000","last_clean":"2024-08-27T03:53:40.268711+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:53:40.268711+0000","last_undegraded":"2024-08-27T03:53:40.268711+0000","last_fullsized":"2024-08-27T03:53:40.268711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:41.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'379","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.396807+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.396807+0000","last_peered":"2024-08-27T03:58:29.396807+0000","last_clean":"2024-08-27T03:58:29.396807+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:58:29.396807+0000","last_undegraded":"2024-08-27T03:58:29.396807+0000","last_fullsized":"2024-08-27T03:58:29.396807+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:12.752267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.295363+0000","last_change":"2024-08-27T02:31:12.517594+0000","last_active":"2024-08-27T03:55:50.295363+0000","last_peered":"2024-08-27T03:55:50.295363+0000","last_clean":"2024-08-27T03:55:50.295363+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:55:50.295363+0000","last_undegraded":"2024-08-27T03:55:50.295363+0000","last_fullsized":"2024-08-27T03:55:50.295363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:58:27.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'112","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.818594+0000","last_change":"2024-08-27T02:31:14.523873+0000","last_active":"2024-08-27T03:56:44.818594+0000","last_peered":"2024-08-27T03:56:44.818594+0000","last_clean":"2024-08-27T03:56:44.818594+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:56:44.818594+0000","last_undegraded":"2024-08-27T03:56:44.818594+0000","last_fullsized":"2024-08-27T03:56:44.818594+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:56.720396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'372","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:53.153842+0000","last_change":"2024-08-27T02:31:06.465894+0000","last_active":"2024-08-27T03:53:53.153842+0000","last_peered":"2024-08-27T03:53:53.153842+0000","last_clean":"2024-08-27T03:53:53.153842+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:53:53.153842+0000","last_undegraded":"2024-08-27T03:53:53.153842+0000","last_fullsized":"2024-08-27T03:53:53.153842+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:23:38.612022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'289","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.843276+0000","last_change":"2024-08-27T02:31:04.450156+0000","last_active":"2024-08-27T03:58:29.843276+0000","last_peered":"2024-08-27T03:58:29.843276+0000","last_clean":"2024-08-27T03:58:29.843276+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:29.843276+0000","last_undegraded":"2024-08-27T03:58:29.843276+0000","last_fullsized":"2024-08-27T03:58:29.843276+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:04:33.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":438,"num_read_kb":8306,"num_write":1009,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:39.846494+0000","last_change":"2024-08-27T02:31:08.463927+0000","last_active":"2024-08-27T03:53:39.846494+0000","last_peered":"2024-08-27T03:53:39.846494+0000","last_clean":"2024-08-27T03:53:39.846494+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:53:39.846494+0000","last_undegraded":"2024-08-27T03:53:39.846494+0000","last_fullsized":"2024-08-27T03:53:39.846494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:31:34.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'268","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.468339+0000","last_change":"2024-08-27T02:31:10.470453+0000","last_active":"2024-08-27T03:58:29.468339+0000","last_peered":"2024-08-27T03:58:29.468339+0000","last_clean":"2024-08-27T03:58:29.468339+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:58:29.468339+0000","last_undegraded":"2024-08-27T03:58:29.468339+0000","last_fullsized":"2024-08-27T03:58:29.468339+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:46.212245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.459171+0000","last_change":"2024-08-27T02:31:12.494052+0000","last_active":"2024-08-27T03:56:00.459171+0000","last_peered":"2024-08-27T03:56:00.459171+0000","last_clean":"2024-08-27T03:56:00.459171+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:56:00.459171+0000","last_undegraded":"2024-08-27T03:56:00.459171+0000","last_fullsized":"2024-08-27T03:56:00.459171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:24.014947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'135","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.343269+0000","last_change":"2024-08-27T02:31:15.027895+0000","last_active":"2024-08-27T03:56:39.343269+0000","last_peered":"2024-08-27T03:56:39.343269+0000","last_clean":"2024-08-27T03:56:39.343269+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:56:39.343269+0000","last_undegraded":"2024-08-27T03:56:39.343269+0000","last_fullsized":"2024-08-27T03:56:39.343269+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:31:36.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'733","reported_seq":2227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.476464+0000","last_change":"2024-08-27T02:31:06.447002+0000","last_active":"2024-08-27T03:56:44.476464+0000","last_peered":"2024-08-27T03:56:44.476464+0000","last_clean":"2024-08-27T03:56:44.476464+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:56:44.476464+0000","last_undegraded":"2024-08-27T03:56:44.476464+0000","last_fullsized":"2024-08-27T03:56:44.476464+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:04.399827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'279","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.891388+0000","last_change":"2024-08-27T02:31:04.476828+0000","last_active":"2024-08-27T03:58:29.891388+0000","last_peered":"2024-08-27T03:58:29.891388+0000","last_clean":"2024-08-27T03:58:29.891388+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:29.891388+0000","last_undegraded":"2024-08-27T03:58:29.891388+0000","last_fullsized":"2024-08-27T03:58:29.891388+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:42:38.137890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54920,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":459,"num_read_kb":19461,"num_write":1068,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090711+0000","last_change":"2024-08-27T02:31:08.468289+0000","last_active":"2024-08-27T03:55:45.090711+0000","last_peered":"2024-08-27T03:55:45.090711+0000","last_clean":"2024-08-27T03:55:45.090711+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:55:45.090711+0000","last_undegraded":"2024-08-27T03:55:45.090711+0000","last_fullsized":"2024-08-27T03:55:45.090711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:51:14.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'275","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.904700+0000","last_change":"2024-08-27T02:31:10.474659+0000","last_active":"2024-08-27T03:58:03.904700+0000","last_peered":"2024-08-27T03:58:03.904700+0000","last_clean":"2024-08-27T03:58:03.904700+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:58:03.904700+0000","last_undegraded":"2024-08-27T03:58:03.904700+0000","last_fullsized":"2024-08-27T03:58:03.904700+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:14.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62250,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":458,"num_read_kb":1041,"num_write":384,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.062348+0000","last_change":"2024-08-27T02:31:12.494960+0000","last_active":"2024-08-27T03:53:45.062348+0000","last_peered":"2024-08-27T03:53:45.062348+0000","last_clean":"2024-08-27T03:53:45.062348+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:53:45.062348+0000","last_undegraded":"2024-08-27T03:53:45.062348+0000","last_fullsized":"2024-08-27T03:53:45.062348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:23.135684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'178","reported_seq":1652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.531902+0000","last_change":"2024-08-27T02:31:14.521123+0000","last_active":"2024-08-27T03:56:38.531902+0000","last_peered":"2024-08-27T03:56:38.531902+0000","last_clean":"2024-08-27T03:56:38.531902+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:56:38.531902+0000","last_undegraded":"2024-08-27T03:56:38.531902+0000","last_fullsized":"2024-08-27T03:56:38.531902+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:15.425652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'548","reported_seq":2365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090765+0000","last_change":"2024-08-27T02:31:06.457635+0000","last_active":"2024-08-27T03:55:45.090765+0000","last_peered":"2024-08-27T03:55:45.090765+0000","last_clean":"2024-08-27T03:55:45.090765+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:55:45.090765+0000","last_undegraded":"2024-08-27T03:55:45.090765+0000","last_fullsized":"2024-08-27T03:55:45.090765+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:15:48.872076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'267","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.221760+0000","last_change":"2024-08-27T02:31:38.758741+0000","last_active":"2024-08-27T03:58:30.221760+0000","last_peered":"2024-08-27T03:58:30.221760+0000","last_clean":"2024-08-27T03:58:30.221760+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:30.221760+0000","last_undegraded":"2024-08-27T03:58:30.221760+0000","last_fullsized":"2024-08-27T03:58:30.221760+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:08.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586726,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":462,"num_read_kb":5169,"num_write":992,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:01.078719+0000","last_change":"2024-08-27T02:31:08.471579+0000","last_active":"2024-08-27T03:56:01.078719+0000","last_peered":"2024-08-27T03:56:01.078719+0000","last_clean":"2024-08-27T03:56:01.078719+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:56:01.078719+0000","last_undegraded":"2024-08-27T03:56:01.078719+0000","last_fullsized":"2024-08-27T03:56:01.078719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:24.013362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'300","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.914655+0000","last_change":"2024-08-27T02:31:10.462249+0000","last_active":"2024-08-27T03:58:03.914655+0000","last_peered":"2024-08-27T03:58:03.914655+0000","last_clean":"2024-08-27T03:58:03.914655+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:58:03.914655+0000","last_undegraded":"2024-08-27T03:58:03.914655+0000","last_fullsized":"2024-08-27T03:58:03.914655+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:52:58.552884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":928,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.486117+0000","last_change":"2024-08-27T02:31:12.523057+0000","last_active":"2024-08-27T03:53:45.486117+0000","last_peered":"2024-08-27T03:53:45.486117+0000","last_clean":"2024-08-27T03:53:45.486117+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:53:45.486117+0000","last_undegraded":"2024-08-27T03:53:45.486117+0000","last_fullsized":"2024-08-27T03:53:45.486117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:12:26.836037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'144","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.904543+0000","last_change":"2024-08-27T02:31:14.506679+0000","last_active":"2024-08-27T03:58:02.904543+0000","last_peered":"2024-08-27T03:58:02.904543+0000","last_clean":"2024-08-27T03:58:02.904543+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:58:02.904543+0000","last_undegraded":"2024-08-27T03:58:02.904543+0000","last_fullsized":"2024-08-27T03:58:02.904543+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:33.099195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'732","reported_seq":2154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073279+0000","last_change":"2024-08-27T02:31:06.469294+0000","last_active":"2024-08-27T03:55:36.073279+0000","last_peered":"2024-08-27T03:55:36.073279+0000","last_clean":"2024-08-27T03:55:36.073279+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:55:36.073279+0000","last_undegraded":"2024-08-27T03:55:36.073279+0000","last_fullsized":"2024-08-27T03:55:36.073279+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:14.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'292","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.355463+0000","last_change":"2024-08-27T02:31:04.482354+0000","last_active":"2024-08-27T03:58:30.355463+0000","last_peered":"2024-08-27T03:58:30.355463+0000","last_clean":"2024-08-27T03:58:30.355463+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:30.355463+0000","last_undegraded":"2024-08-27T03:58:30.355463+0000","last_fullsized":"2024-08-27T03:58:30.355463+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:41:12.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5309852,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":458,"num_read_kb":48183,"num_write":1046,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'437","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073216+0000","last_change":"2024-08-27T02:31:06.449966+0000","last_active":"2024-08-27T03:55:36.073216+0000","last_peered":"2024-08-27T03:55:36.073216+0000","last_clean":"2024-08-27T03:55:36.073216+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:55:36.073216+0000","last_undegraded":"2024-08-27T03:55:36.073216+0000","last_fullsized":"2024-08-27T03:55:36.073216+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:00:38.353825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'328","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.971557+0000","last_change":"2024-08-27T02:31:04.478639+0000","last_active":"2024-08-27T03:58:29.971557+0000","last_peered":"2024-08-27T03:58:29.971557+0000","last_clean":"2024-08-27T03:58:29.971557+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:29.971557+0000","last_undegraded":"2024-08-27T03:58:29.971557+0000","last_fullsized":"2024-08-27T03:58:29.971557+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:22:20.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4933358,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":495,"num_read_kb":9917,"num_write":1115,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'473","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874461+0000","last_change":"2024-08-27T02:31:06.450216+0000","last_active":"2024-08-27T03:55:39.874461+0000","last_peered":"2024-08-27T03:55:39.874461+0000","last_clean":"2024-08-27T03:55:39.874461+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:55:39.874461+0000","last_undegraded":"2024-08-27T03:55:39.874461+0000","last_fullsized":"2024-08-27T03:55:39.874461+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:14.184039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'373","reported_seq":1073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.016676+0000","last_change":"2024-08-27T02:31:38.749882+0000","last_active":"2024-08-27T03:58:30.016676+0000","last_peered":"2024-08-27T03:58:30.016676+0000","last_clean":"2024-08-27T03:58:30.016676+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:30.016676+0000","last_undegraded":"2024-08-27T03:58:30.016676+0000","last_fullsized":"2024-08-27T03:58:30.016676+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:33:03.649537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11540651,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":788,"num_read_kb":15883,"num_write":1148,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'570","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524113+0000","last_change":"2024-08-27T02:31:06.443475+0000","last_active":"2024-08-27T03:56:44.524113+0000","last_peered":"2024-08-27T03:56:44.524113+0000","last_clean":"2024-08-27T03:56:44.524113+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:56:44.524113+0000","last_undegraded":"2024-08-27T03:56:44.524113+0000","last_fullsized":"2024-08-27T03:56:44.524113+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:36:38.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'271","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.305882+0000","last_change":"2024-08-27T02:31:04.457012+0000","last_active":"2024-08-27T03:58:30.305882+0000","last_peered":"2024-08-27T03:58:30.305882+0000","last_clean":"2024-08-27T03:58:30.305882+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:30.305882+0000","last_undegraded":"2024-08-27T03:58:30.305882+0000","last_fullsized":"2024-08-27T03:58:30.305882+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:51:49.178714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7300249,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":591,"num_read_kb":27255,"num_write":970,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'606","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.938985+0000","last_change":"2024-08-27T02:31:06.461548+0000","last_active":"2024-08-27T03:58:02.938985+0000","last_peered":"2024-08-27T03:58:02.938985+0000","last_clean":"2024-08-27T03:58:02.938985+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:02.938985+0000","last_undegraded":"2024-08-27T03:58:02.938985+0000","last_fullsized":"2024-08-27T03:58:02.938985+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:54:26.910185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'312","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.858995+0000","last_change":"2024-08-27T02:31:04.476105+0000","last_active":"2024-08-27T03:58:29.858995+0000","last_peered":"2024-08-27T03:58:29.858995+0000","last_clean":"2024-08-27T03:58:29.858995+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:29.858995+0000","last_undegraded":"2024-08-27T03:58:29.858995+0000","last_fullsized":"2024-08-27T03:58:29.858995+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:19:35.578103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11437427,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":422,"num_read_kb":45250,"num_write":1008,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'437","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072894+0000","last_change":"2024-08-27T02:31:06.461180+0000","last_active":"2024-08-27T03:54:30.072894+0000","last_peered":"2024-08-27T03:54:30.072894+0000","last_clean":"2024-08-27T03:54:30.072894+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:54:30.072894+0000","last_undegraded":"2024-08-27T03:54:30.072894+0000","last_fullsized":"2024-08-27T03:54:30.072894+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:35:29.428642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'333","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.046535+0000","last_change":"2024-08-27T02:31:04.469464+0000","last_active":"2024-08-27T03:58:31.046535+0000","last_peered":"2024-08-27T03:58:31.046535+0000","last_clean":"2024-08-27T03:58:31.046535+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:31.046535+0000","last_undegraded":"2024-08-27T03:58:31.046535+0000","last_fullsized":"2024-08-27T03:58:31.046535+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:55:43.726324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109793,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":583,"num_read_kb":26118,"num_write":1288,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'574","reported_seq":2441,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.915919+0000","last_change":"2024-08-27T02:31:06.447514+0000","last_active":"2024-08-27T03:58:02.915919+0000","last_peered":"2024-08-27T03:58:02.915919+0000","last_clean":"2024-08-27T03:58:02.915919+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:02.915919+0000","last_undegraded":"2024-08-27T03:58:02.915919+0000","last_fullsized":"2024-08-27T03:58:02.915919+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:41:53.347545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'274","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.010651+0000","last_change":"2024-08-27T02:31:40.468497+0000","last_active":"2024-08-27T03:58:30.010651+0000","last_peered":"2024-08-27T03:58:30.010651+0000","last_clean":"2024-08-27T03:58:30.010651+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:30.010651+0000","last_undegraded":"2024-08-27T03:58:30.010651+0000","last_fullsized":"2024-08-27T03:58:30.010651+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:27.567253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11803400,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":511,"num_read_kb":100247,"num_write":996,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'445","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215939+0000","last_change":"2024-08-27T02:31:06.469696+0000","last_active":"2024-08-27T03:55:54.215939+0000","last_peered":"2024-08-27T03:55:54.215939+0000","last_clean":"2024-08-27T03:55:54.215939+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:55:54.215939+0000","last_undegraded":"2024-08-27T03:55:54.215939+0000","last_fullsized":"2024-08-27T03:55:54.215939+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:20.988932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'312","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.921673+0000","last_change":"2024-08-27T02:31:04.455655+0000","last_active":"2024-08-27T03:58:29.921673+0000","last_peered":"2024-08-27T03:58:29.921673+0000","last_clean":"2024-08-27T03:58:29.921673+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:29.921673+0000","last_undegraded":"2024-08-27T03:58:29.921673+0000","last_fullsized":"2024-08-27T03:58:29.921673+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:53:08.178860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23165461,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":520,"num_read_kb":99962,"num_write":1172,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'357","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.942738+0000","last_change":"2024-08-27T02:31:06.462059+0000","last_active":"2024-08-27T03:58:02.942738+0000","last_peered":"2024-08-27T03:58:02.942738+0000","last_clean":"2024-08-27T03:58:02.942738+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:02.942738+0000","last_undegraded":"2024-08-27T03:58:02.942738+0000","last_fullsized":"2024-08-27T03:58:02.942738+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:59.170394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'240","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.836375+0000","last_change":"2024-08-27T02:31:04.446192+0000","last_active":"2024-08-27T03:58:29.836375+0000","last_peered":"2024-08-27T03:58:29.836375+0000","last_clean":"2024-08-27T03:58:29.836375+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:29.836375+0000","last_undegraded":"2024-08-27T03:58:29.836375+0000","last_fullsized":"2024-08-27T03:58:29.836375+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:44.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1076308,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":356,"num_read_kb":6749,"num_write":893,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'639","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524102+0000","last_change":"2024-08-27T02:31:06.456393+0000","last_active":"2024-08-27T03:56:44.524102+0000","last_peered":"2024-08-27T03:56:44.524102+0000","last_clean":"2024-08-27T03:56:44.524102+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:56:44.524102+0000","last_undegraded":"2024-08-27T03:56:44.524102+0000","last_fullsized":"2024-08-27T03:56:44.524102+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:03.541422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'308","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.914602+0000","last_change":"2024-08-27T02:31:04.455660+0000","last_active":"2024-08-27T03:58:29.914602+0000","last_peered":"2024-08-27T03:58:29.914602+0000","last_clean":"2024-08-27T03:58:29.914602+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:29.914602+0000","last_undegraded":"2024-08-27T03:58:29.914602+0000","last_fullsized":"2024-08-27T03:58:29.914602+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:59:36.250505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4895758,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":522,"num_read_kb":2752,"num_write":1231,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'437","reported_seq":1952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.059524+0000","last_change":"2024-08-27T02:31:06.469100+0000","last_active":"2024-08-27T03:54:40.059524+0000","last_peered":"2024-08-27T03:54:40.059524+0000","last_clean":"2024-08-27T03:54:40.059524+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:54:40.059524+0000","last_undegraded":"2024-08-27T03:54:40.059524+0000","last_fullsized":"2024-08-27T03:54:40.059524+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:54:14.589392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'273","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.899218+0000","last_change":"2024-08-27T02:31:04.474597+0000","last_active":"2024-08-27T03:58:29.899218+0000","last_peered":"2024-08-27T03:58:29.899218+0000","last_clean":"2024-08-27T03:58:29.899218+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:29.899218+0000","last_undegraded":"2024-08-27T03:58:29.899218+0000","last_fullsized":"2024-08-27T03:58:29.899218+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:19:48.419717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172637,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":379,"num_read_kb":2564,"num_write":1008,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'612","reported_seq":2444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.590756+0000","last_change":"2024-08-27T02:31:06.473076+0000","last_active":"2024-08-27T03:56:42.590756+0000","last_peered":"2024-08-27T03:56:42.590756+0000","last_clean":"2024-08-27T03:56:42.590756+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:56:42.590756+0000","last_undegraded":"2024-08-27T03:56:42.590756+0000","last_fullsized":"2024-08-27T03:56:42.590756+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:19.460348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'278","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.253362+0000","last_change":"2024-08-27T02:31:04.466914+0000","last_active":"2024-08-27T03:58:30.253362+0000","last_peered":"2024-08-27T03:58:30.253362+0000","last_clean":"2024-08-27T03:58:30.253362+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:30.253362+0000","last_undegraded":"2024-08-27T03:58:30.253362+0000","last_fullsized":"2024-08-27T03:58:30.253362+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:32.345511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":718000,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":786,"num_read_kb":79613,"num_write":995,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'502","reported_seq":2126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.279816+0000","last_change":"2024-08-27T02:31:06.453414+0000","last_active":"2024-08-27T03:54:25.279816+0000","last_peered":"2024-08-27T03:54:25.279816+0000","last_clean":"2024-08-27T03:54:25.279816+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:54:25.279816+0000","last_undegraded":"2024-08-27T03:54:25.279816+0000","last_fullsized":"2024-08-27T03:54:25.279816+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:58:00.941444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'280","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.367297+0000","last_change":"2024-08-27T02:31:04.493288+0000","last_active":"2024-08-27T03:58:30.367297+0000","last_peered":"2024-08-27T03:58:30.367297+0000","last_clean":"2024-08-27T03:58:30.367297+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:30.367297+0000","last_undegraded":"2024-08-27T03:58:30.367297+0000","last_fullsized":"2024-08-27T03:58:30.367297+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:54:10.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911854,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":576,"num_read_kb":25476,"num_write":954,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'802","reported_seq":2696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.912104+0000","last_change":"2024-08-27T02:31:06.446787+0000","last_active":"2024-08-27T03:58:02.912104+0000","last_peered":"2024-08-27T03:58:02.912104+0000","last_clean":"2024-08-27T03:58:02.912104+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:02.912104+0000","last_undegraded":"2024-08-27T03:58:02.912104+0000","last_fullsized":"2024-08-27T03:58:02.912104+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:54.168779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'285","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.308721+0000","last_change":"2024-08-27T02:31:04.498684+0000","last_active":"2024-08-27T03:58:30.308721+0000","last_peered":"2024-08-27T03:58:30.308721+0000","last_clean":"2024-08-27T03:58:30.308721+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:30.308721+0000","last_undegraded":"2024-08-27T03:58:30.308721+0000","last_fullsized":"2024-08-27T03:58:30.308721+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:33:00.705755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11798001,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":493,"num_read_kb":75812,"num_write":963,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'417","reported_seq":1897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.869970+0000","last_change":"2024-08-27T02:31:06.460970+0000","last_active":"2024-08-27T03:54:24.869970+0000","last_peered":"2024-08-27T03:54:24.869970+0000","last_clean":"2024-08-27T03:54:24.869970+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:54:24.869970+0000","last_undegraded":"2024-08-27T03:54:24.869970+0000","last_fullsized":"2024-08-27T03:54:24.869970+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:33.950629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'371","reported_seq":1290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.061637+0000","last_change":"2024-08-27T02:31:04.477605+0000","last_active":"2024-08-27T03:58:30.061637+0000","last_peered":"2024-08-27T03:58:30.061637+0000","last_clean":"2024-08-27T03:58:30.061637+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:30.061637+0000","last_undegraded":"2024-08-27T03:58:30.061637+0000","last_fullsized":"2024-08-27T03:58:30.061637+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:54.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29877,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":954,"num_read_kb":143554,"num_write":1147,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'385","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.303474+0000","last_change":"2024-08-27T02:31:06.448211+0000","last_active":"2024-08-27T03:56:00.303474+0000","last_peered":"2024-08-27T03:56:00.303474+0000","last_clean":"2024-08-27T03:56:00.303474+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:56:00.303474+0000","last_undegraded":"2024-08-27T03:56:00.303474+0000","last_fullsized":"2024-08-27T03:56:00.303474+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:44.911262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'329","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.760740+0000","last_change":"2024-08-27T02:31:04.468993+0000","last_active":"2024-08-27T03:58:29.760740+0000","last_peered":"2024-08-27T03:58:29.760740+0000","last_clean":"2024-08-27T03:58:29.760740+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:29.760740+0000","last_undegraded":"2024-08-27T03:58:29.760740+0000","last_fullsized":"2024-08-27T03:58:29.760740+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:42.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2148831,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":566,"num_read_kb":11843,"num_write":1238,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'301","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.843384+0000","last_change":"2024-08-27T02:31:04.470311+0000","last_active":"2024-08-27T03:58:29.843384+0000","last_peered":"2024-08-27T03:58:29.843384+0000","last_clean":"2024-08-27T03:58:29.843384+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:29.843384+0000","last_undegraded":"2024-08-27T03:58:29.843384+0000","last_fullsized":"2024-08-27T03:58:29.843384+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:46.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54971,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":482,"num_read_kb":4946,"num_write":1023,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'381","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.298368+0000","last_change":"2024-08-27T02:31:39.753199+0000","last_active":"2024-08-27T03:56:00.298368+0000","last_peered":"2024-08-27T03:56:00.298368+0000","last_clean":"2024-08-27T03:56:00.298368+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:56:00.298368+0000","last_undegraded":"2024-08-27T03:56:00.298368+0000","last_fullsized":"2024-08-27T03:56:00.298368+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:20:26.815028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'324","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.051291+0000","last_change":"2024-08-27T02:31:04.468743+0000","last_active":"2024-08-27T03:58:31.051291+0000","last_peered":"2024-08-27T03:58:31.051291+0000","last_clean":"2024-08-27T03:58:31.051291+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:31.051291+0000","last_undegraded":"2024-08-27T03:58:31.051291+0000","last_fullsized":"2024-08-27T03:58:31.051291+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:32:18.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7430147,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":603,"num_read_kb":18082,"num_write":1112,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.999344+0000","last_change":"2024-08-27T02:31:06.441369+0000","last_active":"2024-08-27T03:58:02.999344+0000","last_peered":"2024-08-27T03:58:02.999344+0000","last_clean":"2024-08-27T03:58:02.999344+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:02.999344+0000","last_undegraded":"2024-08-27T03:58:02.999344+0000","last_fullsized":"2024-08-27T03:58:02.999344+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:46.354455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1592,"ondisk_log_size":1592,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1623887,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19235,"num_read_kb":37371,"num_write":16116,"num_write_kb":11765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1908736,"data_stored":1489439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1889,"ondisk_log_size":1889,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3951,"ondisk_log_size":3951,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":280168786,"num_objects":2687,"num_object_clones":0,"num_object_copies":10748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":0,"num_read":33251,"num_read_kb":1916386,"num_write":68056,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":433528832,"data_stored":433528832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4307,"ondisk_log_size":4307,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":15728640,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":208074,"num_write":158,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35188736,"data_stored":35187371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":42587765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":128,"num_read_kb":198799,"num_write":150,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79351808,"data_stored":79348287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510495,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223448,"kb_used_data":47932,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94148392,"statfs":{"total":96636764160,"available":96407953408,"internally_reserved":0,"allocated":49082368,"data_stored":47081822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543204,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387652,"kb_used_data":71660,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93984188,"statfs":{"total":96636764160,"available":96239808512,"internally_reserved":0,"allocated":73379840,"data_stored":71344196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323353034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543205,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381640,"kb_used_data":119956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93990200,"statfs":{"total":96636764160,"available":96245964800,"internally_reserved":0,"allocated":122834944,"data_stored":120855804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543202,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252180,"kb_used_data":112772,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94119660,"statfs":{"total":96636764160,"available":96378531840,"internally_reserved":0,"allocated":115478528,"data_stored":113383684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543201,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238456,"kb_used_data":130908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94133384,"statfs":{"total":96636764160,"available":96392585216,"internally_reserved":0,"allocated":134049792,"data_stored":132092224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543203,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394180,"kb_used_data":128372,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93977660,"statfs":{"total":96636764160,"available":96233123840,"internally_reserved":0,"allocated":131452928,"data_stored":129397494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543205,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211752,"kb_used_data":104160,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94160088,"statfs":{"total":96636764160,"available":96419930112,"internally_reserved":0,"allocated":106659840,"data_stored":104687967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543203,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":418184,"kb_used_data":126028,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93953656,"statfs":{"total":96636764160,"available":96208543744,"internally_reserved":0,"allocated":129052672,"data_stored":126992328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48959488,"data_stored":48959488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33320960,"data_stored":33320960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53968896,"data_stored":53968896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62959616,"data_stored":62959616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73605120,"data_stored":73605120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":70320128,"data_stored":70320128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":47345664,"data_stored":47345664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":43048960,"data_stored":43048960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":165537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":90823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":40312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":339243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":458355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":134672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":221561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5304320,"data_stored":5303242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4255744,"data_stored":4254666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T03:58:32.714 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-27T03:58:32.715 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T03:58:33.068 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:58:33.089 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T03:58:33.093 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2892,"stamp":"2024-08-27T03:58:31.279856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":340716903,"num_objects":3195,"num_object_clones":0,"num_object_copies":11764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3195,"num_whiteouts":0,"num_read":285234,"num_read_kb":2573635,"num_write":157223,"num_write_kb":2372713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13502,"ondisk_log_size":13502,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2507492,"kb_used_data":841788,"kb_used_omap":12,"kb_used_meta":1665203,"kb_avail":752467228,"statfs":{"total":773094113280,"available":770526441472,"internally_reserved":0,"allocated":861990912,"data_stored":845835519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1705168433},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-332165186,"num_objects":-1734,"num_object_clones":0,"num_object_copies":-6884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1734,"num_whiteouts":0,"num_read":1976,"num_read_kb":1992,"num_write":1855,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008003"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875576+0000","last_change":"2024-08-27T03:10:45.291800+0000","last_active":"2024-08-27T03:55:44.875576+0000","last_peered":"2024-08-27T03:55:44.875576+0000","last_clean":"2024-08-27T03:55:44.875576+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:55:44.875576+0000","last_undegraded":"2024-08-27T03:55:44.875576+0000","last_fullsized":"2024-08-27T03:55:44.875576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:23:36.039939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.913854+0000","last_change":"2024-08-27T02:50:55.799193+0000","last_active":"2024-08-27T03:58:24.913854+0000","last_peered":"2024-08-27T03:58:24.913854+0000","last_clean":"2024-08-27T03:58:24.913854+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:58:24.913854+0000","last_undegraded":"2024-08-27T03:58:24.913854+0000","last_fullsized":"2024-08-27T03:58:24.913854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:21:44.106748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.896443+0000","last_change":"2024-08-27T02:50:51.735635+0000","last_active":"2024-08-27T03:55:54.896443+0000","last_peered":"2024-08-27T03:55:54.896443+0000","last_clean":"2024-08-27T03:55:54.896443+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:55:54.896443+0000","last_undegraded":"2024-08-27T03:55:54.896443+0000","last_fullsized":"2024-08-27T03:55:54.896443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:41.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.292121+0000","last_change":"2024-08-27T02:46:49.663999+0000","last_active":"2024-08-27T03:55:35.292121+0000","last_peered":"2024-08-27T03:55:35.292121+0000","last_clean":"2024-08-27T03:55:35.292121+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:55:35.292121+0000","last_undegraded":"2024-08-27T03:55:35.292121+0000","last_fullsized":"2024-08-27T03:55:35.292121+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:06:26.935384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073515+0000","last_change":"2024-08-27T03:10:45.296108+0000","last_active":"2024-08-27T03:55:45.073515+0000","last_peered":"2024-08-27T03:55:45.073515+0000","last_clean":"2024-08-27T03:55:45.073515+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:55:45.073515+0000","last_undegraded":"2024-08-27T03:55:45.073515+0000","last_fullsized":"2024-08-27T03:55:45.073515+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:12.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128164+0000","last_change":"2024-08-27T02:50:55.775244+0000","last_active":"2024-08-27T03:58:25.128164+0000","last_peered":"2024-08-27T03:58:25.128164+0000","last_clean":"2024-08-27T03:58:25.128164+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:58:25.128164+0000","last_undegraded":"2024-08-27T03:58:25.128164+0000","last_fullsized":"2024-08-27T03:58:25.128164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:30.406512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076691+0000","last_change":"2024-08-27T02:50:51.735266+0000","last_active":"2024-08-27T03:55:51.076691+0000","last_peered":"2024-08-27T03:55:51.076691+0000","last_clean":"2024-08-27T03:55:51.076691+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:55:51.076691+0000","last_undegraded":"2024-08-27T03:55:51.076691+0000","last_fullsized":"2024-08-27T03:55:51.076691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:50:41.400577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064603+0000","last_change":"2024-08-27T02:46:49.676761+0000","last_active":"2024-08-27T03:55:05.064603+0000","last_peered":"2024-08-27T03:55:05.064603+0000","last_clean":"2024-08-27T03:55:05.064603+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:55:05.064603+0000","last_undegraded":"2024-08-27T03:55:05.064603+0000","last_fullsized":"2024-08-27T03:55:05.064603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:59:06.352477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.436334+0000","last_change":"2024-08-27T03:10:45.294573+0000","last_active":"2024-08-27T03:54:15.436334+0000","last_peered":"2024-08-27T03:54:15.436334+0000","last_clean":"2024-08-27T03:54:15.436334+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:54:15.436334+0000","last_undegraded":"2024-08-27T03:54:15.436334+0000","last_fullsized":"2024-08-27T03:54:15.436334+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:54.922215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290928+0000","last_change":"2024-08-27T02:50:55.791602+0000","last_active":"2024-08-27T03:55:30.290928+0000","last_peered":"2024-08-27T03:55:30.290928+0000","last_clean":"2024-08-27T03:55:30.290928+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:55:30.290928+0000","last_undegraded":"2024-08-27T03:55:30.290928+0000","last_fullsized":"2024-08-27T03:55:30.290928+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:05.925142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'10","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.880591+0000","last_change":"2024-08-27T02:50:51.729715+0000","last_active":"2024-08-27T03:58:29.880591+0000","last_peered":"2024-08-27T03:58:29.880591+0000","last_clean":"2024-08-27T03:58:29.880591+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:58:29.880591+0000","last_undegraded":"2024-08-27T03:58:29.880591+0000","last_fullsized":"2024-08-27T03:58:29.880591+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:26.531591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60362,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":21563,"num_write":15,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494185+0000","last_change":"2024-08-27T02:46:49.653398+0000","last_active":"2024-08-27T03:54:20.494185+0000","last_peered":"2024-08-27T03:54:20.494185+0000","last_clean":"2024-08-27T03:54:20.494185+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:54:20.494185+0000","last_undegraded":"2024-08-27T03:54:20.494185+0000","last_fullsized":"2024-08-27T03:54:20.494185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:50.129103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871224+0000","last_change":"2024-08-27T03:10:45.281316+0000","last_active":"2024-08-27T03:54:29.871224+0000","last_peered":"2024-08-27T03:54:29.871224+0000","last_clean":"2024-08-27T03:54:29.871224+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:54:29.871224+0000","last_undegraded":"2024-08-27T03:54:29.871224+0000","last_fullsized":"2024-08-27T03:54:29.871224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:26.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.887006+0000","last_change":"2024-08-27T02:50:55.794295+0000","last_active":"2024-08-27T03:55:14.887006+0000","last_peered":"2024-08-27T03:55:14.887006+0000","last_clean":"2024-08-27T03:55:14.887006+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:55:14.887006+0000","last_undegraded":"2024-08-27T03:55:14.887006+0000","last_fullsized":"2024-08-27T03:55:14.887006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:10.976998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.087490+0000","last_change":"2024-08-27T02:50:51.720342+0000","last_active":"2024-08-27T03:55:30.087490+0000","last_peered":"2024-08-27T03:55:30.087490+0000","last_clean":"2024-08-27T03:55:30.087490+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:55:30.087490+0000","last_undegraded":"2024-08-27T03:55:30.087490+0000","last_fullsized":"2024-08-27T03:55:30.087490+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:16:13.056385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868989+0000","last_change":"2024-08-27T02:46:49.680620+0000","last_active":"2024-08-27T03:54:19.868989+0000","last_peered":"2024-08-27T03:54:19.868989+0000","last_clean":"2024-08-27T03:54:19.868989+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:54:19.868989+0000","last_undegraded":"2024-08-27T03:54:19.868989+0000","last_fullsized":"2024-08-27T03:54:19.868989+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:46:31.779704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:59.882198+0000","last_change":"2024-08-27T03:10:45.289727+0000","last_active":"2024-08-27T03:54:59.882198+0000","last_peered":"2024-08-27T03:54:59.882198+0000","last_clean":"2024-08-27T03:54:59.882198+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:54:59.882198+0000","last_undegraded":"2024-08-27T03:54:59.882198+0000","last_fullsized":"2024-08-27T03:54:59.882198+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:30:10.424523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:04.852380+0000","last_change":"2024-08-27T02:50:55.806362+0000","last_active":"2024-08-27T03:54:04.852380+0000","last_peered":"2024-08-27T03:54:04.852380+0000","last_clean":"2024-08-27T03:54:04.852380+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:54:04.852380+0000","last_undegraded":"2024-08-27T03:54:04.852380+0000","last_fullsized":"2024-08-27T03:54:04.852380+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:25.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.486004+0000","last_change":"2024-08-27T02:50:51.720059+0000","last_active":"2024-08-27T03:53:45.486004+0000","last_peered":"2024-08-27T03:53:45.486004+0000","last_clean":"2024-08-27T03:53:45.486004+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:53:45.486004+0000","last_undegraded":"2024-08-27T03:53:45.486004+0000","last_fullsized":"2024-08-27T03:53:45.486004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:07.906082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868908+0000","last_change":"2024-08-27T02:46:49.675252+0000","last_active":"2024-08-27T03:54:19.868908+0000","last_peered":"2024-08-27T03:54:19.868908+0000","last_clean":"2024-08-27T03:54:19.868908+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:54:19.868908+0000","last_undegraded":"2024-08-27T03:54:19.868908+0000","last_fullsized":"2024-08-27T03:54:19.868908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:11.184532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058881+0000","last_change":"2024-08-27T03:10:45.303346+0000","last_active":"2024-08-27T03:54:31.058881+0000","last_peered":"2024-08-27T03:54:31.058881+0000","last_clean":"2024-08-27T03:54:31.058881+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:54:31.058881+0000","last_undegraded":"2024-08-27T03:54:31.058881+0000","last_fullsized":"2024-08-27T03:54:31.058881+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:17:17.630708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.429653+0000","last_change":"2024-08-27T02:50:55.789996+0000","last_active":"2024-08-27T03:53:45.429653+0000","last_peered":"2024-08-27T03:53:45.429653+0000","last_clean":"2024-08-27T03:53:45.429653+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:53:45.429653+0000","last_undegraded":"2024-08-27T03:53:45.429653+0000","last_fullsized":"2024-08-27T03:53:45.429653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:53.367346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:25.100608+0000","last_change":"2024-08-27T02:50:51.707799+0000","last_active":"2024-08-27T03:56:25.100608+0000","last_peered":"2024-08-27T03:56:25.100608+0000","last_clean":"2024-08-27T03:56:25.100608+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:56:25.100608+0000","last_undegraded":"2024-08-27T03:56:25.100608+0000","last_fullsized":"2024-08-27T03:56:25.100608+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:38.856713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437440+0000","last_change":"2024-08-27T02:46:49.657662+0000","last_active":"2024-08-27T03:54:20.437440+0000","last_peered":"2024-08-27T03:54:20.437440+0000","last_clean":"2024-08-27T03:54:20.437440+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:54:20.437440+0000","last_undegraded":"2024-08-27T03:54:20.437440+0000","last_fullsized":"2024-08-27T03:54:20.437440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:37:52.995296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299701+0000","last_change":"2024-08-27T03:10:45.293045+0000","last_active":"2024-08-27T03:55:45.299701+0000","last_peered":"2024-08-27T03:55:45.299701+0000","last_clean":"2024-08-27T03:55:45.299701+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:55:45.299701+0000","last_undegraded":"2024-08-27T03:55:45.299701+0000","last_fullsized":"2024-08-27T03:55:45.299701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:53:47.782276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.490696+0000","last_change":"2024-08-27T02:50:55.766901+0000","last_active":"2024-08-27T03:58:25.490696+0000","last_peered":"2024-08-27T03:58:25.490696+0000","last_clean":"2024-08-27T03:58:25.490696+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:58:25.490696+0000","last_undegraded":"2024-08-27T03:58:25.490696+0000","last_fullsized":"2024-08-27T03:58:25.490696+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:30:21.583051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":18432,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093324+0000","last_change":"2024-08-27T02:50:51.738475+0000","last_active":"2024-08-27T03:55:55.093324+0000","last_peered":"2024-08-27T03:55:55.093324+0000","last_clean":"2024-08-27T03:55:55.093324+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:55:55.093324+0000","last_undegraded":"2024-08-27T03:55:55.093324+0000","last_fullsized":"2024-08-27T03:55:55.093324+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:26:56.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.497953+0000","last_change":"2024-08-27T02:46:49.647868+0000","last_active":"2024-08-27T03:54:40.497953+0000","last_peered":"2024-08-27T03:54:40.497953+0000","last_clean":"2024-08-27T03:54:40.497953+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:54:40.497953+0000","last_undegraded":"2024-08-27T03:54:40.497953+0000","last_fullsized":"2024-08-27T03:54:40.497953+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:28:45.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299830+0000","last_change":"2024-08-27T03:10:45.284842+0000","last_active":"2024-08-27T03:55:45.299830+0000","last_peered":"2024-08-27T03:55:45.299830+0000","last_clean":"2024-08-27T03:55:45.299830+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:55:45.299830+0000","last_undegraded":"2024-08-27T03:55:45.299830+0000","last_fullsized":"2024-08-27T03:55:45.299830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:45:04.454859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930510+0000","last_change":"2024-08-27T02:50:55.778273+0000","last_active":"2024-08-27T03:58:24.930510+0000","last_peered":"2024-08-27T03:58:24.930510+0000","last_clean":"2024-08-27T03:58:24.930510+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:58:24.930510+0000","last_undegraded":"2024-08-27T03:58:24.930510+0000","last_fullsized":"2024-08-27T03:58:24.930510+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:39.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.296625+0000","last_change":"2024-08-27T02:50:51.714543+0000","last_active":"2024-08-27T03:55:55.296625+0000","last_peered":"2024-08-27T03:55:55.296625+0000","last_clean":"2024-08-27T03:55:55.296625+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:55:55.296625+0000","last_undegraded":"2024-08-27T03:55:55.296625+0000","last_fullsized":"2024-08-27T03:55:55.296625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:34.299020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058666+0000","last_change":"2024-08-27T02:46:49.667902+0000","last_active":"2024-08-27T03:54:31.058666+0000","last_peered":"2024-08-27T03:54:31.058666+0000","last_clean":"2024-08-27T03:54:31.058666+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:54:31.058666+0000","last_undegraded":"2024-08-27T03:54:31.058666+0000","last_fullsized":"2024-08-27T03:54:31.058666+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:38.299301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065781+0000","last_change":"2024-08-27T03:10:45.298717+0000","last_active":"2024-08-27T03:55:06.065781+0000","last_peered":"2024-08-27T03:55:06.065781+0000","last_clean":"2024-08-27T03:55:06.065781+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:55:06.065781+0000","last_undegraded":"2024-08-27T03:55:06.065781+0000","last_fullsized":"2024-08-27T03:55:06.065781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:23:22.104053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.114116+0000","last_change":"2024-08-27T02:50:55.800701+0000","last_active":"2024-08-27T03:58:29.114116+0000","last_peered":"2024-08-27T03:58:29.114116+0000","last_clean":"2024-08-27T03:58:29.114116+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:58:29.114116+0000","last_undegraded":"2024-08-27T03:58:29.114116+0000","last_fullsized":"2024-08-27T03:58:29.114116+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:22.225737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'1","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.854797+0000","last_change":"2024-08-27T02:50:51.725068+0000","last_active":"2024-08-27T03:54:14.854797+0000","last_peered":"2024-08-27T03:54:14.854797+0000","last_clean":"2024-08-27T03:54:14.854797+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:54:14.854797+0000","last_undegraded":"2024-08-27T03:54:14.854797+0000","last_fullsized":"2024-08-27T03:54:14.854797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:06:25.729104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495980+0000","last_change":"2024-08-27T02:46:49.654801+0000","last_active":"2024-08-27T03:54:30.495980+0000","last_peered":"2024-08-27T03:54:30.495980+0000","last_clean":"2024-08-27T03:54:30.495980+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:54:30.495980+0000","last_undegraded":"2024-08-27T03:54:30.495980+0000","last_fullsized":"2024-08-27T03:54:30.495980+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:08.448754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064497+0000","last_change":"2024-08-27T03:10:45.296344+0000","last_active":"2024-08-27T03:55:05.064497+0000","last_peered":"2024-08-27T03:55:05.064497+0000","last_clean":"2024-08-27T03:55:05.064497+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:55:05.064497+0000","last_undegraded":"2024-08-27T03:55:05.064497+0000","last_fullsized":"2024-08-27T03:55:05.064497+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:28.938702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.499627+0000","last_change":"2024-08-27T02:51:41.064218+0000","last_active":"2024-08-27T03:54:50.499627+0000","last_peered":"2024-08-27T03:54:50.499627+0000","last_clean":"2024-08-27T03:54:50.499627+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:54:50.499627+0000","last_undegraded":"2024-08-27T03:54:50.499627+0000","last_fullsized":"2024-08-27T03:54:50.499627+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:59:05.157815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.270244+0000","last_change":"2024-08-27T02:50:51.728712+0000","last_active":"2024-08-27T03:53:45.270244+0000","last_peered":"2024-08-27T03:53:45.270244+0000","last_clean":"2024-08-27T03:53:45.270244+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:53:45.270244+0000","last_undegraded":"2024-08-27T03:53:45.270244+0000","last_fullsized":"2024-08-27T03:53:45.270244+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:43:32.708072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":308,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871387+0000","last_change":"2024-08-27T02:46:49.674700+0000","last_active":"2024-08-27T03:54:29.871387+0000","last_peered":"2024-08-27T03:54:29.871387+0000","last_clean":"2024-08-27T03:54:29.871387+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:54:29.871387+0000","last_undegraded":"2024-08-27T03:54:29.871387+0000","last_fullsized":"2024-08-27T03:54:29.871387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:39:28.639475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.289661+0000","last_change":"2024-08-27T03:10:45.293007+0000","last_active":"2024-08-27T03:55:05.289661+0000","last_peered":"2024-08-27T03:55:05.289661+0000","last_clean":"2024-08-27T03:55:05.289661+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:55:05.289661+0000","last_undegraded":"2024-08-27T03:55:05.289661+0000","last_fullsized":"2024-08-27T03:55:05.289661+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:23:00.597660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.860865+0000","last_change":"2024-08-27T02:50:55.799828+0000","last_active":"2024-08-27T03:53:44.860865+0000","last_peered":"2024-08-27T03:53:44.860865+0000","last_clean":"2024-08-27T03:53:44.860865+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:53:44.860865+0000","last_undegraded":"2024-08-27T03:53:44.860865+0000","last_fullsized":"2024-08-27T03:53:44.860865+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:54.431380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.048186+0000","last_change":"2024-08-27T02:50:51.720595+0000","last_active":"2024-08-27T03:53:45.048186+0000","last_peered":"2024-08-27T03:53:45.048186+0000","last_clean":"2024-08-27T03:53:45.048186+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:53:45.048186+0000","last_undegraded":"2024-08-27T03:53:45.048186+0000","last_fullsized":"2024-08-27T03:53:45.048186+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:42:21.827378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057603+0000","last_change":"2024-08-27T02:46:49.678450+0000","last_active":"2024-08-27T03:54:30.057603+0000","last_peered":"2024-08-27T03:54:30.057603+0000","last_clean":"2024-08-27T03:54:30.057603+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:54:30.057603+0000","last_undegraded":"2024-08-27T03:54:30.057603+0000","last_fullsized":"2024-08-27T03:54:30.057603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:37.128746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:04.866169+0000","last_change":"2024-08-27T03:10:45.298256+0000","last_active":"2024-08-27T03:55:04.866169+0000","last_peered":"2024-08-27T03:55:04.866169+0000","last_clean":"2024-08-27T03:55:04.866169+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:55:04.866169+0000","last_undegraded":"2024-08-27T03:55:04.866169+0000","last_fullsized":"2024-08-27T03:55:04.866169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:20:23.614816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.096796+0000","last_change":"2024-08-27T02:50:55.769990+0000","last_active":"2024-08-27T03:56:10.096796+0000","last_peered":"2024-08-27T03:56:10.096796+0000","last_clean":"2024-08-27T03:56:10.096796+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:56:10.096796+0000","last_undegraded":"2024-08-27T03:56:10.096796+0000","last_fullsized":"2024-08-27T03:56:10.096796+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:30.128153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300910+0000","last_change":"2024-08-27T02:50:51.699776+0000","last_active":"2024-08-27T03:56:10.300910+0000","last_peered":"2024-08-27T03:56:10.300910+0000","last_clean":"2024-08-27T03:56:10.300910+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:56:10.300910+0000","last_undegraded":"2024-08-27T03:56:10.300910+0000","last_fullsized":"2024-08-27T03:56:10.300910+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:07:34.952020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.286162+0000","last_change":"2024-08-27T02:46:49.665181+0000","last_active":"2024-08-27T03:54:50.286162+0000","last_peered":"2024-08-27T03:54:50.286162+0000","last_clean":"2024-08-27T03:54:50.286162+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:54:50.286162+0000","last_undegraded":"2024-08-27T03:54:50.286162+0000","last_fullsized":"2024-08-27T03:54:50.286162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:42.937470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867848+0000","last_change":"2024-08-27T03:10:45.289487+0000","last_active":"2024-08-27T03:54:14.867848+0000","last_peered":"2024-08-27T03:54:14.867848+0000","last_clean":"2024-08-27T03:54:14.867848+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:54:14.867848+0000","last_undegraded":"2024-08-27T03:54:14.867848+0000","last_fullsized":"2024-08-27T03:54:14.867848+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:39.767865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082072+0000","last_change":"2024-08-27T02:50:55.787899+0000","last_active":"2024-08-27T03:56:16.082072+0000","last_peered":"2024-08-27T03:56:16.082072+0000","last_clean":"2024-08-27T03:56:16.082072+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:56:16.082072+0000","last_undegraded":"2024-08-27T03:56:16.082072+0000","last_fullsized":"2024-08-27T03:56:16.082072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:02.349021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:55.064852+0000","last_change":"2024-08-27T02:50:51.710484+0000","last_active":"2024-08-27T03:53:55.064852+0000","last_peered":"2024-08-27T03:53:55.064852+0000","last_clean":"2024-08-27T03:53:55.064852+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:53:55.064852+0000","last_undegraded":"2024-08-27T03:53:55.064852+0000","last_fullsized":"2024-08-27T03:53:55.064852+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:35:36.294957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281022+0000","last_change":"2024-08-27T02:46:49.668229+0000","last_active":"2024-08-27T03:54:30.281022+0000","last_peered":"2024-08-27T03:54:30.281022+0000","last_clean":"2024-08-27T03:54:30.281022+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:54:30.281022+0000","last_undegraded":"2024-08-27T03:54:30.281022+0000","last_fullsized":"2024-08-27T03:54:30.281022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:15.719694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.493101+0000","last_change":"2024-08-27T03:10:45.282295+0000","last_active":"2024-08-27T03:54:15.493101+0000","last_peered":"2024-08-27T03:54:15.493101+0000","last_clean":"2024-08-27T03:54:15.493101+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:54:15.493101+0000","last_undegraded":"2024-08-27T03:54:15.493101+0000","last_fullsized":"2024-08-27T03:54:15.493101+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:10:06.995285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082002+0000","last_change":"2024-08-27T02:50:55.769855+0000","last_active":"2024-08-27T03:56:16.082002+0000","last_peered":"2024-08-27T03:56:16.082002+0000","last_clean":"2024-08-27T03:56:16.082002+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:56:16.082002+0000","last_undegraded":"2024-08-27T03:56:16.082002+0000","last_fullsized":"2024-08-27T03:56:16.082002+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:05.548730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.862920+0000","last_change":"2024-08-27T02:50:51.730019+0000","last_active":"2024-08-27T03:53:54.862920+0000","last_peered":"2024-08-27T03:53:54.862920+0000","last_clean":"2024-08-27T03:53:54.862920+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:53:54.862920+0000","last_undegraded":"2024-08-27T03:53:54.862920+0000","last_fullsized":"2024-08-27T03:53:54.862920+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:46.716300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495770+0000","last_change":"2024-08-27T02:46:49.666192+0000","last_active":"2024-08-27T03:54:30.495770+0000","last_peered":"2024-08-27T03:54:30.495770+0000","last_clean":"2024-08-27T03:54:30.495770+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:54:30.495770+0000","last_undegraded":"2024-08-27T03:54:30.495770+0000","last_fullsized":"2024-08-27T03:54:30.495770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:05.105406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287223+0000","last_change":"2024-08-27T03:10:45.283329+0000","last_active":"2024-08-27T03:55:15.287223+0000","last_peered":"2024-08-27T03:55:15.287223+0000","last_clean":"2024-08-27T03:55:15.287223+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:55:15.287223+0000","last_undegraded":"2024-08-27T03:55:15.287223+0000","last_fullsized":"2024-08-27T03:55:15.287223+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:08.644016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.863049+0000","last_change":"2024-08-27T02:50:55.783336+0000","last_active":"2024-08-27T03:53:54.863049+0000","last_peered":"2024-08-27T03:53:54.863049+0000","last_clean":"2024-08-27T03:53:54.863049+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:53:54.863049+0000","last_undegraded":"2024-08-27T03:53:54.863049+0000","last_fullsized":"2024-08-27T03:53:54.863049+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:19.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:55.431875+0000","last_change":"2024-08-27T02:50:51.738540+0000","last_active":"2024-08-27T03:53:55.431875+0000","last_peered":"2024-08-27T03:53:55.431875+0000","last_clean":"2024-08-27T03:53:55.431875+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:53:55.431875+0000","last_undegraded":"2024-08-27T03:53:55.431875+0000","last_fullsized":"2024-08-27T03:53:55.431875+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:28.212686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072847+0000","last_change":"2024-08-27T02:46:49.654783+0000","last_active":"2024-08-27T03:54:30.072847+0000","last_peered":"2024-08-27T03:54:30.072847+0000","last_clean":"2024-08-27T03:54:30.072847+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:54:30.072847+0000","last_undegraded":"2024-08-27T03:54:30.072847+0000","last_fullsized":"2024-08-27T03:54:30.072847+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:07.533650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867790+0000","last_change":"2024-08-27T03:10:45.266598+0000","last_active":"2024-08-27T03:54:14.867790+0000","last_peered":"2024-08-27T03:54:14.867790+0000","last_clean":"2024-08-27T03:54:14.867790+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:54:14.867790+0000","last_undegraded":"2024-08-27T03:54:14.867790+0000","last_fullsized":"2024-08-27T03:54:14.867790+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:16.790039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462591+0000","last_change":"2024-08-27T02:50:55.778741+0000","last_active":"2024-08-27T03:56:15.462591+0000","last_peered":"2024-08-27T03:56:15.462591+0000","last_clean":"2024-08-27T03:56:15.462591+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:56:15.462591+0000","last_undegraded":"2024-08-27T03:56:15.462591+0000","last_fullsized":"2024-08-27T03:56:15.462591+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:56:17.118596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:54.850206+0000","last_change":"2024-08-27T02:50:51.722290+0000","last_active":"2024-08-27T03:53:54.850206+0000","last_peered":"2024-08-27T03:53:54.850206+0000","last_clean":"2024-08-27T03:53:54.850206+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:53:54.850206+0000","last_undegraded":"2024-08-27T03:53:54.850206+0000","last_fullsized":"2024-08-27T03:53:54.850206+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:01.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871100+0000","last_change":"2024-08-27T02:46:49.673825+0000","last_active":"2024-08-27T03:54:29.871100+0000","last_peered":"2024-08-27T03:54:29.871100+0000","last_clean":"2024-08-27T03:54:29.871100+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:54:29.871100+0000","last_undegraded":"2024-08-27T03:54:29.871100+0000","last_fullsized":"2024-08-27T03:54:29.871100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:03.488183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.054649+0000","last_change":"2024-08-27T03:10:45.296440+0000","last_active":"2024-08-27T03:54:15.054649+0000","last_peered":"2024-08-27T03:54:15.054649+0000","last_clean":"2024-08-27T03:54:15.054649+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:54:15.054649+0000","last_undegraded":"2024-08-27T03:54:15.054649+0000","last_fullsized":"2024-08-27T03:54:15.054649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:09.800699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'1","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900422+0000","last_change":"2024-08-27T02:50:55.782955+0000","last_active":"2024-08-27T03:56:09.900422+0000","last_peered":"2024-08-27T03:56:09.900422+0000","last_clean":"2024-08-27T03:56:09.900422+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:56:09.900422+0000","last_undegraded":"2024-08-27T03:56:09.900422+0000","last_fullsized":"2024-08-27T03:56:09.900422+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:13.729427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306233+0000","last_change":"2024-08-27T02:50:51.737202+0000","last_active":"2024-08-27T03:56:10.306233+0000","last_peered":"2024-08-27T03:56:10.306233+0000","last_clean":"2024-08-27T03:56:10.306233+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:56:10.306233+0000","last_undegraded":"2024-08-27T03:56:10.306233+0000","last_fullsized":"2024-08-27T03:56:10.306233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:36.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'155","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:39.874246+0000","last_change":"2024-08-27T02:46:49.680563+0000","last_active":"2024-08-27T03:54:39.874246+0000","last_peered":"2024-08-27T03:54:39.874246+0000","last_clean":"2024-08-27T03:54:39.874246+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:54:39.874246+0000","last_undegraded":"2024-08-27T03:54:39.874246+0000","last_fullsized":"2024-08-27T03:54:39.874246+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:31.769992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299565+0000","last_change":"2024-08-27T03:10:45.284394+0000","last_active":"2024-08-27T03:55:45.299565+0000","last_peered":"2024-08-27T03:55:45.299565+0000","last_clean":"2024-08-27T03:55:45.299565+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:55:45.299565+0000","last_undegraded":"2024-08-27T03:55:45.299565+0000","last_fullsized":"2024-08-27T03:55:45.299565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:56.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930627+0000","last_change":"2024-08-27T02:50:55.783274+0000","last_active":"2024-08-27T03:58:24.930627+0000","last_peered":"2024-08-27T03:58:24.930627+0000","last_clean":"2024-08-27T03:58:24.930627+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:58:24.930627+0000","last_undegraded":"2024-08-27T03:58:24.930627+0000","last_fullsized":"2024-08-27T03:58:24.930627+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:45:25.580491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079012+0000","last_change":"2024-08-27T02:50:51.720906+0000","last_active":"2024-08-27T03:56:10.079012+0000","last_peered":"2024-08-27T03:56:10.079012+0000","last_clean":"2024-08-27T03:56:10.079012+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:56:10.079012+0000","last_undegraded":"2024-08-27T03:56:10.079012+0000","last_fullsized":"2024-08-27T03:56:10.079012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:53.550807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.856027+0000","last_change":"2024-08-27T02:46:49.663826+0000","last_active":"2024-08-27T03:54:19.856027+0000","last_peered":"2024-08-27T03:54:19.856027+0000","last_clean":"2024-08-27T03:54:19.856027+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:54:19.856027+0000","last_undegraded":"2024-08-27T03:54:19.856027+0000","last_fullsized":"2024-08-27T03:54:19.856027+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:54.422893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462512+0000","last_change":"2024-08-27T03:10:45.287877+0000","last_active":"2024-08-27T03:56:15.462512+0000","last_peered":"2024-08-27T03:56:15.462512+0000","last_clean":"2024-08-27T03:56:15.462512+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:56:15.462512+0000","last_undegraded":"2024-08-27T03:56:15.462512+0000","last_fullsized":"2024-08-27T03:56:15.462512+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:39:37.167338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:06.053303+0000","last_change":"2024-08-27T02:50:55.796569+0000","last_active":"2024-08-27T03:54:06.053303+0000","last_peered":"2024-08-27T03:54:06.053303+0000","last_clean":"2024-08-27T03:54:06.053303+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:54:06.053303+0000","last_undegraded":"2024-08-27T03:54:06.053303+0000","last_fullsized":"2024-08-27T03:54:06.053303+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:41.999490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300859+0000","last_change":"2024-08-27T02:50:51.714350+0000","last_active":"2024-08-27T03:56:10.300859+0000","last_peered":"2024-08-27T03:56:10.300859+0000","last_clean":"2024-08-27T03:56:10.300859+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:56:10.300859+0000","last_undegraded":"2024-08-27T03:56:10.300859+0000","last_fullsized":"2024-08-27T03:56:10.300859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:27:51.967867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'95","reported_seq":424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437556+0000","last_change":"2024-08-27T02:46:49.668269+0000","last_active":"2024-08-27T03:54:20.437556+0000","last_peered":"2024-08-27T03:54:20.437556+0000","last_clean":"2024-08-27T03:54:20.437556+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:54:20.437556+0000","last_undegraded":"2024-08-27T03:54:20.437556+0000","last_fullsized":"2024-08-27T03:54:20.437556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:35:55.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307291+0000","last_change":"2024-08-27T03:10:45.299758+0000","last_active":"2024-08-27T03:56:15.307291+0000","last_peered":"2024-08-27T03:56:15.307291+0000","last_clean":"2024-08-27T03:56:15.307291+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:56:15.307291+0000","last_undegraded":"2024-08-27T03:56:15.307291+0000","last_fullsized":"2024-08-27T03:56:15.307291+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.273910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930815+0000","last_change":"2024-08-27T02:50:55.792739+0000","last_active":"2024-08-27T03:58:24.930815+0000","last_peered":"2024-08-27T03:58:24.930815+0000","last_clean":"2024-08-27T03:58:24.930815+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:58:24.930815+0000","last_undegraded":"2024-08-27T03:58:24.930815+0000","last_fullsized":"2024-08-27T03:58:24.930815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:53.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082281+0000","last_change":"2024-08-27T02:50:51.725905+0000","last_active":"2024-08-27T03:56:16.082281+0000","last_peered":"2024-08-27T03:56:16.082281+0000","last_clean":"2024-08-27T03:56:16.082281+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:56:16.082281+0000","last_undegraded":"2024-08-27T03:56:16.082281+0000","last_fullsized":"2024-08-27T03:56:16.082281+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:12.890510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.055617+0000","last_change":"2024-08-27T02:46:49.680856+0000","last_active":"2024-08-27T03:54:20.055617+0000","last_peered":"2024-08-27T03:54:20.055617+0000","last_clean":"2024-08-27T03:54:20.055617+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:54:20.055617+0000","last_undegraded":"2024-08-27T03:54:20.055617+0000","last_fullsized":"2024-08-27T03:54:20.055617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:18:48.246298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.894119+0000","last_change":"2024-08-27T03:10:45.290159+0000","last_active":"2024-08-27T03:55:44.894119+0000","last_peered":"2024-08-27T03:55:44.894119+0000","last_clean":"2024-08-27T03:55:44.894119+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:55:44.894119+0000","last_undegraded":"2024-08-27T03:55:44.894119+0000","last_fullsized":"2024-08-27T03:55:44.894119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:46:58.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093241+0000","last_change":"2024-08-27T02:50:55.801909+0000","last_active":"2024-08-27T03:55:55.093241+0000","last_peered":"2024-08-27T03:55:55.093241+0000","last_clean":"2024-08-27T03:55:55.093241+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:55:55.093241+0000","last_undegraded":"2024-08-27T03:55:55.093241+0000","last_fullsized":"2024-08-27T03:55:55.093241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:21:22.557931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.326037+0000","last_change":"2024-08-27T02:50:51.714694+0000","last_active":"2024-08-27T03:58:05.326037+0000","last_peered":"2024-08-27T03:58:05.326037+0000","last_clean":"2024-08-27T03:58:05.326037+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:58:05.326037+0000","last_undegraded":"2024-08-27T03:58:05.326037+0000","last_fullsized":"2024-08-27T03:58:05.326037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:09.799135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494067+0000","last_change":"2024-08-27T02:46:49.660909+0000","last_active":"2024-08-27T03:54:20.494067+0000","last_peered":"2024-08-27T03:54:20.494067+0000","last_clean":"2024-08-27T03:54:20.494067+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:54:20.494067+0000","last_undegraded":"2024-08-27T03:54:20.494067+0000","last_fullsized":"2024-08-27T03:54:20.494067+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:08:11.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302508+0000","last_change":"2024-08-27T03:10:45.301566+0000","last_active":"2024-08-27T03:55:55.302508+0000","last_peered":"2024-08-27T03:55:55.302508+0000","last_clean":"2024-08-27T03:55:55.302508+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:55:55.302508+0000","last_undegraded":"2024-08-27T03:55:55.302508+0000","last_fullsized":"2024-08-27T03:55:55.302508+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:57:00.105752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302217+0000","last_change":"2024-08-27T02:50:55.793032+0000","last_active":"2024-08-27T03:55:55.302217+0000","last_peered":"2024-08-27T03:55:55.302217+0000","last_clean":"2024-08-27T03:55:55.302217+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:55:55.302217+0000","last_undegraded":"2024-08-27T03:55:55.302217+0000","last_fullsized":"2024-08-27T03:55:55.302217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:41:51.131027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076538+0000","last_change":"2024-08-27T02:50:51.736002+0000","last_active":"2024-08-27T03:55:51.076538+0000","last_peered":"2024-08-27T03:55:51.076538+0000","last_clean":"2024-08-27T03:55:51.076538+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:55:51.076538+0000","last_undegraded":"2024-08-27T03:55:51.076538+0000","last_fullsized":"2024-08-27T03:55:51.076538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:07.337806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.278542+0000","last_change":"2024-08-27T02:46:49.656326+0000","last_active":"2024-08-27T03:54:20.278542+0000","last_peered":"2024-08-27T03:54:20.278542+0000","last_clean":"2024-08-27T03:54:20.278542+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:54:20.278542+0000","last_undegraded":"2024-08-27T03:54:20.278542+0000","last_fullsized":"2024-08-27T03:54:20.278542+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:12:37.739208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299649+0000","last_change":"2024-08-27T03:10:45.282178+0000","last_active":"2024-08-27T03:55:45.299649+0000","last_peered":"2024-08-27T03:55:45.299649+0000","last_clean":"2024-08-27T03:55:45.299649+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:55:45.299649+0000","last_undegraded":"2024-08-27T03:55:45.299649+0000","last_fullsized":"2024-08-27T03:55:45.299649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:24:50.331973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:26.109697+0000","last_change":"2024-08-27T02:50:55.769877+0000","last_active":"2024-08-27T03:58:26.109697+0000","last_peered":"2024-08-27T03:58:26.109697+0000","last_clean":"2024-08-27T03:58:26.109697+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:58:26.109697+0000","last_undegraded":"2024-08-27T03:58:26.109697+0000","last_fullsized":"2024-08-27T03:58:26.109697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:43:34.441494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'11","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.743519+0000","last_change":"2024-08-27T02:50:51.706023+0000","last_active":"2024-08-27T03:58:29.743519+0000","last_peered":"2024-08-27T03:58:29.743519+0000","last_clean":"2024-08-27T03:58:29.743519+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:58:29.743519+0000","last_undegraded":"2024-08-27T03:58:29.743519+0000","last_fullsized":"2024-08-27T03:58:29.743519+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:01:06.191127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900237+0000","last_change":"2024-08-27T02:46:49.681215+0000","last_active":"2024-08-27T03:56:09.900237+0000","last_peered":"2024-08-27T03:56:09.900237+0000","last_clean":"2024-08-27T03:56:09.900237+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:56:09.900237+0000","last_undegraded":"2024-08-27T03:56:09.900237+0000","last_fullsized":"2024-08-27T03:56:09.900237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:59.655983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294482+0000","last_change":"2024-08-27T03:10:45.266749+0000","last_active":"2024-08-27T03:55:45.294482+0000","last_peered":"2024-08-27T03:55:45.294482+0000","last_clean":"2024-08-27T03:55:45.294482+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:55:45.294482+0000","last_undegraded":"2024-08-27T03:55:45.294482+0000","last_fullsized":"2024-08-27T03:55:45.294482+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:25:14.767363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307348+0000","last_change":"2024-08-27T02:50:55.806234+0000","last_active":"2024-08-27T03:56:15.307348+0000","last_peered":"2024-08-27T03:56:15.307348+0000","last_clean":"2024-08-27T03:56:15.307348+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:56:15.307348+0000","last_undegraded":"2024-08-27T03:56:15.307348+0000","last_fullsized":"2024-08-27T03:56:15.307348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:26.269206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128113+0000","last_change":"2024-08-27T02:50:51.727708+0000","last_active":"2024-08-27T03:58:25.128113+0000","last_peered":"2024-08-27T03:58:25.128113+0000","last_clean":"2024-08-27T03:58:25.128113+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:58:25.128113+0000","last_undegraded":"2024-08-27T03:58:25.128113+0000","last_fullsized":"2024-08-27T03:58:25.128113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:26:00.265762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461291+0000","last_change":"2024-08-27T02:46:49.658797+0000","last_active":"2024-08-27T03:56:10.461291+0000","last_peered":"2024-08-27T03:56:10.461291+0000","last_clean":"2024-08-27T03:56:10.461291+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:56:10.461291+0000","last_undegraded":"2024-08-27T03:56:10.461291+0000","last_fullsized":"2024-08-27T03:56:10.461291+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:21.705436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.280973+0000","last_change":"2024-08-27T03:10:45.299158+0000","last_active":"2024-08-27T03:54:30.280973+0000","last_peered":"2024-08-27T03:54:30.280973+0000","last_clean":"2024-08-27T03:54:30.280973+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:54:30.280973+0000","last_undegraded":"2024-08-27T03:54:30.280973+0000","last_fullsized":"2024-08-27T03:54:30.280973+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:52:58.039454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294519+0000","last_change":"2024-08-27T02:50:55.778021+0000","last_active":"2024-08-27T03:55:45.294519+0000","last_peered":"2024-08-27T03:55:45.294519+0000","last_clean":"2024-08-27T03:55:45.294519+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:55:45.294519+0000","last_undegraded":"2024-08-27T03:55:45.294519+0000","last_fullsized":"2024-08-27T03:55:45.294519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:18:53.906397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.295971+0000","last_change":"2024-08-27T02:50:51.715619+0000","last_active":"2024-08-27T03:55:30.295971+0000","last_peered":"2024-08-27T03:55:30.295971+0000","last_clean":"2024-08-27T03:55:30.295971+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:55:30.295971+0000","last_undegraded":"2024-08-27T03:55:30.295971+0000","last_fullsized":"2024-08-27T03:55:30.295971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:22:37.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300942+0000","last_change":"2024-08-27T02:46:49.677851+0000","last_active":"2024-08-27T03:56:10.300942+0000","last_peered":"2024-08-27T03:56:10.300942+0000","last_clean":"2024-08-27T03:56:10.300942+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:56:10.300942+0000","last_undegraded":"2024-08-27T03:56:10.300942+0000","last_fullsized":"2024-08-27T03:56:10.300942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:32.601632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858095+0000","last_change":"2024-08-27T03:10:45.277501+0000","last_active":"2024-08-27T03:54:29.858095+0000","last_peered":"2024-08-27T03:54:29.858095+0000","last_clean":"2024-08-27T03:54:29.858095+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:54:29.858095+0000","last_undegraded":"2024-08-27T03:54:29.858095+0000","last_fullsized":"2024-08-27T03:54:29.858095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:52:19.885914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290804+0000","last_change":"2024-08-27T02:50:55.775204+0000","last_active":"2024-08-27T03:55:30.290804+0000","last_peered":"2024-08-27T03:55:30.290804+0000","last_clean":"2024-08-27T03:55:30.290804+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:55:30.290804+0000","last_undegraded":"2024-08-27T03:55:30.290804+0000","last_fullsized":"2024-08-27T03:55:30.290804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:27:44.097101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:50.097883+0000","last_change":"2024-08-27T02:50:51.712535+0000","last_active":"2024-08-27T03:57:50.097883+0000","last_peered":"2024-08-27T03:57:50.097883+0000","last_clean":"2024-08-27T03:57:50.097883+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:57:50.097883+0000","last_undegraded":"2024-08-27T03:57:50.097883+0000","last_fullsized":"2024-08-27T03:57:50.097883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:06.145410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461503+0000","last_change":"2024-08-27T02:46:49.657230+0000","last_active":"2024-08-27T03:56:10.461503+0000","last_peered":"2024-08-27T03:56:10.461503+0000","last_clean":"2024-08-27T03:56:10.461503+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:56:10.461503+0000","last_undegraded":"2024-08-27T03:56:10.461503+0000","last_fullsized":"2024-08-27T03:56:10.461503+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:31.912789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:51.062718+0000","last_change":"2024-08-27T03:10:45.304634+0000","last_active":"2024-08-27T03:54:51.062718+0000","last_peered":"2024-08-27T03:54:51.062718+0000","last_clean":"2024-08-27T03:54:51.062718+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:54:51.062718+0000","last_undegraded":"2024-08-27T03:54:51.062718+0000","last_fullsized":"2024-08-27T03:54:51.062718+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:40.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302531+0000","last_change":"2024-08-27T02:50:55.800079+0000","last_active":"2024-08-27T03:55:55.302531+0000","last_peered":"2024-08-27T03:55:55.302531+0000","last_clean":"2024-08-27T03:55:55.302531+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:55:55.302531+0000","last_undegraded":"2024-08-27T03:55:55.302531+0000","last_fullsized":"2024-08-27T03:55:55.302531+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:24:12.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.878104+0000","last_change":"2024-08-27T02:50:51.722487+0000","last_active":"2024-08-27T03:55:54.878104+0000","last_peered":"2024-08-27T03:55:54.878104+0000","last_clean":"2024-08-27T03:55:54.878104+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:55:54.878104+0000","last_undegraded":"2024-08-27T03:55:54.878104+0000","last_fullsized":"2024-08-27T03:55:54.878104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:03.625739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302418+0000","last_change":"2024-08-27T02:46:49.670647+0000","last_active":"2024-08-27T03:55:55.302418+0000","last_peered":"2024-08-27T03:55:55.302418+0000","last_clean":"2024-08-27T03:55:55.302418+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:55:55.302418+0000","last_undegraded":"2024-08-27T03:55:55.302418+0000","last_fullsized":"2024-08-27T03:55:55.302418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:21:10.983060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072751+0000","last_change":"2024-08-27T03:10:45.294675+0000","last_active":"2024-08-27T03:54:30.072751+0000","last_peered":"2024-08-27T03:54:30.072751+0000","last_clean":"2024-08-27T03:54:30.072751+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:54:30.072751+0000","last_undegraded":"2024-08-27T03:54:30.072751+0000","last_fullsized":"2024-08-27T03:54:30.072751+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:48.670669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093451+0000","last_change":"2024-08-27T02:50:55.767291+0000","last_active":"2024-08-27T03:55:55.093451+0000","last_peered":"2024-08-27T03:55:55.093451+0000","last_clean":"2024-08-27T03:55:55.093451+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:55:55.093451+0000","last_undegraded":"2024-08-27T03:55:55.093451+0000","last_fullsized":"2024-08-27T03:55:55.093451+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:34.369306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302551+0000","last_change":"2024-08-27T02:50:51.715173+0000","last_active":"2024-08-27T03:55:55.302551+0000","last_peered":"2024-08-27T03:55:55.302551+0000","last_clean":"2024-08-27T03:55:55.302551+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:55:55.302551+0000","last_undegraded":"2024-08-27T03:55:55.302551+0000","last_fullsized":"2024-08-27T03:55:55.302551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:01:41.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.072924+0000","last_change":"2024-08-27T02:46:49.659905+0000","last_active":"2024-08-27T03:55:36.072924+0000","last_peered":"2024-08-27T03:55:36.072924+0000","last_clean":"2024-08-27T03:55:36.072924+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:55:36.072924+0000","last_undegraded":"2024-08-27T03:55:36.072924+0000","last_fullsized":"2024-08-27T03:55:36.072924+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:42:58.919137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.080081+0000","last_change":"2024-08-27T03:10:45.302257+0000","last_active":"2024-08-27T03:56:15.080081+0000","last_peered":"2024-08-27T03:56:15.080081+0000","last_clean":"2024-08-27T03:56:15.080081+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:56:15.080081+0000","last_undegraded":"2024-08-27T03:56:15.080081+0000","last_fullsized":"2024-08-27T03:56:15.080081+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:49:38.342418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.039145+0000","last_change":"2024-08-27T02:50:55.776653+0000","last_active":"2024-08-27T03:58:30.039145+0000","last_peered":"2024-08-27T03:58:30.039145+0000","last_clean":"2024-08-27T03:58:30.039145+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:58:30.039145+0000","last_undegraded":"2024-08-27T03:58:30.039145+0000","last_fullsized":"2024-08-27T03:58:30.039145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:30:47.655678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292165+0000","last_change":"2024-08-27T02:50:51.712698+0000","last_active":"2024-08-27T03:55:15.292165+0000","last_peered":"2024-08-27T03:55:15.292165+0000","last_clean":"2024-08-27T03:55:15.292165+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:55:15.292165+0000","last_undegraded":"2024-08-27T03:55:15.292165+0000","last_fullsized":"2024-08-27T03:55:15.292165+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:54.805987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873157+0000","last_change":"2024-08-27T02:46:49.666166+0000","last_active":"2024-08-27T03:55:34.873157+0000","last_peered":"2024-08-27T03:55:34.873157+0000","last_clean":"2024-08-27T03:55:34.873157+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:55:34.873157+0000","last_undegraded":"2024-08-27T03:55:34.873157+0000","last_fullsized":"2024-08-27T03:55:34.873157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:59:52.040406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.302157+0000","last_change":"2024-08-27T03:10:45.289668+0000","last_active":"2024-08-27T03:56:15.302157+0000","last_peered":"2024-08-27T03:56:15.302157+0000","last_clean":"2024-08-27T03:56:15.302157+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:56:15.302157+0000","last_undegraded":"2024-08-27T03:56:15.302157+0000","last_fullsized":"2024-08-27T03:56:15.302157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:24.929800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.868290+0000","last_change":"2024-08-27T02:50:55.777558+0000","last_active":"2024-08-27T03:55:14.868290+0000","last_peered":"2024-08-27T03:55:14.868290+0000","last_clean":"2024-08-27T03:55:14.868290+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:55:14.868290+0000","last_undegraded":"2024-08-27T03:55:14.868290+0000","last_fullsized":"2024-08-27T03:55:14.868290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:52.030335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.295837+0000","last_change":"2024-08-27T02:50:51.718684+0000","last_active":"2024-08-27T03:55:30.295837+0000","last_peered":"2024-08-27T03:55:30.295837+0000","last_clean":"2024-08-27T03:55:30.295837+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:55:30.295837+0000","last_undegraded":"2024-08-27T03:55:30.295837+0000","last_fullsized":"2024-08-27T03:55:30.295837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:58:00.220312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21053,"num_write":11,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.088488+0000","last_change":"2024-08-27T02:46:49.666930+0000","last_active":"2024-08-27T03:55:35.088488+0000","last_peered":"2024-08-27T03:55:35.088488+0000","last_clean":"2024-08-27T03:55:35.088488+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:55:35.088488+0000","last_undegraded":"2024-08-27T03:55:35.088488+0000","last_fullsized":"2024-08-27T03:55:35.088488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:46.255173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495870+0000","last_change":"2024-08-27T03:10:45.281649+0000","last_active":"2024-08-27T03:54:30.495870+0000","last_peered":"2024-08-27T03:54:30.495870+0000","last_clean":"2024-08-27T03:54:30.495870+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:54:30.495870+0000","last_undegraded":"2024-08-27T03:54:30.495870+0000","last_fullsized":"2024-08-27T03:54:30.495870+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:51:40.495289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.480110+0000","last_change":"2024-08-27T02:50:55.790207+0000","last_active":"2024-08-27T03:57:35.480110+0000","last_peered":"2024-08-27T03:57:35.480110+0000","last_clean":"2024-08-27T03:57:35.480110+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:57:35.480110+0000","last_undegraded":"2024-08-27T03:57:35.480110+0000","last_fullsized":"2024-08-27T03:57:35.480110+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:29.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070538+0000","last_change":"2024-08-27T02:50:51.740655+0000","last_active":"2024-08-27T03:55:26.070538+0000","last_peered":"2024-08-27T03:55:26.070538+0000","last_clean":"2024-08-27T03:55:26.070538+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:55:26.070538+0000","last_undegraded":"2024-08-27T03:55:26.070538+0000","last_fullsized":"2024-08-27T03:55:26.070538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.497115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.453720+0000","last_change":"2024-08-27T02:46:49.638555+0000","last_active":"2024-08-27T03:55:35.453720+0000","last_peered":"2024-08-27T03:55:35.453720+0000","last_clean":"2024-08-27T03:55:35.453720+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:55:35.453720+0000","last_undegraded":"2024-08-27T03:55:35.453720+0000","last_fullsized":"2024-08-27T03:55:35.453720+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:10.855684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.283538+0000","last_change":"2024-08-27T03:10:45.290709+0000","last_active":"2024-08-27T03:54:40.283538+0000","last_peered":"2024-08-27T03:54:40.283538+0000","last_clean":"2024-08-27T03:54:40.283538+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:54:40.283538+0000","last_undegraded":"2024-08-27T03:54:40.283538+0000","last_fullsized":"2024-08-27T03:54:40.283538+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:12:15.082820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.116553+0000","last_change":"2024-08-27T02:50:55.772109+0000","last_active":"2024-08-27T03:57:35.116553+0000","last_peered":"2024-08-27T03:57:35.116553+0000","last_clean":"2024-08-27T03:57:35.116553+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:57:35.116553+0000","last_undegraded":"2024-08-27T03:57:35.116553+0000","last_fullsized":"2024-08-27T03:57:35.116553+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:34.257753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.452715+0000","last_change":"2024-08-27T02:50:51.705872+0000","last_active":"2024-08-27T03:55:30.452715+0000","last_peered":"2024-08-27T03:55:30.452715+0000","last_clean":"2024-08-27T03:55:30.452715+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:55:30.452715+0000","last_undegraded":"2024-08-27T03:55:30.452715+0000","last_fullsized":"2024-08-27T03:55:30.452715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:55.217217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290820+0000","last_change":"2024-08-27T02:46:49.667612+0000","last_active":"2024-08-27T03:55:10.290820+0000","last_peered":"2024-08-27T03:55:10.290820+0000","last_clean":"2024-08-27T03:55:10.290820+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:55:10.290820+0000","last_undegraded":"2024-08-27T03:55:10.290820+0000","last_fullsized":"2024-08-27T03:55:10.290820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:31.706212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'281","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.198532+0000","last_change":"2024-08-27T02:31:04.495209+0000","last_active":"2024-08-27T03:58:30.198532+0000","last_peered":"2024-08-27T03:58:30.198532+0000","last_clean":"2024-08-27T03:58:30.198532+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:30.198532+0000","last_undegraded":"2024-08-27T03:58:30.198532+0000","last_fullsized":"2024-08-27T03:58:30.198532+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:38:11.148447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6300018,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":391,"num_read_kb":22191,"num_write":976,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'457","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.605860+0000","last_change":"2024-08-27T02:31:06.459589+0000","last_active":"2024-08-27T03:56:42.605860+0000","last_peered":"2024-08-27T03:56:42.605860+0000","last_clean":"2024-08-27T03:56:42.605860+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:56:42.605860+0000","last_undegraded":"2024-08-27T03:56:42.605860+0000","last_fullsized":"2024-08-27T03:56:42.605860+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:09.070330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'343","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.019124+0000","last_change":"2024-08-27T02:31:04.454947+0000","last_active":"2024-08-27T03:58:31.019124+0000","last_peered":"2024-08-27T03:58:31.019124+0000","last_clean":"2024-08-27T03:58:31.019124+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:31.019124+0000","last_undegraded":"2024-08-27T03:58:31.019124+0000","last_fullsized":"2024-08-27T03:58:31.019124+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:49.691799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11910763,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":605,"num_read_kb":39942,"num_write":1259,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'825","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.450685+0000","last_change":"2024-08-27T02:31:06.453930+0000","last_active":"2024-08-27T03:56:44.450685+0000","last_peered":"2024-08-27T03:56:44.450685+0000","last_clean":"2024-08-27T03:56:44.450685+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:56:44.450685+0000","last_undegraded":"2024-08-27T03:56:44.450685+0000","last_fullsized":"2024-08-27T03:56:44.450685+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:09.257638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'252","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.275414+0000","last_change":"2024-08-27T02:31:04.493891+0000","last_active":"2024-08-27T03:58:30.275414+0000","last_peered":"2024-08-27T03:58:30.275414+0000","last_clean":"2024-08-27T03:58:30.275414+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:30.275414+0000","last_undegraded":"2024-08-27T03:58:30.275414+0000","last_fullsized":"2024-08-27T03:58:30.275414+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:19:06.244262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292671,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":380,"num_read_kb":449,"num_write":890,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1216","reported_seq":2730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.360305+0000","last_change":"2024-08-27T02:31:06.464864+0000","last_active":"2024-08-27T03:54:25.360305+0000","last_peered":"2024-08-27T03:54:25.360305+0000","last_clean":"2024-08-27T03:54:25.360305+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:54:25.360305+0000","last_undegraded":"2024-08-27T03:54:25.360305+0000","last_fullsized":"2024-08-27T03:54:25.360305+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:57:06.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'281","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.838765+0000","last_change":"2024-08-27T02:31:04.469467+0000","last_active":"2024-08-27T03:58:29.838765+0000","last_peered":"2024-08-27T03:58:29.838765+0000","last_clean":"2024-08-27T03:58:29.838765+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:29.838765+0000","last_undegraded":"2024-08-27T03:58:29.838765+0000","last_fullsized":"2024-08-27T03:58:29.838765+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:20:36.614222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185945,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":522,"num_read_kb":3870,"num_write":1052,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'480","reported_seq":2134,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.441763+0000","last_change":"2024-08-27T02:31:06.457144+0000","last_active":"2024-08-27T03:56:44.441763+0000","last_peered":"2024-08-27T03:56:44.441763+0000","last_clean":"2024-08-27T03:56:44.441763+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:56:44.441763+0000","last_undegraded":"2024-08-27T03:56:44.441763+0000","last_fullsized":"2024-08-27T03:56:44.441763+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:55:40.220861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'353","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.236717+0000","last_change":"2024-08-27T02:31:04.489890+0000","last_active":"2024-08-27T03:58:30.236717+0000","last_peered":"2024-08-27T03:58:30.236717+0000","last_clean":"2024-08-27T03:58:30.236717+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:30.236717+0000","last_undegraded":"2024-08-27T03:58:30.236717+0000","last_fullsized":"2024-08-27T03:58:30.236717+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:07:25.086829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5744857,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":497,"num_read_kb":17279,"num_write":1167,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'493","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.525387+0000","last_change":"2024-08-27T02:31:06.469894+0000","last_active":"2024-08-27T03:56:44.525387+0000","last_peered":"2024-08-27T03:56:44.525387+0000","last_clean":"2024-08-27T03:56:44.525387+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:56:44.525387+0000","last_undegraded":"2024-08-27T03:56:44.525387+0000","last_fullsized":"2024-08-27T03:56:44.525387+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:32:27.240233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'274","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.722139+0000","last_change":"2024-08-27T02:31:04.451736+0000","last_active":"2024-08-27T03:58:29.722139+0000","last_peered":"2024-08-27T03:58:29.722139+0000","last_clean":"2024-08-27T03:58:29.722139+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:29.722139+0000","last_undegraded":"2024-08-27T03:58:29.722139+0000","last_fullsized":"2024-08-27T03:58:29.722139+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:49:13.433050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6967334,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":427,"num_read_kb":18973,"num_write":890,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.073015+0000","last_change":"2024-08-27T02:31:06.464775+0000","last_active":"2024-08-27T03:54:30.073015+0000","last_peered":"2024-08-27T03:54:30.073015+0000","last_clean":"2024-08-27T03:54:30.073015+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:54:30.073015+0000","last_undegraded":"2024-08-27T03:54:30.073015+0000","last_fullsized":"2024-08-27T03:54:30.073015+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:49:58.791418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'315","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.083172+0000","last_change":"2024-08-27T02:31:39.748095+0000","last_active":"2024-08-27T03:58:30.083172+0000","last_peered":"2024-08-27T03:58:30.083172+0000","last_clean":"2024-08-27T03:58:30.083172+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:30.083172+0000","last_undegraded":"2024-08-27T03:58:30.083172+0000","last_fullsized":"2024-08-27T03:58:30.083172+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:23:44.181903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10895133,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":497,"num_read_kb":18874,"num_write":1110,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'903","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.948193+0000","last_change":"2024-08-27T02:31:06.441463+0000","last_active":"2024-08-27T03:58:02.948193+0000","last_peered":"2024-08-27T03:58:02.948193+0000","last_clean":"2024-08-27T03:58:02.948193+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:02.948193+0000","last_undegraded":"2024-08-27T03:58:02.948193+0000","last_fullsized":"2024-08-27T03:58:02.948193+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:32:21.433480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'307","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.866449+0000","last_change":"2024-08-27T02:31:04.460911+0000","last_active":"2024-08-27T03:58:29.866449+0000","last_peered":"2024-08-27T03:58:29.866449+0000","last_clean":"2024-08-27T03:58:29.866449+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:29.866449+0000","last_undegraded":"2024-08-27T03:58:29.866449+0000","last_fullsized":"2024-08-27T03:58:29.866449+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:09.211873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":612034,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":537,"num_read_kb":6557,"num_write":1011,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'920","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057701+0000","last_change":"2024-08-27T02:31:06.459200+0000","last_active":"2024-08-27T03:54:30.057701+0000","last_peered":"2024-08-27T03:54:30.057701+0000","last_clean":"2024-08-27T03:54:30.057701+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:54:30.057701+0000","last_undegraded":"2024-08-27T03:54:30.057701+0000","last_fullsized":"2024-08-27T03:54:30.057701+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:09:01.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'768","reported_seq":2529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677234+0000","last_change":"2024-08-27T02:31:06.466669+0000","last_active":"2024-08-27T03:56:42.677234+0000","last_peered":"2024-08-27T03:56:42.677234+0000","last_clean":"2024-08-27T03:56:42.677234+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:56:42.677234+0000","last_undegraded":"2024-08-27T03:56:42.677234+0000","last_fullsized":"2024-08-27T03:56:42.677234+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:23:04.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'282","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.300827+0000","last_change":"2024-08-27T02:31:04.495961+0000","last_active":"2024-08-27T03:58:30.300827+0000","last_peered":"2024-08-27T03:58:30.300827+0000","last_clean":"2024-08-27T03:58:30.300827+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:30.300827+0000","last_undegraded":"2024-08-27T03:58:30.300827+0000","last_fullsized":"2024-08-27T03:58:30.300827+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.777645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325230,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":355,"num_read_kb":9002,"num_write":922,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'787","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290995+0000","last_change":"2024-08-27T02:31:06.454274+0000","last_active":"2024-08-27T03:55:10.290995+0000","last_peered":"2024-08-27T03:55:10.290995+0000","last_clean":"2024-08-27T03:55:10.290995+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:55:10.290995+0000","last_undegraded":"2024-08-27T03:55:10.290995+0000","last_fullsized":"2024-08-27T03:55:10.290995+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:09:59.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.355537+0000","last_change":"2024-08-27T02:31:04.457818+0000","last_active":"2024-08-27T03:58:30.355537+0000","last_peered":"2024-08-27T03:58:30.355537+0000","last_clean":"2024-08-27T03:58:30.355537+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:30.355537+0000","last_undegraded":"2024-08-27T03:58:30.355537+0000","last_fullsized":"2024-08-27T03:58:30.355537+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:01:36.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087207,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":630,"num_read_kb":8370,"num_write":1156,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'487","reported_seq":2244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873079+0000","last_change":"2024-08-27T02:31:06.447246+0000","last_active":"2024-08-27T03:55:34.873079+0000","last_peered":"2024-08-27T03:55:34.873079+0000","last_clean":"2024-08-27T03:55:34.873079+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:55:34.873079+0000","last_undegraded":"2024-08-27T03:55:34.873079+0000","last_fullsized":"2024-08-27T03:55:34.873079+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:18:22.098121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'304","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.402385+0000","last_change":"2024-08-27T02:31:39.807510+0000","last_active":"2024-08-27T03:58:30.402385+0000","last_peered":"2024-08-27T03:58:30.402385+0000","last_clean":"2024-08-27T03:58:30.402385+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:30.402385+0000","last_undegraded":"2024-08-27T03:58:30.402385+0000","last_fullsized":"2024-08-27T03:58:30.402385+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:54.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894162,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":496,"num_read_kb":11494,"num_write":1092,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'683","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.996353+0000","last_change":"2024-08-27T02:31:06.453083+0000","last_active":"2024-08-27T03:58:02.996353+0000","last_peered":"2024-08-27T03:58:02.996353+0000","last_clean":"2024-08-27T03:58:02.996353+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:02.996353+0000","last_undegraded":"2024-08-27T03:58:02.996353+0000","last_fullsized":"2024-08-27T03:58:02.996353+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:51:51.420652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'334","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.096602+0000","last_change":"2024-08-27T02:31:04.464917+0000","last_active":"2024-08-27T03:58:30.096602+0000","last_peered":"2024-08-27T03:58:30.096602+0000","last_clean":"2024-08-27T03:58:30.096602+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:30.096602+0000","last_undegraded":"2024-08-27T03:58:30.096602+0000","last_fullsized":"2024-08-27T03:58:30.096602+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:42.233736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319598,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":735,"num_read_kb":144736,"num_write":1160,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'477","reported_seq":2100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.520780+0000","last_change":"2024-08-27T02:31:06.456023+0000","last_active":"2024-08-27T03:56:44.520780+0000","last_peered":"2024-08-27T03:56:44.520780+0000","last_clean":"2024-08-27T03:56:44.520780+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:56:44.520780+0000","last_undegraded":"2024-08-27T03:56:44.520780+0000","last_fullsized":"2024-08-27T03:56:44.520780+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:57:03.958056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'285","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.820355+0000","last_change":"2024-08-27T02:31:04.450019+0000","last_active":"2024-08-27T03:58:29.820355+0000","last_peered":"2024-08-27T03:58:29.820355+0000","last_clean":"2024-08-27T03:58:29.820355+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:29.820355+0000","last_undegraded":"2024-08-27T03:58:29.820355+0000","last_fullsized":"2024-08-27T03:58:29.820355+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:26.736946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7210638,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":521,"num_read_kb":47085,"num_write":1015,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'764","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090961+0000","last_change":"2024-08-27T02:31:06.457069+0000","last_active":"2024-08-27T03:55:45.090961+0000","last_peered":"2024-08-27T03:55:45.090961+0000","last_clean":"2024-08-27T03:55:45.090961+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:55:45.090961+0000","last_undegraded":"2024-08-27T03:55:45.090961+0000","last_fullsized":"2024-08-27T03:55:45.090961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:48.523132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'295","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.231200+0000","last_change":"2024-08-27T02:31:04.456657+0000","last_active":"2024-08-27T03:58:30.231200+0000","last_peered":"2024-08-27T03:58:30.231200+0000","last_clean":"2024-08-27T03:58:30.231200+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:30.231200+0000","last_undegraded":"2024-08-27T03:58:30.231200+0000","last_fullsized":"2024-08-27T03:58:30.231200+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:01:15.039976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276318,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":435,"num_read_kb":14802,"num_write":958,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.850365+0000","last_change":"2024-08-27T02:31:14.508871+0000","last_active":"2024-08-27T03:56:44.850365+0000","last_peered":"2024-08-27T03:56:44.850365+0000","last_clean":"2024-08-27T03:56:44.850365+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:56:44.850365+0000","last_undegraded":"2024-08-27T03:56:44.850365+0000","last_fullsized":"2024-08-27T03:56:44.850365+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:53:01.791364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'626","reported_seq":2345,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.935016+0000","last_change":"2024-08-27T02:31:06.447319+0000","last_active":"2024-08-27T03:58:02.935016+0000","last_peered":"2024-08-27T03:58:02.935016+0000","last_clean":"2024-08-27T03:58:02.935016+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:02.935016+0000","last_undegraded":"2024-08-27T03:58:02.935016+0000","last_fullsized":"2024-08-27T03:58:02.935016+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:57.126762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'309","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.315319+0000","last_change":"2024-08-27T02:31:04.493003+0000","last_active":"2024-08-27T03:58:30.315319+0000","last_peered":"2024-08-27T03:58:30.315319+0000","last_clean":"2024-08-27T03:58:30.315319+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:30.315319+0000","last_undegraded":"2024-08-27T03:58:30.315319+0000","last_fullsized":"2024-08-27T03:58:30.315319+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:12:45.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973430,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":450,"num_read_kb":48225,"num_write":1093,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875703+0000","last_change":"2024-08-27T02:31:08.475606+0000","last_active":"2024-08-27T03:55:44.875703+0000","last_peered":"2024-08-27T03:55:44.875703+0000","last_clean":"2024-08-27T03:55:44.875703+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:55:44.875703+0000","last_undegraded":"2024-08-27T03:55:44.875703+0000","last_fullsized":"2024-08-27T03:55:44.875703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:10.435910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'368","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:10.327416+0000","last_change":"2024-08-27T02:31:10.474061+0000","last_active":"2024-08-27T03:58:10.327416+0000","last_peered":"2024-08-27T03:58:10.327416+0000","last_clean":"2024-08-27T03:58:10.327416+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:10.327416+0000","last_undegraded":"2024-08-27T03:58:10.327416+0000","last_fullsized":"2024-08-27T03:58:10.327416+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:14.597433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":577,"num_read_kb":1072,"num_write":454,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.301263+0000","last_change":"2024-08-27T02:31:12.513470+0000","last_active":"2024-08-27T03:55:50.301263+0000","last_peered":"2024-08-27T03:55:50.301263+0000","last_clean":"2024-08-27T03:55:50.301263+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:55:50.301263+0000","last_undegraded":"2024-08-27T03:55:50.301263+0000","last_fullsized":"2024-08-27T03:55:50.301263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.177108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'139","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.610770+0000","last_change":"2024-08-27T02:31:14.508729+0000","last_active":"2024-08-27T03:54:25.610770+0000","last_peered":"2024-08-27T03:54:25.610770+0000","last_clean":"2024-08-27T03:54:25.610770+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:54:25.610770+0000","last_undegraded":"2024-08-27T03:54:25.610770+0000","last_fullsized":"2024-08-27T03:54:25.610770+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:18.167802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'817","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875663+0000","last_change":"2024-08-27T02:31:06.451014+0000","last_active":"2024-08-27T03:55:44.875663+0000","last_peered":"2024-08-27T03:55:44.875663+0000","last_clean":"2024-08-27T03:55:44.875663+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:55:44.875663+0000","last_undegraded":"2024-08-27T03:55:44.875663+0000","last_fullsized":"2024-08-27T03:55:44.875663+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:34:38.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'278","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.325266+0000","last_change":"2024-08-27T02:31:04.492617+0000","last_active":"2024-08-27T03:58:30.325266+0000","last_peered":"2024-08-27T03:58:30.325266+0000","last_clean":"2024-08-27T03:58:30.325266+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:30.325266+0000","last_undegraded":"2024-08-27T03:58:30.325266+0000","last_fullsized":"2024-08-27T03:58:30.325266+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:51.730290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325188,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":355,"num_read_kb":13671,"num_write":912,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.892074+0000","last_change":"2024-08-27T02:31:08.444125+0000","last_active":"2024-08-27T03:55:34.892074+0000","last_peered":"2024-08-27T03:55:34.892074+0000","last_clean":"2024-08-27T03:55:34.892074+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:55:34.892074+0000","last_undegraded":"2024-08-27T03:55:34.892074+0000","last_fullsized":"2024-08-27T03:55:34.892074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:50.658905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'118","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.091053+0000","last_change":"2024-08-27T02:31:10.463462+0000","last_active":"2024-08-27T03:55:45.091053+0000","last_peered":"2024-08-27T03:55:45.091053+0000","last_clean":"2024-08-27T03:55:45.091053+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:55:45.091053+0000","last_undegraded":"2024-08-27T03:55:45.091053+0000","last_fullsized":"2024-08-27T03:55:45.091053+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:05.726630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.092259+0000","last_change":"2024-08-27T02:31:12.524180+0000","last_active":"2024-08-27T03:55:50.092259+0000","last_peered":"2024-08-27T03:55:50.092259+0000","last_clean":"2024-08-27T03:55:50.092259+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:55:50.092259+0000","last_undegraded":"2024-08-27T03:55:50.092259+0000","last_fullsized":"2024-08-27T03:55:50.092259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'140","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.401306+0000","last_change":"2024-08-27T02:31:14.511765+0000","last_active":"2024-08-27T03:56:44.401306+0000","last_peered":"2024-08-27T03:56:44.401306+0000","last_clean":"2024-08-27T03:56:44.401306+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:56:44.401306+0000","last_undegraded":"2024-08-27T03:56:44.401306+0000","last_fullsized":"2024-08-27T03:56:44.401306+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:18:47.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.523863+0000","last_change":"2024-08-27T02:31:06.450475+0000","last_active":"2024-08-27T03:56:44.523863+0000","last_peered":"2024-08-27T03:56:44.523863+0000","last_clean":"2024-08-27T03:56:44.523863+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:56:44.523863+0000","last_undegraded":"2024-08-27T03:56:44.523863+0000","last_fullsized":"2024-08-27T03:56:44.523863+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:57:34.146161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'335","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.050215+0000","last_change":"2024-08-27T02:31:38.759396+0000","last_active":"2024-08-27T03:58:30.050215+0000","last_peered":"2024-08-27T03:58:30.050215+0000","last_clean":"2024-08-27T03:58:30.050215+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:30.050215+0000","last_undegraded":"2024-08-27T03:58:30.050215+0000","last_fullsized":"2024-08-27T03:58:30.050215+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:50.384706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6417572,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":618,"num_read_kb":34085,"num_write":1208,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727614+0000","last_change":"2024-08-27T02:31:08.475047+0000","last_active":"2024-08-27T03:58:28.727614+0000","last_peered":"2024-08-27T03:58:28.727614+0000","last_clean":"2024-08-27T03:58:28.727614+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:58:28.727614+0000","last_undegraded":"2024-08-27T03:58:28.727614+0000","last_fullsized":"2024-08-27T03:58:28.727614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:00:07.644027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'154","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.068764+0000","last_change":"2024-08-27T02:31:10.464314+0000","last_active":"2024-08-27T03:55:25.068764+0000","last_peered":"2024-08-27T03:55:25.068764+0000","last_clean":"2024-08-27T03:55:25.068764+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:55:25.068764+0000","last_undegraded":"2024-08-27T03:55:25.068764+0000","last_fullsized":"2024-08-27T03:55:25.068764+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:19.772117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'697","reported_seq":2535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.988503+0000","last_change":"2024-08-27T02:31:12.509703+0000","last_active":"2024-08-27T03:58:28.988503+0000","last_peered":"2024-08-27T03:58:28.988503+0000","last_clean":"2024-08-27T03:58:28.988503+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:58:28.988503+0000","last_undegraded":"2024-08-27T03:58:28.988503+0000","last_fullsized":"2024-08-27T03:58:28.988503+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":601,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:41.710475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'177","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.636112+0000","last_change":"2024-08-27T02:31:15.025741+0000","last_active":"2024-08-27T03:58:02.636112+0000","last_peered":"2024-08-27T03:58:02.636112+0000","last_clean":"2024-08-27T03:58:02.636112+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:58:02.636112+0000","last_undegraded":"2024-08-27T03:58:02.636112+0000","last_fullsized":"2024-08-27T03:58:02.636112+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:42:35.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'582","reported_seq":2233,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.527277+0000","last_change":"2024-08-27T02:31:06.461256+0000","last_active":"2024-08-27T03:56:44.527277+0000","last_peered":"2024-08-27T03:56:44.527277+0000","last_clean":"2024-08-27T03:56:44.527277+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:56:44.527277+0000","last_undegraded":"2024-08-27T03:56:44.527277+0000","last_fullsized":"2024-08-27T03:56:44.527277+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:25:53.064370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'309","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.362891+0000","last_change":"2024-08-27T02:31:04.481742+0000","last_active":"2024-08-27T03:58:30.362891+0000","last_peered":"2024-08-27T03:58:30.362891+0000","last_clean":"2024-08-27T03:58:30.362891+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:30.362891+0000","last_undegraded":"2024-08-27T03:58:30.362891+0000","last_fullsized":"2024-08-27T03:58:30.362891+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:44:24.122491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":412,"num_read_kb":7479,"num_write":1086,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875767+0000","last_change":"2024-08-27T02:31:08.476876+0000","last_active":"2024-08-27T03:55:44.875767+0000","last_peered":"2024-08-27T03:55:44.875767+0000","last_clean":"2024-08-27T03:55:44.875767+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:55:44.875767+0000","last_undegraded":"2024-08-27T03:55:44.875767+0000","last_fullsized":"2024-08-27T03:55:44.875767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:49:16.770918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'290","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.333168+0000","last_change":"2024-08-27T02:31:10.638091+0000","last_active":"2024-08-27T03:58:30.333168+0000","last_peered":"2024-08-27T03:58:30.333168+0000","last_clean":"2024-08-27T03:58:30.333168+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:58:30.333168+0000","last_undegraded":"2024-08-27T03:58:30.333168+0000","last_fullsized":"2024-08-27T03:58:30.333168+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:14.620860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'728","reported_seq":2829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.998721+0000","last_change":"2024-08-27T02:31:12.505687+0000","last_active":"2024-08-27T03:58:28.998721+0000","last_peered":"2024-08-27T03:58:28.998721+0000","last_clean":"2024-08-27T03:58:28.998721+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:58:28.998721+0000","last_undegraded":"2024-08-27T03:58:28.998721+0000","last_fullsized":"2024-08-27T03:58:28.998721+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:36:59.690511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1267","reported_seq":2829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874236+0000","last_change":"2024-08-27T02:31:06.443724+0000","last_active":"2024-08-27T03:55:39.874236+0000","last_peered":"2024-08-27T03:55:39.874236+0000","last_clean":"2024-08-27T03:55:39.874236+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:55:39.874236+0000","last_undegraded":"2024-08-27T03:55:39.874236+0000","last_fullsized":"2024-08-27T03:55:39.874236+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:12:39.506534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'320","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.300512+0000","last_change":"2024-08-27T02:31:04.500120+0000","last_active":"2024-08-27T03:58:30.300512+0000","last_peered":"2024-08-27T03:58:30.300512+0000","last_clean":"2024-08-27T03:58:30.300512+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:30.300512+0000","last_undegraded":"2024-08-27T03:58:30.300512+0000","last_fullsized":"2024-08-27T03:58:30.300512+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:28:33.060344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6380157,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":489,"num_read_kb":34000,"num_write":1055,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.298359+0000","last_change":"2024-08-27T02:31:08.468116+0000","last_active":"2024-08-27T03:55:40.298359+0000","last_peered":"2024-08-27T03:55:40.298359+0000","last_clean":"2024-08-27T03:55:40.298359+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:55:40.298359+0000","last_undegraded":"2024-08-27T03:55:40.298359+0000","last_fullsized":"2024-08-27T03:55:40.298359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:43.021123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'395","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:14.911227+0000","last_change":"2024-08-27T02:31:10.633487+0000","last_active":"2024-08-27T03:58:14.911227+0000","last_peered":"2024-08-27T03:58:14.911227+0000","last_clean":"2024-08-27T03:58:14.911227+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:58:14.911227+0000","last_undegraded":"2024-08-27T03:58:14.911227+0000","last_fullsized":"2024-08-27T03:58:14.911227+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:27:37.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49315,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":621,"num_read_kb":1077,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058784+0000","last_change":"2024-08-27T02:31:12.508561+0000","last_active":"2024-08-27T03:54:31.058784+0000","last_peered":"2024-08-27T03:54:31.058784+0000","last_clean":"2024-08-27T03:54:31.058784+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:54:31.058784+0000","last_undegraded":"2024-08-27T03:54:31.058784+0000","last_fullsized":"2024-08-27T03:54:31.058784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:32:48.985390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'588","reported_seq":1428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929629+0000","last_change":"2024-08-27T02:31:14.510230+0000","last_active":"2024-08-27T03:58:03.929629+0000","last_peered":"2024-08-27T03:58:03.929629+0000","last_clean":"2024-08-27T03:58:03.929629+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:58:03.929629+0000","last_undegraded":"2024-08-27T03:58:03.929629+0000","last_fullsized":"2024-08-27T03:58:03.929629+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:05:59.246892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1455","reported_seq":2950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217533+0000","last_change":"2024-08-27T02:31:06.455483+0000","last_active":"2024-08-27T03:55:54.217533+0000","last_peered":"2024-08-27T03:55:54.217533+0000","last_clean":"2024-08-27T03:55:54.217533+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:55:54.217533+0000","last_undegraded":"2024-08-27T03:55:54.217533+0000","last_fullsized":"2024-08-27T03:55:54.217533+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:08.735623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'341","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.235733+0000","last_change":"2024-08-27T02:31:04.495144+0000","last_active":"2024-08-27T03:58:30.235733+0000","last_peered":"2024-08-27T03:58:30.235733+0000","last_clean":"2024-08-27T03:58:30.235733+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:30.235733+0000","last_undegraded":"2024-08-27T03:58:30.235733+0000","last_fullsized":"2024-08-27T03:58:30.235733+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:04:23.814829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2500262,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":612,"num_read_kb":2850,"num_write":1239,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072095+0000","last_change":"2024-08-27T02:31:08.461348+0000","last_active":"2024-08-27T03:55:40.072095+0000","last_peered":"2024-08-27T03:55:40.072095+0000","last_clean":"2024-08-27T03:55:40.072095+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:55:40.072095+0000","last_undegraded":"2024-08-27T03:55:40.072095+0000","last_fullsized":"2024-08-27T03:55:40.072095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:50.304151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'307","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.550654+0000","last_change":"2024-08-27T02:31:10.465779+0000","last_active":"2024-08-27T03:58:29.550654+0000","last_peered":"2024-08-27T03:58:29.550654+0000","last_clean":"2024-08-27T03:58:29.550654+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:58:29.550654+0000","last_undegraded":"2024-08-27T03:58:29.550654+0000","last_fullsized":"2024-08-27T03:58:29.550654+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:24:14.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900276+0000","last_change":"2024-08-27T02:31:12.506224+0000","last_active":"2024-08-27T03:56:09.900276+0000","last_peered":"2024-08-27T03:56:09.900276+0000","last_clean":"2024-08-27T03:56:09.900276+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:56:09.900276+0000","last_undegraded":"2024-08-27T03:56:09.900276+0000","last_fullsized":"2024-08-27T03:56:09.900276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:37.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2395","reported_seq":4229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:50.470481+0000","last_change":"2024-08-27T02:31:14.514506+0000","last_active":"2024-08-27T03:56:50.470481+0000","last_peered":"2024-08-27T03:56:50.470481+0000","last_clean":"2024-08-27T03:56:50.470481+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:56:50.470481+0000","last_undegraded":"2024-08-27T03:56:50.470481+0000","last_fullsized":"2024-08-27T03:56:50.470481+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":2300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:49.198563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'439","reported_seq":1936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.457107+0000","last_change":"2024-08-27T02:31:06.473831+0000","last_active":"2024-08-27T03:55:50.457107+0000","last_peered":"2024-08-27T03:55:50.457107+0000","last_clean":"2024-08-27T03:55:50.457107+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:55:50.457107+0000","last_undegraded":"2024-08-27T03:55:50.457107+0000","last_fullsized":"2024-08-27T03:55:50.457107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:34:41.312642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'308","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.250566+0000","last_change":"2024-08-27T02:31:04.501562+0000","last_active":"2024-08-27T03:58:30.250566+0000","last_peered":"2024-08-27T03:58:30.250566+0000","last_clean":"2024-08-27T03:58:30.250566+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:30.250566+0000","last_undegraded":"2024-08-27T03:58:30.250566+0000","last_fullsized":"2024-08-27T03:58:30.250566+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11452309,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":470,"num_read_kb":51263,"num_write":1101,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056621+0000","last_change":"2024-08-27T02:31:08.463300+0000","last_active":"2024-08-27T03:54:25.056621+0000","last_peered":"2024-08-27T03:54:25.056621+0000","last_clean":"2024-08-27T03:54:25.056621+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:54:25.056621+0000","last_undegraded":"2024-08-27T03:54:25.056621+0000","last_fullsized":"2024-08-27T03:54:25.056621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:03.773202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'357","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.903629+0000","last_change":"2024-08-27T02:31:10.476799+0000","last_active":"2024-08-27T03:58:03.903629+0000","last_peered":"2024-08-27T03:58:03.903629+0000","last_clean":"2024-08-27T03:58:03.903629+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:58:03.903629+0000","last_undegraded":"2024-08-27T03:58:03.903629+0000","last_fullsized":"2024-08-27T03:58:03.903629+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:52:11.386500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55253,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":570,"num_read_kb":1090,"num_write":450,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'718","reported_seq":4949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.002965+0000","last_change":"2024-08-27T02:31:12.515783+0000","last_active":"2024-08-27T03:58:29.002965+0000","last_peered":"2024-08-27T03:58:29.002965+0000","last_clean":"2024-08-27T03:58:29.002965+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:58:29.002965+0000","last_undegraded":"2024-08-27T03:58:29.002965+0000","last_fullsized":"2024-08-27T03:58:29.002965+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:57.983153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'170","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.633450+0000","last_change":"2024-08-27T02:31:14.512105+0000","last_active":"2024-08-27T03:58:02.633450+0000","last_peered":"2024-08-27T03:58:02.633450+0000","last_clean":"2024-08-27T03:58:02.633450+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:58:02.633450+0000","last_undegraded":"2024-08-27T03:58:02.633450+0000","last_fullsized":"2024-08-27T03:58:02.633450+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:45:04.697202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'798","reported_seq":2339,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.931076+0000","last_change":"2024-08-27T02:31:06.448300+0000","last_active":"2024-08-27T03:58:02.931076+0000","last_peered":"2024-08-27T03:58:02.931076+0000","last_clean":"2024-08-27T03:58:02.931076+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:02.931076+0000","last_undegraded":"2024-08-27T03:58:02.931076+0000","last_fullsized":"2024-08-27T03:58:02.931076+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:17.328531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'264","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.893918+0000","last_change":"2024-08-27T02:31:04.451589+0000","last_active":"2024-08-27T03:58:29.893918+0000","last_peered":"2024-08-27T03:58:29.893918+0000","last_clean":"2024-08-27T03:58:29.893918+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:29.893918+0000","last_undegraded":"2024-08-27T03:58:29.893918+0000","last_fullsized":"2024-08-27T03:58:29.893918+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:25.923987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6738883,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":331,"num_read_kb":7344,"num_write":921,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.075921+0000","last_change":"2024-08-27T02:31:08.455579+0000","last_active":"2024-08-27T03:55:55.075921+0000","last_peered":"2024-08-27T03:55:55.075921+0000","last_clean":"2024-08-27T03:55:55.075921+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:55:55.075921+0000","last_undegraded":"2024-08-27T03:55:55.075921+0000","last_fullsized":"2024-08-27T03:55:55.075921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:50:22.765293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'492","reported_seq":1164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.800742+0000","last_change":"2024-08-27T02:31:10.476948+0000","last_active":"2024-08-27T03:58:29.800742+0000","last_peered":"2024-08-27T03:58:29.800742+0000","last_clean":"2024-08-27T03:58:29.800742+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:58:29.800742+0000","last_undegraded":"2024-08-27T03:58:29.800742+0000","last_fullsized":"2024-08-27T03:58:29.800742+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:15:08.613306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":857,"num_read_kb":1955,"num_write":696,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073445+0000","last_change":"2024-08-27T02:31:12.497480+0000","last_active":"2024-08-27T03:55:45.073445+0000","last_peered":"2024-08-27T03:55:45.073445+0000","last_clean":"2024-08-27T03:55:45.073445+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:55:45.073445+0000","last_undegraded":"2024-08-27T03:55:45.073445+0000","last_fullsized":"2024-08-27T03:55:45.073445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:37:27.672439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'129","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.500987+0000","last_change":"2024-08-27T02:31:14.509810+0000","last_active":"2024-08-27T03:56:44.500987+0000","last_peered":"2024-08-27T03:56:44.500987+0000","last_clean":"2024-08-27T03:56:44.500987+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:56:44.500987+0000","last_undegraded":"2024-08-27T03:56:44.500987+0000","last_fullsized":"2024-08-27T03:56:44.500987+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:19:36.713125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'442","reported_seq":1971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071688+0000","last_change":"2024-08-27T02:31:06.467597+0000","last_active":"2024-08-27T03:54:25.071688+0000","last_peered":"2024-08-27T03:54:25.071688+0000","last_clean":"2024-08-27T03:54:25.071688+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:54:25.071688+0000","last_undegraded":"2024-08-27T03:54:25.071688+0000","last_fullsized":"2024-08-27T03:54:25.071688+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:25.304915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'283","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.864676+0000","last_change":"2024-08-27T02:31:04.477417+0000","last_active":"2024-08-27T03:58:29.864676+0000","last_peered":"2024-08-27T03:58:29.864676+0000","last_clean":"2024-08-27T03:58:29.864676+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:29.864676+0000","last_undegraded":"2024-08-27T03:58:29.864676+0000","last_fullsized":"2024-08-27T03:58:29.864676+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:14.347972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490767,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":410,"num_read_kb":3132,"num_write":1030,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056667+0000","last_change":"2024-08-27T02:31:08.455739+0000","last_active":"2024-08-27T03:54:25.056667+0000","last_peered":"2024-08-27T03:54:25.056667+0000","last_clean":"2024-08-27T03:54:25.056667+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:54:25.056667+0000","last_undegraded":"2024-08-27T03:54:25.056667+0000","last_fullsized":"2024-08-27T03:54:25.056667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:28.350091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.873334+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.873334+0000","last_peered":"2024-08-27T03:58:29.873334+0000","last_clean":"2024-08-27T03:58:29.873334+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:58:29.873334+0000","last_undegraded":"2024-08-27T03:58:29.873334+0000","last_fullsized":"2024-08-27T03:58:29.873334+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:05:17.996037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498208+0000","last_change":"2024-08-27T02:31:12.518013+0000","last_active":"2024-08-27T03:54:40.498208+0000","last_peered":"2024-08-27T03:54:40.498208+0000","last_clean":"2024-08-27T03:54:40.498208+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:54:40.498208+0000","last_undegraded":"2024-08-27T03:54:40.498208+0000","last_fullsized":"2024-08-27T03:54:40.498208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:06.086496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'122","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:39.920813+0000","last_change":"2024-08-27T02:31:14.508708+0000","last_active":"2024-08-27T03:57:39.920813+0000","last_peered":"2024-08-27T03:57:39.920813+0000","last_clean":"2024-08-27T03:57:39.920813+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:57:39.920813+0000","last_undegraded":"2024-08-27T03:57:39.920813+0000","last_fullsized":"2024-08-27T03:57:39.920813+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:18.139046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'303","reported_seq":1695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217612+0000","last_change":"2024-08-27T02:31:06.455458+0000","last_active":"2024-08-27T03:55:54.217612+0000","last_peered":"2024-08-27T03:55:54.217612+0000","last_clean":"2024-08-27T03:55:54.217612+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:55:54.217612+0000","last_undegraded":"2024-08-27T03:55:54.217612+0000","last_fullsized":"2024-08-27T03:55:54.217612+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:15.294777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'289","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.424136+0000","last_change":"2024-08-27T02:31:38.753790+0000","last_active":"2024-08-27T03:58:30.424136+0000","last_peered":"2024-08-27T03:58:30.424136+0000","last_clean":"2024-08-27T03:58:30.424136+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:30.424136+0000","last_undegraded":"2024-08-27T03:58:30.424136+0000","last_fullsized":"2024-08-27T03:58:30.424136+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:17:03.166739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1921,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":415,"num_read_kb":5526,"num_write":974,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:26.057616+0000","last_change":"2024-08-27T02:31:08.473152+0000","last_active":"2024-08-27T03:54:26.057616+0000","last_peered":"2024-08-27T03:54:26.057616+0000","last_clean":"2024-08-27T03:54:26.057616+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:54:26.057616+0000","last_undegraded":"2024-08-27T03:54:26.057616+0000","last_fullsized":"2024-08-27T03:54:26.057616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:14.881514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'377","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.317872+0000","last_change":"2024-08-27T02:31:10.462797+0000","last_active":"2024-08-27T03:58:29.317872+0000","last_peered":"2024-08-27T03:58:29.317872+0000","last_clean":"2024-08-27T03:58:29.317872+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:29.317872+0000","last_undegraded":"2024-08-27T03:58:29.317872+0000","last_fullsized":"2024-08-27T03:58:29.317872+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:33.566956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'670","reported_seq":2559,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.989770+0000","last_change":"2024-08-27T02:31:12.508008+0000","last_active":"2024-08-27T03:58:28.989770+0000","last_peered":"2024-08-27T03:58:28.989770+0000","last_clean":"2024-08-27T03:58:28.989770+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:28.989770+0000","last_undegraded":"2024-08-27T03:58:28.989770+0000","last_fullsized":"2024-08-27T03:58:28.989770+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:20.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'97","reported_seq":609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.307427+0000","last_change":"2024-08-27T02:31:14.503409+0000","last_active":"2024-08-27T03:56:40.307427+0000","last_peered":"2024-08-27T03:56:40.307427+0000","last_clean":"2024-08-27T03:56:40.307427+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:56:40.307427+0000","last_undegraded":"2024-08-27T03:56:40.307427+0000","last_fullsized":"2024-08-27T03:56:40.307427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:06:36.783130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'835","reported_seq":2581,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071793+0000","last_change":"2024-08-27T02:31:06.471655+0000","last_active":"2024-08-27T03:54:25.071793+0000","last_peered":"2024-08-27T03:54:25.071793+0000","last_clean":"2024-08-27T03:54:25.071793+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:54:25.071793+0000","last_undegraded":"2024-08-27T03:54:25.071793+0000","last_fullsized":"2024-08-27T03:54:25.071793+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:48:58.542463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'288","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.080550+0000","last_change":"2024-08-27T02:31:04.484468+0000","last_active":"2024-08-27T03:58:30.080550+0000","last_peered":"2024-08-27T03:58:30.080550+0000","last_clean":"2024-08-27T03:58:30.080550+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:30.080550+0000","last_undegraded":"2024-08-27T03:58:30.080550+0000","last_fullsized":"2024-08-27T03:58:30.080550+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:45:11.647025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6451730,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":762,"num_read_kb":112858,"num_write":1039,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.741436+0000","last_change":"2024-08-27T02:31:08.472253+0000","last_active":"2024-08-27T03:58:28.741436+0000","last_peered":"2024-08-27T03:58:28.741436+0000","last_clean":"2024-08-27T03:58:28.741436+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:28.741436+0000","last_undegraded":"2024-08-27T03:58:28.741436+0000","last_fullsized":"2024-08-27T03:58:28.741436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:32:23.121770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'117","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.870144+0000","last_change":"2024-08-27T02:31:10.637623+0000","last_active":"2024-08-27T03:54:24.870144+0000","last_peered":"2024-08-27T03:54:24.870144+0000","last_clean":"2024-08-27T03:54:24.870144+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:54:24.870144+0000","last_undegraded":"2024-08-27T03:54:24.870144+0000","last_fullsized":"2024-08-27T03:54:24.870144+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:20:41.856144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'691","reported_seq":3063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.994322+0000","last_change":"2024-08-27T02:31:12.491000+0000","last_active":"2024-08-27T03:58:28.994322+0000","last_peered":"2024-08-27T03:58:28.994322+0000","last_clean":"2024-08-27T03:58:28.994322+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:28.994322+0000","last_undegraded":"2024-08-27T03:58:28.994322+0000","last_fullsized":"2024-08-27T03:58:28.994322+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:38.876627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074108+0000","last_change":"2024-08-27T02:31:14.511270+0000","last_active":"2024-08-27T03:54:35.074108+0000","last_peered":"2024-08-27T03:54:35.074108+0000","last_clean":"2024-08-27T03:54:35.074108+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:54:35.074108+0000","last_undegraded":"2024-08-27T03:54:35.074108+0000","last_fullsized":"2024-08-27T03:54:35.074108+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:43.076037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2340,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:36.059935+0000","last_change":"2024-08-27T02:31:06.459516+0000","last_active":"2024-08-27T03:54:36.059935+0000","last_peered":"2024-08-27T03:54:36.059935+0000","last_clean":"2024-08-27T03:54:36.059935+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:54:36.059935+0000","last_undegraded":"2024-08-27T03:54:36.059935+0000","last_fullsized":"2024-08-27T03:54:36.059935+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:49:12.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'331","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.827904+0000","last_change":"2024-08-27T02:31:04.475738+0000","last_active":"2024-08-27T03:58:29.827904+0000","last_peered":"2024-08-27T03:58:29.827904+0000","last_clean":"2024-08-27T03:58:29.827904+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:29.827904+0000","last_undegraded":"2024-08-27T03:58:29.827904+0000","last_fullsized":"2024-08-27T03:58:29.827904+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:44:38.581586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426989,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":688,"num_read_kb":1676,"num_write":1165,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071772+0000","last_change":"2024-08-27T02:31:08.477595+0000","last_active":"2024-08-27T03:54:25.071772+0000","last_peered":"2024-08-27T03:54:25.071772+0000","last_clean":"2024-08-27T03:54:25.071772+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:54:25.071772+0000","last_undegraded":"2024-08-27T03:54:25.071772+0000","last_fullsized":"2024-08-27T03:54:25.071772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:59.236199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'398","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.890122+0000","last_change":"2024-08-27T02:31:10.469889+0000","last_active":"2024-08-27T03:58:03.890122+0000","last_peered":"2024-08-27T03:58:03.890122+0000","last_clean":"2024-08-27T03:58:03.890122+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:58:03.890122+0000","last_undegraded":"2024-08-27T03:58:03.890122+0000","last_fullsized":"2024-08-27T03:58:03.890122+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:10:03.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52725,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":617,"num_read_kb":1098,"num_write":480,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439768+0000","last_change":"2024-08-27T02:31:12.497988+0000","last_active":"2024-08-27T03:54:30.439768+0000","last_peered":"2024-08-27T03:54:30.439768+0000","last_clean":"2024-08-27T03:54:30.439768+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:54:30.439768+0000","last_undegraded":"2024-08-27T03:54:30.439768+0000","last_fullsized":"2024-08-27T03:54:30.439768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:13:47.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'228","reported_seq":770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:41.905788+0000","last_change":"2024-08-27T02:31:14.492927+0000","last_active":"2024-08-27T03:56:41.905788+0000","last_peered":"2024-08-27T03:56:41.905788+0000","last_clean":"2024-08-27T03:56:41.905788+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:56:41.905788+0000","last_undegraded":"2024-08-27T03:56:41.905788+0000","last_fullsized":"2024-08-27T03:56:41.905788+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:13.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'523","reported_seq":2133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.924936+0000","last_change":"2024-08-27T02:31:06.467157+0000","last_active":"2024-08-27T03:58:02.924936+0000","last_peered":"2024-08-27T03:58:02.924936+0000","last_clean":"2024-08-27T03:58:02.924936+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:02.924936+0000","last_undegraded":"2024-08-27T03:58:02.924936+0000","last_fullsized":"2024-08-27T03:58:02.924936+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:37.085886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290875+0000","last_change":"2024-08-27T02:30:47.729098+0000","last_active":"2024-08-27T03:55:10.290875+0000","last_peered":"2024-08-27T03:55:10.290875+0000","last_clean":"2024-08-27T03:55:10.290875+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:55:10.290875+0000","last_undegraded":"2024-08-27T03:55:10.290875+0000","last_fullsized":"2024-08-27T03:55:10.290875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_clean_scrub_stamp":"2024-08-27T02:30:46.155361+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:24.032204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884146+0000","last_change":"2024-08-27T02:30:54.230879+0000","last_active":"2024-08-27T03:56:19.884146+0000","last_peered":"2024-08-27T03:56:19.884146+0000","last_clean":"2024-08-27T03:56:19.884146+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:56:19.884146+0000","last_undegraded":"2024-08-27T03:56:19.884146+0000","last_fullsized":"2024-08-27T03:56:19.884146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:44:20.045106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'265","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.786697+0000","last_change":"2024-08-27T02:31:04.461391+0000","last_active":"2024-08-27T03:58:29.786697+0000","last_peered":"2024-08-27T03:58:29.786697+0000","last_clean":"2024-08-27T03:58:29.786697+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:29.786697+0000","last_undegraded":"2024-08-27T03:58:29.786697+0000","last_fullsized":"2024-08-27T03:58:29.786697+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:42:05.833893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10545208,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":686,"num_read_kb":118351,"num_write":983,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281099+0000","last_change":"2024-08-27T02:31:08.459311+0000","last_active":"2024-08-27T03:54:30.281099+0000","last_peered":"2024-08-27T03:54:30.281099+0000","last_clean":"2024-08-27T03:54:30.281099+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:54:30.281099+0000","last_undegraded":"2024-08-27T03:54:30.281099+0000","last_fullsized":"2024-08-27T03:54:30.281099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:59.553379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'721","reported_seq":1448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.071686+0000","last_change":"2024-08-27T02:31:10.463138+0000","last_active":"2024-08-27T03:58:29.071686+0000","last_peered":"2024-08-27T03:58:29.071686+0000","last_clean":"2024-08-27T03:58:29.071686+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:58:29.071686+0000","last_undegraded":"2024-08-27T03:58:29.071686+0000","last_fullsized":"2024-08-27T03:58:29.071686+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:46:40.351745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159854,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":2935,"num_write":1332,"num_write_kb":1163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294607+0000","last_change":"2024-08-27T02:31:12.521459+0000","last_active":"2024-08-27T03:55:45.294607+0000","last_peered":"2024-08-27T03:55:45.294607+0000","last_clean":"2024-08-27T03:55:45.294607+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:55:45.294607+0000","last_undegraded":"2024-08-27T03:55:45.294607+0000","last_fullsized":"2024-08-27T03:55:45.294607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:35:48.852493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'207","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.606155+0000","last_change":"2024-08-27T02:31:14.512251+0000","last_active":"2024-08-27T03:56:44.606155+0000","last_peered":"2024-08-27T03:56:44.606155+0000","last_clean":"2024-08-27T03:56:44.606155+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:56:44.606155+0000","last_undegraded":"2024-08-27T03:56:44.606155+0000","last_fullsized":"2024-08-27T03:56:44.606155+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:31.795991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1517","reported_seq":3073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.293279+0000","last_change":"2024-08-27T02:31:06.451054+0000","last_active":"2024-08-27T03:55:40.293279+0000","last_peered":"2024-08-27T03:55:40.293279+0000","last_clean":"2024-08-27T03:55:40.293279+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:55:40.293279+0000","last_undegraded":"2024-08-27T03:55:40.293279+0000","last_fullsized":"2024-08-27T03:55:40.293279+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:15:15.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292215+0000","last_change":"2024-08-27T02:30:54.329044+0000","last_active":"2024-08-27T03:55:15.292215+0000","last_peered":"2024-08-27T03:55:15.292215+0000","last_clean":"2024-08-27T03:55:15.292215+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:55:15.292215+0000","last_undegraded":"2024-08-27T03:55:15.292215+0000","last_fullsized":"2024-08-27T03:55:15.292215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:29.700171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.306400+0000","last_change":"2024-08-27T02:31:04.457791+0000","last_active":"2024-08-27T03:58:30.306400+0000","last_peered":"2024-08-27T03:58:30.306400+0000","last_clean":"2024-08-27T03:58:30.306400+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:30.306400+0000","last_undegraded":"2024-08-27T03:58:30.306400+0000","last_fullsized":"2024-08-27T03:58:30.306400+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:56.441080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750723,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":787,"num_read_kb":13511,"num_write":1080,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'5","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727332+0000","last_change":"2024-08-27T02:31:08.472147+0000","last_active":"2024-08-27T03:58:28.727332+0000","last_peered":"2024-08-27T03:58:28.727332+0000","last_clean":"2024-08-27T03:58:28.727332+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:28.727332+0000","last_undegraded":"2024-08-27T03:58:28.727332+0000","last_fullsized":"2024-08-27T03:58:28.727332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:05:58.557262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1334","reported_seq":3319,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.067019+0000","last_change":"2024-08-27T02:31:10.466706+0000","last_active":"2024-08-27T03:58:31.067019+0000","last_peered":"2024-08-27T03:58:31.067019+0000","last_clean":"2024-08-27T03:58:31.067019+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:31.067019+0000","last_undegraded":"2024-08-27T03:58:31.067019+0000","last_fullsized":"2024-08-27T03:58:31.067019+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:35.321692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145784,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2069,"num_read_kb":3907,"num_write":1257,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:55.287626+0000","last_change":"2024-08-27T02:31:12.508877+0000","last_active":"2024-08-27T03:54:55.287626+0000","last_peered":"2024-08-27T03:54:55.287626+0000","last_clean":"2024-08-27T03:54:55.287626+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:54:55.287626+0000","last_undegraded":"2024-08-27T03:54:55.287626+0000","last_fullsized":"2024-08-27T03:54:55.287626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:12.131410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'164","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929974+0000","last_change":"2024-08-27T02:31:15.023823+0000","last_active":"2024-08-27T03:58:03.929974+0000","last_peered":"2024-08-27T03:58:03.929974+0000","last_clean":"2024-08-27T03:58:03.929974+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:58:03.929974+0000","last_undegraded":"2024-08-27T03:58:03.929974+0000","last_fullsized":"2024-08-27T03:58:03.929974+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:40:47.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079130+0000","last_change":"2024-08-27T02:31:39.754692+0000","last_active":"2024-08-27T03:56:10.079130+0000","last_peered":"2024-08-27T03:56:10.079130+0000","last_clean":"2024-08-27T03:56:10.079130+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:56:10.079130+0000","last_undegraded":"2024-08-27T03:56:10.079130+0000","last_fullsized":"2024-08-27T03:56:10.079130+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:08:56.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:20.081115+0000","last_change":"2024-08-27T02:30:54.225706+0000","last_active":"2024-08-27T03:56:20.081115+0000","last_peered":"2024-08-27T03:56:20.081115+0000","last_clean":"2024-08-27T03:56:20.081115+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:56:20.081115+0000","last_undegraded":"2024-08-27T03:56:20.081115+0000","last_fullsized":"2024-08-27T03:56:20.081115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'379","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.074267+0000","last_change":"2024-08-27T02:31:04.461095+0000","last_active":"2024-08-27T03:58:31.074267+0000","last_peered":"2024-08-27T03:58:31.074267+0000","last_clean":"2024-08-27T03:58:31.074267+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:31.074267+0000","last_undegraded":"2024-08-27T03:58:31.074267+0000","last_fullsized":"2024-08-27T03:58:31.074267+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:26:18.748313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6616429,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":642,"num_read_kb":29599,"num_write":1249,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072448+0000","last_change":"2024-08-27T02:31:08.479508+0000","last_active":"2024-08-27T03:55:40.072448+0000","last_peered":"2024-08-27T03:55:40.072448+0000","last_clean":"2024-08-27T03:55:40.072448+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:55:40.072448+0000","last_undegraded":"2024-08-27T03:55:40.072448+0000","last_fullsized":"2024-08-27T03:55:40.072448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:21.994771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'327","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.502580+0000","last_change":"2024-08-27T02:31:10.637428+0000","last_active":"2024-08-27T03:58:03.502580+0000","last_peered":"2024-08-27T03:58:03.502580+0000","last_clean":"2024-08-27T03:58:03.502580+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:03.502580+0000","last_undegraded":"2024-08-27T03:58:03.502580+0000","last_fullsized":"2024-08-27T03:58:03.502580+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:29.250940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.496951+0000","last_change":"2024-08-27T02:31:12.518266+0000","last_active":"2024-08-27T03:54:35.496951+0000","last_peered":"2024-08-27T03:54:35.496951+0000","last_clean":"2024-08-27T03:54:35.496951+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:54:35.496951+0000","last_undegraded":"2024-08-27T03:54:35.496951+0000","last_fullsized":"2024-08-27T03:54:35.496951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:31:54.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'259","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.909802+0000","last_change":"2024-08-27T02:31:14.514321+0000","last_active":"2024-08-27T03:56:44.909802+0000","last_peered":"2024-08-27T03:56:44.909802+0000","last_clean":"2024-08-27T03:56:44.909802+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:56:44.909802+0000","last_undegraded":"2024-08-27T03:56:44.909802+0000","last_fullsized":"2024-08-27T03:56:44.909802+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:43:02.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.620203+0000","last_change":"2024-08-27T02:31:06.453284+0000","last_active":"2024-08-27T03:56:42.620203+0000","last_peered":"2024-08-27T03:56:42.620203+0000","last_clean":"2024-08-27T03:56:42.620203+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:56:42.620203+0000","last_undegraded":"2024-08-27T03:56:42.620203+0000","last_fullsized":"2024-08-27T03:56:42.620203+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:06:48.027363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884076+0000","last_change":"2024-08-27T02:30:54.233089+0000","last_active":"2024-08-27T03:56:19.884076+0000","last_peered":"2024-08-27T03:56:19.884076+0000","last_clean":"2024-08-27T03:56:19.884076+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:56:19.884076+0000","last_undegraded":"2024-08-27T03:56:19.884076+0000","last_fullsized":"2024-08-27T03:56:19.884076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'298","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.952485+0000","last_change":"2024-08-27T02:31:04.451624+0000","last_active":"2024-08-27T03:58:29.952485+0000","last_peered":"2024-08-27T03:58:29.952485+0000","last_clean":"2024-08-27T03:58:29.952485+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:29.952485+0000","last_undegraded":"2024-08-27T03:58:29.952485+0000","last_fullsized":"2024-08-27T03:58:29.952485+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:25:39.692713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5774713,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":378,"num_read_kb":9569,"num_write":1035,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498104+0000","last_change":"2024-08-27T02:31:08.469937+0000","last_active":"2024-08-27T03:54:40.498104+0000","last_peered":"2024-08-27T03:54:40.498104+0000","last_clean":"2024-08-27T03:54:40.498104+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:54:40.498104+0000","last_undegraded":"2024-08-27T03:54:40.498104+0000","last_fullsized":"2024-08-27T03:54:40.498104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:03.713631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'172","reported_seq":758,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:01.706772+0000","last_change":"2024-08-27T02:31:10.467429+0000","last_active":"2024-08-27T03:58:01.706772+0000","last_peered":"2024-08-27T03:58:01.706772+0000","last_clean":"2024-08-27T03:58:01.706772+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:58:01.706772+0000","last_undegraded":"2024-08-27T03:58:01.706772+0000","last_fullsized":"2024-08-27T03:58:01.706772+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.607849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.456113+0000","last_change":"2024-08-27T02:31:12.523339+0000","last_active":"2024-08-27T03:55:45.456113+0000","last_peered":"2024-08-27T03:55:45.456113+0000","last_clean":"2024-08-27T03:55:45.456113+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:55:45.456113+0000","last_undegraded":"2024-08-27T03:55:45.456113+0000","last_fullsized":"2024-08-27T03:55:45.456113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:50:38.396815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875506+0000","last_change":"2024-08-27T02:31:14.502543+0000","last_active":"2024-08-27T03:55:44.875506+0000","last_peered":"2024-08-27T03:55:44.875506+0000","last_clean":"2024-08-27T03:55:44.875506+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:55:44.875506+0000","last_undegraded":"2024-08-27T03:55:44.875506+0000","last_fullsized":"2024-08-27T03:55:44.875506+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:40:33.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1261","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:26.057489+0000","last_change":"2024-08-27T02:31:06.436150+0000","last_active":"2024-08-27T03:54:26.057489+0000","last_peered":"2024-08-27T03:54:26.057489+0000","last_clean":"2024-08-27T03:54:26.057489+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:54:26.057489+0000","last_undegraded":"2024-08-27T03:54:26.057489+0000","last_fullsized":"2024-08-27T03:54:26.057489+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:19:53.560315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'294","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.829572+0000","last_change":"2024-08-27T02:31:04.450049+0000","last_active":"2024-08-27T03:58:29.829572+0000","last_peered":"2024-08-27T03:58:29.829572+0000","last_clean":"2024-08-27T03:58:29.829572+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:29.829572+0000","last_undegraded":"2024-08-27T03:58:29.829572+0000","last_fullsized":"2024-08-27T03:58:29.829572+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:23:00.868698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55139,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":426,"num_read_kb":946,"num_write":1062,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:21.083627+0000","last_change":"2024-08-27T02:30:54.235714+0000","last_active":"2024-08-27T03:56:21.083627+0000","last_peered":"2024-08-27T03:56:21.083627+0000","last_clean":"2024-08-27T03:56:21.083627+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:56:21.083627+0000","last_undegraded":"2024-08-27T03:56:21.083627+0000","last_fullsized":"2024-08-27T03:56:21.083627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:03:53.967353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495848+0000","last_change":"2024-08-27T02:31:08.472606+0000","last_active":"2024-08-27T03:54:30.495848+0000","last_peered":"2024-08-27T03:54:30.495848+0000","last_clean":"2024-08-27T03:54:30.495848+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:54:30.495848+0000","last_undegraded":"2024-08-27T03:54:30.495848+0000","last_fullsized":"2024-08-27T03:54:30.495848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:53.292285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'660","reported_seq":1379,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.217500+0000","last_change":"2024-08-27T02:31:10.465002+0000","last_active":"2024-08-27T03:58:29.217500+0000","last_peered":"2024-08-27T03:58:29.217500+0000","last_clean":"2024-08-27T03:58:29.217500+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:29.217500+0000","last_undegraded":"2024-08-27T03:58:29.217500+0000","last_fullsized":"2024-08-27T03:58:29.217500+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:48:12.137313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102880,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1767,"num_read_kb":2826,"num_write":2346,"num_write_kb":2122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074054+0000","last_change":"2024-08-27T02:31:12.500222+0000","last_active":"2024-08-27T03:54:35.074054+0000","last_peered":"2024-08-27T03:54:35.074054+0000","last_clean":"2024-08-27T03:54:35.074054+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:54:35.074054+0000","last_undegraded":"2024-08-27T03:54:35.074054+0000","last_fullsized":"2024-08-27T03:54:35.074054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:27:56.971452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'145","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.589165+0000","last_change":"2024-08-27T02:31:15.026476+0000","last_active":"2024-08-27T03:56:38.589165+0000","last_peered":"2024-08-27T03:56:38.589165+0000","last_clean":"2024-08-27T03:56:38.589165+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:56:38.589165+0000","last_undegraded":"2024-08-27T03:56:38.589165+0000","last_fullsized":"2024-08-27T03:56:38.589165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:06.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'759","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495829+0000","last_change":"2024-08-27T02:31:06.443554+0000","last_active":"2024-08-27T03:54:30.495829+0000","last_peered":"2024-08-27T03:54:30.495829+0000","last_clean":"2024-08-27T03:54:30.495829+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:54:30.495829+0000","last_undegraded":"2024-08-27T03:54:30.495829+0000","last_fullsized":"2024-08-27T03:54:30.495829+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:41.381628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'351","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.061321+0000","last_change":"2024-08-27T02:31:04.460588+0000","last_active":"2024-08-27T03:58:31.061321+0000","last_peered":"2024-08-27T03:58:31.061321+0000","last_clean":"2024-08-27T03:58:31.061321+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:31.061321+0000","last_undegraded":"2024-08-27T03:58:31.061321+0000","last_fullsized":"2024-08-27T03:58:31.061321+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:03:48.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255012,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":601,"num_read_kb":96021,"num_write":1165,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.282226+0000","last_change":"2024-08-27T02:30:54.329145+0000","last_active":"2024-08-27T03:54:35.282226+0000","last_peered":"2024-08-27T03:54:35.282226+0000","last_clean":"2024-08-27T03:54:35.282226+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:54:35.282226+0000","last_undegraded":"2024-08-27T03:54:35.282226+0000","last_fullsized":"2024-08-27T03:54:35.282226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:09:53.126738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439720+0000","last_change":"2024-08-27T02:31:08.465815+0000","last_active":"2024-08-27T03:54:30.439720+0000","last_peered":"2024-08-27T03:54:30.439720+0000","last_clean":"2024-08-27T03:54:30.439720+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:54:30.439720+0000","last_undegraded":"2024-08-27T03:54:30.439720+0000","last_fullsized":"2024-08-27T03:54:30.439720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:07:29.803901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'213","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058735+0000","last_change":"2024-08-27T02:31:10.635979+0000","last_active":"2024-08-27T03:54:31.058735+0000","last_peered":"2024-08-27T03:54:31.058735+0000","last_clean":"2024-08-27T03:54:31.058735+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:54:31.058735+0000","last_undegraded":"2024-08-27T03:54:31.058735+0000","last_fullsized":"2024-08-27T03:54:31.058735+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:42.747005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'718","reported_seq":2957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.985171+0000","last_change":"2024-08-27T02:31:12.507006+0000","last_active":"2024-08-27T03:58:28.985171+0000","last_peered":"2024-08-27T03:58:28.985171+0000","last_clean":"2024-08-27T03:58:28.985171+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:58:28.985171+0000","last_undegraded":"2024-08-27T03:58:28.985171+0000","last_fullsized":"2024-08-27T03:58:28.985171+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:59.445792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:09.915872+0000","last_change":"2024-08-27T02:31:15.023353+0000","last_active":"2024-08-27T03:57:09.915872+0000","last_peered":"2024-08-27T03:57:09.915872+0000","last_clean":"2024-08-27T03:57:09.915872+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:57:09.915872+0000","last_undegraded":"2024-08-27T03:57:09.915872+0000","last_fullsized":"2024-08-27T03:57:09.915872+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:35:33.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'409","reported_seq":1935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891884+0000","last_change":"2024-08-27T02:31:06.459269+0000","last_active":"2024-08-27T03:55:34.891884+0000","last_peered":"2024-08-27T03:55:34.891884+0000","last_clean":"2024-08-27T03:55:34.891884+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:55:34.891884+0000","last_undegraded":"2024-08-27T03:55:34.891884+0000","last_fullsized":"2024-08-27T03:55:34.891884+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.224368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'287","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.926929+0000","last_change":"2024-08-27T02:31:04.477646+0000","last_active":"2024-08-27T03:58:29.926929+0000","last_peered":"2024-08-27T03:58:29.926929+0000","last_clean":"2024-08-27T03:58:29.926929+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:29.926929+0000","last_undegraded":"2024-08-27T03:58:29.926929+0000","last_fullsized":"2024-08-27T03:58:29.926929+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:45.643961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114302,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":459,"num_read_kb":4604,"num_write":975,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070645+0000","last_change":"2024-08-27T02:30:54.235830+0000","last_active":"2024-08-27T03:55:26.070645+0000","last_peered":"2024-08-27T03:55:26.070645+0000","last_clean":"2024-08-27T03:55:26.070645+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:55:26.070645+0000","last_undegraded":"2024-08-27T03:55:26.070645+0000","last_fullsized":"2024-08-27T03:55:26.070645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:16.134185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072798+0000","last_change":"2024-08-27T02:31:08.458894+0000","last_active":"2024-08-27T03:54:30.072798+0000","last_peered":"2024-08-27T03:54:30.072798+0000","last_clean":"2024-08-27T03:54:30.072798+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:54:30.072798+0000","last_undegraded":"2024-08-27T03:54:30.072798+0000","last_fullsized":"2024-08-27T03:54:30.072798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:30.416824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'160","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072928+0000","last_change":"2024-08-27T02:31:10.461453+0000","last_active":"2024-08-27T03:54:30.072928+0000","last_peered":"2024-08-27T03:54:30.072928+0000","last_clean":"2024-08-27T03:54:30.072928+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:54:30.072928+0000","last_undegraded":"2024-08-27T03:54:30.072928+0000","last_fullsized":"2024-08-27T03:54:30.072928+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:13.247299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'729","reported_seq":4712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.995663+0000","last_change":"2024-08-27T02:31:12.506051+0000","last_active":"2024-08-27T03:58:28.995663+0000","last_peered":"2024-08-27T03:58:28.995663+0000","last_clean":"2024-08-27T03:58:28.995663+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:58:28.995663+0000","last_undegraded":"2024-08-27T03:58:28.995663+0000","last_fullsized":"2024-08-27T03:58:28.995663+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:23:19.155039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'206","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.485251+0000","last_change":"2024-08-27T02:31:14.511228+0000","last_active":"2024-08-27T03:56:44.485251+0000","last_peered":"2024-08-27T03:56:44.485251+0000","last_clean":"2024-08-27T03:56:44.485251+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:56:44.485251+0000","last_undegraded":"2024-08-27T03:56:44.485251+0000","last_fullsized":"2024-08-27T03:56:44.485251+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:49:37.070870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'395","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217585+0000","last_change":"2024-08-27T02:31:06.439611+0000","last_active":"2024-08-27T03:55:54.217585+0000","last_peered":"2024-08-27T03:55:54.217585+0000","last_clean":"2024-08-27T03:55:54.217585+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:55:54.217585+0000","last_undegraded":"2024-08-27T03:55:54.217585+0000","last_fullsized":"2024-08-27T03:55:54.217585+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:00:53.658025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'311","reported_seq":967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.136785+0000","last_change":"2024-08-27T02:31:04.493690+0000","last_active":"2024-08-27T03:58:30.136785+0000","last_peered":"2024-08-27T03:58:30.136785+0000","last_clean":"2024-08-27T03:58:30.136785+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:30.136785+0000","last_undegraded":"2024-08-27T03:58:30.136785+0000","last_fullsized":"2024-08-27T03:58:30.136785+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:56.655781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2081743,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":421,"num_read_kb":35253,"num_write":1065,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.451652+0000","last_change":"2024-08-27T02:30:54.326308+0000","last_active":"2024-08-27T03:55:25.451652+0000","last_peered":"2024-08-27T03:55:25.451652+0000","last_clean":"2024-08-27T03:55:25.451652+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:55:25.451652+0000","last_undegraded":"2024-08-27T03:55:25.451652+0000","last_fullsized":"2024-08-27T03:55:25.451652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:39.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891808+0000","last_change":"2024-08-27T02:31:08.470557+0000","last_active":"2024-08-27T03:55:34.891808+0000","last_peered":"2024-08-27T03:55:34.891808+0000","last_clean":"2024-08-27T03:55:34.891808+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:55:34.891808+0000","last_undegraded":"2024-08-27T03:55:34.891808+0000","last_fullsized":"2024-08-27T03:55:34.891808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:16.200643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'793","reported_seq":1544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.184483+0000","last_change":"2024-08-27T02:31:10.635066+0000","last_active":"2024-08-27T03:58:30.184483+0000","last_peered":"2024-08-27T03:58:30.184483+0000","last_clean":"2024-08-27T03:58:30.184483+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:30.184483+0000","last_undegraded":"2024-08-27T03:58:30.184483+0000","last_fullsized":"2024-08-27T03:58:30.184483+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:14:49.402084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150718,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1403,"num_read_kb":3271,"num_write":1144,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:34.872717+0000","last_change":"2024-08-27T02:31:12.504645+0000","last_active":"2024-08-27T03:54:34.872717+0000","last_peered":"2024-08-27T03:54:34.872717+0000","last_clean":"2024-08-27T03:54:34.872717+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:54:34.872717+0000","last_undegraded":"2024-08-27T03:54:34.872717+0000","last_fullsized":"2024-08-27T03:54:34.872717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:57.439347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858183+0000","last_change":"2024-08-27T02:31:14.522454+0000","last_active":"2024-08-27T03:54:29.858183+0000","last_peered":"2024-08-27T03:54:29.858183+0000","last_clean":"2024-08-27T03:54:29.858183+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:54:29.858183+0000","last_undegraded":"2024-08-27T03:54:29.858183+0000","last_fullsized":"2024-08-27T03:54:29.858183+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:07.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'163","reported_seq":747,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.991063+0000","last_change":"2024-08-27T02:31:14.511332+0000","last_active":"2024-08-27T03:56:42.991063+0000","last_peered":"2024-08-27T03:56:42.991063+0000","last_clean":"2024-08-27T03:56:42.991063+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:56:42.991063+0000","last_undegraded":"2024-08-27T03:56:42.991063+0000","last_fullsized":"2024-08-27T03:56:42.991063+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:05:01.793333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'935","reported_seq":2440,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677370+0000","last_change":"2024-08-27T02:31:06.457663+0000","last_active":"2024-08-27T03:56:42.677370+0000","last_peered":"2024-08-27T03:56:42.677370+0000","last_clean":"2024-08-27T03:56:42.677370+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:56:42.677370+0000","last_undegraded":"2024-08-27T03:56:42.677370+0000","last_fullsized":"2024-08-27T03:56:42.677370+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:41.288217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'338","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.023357+0000","last_change":"2024-08-27T02:31:04.463717+0000","last_active":"2024-08-27T03:58:30.023357+0000","last_peered":"2024-08-27T03:58:30.023357+0000","last_clean":"2024-08-27T03:58:30.023357+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:30.023357+0000","last_undegraded":"2024-08-27T03:58:30.023357+0000","last_fullsized":"2024-08-27T03:58:30.023357+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:55:39.806434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263718,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":571,"num_read_kb":506,"num_write":1104,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:11.067136+0000","last_change":"2024-08-27T02:31:08.470840+0000","last_active":"2024-08-27T03:55:11.067136+0000","last_peered":"2024-08-27T03:55:11.067136+0000","last_clean":"2024-08-27T03:55:11.067136+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:55:11.067136+0000","last_undegraded":"2024-08-27T03:55:11.067136+0000","last_fullsized":"2024-08-27T03:55:11.067136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:02.714442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'277","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.899420+0000","last_change":"2024-08-27T02:31:10.463641+0000","last_active":"2024-08-27T03:58:03.899420+0000","last_peered":"2024-08-27T03:58:03.899420+0000","last_clean":"2024-08-27T03:58:03.899420+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:58:03.899420+0000","last_undegraded":"2024-08-27T03:58:03.899420+0000","last_fullsized":"2024-08-27T03:58:03.899420+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:35:43.609652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":874,"num_write":346,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.886578+0000","last_change":"2024-08-27T02:31:12.505279+0000","last_active":"2024-08-27T03:55:14.886578+0000","last_peered":"2024-08-27T03:55:14.886578+0000","last_clean":"2024-08-27T03:55:14.886578+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:55:14.886578+0000","last_undegraded":"2024-08-27T03:55:14.886578+0000","last_fullsized":"2024-08-27T03:55:14.886578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:41.364605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.893070+0000","last_change":"2024-08-27T02:31:14.521163+0000","last_active":"2024-08-27T03:55:39.893070+0000","last_peered":"2024-08-27T03:55:39.893070+0000","last_clean":"2024-08-27T03:55:39.893070+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:55:39.893070+0000","last_undegraded":"2024-08-27T03:55:39.893070+0000","last_fullsized":"2024-08-27T03:55:39.893070+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:59:46.536741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'377","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065840+0000","last_change":"2024-08-27T02:31:06.474269+0000","last_active":"2024-08-27T03:55:06.065840+0000","last_peered":"2024-08-27T03:55:06.065840+0000","last_clean":"2024-08-27T03:55:06.065840+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:55:06.065840+0000","last_undegraded":"2024-08-27T03:55:06.065840+0000","last_fullsized":"2024-08-27T03:55:06.065840+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:31:44.710331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'288","reported_seq":895,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.148282+0000","last_change":"2024-08-27T02:31:04.501132+0000","last_active":"2024-08-27T03:58:30.148282+0000","last_peered":"2024-08-27T03:58:30.148282+0000","last_clean":"2024-08-27T03:58:30.148282+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:30.148282+0000","last_undegraded":"2024-08-27T03:58:30.148282+0000","last_fullsized":"2024-08-27T03:58:30.148282+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:51.438866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31307,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":399,"num_read_kb":2061,"num_write":936,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.885122+0000","last_change":"2024-08-27T02:31:08.461957+0000","last_active":"2024-08-27T03:55:09.885122+0000","last_peered":"2024-08-27T03:55:09.885122+0000","last_clean":"2024-08-27T03:55:09.885122+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:55:09.885122+0000","last_undegraded":"2024-08-27T03:55:09.885122+0000","last_fullsized":"2024-08-27T03:55:09.885122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:42.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'55","reported_seq":585,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.285806+0000","last_change":"2024-08-27T02:31:10.464843+0000","last_active":"2024-08-27T03:55:10.285806+0000","last_peered":"2024-08-27T03:55:10.285806+0000","last_clean":"2024-08-27T03:55:10.285806+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:55:10.285806+0000","last_undegraded":"2024-08-27T03:55:10.285806+0000","last_fullsized":"2024-08-27T03:55:10.285806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:47:45.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292286+0000","last_change":"2024-08-27T02:31:12.506193+0000","last_active":"2024-08-27T03:55:15.292286+0000","last_peered":"2024-08-27T03:55:15.292286+0000","last_clean":"2024-08-27T03:55:15.292286+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:55:15.292286+0000","last_undegraded":"2024-08-27T03:55:15.292286+0000","last_fullsized":"2024-08-27T03:55:15.292286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:31:44.393834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'182","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.584739+0000","last_change":"2024-08-27T02:31:14.517907+0000","last_active":"2024-08-27T03:56:42.584739+0000","last_peered":"2024-08-27T03:56:42.584739+0000","last_clean":"2024-08-27T03:56:42.584739+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:56:42.584739+0000","last_undegraded":"2024-08-27T03:56:42.584739+0000","last_fullsized":"2024-08-27T03:56:42.584739+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:28.044838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'411","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.884819+0000","last_change":"2024-08-27T02:31:06.459463+0000","last_active":"2024-08-27T03:55:09.884819+0000","last_peered":"2024-08-27T03:55:09.884819+0000","last_clean":"2024-08-27T03:55:09.884819+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:55:09.884819+0000","last_undegraded":"2024-08-27T03:55:09.884819+0000","last_fullsized":"2024-08-27T03:55:09.884819+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:50:28.320442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'282","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.834385+0000","last_change":"2024-08-27T02:31:04.477014+0000","last_active":"2024-08-27T03:58:29.834385+0000","last_peered":"2024-08-27T03:58:29.834385+0000","last_clean":"2024-08-27T03:58:29.834385+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:29.834385+0000","last_undegraded":"2024-08-27T03:58:29.834385+0000","last_fullsized":"2024-08-27T03:58:29.834385+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:53:15.700336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11011652,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":411,"num_read_kb":30350,"num_write":983,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290942+0000","last_change":"2024-08-27T02:31:08.450903+0000","last_active":"2024-08-27T03:55:10.290942+0000","last_peered":"2024-08-27T03:55:10.290942+0000","last_clean":"2024-08-27T03:55:10.290942+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:55:10.290942+0000","last_undegraded":"2024-08-27T03:55:10.290942+0000","last_fullsized":"2024-08-27T03:55:10.290942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:21.462233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'337","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.871493+0000","last_change":"2024-08-27T02:31:10.467565+0000","last_active":"2024-08-27T03:58:03.871493+0000","last_peered":"2024-08-27T03:58:03.871493+0000","last_clean":"2024-08-27T03:58:03.871493+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:58:03.871493+0000","last_undegraded":"2024-08-27T03:58:03.871493+0000","last_fullsized":"2024-08-27T03:58:03.871493+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:04:40.132706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60998,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":557,"num_read_kb":1116,"num_write":444,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449445+0000","last_change":"2024-08-27T02:31:12.502528+0000","last_active":"2024-08-27T03:55:15.449445+0000","last_peered":"2024-08-27T03:55:15.449445+0000","last_clean":"2024-08-27T03:55:15.449445+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:55:15.449445+0000","last_undegraded":"2024-08-27T03:55:15.449445+0000","last_fullsized":"2024-08-27T03:55:15.449445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:14.781588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'114","reported_seq":626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847662+0000","last_change":"2024-08-27T02:31:14.521917+0000","last_active":"2024-08-27T03:53:44.847662+0000","last_peered":"2024-08-27T03:53:44.847662+0000","last_clean":"2024-08-27T03:53:44.847662+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:53:44.847662+0000","last_undegraded":"2024-08-27T03:53:44.847662+0000","last_fullsized":"2024-08-27T03:53:44.847662+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:08:19.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'418","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.908107+0000","last_change":"2024-08-27T02:31:06.451606+0000","last_active":"2024-08-27T03:58:02.908107+0000","last_peered":"2024-08-27T03:58:02.908107+0000","last_clean":"2024-08-27T03:58:02.908107+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:02.908107+0000","last_undegraded":"2024-08-27T03:58:02.908107+0000","last_fullsized":"2024-08-27T03:58:02.908107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:09:38.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'298","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.010900+0000","last_change":"2024-08-27T02:31:04.453573+0000","last_active":"2024-08-27T03:58:30.010900+0000","last_peered":"2024-08-27T03:58:30.010900+0000","last_clean":"2024-08-27T03:58:30.010900+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:30.010900+0000","last_undegraded":"2024-08-27T03:58:30.010900+0000","last_fullsized":"2024-08-27T03:58:30.010900+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:04.196182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1025086,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":416,"num_read_kb":16403,"num_write":1095,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.448286+0000","last_change":"2024-08-27T02:31:08.465448+0000","last_active":"2024-08-27T03:55:10.448286+0000","last_peered":"2024-08-27T03:55:10.448286+0000","last_clean":"2024-08-27T03:55:10.448286+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:55:10.448286+0000","last_undegraded":"2024-08-27T03:55:10.448286+0000","last_fullsized":"2024-08-27T03:55:10.448286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:16:51.893136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'281","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.033952+0000","last_change":"2024-08-27T02:31:10.476895+0000","last_active":"2024-08-27T03:58:30.033952+0000","last_peered":"2024-08-27T03:58:30.033952+0000","last_clean":"2024-08-27T03:58:30.033952+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:58:30.033952+0000","last_undegraded":"2024-08-27T03:58:30.033952+0000","last_fullsized":"2024-08-27T03:58:30.033952+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:34:48.785917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287158+0000","last_change":"2024-08-27T02:31:12.521407+0000","last_active":"2024-08-27T03:55:15.287158+0000","last_peered":"2024-08-27T03:55:15.287158+0000","last_clean":"2024-08-27T03:55:15.287158+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:55:15.287158+0000","last_undegraded":"2024-08-27T03:55:15.287158+0000","last_fullsized":"2024-08-27T03:55:15.287158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:41:44.290066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'836","reported_seq":2411,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215749+0000","last_change":"2024-08-27T02:31:06.459141+0000","last_active":"2024-08-27T03:55:54.215749+0000","last_peered":"2024-08-27T03:55:54.215749+0000","last_clean":"2024-08-27T03:55:54.215749+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:55:54.215749+0000","last_undegraded":"2024-08-27T03:55:54.215749+0000","last_fullsized":"2024-08-27T03:55:54.215749+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:38:51.610195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'373","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.886416+0000","last_change":"2024-08-27T02:31:04.437260+0000","last_active":"2024-08-27T03:58:29.886416+0000","last_peered":"2024-08-27T03:58:29.886416+0000","last_clean":"2024-08-27T03:58:29.886416+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:29.886416+0000","last_undegraded":"2024-08-27T03:58:29.886416+0000","last_fullsized":"2024-08-27T03:58:29.886416+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:58.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2130642,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":717,"num_read_kb":11072,"num_write":1329,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.289681+0000","last_change":"2024-08-27T02:31:08.460233+0000","last_active":"2024-08-27T03:55:25.289681+0000","last_peered":"2024-08-27T03:55:25.289681+0000","last_clean":"2024-08-27T03:55:25.289681+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:55:25.289681+0000","last_undegraded":"2024-08-27T03:55:25.289681+0000","last_fullsized":"2024-08-27T03:55:25.289681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:26.664269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'547","reported_seq":1203,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.953613+0000","last_change":"2024-08-27T02:31:10.471987+0000","last_active":"2024-08-27T03:58:29.953613+0000","last_peered":"2024-08-27T03:58:29.953613+0000","last_clean":"2024-08-27T03:58:29.953613+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:29.953613+0000","last_undegraded":"2024-08-27T03:58:29.953613+0000","last_fullsized":"2024-08-27T03:58:29.953613+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:10:16.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":977,"num_read_kb":2264,"num_write":852,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847691+0000","last_change":"2024-08-27T02:31:12.513046+0000","last_active":"2024-08-27T03:53:44.847691+0000","last_peered":"2024-08-27T03:53:44.847691+0000","last_clean":"2024-08-27T03:53:44.847691+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:53:44.847691+0000","last_undegraded":"2024-08-27T03:53:44.847691+0000","last_fullsized":"2024-08-27T03:53:44.847691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:14.240422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'140","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.320188+0000","last_change":"2024-08-27T02:31:15.026496+0000","last_active":"2024-08-27T03:56:39.320188+0000","last_peered":"2024-08-27T03:56:39.320188+0000","last_clean":"2024-08-27T03:56:39.320188+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:56:39.320188+0000","last_undegraded":"2024-08-27T03:56:39.320188+0000","last_fullsized":"2024-08-27T03:56:39.320188+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:25.778670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1179","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.212577+0000","last_change":"2024-08-27T02:31:06.444819+0000","last_active":"2024-08-27T03:55:54.212577+0000","last_peered":"2024-08-27T03:55:54.212577+0000","last_clean":"2024-08-27T03:55:54.212577+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:55:54.212577+0000","last_undegraded":"2024-08-27T03:55:54.212577+0000","last_fullsized":"2024-08-27T03:55:54.212577+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:12.874709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'328","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.080251+0000","last_change":"2024-08-27T02:31:04.452002+0000","last_active":"2024-08-27T03:58:31.080251+0000","last_peered":"2024-08-27T03:58:31.080251+0000","last_clean":"2024-08-27T03:58:31.080251+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:31.080251+0000","last_undegraded":"2024-08-27T03:58:31.080251+0000","last_fullsized":"2024-08-27T03:58:31.080251+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:54.064616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5598635,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":512,"num_read_kb":41676,"num_write":1072,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439838+0000","last_change":"2024-08-27T02:31:08.468006+0000","last_active":"2024-08-27T03:54:30.439838+0000","last_peered":"2024-08-27T03:54:30.439838+0000","last_clean":"2024-08-27T03:54:30.439838+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:54:30.439838+0000","last_undegraded":"2024-08-27T03:54:30.439838+0000","last_fullsized":"2024-08-27T03:54:30.439838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:40:17.372181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'350","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.104104+0000","last_change":"2024-08-27T02:31:10.477408+0000","last_active":"2024-08-27T03:58:30.104104+0000","last_peered":"2024-08-27T03:58:30.104104+0000","last_clean":"2024-08-27T03:58:30.104104+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:58:30.104104+0000","last_undegraded":"2024-08-27T03:58:30.104104+0000","last_fullsized":"2024-08-27T03:58:30.104104+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:59:29.617560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:46.048972+0000","last_change":"2024-08-27T02:31:12.493945+0000","last_active":"2024-08-27T03:53:46.048972+0000","last_peered":"2024-08-27T03:53:46.048972+0000","last_clean":"2024-08-27T03:53:46.048972+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:53:46.048972+0000","last_undegraded":"2024-08-27T03:53:46.048972+0000","last_fullsized":"2024-08-27T03:53:46.048972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449386+0000","last_change":"2024-08-27T02:31:14.521472+0000","last_active":"2024-08-27T03:55:15.449386+0000","last_peered":"2024-08-27T03:55:15.449386+0000","last_clean":"2024-08-27T03:55:15.449386+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:55:15.449386+0000","last_undegraded":"2024-08-27T03:55:15.449386+0000","last_fullsized":"2024-08-27T03:55:15.449386+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:13.751034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'696","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.472769+0000","last_change":"2024-08-27T02:31:06.446538+0000","last_active":"2024-08-27T03:56:44.472769+0000","last_peered":"2024-08-27T03:56:44.472769+0000","last_clean":"2024-08-27T03:56:44.472769+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:56:44.472769+0000","last_undegraded":"2024-08-27T03:56:44.472769+0000","last_fullsized":"2024-08-27T03:56:44.472769+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:59:31.607194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'296","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.096874+0000","last_change":"2024-08-27T02:31:04.486015+0000","last_active":"2024-08-27T03:58:30.096874+0000","last_peered":"2024-08-27T03:58:30.096874+0000","last_clean":"2024-08-27T03:58:30.096874+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:30.096874+0000","last_undegraded":"2024-08-27T03:58:30.096874+0000","last_fullsized":"2024-08-27T03:58:30.096874+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:24.013613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5264007,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":435,"num_read_kb":27839,"num_write":1080,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.061200+0000","last_change":"2024-08-27T02:31:08.461902+0000","last_active":"2024-08-27T03:53:40.061200+0000","last_peered":"2024-08-27T03:53:40.061200+0000","last_clean":"2024-08-27T03:53:40.061200+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:53:40.061200+0000","last_undegraded":"2024-08-27T03:53:40.061200+0000","last_fullsized":"2024-08-27T03:53:40.061200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:54:08.973943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'319","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.910261+0000","last_change":"2024-08-27T02:31:10.636027+0000","last_active":"2024-08-27T03:58:03.910261+0000","last_peered":"2024-08-27T03:58:03.910261+0000","last_clean":"2024-08-27T03:58:03.910261+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:58:03.910261+0000","last_undegraded":"2024-08-27T03:58:03.910261+0000","last_fullsized":"2024-08-27T03:58:03.910261+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:09:14.223534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79082,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":1091,"num_write":420,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:31.071793+0000","last_change":"2024-08-27T02:31:12.498318+0000","last_active":"2024-08-27T03:55:31.071793+0000","last_peered":"2024-08-27T03:55:31.071793+0000","last_clean":"2024-08-27T03:55:31.071793+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:55:31.071793+0000","last_undegraded":"2024-08-27T03:55:31.071793+0000","last_fullsized":"2024-08-27T03:55:31.071793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:41.474651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.928313+0000","last_change":"2024-08-27T02:31:14.521960+0000","last_active":"2024-08-27T03:58:03.928313+0000","last_peered":"2024-08-27T03:58:03.928313+0000","last_clean":"2024-08-27T03:58:03.928313+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:58:03.928313+0000","last_undegraded":"2024-08-27T03:58:03.928313+0000","last_fullsized":"2024-08-27T03:58:03.928313+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:38:31.904177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'789","reported_seq":2418,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:50.098393+0000","last_change":"2024-08-27T02:31:06.453981+0000","last_active":"2024-08-27T03:53:50.098393+0000","last_peered":"2024-08-27T03:53:50.098393+0000","last_clean":"2024-08-27T03:53:50.098393+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:53:50.098393+0000","last_undegraded":"2024-08-27T03:53:50.098393+0000","last_fullsized":"2024-08-27T03:53:50.098393+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:08.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'290","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.293948+0000","last_change":"2024-08-27T02:31:04.466853+0000","last_active":"2024-08-27T03:58:30.293948+0000","last_peered":"2024-08-27T03:58:30.293948+0000","last_clean":"2024-08-27T03:58:30.293948+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:30.293948+0000","last_undegraded":"2024-08-27T03:58:30.293948+0000","last_fullsized":"2024-08-27T03:58:30.293948+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:53:03.083121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432855,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":441,"num_read_kb":2807,"num_write":1035,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:41.048008+0000","last_change":"2024-08-27T02:31:08.471391+0000","last_active":"2024-08-27T03:53:41.048008+0000","last_peered":"2024-08-27T03:53:41.048008+0000","last_clean":"2024-08-27T03:53:41.048008+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:53:41.048008+0000","last_undegraded":"2024-08-27T03:53:41.048008+0000","last_fullsized":"2024-08-27T03:53:41.048008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:57.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'131","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.086304+0000","last_change":"2024-08-27T02:31:10.635520+0000","last_active":"2024-08-27T03:55:25.086304+0000","last_peered":"2024-08-27T03:55:25.086304+0000","last_clean":"2024-08-27T03:55:25.086304+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:55:25.086304+0000","last_undegraded":"2024-08-27T03:55:25.086304+0000","last_fullsized":"2024-08-27T03:55:25.086304+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:36:27.001114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'692","reported_seq":2817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.982163+0000","last_change":"2024-08-27T02:31:12.490737+0000","last_active":"2024-08-27T03:58:28.982163+0000","last_peered":"2024-08-27T03:58:28.982163+0000","last_clean":"2024-08-27T03:58:28.982163+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:28.982163+0000","last_undegraded":"2024-08-27T03:58:28.982163+0000","last_fullsized":"2024-08-27T03:58:28.982163+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:40.803189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'112","reported_seq":615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.583823+0000","last_change":"2024-08-27T02:31:14.516613+0000","last_active":"2024-08-27T03:56:38.583823+0000","last_peered":"2024-08-27T03:56:38.583823+0000","last_clean":"2024-08-27T03:56:38.583823+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:56:38.583823+0000","last_undegraded":"2024-08-27T03:56:38.583823+0000","last_fullsized":"2024-08-27T03:56:38.583823+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:26:30.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'786","reported_seq":2382,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:02.876625+0000","last_change":"2024-08-27T02:31:06.467671+0000","last_active":"2024-08-27T03:54:02.876625+0000","last_peered":"2024-08-27T03:54:02.876625+0000","last_clean":"2024-08-27T03:54:02.876625+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:54:02.876625+0000","last_undegraded":"2024-08-27T03:54:02.876625+0000","last_fullsized":"2024-08-27T03:54:02.876625+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:18:26.329266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'259","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.905414+0000","last_change":"2024-08-27T02:31:04.463606+0000","last_active":"2024-08-27T03:58:29.905414+0000","last_peered":"2024-08-27T03:58:29.905414+0000","last_clean":"2024-08-27T03:58:29.905414+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:29.905414+0000","last_undegraded":"2024-08-27T03:58:29.905414+0000","last_fullsized":"2024-08-27T03:58:29.905414+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:15.431577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555320,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":465,"num_read_kb":12943,"num_write":951,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.268711+0000","last_change":"2024-08-27T02:31:08.447203+0000","last_active":"2024-08-27T03:53:40.268711+0000","last_peered":"2024-08-27T03:53:40.268711+0000","last_clean":"2024-08-27T03:53:40.268711+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:53:40.268711+0000","last_undegraded":"2024-08-27T03:53:40.268711+0000","last_fullsized":"2024-08-27T03:53:40.268711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:41.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'379","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.396807+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.396807+0000","last_peered":"2024-08-27T03:58:29.396807+0000","last_clean":"2024-08-27T03:58:29.396807+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:58:29.396807+0000","last_undegraded":"2024-08-27T03:58:29.396807+0000","last_fullsized":"2024-08-27T03:58:29.396807+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:12.752267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.295363+0000","last_change":"2024-08-27T02:31:12.517594+0000","last_active":"2024-08-27T03:55:50.295363+0000","last_peered":"2024-08-27T03:55:50.295363+0000","last_clean":"2024-08-27T03:55:50.295363+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:55:50.295363+0000","last_undegraded":"2024-08-27T03:55:50.295363+0000","last_fullsized":"2024-08-27T03:55:50.295363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:58:27.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'112","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.818594+0000","last_change":"2024-08-27T02:31:14.523873+0000","last_active":"2024-08-27T03:56:44.818594+0000","last_peered":"2024-08-27T03:56:44.818594+0000","last_clean":"2024-08-27T03:56:44.818594+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:56:44.818594+0000","last_undegraded":"2024-08-27T03:56:44.818594+0000","last_fullsized":"2024-08-27T03:56:44.818594+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:56.720396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'372","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:53.153842+0000","last_change":"2024-08-27T02:31:06.465894+0000","last_active":"2024-08-27T03:53:53.153842+0000","last_peered":"2024-08-27T03:53:53.153842+0000","last_clean":"2024-08-27T03:53:53.153842+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:53:53.153842+0000","last_undegraded":"2024-08-27T03:53:53.153842+0000","last_fullsized":"2024-08-27T03:53:53.153842+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:23:38.612022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'289","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.843276+0000","last_change":"2024-08-27T02:31:04.450156+0000","last_active":"2024-08-27T03:58:29.843276+0000","last_peered":"2024-08-27T03:58:29.843276+0000","last_clean":"2024-08-27T03:58:29.843276+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:29.843276+0000","last_undegraded":"2024-08-27T03:58:29.843276+0000","last_fullsized":"2024-08-27T03:58:29.843276+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:04:33.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2501,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":438,"num_read_kb":8306,"num_write":1009,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:39.846494+0000","last_change":"2024-08-27T02:31:08.463927+0000","last_active":"2024-08-27T03:53:39.846494+0000","last_peered":"2024-08-27T03:53:39.846494+0000","last_clean":"2024-08-27T03:53:39.846494+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:53:39.846494+0000","last_undegraded":"2024-08-27T03:53:39.846494+0000","last_fullsized":"2024-08-27T03:53:39.846494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:31:34.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'268","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.468339+0000","last_change":"2024-08-27T02:31:10.470453+0000","last_active":"2024-08-27T03:58:29.468339+0000","last_peered":"2024-08-27T03:58:29.468339+0000","last_clean":"2024-08-27T03:58:29.468339+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:58:29.468339+0000","last_undegraded":"2024-08-27T03:58:29.468339+0000","last_fullsized":"2024-08-27T03:58:29.468339+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:46.212245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.459171+0000","last_change":"2024-08-27T02:31:12.494052+0000","last_active":"2024-08-27T03:56:00.459171+0000","last_peered":"2024-08-27T03:56:00.459171+0000","last_clean":"2024-08-27T03:56:00.459171+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:56:00.459171+0000","last_undegraded":"2024-08-27T03:56:00.459171+0000","last_fullsized":"2024-08-27T03:56:00.459171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:24.014947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'135","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.343269+0000","last_change":"2024-08-27T02:31:15.027895+0000","last_active":"2024-08-27T03:56:39.343269+0000","last_peered":"2024-08-27T03:56:39.343269+0000","last_clean":"2024-08-27T03:56:39.343269+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:56:39.343269+0000","last_undegraded":"2024-08-27T03:56:39.343269+0000","last_fullsized":"2024-08-27T03:56:39.343269+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:31:36.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'733","reported_seq":2227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.476464+0000","last_change":"2024-08-27T02:31:06.447002+0000","last_active":"2024-08-27T03:56:44.476464+0000","last_peered":"2024-08-27T03:56:44.476464+0000","last_clean":"2024-08-27T03:56:44.476464+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:56:44.476464+0000","last_undegraded":"2024-08-27T03:56:44.476464+0000","last_fullsized":"2024-08-27T03:56:44.476464+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:04.399827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'279","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.891388+0000","last_change":"2024-08-27T02:31:04.476828+0000","last_active":"2024-08-27T03:58:29.891388+0000","last_peered":"2024-08-27T03:58:29.891388+0000","last_clean":"2024-08-27T03:58:29.891388+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:29.891388+0000","last_undegraded":"2024-08-27T03:58:29.891388+0000","last_fullsized":"2024-08-27T03:58:29.891388+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:42:38.137890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54920,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":459,"num_read_kb":19461,"num_write":1068,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090711+0000","last_change":"2024-08-27T02:31:08.468289+0000","last_active":"2024-08-27T03:55:45.090711+0000","last_peered":"2024-08-27T03:55:45.090711+0000","last_clean":"2024-08-27T03:55:45.090711+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:55:45.090711+0000","last_undegraded":"2024-08-27T03:55:45.090711+0000","last_fullsized":"2024-08-27T03:55:45.090711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:51:14.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'275","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.904700+0000","last_change":"2024-08-27T02:31:10.474659+0000","last_active":"2024-08-27T03:58:03.904700+0000","last_peered":"2024-08-27T03:58:03.904700+0000","last_clean":"2024-08-27T03:58:03.904700+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:58:03.904700+0000","last_undegraded":"2024-08-27T03:58:03.904700+0000","last_fullsized":"2024-08-27T03:58:03.904700+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:14.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62250,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":458,"num_read_kb":1041,"num_write":384,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.062348+0000","last_change":"2024-08-27T02:31:12.494960+0000","last_active":"2024-08-27T03:53:45.062348+0000","last_peered":"2024-08-27T03:53:45.062348+0000","last_clean":"2024-08-27T03:53:45.062348+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:53:45.062348+0000","last_undegraded":"2024-08-27T03:53:45.062348+0000","last_fullsized":"2024-08-27T03:53:45.062348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:23.135684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'178","reported_seq":1652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.531902+0000","last_change":"2024-08-27T02:31:14.521123+0000","last_active":"2024-08-27T03:56:38.531902+0000","last_peered":"2024-08-27T03:56:38.531902+0000","last_clean":"2024-08-27T03:56:38.531902+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:56:38.531902+0000","last_undegraded":"2024-08-27T03:56:38.531902+0000","last_fullsized":"2024-08-27T03:56:38.531902+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:15.425652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'548","reported_seq":2365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090765+0000","last_change":"2024-08-27T02:31:06.457635+0000","last_active":"2024-08-27T03:55:45.090765+0000","last_peered":"2024-08-27T03:55:45.090765+0000","last_clean":"2024-08-27T03:55:45.090765+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:55:45.090765+0000","last_undegraded":"2024-08-27T03:55:45.090765+0000","last_fullsized":"2024-08-27T03:55:45.090765+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:15:48.872076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'267","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.221760+0000","last_change":"2024-08-27T02:31:38.758741+0000","last_active":"2024-08-27T03:58:30.221760+0000","last_peered":"2024-08-27T03:58:30.221760+0000","last_clean":"2024-08-27T03:58:30.221760+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:30.221760+0000","last_undegraded":"2024-08-27T03:58:30.221760+0000","last_fullsized":"2024-08-27T03:58:30.221760+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:08.057508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586726,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":462,"num_read_kb":5169,"num_write":992,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:01.078719+0000","last_change":"2024-08-27T02:31:08.471579+0000","last_active":"2024-08-27T03:56:01.078719+0000","last_peered":"2024-08-27T03:56:01.078719+0000","last_clean":"2024-08-27T03:56:01.078719+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:56:01.078719+0000","last_undegraded":"2024-08-27T03:56:01.078719+0000","last_fullsized":"2024-08-27T03:56:01.078719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:24.013362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'300","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.914655+0000","last_change":"2024-08-27T02:31:10.462249+0000","last_active":"2024-08-27T03:58:03.914655+0000","last_peered":"2024-08-27T03:58:03.914655+0000","last_clean":"2024-08-27T03:58:03.914655+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:58:03.914655+0000","last_undegraded":"2024-08-27T03:58:03.914655+0000","last_fullsized":"2024-08-27T03:58:03.914655+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:52:58.552884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":928,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.486117+0000","last_change":"2024-08-27T02:31:12.523057+0000","last_active":"2024-08-27T03:53:45.486117+0000","last_peered":"2024-08-27T03:53:45.486117+0000","last_clean":"2024-08-27T03:53:45.486117+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:53:45.486117+0000","last_undegraded":"2024-08-27T03:53:45.486117+0000","last_fullsized":"2024-08-27T03:53:45.486117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:12:26.836037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'144","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.904543+0000","last_change":"2024-08-27T02:31:14.506679+0000","last_active":"2024-08-27T03:58:02.904543+0000","last_peered":"2024-08-27T03:58:02.904543+0000","last_clean":"2024-08-27T03:58:02.904543+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:58:02.904543+0000","last_undegraded":"2024-08-27T03:58:02.904543+0000","last_fullsized":"2024-08-27T03:58:02.904543+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:33.099195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'732","reported_seq":2154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073279+0000","last_change":"2024-08-27T02:31:06.469294+0000","last_active":"2024-08-27T03:55:36.073279+0000","last_peered":"2024-08-27T03:55:36.073279+0000","last_clean":"2024-08-27T03:55:36.073279+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:55:36.073279+0000","last_undegraded":"2024-08-27T03:55:36.073279+0000","last_fullsized":"2024-08-27T03:55:36.073279+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:14.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'292","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.355463+0000","last_change":"2024-08-27T02:31:04.482354+0000","last_active":"2024-08-27T03:58:30.355463+0000","last_peered":"2024-08-27T03:58:30.355463+0000","last_clean":"2024-08-27T03:58:30.355463+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:30.355463+0000","last_undegraded":"2024-08-27T03:58:30.355463+0000","last_fullsized":"2024-08-27T03:58:30.355463+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:41:12.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5309852,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":458,"num_read_kb":48183,"num_write":1046,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'437","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073216+0000","last_change":"2024-08-27T02:31:06.449966+0000","last_active":"2024-08-27T03:55:36.073216+0000","last_peered":"2024-08-27T03:55:36.073216+0000","last_clean":"2024-08-27T03:55:36.073216+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:55:36.073216+0000","last_undegraded":"2024-08-27T03:55:36.073216+0000","last_fullsized":"2024-08-27T03:55:36.073216+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:00:38.353825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'328","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.971557+0000","last_change":"2024-08-27T02:31:04.478639+0000","last_active":"2024-08-27T03:58:29.971557+0000","last_peered":"2024-08-27T03:58:29.971557+0000","last_clean":"2024-08-27T03:58:29.971557+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:29.971557+0000","last_undegraded":"2024-08-27T03:58:29.971557+0000","last_fullsized":"2024-08-27T03:58:29.971557+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:22:20.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4933358,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":495,"num_read_kb":9917,"num_write":1115,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'473","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874461+0000","last_change":"2024-08-27T02:31:06.450216+0000","last_active":"2024-08-27T03:55:39.874461+0000","last_peered":"2024-08-27T03:55:39.874461+0000","last_clean":"2024-08-27T03:55:39.874461+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:55:39.874461+0000","last_undegraded":"2024-08-27T03:55:39.874461+0000","last_fullsized":"2024-08-27T03:55:39.874461+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:14.184039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'373","reported_seq":1073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.016676+0000","last_change":"2024-08-27T02:31:38.749882+0000","last_active":"2024-08-27T03:58:30.016676+0000","last_peered":"2024-08-27T03:58:30.016676+0000","last_clean":"2024-08-27T03:58:30.016676+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:30.016676+0000","last_undegraded":"2024-08-27T03:58:30.016676+0000","last_fullsized":"2024-08-27T03:58:30.016676+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:33:03.649537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11540651,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":788,"num_read_kb":15883,"num_write":1148,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'570","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524113+0000","last_change":"2024-08-27T02:31:06.443475+0000","last_active":"2024-08-27T03:56:44.524113+0000","last_peered":"2024-08-27T03:56:44.524113+0000","last_clean":"2024-08-27T03:56:44.524113+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:56:44.524113+0000","last_undegraded":"2024-08-27T03:56:44.524113+0000","last_fullsized":"2024-08-27T03:56:44.524113+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:36:38.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'271","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.305882+0000","last_change":"2024-08-27T02:31:04.457012+0000","last_active":"2024-08-27T03:58:30.305882+0000","last_peered":"2024-08-27T03:58:30.305882+0000","last_clean":"2024-08-27T03:58:30.305882+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:30.305882+0000","last_undegraded":"2024-08-27T03:58:30.305882+0000","last_fullsized":"2024-08-27T03:58:30.305882+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:51:49.178714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7300249,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":591,"num_read_kb":27255,"num_write":970,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'606","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.938985+0000","last_change":"2024-08-27T02:31:06.461548+0000","last_active":"2024-08-27T03:58:02.938985+0000","last_peered":"2024-08-27T03:58:02.938985+0000","last_clean":"2024-08-27T03:58:02.938985+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:02.938985+0000","last_undegraded":"2024-08-27T03:58:02.938985+0000","last_fullsized":"2024-08-27T03:58:02.938985+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:54:26.910185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'312","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.858995+0000","last_change":"2024-08-27T02:31:04.476105+0000","last_active":"2024-08-27T03:58:29.858995+0000","last_peered":"2024-08-27T03:58:29.858995+0000","last_clean":"2024-08-27T03:58:29.858995+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:29.858995+0000","last_undegraded":"2024-08-27T03:58:29.858995+0000","last_fullsized":"2024-08-27T03:58:29.858995+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:19:35.578103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11437427,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":422,"num_read_kb":45250,"num_write":1008,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'437","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072894+0000","last_change":"2024-08-27T02:31:06.461180+0000","last_active":"2024-08-27T03:54:30.072894+0000","last_peered":"2024-08-27T03:54:30.072894+0000","last_clean":"2024-08-27T03:54:30.072894+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:54:30.072894+0000","last_undegraded":"2024-08-27T03:54:30.072894+0000","last_fullsized":"2024-08-27T03:54:30.072894+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:35:29.428642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'333","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.046535+0000","last_change":"2024-08-27T02:31:04.469464+0000","last_active":"2024-08-27T03:58:31.046535+0000","last_peered":"2024-08-27T03:58:31.046535+0000","last_clean":"2024-08-27T03:58:31.046535+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:31.046535+0000","last_undegraded":"2024-08-27T03:58:31.046535+0000","last_fullsized":"2024-08-27T03:58:31.046535+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:55:43.726324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109793,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":583,"num_read_kb":26118,"num_write":1288,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'574","reported_seq":2441,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.915919+0000","last_change":"2024-08-27T02:31:06.447514+0000","last_active":"2024-08-27T03:58:02.915919+0000","last_peered":"2024-08-27T03:58:02.915919+0000","last_clean":"2024-08-27T03:58:02.915919+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:02.915919+0000","last_undegraded":"2024-08-27T03:58:02.915919+0000","last_fullsized":"2024-08-27T03:58:02.915919+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:41:53.347545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'274","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.010651+0000","last_change":"2024-08-27T02:31:40.468497+0000","last_active":"2024-08-27T03:58:30.010651+0000","last_peered":"2024-08-27T03:58:30.010651+0000","last_clean":"2024-08-27T03:58:30.010651+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:30.010651+0000","last_undegraded":"2024-08-27T03:58:30.010651+0000","last_fullsized":"2024-08-27T03:58:30.010651+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:27.567253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11803400,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":511,"num_read_kb":100247,"num_write":996,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'445","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215939+0000","last_change":"2024-08-27T02:31:06.469696+0000","last_active":"2024-08-27T03:55:54.215939+0000","last_peered":"2024-08-27T03:55:54.215939+0000","last_clean":"2024-08-27T03:55:54.215939+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:55:54.215939+0000","last_undegraded":"2024-08-27T03:55:54.215939+0000","last_fullsized":"2024-08-27T03:55:54.215939+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:20.988932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'312","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.921673+0000","last_change":"2024-08-27T02:31:04.455655+0000","last_active":"2024-08-27T03:58:29.921673+0000","last_peered":"2024-08-27T03:58:29.921673+0000","last_clean":"2024-08-27T03:58:29.921673+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:29.921673+0000","last_undegraded":"2024-08-27T03:58:29.921673+0000","last_fullsized":"2024-08-27T03:58:29.921673+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:53:08.178860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23165461,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":520,"num_read_kb":99962,"num_write":1172,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'357","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.942738+0000","last_change":"2024-08-27T02:31:06.462059+0000","last_active":"2024-08-27T03:58:02.942738+0000","last_peered":"2024-08-27T03:58:02.942738+0000","last_clean":"2024-08-27T03:58:02.942738+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:02.942738+0000","last_undegraded":"2024-08-27T03:58:02.942738+0000","last_fullsized":"2024-08-27T03:58:02.942738+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:59.170394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'240","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.836375+0000","last_change":"2024-08-27T02:31:04.446192+0000","last_active":"2024-08-27T03:58:29.836375+0000","last_peered":"2024-08-27T03:58:29.836375+0000","last_clean":"2024-08-27T03:58:29.836375+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:29.836375+0000","last_undegraded":"2024-08-27T03:58:29.836375+0000","last_fullsized":"2024-08-27T03:58:29.836375+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:44.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1076308,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":356,"num_read_kb":6749,"num_write":893,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'639","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524102+0000","last_change":"2024-08-27T02:31:06.456393+0000","last_active":"2024-08-27T03:56:44.524102+0000","last_peered":"2024-08-27T03:56:44.524102+0000","last_clean":"2024-08-27T03:56:44.524102+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:56:44.524102+0000","last_undegraded":"2024-08-27T03:56:44.524102+0000","last_fullsized":"2024-08-27T03:56:44.524102+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:03.541422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'308","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.914602+0000","last_change":"2024-08-27T02:31:04.455660+0000","last_active":"2024-08-27T03:58:29.914602+0000","last_peered":"2024-08-27T03:58:29.914602+0000","last_clean":"2024-08-27T03:58:29.914602+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:29.914602+0000","last_undegraded":"2024-08-27T03:58:29.914602+0000","last_fullsized":"2024-08-27T03:58:29.914602+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:59:36.250505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4895758,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":522,"num_read_kb":2752,"num_write":1231,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'437","reported_seq":1952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.059524+0000","last_change":"2024-08-27T02:31:06.469100+0000","last_active":"2024-08-27T03:54:40.059524+0000","last_peered":"2024-08-27T03:54:40.059524+0000","last_clean":"2024-08-27T03:54:40.059524+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:54:40.059524+0000","last_undegraded":"2024-08-27T03:54:40.059524+0000","last_fullsized":"2024-08-27T03:54:40.059524+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:54:14.589392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'273","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.899218+0000","last_change":"2024-08-27T02:31:04.474597+0000","last_active":"2024-08-27T03:58:29.899218+0000","last_peered":"2024-08-27T03:58:29.899218+0000","last_clean":"2024-08-27T03:58:29.899218+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:29.899218+0000","last_undegraded":"2024-08-27T03:58:29.899218+0000","last_fullsized":"2024-08-27T03:58:29.899218+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:19:48.419717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172637,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":379,"num_read_kb":2564,"num_write":1008,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'612","reported_seq":2444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.590756+0000","last_change":"2024-08-27T02:31:06.473076+0000","last_active":"2024-08-27T03:56:42.590756+0000","last_peered":"2024-08-27T03:56:42.590756+0000","last_clean":"2024-08-27T03:56:42.590756+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:56:42.590756+0000","last_undegraded":"2024-08-27T03:56:42.590756+0000","last_fullsized":"2024-08-27T03:56:42.590756+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:19.460348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'278","reported_seq":1088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.253362+0000","last_change":"2024-08-27T02:31:04.466914+0000","last_active":"2024-08-27T03:58:30.253362+0000","last_peered":"2024-08-27T03:58:30.253362+0000","last_clean":"2024-08-27T03:58:30.253362+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:30.253362+0000","last_undegraded":"2024-08-27T03:58:30.253362+0000","last_fullsized":"2024-08-27T03:58:30.253362+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:32.345511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":718000,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":786,"num_read_kb":79613,"num_write":995,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'502","reported_seq":2126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.279816+0000","last_change":"2024-08-27T02:31:06.453414+0000","last_active":"2024-08-27T03:54:25.279816+0000","last_peered":"2024-08-27T03:54:25.279816+0000","last_clean":"2024-08-27T03:54:25.279816+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:54:25.279816+0000","last_undegraded":"2024-08-27T03:54:25.279816+0000","last_fullsized":"2024-08-27T03:54:25.279816+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:58:00.941444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'280","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.367297+0000","last_change":"2024-08-27T02:31:04.493288+0000","last_active":"2024-08-27T03:58:30.367297+0000","last_peered":"2024-08-27T03:58:30.367297+0000","last_clean":"2024-08-27T03:58:30.367297+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:30.367297+0000","last_undegraded":"2024-08-27T03:58:30.367297+0000","last_fullsized":"2024-08-27T03:58:30.367297+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:54:10.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911854,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":576,"num_read_kb":25476,"num_write":954,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'802","reported_seq":2696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.912104+0000","last_change":"2024-08-27T02:31:06.446787+0000","last_active":"2024-08-27T03:58:02.912104+0000","last_peered":"2024-08-27T03:58:02.912104+0000","last_clean":"2024-08-27T03:58:02.912104+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:02.912104+0000","last_undegraded":"2024-08-27T03:58:02.912104+0000","last_fullsized":"2024-08-27T03:58:02.912104+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:54.168779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'285","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.308721+0000","last_change":"2024-08-27T02:31:04.498684+0000","last_active":"2024-08-27T03:58:30.308721+0000","last_peered":"2024-08-27T03:58:30.308721+0000","last_clean":"2024-08-27T03:58:30.308721+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:30.308721+0000","last_undegraded":"2024-08-27T03:58:30.308721+0000","last_fullsized":"2024-08-27T03:58:30.308721+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:33:00.705755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11798001,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":493,"num_read_kb":75812,"num_write":963,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'417","reported_seq":1897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.869970+0000","last_change":"2024-08-27T02:31:06.460970+0000","last_active":"2024-08-27T03:54:24.869970+0000","last_peered":"2024-08-27T03:54:24.869970+0000","last_clean":"2024-08-27T03:54:24.869970+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:54:24.869970+0000","last_undegraded":"2024-08-27T03:54:24.869970+0000","last_fullsized":"2024-08-27T03:54:24.869970+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:33.950629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'371","reported_seq":1290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.061637+0000","last_change":"2024-08-27T02:31:04.477605+0000","last_active":"2024-08-27T03:58:30.061637+0000","last_peered":"2024-08-27T03:58:30.061637+0000","last_clean":"2024-08-27T03:58:30.061637+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:30.061637+0000","last_undegraded":"2024-08-27T03:58:30.061637+0000","last_fullsized":"2024-08-27T03:58:30.061637+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:54.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29877,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":954,"num_read_kb":143554,"num_write":1147,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'385","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.303474+0000","last_change":"2024-08-27T02:31:06.448211+0000","last_active":"2024-08-27T03:56:00.303474+0000","last_peered":"2024-08-27T03:56:00.303474+0000","last_clean":"2024-08-27T03:56:00.303474+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:56:00.303474+0000","last_undegraded":"2024-08-27T03:56:00.303474+0000","last_fullsized":"2024-08-27T03:56:00.303474+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:44.911262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'329","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.760740+0000","last_change":"2024-08-27T02:31:04.468993+0000","last_active":"2024-08-27T03:58:29.760740+0000","last_peered":"2024-08-27T03:58:29.760740+0000","last_clean":"2024-08-27T03:58:29.760740+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:29.760740+0000","last_undegraded":"2024-08-27T03:58:29.760740+0000","last_fullsized":"2024-08-27T03:58:29.760740+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:42.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2148831,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":566,"num_read_kb":11843,"num_write":1238,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'301","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.843384+0000","last_change":"2024-08-27T02:31:04.470311+0000","last_active":"2024-08-27T03:58:29.843384+0000","last_peered":"2024-08-27T03:58:29.843384+0000","last_clean":"2024-08-27T03:58:29.843384+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:29.843384+0000","last_undegraded":"2024-08-27T03:58:29.843384+0000","last_fullsized":"2024-08-27T03:58:29.843384+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:46.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54971,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":482,"num_read_kb":4946,"num_write":1023,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'381","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.298368+0000","last_change":"2024-08-27T02:31:39.753199+0000","last_active":"2024-08-27T03:56:00.298368+0000","last_peered":"2024-08-27T03:56:00.298368+0000","last_clean":"2024-08-27T03:56:00.298368+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:56:00.298368+0000","last_undegraded":"2024-08-27T03:56:00.298368+0000","last_fullsized":"2024-08-27T03:56:00.298368+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:20:26.815028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'324","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.051291+0000","last_change":"2024-08-27T02:31:04.468743+0000","last_active":"2024-08-27T03:58:31.051291+0000","last_peered":"2024-08-27T03:58:31.051291+0000","last_clean":"2024-08-27T03:58:31.051291+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:31.051291+0000","last_undegraded":"2024-08-27T03:58:31.051291+0000","last_fullsized":"2024-08-27T03:58:31.051291+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:32:18.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7430147,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":603,"num_read_kb":18082,"num_write":1112,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.999344+0000","last_change":"2024-08-27T02:31:06.441369+0000","last_active":"2024-08-27T03:58:02.999344+0000","last_peered":"2024-08-27T03:58:02.999344+0000","last_clean":"2024-08-27T03:58:02.999344+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:02.999344+0000","last_undegraded":"2024-08-27T03:58:02.999344+0000","last_fullsized":"2024-08-27T03:58:02.999344+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:46.354455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1592,"ondisk_log_size":1592,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1623887,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19235,"num_read_kb":37371,"num_write":16116,"num_write_kb":11765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1908736,"data_stored":1489439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1889,"ondisk_log_size":1889,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3951,"ondisk_log_size":3951,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":280168786,"num_objects":2687,"num_object_clones":0,"num_object_copies":10748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":0,"num_read":33251,"num_read_kb":1916386,"num_write":68056,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":433528832,"data_stored":433528832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4307,"ondisk_log_size":4307,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":15728640,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":208074,"num_write":158,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35188736,"data_stored":35187371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":42587765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":128,"num_read_kb":198799,"num_write":150,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79351808,"data_stored":79348287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510495,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223448,"kb_used_data":47932,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94148392,"statfs":{"total":96636764160,"available":96407953408,"internally_reserved":0,"allocated":49082368,"data_stored":47081822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543204,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387652,"kb_used_data":71660,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93984188,"statfs":{"total":96636764160,"available":96239808512,"internally_reserved":0,"allocated":73379840,"data_stored":71344196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323353034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543205,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381640,"kb_used_data":119956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93990200,"statfs":{"total":96636764160,"available":96245964800,"internally_reserved":0,"allocated":122834944,"data_stored":120855804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543202,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252180,"kb_used_data":112772,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94119660,"statfs":{"total":96636764160,"available":96378531840,"internally_reserved":0,"allocated":115478528,"data_stored":113383684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543201,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238456,"kb_used_data":130908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94133384,"statfs":{"total":96636764160,"available":96392585216,"internally_reserved":0,"allocated":134049792,"data_stored":132092224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543203,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394180,"kb_used_data":128372,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93977660,"statfs":{"total":96636764160,"available":96233123840,"internally_reserved":0,"allocated":131452928,"data_stored":129397494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543205,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211752,"kb_used_data":104160,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94160088,"statfs":{"total":96636764160,"available":96419930112,"internally_reserved":0,"allocated":106659840,"data_stored":104687967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543203,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":418184,"kb_used_data":126028,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93953656,"statfs":{"total":96636764160,"available":96208543744,"internally_reserved":0,"allocated":129052672,"data_stored":126992328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48959488,"data_stored":48959488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33320960,"data_stored":33320960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53968896,"data_stored":53968896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62959616,"data_stored":62959616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73605120,"data_stored":73605120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":70320128,"data_stored":70320128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":47345664,"data_stored":47345664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":43048960,"data_stored":43048960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":165537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":90823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":40312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":339243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":458355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":134672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":221561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5304320,"data_stored":5303242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4255744,"data_stored":4254666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T03:58:33.109 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-27T03:58:33.432 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:58:33.432 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":267,"fsid":"2bd9f312-2905-4c35-8bed-4bbae91a1fc0","created":"2024-08-27T02:30:32.659875+0000","modified":"2024-08-27T03:10:46.247424+0000","last_up_change":"2024-08-27T02:30:45.152567+0000","last_in_change":"2024-08-27T02:30:34.955101+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-27T02:30:45.666848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-27T02:30:50.925178+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-08-27T02:31:02.395480+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-08-27T02:31:04.776842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-08-27T02:31:06.533652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-08-27T02:31:08.785829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-08-27T02:31:10.484682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-08-27T02:31:12.632345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-08-27T02:46:48.437070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-08-27T02:50:50.478995+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-08-27T02:50:54.144114+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-08-27T03:10:43.418949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"267","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d507e514-2956-41e1-9e95-23db7e11d2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6817","nonce":203223605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6819","nonce":203223605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6823","nonce":203223605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":203223605},{"type":"v1","addr":"172.21.15.143:6821","nonce":203223605}]},"public_addr":"172.21.15.143:6817/203223605","cluster_addr":"172.21.15.143:6819/203223605","heartbeat_back_addr":"172.21.15.143:6823/203223605","heartbeat_front_addr":"172.21.15.143:6821/203223605","state":["exists","up"]},{"osd":1,"uuid":"86e299bc-e71b-42e5-aede-b7f685b509ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6825","nonce":2173528226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6827","nonce":2173528226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6831","nonce":2173528226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2173528226},{"type":"v1","addr":"172.21.15.143:6829","nonce":2173528226}]},"public_addr":"172.21.15.143:6825/2173528226","cluster_addr":"172.21.15.143:6827/2173528226","heartbeat_back_addr":"172.21.15.143:6831/2173528226","heartbeat_front_addr":"172.21.15.143:6829/2173528226","state":["exists","up"]},{"osd":2,"uuid":"26a2b164-aa60-47bf-ac44-f85aebbe9505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6801","nonce":2368617930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6803","nonce":2368617930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6807","nonce":2368617930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2368617930},{"type":"v1","addr":"172.21.15.143:6805","nonce":2368617930}]},"public_addr":"172.21.15.143:6801/2368617930","cluster_addr":"172.21.15.143:6803/2368617930","heartbeat_back_addr":"172.21.15.143:6807/2368617930","heartbeat_front_addr":"172.21.15.143:6805/2368617930","state":["exists","up"]},{"osd":3,"uuid":"6eb8aad7-7383-448d-9847-054191aaf780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6809","nonce":3382757569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6811","nonce":3382757569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6815","nonce":3382757569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3382757569},{"type":"v1","addr":"172.21.15.143:6813","nonce":3382757569}]},"public_addr":"172.21.15.143:6809/3382757569","cluster_addr":"172.21.15.143:6811/3382757569","heartbeat_back_addr":"172.21.15.143:6815/3382757569","heartbeat_front_addr":"172.21.15.143:6813/3382757569","state":["exists","up"]},{"osd":4,"uuid":"0418e412-238a-4d63-ae59-8e7cdf5fdfb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6825","nonce":3209286965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6827","nonce":3209286965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6831","nonce":3209286965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3209286965},{"type":"v1","addr":"172.21.15.181:6829","nonce":3209286965}]},"public_addr":"172.21.15.181:6825/3209286965","cluster_addr":"172.21.15.181:6827/3209286965","heartbeat_back_addr":"172.21.15.181:6831/3209286965","heartbeat_front_addr":"172.21.15.181:6829/3209286965","state":["exists","up"]},{"osd":5,"uuid":"5e73fea8-56ab-42ff-8e05-537a33b1da58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6801","nonce":2843441581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6803","nonce":2843441581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6807","nonce":2843441581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2843441581},{"type":"v1","addr":"172.21.15.181:6805","nonce":2843441581}]},"public_addr":"172.21.15.181:6801/2843441581","cluster_addr":"172.21.15.181:6803/2843441581","heartbeat_back_addr":"172.21.15.181:6807/2843441581","heartbeat_front_addr":"172.21.15.181:6805/2843441581","state":["exists","up"]},{"osd":6,"uuid":"ad844130-54fa-45ca-a121-2edf1b658b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6809","nonce":3659401645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6811","nonce":3659401645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6815","nonce":3659401645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3659401645},{"type":"v1","addr":"172.21.15.181:6813","nonce":3659401645}]},"public_addr":"172.21.15.181:6809/3659401645","cluster_addr":"172.21.15.181:6811/3659401645","heartbeat_back_addr":"172.21.15.181:6815/3659401645","heartbeat_front_addr":"172.21.15.181:6813/3659401645","state":["exists","up"]},{"osd":7,"uuid":"f7f84897-483a-49d9-82a1-baeae11786a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6817","nonce":1853453285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6819","nonce":1853453285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6823","nonce":1853453285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":1853453285},{"type":"v1","addr":"172.21.15.181:6821","nonce":1853453285}]},"public_addr":"172.21.15.181:6817/1853453285","cluster_addr":"172.21.15.181:6819/1853453285","heartbeat_back_addr":"172.21.15.181:6823/1853453285","heartbeat_front_addr":"172.21.15.181:6821/1853453285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.777253+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.966329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.254168+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.453846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:42.001243+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.466919+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.551083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-27T02:30:41.288126+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.a","mappings":[{"from":4,"to":3}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":6,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2},{"from":0,"to":3}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]},{"pgid":"67.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-27T03:58:34.452 INFO:tasks.ceph:Scrubbing osd.0 2024-08-27T03:58:34.452 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:34.617 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:34.617 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:34.618 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:34.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-27T03:58:34.923 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 0 to deep-scrub 2024-08-27T03:58:34.939 INFO:tasks.ceph:Scrubbing osd.1 2024-08-27T03:58:34.940 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:35.090 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:35.090 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:35.090 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:35.107 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-27T03:58:35.404 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 1 to deep-scrub 2024-08-27T03:58:35.424 INFO:tasks.ceph:Scrubbing osd.2 2024-08-27T03:58:35.424 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:35.560 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:35.560 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:35.560 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:35.575 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-27T03:58:35.858 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 2 to deep-scrub 2024-08-27T03:58:35.877 INFO:tasks.ceph:Scrubbing osd.3 2024-08-27T03:58:35.877 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:36.020 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:36.020 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:36.020 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:36.035 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-27T03:58:36.321 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 3 to deep-scrub 2024-08-27T03:58:36.340 INFO:tasks.ceph:Scrubbing osd.4 2024-08-27T03:58:36.340 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:36.493 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:36.493 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:36.493 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:36.509 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-27T03:58:36.797 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 4 to deep-scrub 2024-08-27T03:58:36.816 INFO:tasks.ceph:Scrubbing osd.5 2024-08-27T03:58:36.817 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:36.958 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:36.958 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:36.958 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:36.973 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-27T03:58:37.264 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 5 to deep-scrub 2024-08-27T03:58:37.284 INFO:tasks.ceph:Scrubbing osd.6 2024-08-27T03:58:37.284 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:37.422 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:37.422 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:37.422 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:37.437 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-27T03:58:37.738 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 6 to deep-scrub 2024-08-27T03:58:37.758 INFO:tasks.ceph:Scrubbing osd.7 2024-08-27T03:58:37.759 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-27T03:58:37.907 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-08-27T03:58:37.907 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-27T03:58:37.907 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-08-27T03:58:37.923 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-27T03:58:38.209 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 7 to deep-scrub 2024-08-27T03:58:38.227 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T03:58:38.570 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:58:38.582 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T03:58:38.590 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2895,"stamp":"2024-08-27T03:58:37.283379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67386791,"num_objects":861,"num_object_clones":0,"num_object_copies":2456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":287806,"num_read_kb":2575721,"num_write":159683,"num_write_kb":2372746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12645,"ondisk_log_size":12645,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1859104,"kb_used_data":122152,"kb_used_omap":12,"kb_used_meta":1735987,"kb_avail":753115616,"statfs":{"total":773094113280,"available":771190390784,"internally_reserved":0,"allocated":125083648,"data_stored":109136286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1777651249},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-605495298,"num_objects":-4068,"num_object_clones":0,"num_object_copies":-16192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4068,"num_whiteouts":0,"num_read":4548,"num_read_kb":4078,"num_write":4315,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007388"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875576+0000","last_change":"2024-08-27T03:10:45.291800+0000","last_active":"2024-08-27T03:55:44.875576+0000","last_peered":"2024-08-27T03:55:44.875576+0000","last_clean":"2024-08-27T03:55:44.875576+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:55:44.875576+0000","last_undegraded":"2024-08-27T03:55:44.875576+0000","last_fullsized":"2024-08-27T03:55:44.875576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:23:36.039939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.913854+0000","last_change":"2024-08-27T02:50:55.799193+0000","last_active":"2024-08-27T03:58:24.913854+0000","last_peered":"2024-08-27T03:58:24.913854+0000","last_clean":"2024-08-27T03:58:24.913854+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:58:24.913854+0000","last_undegraded":"2024-08-27T03:58:24.913854+0000","last_fullsized":"2024-08-27T03:58:24.913854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:21:44.106748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.896443+0000","last_change":"2024-08-27T02:50:51.735635+0000","last_active":"2024-08-27T03:55:54.896443+0000","last_peered":"2024-08-27T03:55:54.896443+0000","last_clean":"2024-08-27T03:55:54.896443+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:55:54.896443+0000","last_undegraded":"2024-08-27T03:55:54.896443+0000","last_fullsized":"2024-08-27T03:55:54.896443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:41.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.292121+0000","last_change":"2024-08-27T02:46:49.663999+0000","last_active":"2024-08-27T03:55:35.292121+0000","last_peered":"2024-08-27T03:55:35.292121+0000","last_clean":"2024-08-27T03:55:35.292121+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:55:35.292121+0000","last_undegraded":"2024-08-27T03:55:35.292121+0000","last_fullsized":"2024-08-27T03:55:35.292121+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:06:26.935384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073515+0000","last_change":"2024-08-27T03:10:45.296108+0000","last_active":"2024-08-27T03:55:45.073515+0000","last_peered":"2024-08-27T03:55:45.073515+0000","last_clean":"2024-08-27T03:55:45.073515+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:55:45.073515+0000","last_undegraded":"2024-08-27T03:55:45.073515+0000","last_fullsized":"2024-08-27T03:55:45.073515+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:12.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128164+0000","last_change":"2024-08-27T02:50:55.775244+0000","last_active":"2024-08-27T03:58:25.128164+0000","last_peered":"2024-08-27T03:58:25.128164+0000","last_clean":"2024-08-27T03:58:25.128164+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:58:25.128164+0000","last_undegraded":"2024-08-27T03:58:25.128164+0000","last_fullsized":"2024-08-27T03:58:25.128164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:30.406512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076691+0000","last_change":"2024-08-27T02:50:51.735266+0000","last_active":"2024-08-27T03:55:51.076691+0000","last_peered":"2024-08-27T03:55:51.076691+0000","last_clean":"2024-08-27T03:55:51.076691+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:55:51.076691+0000","last_undegraded":"2024-08-27T03:55:51.076691+0000","last_fullsized":"2024-08-27T03:55:51.076691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:50:41.400577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064603+0000","last_change":"2024-08-27T02:46:49.676761+0000","last_active":"2024-08-27T03:55:05.064603+0000","last_peered":"2024-08-27T03:55:05.064603+0000","last_clean":"2024-08-27T03:55:05.064603+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:55:05.064603+0000","last_undegraded":"2024-08-27T03:55:05.064603+0000","last_fullsized":"2024-08-27T03:55:05.064603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:59:06.352477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.436334+0000","last_change":"2024-08-27T03:10:45.294573+0000","last_active":"2024-08-27T03:54:15.436334+0000","last_peered":"2024-08-27T03:54:15.436334+0000","last_clean":"2024-08-27T03:54:15.436334+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:54:15.436334+0000","last_undegraded":"2024-08-27T03:54:15.436334+0000","last_fullsized":"2024-08-27T03:54:15.436334+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:54.922215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290928+0000","last_change":"2024-08-27T02:50:55.791602+0000","last_active":"2024-08-27T03:55:30.290928+0000","last_peered":"2024-08-27T03:55:30.290928+0000","last_clean":"2024-08-27T03:55:30.290928+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:55:30.290928+0000","last_undegraded":"2024-08-27T03:55:30.290928+0000","last_fullsized":"2024-08-27T03:55:30.290928+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:05.925142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'11","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.881057+0000","last_change":"2024-08-27T02:50:51.729715+0000","last_active":"2024-08-27T03:58:29.881057+0000","last_peered":"2024-08-27T03:58:29.881057+0000","last_clean":"2024-08-27T03:58:29.881057+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:58:29.881057+0000","last_undegraded":"2024-08-27T03:58:29.881057+0000","last_fullsized":"2024-08-27T03:58:29.881057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:26.531591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21563,"num_write":16,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494185+0000","last_change":"2024-08-27T02:46:49.653398+0000","last_active":"2024-08-27T03:54:20.494185+0000","last_peered":"2024-08-27T03:54:20.494185+0000","last_clean":"2024-08-27T03:54:20.494185+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:54:20.494185+0000","last_undegraded":"2024-08-27T03:54:20.494185+0000","last_fullsized":"2024-08-27T03:54:20.494185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:50.129103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871224+0000","last_change":"2024-08-27T03:10:45.281316+0000","last_active":"2024-08-27T03:54:29.871224+0000","last_peered":"2024-08-27T03:54:29.871224+0000","last_clean":"2024-08-27T03:54:29.871224+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:54:29.871224+0000","last_undegraded":"2024-08-27T03:54:29.871224+0000","last_fullsized":"2024-08-27T03:54:29.871224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:26.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.887006+0000","last_change":"2024-08-27T02:50:55.794295+0000","last_active":"2024-08-27T03:55:14.887006+0000","last_peered":"2024-08-27T03:55:14.887006+0000","last_clean":"2024-08-27T03:55:14.887006+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:55:14.887006+0000","last_undegraded":"2024-08-27T03:55:14.887006+0000","last_fullsized":"2024-08-27T03:55:14.887006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:10.976998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.087490+0000","last_change":"2024-08-27T02:50:51.720342+0000","last_active":"2024-08-27T03:55:30.087490+0000","last_peered":"2024-08-27T03:55:30.087490+0000","last_clean":"2024-08-27T03:55:30.087490+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:55:30.087490+0000","last_undegraded":"2024-08-27T03:55:30.087490+0000","last_fullsized":"2024-08-27T03:55:30.087490+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:16:13.056385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868989+0000","last_change":"2024-08-27T02:46:49.680620+0000","last_active":"2024-08-27T03:54:19.868989+0000","last_peered":"2024-08-27T03:54:19.868989+0000","last_clean":"2024-08-27T03:54:19.868989+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:54:19.868989+0000","last_undegraded":"2024-08-27T03:54:19.868989+0000","last_fullsized":"2024-08-27T03:54:19.868989+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:46:31.779704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:59.882198+0000","last_change":"2024-08-27T03:10:45.289727+0000","last_active":"2024-08-27T03:54:59.882198+0000","last_peered":"2024-08-27T03:54:59.882198+0000","last_clean":"2024-08-27T03:54:59.882198+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:54:59.882198+0000","last_undegraded":"2024-08-27T03:54:59.882198+0000","last_fullsized":"2024-08-27T03:54:59.882198+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:30:10.424523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:04.852380+0000","last_change":"2024-08-27T02:50:55.806362+0000","last_active":"2024-08-27T03:54:04.852380+0000","last_peered":"2024-08-27T03:54:04.852380+0000","last_clean":"2024-08-27T03:54:04.852380+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:54:04.852380+0000","last_undegraded":"2024-08-27T03:54:04.852380+0000","last_fullsized":"2024-08-27T03:54:04.852380+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:25.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.282979+0000","last_change":"2024-08-27T02:50:51.720059+0000","last_active":"2024-08-27T03:58:31.282979+0000","last_peered":"2024-08-27T03:58:31.282979+0000","last_clean":"2024-08-27T03:58:31.282979+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:58:31.282979+0000","last_undegraded":"2024-08-27T03:58:31.282979+0000","last_fullsized":"2024-08-27T03:58:31.282979+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868908+0000","last_change":"2024-08-27T02:46:49.675252+0000","last_active":"2024-08-27T03:54:19.868908+0000","last_peered":"2024-08-27T03:54:19.868908+0000","last_clean":"2024-08-27T03:54:19.868908+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:54:19.868908+0000","last_undegraded":"2024-08-27T03:54:19.868908+0000","last_fullsized":"2024-08-27T03:54:19.868908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:11.184532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058881+0000","last_change":"2024-08-27T03:10:45.303346+0000","last_active":"2024-08-27T03:54:31.058881+0000","last_peered":"2024-08-27T03:54:31.058881+0000","last_clean":"2024-08-27T03:54:31.058881+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:54:31.058881+0000","last_undegraded":"2024-08-27T03:54:31.058881+0000","last_fullsized":"2024-08-27T03:54:31.058881+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:17:17.630708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461358+0000","last_change":"2024-08-27T02:50:55.789996+0000","last_active":"2024-08-27T03:56:10.461358+0000","last_peered":"2024-08-27T03:56:10.461358+0000","last_clean":"2024-08-27T03:56:10.461358+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:56:10.461358+0000","last_undegraded":"2024-08-27T03:56:10.461358+0000","last_fullsized":"2024-08-27T03:56:10.461358+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:53.367346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:25.100608+0000","last_change":"2024-08-27T02:50:51.707799+0000","last_active":"2024-08-27T03:56:25.100608+0000","last_peered":"2024-08-27T03:56:25.100608+0000","last_clean":"2024-08-27T03:56:25.100608+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:56:25.100608+0000","last_undegraded":"2024-08-27T03:56:25.100608+0000","last_fullsized":"2024-08-27T03:56:25.100608+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:38.856713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437440+0000","last_change":"2024-08-27T02:46:49.657662+0000","last_active":"2024-08-27T03:54:20.437440+0000","last_peered":"2024-08-27T03:54:20.437440+0000","last_clean":"2024-08-27T03:54:20.437440+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:54:20.437440+0000","last_undegraded":"2024-08-27T03:54:20.437440+0000","last_fullsized":"2024-08-27T03:54:20.437440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:37:52.995296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299701+0000","last_change":"2024-08-27T03:10:45.293045+0000","last_active":"2024-08-27T03:55:45.299701+0000","last_peered":"2024-08-27T03:55:45.299701+0000","last_clean":"2024-08-27T03:55:45.299701+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:55:45.299701+0000","last_undegraded":"2024-08-27T03:55:45.299701+0000","last_fullsized":"2024-08-27T03:55:45.299701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:53:47.782276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.041243+0000","last_change":"2024-08-27T02:50:55.766901+0000","last_active":"2024-08-27T03:58:30.041243+0000","last_peered":"2024-08-27T03:58:30.041243+0000","last_clean":"2024-08-27T03:58:30.041243+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:58:30.041243+0000","last_undegraded":"2024-08-27T03:58:30.041243+0000","last_fullsized":"2024-08-27T03:58:30.041243+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:30:21.583051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.841038+0000","last_change":"2024-08-27T02:50:51.738475+0000","last_active":"2024-08-27T03:58:30.841038+0000","last_peered":"2024-08-27T03:58:30.841038+0000","last_clean":"2024-08-27T03:58:30.841038+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:58:30.841038+0000","last_undegraded":"2024-08-27T03:58:30.841038+0000","last_fullsized":"2024-08-27T03:58:30.841038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:26:56.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.497953+0000","last_change":"2024-08-27T02:46:49.647868+0000","last_active":"2024-08-27T03:54:40.497953+0000","last_peered":"2024-08-27T03:54:40.497953+0000","last_clean":"2024-08-27T03:54:40.497953+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:54:40.497953+0000","last_undegraded":"2024-08-27T03:54:40.497953+0000","last_fullsized":"2024-08-27T03:54:40.497953+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:28:45.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299830+0000","last_change":"2024-08-27T03:10:45.284842+0000","last_active":"2024-08-27T03:55:45.299830+0000","last_peered":"2024-08-27T03:55:45.299830+0000","last_clean":"2024-08-27T03:55:45.299830+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:55:45.299830+0000","last_undegraded":"2024-08-27T03:55:45.299830+0000","last_fullsized":"2024-08-27T03:55:45.299830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:45:04.454859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930510+0000","last_change":"2024-08-27T02:50:55.778273+0000","last_active":"2024-08-27T03:58:24.930510+0000","last_peered":"2024-08-27T03:58:24.930510+0000","last_clean":"2024-08-27T03:58:24.930510+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:58:24.930510+0000","last_undegraded":"2024-08-27T03:58:24.930510+0000","last_fullsized":"2024-08-27T03:58:24.930510+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:39.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.296625+0000","last_change":"2024-08-27T02:50:51.714543+0000","last_active":"2024-08-27T03:55:55.296625+0000","last_peered":"2024-08-27T03:55:55.296625+0000","last_clean":"2024-08-27T03:55:55.296625+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:55:55.296625+0000","last_undegraded":"2024-08-27T03:55:55.296625+0000","last_fullsized":"2024-08-27T03:55:55.296625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:34.299020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058666+0000","last_change":"2024-08-27T02:46:49.667902+0000","last_active":"2024-08-27T03:54:31.058666+0000","last_peered":"2024-08-27T03:54:31.058666+0000","last_clean":"2024-08-27T03:54:31.058666+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:54:31.058666+0000","last_undegraded":"2024-08-27T03:54:31.058666+0000","last_fullsized":"2024-08-27T03:54:31.058666+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:38.299301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065781+0000","last_change":"2024-08-27T03:10:45.298717+0000","last_active":"2024-08-27T03:55:06.065781+0000","last_peered":"2024-08-27T03:55:06.065781+0000","last_clean":"2024-08-27T03:55:06.065781+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:55:06.065781+0000","last_undegraded":"2024-08-27T03:55:06.065781+0000","last_fullsized":"2024-08-27T03:55:06.065781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:23:22.104053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.654528+0000","last_change":"2024-08-27T02:50:55.800701+0000","last_active":"2024-08-27T03:58:29.654528+0000","last_peered":"2024-08-27T03:58:29.654528+0000","last_clean":"2024-08-27T03:58:29.654528+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:58:29.654528+0000","last_undegraded":"2024-08-27T03:58:29.654528+0000","last_fullsized":"2024-08-27T03:58:29.654528+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:22.225737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'2","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:34.887617+0000","last_change":"2024-08-27T02:50:51.725068+0000","last_active":"2024-08-27T03:56:34.887617+0000","last_peered":"2024-08-27T03:56:34.887617+0000","last_clean":"2024-08-27T03:56:34.887617+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:56:34.887617+0000","last_undegraded":"2024-08-27T03:56:34.887617+0000","last_fullsized":"2024-08-27T03:56:34.887617+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:06:25.729104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495980+0000","last_change":"2024-08-27T02:46:49.654801+0000","last_active":"2024-08-27T03:54:30.495980+0000","last_peered":"2024-08-27T03:54:30.495980+0000","last_clean":"2024-08-27T03:54:30.495980+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:54:30.495980+0000","last_undegraded":"2024-08-27T03:54:30.495980+0000","last_fullsized":"2024-08-27T03:54:30.495980+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:08.448754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064497+0000","last_change":"2024-08-27T03:10:45.296344+0000","last_active":"2024-08-27T03:55:05.064497+0000","last_peered":"2024-08-27T03:55:05.064497+0000","last_clean":"2024-08-27T03:55:05.064497+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:55:05.064497+0000","last_undegraded":"2024-08-27T03:55:05.064497+0000","last_fullsized":"2024-08-27T03:55:05.064497+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:28.938702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.499627+0000","last_change":"2024-08-27T02:51:41.064218+0000","last_active":"2024-08-27T03:54:50.499627+0000","last_peered":"2024-08-27T03:54:50.499627+0000","last_clean":"2024-08-27T03:54:50.499627+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:54:50.499627+0000","last_undegraded":"2024-08-27T03:54:50.499627+0000","last_fullsized":"2024-08-27T03:54:50.499627+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:59:05.157815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306276+0000","last_change":"2024-08-27T02:50:51.728712+0000","last_active":"2024-08-27T03:56:10.306276+0000","last_peered":"2024-08-27T03:56:10.306276+0000","last_clean":"2024-08-27T03:56:10.306276+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:56:10.306276+0000","last_undegraded":"2024-08-27T03:56:10.306276+0000","last_fullsized":"2024-08-27T03:56:10.306276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:43:32.708072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":308,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871387+0000","last_change":"2024-08-27T02:46:49.674700+0000","last_active":"2024-08-27T03:54:29.871387+0000","last_peered":"2024-08-27T03:54:29.871387+0000","last_clean":"2024-08-27T03:54:29.871387+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:54:29.871387+0000","last_undegraded":"2024-08-27T03:54:29.871387+0000","last_fullsized":"2024-08-27T03:54:29.871387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:39:28.639475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.289661+0000","last_change":"2024-08-27T03:10:45.293007+0000","last_active":"2024-08-27T03:55:05.289661+0000","last_peered":"2024-08-27T03:55:05.289661+0000","last_clean":"2024-08-27T03:55:05.289661+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:55:05.289661+0000","last_undegraded":"2024-08-27T03:55:05.289661+0000","last_fullsized":"2024-08-27T03:55:05.289661+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:23:00.597660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900537+0000","last_change":"2024-08-27T02:50:55.799828+0000","last_active":"2024-08-27T03:56:09.900537+0000","last_peered":"2024-08-27T03:56:09.900537+0000","last_clean":"2024-08-27T03:56:09.900537+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:56:09.900537+0000","last_undegraded":"2024-08-27T03:56:09.900537+0000","last_fullsized":"2024-08-27T03:56:09.900537+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:54.431380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079054+0000","last_change":"2024-08-27T02:50:51.720595+0000","last_active":"2024-08-27T03:56:10.079054+0000","last_peered":"2024-08-27T03:56:10.079054+0000","last_clean":"2024-08-27T03:56:10.079054+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:56:10.079054+0000","last_undegraded":"2024-08-27T03:56:10.079054+0000","last_fullsized":"2024-08-27T03:56:10.079054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:42:21.827378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057603+0000","last_change":"2024-08-27T02:46:49.678450+0000","last_active":"2024-08-27T03:54:30.057603+0000","last_peered":"2024-08-27T03:54:30.057603+0000","last_clean":"2024-08-27T03:54:30.057603+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:54:30.057603+0000","last_undegraded":"2024-08-27T03:54:30.057603+0000","last_fullsized":"2024-08-27T03:54:30.057603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:37.128746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:04.866169+0000","last_change":"2024-08-27T03:10:45.298256+0000","last_active":"2024-08-27T03:55:04.866169+0000","last_peered":"2024-08-27T03:55:04.866169+0000","last_clean":"2024-08-27T03:55:04.866169+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:55:04.866169+0000","last_undegraded":"2024-08-27T03:55:04.866169+0000","last_fullsized":"2024-08-27T03:55:04.866169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:20:23.614816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.841187+0000","last_change":"2024-08-27T02:50:55.769990+0000","last_active":"2024-08-27T03:58:30.841187+0000","last_peered":"2024-08-27T03:58:30.841187+0000","last_clean":"2024-08-27T03:58:30.841187+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:58:30.841187+0000","last_undegraded":"2024-08-27T03:58:30.841187+0000","last_fullsized":"2024-08-27T03:58:30.841187+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:30.128153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.809126+0000","last_change":"2024-08-27T02:50:51.699776+0000","last_active":"2024-08-27T03:58:29.809126+0000","last_peered":"2024-08-27T03:58:29.809126+0000","last_clean":"2024-08-27T03:58:29.809126+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:58:29.809126+0000","last_undegraded":"2024-08-27T03:58:29.809126+0000","last_fullsized":"2024-08-27T03:58:29.809126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.286162+0000","last_change":"2024-08-27T02:46:49.665181+0000","last_active":"2024-08-27T03:54:50.286162+0000","last_peered":"2024-08-27T03:54:50.286162+0000","last_clean":"2024-08-27T03:54:50.286162+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:54:50.286162+0000","last_undegraded":"2024-08-27T03:54:50.286162+0000","last_fullsized":"2024-08-27T03:54:50.286162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:42.937470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867848+0000","last_change":"2024-08-27T03:10:45.289487+0000","last_active":"2024-08-27T03:54:14.867848+0000","last_peered":"2024-08-27T03:54:14.867848+0000","last_clean":"2024-08-27T03:54:14.867848+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:54:14.867848+0000","last_undegraded":"2024-08-27T03:54:14.867848+0000","last_fullsized":"2024-08-27T03:54:14.867848+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:39.767865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.339150+0000","last_change":"2024-08-27T02:50:55.787899+0000","last_active":"2024-08-27T03:58:30.339150+0000","last_peered":"2024-08-27T03:58:30.339150+0000","last_clean":"2024-08-27T03:58:30.339150+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:58:30.339150+0000","last_undegraded":"2024-08-27T03:58:30.339150+0000","last_fullsized":"2024-08-27T03:58:30.339150+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.097716+0000","last_change":"2024-08-27T02:50:51.710484+0000","last_active":"2024-08-27T03:56:15.097716+0000","last_peered":"2024-08-27T03:56:15.097716+0000","last_clean":"2024-08-27T03:56:15.097716+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:56:15.097716+0000","last_undegraded":"2024-08-27T03:56:15.097716+0000","last_fullsized":"2024-08-27T03:56:15.097716+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:35:36.294957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281022+0000","last_change":"2024-08-27T02:46:49.668229+0000","last_active":"2024-08-27T03:54:30.281022+0000","last_peered":"2024-08-27T03:54:30.281022+0000","last_clean":"2024-08-27T03:54:30.281022+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:54:30.281022+0000","last_undegraded":"2024-08-27T03:54:30.281022+0000","last_fullsized":"2024-08-27T03:54:30.281022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:15.719694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.493101+0000","last_change":"2024-08-27T03:10:45.282295+0000","last_active":"2024-08-27T03:54:15.493101+0000","last_peered":"2024-08-27T03:54:15.493101+0000","last_clean":"2024-08-27T03:54:15.493101+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:54:15.493101+0000","last_undegraded":"2024-08-27T03:54:15.493101+0000","last_fullsized":"2024-08-27T03:54:15.493101+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:10:06.995285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.108686+0000","last_change":"2024-08-27T02:50:55.769855+0000","last_active":"2024-08-27T03:58:30.108686+0000","last_peered":"2024-08-27T03:58:30.108686+0000","last_clean":"2024-08-27T03:58:30.108686+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:58:30.108686+0000","last_undegraded":"2024-08-27T03:58:30.108686+0000","last_fullsized":"2024-08-27T03:58:30.108686+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.901513+0000","last_change":"2024-08-27T02:50:51.730019+0000","last_active":"2024-08-27T03:56:14.901513+0000","last_peered":"2024-08-27T03:56:14.901513+0000","last_clean":"2024-08-27T03:56:14.901513+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:56:14.901513+0000","last_undegraded":"2024-08-27T03:56:14.901513+0000","last_fullsized":"2024-08-27T03:56:14.901513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:46.716300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495770+0000","last_change":"2024-08-27T02:46:49.666192+0000","last_active":"2024-08-27T03:54:30.495770+0000","last_peered":"2024-08-27T03:54:30.495770+0000","last_clean":"2024-08-27T03:54:30.495770+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:54:30.495770+0000","last_undegraded":"2024-08-27T03:54:30.495770+0000","last_fullsized":"2024-08-27T03:54:30.495770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:05.105406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287223+0000","last_change":"2024-08-27T03:10:45.283329+0000","last_active":"2024-08-27T03:55:15.287223+0000","last_peered":"2024-08-27T03:55:15.287223+0000","last_clean":"2024-08-27T03:55:15.287223+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:55:15.287223+0000","last_undegraded":"2024-08-27T03:55:15.287223+0000","last_fullsized":"2024-08-27T03:55:15.287223+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:08.644016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.901666+0000","last_change":"2024-08-27T02:50:55.783336+0000","last_active":"2024-08-27T03:56:14.901666+0000","last_peered":"2024-08-27T03:56:14.901666+0000","last_clean":"2024-08-27T03:56:14.901666+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:56:14.901666+0000","last_undegraded":"2024-08-27T03:56:14.901666+0000","last_fullsized":"2024-08-27T03:56:14.901666+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:19.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462633+0000","last_change":"2024-08-27T02:50:51.738540+0000","last_active":"2024-08-27T03:56:15.462633+0000","last_peered":"2024-08-27T03:56:15.462633+0000","last_clean":"2024-08-27T03:56:15.462633+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:56:15.462633+0000","last_undegraded":"2024-08-27T03:56:15.462633+0000","last_fullsized":"2024-08-27T03:56:15.462633+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:28.212686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072847+0000","last_change":"2024-08-27T02:46:49.654783+0000","last_active":"2024-08-27T03:54:30.072847+0000","last_peered":"2024-08-27T03:54:30.072847+0000","last_clean":"2024-08-27T03:54:30.072847+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:54:30.072847+0000","last_undegraded":"2024-08-27T03:54:30.072847+0000","last_fullsized":"2024-08-27T03:54:30.072847+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:07.533650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867790+0000","last_change":"2024-08-27T03:10:45.266598+0000","last_active":"2024-08-27T03:54:14.867790+0000","last_peered":"2024-08-27T03:54:14.867790+0000","last_clean":"2024-08-27T03:54:14.867790+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:54:14.867790+0000","last_undegraded":"2024-08-27T03:54:14.867790+0000","last_fullsized":"2024-08-27T03:54:14.867790+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:16.790039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.227000+0000","last_change":"2024-08-27T02:50:55.778741+0000","last_active":"2024-08-27T03:58:29.227000+0000","last_peered":"2024-08-27T03:58:29.227000+0000","last_clean":"2024-08-27T03:58:29.227000+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:58:29.227000+0000","last_undegraded":"2024-08-27T03:58:29.227000+0000","last_fullsized":"2024-08-27T03:58:29.227000+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:56:17.118596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.882842+0000","last_change":"2024-08-27T02:50:51.722290+0000","last_active":"2024-08-27T03:56:14.882842+0000","last_peered":"2024-08-27T03:56:14.882842+0000","last_clean":"2024-08-27T03:56:14.882842+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:56:14.882842+0000","last_undegraded":"2024-08-27T03:56:14.882842+0000","last_fullsized":"2024-08-27T03:56:14.882842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:01.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871100+0000","last_change":"2024-08-27T02:46:49.673825+0000","last_active":"2024-08-27T03:54:29.871100+0000","last_peered":"2024-08-27T03:54:29.871100+0000","last_clean":"2024-08-27T03:54:29.871100+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:54:29.871100+0000","last_undegraded":"2024-08-27T03:54:29.871100+0000","last_fullsized":"2024-08-27T03:54:29.871100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:03.488183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:25.082170+0000","last_change":"2024-08-27T03:10:45.296440+0000","last_active":"2024-08-27T03:56:25.082170+0000","last_peered":"2024-08-27T03:56:25.082170+0000","last_clean":"2024-08-27T03:56:25.082170+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:56:25.082170+0000","last_undegraded":"2024-08-27T03:56:25.082170+0000","last_fullsized":"2024-08-27T03:56:25.082170+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:09.800699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'2","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930741+0000","last_change":"2024-08-27T02:50:55.782955+0000","last_active":"2024-08-27T03:58:24.930741+0000","last_peered":"2024-08-27T03:58:24.930741+0000","last_clean":"2024-08-27T03:58:24.930741+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:58:24.930741+0000","last_undegraded":"2024-08-27T03:58:24.930741+0000","last_fullsized":"2024-08-27T03:58:24.930741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:13.729427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306233+0000","last_change":"2024-08-27T02:50:51.737202+0000","last_active":"2024-08-27T03:56:10.306233+0000","last_peered":"2024-08-27T03:56:10.306233+0000","last_clean":"2024-08-27T03:56:10.306233+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:56:10.306233+0000","last_undegraded":"2024-08-27T03:56:10.306233+0000","last_fullsized":"2024-08-27T03:56:10.306233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:36.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'155","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:39.874246+0000","last_change":"2024-08-27T02:46:49.680563+0000","last_active":"2024-08-27T03:54:39.874246+0000","last_peered":"2024-08-27T03:54:39.874246+0000","last_clean":"2024-08-27T03:54:39.874246+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:54:39.874246+0000","last_undegraded":"2024-08-27T03:54:39.874246+0000","last_fullsized":"2024-08-27T03:54:39.874246+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:31.769992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299565+0000","last_change":"2024-08-27T03:10:45.284394+0000","last_active":"2024-08-27T03:55:45.299565+0000","last_peered":"2024-08-27T03:55:45.299565+0000","last_clean":"2024-08-27T03:55:45.299565+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:55:45.299565+0000","last_undegraded":"2024-08-27T03:55:45.299565+0000","last_fullsized":"2024-08-27T03:55:45.299565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:56.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930627+0000","last_change":"2024-08-27T02:50:55.783274+0000","last_active":"2024-08-27T03:58:24.930627+0000","last_peered":"2024-08-27T03:58:24.930627+0000","last_clean":"2024-08-27T03:58:24.930627+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:58:24.930627+0000","last_undegraded":"2024-08-27T03:58:24.930627+0000","last_fullsized":"2024-08-27T03:58:24.930627+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:45:25.580491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.104827+0000","last_change":"2024-08-27T02:50:51.720906+0000","last_active":"2024-08-27T03:58:25.104827+0000","last_peered":"2024-08-27T03:58:25.104827+0000","last_clean":"2024-08-27T03:58:25.104827+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:58:25.104827+0000","last_undegraded":"2024-08-27T03:58:25.104827+0000","last_fullsized":"2024-08-27T03:58:25.104827+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:53.550807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.856027+0000","last_change":"2024-08-27T02:46:49.663826+0000","last_active":"2024-08-27T03:54:19.856027+0000","last_peered":"2024-08-27T03:54:19.856027+0000","last_clean":"2024-08-27T03:54:19.856027+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:54:19.856027+0000","last_undegraded":"2024-08-27T03:54:19.856027+0000","last_fullsized":"2024-08-27T03:54:19.856027+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:54.422893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462512+0000","last_change":"2024-08-27T03:10:45.287877+0000","last_active":"2024-08-27T03:56:15.462512+0000","last_peered":"2024-08-27T03:56:15.462512+0000","last_clean":"2024-08-27T03:56:15.462512+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:56:15.462512+0000","last_undegraded":"2024-08-27T03:56:15.462512+0000","last_fullsized":"2024-08-27T03:56:15.462512+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:39:37.167338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:21.083813+0000","last_change":"2024-08-27T02:50:55.796569+0000","last_active":"2024-08-27T03:56:21.083813+0000","last_peered":"2024-08-27T03:56:21.083813+0000","last_clean":"2024-08-27T03:56:21.083813+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:56:21.083813+0000","last_undegraded":"2024-08-27T03:56:21.083813+0000","last_fullsized":"2024-08-27T03:56:21.083813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300859+0000","last_change":"2024-08-27T02:50:51.714350+0000","last_active":"2024-08-27T03:56:10.300859+0000","last_peered":"2024-08-27T03:56:10.300859+0000","last_clean":"2024-08-27T03:56:10.300859+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:56:10.300859+0000","last_undegraded":"2024-08-27T03:56:10.300859+0000","last_fullsized":"2024-08-27T03:56:10.300859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:27:51.967867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'95","reported_seq":424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437556+0000","last_change":"2024-08-27T02:46:49.668269+0000","last_active":"2024-08-27T03:54:20.437556+0000","last_peered":"2024-08-27T03:54:20.437556+0000","last_clean":"2024-08-27T03:54:20.437556+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:54:20.437556+0000","last_undegraded":"2024-08-27T03:54:20.437556+0000","last_fullsized":"2024-08-27T03:54:20.437556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:35:55.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307291+0000","last_change":"2024-08-27T03:10:45.299758+0000","last_active":"2024-08-27T03:56:15.307291+0000","last_peered":"2024-08-27T03:56:15.307291+0000","last_clean":"2024-08-27T03:56:15.307291+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:56:15.307291+0000","last_undegraded":"2024-08-27T03:56:15.307291+0000","last_fullsized":"2024-08-27T03:56:15.307291+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.273910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930815+0000","last_change":"2024-08-27T02:50:55.792739+0000","last_active":"2024-08-27T03:58:24.930815+0000","last_peered":"2024-08-27T03:58:24.930815+0000","last_clean":"2024-08-27T03:58:24.930815+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:58:24.930815+0000","last_undegraded":"2024-08-27T03:58:24.930815+0000","last_fullsized":"2024-08-27T03:58:24.930815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:53.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082281+0000","last_change":"2024-08-27T02:50:51.725905+0000","last_active":"2024-08-27T03:56:16.082281+0000","last_peered":"2024-08-27T03:56:16.082281+0000","last_clean":"2024-08-27T03:56:16.082281+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:56:16.082281+0000","last_undegraded":"2024-08-27T03:56:16.082281+0000","last_fullsized":"2024-08-27T03:56:16.082281+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:12.890510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.055617+0000","last_change":"2024-08-27T02:46:49.680856+0000","last_active":"2024-08-27T03:54:20.055617+0000","last_peered":"2024-08-27T03:54:20.055617+0000","last_clean":"2024-08-27T03:54:20.055617+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:54:20.055617+0000","last_undegraded":"2024-08-27T03:54:20.055617+0000","last_fullsized":"2024-08-27T03:54:20.055617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:18:48.246298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.894119+0000","last_change":"2024-08-27T03:10:45.290159+0000","last_active":"2024-08-27T03:55:44.894119+0000","last_peered":"2024-08-27T03:55:44.894119+0000","last_clean":"2024-08-27T03:55:44.894119+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:55:44.894119+0000","last_undegraded":"2024-08-27T03:55:44.894119+0000","last_fullsized":"2024-08-27T03:55:44.894119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:46:58.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093241+0000","last_change":"2024-08-27T02:50:55.801909+0000","last_active":"2024-08-27T03:55:55.093241+0000","last_peered":"2024-08-27T03:55:55.093241+0000","last_clean":"2024-08-27T03:55:55.093241+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:55:55.093241+0000","last_undegraded":"2024-08-27T03:55:55.093241+0000","last_fullsized":"2024-08-27T03:55:55.093241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:21:22.557931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.326037+0000","last_change":"2024-08-27T02:50:51.714694+0000","last_active":"2024-08-27T03:58:05.326037+0000","last_peered":"2024-08-27T03:58:05.326037+0000","last_clean":"2024-08-27T03:58:05.326037+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:58:05.326037+0000","last_undegraded":"2024-08-27T03:58:05.326037+0000","last_fullsized":"2024-08-27T03:58:05.326037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:09.799135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494067+0000","last_change":"2024-08-27T02:46:49.660909+0000","last_active":"2024-08-27T03:54:20.494067+0000","last_peered":"2024-08-27T03:54:20.494067+0000","last_clean":"2024-08-27T03:54:20.494067+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:54:20.494067+0000","last_undegraded":"2024-08-27T03:54:20.494067+0000","last_fullsized":"2024-08-27T03:54:20.494067+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:08:11.952733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302508+0000","last_change":"2024-08-27T03:10:45.301566+0000","last_active":"2024-08-27T03:55:55.302508+0000","last_peered":"2024-08-27T03:55:55.302508+0000","last_clean":"2024-08-27T03:55:55.302508+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:55:55.302508+0000","last_undegraded":"2024-08-27T03:55:55.302508+0000","last_fullsized":"2024-08-27T03:55:55.302508+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:57:00.105752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302217+0000","last_change":"2024-08-27T02:50:55.793032+0000","last_active":"2024-08-27T03:55:55.302217+0000","last_peered":"2024-08-27T03:55:55.302217+0000","last_clean":"2024-08-27T03:55:55.302217+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:55:55.302217+0000","last_undegraded":"2024-08-27T03:55:55.302217+0000","last_fullsized":"2024-08-27T03:55:55.302217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:41:51.131027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076538+0000","last_change":"2024-08-27T02:50:51.736002+0000","last_active":"2024-08-27T03:55:51.076538+0000","last_peered":"2024-08-27T03:55:51.076538+0000","last_clean":"2024-08-27T03:55:51.076538+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:55:51.076538+0000","last_undegraded":"2024-08-27T03:55:51.076538+0000","last_fullsized":"2024-08-27T03:55:51.076538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:07.337806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.278542+0000","last_change":"2024-08-27T02:46:49.656326+0000","last_active":"2024-08-27T03:54:20.278542+0000","last_peered":"2024-08-27T03:54:20.278542+0000","last_clean":"2024-08-27T03:54:20.278542+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:54:20.278542+0000","last_undegraded":"2024-08-27T03:54:20.278542+0000","last_fullsized":"2024-08-27T03:54:20.278542+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:12:37.739208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299649+0000","last_change":"2024-08-27T03:10:45.282178+0000","last_active":"2024-08-27T03:55:45.299649+0000","last_peered":"2024-08-27T03:55:45.299649+0000","last_clean":"2024-08-27T03:55:45.299649+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:55:45.299649+0000","last_undegraded":"2024-08-27T03:55:45.299649+0000","last_fullsized":"2024-08-27T03:55:45.299649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:24:50.331973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:26.109697+0000","last_change":"2024-08-27T02:50:55.769877+0000","last_active":"2024-08-27T03:58:26.109697+0000","last_peered":"2024-08-27T03:58:26.109697+0000","last_clean":"2024-08-27T03:58:26.109697+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:58:26.109697+0000","last_undegraded":"2024-08-27T03:58:26.109697+0000","last_fullsized":"2024-08-27T03:58:26.109697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:43:34.441494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'12","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.878575+0000","last_change":"2024-08-27T02:50:51.706023+0000","last_active":"2024-08-27T03:58:29.878575+0000","last_peered":"2024-08-27T03:58:29.878575+0000","last_clean":"2024-08-27T03:58:29.878575+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:58:29.878575+0000","last_undegraded":"2024-08-27T03:58:29.878575+0000","last_fullsized":"2024-08-27T03:58:29.878575+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:01:06.191127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":17,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900237+0000","last_change":"2024-08-27T02:46:49.681215+0000","last_active":"2024-08-27T03:56:09.900237+0000","last_peered":"2024-08-27T03:56:09.900237+0000","last_clean":"2024-08-27T03:56:09.900237+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:56:09.900237+0000","last_undegraded":"2024-08-27T03:56:09.900237+0000","last_fullsized":"2024-08-27T03:56:09.900237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:59.655983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294482+0000","last_change":"2024-08-27T03:10:45.266749+0000","last_active":"2024-08-27T03:55:45.294482+0000","last_peered":"2024-08-27T03:55:45.294482+0000","last_clean":"2024-08-27T03:55:45.294482+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:55:45.294482+0000","last_undegraded":"2024-08-27T03:55:45.294482+0000","last_fullsized":"2024-08-27T03:55:45.294482+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:25:14.767363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307348+0000","last_change":"2024-08-27T02:50:55.806234+0000","last_active":"2024-08-27T03:56:15.307348+0000","last_peered":"2024-08-27T03:56:15.307348+0000","last_clean":"2024-08-27T03:56:15.307348+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:56:15.307348+0000","last_undegraded":"2024-08-27T03:56:15.307348+0000","last_fullsized":"2024-08-27T03:56:15.307348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:26.269206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128113+0000","last_change":"2024-08-27T02:50:51.727708+0000","last_active":"2024-08-27T03:58:25.128113+0000","last_peered":"2024-08-27T03:58:25.128113+0000","last_clean":"2024-08-27T03:58:25.128113+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:58:25.128113+0000","last_undegraded":"2024-08-27T03:58:25.128113+0000","last_fullsized":"2024-08-27T03:58:25.128113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:26:00.265762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461291+0000","last_change":"2024-08-27T02:46:49.658797+0000","last_active":"2024-08-27T03:56:10.461291+0000","last_peered":"2024-08-27T03:56:10.461291+0000","last_clean":"2024-08-27T03:56:10.461291+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:56:10.461291+0000","last_undegraded":"2024-08-27T03:56:10.461291+0000","last_fullsized":"2024-08-27T03:56:10.461291+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:21.705436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.280973+0000","last_change":"2024-08-27T03:10:45.299158+0000","last_active":"2024-08-27T03:54:30.280973+0000","last_peered":"2024-08-27T03:54:30.280973+0000","last_clean":"2024-08-27T03:54:30.280973+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:54:30.280973+0000","last_undegraded":"2024-08-27T03:54:30.280973+0000","last_fullsized":"2024-08-27T03:54:30.280973+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:52:58.039454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294519+0000","last_change":"2024-08-27T02:50:55.778021+0000","last_active":"2024-08-27T03:55:45.294519+0000","last_peered":"2024-08-27T03:55:45.294519+0000","last_clean":"2024-08-27T03:55:45.294519+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:55:45.294519+0000","last_undegraded":"2024-08-27T03:55:45.294519+0000","last_fullsized":"2024-08-27T03:55:45.294519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:18:53.906397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.326804+0000","last_change":"2024-08-27T02:50:51.715619+0000","last_active":"2024-08-27T03:57:35.326804+0000","last_peered":"2024-08-27T03:57:35.326804+0000","last_clean":"2024-08-27T03:57:35.326804+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:57:35.326804+0000","last_undegraded":"2024-08-27T03:57:35.326804+0000","last_fullsized":"2024-08-27T03:57:35.326804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:22:37.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300942+0000","last_change":"2024-08-27T02:46:49.677851+0000","last_active":"2024-08-27T03:56:10.300942+0000","last_peered":"2024-08-27T03:56:10.300942+0000","last_clean":"2024-08-27T03:56:10.300942+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:56:10.300942+0000","last_undegraded":"2024-08-27T03:56:10.300942+0000","last_fullsized":"2024-08-27T03:56:10.300942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:32.601632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858095+0000","last_change":"2024-08-27T03:10:45.277501+0000","last_active":"2024-08-27T03:54:29.858095+0000","last_peered":"2024-08-27T03:54:29.858095+0000","last_clean":"2024-08-27T03:54:29.858095+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:54:29.858095+0000","last_undegraded":"2024-08-27T03:54:29.858095+0000","last_fullsized":"2024-08-27T03:54:29.858095+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:52:19.885914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290804+0000","last_change":"2024-08-27T02:50:55.775204+0000","last_active":"2024-08-27T03:55:30.290804+0000","last_peered":"2024-08-27T03:55:30.290804+0000","last_clean":"2024-08-27T03:55:30.290804+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:55:30.290804+0000","last_undegraded":"2024-08-27T03:55:30.290804+0000","last_fullsized":"2024-08-27T03:55:30.290804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:27:44.097101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'6","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.745784+0000","last_change":"2024-08-27T02:50:51.712535+0000","last_active":"2024-08-27T03:58:29.745784+0000","last_peered":"2024-08-27T03:58:29.745784+0000","last_clean":"2024-08-27T03:58:29.745784+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:58:29.745784+0000","last_undegraded":"2024-08-27T03:58:29.745784+0000","last_fullsized":"2024-08-27T03:58:29.745784+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:06.145410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461503+0000","last_change":"2024-08-27T02:46:49.657230+0000","last_active":"2024-08-27T03:56:10.461503+0000","last_peered":"2024-08-27T03:56:10.461503+0000","last_clean":"2024-08-27T03:56:10.461503+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:56:10.461503+0000","last_undegraded":"2024-08-27T03:56:10.461503+0000","last_fullsized":"2024-08-27T03:56:10.461503+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:31.912789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:51.062718+0000","last_change":"2024-08-27T03:10:45.304634+0000","last_active":"2024-08-27T03:54:51.062718+0000","last_peered":"2024-08-27T03:54:51.062718+0000","last_clean":"2024-08-27T03:54:51.062718+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:54:51.062718+0000","last_undegraded":"2024-08-27T03:54:51.062718+0000","last_fullsized":"2024-08-27T03:54:51.062718+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:40.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302531+0000","last_change":"2024-08-27T02:50:55.800079+0000","last_active":"2024-08-27T03:55:55.302531+0000","last_peered":"2024-08-27T03:55:55.302531+0000","last_clean":"2024-08-27T03:55:55.302531+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:55:55.302531+0000","last_undegraded":"2024-08-27T03:55:55.302531+0000","last_fullsized":"2024-08-27T03:55:55.302531+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:24:12.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.878104+0000","last_change":"2024-08-27T02:50:51.722487+0000","last_active":"2024-08-27T03:55:54.878104+0000","last_peered":"2024-08-27T03:55:54.878104+0000","last_clean":"2024-08-27T03:55:54.878104+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:55:54.878104+0000","last_undegraded":"2024-08-27T03:55:54.878104+0000","last_fullsized":"2024-08-27T03:55:54.878104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:03.625739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302418+0000","last_change":"2024-08-27T02:46:49.670647+0000","last_active":"2024-08-27T03:55:55.302418+0000","last_peered":"2024-08-27T03:55:55.302418+0000","last_clean":"2024-08-27T03:55:55.302418+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:55:55.302418+0000","last_undegraded":"2024-08-27T03:55:55.302418+0000","last_fullsized":"2024-08-27T03:55:55.302418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:21:10.983060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072751+0000","last_change":"2024-08-27T03:10:45.294675+0000","last_active":"2024-08-27T03:54:30.072751+0000","last_peered":"2024-08-27T03:54:30.072751+0000","last_clean":"2024-08-27T03:54:30.072751+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:54:30.072751+0000","last_undegraded":"2024-08-27T03:54:30.072751+0000","last_fullsized":"2024-08-27T03:54:30.072751+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:48.670669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093451+0000","last_change":"2024-08-27T02:50:55.767291+0000","last_active":"2024-08-27T03:55:55.093451+0000","last_peered":"2024-08-27T03:55:55.093451+0000","last_clean":"2024-08-27T03:55:55.093451+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:55:55.093451+0000","last_undegraded":"2024-08-27T03:55:55.093451+0000","last_fullsized":"2024-08-27T03:55:55.093451+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:34.369306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.334012+0000","last_change":"2024-08-27T02:50:51.715173+0000","last_active":"2024-08-27T03:58:05.334012+0000","last_peered":"2024-08-27T03:58:05.334012+0000","last_clean":"2024-08-27T03:58:05.334012+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:58:05.334012+0000","last_undegraded":"2024-08-27T03:58:05.334012+0000","last_fullsized":"2024-08-27T03:58:05.334012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:01:41.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.072924+0000","last_change":"2024-08-27T02:46:49.659905+0000","last_active":"2024-08-27T03:55:36.072924+0000","last_peered":"2024-08-27T03:55:36.072924+0000","last_clean":"2024-08-27T03:55:36.072924+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:55:36.072924+0000","last_undegraded":"2024-08-27T03:55:36.072924+0000","last_fullsized":"2024-08-27T03:55:36.072924+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:42:58.919137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.080081+0000","last_change":"2024-08-27T03:10:45.302257+0000","last_active":"2024-08-27T03:56:15.080081+0000","last_peered":"2024-08-27T03:56:15.080081+0000","last_clean":"2024-08-27T03:56:15.080081+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:56:15.080081+0000","last_undegraded":"2024-08-27T03:56:15.080081+0000","last_fullsized":"2024-08-27T03:56:15.080081+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:49:38.342418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.039145+0000","last_change":"2024-08-27T02:50:55.776653+0000","last_active":"2024-08-27T03:58:30.039145+0000","last_peered":"2024-08-27T03:58:30.039145+0000","last_clean":"2024-08-27T03:58:30.039145+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:58:30.039145+0000","last_undegraded":"2024-08-27T03:58:30.039145+0000","last_fullsized":"2024-08-27T03:58:30.039145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:30:47.655678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292165+0000","last_change":"2024-08-27T02:50:51.712698+0000","last_active":"2024-08-27T03:55:15.292165+0000","last_peered":"2024-08-27T03:55:15.292165+0000","last_clean":"2024-08-27T03:55:15.292165+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:55:15.292165+0000","last_undegraded":"2024-08-27T03:55:15.292165+0000","last_fullsized":"2024-08-27T03:55:15.292165+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:54.805987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873157+0000","last_change":"2024-08-27T02:46:49.666166+0000","last_active":"2024-08-27T03:55:34.873157+0000","last_peered":"2024-08-27T03:55:34.873157+0000","last_clean":"2024-08-27T03:55:34.873157+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:55:34.873157+0000","last_undegraded":"2024-08-27T03:55:34.873157+0000","last_fullsized":"2024-08-27T03:55:34.873157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:59:52.040406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.302157+0000","last_change":"2024-08-27T03:10:45.289668+0000","last_active":"2024-08-27T03:56:15.302157+0000","last_peered":"2024-08-27T03:56:15.302157+0000","last_clean":"2024-08-27T03:56:15.302157+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:56:15.302157+0000","last_undegraded":"2024-08-27T03:56:15.302157+0000","last_fullsized":"2024-08-27T03:56:15.302157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:24.929800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.868290+0000","last_change":"2024-08-27T02:50:55.777558+0000","last_active":"2024-08-27T03:55:14.868290+0000","last_peered":"2024-08-27T03:55:14.868290+0000","last_clean":"2024-08-27T03:55:14.868290+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:55:14.868290+0000","last_undegraded":"2024-08-27T03:55:14.868290+0000","last_fullsized":"2024-08-27T03:55:14.868290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:52.030335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'7","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.326696+0000","last_change":"2024-08-27T02:50:51.718684+0000","last_active":"2024-08-27T03:57:35.326696+0000","last_peered":"2024-08-27T03:57:35.326696+0000","last_clean":"2024-08-27T03:57:35.326696+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:57:35.326696+0000","last_undegraded":"2024-08-27T03:57:35.326696+0000","last_fullsized":"2024-08-27T03:57:35.326696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:58:00.220312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.088488+0000","last_change":"2024-08-27T02:46:49.666930+0000","last_active":"2024-08-27T03:55:35.088488+0000","last_peered":"2024-08-27T03:55:35.088488+0000","last_clean":"2024-08-27T03:55:35.088488+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:55:35.088488+0000","last_undegraded":"2024-08-27T03:55:35.088488+0000","last_fullsized":"2024-08-27T03:55:35.088488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:46.255173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495870+0000","last_change":"2024-08-27T03:10:45.281649+0000","last_active":"2024-08-27T03:54:30.495870+0000","last_peered":"2024-08-27T03:54:30.495870+0000","last_clean":"2024-08-27T03:54:30.495870+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:54:30.495870+0000","last_undegraded":"2024-08-27T03:54:30.495870+0000","last_fullsized":"2024-08-27T03:54:30.495870+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:51:40.495289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.480110+0000","last_change":"2024-08-27T02:50:55.790207+0000","last_active":"2024-08-27T03:57:35.480110+0000","last_peered":"2024-08-27T03:57:35.480110+0000","last_clean":"2024-08-27T03:57:35.480110+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:57:35.480110+0000","last_undegraded":"2024-08-27T03:57:35.480110+0000","last_fullsized":"2024-08-27T03:57:35.480110+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:29.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070538+0000","last_change":"2024-08-27T02:50:51.740655+0000","last_active":"2024-08-27T03:55:26.070538+0000","last_peered":"2024-08-27T03:55:26.070538+0000","last_clean":"2024-08-27T03:55:26.070538+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:55:26.070538+0000","last_undegraded":"2024-08-27T03:55:26.070538+0000","last_fullsized":"2024-08-27T03:55:26.070538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.497115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.453720+0000","last_change":"2024-08-27T02:46:49.638555+0000","last_active":"2024-08-27T03:55:35.453720+0000","last_peered":"2024-08-27T03:55:35.453720+0000","last_clean":"2024-08-27T03:55:35.453720+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:55:35.453720+0000","last_undegraded":"2024-08-27T03:55:35.453720+0000","last_fullsized":"2024-08-27T03:55:35.453720+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:10.855684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.283538+0000","last_change":"2024-08-27T03:10:45.290709+0000","last_active":"2024-08-27T03:54:40.283538+0000","last_peered":"2024-08-27T03:54:40.283538+0000","last_clean":"2024-08-27T03:54:40.283538+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:54:40.283538+0000","last_undegraded":"2024-08-27T03:54:40.283538+0000","last_fullsized":"2024-08-27T03:54:40.283538+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:12:15.082820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.116553+0000","last_change":"2024-08-27T02:50:55.772109+0000","last_active":"2024-08-27T03:57:35.116553+0000","last_peered":"2024-08-27T03:57:35.116553+0000","last_clean":"2024-08-27T03:57:35.116553+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:57:35.116553+0000","last_undegraded":"2024-08-27T03:57:35.116553+0000","last_fullsized":"2024-08-27T03:57:35.116553+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:34.257753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.452715+0000","last_change":"2024-08-27T02:50:51.705872+0000","last_active":"2024-08-27T03:55:30.452715+0000","last_peered":"2024-08-27T03:55:30.452715+0000","last_clean":"2024-08-27T03:55:30.452715+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:55:30.452715+0000","last_undegraded":"2024-08-27T03:55:30.452715+0000","last_fullsized":"2024-08-27T03:55:30.452715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:55.217217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290820+0000","last_change":"2024-08-27T02:46:49.667612+0000","last_active":"2024-08-27T03:55:10.290820+0000","last_peered":"2024-08-27T03:55:10.290820+0000","last_clean":"2024-08-27T03:55:10.290820+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:55:10.290820+0000","last_undegraded":"2024-08-27T03:55:10.290820+0000","last_fullsized":"2024-08-27T03:55:10.290820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:31.706212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'314","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.704202+0000","last_change":"2024-08-27T02:31:04.495209+0000","last_active":"2024-08-27T03:58:31.704202+0000","last_peered":"2024-08-27T03:58:31.704202+0000","last_clean":"2024-08-27T03:58:31.704202+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:31.704202+0000","last_undegraded":"2024-08-27T03:58:31.704202+0000","last_fullsized":"2024-08-27T03:58:31.704202+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:38:11.148447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291497,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":22191,"num_write":1009,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'457","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.605860+0000","last_change":"2024-08-27T02:31:06.459589+0000","last_active":"2024-08-27T03:56:42.605860+0000","last_peered":"2024-08-27T03:56:42.605860+0000","last_clean":"2024-08-27T03:56:42.605860+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:56:42.605860+0000","last_undegraded":"2024-08-27T03:56:42.605860+0000","last_fullsized":"2024-08-27T03:56:42.605860+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:09.070330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'361","reported_seq":1049,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.749381+0000","last_change":"2024-08-27T02:31:04.454947+0000","last_active":"2024-08-27T03:58:31.749381+0000","last_peered":"2024-08-27T03:58:31.749381+0000","last_clean":"2024-08-27T03:58:31.749381+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:31.749381+0000","last_undegraded":"2024-08-27T03:58:31.749381+0000","last_fullsized":"2024-08-27T03:58:31.749381+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424748,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":39942,"num_write":1277,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'825","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.450685+0000","last_change":"2024-08-27T02:31:06.453930+0000","last_active":"2024-08-27T03:56:44.450685+0000","last_peered":"2024-08-27T03:56:44.450685+0000","last_clean":"2024-08-27T03:56:44.450685+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:56:44.450685+0000","last_undegraded":"2024-08-27T03:56:44.450685+0000","last_fullsized":"2024-08-27T03:56:44.450685+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:09.257638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'282","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.853105+0000","last_change":"2024-08-27T02:31:04.493891+0000","last_active":"2024-08-27T03:58:31.853105+0000","last_peered":"2024-08-27T03:58:31.853105+0000","last_clean":"2024-08-27T03:58:31.853105+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:31.853105+0000","last_undegraded":"2024-08-27T03:58:31.853105+0000","last_fullsized":"2024-08-27T03:58:31.853105+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":449,"num_write":920,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1216","reported_seq":2730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.360305+0000","last_change":"2024-08-27T02:31:06.464864+0000","last_active":"2024-08-27T03:54:25.360305+0000","last_peered":"2024-08-27T03:54:25.360305+0000","last_clean":"2024-08-27T03:54:25.360305+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:54:25.360305+0000","last_undegraded":"2024-08-27T03:54:25.360305+0000","last_fullsized":"2024-08-27T03:54:25.360305+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:57:06.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'320","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.698848+0000","last_change":"2024-08-27T02:31:04.469467+0000","last_active":"2024-08-27T03:58:31.698848+0000","last_peered":"2024-08-27T03:58:31.698848+0000","last_clean":"2024-08-27T03:58:31.698848+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:31.698848+0000","last_undegraded":"2024-08-27T03:58:31.698848+0000","last_fullsized":"2024-08-27T03:58:31.698848+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:20:36.614222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":3871,"num_write":1091,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'480","reported_seq":2134,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.441763+0000","last_change":"2024-08-27T02:31:06.457144+0000","last_active":"2024-08-27T03:56:44.441763+0000","last_peered":"2024-08-27T03:56:44.441763+0000","last_clean":"2024-08-27T03:56:44.441763+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:56:44.441763+0000","last_undegraded":"2024-08-27T03:56:44.441763+0000","last_fullsized":"2024-08-27T03:56:44.441763+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:55:40.220861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'389","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.797460+0000","last_change":"2024-08-27T02:31:04.489890+0000","last_active":"2024-08-27T03:58:31.797460+0000","last_peered":"2024-08-27T03:58:31.797460+0000","last_clean":"2024-08-27T03:58:31.797460+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:31.797460+0000","last_undegraded":"2024-08-27T03:58:31.797460+0000","last_fullsized":"2024-08-27T03:58:31.797460+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:07:25.086829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493421,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":17279,"num_write":1203,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'493","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.525387+0000","last_change":"2024-08-27T02:31:06.469894+0000","last_active":"2024-08-27T03:56:44.525387+0000","last_peered":"2024-08-27T03:56:44.525387+0000","last_clean":"2024-08-27T03:56:44.525387+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:56:44.525387+0000","last_undegraded":"2024-08-27T03:56:44.525387+0000","last_fullsized":"2024-08-27T03:56:44.525387+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:32:27.240233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'334","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.853576+0000","last_change":"2024-08-27T02:31:04.451736+0000","last_active":"2024-08-27T03:58:31.853576+0000","last_peered":"2024-08-27T03:58:31.853576+0000","last_clean":"2024-08-27T03:58:31.853576+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:31.853576+0000","last_undegraded":"2024-08-27T03:58:31.853576+0000","last_fullsized":"2024-08-27T03:58:31.853576+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:49:13.433050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399097,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":18975,"num_write":950,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1780,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.073015+0000","last_change":"2024-08-27T02:31:06.464775+0000","last_active":"2024-08-27T03:54:30.073015+0000","last_peered":"2024-08-27T03:54:30.073015+0000","last_clean":"2024-08-27T03:54:30.073015+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:54:30.073015+0000","last_undegraded":"2024-08-27T03:54:30.073015+0000","last_fullsized":"2024-08-27T03:54:30.073015+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:49:58.791418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'354","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.760854+0000","last_change":"2024-08-27T02:31:39.748095+0000","last_active":"2024-08-27T03:58:31.760854+0000","last_peered":"2024-08-27T03:58:31.760854+0000","last_clean":"2024-08-27T03:58:31.760854+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:31.760854+0000","last_undegraded":"2024-08-27T03:58:31.760854+0000","last_fullsized":"2024-08-27T03:58:31.760854+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:23:44.181903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5643582,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":18874,"num_write":1149,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'903","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.948193+0000","last_change":"2024-08-27T02:31:06.441463+0000","last_active":"2024-08-27T03:58:02.948193+0000","last_peered":"2024-08-27T03:58:02.948193+0000","last_clean":"2024-08-27T03:58:02.948193+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:02.948193+0000","last_undegraded":"2024-08-27T03:58:02.948193+0000","last_fullsized":"2024-08-27T03:58:02.948193+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:32:21.433480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'344","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.835033+0000","last_change":"2024-08-27T02:31:04.460911+0000","last_active":"2024-08-27T03:58:31.835033+0000","last_peered":"2024-08-27T03:58:31.835033+0000","last_clean":"2024-08-27T03:58:31.835033+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:31.835033+0000","last_undegraded":"2024-08-27T03:58:31.835033+0000","last_fullsized":"2024-08-27T03:58:31.835033+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:09.211873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550512,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":6557,"num_write":1048,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'920","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057701+0000","last_change":"2024-08-27T02:31:06.459200+0000","last_active":"2024-08-27T03:54:30.057701+0000","last_peered":"2024-08-27T03:54:30.057701+0000","last_clean":"2024-08-27T03:54:30.057701+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:54:30.057701+0000","last_undegraded":"2024-08-27T03:54:30.057701+0000","last_fullsized":"2024-08-27T03:54:30.057701+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:09:01.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'768","reported_seq":2529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677234+0000","last_change":"2024-08-27T02:31:06.466669+0000","last_active":"2024-08-27T03:56:42.677234+0000","last_peered":"2024-08-27T03:56:42.677234+0000","last_clean":"2024-08-27T03:56:42.677234+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:56:42.677234+0000","last_undegraded":"2024-08-27T03:56:42.677234+0000","last_fullsized":"2024-08-27T03:56:42.677234+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:23:04.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'317","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.843954+0000","last_change":"2024-08-27T02:31:04.495961+0000","last_active":"2024-08-27T03:58:31.843954+0000","last_peered":"2024-08-27T03:58:31.843954+0000","last_clean":"2024-08-27T03:58:31.843954+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:31.843954+0000","last_undegraded":"2024-08-27T03:58:31.843954+0000","last_fullsized":"2024-08-27T03:58:31.843954+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.777645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":9006,"num_write":957,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'787","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290995+0000","last_change":"2024-08-27T02:31:06.454274+0000","last_active":"2024-08-27T03:55:10.290995+0000","last_peered":"2024-08-27T03:55:10.290995+0000","last_clean":"2024-08-27T03:55:10.290995+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:55:10.290995+0000","last_undegraded":"2024-08-27T03:55:10.290995+0000","last_fullsized":"2024-08-27T03:55:10.290995+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:09:59.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'361","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.769091+0000","last_change":"2024-08-27T02:31:04.457818+0000","last_active":"2024-08-27T03:58:31.769091+0000","last_peered":"2024-08-27T03:58:31.769091+0000","last_clean":"2024-08-27T03:58:31.769091+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:31.769091+0000","last_undegraded":"2024-08-27T03:58:31.769091+0000","last_fullsized":"2024-08-27T03:58:31.769091+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:01:36.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":653,"num_read_kb":8370,"num_write":1179,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'487","reported_seq":2244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873079+0000","last_change":"2024-08-27T02:31:06.447246+0000","last_active":"2024-08-27T03:55:34.873079+0000","last_peered":"2024-08-27T03:55:34.873079+0000","last_clean":"2024-08-27T03:55:34.873079+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:55:34.873079+0000","last_undegraded":"2024-08-27T03:55:34.873079+0000","last_fullsized":"2024-08-27T03:55:34.873079+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:18:22.098121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'337","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.848179+0000","last_change":"2024-08-27T02:31:39.807510+0000","last_active":"2024-08-27T03:58:31.848179+0000","last_peered":"2024-08-27T03:58:31.848179+0000","last_clean":"2024-08-27T03:58:31.848179+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:31.848179+0000","last_undegraded":"2024-08-27T03:58:31.848179+0000","last_fullsized":"2024-08-27T03:58:31.848179+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:54.340417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569152,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":11498,"num_write":1125,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'683","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.996353+0000","last_change":"2024-08-27T02:31:06.453083+0000","last_active":"2024-08-27T03:58:02.996353+0000","last_peered":"2024-08-27T03:58:02.996353+0000","last_clean":"2024-08-27T03:58:02.996353+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:02.996353+0000","last_undegraded":"2024-08-27T03:58:02.996353+0000","last_fullsized":"2024-08-27T03:58:02.996353+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:51:51.420652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'369","reported_seq":1133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.793258+0000","last_change":"2024-08-27T02:31:04.464917+0000","last_active":"2024-08-27T03:58:31.793258+0000","last_peered":"2024-08-27T03:58:31.793258+0000","last_clean":"2024-08-27T03:58:31.793258+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:31.793258+0000","last_undegraded":"2024-08-27T03:58:31.793258+0000","last_fullsized":"2024-08-27T03:58:31.793258+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:42.233736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":144736,"num_write":1195,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'477","reported_seq":2100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.520780+0000","last_change":"2024-08-27T02:31:06.456023+0000","last_active":"2024-08-27T03:56:44.520780+0000","last_peered":"2024-08-27T03:56:44.520780+0000","last_clean":"2024-08-27T03:56:44.520780+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:56:44.520780+0000","last_undegraded":"2024-08-27T03:56:44.520780+0000","last_fullsized":"2024-08-27T03:56:44.520780+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:57:03.958056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'335","reported_seq":1049,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.834620+0000","last_change":"2024-08-27T02:31:04.450019+0000","last_active":"2024-08-27T03:58:31.834620+0000","last_peered":"2024-08-27T03:58:31.834620+0000","last_clean":"2024-08-27T03:58:31.834620+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:31.834620+0000","last_undegraded":"2024-08-27T03:58:31.834620+0000","last_fullsized":"2024-08-27T03:58:31.834620+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:26.736946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":571,"num_read_kb":47085,"num_write":1065,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'764","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090961+0000","last_change":"2024-08-27T02:31:06.457069+0000","last_active":"2024-08-27T03:55:45.090961+0000","last_peered":"2024-08-27T03:55:45.090961+0000","last_clean":"2024-08-27T03:55:45.090961+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:55:45.090961+0000","last_undegraded":"2024-08-27T03:55:45.090961+0000","last_fullsized":"2024-08-27T03:55:45.090961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:48.523132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'335","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.818718+0000","last_change":"2024-08-27T02:31:04.456657+0000","last_active":"2024-08-27T03:58:31.818718+0000","last_peered":"2024-08-27T03:58:31.818718+0000","last_clean":"2024-08-27T03:58:31.818718+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:31.818718+0000","last_undegraded":"2024-08-27T03:58:31.818718+0000","last_fullsized":"2024-08-27T03:58:31.818718+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:01:15.039976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14802,"num_write":998,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.850365+0000","last_change":"2024-08-27T02:31:14.508871+0000","last_active":"2024-08-27T03:56:44.850365+0000","last_peered":"2024-08-27T03:56:44.850365+0000","last_clean":"2024-08-27T03:56:44.850365+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:56:44.850365+0000","last_undegraded":"2024-08-27T03:56:44.850365+0000","last_fullsized":"2024-08-27T03:56:44.850365+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:53:01.791364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'626","reported_seq":2345,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.935016+0000","last_change":"2024-08-27T02:31:06.447319+0000","last_active":"2024-08-27T03:58:02.935016+0000","last_peered":"2024-08-27T03:58:02.935016+0000","last_clean":"2024-08-27T03:58:02.935016+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:02.935016+0000","last_undegraded":"2024-08-27T03:58:02.935016+0000","last_fullsized":"2024-08-27T03:58:02.935016+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:57.126762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'362","reported_seq":1021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.848600+0000","last_change":"2024-08-27T02:31:04.493003+0000","last_active":"2024-08-27T03:58:31.848600+0000","last_peered":"2024-08-27T03:58:31.848600+0000","last_clean":"2024-08-27T03:58:31.848600+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:31.848600+0000","last_undegraded":"2024-08-27T03:58:31.848600+0000","last_fullsized":"2024-08-27T03:58:31.848600+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:12:45.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":48228,"num_write":1146,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875703+0000","last_change":"2024-08-27T02:31:08.475606+0000","last_active":"2024-08-27T03:55:44.875703+0000","last_peered":"2024-08-27T03:55:44.875703+0000","last_clean":"2024-08-27T03:55:44.875703+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:55:44.875703+0000","last_undegraded":"2024-08-27T03:55:44.875703+0000","last_fullsized":"2024-08-27T03:55:44.875703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:10.435910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'372","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.993826+0000","last_change":"2024-08-27T02:31:10.474061+0000","last_active":"2024-08-27T03:58:30.993826+0000","last_peered":"2024-08-27T03:58:30.993826+0000","last_clean":"2024-08-27T03:58:30.993826+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:30.993826+0000","last_undegraded":"2024-08-27T03:58:30.993826+0000","last_fullsized":"2024-08-27T03:58:30.993826+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:14.597433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45479,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1191,"num_write":460,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.301263+0000","last_change":"2024-08-27T02:31:12.513470+0000","last_active":"2024-08-27T03:55:50.301263+0000","last_peered":"2024-08-27T03:55:50.301263+0000","last_clean":"2024-08-27T03:55:50.301263+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:55:50.301263+0000","last_undegraded":"2024-08-27T03:55:50.301263+0000","last_fullsized":"2024-08-27T03:55:50.301263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.177108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'139","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.610770+0000","last_change":"2024-08-27T02:31:14.508729+0000","last_active":"2024-08-27T03:54:25.610770+0000","last_peered":"2024-08-27T03:54:25.610770+0000","last_clean":"2024-08-27T03:54:25.610770+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:54:25.610770+0000","last_undegraded":"2024-08-27T03:54:25.610770+0000","last_fullsized":"2024-08-27T03:54:25.610770+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:18.167802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'817","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875663+0000","last_change":"2024-08-27T02:31:06.451014+0000","last_active":"2024-08-27T03:55:44.875663+0000","last_peered":"2024-08-27T03:55:44.875663+0000","last_clean":"2024-08-27T03:55:44.875663+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:55:44.875663+0000","last_undegraded":"2024-08-27T03:55:44.875663+0000","last_fullsized":"2024-08-27T03:55:44.875663+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:34:38.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'315","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.852086+0000","last_change":"2024-08-27T02:31:04.492617+0000","last_active":"2024-08-27T03:58:31.852086+0000","last_peered":"2024-08-27T03:58:31.852086+0000","last_clean":"2024-08-27T03:58:31.852086+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:31.852086+0000","last_undegraded":"2024-08-27T03:58:31.852086+0000","last_fullsized":"2024-08-27T03:58:31.852086+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:51.730290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":392,"num_read_kb":13675,"num_write":949,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.892074+0000","last_change":"2024-08-27T02:31:08.444125+0000","last_active":"2024-08-27T03:55:34.892074+0000","last_peered":"2024-08-27T03:55:34.892074+0000","last_clean":"2024-08-27T03:55:34.892074+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:55:34.892074+0000","last_undegraded":"2024-08-27T03:55:34.892074+0000","last_fullsized":"2024-08-27T03:55:34.892074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:50.658905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'118","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.091053+0000","last_change":"2024-08-27T02:31:10.463462+0000","last_active":"2024-08-27T03:55:45.091053+0000","last_peered":"2024-08-27T03:55:45.091053+0000","last_clean":"2024-08-27T03:55:45.091053+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:55:45.091053+0000","last_undegraded":"2024-08-27T03:55:45.091053+0000","last_fullsized":"2024-08-27T03:55:45.091053+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:05.726630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.092259+0000","last_change":"2024-08-27T02:31:12.524180+0000","last_active":"2024-08-27T03:55:50.092259+0000","last_peered":"2024-08-27T03:55:50.092259+0000","last_clean":"2024-08-27T03:55:50.092259+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:55:50.092259+0000","last_undegraded":"2024-08-27T03:55:50.092259+0000","last_fullsized":"2024-08-27T03:55:50.092259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'140","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.401306+0000","last_change":"2024-08-27T02:31:14.511765+0000","last_active":"2024-08-27T03:56:44.401306+0000","last_peered":"2024-08-27T03:56:44.401306+0000","last_clean":"2024-08-27T03:56:44.401306+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:56:44.401306+0000","last_undegraded":"2024-08-27T03:56:44.401306+0000","last_fullsized":"2024-08-27T03:56:44.401306+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:18:47.730369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.523863+0000","last_change":"2024-08-27T02:31:06.450475+0000","last_active":"2024-08-27T03:56:44.523863+0000","last_peered":"2024-08-27T03:56:44.523863+0000","last_clean":"2024-08-27T03:56:44.523863+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:56:44.523863+0000","last_undegraded":"2024-08-27T03:56:44.523863+0000","last_fullsized":"2024-08-27T03:56:44.523863+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:57:34.146161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'379","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.839363+0000","last_change":"2024-08-27T02:31:38.759396+0000","last_active":"2024-08-27T03:58:31.839363+0000","last_peered":"2024-08-27T03:58:31.839363+0000","last_clean":"2024-08-27T03:58:31.839363+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:31.839363+0000","last_undegraded":"2024-08-27T03:58:31.839363+0000","last_fullsized":"2024-08-27T03:58:31.839363+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:50.384706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":34086,"num_write":1252,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727614+0000","last_change":"2024-08-27T02:31:08.475047+0000","last_active":"2024-08-27T03:58:28.727614+0000","last_peered":"2024-08-27T03:58:28.727614+0000","last_clean":"2024-08-27T03:58:28.727614+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:58:28.727614+0000","last_undegraded":"2024-08-27T03:58:28.727614+0000","last_fullsized":"2024-08-27T03:58:28.727614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:00:07.644027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'154","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.068764+0000","last_change":"2024-08-27T02:31:10.464314+0000","last_active":"2024-08-27T03:55:25.068764+0000","last_peered":"2024-08-27T03:55:25.068764+0000","last_clean":"2024-08-27T03:55:25.068764+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:55:25.068764+0000","last_undegraded":"2024-08-27T03:55:25.068764+0000","last_fullsized":"2024-08-27T03:55:25.068764+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:19.772117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'698","reported_seq":2536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.991256+0000","last_change":"2024-08-27T02:31:12.509703+0000","last_active":"2024-08-27T03:58:28.991256+0000","last_peered":"2024-08-27T03:58:28.991256+0000","last_clean":"2024-08-27T03:58:28.991256+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:58:28.991256+0000","last_undegraded":"2024-08-27T03:58:28.991256+0000","last_fullsized":"2024-08-27T03:58:28.991256+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":601,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:41.710475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'177","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.636112+0000","last_change":"2024-08-27T02:31:15.025741+0000","last_active":"2024-08-27T03:58:02.636112+0000","last_peered":"2024-08-27T03:58:02.636112+0000","last_clean":"2024-08-27T03:58:02.636112+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:58:02.636112+0000","last_undegraded":"2024-08-27T03:58:02.636112+0000","last_fullsized":"2024-08-27T03:58:02.636112+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:42:35.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'582","reported_seq":2233,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.527277+0000","last_change":"2024-08-27T02:31:06.461256+0000","last_active":"2024-08-27T03:56:44.527277+0000","last_peered":"2024-08-27T03:56:44.527277+0000","last_clean":"2024-08-27T03:56:44.527277+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:56:44.527277+0000","last_undegraded":"2024-08-27T03:56:44.527277+0000","last_fullsized":"2024-08-27T03:56:44.527277+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:25:53.064370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'340","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.785890+0000","last_change":"2024-08-27T02:31:04.481742+0000","last_active":"2024-08-27T03:58:31.785890+0000","last_peered":"2024-08-27T03:58:31.785890+0000","last_clean":"2024-08-27T03:58:31.785890+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:31.785890+0000","last_undegraded":"2024-08-27T03:58:31.785890+0000","last_fullsized":"2024-08-27T03:58:31.785890+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:44:24.122491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":443,"num_read_kb":7480,"num_write":1117,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875767+0000","last_change":"2024-08-27T02:31:08.476876+0000","last_active":"2024-08-27T03:55:44.875767+0000","last_peered":"2024-08-27T03:55:44.875767+0000","last_clean":"2024-08-27T03:55:44.875767+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:55:44.875767+0000","last_undegraded":"2024-08-27T03:55:44.875767+0000","last_fullsized":"2024-08-27T03:55:44.875767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:49:16.770918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'290","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.333168+0000","last_change":"2024-08-27T02:31:10.638091+0000","last_active":"2024-08-27T03:58:30.333168+0000","last_peered":"2024-08-27T03:58:30.333168+0000","last_clean":"2024-08-27T03:58:30.333168+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:58:30.333168+0000","last_undegraded":"2024-08-27T03:58:30.333168+0000","last_fullsized":"2024-08-27T03:58:30.333168+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:14.620860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'731","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.163701+0000","last_change":"2024-08-27T02:31:12.505687+0000","last_active":"2024-08-27T03:58:31.163701+0000","last_peered":"2024-08-27T03:58:31.163701+0000","last_clean":"2024-08-27T03:58:31.163701+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:58:31.163701+0000","last_undegraded":"2024-08-27T03:58:31.163701+0000","last_fullsized":"2024-08-27T03:58:31.163701+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:36:59.690511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1267","reported_seq":2829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874236+0000","last_change":"2024-08-27T02:31:06.443724+0000","last_active":"2024-08-27T03:55:39.874236+0000","last_peered":"2024-08-27T03:55:39.874236+0000","last_clean":"2024-08-27T03:55:39.874236+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:55:39.874236+0000","last_undegraded":"2024-08-27T03:55:39.874236+0000","last_fullsized":"2024-08-27T03:55:39.874236+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:12:39.506534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'352","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.841409+0000","last_change":"2024-08-27T02:31:04.500120+0000","last_active":"2024-08-27T03:58:31.841409+0000","last_peered":"2024-08-27T03:58:31.841409+0000","last_clean":"2024-08-27T03:58:31.841409+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:31.841409+0000","last_undegraded":"2024-08-27T03:58:31.841409+0000","last_fullsized":"2024-08-27T03:58:31.841409+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:28:33.060344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":34000,"num_write":1087,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.298359+0000","last_change":"2024-08-27T02:31:08.468116+0000","last_active":"2024-08-27T03:55:40.298359+0000","last_peered":"2024-08-27T03:55:40.298359+0000","last_clean":"2024-08-27T03:55:40.298359+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:55:40.298359+0000","last_undegraded":"2024-08-27T03:55:40.298359+0000","last_fullsized":"2024-08-27T03:55:40.298359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:43.021123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'399","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.277174+0000","last_change":"2024-08-27T02:31:10.633487+0000","last_active":"2024-08-27T03:58:31.277174+0000","last_peered":"2024-08-27T03:58:31.277174+0000","last_clean":"2024-08-27T03:58:31.277174+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:58:31.277174+0000","last_undegraded":"2024-08-27T03:58:31.277174+0000","last_fullsized":"2024-08-27T03:58:31.277174+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:27:37.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44175,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":1186,"num_write":474,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058784+0000","last_change":"2024-08-27T02:31:12.508561+0000","last_active":"2024-08-27T03:54:31.058784+0000","last_peered":"2024-08-27T03:54:31.058784+0000","last_clean":"2024-08-27T03:54:31.058784+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:54:31.058784+0000","last_undegraded":"2024-08-27T03:54:31.058784+0000","last_fullsized":"2024-08-27T03:54:31.058784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:32:48.985390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'588","reported_seq":1428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929629+0000","last_change":"2024-08-27T02:31:14.510230+0000","last_active":"2024-08-27T03:58:03.929629+0000","last_peered":"2024-08-27T03:58:03.929629+0000","last_clean":"2024-08-27T03:58:03.929629+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:58:03.929629+0000","last_undegraded":"2024-08-27T03:58:03.929629+0000","last_fullsized":"2024-08-27T03:58:03.929629+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:05:59.246892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1455","reported_seq":2950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217533+0000","last_change":"2024-08-27T02:31:06.455483+0000","last_active":"2024-08-27T03:55:54.217533+0000","last_peered":"2024-08-27T03:55:54.217533+0000","last_clean":"2024-08-27T03:55:54.217533+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:55:54.217533+0000","last_undegraded":"2024-08-27T03:55:54.217533+0000","last_fullsized":"2024-08-27T03:55:54.217533+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:08.735623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'373","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.617220+0000","last_change":"2024-08-27T02:31:04.495144+0000","last_active":"2024-08-27T03:58:31.617220+0000","last_peered":"2024-08-27T03:58:31.617220+0000","last_clean":"2024-08-27T03:58:31.617220+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:31.617220+0000","last_undegraded":"2024-08-27T03:58:31.617220+0000","last_fullsized":"2024-08-27T03:58:31.617220+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:04:23.814829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400081,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":644,"num_read_kb":2850,"num_write":1271,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072095+0000","last_change":"2024-08-27T02:31:08.461348+0000","last_active":"2024-08-27T03:55:40.072095+0000","last_peered":"2024-08-27T03:55:40.072095+0000","last_clean":"2024-08-27T03:55:40.072095+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:55:40.072095+0000","last_undegraded":"2024-08-27T03:55:40.072095+0000","last_fullsized":"2024-08-27T03:55:40.072095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:50.304151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'307","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.550654+0000","last_change":"2024-08-27T02:31:10.465779+0000","last_active":"2024-08-27T03:58:29.550654+0000","last_peered":"2024-08-27T03:58:29.550654+0000","last_clean":"2024-08-27T03:58:29.550654+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:58:29.550654+0000","last_undegraded":"2024-08-27T03:58:29.550654+0000","last_fullsized":"2024-08-27T03:58:29.550654+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:24:14.492475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900276+0000","last_change":"2024-08-27T02:31:12.506224+0000","last_active":"2024-08-27T03:56:09.900276+0000","last_peered":"2024-08-27T03:56:09.900276+0000","last_clean":"2024-08-27T03:56:09.900276+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:56:09.900276+0000","last_undegraded":"2024-08-27T03:56:09.900276+0000","last_fullsized":"2024-08-27T03:56:09.900276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:37.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2395","reported_seq":4229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:50.470481+0000","last_change":"2024-08-27T02:31:14.514506+0000","last_active":"2024-08-27T03:56:50.470481+0000","last_peered":"2024-08-27T03:56:50.470481+0000","last_clean":"2024-08-27T03:56:50.470481+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:56:50.470481+0000","last_undegraded":"2024-08-27T03:56:50.470481+0000","last_fullsized":"2024-08-27T03:56:50.470481+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":2300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:49.198563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'439","reported_seq":1936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.457107+0000","last_change":"2024-08-27T02:31:06.473831+0000","last_active":"2024-08-27T03:55:50.457107+0000","last_peered":"2024-08-27T03:55:50.457107+0000","last_clean":"2024-08-27T03:55:50.457107+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:55:50.457107+0000","last_undegraded":"2024-08-27T03:55:50.457107+0000","last_fullsized":"2024-08-27T03:55:50.457107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:34:41.312642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'337","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.763621+0000","last_change":"2024-08-27T02:31:04.501562+0000","last_active":"2024-08-27T03:58:31.763621+0000","last_peered":"2024-08-27T03:58:31.763621+0000","last_clean":"2024-08-27T03:58:31.763621+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:31.763621+0000","last_undegraded":"2024-08-27T03:58:31.763621+0000","last_fullsized":"2024-08-27T03:58:31.763621+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1998258,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":51263,"num_write":1130,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056621+0000","last_change":"2024-08-27T02:31:08.463300+0000","last_active":"2024-08-27T03:54:25.056621+0000","last_peered":"2024-08-27T03:54:25.056621+0000","last_clean":"2024-08-27T03:54:25.056621+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:54:25.056621+0000","last_undegraded":"2024-08-27T03:54:25.056621+0000","last_fullsized":"2024-08-27T03:54:25.056621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:03.773202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'361","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.406263+0000","last_change":"2024-08-27T02:31:10.476799+0000","last_active":"2024-08-27T03:58:31.406263+0000","last_peered":"2024-08-27T03:58:31.406263+0000","last_clean":"2024-08-27T03:58:31.406263+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:58:31.406263+0000","last_undegraded":"2024-08-27T03:58:31.406263+0000","last_fullsized":"2024-08-27T03:58:31.406263+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:52:11.386500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":1205,"num_write":456,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'720","reported_seq":4951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.335657+0000","last_change":"2024-08-27T02:31:12.515783+0000","last_active":"2024-08-27T03:58:30.335657+0000","last_peered":"2024-08-27T03:58:30.335657+0000","last_clean":"2024-08-27T03:58:30.335657+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:58:30.335657+0000","last_undegraded":"2024-08-27T03:58:30.335657+0000","last_fullsized":"2024-08-27T03:58:30.335657+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:57.983153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'170","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.633450+0000","last_change":"2024-08-27T02:31:14.512105+0000","last_active":"2024-08-27T03:58:02.633450+0000","last_peered":"2024-08-27T03:58:02.633450+0000","last_clean":"2024-08-27T03:58:02.633450+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:58:02.633450+0000","last_undegraded":"2024-08-27T03:58:02.633450+0000","last_fullsized":"2024-08-27T03:58:02.633450+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:45:04.697202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'798","reported_seq":2339,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.931076+0000","last_change":"2024-08-27T02:31:06.448300+0000","last_active":"2024-08-27T03:58:02.931076+0000","last_peered":"2024-08-27T03:58:02.931076+0000","last_clean":"2024-08-27T03:58:02.931076+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:02.931076+0000","last_undegraded":"2024-08-27T03:58:02.931076+0000","last_fullsized":"2024-08-27T03:58:02.931076+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:17.328531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'306","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.816323+0000","last_change":"2024-08-27T02:31:04.451589+0000","last_active":"2024-08-27T03:58:31.816323+0000","last_peered":"2024-08-27T03:58:31.816323+0000","last_clean":"2024-08-27T03:58:31.816323+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:31.816323+0000","last_undegraded":"2024-08-27T03:58:31.816323+0000","last_fullsized":"2024-08-27T03:58:31.816323+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:25.923987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437736,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":7344,"num_write":963,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.075921+0000","last_change":"2024-08-27T02:31:08.455579+0000","last_active":"2024-08-27T03:55:55.075921+0000","last_peered":"2024-08-27T03:55:55.075921+0000","last_clean":"2024-08-27T03:55:55.075921+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:55:55.075921+0000","last_undegraded":"2024-08-27T03:55:55.075921+0000","last_fullsized":"2024-08-27T03:55:55.075921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:50:22.765293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'496","reported_seq":1173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.564486+0000","last_change":"2024-08-27T02:31:10.476948+0000","last_active":"2024-08-27T03:58:31.564486+0000","last_peered":"2024-08-27T03:58:31.564486+0000","last_clean":"2024-08-27T03:58:31.564486+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:58:31.564486+0000","last_undegraded":"2024-08-27T03:58:31.564486+0000","last_fullsized":"2024-08-27T03:58:31.564486+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:15:08.613306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73530,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2086,"num_write":702,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073445+0000","last_change":"2024-08-27T02:31:12.497480+0000","last_active":"2024-08-27T03:55:45.073445+0000","last_peered":"2024-08-27T03:55:45.073445+0000","last_clean":"2024-08-27T03:55:45.073445+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:55:45.073445+0000","last_undegraded":"2024-08-27T03:55:45.073445+0000","last_fullsized":"2024-08-27T03:55:45.073445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:37:27.672439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'129","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.500987+0000","last_change":"2024-08-27T02:31:14.509810+0000","last_active":"2024-08-27T03:56:44.500987+0000","last_peered":"2024-08-27T03:56:44.500987+0000","last_clean":"2024-08-27T03:56:44.500987+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:56:44.500987+0000","last_undegraded":"2024-08-27T03:56:44.500987+0000","last_fullsized":"2024-08-27T03:56:44.500987+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:19:36.713125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'442","reported_seq":1971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071688+0000","last_change":"2024-08-27T02:31:06.467597+0000","last_active":"2024-08-27T03:54:25.071688+0000","last_peered":"2024-08-27T03:54:25.071688+0000","last_clean":"2024-08-27T03:54:25.071688+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:54:25.071688+0000","last_undegraded":"2024-08-27T03:54:25.071688+0000","last_fullsized":"2024-08-27T03:54:25.071688+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:25.304915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'311","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.640261+0000","last_change":"2024-08-27T02:31:04.477417+0000","last_active":"2024-08-27T03:58:31.640261+0000","last_peered":"2024-08-27T03:58:31.640261+0000","last_clean":"2024-08-27T03:58:31.640261+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:31.640261+0000","last_undegraded":"2024-08-27T03:58:31.640261+0000","last_fullsized":"2024-08-27T03:58:31.640261+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:14.347972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490466,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":3133,"num_write":1058,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.056667+0000","last_change":"2024-08-27T02:31:08.455739+0000","last_active":"2024-08-27T03:54:25.056667+0000","last_peered":"2024-08-27T03:54:25.056667+0000","last_clean":"2024-08-27T03:54:25.056667+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:54:25.056667+0000","last_undegraded":"2024-08-27T03:54:25.056667+0000","last_fullsized":"2024-08-27T03:54:25.056667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:28.350091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.873334+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.873334+0000","last_peered":"2024-08-27T03:58:29.873334+0000","last_clean":"2024-08-27T03:58:29.873334+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:58:29.873334+0000","last_undegraded":"2024-08-27T03:58:29.873334+0000","last_fullsized":"2024-08-27T03:58:29.873334+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:05:17.996037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498208+0000","last_change":"2024-08-27T02:31:12.518013+0000","last_active":"2024-08-27T03:54:40.498208+0000","last_peered":"2024-08-27T03:54:40.498208+0000","last_clean":"2024-08-27T03:54:40.498208+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:54:40.498208+0000","last_undegraded":"2024-08-27T03:54:40.498208+0000","last_fullsized":"2024-08-27T03:54:40.498208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:06.086496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'122","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:39.920813+0000","last_change":"2024-08-27T02:31:14.508708+0000","last_active":"2024-08-27T03:57:39.920813+0000","last_peered":"2024-08-27T03:57:39.920813+0000","last_clean":"2024-08-27T03:57:39.920813+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:57:39.920813+0000","last_undegraded":"2024-08-27T03:57:39.920813+0000","last_fullsized":"2024-08-27T03:57:39.920813+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:18.139046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'303","reported_seq":1695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217612+0000","last_change":"2024-08-27T02:31:06.455458+0000","last_active":"2024-08-27T03:55:54.217612+0000","last_peered":"2024-08-27T03:55:54.217612+0000","last_clean":"2024-08-27T03:55:54.217612+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:55:54.217612+0000","last_undegraded":"2024-08-27T03:55:54.217612+0000","last_fullsized":"2024-08-27T03:55:54.217612+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:15.294777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'321","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.743629+0000","last_change":"2024-08-27T02:31:38.753790+0000","last_active":"2024-08-27T03:58:31.743629+0000","last_peered":"2024-08-27T03:58:31.743629+0000","last_clean":"2024-08-27T03:58:31.743629+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:31.743629+0000","last_undegraded":"2024-08-27T03:58:31.743629+0000","last_fullsized":"2024-08-27T03:58:31.743629+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:17:03.166739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":447,"num_read_kb":5526,"num_write":1006,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:26.057616+0000","last_change":"2024-08-27T02:31:08.473152+0000","last_active":"2024-08-27T03:54:26.057616+0000","last_peered":"2024-08-27T03:54:26.057616+0000","last_clean":"2024-08-27T03:54:26.057616+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:54:26.057616+0000","last_undegraded":"2024-08-27T03:54:26.057616+0000","last_fullsized":"2024-08-27T03:54:26.057616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:14.881514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'377","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.317872+0000","last_change":"2024-08-27T02:31:10.462797+0000","last_active":"2024-08-27T03:58:29.317872+0000","last_peered":"2024-08-27T03:58:29.317872+0000","last_clean":"2024-08-27T03:58:29.317872+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:29.317872+0000","last_undegraded":"2024-08-27T03:58:29.317872+0000","last_fullsized":"2024-08-27T03:58:29.317872+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:33.566956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'671","reported_seq":2560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.992508+0000","last_change":"2024-08-27T02:31:12.508008+0000","last_active":"2024-08-27T03:58:28.992508+0000","last_peered":"2024-08-27T03:58:28.992508+0000","last_clean":"2024-08-27T03:58:28.992508+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:28.992508+0000","last_undegraded":"2024-08-27T03:58:28.992508+0000","last_fullsized":"2024-08-27T03:58:28.992508+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:20.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'97","reported_seq":609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.307427+0000","last_change":"2024-08-27T02:31:14.503409+0000","last_active":"2024-08-27T03:56:40.307427+0000","last_peered":"2024-08-27T03:56:40.307427+0000","last_clean":"2024-08-27T03:56:40.307427+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:56:40.307427+0000","last_undegraded":"2024-08-27T03:56:40.307427+0000","last_fullsized":"2024-08-27T03:56:40.307427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:06:36.783130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'835","reported_seq":2581,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071793+0000","last_change":"2024-08-27T02:31:06.471655+0000","last_active":"2024-08-27T03:54:25.071793+0000","last_peered":"2024-08-27T03:54:25.071793+0000","last_clean":"2024-08-27T03:54:25.071793+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:54:25.071793+0000","last_undegraded":"2024-08-27T03:54:25.071793+0000","last_fullsized":"2024-08-27T03:54:25.071793+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:48:58.542463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'328","reported_seq":1134,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.730602+0000","last_change":"2024-08-27T02:31:04.484468+0000","last_active":"2024-08-27T03:58:31.730602+0000","last_peered":"2024-08-27T03:58:31.730602+0000","last_clean":"2024-08-27T03:58:31.730602+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:31.730602+0000","last_undegraded":"2024-08-27T03:58:31.730602+0000","last_fullsized":"2024-08-27T03:58:31.730602+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:45:11.647025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185741,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":802,"num_read_kb":112858,"num_write":1079,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.741436+0000","last_change":"2024-08-27T02:31:08.472253+0000","last_active":"2024-08-27T03:58:28.741436+0000","last_peered":"2024-08-27T03:58:28.741436+0000","last_clean":"2024-08-27T03:58:28.741436+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:28.741436+0000","last_undegraded":"2024-08-27T03:58:28.741436+0000","last_fullsized":"2024-08-27T03:58:28.741436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:32:23.121770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'117","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.870144+0000","last_change":"2024-08-27T02:31:10.637623+0000","last_active":"2024-08-27T03:54:24.870144+0000","last_peered":"2024-08-27T03:54:24.870144+0000","last_clean":"2024-08-27T03:54:24.870144+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:54:24.870144+0000","last_undegraded":"2024-08-27T03:54:24.870144+0000","last_fullsized":"2024-08-27T03:54:24.870144+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:20:41.856144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'692","reported_seq":3064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.997646+0000","last_change":"2024-08-27T02:31:12.491000+0000","last_active":"2024-08-27T03:58:28.997646+0000","last_peered":"2024-08-27T03:58:28.997646+0000","last_clean":"2024-08-27T03:58:28.997646+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:28.997646+0000","last_undegraded":"2024-08-27T03:58:28.997646+0000","last_fullsized":"2024-08-27T03:58:28.997646+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:38.876627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074108+0000","last_change":"2024-08-27T02:31:14.511270+0000","last_active":"2024-08-27T03:54:35.074108+0000","last_peered":"2024-08-27T03:54:35.074108+0000","last_clean":"2024-08-27T03:54:35.074108+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:54:35.074108+0000","last_undegraded":"2024-08-27T03:54:35.074108+0000","last_fullsized":"2024-08-27T03:54:35.074108+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:43.076037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2340,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:36.059935+0000","last_change":"2024-08-27T02:31:06.459516+0000","last_active":"2024-08-27T03:54:36.059935+0000","last_peered":"2024-08-27T03:54:36.059935+0000","last_clean":"2024-08-27T03:54:36.059935+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:54:36.059935+0000","last_undegraded":"2024-08-27T03:54:36.059935+0000","last_fullsized":"2024-08-27T03:54:36.059935+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:49:12.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'384","reported_seq":1104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.784256+0000","last_change":"2024-08-27T02:31:04.475738+0000","last_active":"2024-08-27T03:58:31.784256+0000","last_peered":"2024-08-27T03:58:31.784256+0000","last_clean":"2024-08-27T03:58:31.784256+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:31.784256+0000","last_undegraded":"2024-08-27T03:58:31.784256+0000","last_fullsized":"2024-08-27T03:58:31.784256+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:44:38.581586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":741,"num_read_kb":1678,"num_write":1218,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.071772+0000","last_change":"2024-08-27T02:31:08.477595+0000","last_active":"2024-08-27T03:54:25.071772+0000","last_peered":"2024-08-27T03:54:25.071772+0000","last_clean":"2024-08-27T03:54:25.071772+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:54:25.071772+0000","last_undegraded":"2024-08-27T03:54:25.071772+0000","last_fullsized":"2024-08-27T03:54:25.071772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:59.236199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'402","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.066097+0000","last_change":"2024-08-27T02:31:10.469889+0000","last_active":"2024-08-27T03:58:31.066097+0000","last_peered":"2024-08-27T03:58:31.066097+0000","last_clean":"2024-08-27T03:58:31.066097+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:58:31.066097+0000","last_undegraded":"2024-08-27T03:58:31.066097+0000","last_fullsized":"2024-08-27T03:58:31.066097+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:10:03.812030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46460,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":1211,"num_write":486,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439768+0000","last_change":"2024-08-27T02:31:12.497988+0000","last_active":"2024-08-27T03:54:30.439768+0000","last_peered":"2024-08-27T03:54:30.439768+0000","last_clean":"2024-08-27T03:54:30.439768+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:54:30.439768+0000","last_undegraded":"2024-08-27T03:54:30.439768+0000","last_fullsized":"2024-08-27T03:54:30.439768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:13:47.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'228","reported_seq":770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:41.905788+0000","last_change":"2024-08-27T02:31:14.492927+0000","last_active":"2024-08-27T03:56:41.905788+0000","last_peered":"2024-08-27T03:56:41.905788+0000","last_clean":"2024-08-27T03:56:41.905788+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:56:41.905788+0000","last_undegraded":"2024-08-27T03:56:41.905788+0000","last_fullsized":"2024-08-27T03:56:41.905788+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:13.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'523","reported_seq":2133,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.924936+0000","last_change":"2024-08-27T02:31:06.467157+0000","last_active":"2024-08-27T03:58:02.924936+0000","last_peered":"2024-08-27T03:58:02.924936+0000","last_clean":"2024-08-27T03:58:02.924936+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:02.924936+0000","last_undegraded":"2024-08-27T03:58:02.924936+0000","last_fullsized":"2024-08-27T03:58:02.924936+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:37.085886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290875+0000","last_change":"2024-08-27T02:30:47.729098+0000","last_active":"2024-08-27T03:55:10.290875+0000","last_peered":"2024-08-27T03:55:10.290875+0000","last_clean":"2024-08-27T03:55:10.290875+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:55:10.290875+0000","last_undegraded":"2024-08-27T03:55:10.290875+0000","last_fullsized":"2024-08-27T03:55:10.290875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:46.155361+0000","last_clean_scrub_stamp":"2024-08-27T02:30:46.155361+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:24.032204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884146+0000","last_change":"2024-08-27T02:30:54.230879+0000","last_active":"2024-08-27T03:56:19.884146+0000","last_peered":"2024-08-27T03:56:19.884146+0000","last_clean":"2024-08-27T03:56:19.884146+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:56:19.884146+0000","last_undegraded":"2024-08-27T03:56:19.884146+0000","last_fullsized":"2024-08-27T03:56:19.884146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:44:20.045106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'304","reported_seq":1170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.834668+0000","last_change":"2024-08-27T02:31:04.461391+0000","last_active":"2024-08-27T03:58:31.834668+0000","last_peered":"2024-08-27T03:58:31.834668+0000","last_clean":"2024-08-27T03:58:31.834668+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:31.834668+0000","last_undegraded":"2024-08-27T03:58:31.834668+0000","last_fullsized":"2024-08-27T03:58:31.834668+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:42:05.833893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":118351,"num_write":1022,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281099+0000","last_change":"2024-08-27T02:31:08.459311+0000","last_active":"2024-08-27T03:54:30.281099+0000","last_peered":"2024-08-27T03:54:30.281099+0000","last_clean":"2024-08-27T03:54:30.281099+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:54:30.281099+0000","last_undegraded":"2024-08-27T03:54:30.281099+0000","last_fullsized":"2024-08-27T03:54:30.281099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:59.553379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'733","reported_seq":1475,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.876245+0000","last_change":"2024-08-27T02:31:10.463138+0000","last_active":"2024-08-27T03:58:31.876245+0000","last_peered":"2024-08-27T03:58:31.876245+0000","last_clean":"2024-08-27T03:58:31.876245+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:58:31.876245+0000","last_undegraded":"2024-08-27T03:58:31.876245+0000","last_fullsized":"2024-08-27T03:58:31.876245+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:46:40.351745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136746,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1442,"num_read_kb":3290,"num_write":1350,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294607+0000","last_change":"2024-08-27T02:31:12.521459+0000","last_active":"2024-08-27T03:55:45.294607+0000","last_peered":"2024-08-27T03:55:45.294607+0000","last_clean":"2024-08-27T03:55:45.294607+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:55:45.294607+0000","last_undegraded":"2024-08-27T03:55:45.294607+0000","last_fullsized":"2024-08-27T03:55:45.294607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:35:48.852493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'207","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.606155+0000","last_change":"2024-08-27T02:31:14.512251+0000","last_active":"2024-08-27T03:56:44.606155+0000","last_peered":"2024-08-27T03:56:44.606155+0000","last_clean":"2024-08-27T03:56:44.606155+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:56:44.606155+0000","last_undegraded":"2024-08-27T03:56:44.606155+0000","last_fullsized":"2024-08-27T03:56:44.606155+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:31.795991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1517","reported_seq":3073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.293279+0000","last_change":"2024-08-27T02:31:06.451054+0000","last_active":"2024-08-27T03:55:40.293279+0000","last_peered":"2024-08-27T03:55:40.293279+0000","last_clean":"2024-08-27T03:55:40.293279+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:55:40.293279+0000","last_undegraded":"2024-08-27T03:55:40.293279+0000","last_fullsized":"2024-08-27T03:55:40.293279+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:15:15.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292215+0000","last_change":"2024-08-27T02:30:54.329044+0000","last_active":"2024-08-27T03:55:15.292215+0000","last_peered":"2024-08-27T03:55:15.292215+0000","last_clean":"2024-08-27T03:55:15.292215+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:55:15.292215+0000","last_undegraded":"2024-08-27T03:55:15.292215+0000","last_fullsized":"2024-08-27T03:55:15.292215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:29.700171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'389","reported_seq":1149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.866168+0000","last_change":"2024-08-27T02:31:04.457791+0000","last_active":"2024-08-27T03:58:31.866168+0000","last_peered":"2024-08-27T03:58:31.866168+0000","last_clean":"2024-08-27T03:58:31.866168+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:31.866168+0000","last_undegraded":"2024-08-27T03:58:31.866168+0000","last_fullsized":"2024-08-27T03:58:31.866168+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458876,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":824,"num_read_kb":13511,"num_write":1117,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'5","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727332+0000","last_change":"2024-08-27T02:31:08.472147+0000","last_active":"2024-08-27T03:58:28.727332+0000","last_peered":"2024-08-27T03:58:28.727332+0000","last_clean":"2024-08-27T03:58:28.727332+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:28.727332+0000","last_undegraded":"2024-08-27T03:58:28.727332+0000","last_fullsized":"2024-08-27T03:58:28.727332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:05:58.557262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1339","reported_seq":3325,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.171144+0000","last_change":"2024-08-27T02:31:10.466706+0000","last_active":"2024-08-27T03:58:31.171144+0000","last_peered":"2024-08-27T03:58:31.171144+0000","last_clean":"2024-08-27T03:58:31.171144+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:31.171144+0000","last_undegraded":"2024-08-27T03:58:31.171144+0000","last_fullsized":"2024-08-27T03:58:31.171144+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:35.321692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137506,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2076,"num_read_kb":3979,"num_write":1262,"num_write_kb":1030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:55.287626+0000","last_change":"2024-08-27T02:31:12.508877+0000","last_active":"2024-08-27T03:54:55.287626+0000","last_peered":"2024-08-27T03:54:55.287626+0000","last_clean":"2024-08-27T03:54:55.287626+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:54:55.287626+0000","last_undegraded":"2024-08-27T03:54:55.287626+0000","last_fullsized":"2024-08-27T03:54:55.287626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:12.131410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'164","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929974+0000","last_change":"2024-08-27T02:31:15.023823+0000","last_active":"2024-08-27T03:58:03.929974+0000","last_peered":"2024-08-27T03:58:03.929974+0000","last_clean":"2024-08-27T03:58:03.929974+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:58:03.929974+0000","last_undegraded":"2024-08-27T03:58:03.929974+0000","last_fullsized":"2024-08-27T03:58:03.929974+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:40:47.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079130+0000","last_change":"2024-08-27T02:31:39.754692+0000","last_active":"2024-08-27T03:56:10.079130+0000","last_peered":"2024-08-27T03:56:10.079130+0000","last_clean":"2024-08-27T03:56:10.079130+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:56:10.079130+0000","last_undegraded":"2024-08-27T03:56:10.079130+0000","last_fullsized":"2024-08-27T03:56:10.079130+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:08:56.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:20.081115+0000","last_change":"2024-08-27T02:30:54.225706+0000","last_active":"2024-08-27T03:56:20.081115+0000","last_peered":"2024-08-27T03:56:20.081115+0000","last_clean":"2024-08-27T03:56:20.081115+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:56:20.081115+0000","last_undegraded":"2024-08-27T03:56:20.081115+0000","last_fullsized":"2024-08-27T03:56:20.081115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'400","reported_seq":1106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.828814+0000","last_change":"2024-08-27T02:31:04.461095+0000","last_active":"2024-08-27T03:58:31.828814+0000","last_peered":"2024-08-27T03:58:31.828814+0000","last_clean":"2024-08-27T03:58:31.828814+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:31.828814+0000","last_undegraded":"2024-08-27T03:58:31.828814+0000","last_fullsized":"2024-08-27T03:58:31.828814+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:26:18.748313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":29601,"num_write":1270,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.072448+0000","last_change":"2024-08-27T02:31:08.479508+0000","last_active":"2024-08-27T03:55:40.072448+0000","last_peered":"2024-08-27T03:55:40.072448+0000","last_clean":"2024-08-27T03:55:40.072448+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:55:40.072448+0000","last_undegraded":"2024-08-27T03:55:40.072448+0000","last_fullsized":"2024-08-27T03:55:40.072448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:21.994771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'327","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.502580+0000","last_change":"2024-08-27T02:31:10.637428+0000","last_active":"2024-08-27T03:58:03.502580+0000","last_peered":"2024-08-27T03:58:03.502580+0000","last_clean":"2024-08-27T03:58:03.502580+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:03.502580+0000","last_undegraded":"2024-08-27T03:58:03.502580+0000","last_fullsized":"2024-08-27T03:58:03.502580+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:29.250940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.496951+0000","last_change":"2024-08-27T02:31:12.518266+0000","last_active":"2024-08-27T03:54:35.496951+0000","last_peered":"2024-08-27T03:54:35.496951+0000","last_clean":"2024-08-27T03:54:35.496951+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:54:35.496951+0000","last_undegraded":"2024-08-27T03:54:35.496951+0000","last_fullsized":"2024-08-27T03:54:35.496951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:31:54.032388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'259","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.909802+0000","last_change":"2024-08-27T02:31:14.514321+0000","last_active":"2024-08-27T03:56:44.909802+0000","last_peered":"2024-08-27T03:56:44.909802+0000","last_clean":"2024-08-27T03:56:44.909802+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:56:44.909802+0000","last_undegraded":"2024-08-27T03:56:44.909802+0000","last_fullsized":"2024-08-27T03:56:44.909802+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:43:02.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.672839+0000","last_change":"2024-08-27T02:31:06.453284+0000","last_active":"2024-08-27T03:56:42.672839+0000","last_peered":"2024-08-27T03:56:42.672839+0000","last_clean":"2024-08-27T03:56:42.672839+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:56:42.672839+0000","last_undegraded":"2024-08-27T03:56:42.672839+0000","last_fullsized":"2024-08-27T03:56:42.672839+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:19.884076+0000","last_change":"2024-08-27T02:30:54.233089+0000","last_active":"2024-08-27T03:56:19.884076+0000","last_peered":"2024-08-27T03:56:19.884076+0000","last_clean":"2024-08-27T03:56:19.884076+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:56:19.884076+0000","last_undegraded":"2024-08-27T03:56:19.884076+0000","last_fullsized":"2024-08-27T03:56:19.884076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:12.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'346","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.870782+0000","last_change":"2024-08-27T02:31:04.451624+0000","last_active":"2024-08-27T03:58:31.870782+0000","last_peered":"2024-08-27T03:58:31.870782+0000","last_clean":"2024-08-27T03:58:31.870782+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:31.870782+0000","last_undegraded":"2024-08-27T03:58:31.870782+0000","last_fullsized":"2024-08-27T03:58:31.870782+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:25:39.692713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573788,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":426,"num_read_kb":9573,"num_write":1083,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498104+0000","last_change":"2024-08-27T02:31:08.469937+0000","last_active":"2024-08-27T03:54:40.498104+0000","last_peered":"2024-08-27T03:54:40.498104+0000","last_clean":"2024-08-27T03:54:40.498104+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:54:40.498104+0000","last_undegraded":"2024-08-27T03:54:40.498104+0000","last_fullsized":"2024-08-27T03:54:40.498104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:03.713631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'172","reported_seq":758,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:01.706772+0000","last_change":"2024-08-27T02:31:10.467429+0000","last_active":"2024-08-27T03:58:01.706772+0000","last_peered":"2024-08-27T03:58:01.706772+0000","last_clean":"2024-08-27T03:58:01.706772+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:58:01.706772+0000","last_undegraded":"2024-08-27T03:58:01.706772+0000","last_fullsized":"2024-08-27T03:58:01.706772+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.607849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.456113+0000","last_change":"2024-08-27T02:31:12.523339+0000","last_active":"2024-08-27T03:55:45.456113+0000","last_peered":"2024-08-27T03:55:45.456113+0000","last_clean":"2024-08-27T03:55:45.456113+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:55:45.456113+0000","last_undegraded":"2024-08-27T03:55:45.456113+0000","last_fullsized":"2024-08-27T03:55:45.456113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:50:38.396815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875506+0000","last_change":"2024-08-27T02:31:14.502543+0000","last_active":"2024-08-27T03:55:44.875506+0000","last_peered":"2024-08-27T03:55:44.875506+0000","last_clean":"2024-08-27T03:55:44.875506+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:55:44.875506+0000","last_undegraded":"2024-08-27T03:55:44.875506+0000","last_fullsized":"2024-08-27T03:55:44.875506+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:40:33.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1261","reported_seq":2833,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:31.086498+0000","last_change":"2024-08-27T02:31:06.436150+0000","last_active":"2024-08-27T03:56:31.086498+0000","last_peered":"2024-08-27T03:56:31.086498+0000","last_clean":"2024-08-27T03:56:31.086498+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:56:31.086498+0000","last_undegraded":"2024-08-27T03:56:31.086498+0000","last_fullsized":"2024-08-27T03:56:31.086498+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'345","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.859567+0000","last_change":"2024-08-27T02:31:04.450049+0000","last_active":"2024-08-27T03:58:31.859567+0000","last_peered":"2024-08-27T03:58:31.859567+0000","last_clean":"2024-08-27T03:58:31.859567+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:31.859567+0000","last_undegraded":"2024-08-27T03:58:31.859567+0000","last_fullsized":"2024-08-27T03:58:31.859567+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:23:00.868698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":946,"num_write":1113,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:21.083627+0000","last_change":"2024-08-27T02:30:54.235714+0000","last_active":"2024-08-27T03:56:21.083627+0000","last_peered":"2024-08-27T03:56:21.083627+0000","last_clean":"2024-08-27T03:56:21.083627+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:56:21.083627+0000","last_undegraded":"2024-08-27T03:56:21.083627+0000","last_fullsized":"2024-08-27T03:56:21.083627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:03:53.967353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495848+0000","last_change":"2024-08-27T02:31:08.472606+0000","last_active":"2024-08-27T03:54:30.495848+0000","last_peered":"2024-08-27T03:54:30.495848+0000","last_clean":"2024-08-27T03:54:30.495848+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:54:30.495848+0000","last_undegraded":"2024-08-27T03:54:30.495848+0000","last_fullsized":"2024-08-27T03:54:30.495848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:53.292285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'664","reported_seq":1388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.416703+0000","last_change":"2024-08-27T02:31:10.465002+0000","last_active":"2024-08-27T03:58:30.416703+0000","last_peered":"2024-08-27T03:58:30.416703+0000","last_clean":"2024-08-27T03:58:30.416703+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:30.416703+0000","last_undegraded":"2024-08-27T03:58:30.416703+0000","last_fullsized":"2024-08-27T03:58:30.416703+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:48:12.137313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1780,"num_read_kb":2961,"num_write":2352,"num_write_kb":2124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.074054+0000","last_change":"2024-08-27T02:31:12.500222+0000","last_active":"2024-08-27T03:54:35.074054+0000","last_peered":"2024-08-27T03:54:35.074054+0000","last_clean":"2024-08-27T03:54:35.074054+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:54:35.074054+0000","last_undegraded":"2024-08-27T03:54:35.074054+0000","last_fullsized":"2024-08-27T03:54:35.074054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:27:56.971452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'145","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.589165+0000","last_change":"2024-08-27T02:31:15.026476+0000","last_active":"2024-08-27T03:56:38.589165+0000","last_peered":"2024-08-27T03:56:38.589165+0000","last_clean":"2024-08-27T03:56:38.589165+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:56:38.589165+0000","last_undegraded":"2024-08-27T03:56:38.589165+0000","last_fullsized":"2024-08-27T03:56:38.589165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:06.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'759","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495829+0000","last_change":"2024-08-27T02:31:06.443554+0000","last_active":"2024-08-27T03:54:30.495829+0000","last_peered":"2024-08-27T03:54:30.495829+0000","last_clean":"2024-08-27T03:54:30.495829+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:54:30.495829+0000","last_undegraded":"2024-08-27T03:54:30.495829+0000","last_fullsized":"2024-08-27T03:54:30.495829+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:41.381628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'372","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.856625+0000","last_change":"2024-08-27T02:31:04.460588+0000","last_active":"2024-08-27T03:58:31.856625+0000","last_peered":"2024-08-27T03:58:31.856625+0000","last_clean":"2024-08-27T03:58:31.856625+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:31.856625+0000","last_undegraded":"2024-08-27T03:58:31.856625+0000","last_fullsized":"2024-08-27T03:58:31.856625+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254745,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":622,"num_read_kb":96022,"num_write":1186,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:35.282226+0000","last_change":"2024-08-27T02:30:54.329145+0000","last_active":"2024-08-27T03:54:35.282226+0000","last_peered":"2024-08-27T03:54:35.282226+0000","last_clean":"2024-08-27T03:54:35.282226+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:54:35.282226+0000","last_undegraded":"2024-08-27T03:54:35.282226+0000","last_fullsized":"2024-08-27T03:54:35.282226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:09:53.126738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439720+0000","last_change":"2024-08-27T02:31:08.465815+0000","last_active":"2024-08-27T03:54:30.439720+0000","last_peered":"2024-08-27T03:54:30.439720+0000","last_clean":"2024-08-27T03:54:30.439720+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:54:30.439720+0000","last_undegraded":"2024-08-27T03:54:30.439720+0000","last_fullsized":"2024-08-27T03:54:30.439720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:07:29.803901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'213","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058735+0000","last_change":"2024-08-27T02:31:10.635979+0000","last_active":"2024-08-27T03:54:31.058735+0000","last_peered":"2024-08-27T03:54:31.058735+0000","last_clean":"2024-08-27T03:54:31.058735+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:54:31.058735+0000","last_undegraded":"2024-08-27T03:54:31.058735+0000","last_fullsized":"2024-08-27T03:54:31.058735+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:42.747005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'720","reported_seq":2959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.366191+0000","last_change":"2024-08-27T02:31:12.507006+0000","last_active":"2024-08-27T03:58:31.366191+0000","last_peered":"2024-08-27T03:58:31.366191+0000","last_clean":"2024-08-27T03:58:31.366191+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:58:31.366191+0000","last_undegraded":"2024-08-27T03:58:31.366191+0000","last_fullsized":"2024-08-27T03:58:31.366191+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:59.445792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:09.915872+0000","last_change":"2024-08-27T02:31:15.023353+0000","last_active":"2024-08-27T03:57:09.915872+0000","last_peered":"2024-08-27T03:57:09.915872+0000","last_clean":"2024-08-27T03:57:09.915872+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:57:09.915872+0000","last_undegraded":"2024-08-27T03:57:09.915872+0000","last_fullsized":"2024-08-27T03:57:09.915872+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:35:33.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'409","reported_seq":1935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891884+0000","last_change":"2024-08-27T02:31:06.459269+0000","last_active":"2024-08-27T03:55:34.891884+0000","last_peered":"2024-08-27T03:55:34.891884+0000","last_clean":"2024-08-27T03:55:34.891884+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:55:34.891884+0000","last_undegraded":"2024-08-27T03:55:34.891884+0000","last_fullsized":"2024-08-27T03:55:34.891884+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.224368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'331","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.839877+0000","last_change":"2024-08-27T02:31:04.477646+0000","last_active":"2024-08-27T03:58:31.839877+0000","last_peered":"2024-08-27T03:58:31.839877+0000","last_clean":"2024-08-27T03:58:31.839877+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:31.839877+0000","last_undegraded":"2024-08-27T03:58:31.839877+0000","last_fullsized":"2024-08-27T03:58:31.839877+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:45.643961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":4604,"num_write":1019,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.038731+0000","last_change":"2024-08-27T03:58:36.038731+0000","last_active":"2024-08-27T03:58:36.038731+0000","last_peered":"2024-08-27T03:58:36.038731+0000","last_clean":"2024-08-27T03:58:36.038731+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:58:36.038731+0000","last_undegraded":"2024-08-27T03:58:36.038731+0000","last_fullsized":"2024-08-27T03:58:36.038731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.038657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:07:04.224982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072798+0000","last_change":"2024-08-27T02:31:08.458894+0000","last_active":"2024-08-27T03:54:30.072798+0000","last_peered":"2024-08-27T03:54:30.072798+0000","last_clean":"2024-08-27T03:54:30.072798+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:54:30.072798+0000","last_undegraded":"2024-08-27T03:54:30.072798+0000","last_fullsized":"2024-08-27T03:54:30.072798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:17:30.416824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'160","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072928+0000","last_change":"2024-08-27T02:31:10.461453+0000","last_active":"2024-08-27T03:54:30.072928+0000","last_peered":"2024-08-27T03:54:30.072928+0000","last_clean":"2024-08-27T03:54:30.072928+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:54:30.072928+0000","last_undegraded":"2024-08-27T03:54:30.072928+0000","last_fullsized":"2024-08-27T03:54:30.072928+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:43:13.247299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'732","reported_seq":4715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.163710+0000","last_change":"2024-08-27T02:31:12.506051+0000","last_active":"2024-08-27T03:58:31.163710+0000","last_peered":"2024-08-27T03:58:31.163710+0000","last_clean":"2024-08-27T03:58:31.163710+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:58:31.163710+0000","last_undegraded":"2024-08-27T03:58:31.163710+0000","last_fullsized":"2024-08-27T03:58:31.163710+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:23:19.155039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'206","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.485251+0000","last_change":"2024-08-27T02:31:14.511228+0000","last_active":"2024-08-27T03:56:44.485251+0000","last_peered":"2024-08-27T03:56:44.485251+0000","last_clean":"2024-08-27T03:56:44.485251+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:56:44.485251+0000","last_undegraded":"2024-08-27T03:56:44.485251+0000","last_fullsized":"2024-08-27T03:56:44.485251+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:49:37.070870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'395","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.217585+0000","last_change":"2024-08-27T02:31:06.439611+0000","last_active":"2024-08-27T03:55:54.217585+0000","last_peered":"2024-08-27T03:55:54.217585+0000","last_clean":"2024-08-27T03:55:54.217585+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:55:54.217585+0000","last_undegraded":"2024-08-27T03:55:54.217585+0000","last_fullsized":"2024-08-27T03:55:54.217585+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:00:53.658025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'349","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.751932+0000","last_change":"2024-08-27T02:31:04.493690+0000","last_active":"2024-08-27T03:58:31.751932+0000","last_peered":"2024-08-27T03:58:31.751932+0000","last_clean":"2024-08-27T03:58:31.751932+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:31.751932+0000","last_undegraded":"2024-08-27T03:58:31.751932+0000","last_fullsized":"2024-08-27T03:58:31.751932+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:56.655781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044381,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":35253,"num_write":1103,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.451652+0000","last_change":"2024-08-27T02:30:54.326308+0000","last_active":"2024-08-27T03:55:25.451652+0000","last_peered":"2024-08-27T03:55:25.451652+0000","last_clean":"2024-08-27T03:55:25.451652+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:55:25.451652+0000","last_undegraded":"2024-08-27T03:55:25.451652+0000","last_fullsized":"2024-08-27T03:55:25.451652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:30:51.192106+0000","last_clean_scrub_stamp":"2024-08-27T02:30:51.192106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:39.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891808+0000","last_change":"2024-08-27T02:31:08.470557+0000","last_active":"2024-08-27T03:55:34.891808+0000","last_peered":"2024-08-27T03:55:34.891808+0000","last_clean":"2024-08-27T03:55:34.891808+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:55:34.891808+0000","last_undegraded":"2024-08-27T03:55:34.891808+0000","last_fullsized":"2024-08-27T03:55:34.891808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:16.200643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'797","reported_seq":1553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.922124+0000","last_change":"2024-08-27T02:31:10.635066+0000","last_active":"2024-08-27T03:58:30.922124+0000","last_peered":"2024-08-27T03:58:30.922124+0000","last_clean":"2024-08-27T03:58:30.922124+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:30.922124+0000","last_undegraded":"2024-08-27T03:58:30.922124+0000","last_fullsized":"2024-08-27T03:58:30.922124+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:14:49.402084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135678,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1416,"num_read_kb":3420,"num_write":1150,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:34.872717+0000","last_change":"2024-08-27T02:31:12.504645+0000","last_active":"2024-08-27T03:54:34.872717+0000","last_peered":"2024-08-27T03:54:34.872717+0000","last_clean":"2024-08-27T03:54:34.872717+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:54:34.872717+0000","last_undegraded":"2024-08-27T03:54:34.872717+0000","last_fullsized":"2024-08-27T03:54:34.872717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:57.439347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858183+0000","last_change":"2024-08-27T02:31:14.522454+0000","last_active":"2024-08-27T03:54:29.858183+0000","last_peered":"2024-08-27T03:54:29.858183+0000","last_clean":"2024-08-27T03:54:29.858183+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:54:29.858183+0000","last_undegraded":"2024-08-27T03:54:29.858183+0000","last_fullsized":"2024-08-27T03:54:29.858183+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:07.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'163","reported_seq":747,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.991063+0000","last_change":"2024-08-27T02:31:14.511332+0000","last_active":"2024-08-27T03:56:42.991063+0000","last_peered":"2024-08-27T03:56:42.991063+0000","last_clean":"2024-08-27T03:56:42.991063+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:56:42.991063+0000","last_undegraded":"2024-08-27T03:56:42.991063+0000","last_fullsized":"2024-08-27T03:56:42.991063+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:05:01.793333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'935","reported_seq":2440,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.677370+0000","last_change":"2024-08-27T02:31:06.457663+0000","last_active":"2024-08-27T03:56:42.677370+0000","last_peered":"2024-08-27T03:56:42.677370+0000","last_clean":"2024-08-27T03:56:42.677370+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:56:42.677370+0000","last_undegraded":"2024-08-27T03:56:42.677370+0000","last_fullsized":"2024-08-27T03:56:42.677370+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:41.288217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'378","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.812200+0000","last_change":"2024-08-27T02:31:04.463717+0000","last_active":"2024-08-27T03:58:31.812200+0000","last_peered":"2024-08-27T03:58:31.812200+0000","last_clean":"2024-08-27T03:58:31.812200+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:31.812200+0000","last_undegraded":"2024-08-27T03:58:31.812200+0000","last_fullsized":"2024-08-27T03:58:31.812200+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:55:39.806434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263226,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":507,"num_write":1144,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:11.067136+0000","last_change":"2024-08-27T02:31:08.470840+0000","last_active":"2024-08-27T03:55:11.067136+0000","last_peered":"2024-08-27T03:55:11.067136+0000","last_clean":"2024-08-27T03:55:11.067136+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:55:11.067136+0000","last_undegraded":"2024-08-27T03:55:11.067136+0000","last_fullsized":"2024-08-27T03:55:11.067136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:02.714442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'280","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.333806+0000","last_change":"2024-08-27T02:31:10.463641+0000","last_active":"2024-08-27T03:58:31.333806+0000","last_peered":"2024-08-27T03:58:31.333806+0000","last_clean":"2024-08-27T03:58:31.333806+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:58:31.333806+0000","last_undegraded":"2024-08-27T03:58:31.333806+0000","last_fullsized":"2024-08-27T03:58:31.333806+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:35:43.609652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":955,"num_write":350,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.886578+0000","last_change":"2024-08-27T02:31:12.505279+0000","last_active":"2024-08-27T03:55:14.886578+0000","last_peered":"2024-08-27T03:55:14.886578+0000","last_clean":"2024-08-27T03:55:14.886578+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:55:14.886578+0000","last_undegraded":"2024-08-27T03:55:14.886578+0000","last_fullsized":"2024-08-27T03:55:14.886578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:41.364605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.893070+0000","last_change":"2024-08-27T02:31:14.521163+0000","last_active":"2024-08-27T03:55:39.893070+0000","last_peered":"2024-08-27T03:55:39.893070+0000","last_clean":"2024-08-27T03:55:39.893070+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:55:39.893070+0000","last_undegraded":"2024-08-27T03:55:39.893070+0000","last_fullsized":"2024-08-27T03:55:39.893070+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:59:46.536741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'377","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065840+0000","last_change":"2024-08-27T02:31:06.474269+0000","last_active":"2024-08-27T03:55:06.065840+0000","last_peered":"2024-08-27T03:55:06.065840+0000","last_clean":"2024-08-27T03:55:06.065840+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:55:06.065840+0000","last_undegraded":"2024-08-27T03:55:06.065840+0000","last_fullsized":"2024-08-27T03:55:06.065840+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:31:44.710331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'319","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.746720+0000","last_change":"2024-08-27T02:31:04.501132+0000","last_active":"2024-08-27T03:58:31.746720+0000","last_peered":"2024-08-27T03:58:31.746720+0000","last_clean":"2024-08-27T03:58:31.746720+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:31.746720+0000","last_undegraded":"2024-08-27T03:58:31.746720+0000","last_fullsized":"2024-08-27T03:58:31.746720+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:51.438866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":2061,"num_write":967,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.885122+0000","last_change":"2024-08-27T02:31:08.461957+0000","last_active":"2024-08-27T03:55:09.885122+0000","last_peered":"2024-08-27T03:55:09.885122+0000","last_clean":"2024-08-27T03:55:09.885122+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:55:09.885122+0000","last_undegraded":"2024-08-27T03:55:09.885122+0000","last_fullsized":"2024-08-27T03:55:09.885122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:42.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'55","reported_seq":585,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.285806+0000","last_change":"2024-08-27T02:31:10.464843+0000","last_active":"2024-08-27T03:55:10.285806+0000","last_peered":"2024-08-27T03:55:10.285806+0000","last_clean":"2024-08-27T03:55:10.285806+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:55:10.285806+0000","last_undegraded":"2024-08-27T03:55:10.285806+0000","last_fullsized":"2024-08-27T03:55:10.285806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:47:45.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292286+0000","last_change":"2024-08-27T02:31:12.506193+0000","last_active":"2024-08-27T03:55:15.292286+0000","last_peered":"2024-08-27T03:55:15.292286+0000","last_clean":"2024-08-27T03:55:15.292286+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:55:15.292286+0000","last_undegraded":"2024-08-27T03:55:15.292286+0000","last_fullsized":"2024-08-27T03:55:15.292286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:31:44.393834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'182","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.584739+0000","last_change":"2024-08-27T02:31:14.517907+0000","last_active":"2024-08-27T03:56:42.584739+0000","last_peered":"2024-08-27T03:56:42.584739+0000","last_clean":"2024-08-27T03:56:42.584739+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:56:42.584739+0000","last_undegraded":"2024-08-27T03:56:42.584739+0000","last_fullsized":"2024-08-27T03:56:42.584739+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:28.044838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'411","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.884819+0000","last_change":"2024-08-27T02:31:06.459463+0000","last_active":"2024-08-27T03:55:09.884819+0000","last_peered":"2024-08-27T03:55:09.884819+0000","last_clean":"2024-08-27T03:55:09.884819+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:55:09.884819+0000","last_undegraded":"2024-08-27T03:55:09.884819+0000","last_fullsized":"2024-08-27T03:55:09.884819+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:50:28.320442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'324","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.762699+0000","last_change":"2024-08-27T02:31:04.477014+0000","last_active":"2024-08-27T03:58:31.762699+0000","last_peered":"2024-08-27T03:58:31.762699+0000","last_clean":"2024-08-27T03:58:31.762699+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:31.762699+0000","last_undegraded":"2024-08-27T03:58:31.762699+0000","last_fullsized":"2024-08-27T03:58:31.762699+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:53:15.700336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525410,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":30350,"num_write":1025,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290942+0000","last_change":"2024-08-27T02:31:08.450903+0000","last_active":"2024-08-27T03:55:10.290942+0000","last_peered":"2024-08-27T03:55:10.290942+0000","last_clean":"2024-08-27T03:55:10.290942+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:55:10.290942+0000","last_undegraded":"2024-08-27T03:55:10.290942+0000","last_fullsized":"2024-08-27T03:55:10.290942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:21.462233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'341","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.262090+0000","last_change":"2024-08-27T02:31:10.467565+0000","last_active":"2024-08-27T03:58:30.262090+0000","last_peered":"2024-08-27T03:58:30.262090+0000","last_clean":"2024-08-27T03:58:30.262090+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:58:30.262090+0000","last_undegraded":"2024-08-27T03:58:30.262090+0000","last_fullsized":"2024-08-27T03:58:30.262090+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:04:40.132706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1247,"num_write":450,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449445+0000","last_change":"2024-08-27T02:31:12.502528+0000","last_active":"2024-08-27T03:55:15.449445+0000","last_peered":"2024-08-27T03:55:15.449445+0000","last_clean":"2024-08-27T03:55:15.449445+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:55:15.449445+0000","last_undegraded":"2024-08-27T03:55:15.449445+0000","last_fullsized":"2024-08-27T03:55:15.449445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:14.781588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'114","reported_seq":626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847662+0000","last_change":"2024-08-27T02:31:14.521917+0000","last_active":"2024-08-27T03:53:44.847662+0000","last_peered":"2024-08-27T03:53:44.847662+0000","last_clean":"2024-08-27T03:53:44.847662+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:53:44.847662+0000","last_undegraded":"2024-08-27T03:53:44.847662+0000","last_fullsized":"2024-08-27T03:53:44.847662+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:08:19.534306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'418","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.908107+0000","last_change":"2024-08-27T02:31:06.451606+0000","last_active":"2024-08-27T03:58:02.908107+0000","last_peered":"2024-08-27T03:58:02.908107+0000","last_clean":"2024-08-27T03:58:02.908107+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:02.908107+0000","last_undegraded":"2024-08-27T03:58:02.908107+0000","last_fullsized":"2024-08-27T03:58:02.908107+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:09:38.477259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'331","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.752069+0000","last_change":"2024-08-27T02:31:04.453573+0000","last_active":"2024-08-27T03:58:31.752069+0000","last_peered":"2024-08-27T03:58:31.752069+0000","last_clean":"2024-08-27T03:58:31.752069+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:31.752069+0000","last_undegraded":"2024-08-27T03:58:31.752069+0000","last_fullsized":"2024-08-27T03:58:31.752069+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:04.196182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1018782,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":16403,"num_write":1128,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.448286+0000","last_change":"2024-08-27T02:31:08.465448+0000","last_active":"2024-08-27T03:55:10.448286+0000","last_peered":"2024-08-27T03:55:10.448286+0000","last_clean":"2024-08-27T03:55:10.448286+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:55:10.448286+0000","last_undegraded":"2024-08-27T03:55:10.448286+0000","last_fullsized":"2024-08-27T03:55:10.448286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:16:51.893136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'281","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.033952+0000","last_change":"2024-08-27T02:31:10.476895+0000","last_active":"2024-08-27T03:58:30.033952+0000","last_peered":"2024-08-27T03:58:30.033952+0000","last_clean":"2024-08-27T03:58:30.033952+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:58:30.033952+0000","last_undegraded":"2024-08-27T03:58:30.033952+0000","last_fullsized":"2024-08-27T03:58:30.033952+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:34:48.785917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287158+0000","last_change":"2024-08-27T02:31:12.521407+0000","last_active":"2024-08-27T03:55:15.287158+0000","last_peered":"2024-08-27T03:55:15.287158+0000","last_clean":"2024-08-27T03:55:15.287158+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:55:15.287158+0000","last_undegraded":"2024-08-27T03:55:15.287158+0000","last_fullsized":"2024-08-27T03:55:15.287158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:41:44.290066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'836","reported_seq":2411,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215749+0000","last_change":"2024-08-27T02:31:06.459141+0000","last_active":"2024-08-27T03:55:54.215749+0000","last_peered":"2024-08-27T03:55:54.215749+0000","last_clean":"2024-08-27T03:55:54.215749+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:55:54.215749+0000","last_undegraded":"2024-08-27T03:55:54.215749+0000","last_fullsized":"2024-08-27T03:55:54.215749+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:38:51.610195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'418","reported_seq":1157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.830795+0000","last_change":"2024-08-27T02:31:04.437260+0000","last_active":"2024-08-27T03:58:31.830795+0000","last_peered":"2024-08-27T03:58:31.830795+0000","last_clean":"2024-08-27T03:58:31.830795+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:31.830795+0000","last_undegraded":"2024-08-27T03:58:31.830795+0000","last_fullsized":"2024-08-27T03:58:31.830795+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:58.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":762,"num_read_kb":11072,"num_write":1374,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.289681+0000","last_change":"2024-08-27T02:31:08.460233+0000","last_active":"2024-08-27T03:55:25.289681+0000","last_peered":"2024-08-27T03:55:25.289681+0000","last_clean":"2024-08-27T03:55:25.289681+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:55:25.289681+0000","last_undegraded":"2024-08-27T03:55:25.289681+0000","last_fullsized":"2024-08-27T03:55:25.289681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:26.664269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'551","reported_seq":1212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.802981+0000","last_change":"2024-08-27T02:31:10.471987+0000","last_active":"2024-08-27T03:58:31.802981+0000","last_peered":"2024-08-27T03:58:31.802981+0000","last_clean":"2024-08-27T03:58:31.802981+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:31.802981+0000","last_undegraded":"2024-08-27T03:58:31.802981+0000","last_fullsized":"2024-08-27T03:58:31.802981+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:10:16.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":990,"num_read_kb":2409,"num_write":858,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:44.847691+0000","last_change":"2024-08-27T02:31:12.513046+0000","last_active":"2024-08-27T03:53:44.847691+0000","last_peered":"2024-08-27T03:53:44.847691+0000","last_clean":"2024-08-27T03:53:44.847691+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:53:44.847691+0000","last_undegraded":"2024-08-27T03:53:44.847691+0000","last_fullsized":"2024-08-27T03:53:44.847691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:14.240422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'140","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.320188+0000","last_change":"2024-08-27T02:31:15.026496+0000","last_active":"2024-08-27T03:56:39.320188+0000","last_peered":"2024-08-27T03:56:39.320188+0000","last_clean":"2024-08-27T03:56:39.320188+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:56:39.320188+0000","last_undegraded":"2024-08-27T03:56:39.320188+0000","last_fullsized":"2024-08-27T03:56:39.320188+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:25.778670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1179","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.212577+0000","last_change":"2024-08-27T02:31:06.444819+0000","last_active":"2024-08-27T03:55:54.212577+0000","last_peered":"2024-08-27T03:55:54.212577+0000","last_clean":"2024-08-27T03:55:54.212577+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:55:54.212577+0000","last_undegraded":"2024-08-27T03:55:54.212577+0000","last_fullsized":"2024-08-27T03:55:54.212577+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:12.874709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'349","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.740340+0000","last_change":"2024-08-27T02:31:04.452002+0000","last_active":"2024-08-27T03:58:31.740340+0000","last_peered":"2024-08-27T03:58:31.740340+0000","last_clean":"2024-08-27T03:58:31.740340+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:31.740340+0000","last_undegraded":"2024-08-27T03:58:31.740340+0000","last_fullsized":"2024-08-27T03:58:31.740340+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:54.064616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":41676,"num_write":1093,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.439838+0000","last_change":"2024-08-27T02:31:08.468006+0000","last_active":"2024-08-27T03:54:30.439838+0000","last_peered":"2024-08-27T03:54:30.439838+0000","last_clean":"2024-08-27T03:54:30.439838+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:54:30.439838+0000","last_undegraded":"2024-08-27T03:54:30.439838+0000","last_fullsized":"2024-08-27T03:54:30.439838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:40:17.372181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'350","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.104104+0000","last_change":"2024-08-27T02:31:10.477408+0000","last_active":"2024-08-27T03:58:30.104104+0000","last_peered":"2024-08-27T03:58:30.104104+0000","last_clean":"2024-08-27T03:58:30.104104+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:58:30.104104+0000","last_undegraded":"2024-08-27T03:58:30.104104+0000","last_fullsized":"2024-08-27T03:58:30.104104+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:59:29.617560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:46.048972+0000","last_change":"2024-08-27T02:31:12.493945+0000","last_active":"2024-08-27T03:53:46.048972+0000","last_peered":"2024-08-27T03:53:46.048972+0000","last_clean":"2024-08-27T03:53:46.048972+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:53:46.048972+0000","last_undegraded":"2024-08-27T03:53:46.048972+0000","last_fullsized":"2024-08-27T03:53:46.048972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449386+0000","last_change":"2024-08-27T02:31:14.521472+0000","last_active":"2024-08-27T03:55:15.449386+0000","last_peered":"2024-08-27T03:55:15.449386+0000","last_clean":"2024-08-27T03:55:15.449386+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:55:15.449386+0000","last_undegraded":"2024-08-27T03:55:15.449386+0000","last_fullsized":"2024-08-27T03:55:15.449386+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:13.751034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'696","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.472769+0000","last_change":"2024-08-27T02:31:06.446538+0000","last_active":"2024-08-27T03:56:44.472769+0000","last_peered":"2024-08-27T03:56:44.472769+0000","last_clean":"2024-08-27T03:56:44.472769+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:56:44.472769+0000","last_undegraded":"2024-08-27T03:56:44.472769+0000","last_fullsized":"2024-08-27T03:56:44.472769+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:59:31.607194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'333","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.849571+0000","last_change":"2024-08-27T02:31:04.486015+0000","last_active":"2024-08-27T03:58:31.849571+0000","last_peered":"2024-08-27T03:58:31.849571+0000","last_clean":"2024-08-27T03:58:31.849571+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:31.849571+0000","last_undegraded":"2024-08-27T03:58:31.849571+0000","last_fullsized":"2024-08-27T03:58:31.849571+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:24.013613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":27841,"num_write":1117,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.061200+0000","last_change":"2024-08-27T02:31:08.461902+0000","last_active":"2024-08-27T03:53:40.061200+0000","last_peered":"2024-08-27T03:53:40.061200+0000","last_clean":"2024-08-27T03:53:40.061200+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:53:40.061200+0000","last_undegraded":"2024-08-27T03:53:40.061200+0000","last_fullsized":"2024-08-27T03:53:40.061200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:54:08.973943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'323","reported_seq":944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.647767+0000","last_change":"2024-08-27T02:31:10.636027+0000","last_active":"2024-08-27T03:58:31.647767+0000","last_peered":"2024-08-27T03:58:31.647767+0000","last_clean":"2024-08-27T03:58:31.647767+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:58:31.647767+0000","last_undegraded":"2024-08-27T03:58:31.647767+0000","last_fullsized":"2024-08-27T03:58:31.647767+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:09:14.223534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66592,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1228,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:31.071793+0000","last_change":"2024-08-27T02:31:12.498318+0000","last_active":"2024-08-27T03:55:31.071793+0000","last_peered":"2024-08-27T03:55:31.071793+0000","last_clean":"2024-08-27T03:55:31.071793+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:55:31.071793+0000","last_undegraded":"2024-08-27T03:55:31.071793+0000","last_fullsized":"2024-08-27T03:55:31.071793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:41.474651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.928313+0000","last_change":"2024-08-27T02:31:14.521960+0000","last_active":"2024-08-27T03:58:03.928313+0000","last_peered":"2024-08-27T03:58:03.928313+0000","last_clean":"2024-08-27T03:58:03.928313+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:58:03.928313+0000","last_undegraded":"2024-08-27T03:58:03.928313+0000","last_fullsized":"2024-08-27T03:58:03.928313+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:38:31.904177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'789","reported_seq":2418,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:50.098393+0000","last_change":"2024-08-27T02:31:06.453981+0000","last_active":"2024-08-27T03:53:50.098393+0000","last_peered":"2024-08-27T03:53:50.098393+0000","last_clean":"2024-08-27T03:53:50.098393+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:53:50.098393+0000","last_undegraded":"2024-08-27T03:53:50.098393+0000","last_fullsized":"2024-08-27T03:53:50.098393+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:04:08.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'325","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.767601+0000","last_change":"2024-08-27T02:31:04.466853+0000","last_active":"2024-08-27T03:58:31.767601+0000","last_peered":"2024-08-27T03:58:31.767601+0000","last_clean":"2024-08-27T03:58:31.767601+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:31.767601+0000","last_undegraded":"2024-08-27T03:58:31.767601+0000","last_fullsized":"2024-08-27T03:58:31.767601+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399355,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":2807,"num_write":1070,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:41.048008+0000","last_change":"2024-08-27T02:31:08.471391+0000","last_active":"2024-08-27T03:53:41.048008+0000","last_peered":"2024-08-27T03:53:41.048008+0000","last_clean":"2024-08-27T03:53:41.048008+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:53:41.048008+0000","last_undegraded":"2024-08-27T03:53:41.048008+0000","last_fullsized":"2024-08-27T03:53:41.048008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:27:57.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'131","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.086304+0000","last_change":"2024-08-27T02:31:10.635520+0000","last_active":"2024-08-27T03:55:25.086304+0000","last_peered":"2024-08-27T03:55:25.086304+0000","last_clean":"2024-08-27T03:55:25.086304+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:55:25.086304+0000","last_undegraded":"2024-08-27T03:55:25.086304+0000","last_fullsized":"2024-08-27T03:55:25.086304+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:36:27.001114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'693","reported_seq":2818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.985361+0000","last_change":"2024-08-27T02:31:12.490737+0000","last_active":"2024-08-27T03:58:28.985361+0000","last_peered":"2024-08-27T03:58:28.985361+0000","last_clean":"2024-08-27T03:58:28.985361+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:28.985361+0000","last_undegraded":"2024-08-27T03:58:28.985361+0000","last_fullsized":"2024-08-27T03:58:28.985361+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:40.803189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'112","reported_seq":615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.583823+0000","last_change":"2024-08-27T02:31:14.516613+0000","last_active":"2024-08-27T03:56:38.583823+0000","last_peered":"2024-08-27T03:56:38.583823+0000","last_clean":"2024-08-27T03:56:38.583823+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:56:38.583823+0000","last_undegraded":"2024-08-27T03:56:38.583823+0000","last_fullsized":"2024-08-27T03:56:38.583823+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:26:30.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'786","reported_seq":2382,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:02.876625+0000","last_change":"2024-08-27T02:31:06.467671+0000","last_active":"2024-08-27T03:54:02.876625+0000","last_peered":"2024-08-27T03:54:02.876625+0000","last_clean":"2024-08-27T03:54:02.876625+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:54:02.876625+0000","last_undegraded":"2024-08-27T03:54:02.876625+0000","last_fullsized":"2024-08-27T03:54:02.876625+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:18:26.329266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'298","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.666565+0000","last_change":"2024-08-27T02:31:04.463606+0000","last_active":"2024-08-27T03:58:31.666565+0000","last_peered":"2024-08-27T03:58:31.666565+0000","last_clean":"2024-08-27T03:58:31.666565+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:31.666565+0000","last_undegraded":"2024-08-27T03:58:31.666565+0000","last_fullsized":"2024-08-27T03:58:31.666565+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:15.431577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550499,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":12943,"num_write":990,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:40.268711+0000","last_change":"2024-08-27T02:31:08.447203+0000","last_active":"2024-08-27T03:53:40.268711+0000","last_peered":"2024-08-27T03:53:40.268711+0000","last_clean":"2024-08-27T03:53:40.268711+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:53:40.268711+0000","last_undegraded":"2024-08-27T03:53:40.268711+0000","last_fullsized":"2024-08-27T03:53:40.268711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:41.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'379","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.397888+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.397888+0000","last_peered":"2024-08-27T03:58:29.397888+0000","last_clean":"2024-08-27T03:58:29.397888+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:58:29.397888+0000","last_undegraded":"2024-08-27T03:58:29.397888+0000","last_fullsized":"2024-08-27T03:58:29.397888+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:12.752267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.295363+0000","last_change":"2024-08-27T02:31:12.517594+0000","last_active":"2024-08-27T03:55:50.295363+0000","last_peered":"2024-08-27T03:55:50.295363+0000","last_clean":"2024-08-27T03:55:50.295363+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:55:50.295363+0000","last_undegraded":"2024-08-27T03:55:50.295363+0000","last_fullsized":"2024-08-27T03:55:50.295363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:58:27.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'112","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.818594+0000","last_change":"2024-08-27T02:31:14.523873+0000","last_active":"2024-08-27T03:56:44.818594+0000","last_peered":"2024-08-27T03:56:44.818594+0000","last_clean":"2024-08-27T03:56:44.818594+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:56:44.818594+0000","last_undegraded":"2024-08-27T03:56:44.818594+0000","last_fullsized":"2024-08-27T03:56:44.818594+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:56.720396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'372","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:53.153842+0000","last_change":"2024-08-27T02:31:06.465894+0000","last_active":"2024-08-27T03:53:53.153842+0000","last_peered":"2024-08-27T03:53:53.153842+0000","last_clean":"2024-08-27T03:53:53.153842+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:53:53.153842+0000","last_undegraded":"2024-08-27T03:53:53.153842+0000","last_fullsized":"2024-08-27T03:53:53.153842+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:23:38.612022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'325","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.835169+0000","last_change":"2024-08-27T02:31:04.450156+0000","last_active":"2024-08-27T03:58:31.835169+0000","last_peered":"2024-08-27T03:58:31.835169+0000","last_clean":"2024-08-27T03:58:31.835169+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:31.835169+0000","last_undegraded":"2024-08-27T03:58:31.835169+0000","last_fullsized":"2024-08-27T03:58:31.835169+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:04:33.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":8306,"num_write":1045,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:39.846494+0000","last_change":"2024-08-27T02:31:08.463927+0000","last_active":"2024-08-27T03:53:39.846494+0000","last_peered":"2024-08-27T03:53:39.846494+0000","last_clean":"2024-08-27T03:53:39.846494+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:53:39.846494+0000","last_undegraded":"2024-08-27T03:53:39.846494+0000","last_fullsized":"2024-08-27T03:53:39.846494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:31:34.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'268","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.468339+0000","last_change":"2024-08-27T02:31:10.470453+0000","last_active":"2024-08-27T03:58:29.468339+0000","last_peered":"2024-08-27T03:58:29.468339+0000","last_clean":"2024-08-27T03:58:29.468339+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:58:29.468339+0000","last_undegraded":"2024-08-27T03:58:29.468339+0000","last_fullsized":"2024-08-27T03:58:29.468339+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:46.212245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.459171+0000","last_change":"2024-08-27T02:31:12.494052+0000","last_active":"2024-08-27T03:56:00.459171+0000","last_peered":"2024-08-27T03:56:00.459171+0000","last_clean":"2024-08-27T03:56:00.459171+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:56:00.459171+0000","last_undegraded":"2024-08-27T03:56:00.459171+0000","last_fullsized":"2024-08-27T03:56:00.459171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:24.014947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'135","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.343269+0000","last_change":"2024-08-27T02:31:15.027895+0000","last_active":"2024-08-27T03:56:39.343269+0000","last_peered":"2024-08-27T03:56:39.343269+0000","last_clean":"2024-08-27T03:56:39.343269+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:56:39.343269+0000","last_undegraded":"2024-08-27T03:56:39.343269+0000","last_fullsized":"2024-08-27T03:56:39.343269+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:31:36.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'733","reported_seq":2228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.527636+0000","last_change":"2024-08-27T02:31:06.447002+0000","last_active":"2024-08-27T03:56:44.527636+0000","last_peered":"2024-08-27T03:56:44.527636+0000","last_clean":"2024-08-27T03:56:44.527636+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:56:44.527636+0000","last_undegraded":"2024-08-27T03:56:44.527636+0000","last_fullsized":"2024-08-27T03:56:44.527636+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:04.399827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.832658+0000","last_change":"2024-08-27T02:31:04.476828+0000","last_active":"2024-08-27T03:58:31.832658+0000","last_peered":"2024-08-27T03:58:31.832658+0000","last_clean":"2024-08-27T03:58:31.832658+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:31.832658+0000","last_undegraded":"2024-08-27T03:58:31.832658+0000","last_fullsized":"2024-08-27T03:58:31.832658+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:42:38.137890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":19461,"num_write":1109,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090711+0000","last_change":"2024-08-27T02:31:08.468289+0000","last_active":"2024-08-27T03:55:45.090711+0000","last_peered":"2024-08-27T03:55:45.090711+0000","last_clean":"2024-08-27T03:55:45.090711+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:55:45.090711+0000","last_undegraded":"2024-08-27T03:55:45.090711+0000","last_fullsized":"2024-08-27T03:55:45.090711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:51:14.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'279","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.486440+0000","last_change":"2024-08-27T02:31:10.474659+0000","last_active":"2024-08-27T03:58:31.486440+0000","last_peered":"2024-08-27T03:58:31.486440+0000","last_clean":"2024-08-27T03:58:31.486440+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:58:31.486440+0000","last_undegraded":"2024-08-27T03:58:31.486440+0000","last_fullsized":"2024-08-27T03:58:31.486440+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:14:14.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1176,"num_write":390,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.062348+0000","last_change":"2024-08-27T02:31:12.494960+0000","last_active":"2024-08-27T03:53:45.062348+0000","last_peered":"2024-08-27T03:53:45.062348+0000","last_clean":"2024-08-27T03:53:45.062348+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:53:45.062348+0000","last_undegraded":"2024-08-27T03:53:45.062348+0000","last_fullsized":"2024-08-27T03:53:45.062348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:23.135684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'178","reported_seq":1652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.531902+0000","last_change":"2024-08-27T02:31:14.521123+0000","last_active":"2024-08-27T03:56:38.531902+0000","last_peered":"2024-08-27T03:56:38.531902+0000","last_clean":"2024-08-27T03:56:38.531902+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:56:38.531902+0000","last_undegraded":"2024-08-27T03:56:38.531902+0000","last_fullsized":"2024-08-27T03:56:38.531902+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:15.425652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'548","reported_seq":2365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090765+0000","last_change":"2024-08-27T02:31:06.457635+0000","last_active":"2024-08-27T03:55:45.090765+0000","last_peered":"2024-08-27T03:55:45.090765+0000","last_clean":"2024-08-27T03:55:45.090765+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:55:45.090765+0000","last_undegraded":"2024-08-27T03:55:45.090765+0000","last_fullsized":"2024-08-27T03:55:45.090765+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:15:48.872076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'295","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.829634+0000","last_change":"2024-08-27T02:31:38.758741+0000","last_active":"2024-08-27T03:58:31.829634+0000","last_peered":"2024-08-27T03:58:31.829634+0000","last_clean":"2024-08-27T03:58:31.829634+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:31.829634+0000","last_undegraded":"2024-08-27T03:58:31.829634+0000","last_fullsized":"2024-08-27T03:58:31.829634+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":5169,"num_write":1020,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:01.078719+0000","last_change":"2024-08-27T02:31:08.471579+0000","last_active":"2024-08-27T03:56:01.078719+0000","last_peered":"2024-08-27T03:56:01.078719+0000","last_clean":"2024-08-27T03:56:01.078719+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:56:01.078719+0000","last_undegraded":"2024-08-27T03:56:01.078719+0000","last_fullsized":"2024-08-27T03:56:01.078719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:38:24.013362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'304","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.718370+0000","last_change":"2024-08-27T02:31:10.462249+0000","last_active":"2024-08-27T03:58:31.718370+0000","last_peered":"2024-08-27T03:58:31.718370+0000","last_clean":"2024-08-27T03:58:31.718370+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:58:31.718370+0000","last_undegraded":"2024-08-27T03:58:31.718370+0000","last_fullsized":"2024-08-27T03:58:31.718370+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:52:58.552884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1035,"num_write":382,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:53:45.486117+0000","last_change":"2024-08-27T02:31:12.523057+0000","last_active":"2024-08-27T03:53:45.486117+0000","last_peered":"2024-08-27T03:53:45.486117+0000","last_clean":"2024-08-27T03:53:45.486117+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:53:45.486117+0000","last_undegraded":"2024-08-27T03:53:45.486117+0000","last_fullsized":"2024-08-27T03:53:45.486117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:12:26.836037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'144","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.904543+0000","last_change":"2024-08-27T02:31:14.506679+0000","last_active":"2024-08-27T03:58:02.904543+0000","last_peered":"2024-08-27T03:58:02.904543+0000","last_clean":"2024-08-27T03:58:02.904543+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:58:02.904543+0000","last_undegraded":"2024-08-27T03:58:02.904543+0000","last_fullsized":"2024-08-27T03:58:02.904543+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:33.099195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'732","reported_seq":2154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073279+0000","last_change":"2024-08-27T02:31:06.469294+0000","last_active":"2024-08-27T03:55:36.073279+0000","last_peered":"2024-08-27T03:55:36.073279+0000","last_clean":"2024-08-27T03:55:36.073279+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:55:36.073279+0000","last_undegraded":"2024-08-27T03:55:36.073279+0000","last_fullsized":"2024-08-27T03:55:36.073279+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:14.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'329","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.867613+0000","last_change":"2024-08-27T02:31:04.482354+0000","last_active":"2024-08-27T03:58:31.867613+0000","last_peered":"2024-08-27T03:58:31.867613+0000","last_clean":"2024-08-27T03:58:31.867613+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:31.867613+0000","last_undegraded":"2024-08-27T03:58:31.867613+0000","last_fullsized":"2024-08-27T03:58:31.867613+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:41:12.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":48183,"num_write":1083,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'437","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.073216+0000","last_change":"2024-08-27T02:31:06.449966+0000","last_active":"2024-08-27T03:55:36.073216+0000","last_peered":"2024-08-27T03:55:36.073216+0000","last_clean":"2024-08-27T03:55:36.073216+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:55:36.073216+0000","last_undegraded":"2024-08-27T03:55:36.073216+0000","last_fullsized":"2024-08-27T03:55:36.073216+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:00:38.353825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'381","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.871085+0000","last_change":"2024-08-27T02:31:04.478639+0000","last_active":"2024-08-27T03:58:31.871085+0000","last_peered":"2024-08-27T03:58:31.871085+0000","last_clean":"2024-08-27T03:58:31.871085+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:31.871085+0000","last_undegraded":"2024-08-27T03:58:31.871085+0000","last_fullsized":"2024-08-27T03:58:31.871085+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:22:20.511229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4832339,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":9918,"num_write":1168,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'473","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.874461+0000","last_change":"2024-08-27T02:31:06.450216+0000","last_active":"2024-08-27T03:55:39.874461+0000","last_peered":"2024-08-27T03:55:39.874461+0000","last_clean":"2024-08-27T03:55:39.874461+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:55:39.874461+0000","last_undegraded":"2024-08-27T03:55:39.874461+0000","last_fullsized":"2024-08-27T03:55:39.874461+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:14.184039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'405","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.813481+0000","last_change":"2024-08-27T02:31:38.749882+0000","last_active":"2024-08-27T03:58:31.813481+0000","last_peered":"2024-08-27T03:58:31.813481+0000","last_clean":"2024-08-27T03:58:31.813481+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:31.813481+0000","last_undegraded":"2024-08-27T03:58:31.813481+0000","last_fullsized":"2024-08-27T03:58:31.813481+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:33:03.649537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":15883,"num_write":1180,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'570","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524113+0000","last_change":"2024-08-27T02:31:06.443475+0000","last_active":"2024-08-27T03:56:44.524113+0000","last_peered":"2024-08-27T03:56:44.524113+0000","last_clean":"2024-08-27T03:56:44.524113+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:56:44.524113+0000","last_undegraded":"2024-08-27T03:56:44.524113+0000","last_fullsized":"2024-08-27T03:56:44.524113+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:36:38.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'308","reported_seq":1050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.791964+0000","last_change":"2024-08-27T02:31:04.457012+0000","last_active":"2024-08-27T03:58:31.791964+0000","last_peered":"2024-08-27T03:58:31.791964+0000","last_clean":"2024-08-27T03:58:31.791964+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:31.791964+0000","last_undegraded":"2024-08-27T03:58:31.791964+0000","last_fullsized":"2024-08-27T03:58:31.791964+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:51:49.178714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":27259,"num_write":1007,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'606","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.938985+0000","last_change":"2024-08-27T02:31:06.461548+0000","last_active":"2024-08-27T03:58:02.938985+0000","last_peered":"2024-08-27T03:58:02.938985+0000","last_clean":"2024-08-27T03:58:02.938985+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:02.938985+0000","last_undegraded":"2024-08-27T03:58:02.938985+0000","last_fullsized":"2024-08-27T03:58:02.938985+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:54:26.910185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'362","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.791916+0000","last_change":"2024-08-27T02:31:04.476105+0000","last_active":"2024-08-27T03:58:31.791916+0000","last_peered":"2024-08-27T03:58:31.791916+0000","last_clean":"2024-08-27T03:58:31.791916+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:31.791916+0000","last_undegraded":"2024-08-27T03:58:31.791916+0000","last_fullsized":"2024-08-27T03:58:31.791916+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:19:35.578103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589954,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":45255,"num_write":1058,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'437","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072894+0000","last_change":"2024-08-27T02:31:06.461180+0000","last_active":"2024-08-27T03:54:30.072894+0000","last_peered":"2024-08-27T03:54:30.072894+0000","last_clean":"2024-08-27T03:54:30.072894+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:54:30.072894+0000","last_undegraded":"2024-08-27T03:54:30.072894+0000","last_fullsized":"2024-08-27T03:54:30.072894+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:35:29.428642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'354","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.845209+0000","last_change":"2024-08-27T02:31:04.469464+0000","last_active":"2024-08-27T03:58:31.845209+0000","last_peered":"2024-08-27T03:58:31.845209+0000","last_clean":"2024-08-27T03:58:31.845209+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:31.845209+0000","last_undegraded":"2024-08-27T03:58:31.845209+0000","last_fullsized":"2024-08-27T03:58:31.845209+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:55:43.726324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":26119,"num_write":1309,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'574","reported_seq":2441,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.915919+0000","last_change":"2024-08-27T02:31:06.447514+0000","last_active":"2024-08-27T03:58:02.915919+0000","last_peered":"2024-08-27T03:58:02.915919+0000","last_clean":"2024-08-27T03:58:02.915919+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:02.915919+0000","last_undegraded":"2024-08-27T03:58:02.915919+0000","last_fullsized":"2024-08-27T03:58:02.915919+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:41:53.347545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'308","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.847564+0000","last_change":"2024-08-27T02:31:40.468497+0000","last_active":"2024-08-27T03:58:31.847564+0000","last_peered":"2024-08-27T03:58:31.847564+0000","last_clean":"2024-08-27T03:58:31.847564+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:31.847564+0000","last_undegraded":"2024-08-27T03:58:31.847564+0000","last_fullsized":"2024-08-27T03:58:31.847564+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:27.567253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307067,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":100247,"num_write":1030,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'445","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.215939+0000","last_change":"2024-08-27T02:31:06.469696+0000","last_active":"2024-08-27T03:55:54.215939+0000","last_peered":"2024-08-27T03:55:54.215939+0000","last_clean":"2024-08-27T03:55:54.215939+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:55:54.215939+0000","last_undegraded":"2024-08-27T03:55:54.215939+0000","last_fullsized":"2024-08-27T03:55:54.215939+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:20.988932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'357","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.729231+0000","last_change":"2024-08-27T02:31:04.455655+0000","last_active":"2024-08-27T03:58:31.729231+0000","last_peered":"2024-08-27T03:58:31.729231+0000","last_clean":"2024-08-27T03:58:31.729231+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:31.729231+0000","last_undegraded":"2024-08-27T03:58:31.729231+0000","last_fullsized":"2024-08-27T03:58:31.729231+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:53:08.178860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":565,"num_read_kb":99962,"num_write":1217,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'357","reported_seq":1844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.942738+0000","last_change":"2024-08-27T02:31:06.462059+0000","last_active":"2024-08-27T03:58:02.942738+0000","last_peered":"2024-08-27T03:58:02.942738+0000","last_clean":"2024-08-27T03:58:02.942738+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:02.942738+0000","last_undegraded":"2024-08-27T03:58:02.942738+0000","last_fullsized":"2024-08-27T03:58:02.942738+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:59.170394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'281","reported_seq":910,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.772112+0000","last_change":"2024-08-27T02:31:04.446192+0000","last_active":"2024-08-27T03:58:31.772112+0000","last_peered":"2024-08-27T03:58:31.772112+0000","last_clean":"2024-08-27T03:58:31.772112+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:31.772112+0000","last_undegraded":"2024-08-27T03:58:31.772112+0000","last_fullsized":"2024-08-27T03:58:31.772112+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:44.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":397,"num_read_kb":6749,"num_write":934,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'639","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.524102+0000","last_change":"2024-08-27T02:31:06.456393+0000","last_active":"2024-08-27T03:56:44.524102+0000","last_peered":"2024-08-27T03:56:44.524102+0000","last_clean":"2024-08-27T03:56:44.524102+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:56:44.524102+0000","last_undegraded":"2024-08-27T03:56:44.524102+0000","last_fullsized":"2024-08-27T03:56:44.524102+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:03.541422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'346","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.851444+0000","last_change":"2024-08-27T02:31:04.455660+0000","last_active":"2024-08-27T03:58:31.851444+0000","last_peered":"2024-08-27T03:58:31.851444+0000","last_clean":"2024-08-27T03:58:31.851444+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:31.851444+0000","last_undegraded":"2024-08-27T03:58:31.851444+0000","last_fullsized":"2024-08-27T03:58:31.851444+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:59:36.250505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2798159,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":560,"num_read_kb":2754,"num_write":1269,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'437","reported_seq":1952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.059524+0000","last_change":"2024-08-27T02:31:06.469100+0000","last_active":"2024-08-27T03:54:40.059524+0000","last_peered":"2024-08-27T03:54:40.059524+0000","last_clean":"2024-08-27T03:54:40.059524+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:54:40.059524+0000","last_undegraded":"2024-08-27T03:54:40.059524+0000","last_fullsized":"2024-08-27T03:54:40.059524+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:54:14.589392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'313","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.830167+0000","last_change":"2024-08-27T02:31:04.474597+0000","last_active":"2024-08-27T03:58:31.830167+0000","last_peered":"2024-08-27T03:58:31.830167+0000","last_clean":"2024-08-27T03:58:31.830167+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:31.830167+0000","last_undegraded":"2024-08-27T03:58:31.830167+0000","last_fullsized":"2024-08-27T03:58:31.830167+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:19:48.419717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":2564,"num_write":1048,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'612","reported_seq":2444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.590756+0000","last_change":"2024-08-27T02:31:06.473076+0000","last_active":"2024-08-27T03:56:42.590756+0000","last_peered":"2024-08-27T03:56:42.590756+0000","last_clean":"2024-08-27T03:56:42.590756+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:56:42.590756+0000","last_undegraded":"2024-08-27T03:56:42.590756+0000","last_fullsized":"2024-08-27T03:56:42.590756+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:19.460348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":1126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.829878+0000","last_change":"2024-08-27T02:31:04.466914+0000","last_active":"2024-08-27T03:58:31.829878+0000","last_peered":"2024-08-27T03:58:31.829878+0000","last_clean":"2024-08-27T03:58:31.829878+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:31.829878+0000","last_undegraded":"2024-08-27T03:58:31.829878+0000","last_fullsized":"2024-08-27T03:58:31.829878+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:32.345511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":686594,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":79613,"num_write":1033,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'502","reported_seq":2126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:25.279816+0000","last_change":"2024-08-27T02:31:06.453414+0000","last_active":"2024-08-27T03:54:25.279816+0000","last_peered":"2024-08-27T03:54:25.279816+0000","last_clean":"2024-08-27T03:54:25.279816+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:54:25.279816+0000","last_undegraded":"2024-08-27T03:54:25.279816+0000","last_fullsized":"2024-08-27T03:54:25.279816+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:58:00.941444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'307","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.849120+0000","last_change":"2024-08-27T02:31:04.493288+0000","last_active":"2024-08-27T03:58:31.849120+0000","last_peered":"2024-08-27T03:58:31.849120+0000","last_clean":"2024-08-27T03:58:31.849120+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:31.849120+0000","last_undegraded":"2024-08-27T03:58:31.849120+0000","last_fullsized":"2024-08-27T03:58:31.849120+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:54:10.116873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911567,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":603,"num_read_kb":25477,"num_write":981,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'802","reported_seq":2696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.912104+0000","last_change":"2024-08-27T02:31:06.446787+0000","last_active":"2024-08-27T03:58:02.912104+0000","last_peered":"2024-08-27T03:58:02.912104+0000","last_clean":"2024-08-27T03:58:02.912104+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:02.912104+0000","last_undegraded":"2024-08-27T03:58:02.912104+0000","last_fullsized":"2024-08-27T03:58:02.912104+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:54.168779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'311","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.755738+0000","last_change":"2024-08-27T02:31:04.498684+0000","last_active":"2024-08-27T03:58:31.755738+0000","last_peered":"2024-08-27T03:58:31.755738+0000","last_clean":"2024-08-27T03:58:31.755738+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:31.755738+0000","last_undegraded":"2024-08-27T03:58:31.755738+0000","last_fullsized":"2024-08-27T03:58:31.755738+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:33:00.705755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311643,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":75812,"num_write":989,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'417","reported_seq":1897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:24.869970+0000","last_change":"2024-08-27T02:31:06.460970+0000","last_active":"2024-08-27T03:54:24.869970+0000","last_peered":"2024-08-27T03:54:24.869970+0000","last_clean":"2024-08-27T03:54:24.869970+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:54:24.869970+0000","last_undegraded":"2024-08-27T03:54:24.869970+0000","last_fullsized":"2024-08-27T03:54:24.869970+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:33.950629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'422","reported_seq":1341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.835755+0000","last_change":"2024-08-27T02:31:04.477605+0000","last_active":"2024-08-27T03:58:31.835755+0000","last_peered":"2024-08-27T03:58:31.835755+0000","last_clean":"2024-08-27T03:58:31.835755+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:31.835755+0000","last_undegraded":"2024-08-27T03:58:31.835755+0000","last_fullsized":"2024-08-27T03:58:31.835755+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:54.342368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1005,"num_read_kb":143555,"num_write":1198,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'385","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.303474+0000","last_change":"2024-08-27T02:31:06.448211+0000","last_active":"2024-08-27T03:56:00.303474+0000","last_peered":"2024-08-27T03:56:00.303474+0000","last_clean":"2024-08-27T03:56:00.303474+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:56:00.303474+0000","last_undegraded":"2024-08-27T03:56:00.303474+0000","last_fullsized":"2024-08-27T03:56:00.303474+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:44.911262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'359","reported_seq":1050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.703092+0000","last_change":"2024-08-27T02:31:04.468993+0000","last_active":"2024-08-27T03:58:31.703092+0000","last_peered":"2024-08-27T03:58:31.703092+0000","last_clean":"2024-08-27T03:58:31.703092+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:31.703092+0000","last_undegraded":"2024-08-27T03:58:31.703092+0000","last_fullsized":"2024-08-27T03:58:31.703092+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:42.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":596,"num_read_kb":11844,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'342","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.835792+0000","last_change":"2024-08-27T02:31:04.470311+0000","last_active":"2024-08-27T03:58:31.835792+0000","last_peered":"2024-08-27T03:58:31.835792+0000","last_clean":"2024-08-27T03:58:31.835792+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:31.835792+0000","last_undegraded":"2024-08-27T03:58:31.835792+0000","last_fullsized":"2024-08-27T03:58:31.835792+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:46.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":4948,"num_write":1064,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'381","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.298368+0000","last_change":"2024-08-27T02:31:39.753199+0000","last_active":"2024-08-27T03:56:00.298368+0000","last_peered":"2024-08-27T03:56:00.298368+0000","last_clean":"2024-08-27T03:56:00.298368+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:56:00.298368+0000","last_undegraded":"2024-08-27T03:56:00.298368+0000","last_fullsized":"2024-08-27T03:56:00.298368+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:20:26.815028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'342","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.680435+0000","last_change":"2024-08-27T02:31:04.468743+0000","last_active":"2024-08-27T03:58:31.680435+0000","last_peered":"2024-08-27T03:58:31.680435+0000","last_clean":"2024-08-27T03:58:31.680435+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:31.680435+0000","last_undegraded":"2024-08-27T03:58:31.680435+0000","last_fullsized":"2024-08-27T03:58:31.680435+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:03.389915+0000","last_clean_scrub_stamp":"2024-08-27T02:31:03.389915+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:32:18.469890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381353,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":621,"num_read_kb":18083,"num_write":1130,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.999344+0000","last_change":"2024-08-27T02:31:06.441369+0000","last_active":"2024-08-27T03:58:02.999344+0000","last_peered":"2024-08-27T03:58:02.999344+0000","last_clean":"2024-08-27T03:58:02.999344+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:02.999344+0000","last_undegraded":"2024-08-27T03:58:02.999344+0000","last_fullsized":"2024-08-27T03:58:02.999344+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:46.354455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1592,"ondisk_log_size":1592,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":456,"ondisk_log_size":456,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1439020,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19446,"num_read_kb":39405,"num_write":16215,"num_write_kb":11798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1957,"ondisk_log_size":1957,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3951,"ondisk_log_size":3951,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65339946,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":35598,"num_read_kb":1916438,"num_write":70403,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89604096,"data_stored":89604096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3354,"ondisk_log_size":3354,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":208074,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198799,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510496,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192272,"kb_used_data":12472,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94179568,"statfs":{"total":96636764160,"available":96439877632,"internally_reserved":0,"allocated":12771328,"data_stored":10781565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543205,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339372,"kb_used_data":15112,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94032468,"statfs":{"total":96636764160,"available":96289247232,"internally_reserved":0,"allocated":15474688,"data_stored":13471118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543206,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305164,"kb_used_data":17100,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94066676,"statfs":{"total":96636764160,"available":96324276224,"internally_reserved":0,"allocated":17510400,"data_stored":15551496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543203,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162940,"kb_used_data":15028,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94208900,"statfs":{"total":96636764160,"available":96469913600,"internally_reserved":0,"allocated":15388672,"data_stored":13349611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543202,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134296,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94237544,"statfs":{"total":96636764160,"available":96499245056,"internally_reserved":0,"allocated":17350656,"data_stored":15406568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543204,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310428,"kb_used_data":13916,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94061412,"statfs":{"total":96636764160,"available":96318885888,"internally_reserved":0,"allocated":14249984,"data_stored":12236496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":303430087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543206,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113472,"kb_used_data":14212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94258368,"statfs":{"total":96636764160,"available":96520568832,"internally_reserved":0,"allocated":14553088,"data_stored":12591031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543204,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301160,"kb_used_data":17368,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94070680,"statfs":{"total":96636764160,"available":96328376320,"internally_reserved":0,"allocated":17784832,"data_stored":15748401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":12861440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8486912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10297344,"data_stored":10297344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9940992,"data_stored":9940992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13115392,"data_stored":13115392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11055104,"data_stored":11055104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13258752,"data_stored":13258752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10588160,"data_stored":10588160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T03:58:38.660 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.660 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.661 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.662 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.663 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.664 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.665 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.666 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.667 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.668 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.669 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.670 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.671 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.672 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.673 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.674 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.675 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.676 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.677 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.678 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.679 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.680 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.681 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.682 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.683 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.684 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-27T02:30:46.155361+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=46, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-27T02:30:51.192106+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=51, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.685 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-27T02:30:51.192106+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=51, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.686 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-27T02:30:51.192106+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=51, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.687 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-27T02:30:51.192106+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=51, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.688 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-27T02:30:51.192106+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=51, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-27T02:30:51.192106+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=51, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.689 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.690 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-27T02:30:51.192106+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=30, tm_sec=51, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.691 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.692 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.693 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.694 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.695 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.696 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.697 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.698 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.699 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.700 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.701 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.702 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.703 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.703 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-08-27T02:31:03.389915+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.703 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:38.703 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-27T03:58:58.704 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T03:58:59.069 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:58:59.086 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T03:58:59.098 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2905,"stamp":"2024-08-27T03:58:57.298162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67386791,"num_objects":861,"num_object_clones":0,"num_object_copies":2456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":287806,"num_read_kb":2575721,"num_write":159683,"num_write_kb":2372746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":61620,"num_omap_keys":197,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12808,"ondisk_log_size":12808,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1841640,"kb_used_data":122152,"kb_used_omap":12,"kb_used_meta":1719347,"kb_avail":753133080,"statfs":{"total":773094113280,"available":771208273920,"internally_reserved":0,"allocated":125083648,"data_stored":109136286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1760611889},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":60637,"num_omap_keys":193,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009028"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875576+0000","last_change":"2024-08-27T03:10:45.291800+0000","last_active":"2024-08-27T03:55:44.875576+0000","last_peered":"2024-08-27T03:55:44.875576+0000","last_clean":"2024-08-27T03:55:44.875576+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:55:44.875576+0000","last_undegraded":"2024-08-27T03:55:44.875576+0000","last_fullsized":"2024-08-27T03:55:44.875576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:23:36.039939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.913854+0000","last_change":"2024-08-27T02:50:55.799193+0000","last_active":"2024-08-27T03:58:24.913854+0000","last_peered":"2024-08-27T03:58:24.913854+0000","last_clean":"2024-08-27T03:58:24.913854+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:58:24.913854+0000","last_undegraded":"2024-08-27T03:58:24.913854+0000","last_fullsized":"2024-08-27T03:58:24.913854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:21:44.106748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.896443+0000","last_change":"2024-08-27T02:50:51.735635+0000","last_active":"2024-08-27T03:55:54.896443+0000","last_peered":"2024-08-27T03:55:54.896443+0000","last_clean":"2024-08-27T03:55:54.896443+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:55:54.896443+0000","last_undegraded":"2024-08-27T03:55:54.896443+0000","last_fullsized":"2024-08-27T03:55:54.896443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:41.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.292121+0000","last_change":"2024-08-27T02:46:49.663999+0000","last_active":"2024-08-27T03:55:35.292121+0000","last_peered":"2024-08-27T03:55:35.292121+0000","last_clean":"2024-08-27T03:55:35.292121+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:55:35.292121+0000","last_undegraded":"2024-08-27T03:55:35.292121+0000","last_fullsized":"2024-08-27T03:55:35.292121+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:06:26.935384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073515+0000","last_change":"2024-08-27T03:10:45.296108+0000","last_active":"2024-08-27T03:55:45.073515+0000","last_peered":"2024-08-27T03:55:45.073515+0000","last_clean":"2024-08-27T03:55:45.073515+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:55:45.073515+0000","last_undegraded":"2024-08-27T03:55:45.073515+0000","last_fullsized":"2024-08-27T03:55:45.073515+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:12.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128164+0000","last_change":"2024-08-27T02:50:55.775244+0000","last_active":"2024-08-27T03:58:25.128164+0000","last_peered":"2024-08-27T03:58:25.128164+0000","last_clean":"2024-08-27T03:58:25.128164+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:58:25.128164+0000","last_undegraded":"2024-08-27T03:58:25.128164+0000","last_fullsized":"2024-08-27T03:58:25.128164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:30.406512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076691+0000","last_change":"2024-08-27T02:50:51.735266+0000","last_active":"2024-08-27T03:55:51.076691+0000","last_peered":"2024-08-27T03:55:51.076691+0000","last_clean":"2024-08-27T03:55:51.076691+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:55:51.076691+0000","last_undegraded":"2024-08-27T03:55:51.076691+0000","last_fullsized":"2024-08-27T03:55:51.076691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:50:41.400577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064603+0000","last_change":"2024-08-27T02:46:49.676761+0000","last_active":"2024-08-27T03:55:05.064603+0000","last_peered":"2024-08-27T03:55:05.064603+0000","last_clean":"2024-08-27T03:55:05.064603+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:55:05.064603+0000","last_undegraded":"2024-08-27T03:55:05.064603+0000","last_fullsized":"2024-08-27T03:55:05.064603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:59:06.352477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.436334+0000","last_change":"2024-08-27T03:10:45.294573+0000","last_active":"2024-08-27T03:54:15.436334+0000","last_peered":"2024-08-27T03:54:15.436334+0000","last_clean":"2024-08-27T03:54:15.436334+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:54:15.436334+0000","last_undegraded":"2024-08-27T03:54:15.436334+0000","last_fullsized":"2024-08-27T03:54:15.436334+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:54.922215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290928+0000","last_change":"2024-08-27T02:50:55.791602+0000","last_active":"2024-08-27T03:55:30.290928+0000","last_peered":"2024-08-27T03:55:30.290928+0000","last_clean":"2024-08-27T03:55:30.290928+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:55:30.290928+0000","last_undegraded":"2024-08-27T03:55:30.290928+0000","last_fullsized":"2024-08-27T03:55:30.290928+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:05.925142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'11","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.881057+0000","last_change":"2024-08-27T02:50:51.729715+0000","last_active":"2024-08-27T03:58:29.881057+0000","last_peered":"2024-08-27T03:58:29.881057+0000","last_clean":"2024-08-27T03:58:29.881057+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:58:29.881057+0000","last_undegraded":"2024-08-27T03:58:29.881057+0000","last_fullsized":"2024-08-27T03:58:29.881057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:26.531591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21563,"num_write":16,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494185+0000","last_change":"2024-08-27T02:46:49.653398+0000","last_active":"2024-08-27T03:54:20.494185+0000","last_peered":"2024-08-27T03:54:20.494185+0000","last_clean":"2024-08-27T03:54:20.494185+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:54:20.494185+0000","last_undegraded":"2024-08-27T03:54:20.494185+0000","last_fullsized":"2024-08-27T03:54:20.494185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:50.129103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871224+0000","last_change":"2024-08-27T03:10:45.281316+0000","last_active":"2024-08-27T03:54:29.871224+0000","last_peered":"2024-08-27T03:54:29.871224+0000","last_clean":"2024-08-27T03:54:29.871224+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:54:29.871224+0000","last_undegraded":"2024-08-27T03:54:29.871224+0000","last_fullsized":"2024-08-27T03:54:29.871224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:26.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.887006+0000","last_change":"2024-08-27T02:50:55.794295+0000","last_active":"2024-08-27T03:55:14.887006+0000","last_peered":"2024-08-27T03:55:14.887006+0000","last_clean":"2024-08-27T03:55:14.887006+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:55:14.887006+0000","last_undegraded":"2024-08-27T03:55:14.887006+0000","last_fullsized":"2024-08-27T03:55:14.887006+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:10.976998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.087490+0000","last_change":"2024-08-27T02:50:51.720342+0000","last_active":"2024-08-27T03:55:30.087490+0000","last_peered":"2024-08-27T03:55:30.087490+0000","last_clean":"2024-08-27T03:55:30.087490+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:55:30.087490+0000","last_undegraded":"2024-08-27T03:55:30.087490+0000","last_fullsized":"2024-08-27T03:55:30.087490+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:16:13.056385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868989+0000","last_change":"2024-08-27T02:46:49.680620+0000","last_active":"2024-08-27T03:54:19.868989+0000","last_peered":"2024-08-27T03:54:19.868989+0000","last_clean":"2024-08-27T03:54:19.868989+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:54:19.868989+0000","last_undegraded":"2024-08-27T03:54:19.868989+0000","last_fullsized":"2024-08-27T03:54:19.868989+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:46:31.779704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:59.882198+0000","last_change":"2024-08-27T03:10:45.289727+0000","last_active":"2024-08-27T03:54:59.882198+0000","last_peered":"2024-08-27T03:54:59.882198+0000","last_clean":"2024-08-27T03:54:59.882198+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:54:59.882198+0000","last_undegraded":"2024-08-27T03:54:59.882198+0000","last_fullsized":"2024-08-27T03:54:59.882198+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:30:10.424523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:29.886332+0000","last_change":"2024-08-27T02:50:55.806362+0000","last_active":"2024-08-27T03:56:29.886332+0000","last_peered":"2024-08-27T03:56:29.886332+0000","last_clean":"2024-08-27T03:56:29.886332+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:56:29.886332+0000","last_undegraded":"2024-08-27T03:56:29.886332+0000","last_fullsized":"2024-08-27T03:56:29.886332+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.282979+0000","last_change":"2024-08-27T02:50:51.720059+0000","last_active":"2024-08-27T03:58:31.282979+0000","last_peered":"2024-08-27T03:58:31.282979+0000","last_clean":"2024-08-27T03:58:31.282979+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:58:31.282979+0000","last_undegraded":"2024-08-27T03:58:31.282979+0000","last_fullsized":"2024-08-27T03:58:31.282979+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868908+0000","last_change":"2024-08-27T02:46:49.675252+0000","last_active":"2024-08-27T03:54:19.868908+0000","last_peered":"2024-08-27T03:54:19.868908+0000","last_clean":"2024-08-27T03:54:19.868908+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:54:19.868908+0000","last_undegraded":"2024-08-27T03:54:19.868908+0000","last_fullsized":"2024-08-27T03:54:19.868908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:11.184532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:36.087843+0000","last_change":"2024-08-27T03:10:45.303346+0000","last_active":"2024-08-27T03:56:36.087843+0000","last_peered":"2024-08-27T03:56:36.087843+0000","last_clean":"2024-08-27T03:56:36.087843+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:56:36.087843+0000","last_undegraded":"2024-08-27T03:56:36.087843+0000","last_fullsized":"2024-08-27T03:56:36.087843+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461358+0000","last_change":"2024-08-27T02:50:55.789996+0000","last_active":"2024-08-27T03:56:10.461358+0000","last_peered":"2024-08-27T03:56:10.461358+0000","last_clean":"2024-08-27T03:56:10.461358+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:56:10.461358+0000","last_undegraded":"2024-08-27T03:56:10.461358+0000","last_fullsized":"2024-08-27T03:56:10.461358+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:53.367346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.879641+0000","last_change":"2024-08-27T02:50:51.707799+0000","last_active":"2024-08-27T03:58:29.879641+0000","last_peered":"2024-08-27T03:58:29.879641+0000","last_clean":"2024-08-27T03:58:29.879641+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:58:29.879641+0000","last_undegraded":"2024-08-27T03:58:29.879641+0000","last_fullsized":"2024-08-27T03:58:29.879641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.437440+0000","last_change":"2024-08-27T02:46:49.657662+0000","last_active":"2024-08-27T03:54:20.437440+0000","last_peered":"2024-08-27T03:54:20.437440+0000","last_clean":"2024-08-27T03:54:20.437440+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:54:20.437440+0000","last_undegraded":"2024-08-27T03:54:20.437440+0000","last_fullsized":"2024-08-27T03:54:20.437440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:37:52.995296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299701+0000","last_change":"2024-08-27T03:10:45.293045+0000","last_active":"2024-08-27T03:55:45.299701+0000","last_peered":"2024-08-27T03:55:45.299701+0000","last_clean":"2024-08-27T03:55:45.299701+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:55:45.299701+0000","last_undegraded":"2024-08-27T03:55:45.299701+0000","last_fullsized":"2024-08-27T03:55:45.299701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:53:47.782276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.041243+0000","last_change":"2024-08-27T02:50:55.766901+0000","last_active":"2024-08-27T03:58:30.041243+0000","last_peered":"2024-08-27T03:58:30.041243+0000","last_clean":"2024-08-27T03:58:30.041243+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:58:30.041243+0000","last_undegraded":"2024-08-27T03:58:30.041243+0000","last_fullsized":"2024-08-27T03:58:30.041243+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:30:21.583051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.841038+0000","last_change":"2024-08-27T02:50:51.738475+0000","last_active":"2024-08-27T03:58:30.841038+0000","last_peered":"2024-08-27T03:58:30.841038+0000","last_clean":"2024-08-27T03:58:30.841038+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:58:30.841038+0000","last_undegraded":"2024-08-27T03:58:30.841038+0000","last_fullsized":"2024-08-27T03:58:30.841038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:26:56.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.497953+0000","last_change":"2024-08-27T02:46:49.647868+0000","last_active":"2024-08-27T03:54:40.497953+0000","last_peered":"2024-08-27T03:54:40.497953+0000","last_clean":"2024-08-27T03:54:40.497953+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:54:40.497953+0000","last_undegraded":"2024-08-27T03:54:40.497953+0000","last_fullsized":"2024-08-27T03:54:40.497953+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:28:45.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299830+0000","last_change":"2024-08-27T03:10:45.284842+0000","last_active":"2024-08-27T03:55:45.299830+0000","last_peered":"2024-08-27T03:55:45.299830+0000","last_clean":"2024-08-27T03:55:45.299830+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:55:45.299830+0000","last_undegraded":"2024-08-27T03:55:45.299830+0000","last_fullsized":"2024-08-27T03:55:45.299830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:45:04.454859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930510+0000","last_change":"2024-08-27T02:50:55.778273+0000","last_active":"2024-08-27T03:58:24.930510+0000","last_peered":"2024-08-27T03:58:24.930510+0000","last_clean":"2024-08-27T03:58:24.930510+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:58:24.930510+0000","last_undegraded":"2024-08-27T03:58:24.930510+0000","last_fullsized":"2024-08-27T03:58:24.930510+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:39.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.296625+0000","last_change":"2024-08-27T02:50:51.714543+0000","last_active":"2024-08-27T03:55:55.296625+0000","last_peered":"2024-08-27T03:55:55.296625+0000","last_clean":"2024-08-27T03:55:55.296625+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:55:55.296625+0000","last_undegraded":"2024-08-27T03:55:55.296625+0000","last_fullsized":"2024-08-27T03:55:55.296625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:34.299020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058666+0000","last_change":"2024-08-27T02:46:49.667902+0000","last_active":"2024-08-27T03:54:31.058666+0000","last_peered":"2024-08-27T03:54:31.058666+0000","last_clean":"2024-08-27T03:54:31.058666+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:54:31.058666+0000","last_undegraded":"2024-08-27T03:54:31.058666+0000","last_fullsized":"2024-08-27T03:54:31.058666+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:52:38.299301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:06.065781+0000","last_change":"2024-08-27T03:10:45.298717+0000","last_active":"2024-08-27T03:55:06.065781+0000","last_peered":"2024-08-27T03:55:06.065781+0000","last_clean":"2024-08-27T03:55:06.065781+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:55:06.065781+0000","last_undegraded":"2024-08-27T03:55:06.065781+0000","last_fullsized":"2024-08-27T03:55:06.065781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:23:22.104053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.654528+0000","last_change":"2024-08-27T02:50:55.800701+0000","last_active":"2024-08-27T03:58:29.654528+0000","last_peered":"2024-08-27T03:58:29.654528+0000","last_clean":"2024-08-27T03:58:29.654528+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:58:29.654528+0000","last_undegraded":"2024-08-27T03:58:29.654528+0000","last_fullsized":"2024-08-27T03:58:29.654528+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:22.225737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'2","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.146232+0000","last_change":"2024-08-27T02:50:51.725068+0000","last_active":"2024-08-27T03:58:31.146232+0000","last_peered":"2024-08-27T03:58:31.146232+0000","last_clean":"2024-08-27T03:58:31.146232+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:58:31.146232+0000","last_undegraded":"2024-08-27T03:58:31.146232+0000","last_fullsized":"2024-08-27T03:58:31.146232+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495980+0000","last_change":"2024-08-27T02:46:49.654801+0000","last_active":"2024-08-27T03:54:30.495980+0000","last_peered":"2024-08-27T03:54:30.495980+0000","last_clean":"2024-08-27T03:54:30.495980+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:54:30.495980+0000","last_undegraded":"2024-08-27T03:54:30.495980+0000","last_fullsized":"2024-08-27T03:54:30.495980+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:08.448754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.064497+0000","last_change":"2024-08-27T03:10:45.296344+0000","last_active":"2024-08-27T03:55:05.064497+0000","last_peered":"2024-08-27T03:55:05.064497+0000","last_clean":"2024-08-27T03:55:05.064497+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:55:05.064497+0000","last_undegraded":"2024-08-27T03:55:05.064497+0000","last_fullsized":"2024-08-27T03:55:05.064497+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:07:28.938702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.499627+0000","last_change":"2024-08-27T02:51:41.064218+0000","last_active":"2024-08-27T03:54:50.499627+0000","last_peered":"2024-08-27T03:54:50.499627+0000","last_clean":"2024-08-27T03:54:50.499627+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:54:50.499627+0000","last_undegraded":"2024-08-27T03:54:50.499627+0000","last_fullsized":"2024-08-27T03:54:50.499627+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:59:05.157815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306276+0000","last_change":"2024-08-27T02:50:51.728712+0000","last_active":"2024-08-27T03:56:10.306276+0000","last_peered":"2024-08-27T03:56:10.306276+0000","last_clean":"2024-08-27T03:56:10.306276+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:56:10.306276+0000","last_undegraded":"2024-08-27T03:56:10.306276+0000","last_fullsized":"2024-08-27T03:56:10.306276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:43:32.708072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":308,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871387+0000","last_change":"2024-08-27T02:46:49.674700+0000","last_active":"2024-08-27T03:54:29.871387+0000","last_peered":"2024-08-27T03:54:29.871387+0000","last_clean":"2024-08-27T03:54:29.871387+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:54:29.871387+0000","last_undegraded":"2024-08-27T03:54:29.871387+0000","last_fullsized":"2024-08-27T03:54:29.871387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:39:28.639475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.289661+0000","last_change":"2024-08-27T03:10:45.293007+0000","last_active":"2024-08-27T03:55:05.289661+0000","last_peered":"2024-08-27T03:55:05.289661+0000","last_clean":"2024-08-27T03:55:05.289661+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:55:05.289661+0000","last_undegraded":"2024-08-27T03:55:05.289661+0000","last_fullsized":"2024-08-27T03:55:05.289661+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:23:00.597660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900537+0000","last_change":"2024-08-27T02:50:55.799828+0000","last_active":"2024-08-27T03:56:09.900537+0000","last_peered":"2024-08-27T03:56:09.900537+0000","last_clean":"2024-08-27T03:56:09.900537+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:56:09.900537+0000","last_undegraded":"2024-08-27T03:56:09.900537+0000","last_fullsized":"2024-08-27T03:56:09.900537+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:54.431380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.079054+0000","last_change":"2024-08-27T02:50:51.720595+0000","last_active":"2024-08-27T03:56:10.079054+0000","last_peered":"2024-08-27T03:56:10.079054+0000","last_clean":"2024-08-27T03:56:10.079054+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:56:10.079054+0000","last_undegraded":"2024-08-27T03:56:10.079054+0000","last_fullsized":"2024-08-27T03:56:10.079054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:42:21.827378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.057603+0000","last_change":"2024-08-27T02:46:49.678450+0000","last_active":"2024-08-27T03:54:30.057603+0000","last_peered":"2024-08-27T03:54:30.057603+0000","last_clean":"2024-08-27T03:54:30.057603+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:54:30.057603+0000","last_undegraded":"2024-08-27T03:54:30.057603+0000","last_fullsized":"2024-08-27T03:54:30.057603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:37.128746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:04.866169+0000","last_change":"2024-08-27T03:10:45.298256+0000","last_active":"2024-08-27T03:55:04.866169+0000","last_peered":"2024-08-27T03:55:04.866169+0000","last_clean":"2024-08-27T03:55:04.866169+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:55:04.866169+0000","last_undegraded":"2024-08-27T03:55:04.866169+0000","last_fullsized":"2024-08-27T03:55:04.866169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:20:23.614816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.841187+0000","last_change":"2024-08-27T02:50:55.769990+0000","last_active":"2024-08-27T03:58:30.841187+0000","last_peered":"2024-08-27T03:58:30.841187+0000","last_clean":"2024-08-27T03:58:30.841187+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:58:30.841187+0000","last_undegraded":"2024-08-27T03:58:30.841187+0000","last_fullsized":"2024-08-27T03:58:30.841187+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:30.128153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.809126+0000","last_change":"2024-08-27T02:50:51.699776+0000","last_active":"2024-08-27T03:58:29.809126+0000","last_peered":"2024-08-27T03:58:29.809126+0000","last_clean":"2024-08-27T03:58:29.809126+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:58:29.809126+0000","last_undegraded":"2024-08-27T03:58:29.809126+0000","last_fullsized":"2024-08-27T03:58:29.809126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.286162+0000","last_change":"2024-08-27T02:46:49.665181+0000","last_active":"2024-08-27T03:54:50.286162+0000","last_peered":"2024-08-27T03:54:50.286162+0000","last_clean":"2024-08-27T03:54:50.286162+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:54:50.286162+0000","last_undegraded":"2024-08-27T03:54:50.286162+0000","last_fullsized":"2024-08-27T03:54:50.286162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:42.937470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867848+0000","last_change":"2024-08-27T03:10:45.289487+0000","last_active":"2024-08-27T03:54:14.867848+0000","last_peered":"2024-08-27T03:54:14.867848+0000","last_clean":"2024-08-27T03:54:14.867848+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:54:14.867848+0000","last_undegraded":"2024-08-27T03:54:14.867848+0000","last_fullsized":"2024-08-27T03:54:14.867848+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:39.767865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.339150+0000","last_change":"2024-08-27T02:50:55.787899+0000","last_active":"2024-08-27T03:58:30.339150+0000","last_peered":"2024-08-27T03:58:30.339150+0000","last_clean":"2024-08-27T03:58:30.339150+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:58:30.339150+0000","last_undegraded":"2024-08-27T03:58:30.339150+0000","last_fullsized":"2024-08-27T03:58:30.339150+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.097716+0000","last_change":"2024-08-27T02:50:51.710484+0000","last_active":"2024-08-27T03:56:15.097716+0000","last_peered":"2024-08-27T03:56:15.097716+0000","last_clean":"2024-08-27T03:56:15.097716+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:56:15.097716+0000","last_undegraded":"2024-08-27T03:56:15.097716+0000","last_fullsized":"2024-08-27T03:56:15.097716+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:35:36.294957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.281022+0000","last_change":"2024-08-27T02:46:49.668229+0000","last_active":"2024-08-27T03:54:30.281022+0000","last_peered":"2024-08-27T03:54:30.281022+0000","last_clean":"2024-08-27T03:54:30.281022+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:54:30.281022+0000","last_undegraded":"2024-08-27T03:54:30.281022+0000","last_fullsized":"2024-08-27T03:54:30.281022+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:15.719694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:15.493101+0000","last_change":"2024-08-27T03:10:45.282295+0000","last_active":"2024-08-27T03:54:15.493101+0000","last_peered":"2024-08-27T03:54:15.493101+0000","last_clean":"2024-08-27T03:54:15.493101+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:54:15.493101+0000","last_undegraded":"2024-08-27T03:54:15.493101+0000","last_fullsized":"2024-08-27T03:54:15.493101+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:10:06.995285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.108686+0000","last_change":"2024-08-27T02:50:55.769855+0000","last_active":"2024-08-27T03:58:30.108686+0000","last_peered":"2024-08-27T03:58:30.108686+0000","last_clean":"2024-08-27T03:58:30.108686+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:58:30.108686+0000","last_undegraded":"2024-08-27T03:58:30.108686+0000","last_fullsized":"2024-08-27T03:58:30.108686+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.901513+0000","last_change":"2024-08-27T02:50:51.730019+0000","last_active":"2024-08-27T03:56:14.901513+0000","last_peered":"2024-08-27T03:56:14.901513+0000","last_clean":"2024-08-27T03:56:14.901513+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:56:14.901513+0000","last_undegraded":"2024-08-27T03:56:14.901513+0000","last_fullsized":"2024-08-27T03:56:14.901513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:46.716300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495770+0000","last_change":"2024-08-27T02:46:49.666192+0000","last_active":"2024-08-27T03:54:30.495770+0000","last_peered":"2024-08-27T03:54:30.495770+0000","last_clean":"2024-08-27T03:54:30.495770+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:54:30.495770+0000","last_undegraded":"2024-08-27T03:54:30.495770+0000","last_fullsized":"2024-08-27T03:54:30.495770+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:15:05.105406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287223+0000","last_change":"2024-08-27T03:10:45.283329+0000","last_active":"2024-08-27T03:55:15.287223+0000","last_peered":"2024-08-27T03:55:15.287223+0000","last_clean":"2024-08-27T03:55:15.287223+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:55:15.287223+0000","last_undegraded":"2024-08-27T03:55:15.287223+0000","last_fullsized":"2024-08-27T03:55:15.287223+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:08.644016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.901666+0000","last_change":"2024-08-27T02:50:55.783336+0000","last_active":"2024-08-27T03:56:14.901666+0000","last_peered":"2024-08-27T03:56:14.901666+0000","last_clean":"2024-08-27T03:56:14.901666+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:56:14.901666+0000","last_undegraded":"2024-08-27T03:56:14.901666+0000","last_fullsized":"2024-08-27T03:56:14.901666+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:19.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462633+0000","last_change":"2024-08-27T02:50:51.738540+0000","last_active":"2024-08-27T03:56:15.462633+0000","last_peered":"2024-08-27T03:56:15.462633+0000","last_clean":"2024-08-27T03:56:15.462633+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:56:15.462633+0000","last_undegraded":"2024-08-27T03:56:15.462633+0000","last_fullsized":"2024-08-27T03:56:15.462633+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:28.212686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.072847+0000","last_change":"2024-08-27T02:46:49.654783+0000","last_active":"2024-08-27T03:54:30.072847+0000","last_peered":"2024-08-27T03:54:30.072847+0000","last_clean":"2024-08-27T03:54:30.072847+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:54:30.072847+0000","last_undegraded":"2024-08-27T03:54:30.072847+0000","last_fullsized":"2024-08-27T03:54:30.072847+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:07.533650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:14.867790+0000","last_change":"2024-08-27T03:10:45.266598+0000","last_active":"2024-08-27T03:54:14.867790+0000","last_peered":"2024-08-27T03:54:14.867790+0000","last_clean":"2024-08-27T03:54:14.867790+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:54:14.867790+0000","last_undegraded":"2024-08-27T03:54:14.867790+0000","last_fullsized":"2024-08-27T03:54:14.867790+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:33:16.790039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.227000+0000","last_change":"2024-08-27T02:50:55.778741+0000","last_active":"2024-08-27T03:58:29.227000+0000","last_peered":"2024-08-27T03:58:29.227000+0000","last_clean":"2024-08-27T03:58:29.227000+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:58:29.227000+0000","last_undegraded":"2024-08-27T03:58:29.227000+0000","last_fullsized":"2024-08-27T03:58:29.227000+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:56:17.118596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.882842+0000","last_change":"2024-08-27T02:50:51.722290+0000","last_active":"2024-08-27T03:56:14.882842+0000","last_peered":"2024-08-27T03:56:14.882842+0000","last_clean":"2024-08-27T03:56:14.882842+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:56:14.882842+0000","last_undegraded":"2024-08-27T03:56:14.882842+0000","last_fullsized":"2024-08-27T03:56:14.882842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:01.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871100+0000","last_change":"2024-08-27T02:46:49.673825+0000","last_active":"2024-08-27T03:54:29.871100+0000","last_peered":"2024-08-27T03:54:29.871100+0000","last_clean":"2024-08-27T03:54:29.871100+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:54:29.871100+0000","last_undegraded":"2024-08-27T03:54:29.871100+0000","last_fullsized":"2024-08-27T03:54:29.871100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:03.488183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:25.082170+0000","last_change":"2024-08-27T03:10:45.296440+0000","last_active":"2024-08-27T03:56:25.082170+0000","last_peered":"2024-08-27T03:56:25.082170+0000","last_clean":"2024-08-27T03:56:25.082170+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:56:25.082170+0000","last_undegraded":"2024-08-27T03:56:25.082170+0000","last_fullsized":"2024-08-27T03:56:25.082170+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:09.800699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'2","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930741+0000","last_change":"2024-08-27T02:50:55.782955+0000","last_active":"2024-08-27T03:58:24.930741+0000","last_peered":"2024-08-27T03:58:24.930741+0000","last_clean":"2024-08-27T03:58:24.930741+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:58:24.930741+0000","last_undegraded":"2024-08-27T03:58:24.930741+0000","last_fullsized":"2024-08-27T03:58:24.930741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:13.729427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306233+0000","last_change":"2024-08-27T02:50:51.737202+0000","last_active":"2024-08-27T03:56:10.306233+0000","last_peered":"2024-08-27T03:56:10.306233+0000","last_clean":"2024-08-27T03:56:10.306233+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:56:10.306233+0000","last_undegraded":"2024-08-27T03:56:10.306233+0000","last_fullsized":"2024-08-27T03:56:10.306233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:36.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'155","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:39.874246+0000","last_change":"2024-08-27T02:46:49.680563+0000","last_active":"2024-08-27T03:54:39.874246+0000","last_peered":"2024-08-27T03:54:39.874246+0000","last_clean":"2024-08-27T03:54:39.874246+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:54:39.874246+0000","last_undegraded":"2024-08-27T03:54:39.874246+0000","last_fullsized":"2024-08-27T03:54:39.874246+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:31.769992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299565+0000","last_change":"2024-08-27T03:10:45.284394+0000","last_active":"2024-08-27T03:55:45.299565+0000","last_peered":"2024-08-27T03:55:45.299565+0000","last_clean":"2024-08-27T03:55:45.299565+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:55:45.299565+0000","last_undegraded":"2024-08-27T03:55:45.299565+0000","last_fullsized":"2024-08-27T03:55:45.299565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:56.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930627+0000","last_change":"2024-08-27T02:50:55.783274+0000","last_active":"2024-08-27T03:58:24.930627+0000","last_peered":"2024-08-27T03:58:24.930627+0000","last_clean":"2024-08-27T03:58:24.930627+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:58:24.930627+0000","last_undegraded":"2024-08-27T03:58:24.930627+0000","last_fullsized":"2024-08-27T03:58:24.930627+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:45:25.580491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.104827+0000","last_change":"2024-08-27T02:50:51.720906+0000","last_active":"2024-08-27T03:58:25.104827+0000","last_peered":"2024-08-27T03:58:25.104827+0000","last_clean":"2024-08-27T03:58:25.104827+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:58:25.104827+0000","last_undegraded":"2024-08-27T03:58:25.104827+0000","last_fullsized":"2024-08-27T03:58:25.104827+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:53.550807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:34.887749+0000","last_change":"2024-08-27T02:46:49.663826+0000","last_active":"2024-08-27T03:56:34.887749+0000","last_peered":"2024-08-27T03:56:34.887749+0000","last_clean":"2024-08-27T03:56:34.887749+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:56:34.887749+0000","last_undegraded":"2024-08-27T03:56:34.887749+0000","last_fullsized":"2024-08-27T03:56:34.887749+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.462512+0000","last_change":"2024-08-27T03:10:45.287877+0000","last_active":"2024-08-27T03:56:15.462512+0000","last_peered":"2024-08-27T03:56:15.462512+0000","last_clean":"2024-08-27T03:56:15.462512+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:56:15.462512+0000","last_undegraded":"2024-08-27T03:56:15.462512+0000","last_fullsized":"2024-08-27T03:56:15.462512+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:39:37.167338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:21.083813+0000","last_change":"2024-08-27T02:50:55.796569+0000","last_active":"2024-08-27T03:56:21.083813+0000","last_peered":"2024-08-27T03:56:21.083813+0000","last_clean":"2024-08-27T03:56:21.083813+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:56:21.083813+0000","last_undegraded":"2024-08-27T03:56:21.083813+0000","last_fullsized":"2024-08-27T03:56:21.083813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300859+0000","last_change":"2024-08-27T02:50:51.714350+0000","last_active":"2024-08-27T03:56:10.300859+0000","last_peered":"2024-08-27T03:56:10.300859+0000","last_clean":"2024-08-27T03:56:10.300859+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:56:10.300859+0000","last_undegraded":"2024-08-27T03:56:10.300859+0000","last_fullsized":"2024-08-27T03:56:10.300859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:27:51.967867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'95","reported_seq":425,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.467014+0000","last_change":"2024-08-27T02:46:49.668269+0000","last_active":"2024-08-27T03:56:35.467014+0000","last_peered":"2024-08-27T03:56:35.467014+0000","last_clean":"2024-08-27T03:56:35.467014+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:56:35.467014+0000","last_undegraded":"2024-08-27T03:56:35.467014+0000","last_fullsized":"2024-08-27T03:56:35.467014+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307291+0000","last_change":"2024-08-27T03:10:45.299758+0000","last_active":"2024-08-27T03:56:15.307291+0000","last_peered":"2024-08-27T03:56:15.307291+0000","last_clean":"2024-08-27T03:56:15.307291+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:56:15.307291+0000","last_undegraded":"2024-08-27T03:56:15.307291+0000","last_fullsized":"2024-08-27T03:56:15.307291+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.273910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930815+0000","last_change":"2024-08-27T02:50:55.792739+0000","last_active":"2024-08-27T03:58:24.930815+0000","last_peered":"2024-08-27T03:58:24.930815+0000","last_clean":"2024-08-27T03:58:24.930815+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:58:24.930815+0000","last_undegraded":"2024-08-27T03:58:24.930815+0000","last_fullsized":"2024-08-27T03:58:24.930815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:53.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:16.082281+0000","last_change":"2024-08-27T02:50:51.725905+0000","last_active":"2024-08-27T03:56:16.082281+0000","last_peered":"2024-08-27T03:56:16.082281+0000","last_clean":"2024-08-27T03:56:16.082281+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:56:16.082281+0000","last_undegraded":"2024-08-27T03:56:16.082281+0000","last_fullsized":"2024-08-27T03:56:16.082281+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:12.890510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.084227+0000","last_change":"2024-08-27T02:46:49.680856+0000","last_active":"2024-08-27T03:56:35.084227+0000","last_peered":"2024-08-27T03:56:35.084227+0000","last_clean":"2024-08-27T03:56:35.084227+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:56:35.084227+0000","last_undegraded":"2024-08-27T03:56:35.084227+0000","last_fullsized":"2024-08-27T03:56:35.084227+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.894119+0000","last_change":"2024-08-27T03:10:45.290159+0000","last_active":"2024-08-27T03:55:44.894119+0000","last_peered":"2024-08-27T03:55:44.894119+0000","last_clean":"2024-08-27T03:55:44.894119+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:55:44.894119+0000","last_undegraded":"2024-08-27T03:55:44.894119+0000","last_fullsized":"2024-08-27T03:55:44.894119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:46:58.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093241+0000","last_change":"2024-08-27T02:50:55.801909+0000","last_active":"2024-08-27T03:55:55.093241+0000","last_peered":"2024-08-27T03:55:55.093241+0000","last_clean":"2024-08-27T03:55:55.093241+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:55:55.093241+0000","last_undegraded":"2024-08-27T03:55:55.093241+0000","last_fullsized":"2024-08-27T03:55:55.093241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:21:22.557931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.326037+0000","last_change":"2024-08-27T02:50:51.714694+0000","last_active":"2024-08-27T03:58:05.326037+0000","last_peered":"2024-08-27T03:58:05.326037+0000","last_clean":"2024-08-27T03:58:05.326037+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:58:05.326037+0000","last_undegraded":"2024-08-27T03:58:05.326037+0000","last_fullsized":"2024-08-27T03:58:05.326037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:09.799135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.306814+0000","last_change":"2024-08-27T02:46:49.660909+0000","last_active":"2024-08-27T03:56:35.306814+0000","last_peered":"2024-08-27T03:56:35.306814+0000","last_clean":"2024-08-27T03:56:35.306814+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:56:35.306814+0000","last_undegraded":"2024-08-27T03:56:35.306814+0000","last_fullsized":"2024-08-27T03:56:35.306814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302508+0000","last_change":"2024-08-27T03:10:45.301566+0000","last_active":"2024-08-27T03:55:55.302508+0000","last_peered":"2024-08-27T03:55:55.302508+0000","last_clean":"2024-08-27T03:55:55.302508+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:55:55.302508+0000","last_undegraded":"2024-08-27T03:55:55.302508+0000","last_fullsized":"2024-08-27T03:55:55.302508+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:57:00.105752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302217+0000","last_change":"2024-08-27T02:50:55.793032+0000","last_active":"2024-08-27T03:55:55.302217+0000","last_peered":"2024-08-27T03:55:55.302217+0000","last_clean":"2024-08-27T03:55:55.302217+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:55:55.302217+0000","last_undegraded":"2024-08-27T03:55:55.302217+0000","last_fullsized":"2024-08-27T03:55:55.302217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:41:51.131027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:51.076538+0000","last_change":"2024-08-27T02:50:51.736002+0000","last_active":"2024-08-27T03:55:51.076538+0000","last_peered":"2024-08-27T03:55:51.076538+0000","last_clean":"2024-08-27T03:55:51.076538+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:55:51.076538+0000","last_undegraded":"2024-08-27T03:55:51.076538+0000","last_fullsized":"2024-08-27T03:55:51.076538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:07.337806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:30.310788+0000","last_change":"2024-08-27T02:46:49.656326+0000","last_active":"2024-08-27T03:56:30.310788+0000","last_peered":"2024-08-27T03:56:30.310788+0000","last_clean":"2024-08-27T03:56:30.310788+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:56:30.310788+0000","last_undegraded":"2024-08-27T03:56:30.310788+0000","last_fullsized":"2024-08-27T03:56:30.310788+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299649+0000","last_change":"2024-08-27T03:10:45.282178+0000","last_active":"2024-08-27T03:55:45.299649+0000","last_peered":"2024-08-27T03:55:45.299649+0000","last_clean":"2024-08-27T03:55:45.299649+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:55:45.299649+0000","last_undegraded":"2024-08-27T03:55:45.299649+0000","last_fullsized":"2024-08-27T03:55:45.299649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:24:50.331973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:26.109697+0000","last_change":"2024-08-27T02:50:55.769877+0000","last_active":"2024-08-27T03:58:26.109697+0000","last_peered":"2024-08-27T03:58:26.109697+0000","last_clean":"2024-08-27T03:58:26.109697+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:58:26.109697+0000","last_undegraded":"2024-08-27T03:58:26.109697+0000","last_fullsized":"2024-08-27T03:58:26.109697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:43:34.441494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'12","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.878575+0000","last_change":"2024-08-27T02:50:51.706023+0000","last_active":"2024-08-27T03:58:29.878575+0000","last_peered":"2024-08-27T03:58:29.878575+0000","last_clean":"2024-08-27T03:58:29.878575+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:58:29.878575+0000","last_undegraded":"2024-08-27T03:58:29.878575+0000","last_fullsized":"2024-08-27T03:58:29.878575+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:01:06.191127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":17,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900237+0000","last_change":"2024-08-27T02:46:49.681215+0000","last_active":"2024-08-27T03:56:09.900237+0000","last_peered":"2024-08-27T03:56:09.900237+0000","last_clean":"2024-08-27T03:56:09.900237+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:56:09.900237+0000","last_undegraded":"2024-08-27T03:56:09.900237+0000","last_fullsized":"2024-08-27T03:56:09.900237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:59.655983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294482+0000","last_change":"2024-08-27T03:10:45.266749+0000","last_active":"2024-08-27T03:55:45.294482+0000","last_peered":"2024-08-27T03:55:45.294482+0000","last_clean":"2024-08-27T03:55:45.294482+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:55:45.294482+0000","last_undegraded":"2024-08-27T03:55:45.294482+0000","last_fullsized":"2024-08-27T03:55:45.294482+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:25:14.767363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307348+0000","last_change":"2024-08-27T02:50:55.806234+0000","last_active":"2024-08-27T03:56:15.307348+0000","last_peered":"2024-08-27T03:56:15.307348+0000","last_clean":"2024-08-27T03:56:15.307348+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:56:15.307348+0000","last_undegraded":"2024-08-27T03:56:15.307348+0000","last_fullsized":"2024-08-27T03:56:15.307348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:26.269206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128113+0000","last_change":"2024-08-27T02:50:51.727708+0000","last_active":"2024-08-27T03:58:25.128113+0000","last_peered":"2024-08-27T03:58:25.128113+0000","last_clean":"2024-08-27T03:58:25.128113+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:58:25.128113+0000","last_undegraded":"2024-08-27T03:58:25.128113+0000","last_fullsized":"2024-08-27T03:58:25.128113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:26:00.265762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461291+0000","last_change":"2024-08-27T02:46:49.658797+0000","last_active":"2024-08-27T03:56:10.461291+0000","last_peered":"2024-08-27T03:56:10.461291+0000","last_clean":"2024-08-27T03:56:10.461291+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:56:10.461291+0000","last_undegraded":"2024-08-27T03:56:10.461291+0000","last_fullsized":"2024-08-27T03:56:10.461291+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:21.705436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.312150+0000","last_change":"2024-08-27T03:10:45.299158+0000","last_active":"2024-08-27T03:56:35.312150+0000","last_peered":"2024-08-27T03:56:35.312150+0000","last_clean":"2024-08-27T03:56:35.312150+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:56:35.312150+0000","last_undegraded":"2024-08-27T03:56:35.312150+0000","last_fullsized":"2024-08-27T03:56:35.312150+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294519+0000","last_change":"2024-08-27T02:50:55.778021+0000","last_active":"2024-08-27T03:55:45.294519+0000","last_peered":"2024-08-27T03:55:45.294519+0000","last_clean":"2024-08-27T03:55:45.294519+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:55:45.294519+0000","last_undegraded":"2024-08-27T03:55:45.294519+0000","last_fullsized":"2024-08-27T03:55:45.294519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:18:53.906397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.326804+0000","last_change":"2024-08-27T02:50:51.715619+0000","last_active":"2024-08-27T03:57:35.326804+0000","last_peered":"2024-08-27T03:57:35.326804+0000","last_clean":"2024-08-27T03:57:35.326804+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:57:35.326804+0000","last_undegraded":"2024-08-27T03:57:35.326804+0000","last_fullsized":"2024-08-27T03:57:35.326804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:22:37.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300942+0000","last_change":"2024-08-27T02:46:49.677851+0000","last_active":"2024-08-27T03:56:10.300942+0000","last_peered":"2024-08-27T03:56:10.300942+0000","last_clean":"2024-08-27T03:56:10.300942+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:56:10.300942+0000","last_undegraded":"2024-08-27T03:56:10.300942+0000","last_fullsized":"2024-08-27T03:56:10.300942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:32.601632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:34.887556+0000","last_change":"2024-08-27T03:10:45.277501+0000","last_active":"2024-08-27T03:56:34.887556+0000","last_peered":"2024-08-27T03:56:34.887556+0000","last_clean":"2024-08-27T03:56:34.887556+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:56:34.887556+0000","last_undegraded":"2024-08-27T03:56:34.887556+0000","last_fullsized":"2024-08-27T03:56:34.887556+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290804+0000","last_change":"2024-08-27T02:50:55.775204+0000","last_active":"2024-08-27T03:55:30.290804+0000","last_peered":"2024-08-27T03:55:30.290804+0000","last_clean":"2024-08-27T03:55:30.290804+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:55:30.290804+0000","last_undegraded":"2024-08-27T03:55:30.290804+0000","last_fullsized":"2024-08-27T03:55:30.290804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:27:44.097101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'6","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.745784+0000","last_change":"2024-08-27T02:50:51.712535+0000","last_active":"2024-08-27T03:58:29.745784+0000","last_peered":"2024-08-27T03:58:29.745784+0000","last_clean":"2024-08-27T03:58:29.745784+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:58:29.745784+0000","last_undegraded":"2024-08-27T03:58:29.745784+0000","last_fullsized":"2024-08-27T03:58:29.745784+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:06.145410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.461503+0000","last_change":"2024-08-27T02:46:49.657230+0000","last_active":"2024-08-27T03:56:10.461503+0000","last_peered":"2024-08-27T03:56:10.461503+0000","last_clean":"2024-08-27T03:56:10.461503+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:56:10.461503+0000","last_undegraded":"2024-08-27T03:56:10.461503+0000","last_fullsized":"2024-08-27T03:56:10.461503+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:35:31.912789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:51.091460+0000","last_change":"2024-08-27T03:10:45.304634+0000","last_active":"2024-08-27T03:56:51.091460+0000","last_peered":"2024-08-27T03:56:51.091460+0000","last_clean":"2024-08-27T03:56:51.091460+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:56:51.091460+0000","last_undegraded":"2024-08-27T03:56:51.091460+0000","last_fullsized":"2024-08-27T03:56:51.091460+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302531+0000","last_change":"2024-08-27T02:50:55.800079+0000","last_active":"2024-08-27T03:55:55.302531+0000","last_peered":"2024-08-27T03:55:55.302531+0000","last_clean":"2024-08-27T03:55:55.302531+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:55:55.302531+0000","last_undegraded":"2024-08-27T03:55:55.302531+0000","last_fullsized":"2024-08-27T03:55:55.302531+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:24:12.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.878104+0000","last_change":"2024-08-27T02:50:51.722487+0000","last_active":"2024-08-27T03:55:54.878104+0000","last_peered":"2024-08-27T03:55:54.878104+0000","last_clean":"2024-08-27T03:55:54.878104+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:55:54.878104+0000","last_undegraded":"2024-08-27T03:55:54.878104+0000","last_fullsized":"2024-08-27T03:55:54.878104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:03.625739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302418+0000","last_change":"2024-08-27T02:46:49.670647+0000","last_active":"2024-08-27T03:55:55.302418+0000","last_peered":"2024-08-27T03:55:55.302418+0000","last_clean":"2024-08-27T03:55:55.302418+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:55:55.302418+0000","last_undegraded":"2024-08-27T03:55:55.302418+0000","last_fullsized":"2024-08-27T03:55:55.302418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:21:10.983060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.102740+0000","last_change":"2024-08-27T03:10:45.294675+0000","last_active":"2024-08-27T03:56:35.102740+0000","last_peered":"2024-08-27T03:56:35.102740+0000","last_clean":"2024-08-27T03:56:35.102740+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:56:35.102740+0000","last_undegraded":"2024-08-27T03:56:35.102740+0000","last_fullsized":"2024-08-27T03:56:35.102740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093451+0000","last_change":"2024-08-27T02:50:55.767291+0000","last_active":"2024-08-27T03:55:55.093451+0000","last_peered":"2024-08-27T03:55:55.093451+0000","last_clean":"2024-08-27T03:55:55.093451+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:55:55.093451+0000","last_undegraded":"2024-08-27T03:55:55.093451+0000","last_fullsized":"2024-08-27T03:55:55.093451+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:34.369306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.334012+0000","last_change":"2024-08-27T02:50:51.715173+0000","last_active":"2024-08-27T03:58:05.334012+0000","last_peered":"2024-08-27T03:58:05.334012+0000","last_clean":"2024-08-27T03:58:05.334012+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:58:05.334012+0000","last_undegraded":"2024-08-27T03:58:05.334012+0000","last_fullsized":"2024-08-27T03:58:05.334012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:01:41.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:36.072924+0000","last_change":"2024-08-27T02:46:49.659905+0000","last_active":"2024-08-27T03:55:36.072924+0000","last_peered":"2024-08-27T03:55:36.072924+0000","last_clean":"2024-08-27T03:55:36.072924+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:55:36.072924+0000","last_undegraded":"2024-08-27T03:55:36.072924+0000","last_fullsized":"2024-08-27T03:55:36.072924+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:42:58.919137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.080081+0000","last_change":"2024-08-27T03:10:45.302257+0000","last_active":"2024-08-27T03:56:15.080081+0000","last_peered":"2024-08-27T03:56:15.080081+0000","last_clean":"2024-08-27T03:56:15.080081+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:56:15.080081+0000","last_undegraded":"2024-08-27T03:56:15.080081+0000","last_fullsized":"2024-08-27T03:56:15.080081+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:49:38.342418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.039145+0000","last_change":"2024-08-27T02:50:55.776653+0000","last_active":"2024-08-27T03:58:30.039145+0000","last_peered":"2024-08-27T03:58:30.039145+0000","last_clean":"2024-08-27T03:58:30.039145+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:58:30.039145+0000","last_undegraded":"2024-08-27T03:58:30.039145+0000","last_fullsized":"2024-08-27T03:58:30.039145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:30:47.655678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292165+0000","last_change":"2024-08-27T02:50:51.712698+0000","last_active":"2024-08-27T03:55:15.292165+0000","last_peered":"2024-08-27T03:55:15.292165+0000","last_clean":"2024-08-27T03:55:15.292165+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:55:15.292165+0000","last_undegraded":"2024-08-27T03:55:15.292165+0000","last_fullsized":"2024-08-27T03:55:15.292165+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:54.805987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873157+0000","last_change":"2024-08-27T02:46:49.666166+0000","last_active":"2024-08-27T03:55:34.873157+0000","last_peered":"2024-08-27T03:55:34.873157+0000","last_clean":"2024-08-27T03:55:34.873157+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:55:34.873157+0000","last_undegraded":"2024-08-27T03:55:34.873157+0000","last_fullsized":"2024-08-27T03:55:34.873157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:59:52.040406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.302157+0000","last_change":"2024-08-27T03:10:45.289668+0000","last_active":"2024-08-27T03:56:15.302157+0000","last_peered":"2024-08-27T03:56:15.302157+0000","last_clean":"2024-08-27T03:56:15.302157+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:56:15.302157+0000","last_undegraded":"2024-08-27T03:56:15.302157+0000","last_fullsized":"2024-08-27T03:56:15.302157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:24.929800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.868290+0000","last_change":"2024-08-27T02:50:55.777558+0000","last_active":"2024-08-27T03:55:14.868290+0000","last_peered":"2024-08-27T03:55:14.868290+0000","last_clean":"2024-08-27T03:55:14.868290+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:55:14.868290+0000","last_undegraded":"2024-08-27T03:55:14.868290+0000","last_fullsized":"2024-08-27T03:55:14.868290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:14:52.030335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'7","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.326696+0000","last_change":"2024-08-27T02:50:51.718684+0000","last_active":"2024-08-27T03:57:35.326696+0000","last_peered":"2024-08-27T03:57:35.326696+0000","last_clean":"2024-08-27T03:57:35.326696+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:57:35.326696+0000","last_undegraded":"2024-08-27T03:57:35.326696+0000","last_fullsized":"2024-08-27T03:57:35.326696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:58:00.220312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.088488+0000","last_change":"2024-08-27T02:46:49.666930+0000","last_active":"2024-08-27T03:55:35.088488+0000","last_peered":"2024-08-27T03:55:35.088488+0000","last_clean":"2024-08-27T03:55:35.088488+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:55:35.088488+0000","last_undegraded":"2024-08-27T03:55:35.088488+0000","last_fullsized":"2024-08-27T03:55:35.088488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:46.255173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.307001+0000","last_change":"2024-08-27T03:10:45.281649+0000","last_active":"2024-08-27T03:56:35.307001+0000","last_peered":"2024-08-27T03:56:35.307001+0000","last_clean":"2024-08-27T03:56:35.307001+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:56:35.307001+0000","last_undegraded":"2024-08-27T03:56:35.307001+0000","last_fullsized":"2024-08-27T03:56:35.307001+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.480110+0000","last_change":"2024-08-27T02:50:55.790207+0000","last_active":"2024-08-27T03:57:35.480110+0000","last_peered":"2024-08-27T03:57:35.480110+0000","last_clean":"2024-08-27T03:57:35.480110+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:57:35.480110+0000","last_undegraded":"2024-08-27T03:57:35.480110+0000","last_fullsized":"2024-08-27T03:57:35.480110+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:29.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:26.070538+0000","last_change":"2024-08-27T02:50:51.740655+0000","last_active":"2024-08-27T03:55:26.070538+0000","last_peered":"2024-08-27T03:55:26.070538+0000","last_clean":"2024-08-27T03:55:26.070538+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:55:26.070538+0000","last_undegraded":"2024-08-27T03:55:26.070538+0000","last_fullsized":"2024-08-27T03:55:26.070538+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.497115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.453720+0000","last_change":"2024-08-27T02:46:49.638555+0000","last_active":"2024-08-27T03:55:35.453720+0000","last_peered":"2024-08-27T03:55:35.453720+0000","last_clean":"2024-08-27T03:55:35.453720+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:55:35.453720+0000","last_undegraded":"2024-08-27T03:55:35.453720+0000","last_fullsized":"2024-08-27T03:55:35.453720+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:10.855684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:45.314631+0000","last_change":"2024-08-27T03:10:45.290709+0000","last_active":"2024-08-27T03:56:45.314631+0000","last_peered":"2024-08-27T03:56:45.314631+0000","last_clean":"2024-08-27T03:56:45.314631+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:56:45.314631+0000","last_undegraded":"2024-08-27T03:56:45.314631+0000","last_fullsized":"2024-08-27T03:56:45.314631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.116553+0000","last_change":"2024-08-27T02:50:55.772109+0000","last_active":"2024-08-27T03:57:35.116553+0000","last_peered":"2024-08-27T03:57:35.116553+0000","last_clean":"2024-08-27T03:57:35.116553+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:57:35.116553+0000","last_undegraded":"2024-08-27T03:57:35.116553+0000","last_fullsized":"2024-08-27T03:57:35.116553+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:34.257753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.452715+0000","last_change":"2024-08-27T02:50:51.705872+0000","last_active":"2024-08-27T03:55:30.452715+0000","last_peered":"2024-08-27T03:55:30.452715+0000","last_clean":"2024-08-27T03:55:30.452715+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:55:30.452715+0000","last_undegraded":"2024-08-27T03:55:30.452715+0000","last_fullsized":"2024-08-27T03:55:30.452715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:55.217217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290820+0000","last_change":"2024-08-27T02:46:49.667612+0000","last_active":"2024-08-27T03:55:10.290820+0000","last_peered":"2024-08-27T03:55:10.290820+0000","last_clean":"2024-08-27T03:55:10.290820+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:55:10.290820+0000","last_undegraded":"2024-08-27T03:55:10.290820+0000","last_fullsized":"2024-08-27T03:55:10.290820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:51:31.706212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'314","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.926129+0000","last_change":"2024-08-27T03:58:50.926129+0000","last_active":"2024-08-27T03:58:50.926129+0000","last_peered":"2024-08-27T03:58:50.926129+0000","last_clean":"2024-08-27T03:58:50.926129+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:50.926129+0000","last_undegraded":"2024-08-27T03:58:50.926129+0000","last_fullsized":"2024-08-27T03:58:50.926129+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'314","last_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_deep_scrub":"267'314","last_deep_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.925876+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:38:38.135877+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291497,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":22191,"num_write":1009,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'457","reported_seq":2153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.682880+0000","last_change":"2024-08-27T02:31:06.459589+0000","last_active":"2024-08-27T03:56:42.682880+0000","last_peered":"2024-08-27T03:56:42.682880+0000","last_clean":"2024-08-27T03:56:42.682880+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:56:42.682880+0000","last_undegraded":"2024-08-27T03:56:42.682880+0000","last_fullsized":"2024-08-27T03:56:42.682880+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'361","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.144884+0000","last_change":"2024-08-27T03:58:43.144884+0000","last_active":"2024-08-27T03:58:43.144884+0000","last_peered":"2024-08-27T03:58:43.144884+0000","last_clean":"2024-08-27T03:58:43.144884+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:43.144884+0000","last_undegraded":"2024-08-27T03:58:43.144884+0000","last_fullsized":"2024-08-27T03:58:43.144884+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.144636+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:39.143444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424748,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":39942,"num_write":1277,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'826","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.895174+0000","last_change":"2024-08-27T03:58:54.895174+0000","last_active":"2024-08-27T03:58:54.895174+0000","last_peered":"2024-08-27T03:58:54.895174+0000","last_clean":"2024-08-27T03:58:54.895174+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:58:54.895174+0000","last_undegraded":"2024-08-27T03:58:54.895174+0000","last_fullsized":"2024-08-27T03:58:54.895174+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.894988+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:39:10.133666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'282","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.368824+0000","last_change":"2024-08-27T03:58:43.368824+0000","last_active":"2024-08-27T03:58:43.368824+0000","last_peered":"2024-08-27T03:58:43.368824+0000","last_clean":"2024-08-27T03:58:43.368824+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:43.368824+0000","last_undegraded":"2024-08-27T03:58:43.368824+0000","last_fullsized":"2024-08-27T03:58:43.368824+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'282","last_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_deep_scrub":"267'282","last_deep_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.368595+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:28.412078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":449,"num_write":920,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1216","reported_seq":2731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.096638+0000","last_change":"2024-08-27T02:31:06.464864+0000","last_active":"2024-08-27T03:56:10.096638+0000","last_peered":"2024-08-27T03:56:10.096638+0000","last_clean":"2024-08-27T03:56:10.096638+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:56:10.096638+0000","last_undegraded":"2024-08-27T03:56:10.096638+0000","last_fullsized":"2024-08-27T03:56:10.096638+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'320","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.810209+0000","last_change":"2024-08-27T03:58:47.810209+0000","last_active":"2024-08-27T03:58:47.810209+0000","last_peered":"2024-08-27T03:58:47.810209+0000","last_clean":"2024-08-27T03:58:47.810209+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:47.810209+0000","last_undegraded":"2024-08-27T03:58:47.810209+0000","last_fullsized":"2024-08-27T03:58:47.810209+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.809968+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:11:53.480777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":3871,"num_write":1091,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'481","reported_seq":2144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.508513+0000","last_change":"2024-08-27T03:58:52.508513+0000","last_active":"2024-08-27T03:58:52.508513+0000","last_peered":"2024-08-27T03:58:52.508513+0000","last_clean":"2024-08-27T03:58:52.508513+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:58:52.508513+0000","last_undegraded":"2024-08-27T03:58:52.508513+0000","last_fullsized":"2024-08-27T03:58:52.508513+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.508324+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:43.578410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'389","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.872905+0000","last_change":"2024-08-27T03:58:49.872905+0000","last_active":"2024-08-27T03:58:49.872905+0000","last_peered":"2024-08-27T03:58:49.872905+0000","last_clean":"2024-08-27T03:58:49.872905+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:49.872905+0000","last_undegraded":"2024-08-27T03:58:49.872905+0000","last_fullsized":"2024-08-27T03:58:49.872905+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.872597+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:20.188046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493421,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":17279,"num_write":1203,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'494","reported_seq":2083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.643833+0000","last_change":"2024-08-27T03:58:50.643833+0000","last_active":"2024-08-27T03:58:50.643833+0000","last_peered":"2024-08-27T03:58:50.643833+0000","last_clean":"2024-08-27T03:58:50.643833+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:58:50.643833+0000","last_undegraded":"2024-08-27T03:58:50.643833+0000","last_fullsized":"2024-08-27T03:58:50.643833+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.643652+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:41:35.221530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'334","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.751411+0000","last_change":"2024-08-27T03:58:49.751411+0000","last_active":"2024-08-27T03:58:49.751411+0000","last_peered":"2024-08-27T03:58:49.751411+0000","last_clean":"2024-08-27T03:58:49.751411+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:49.751411+0000","last_undegraded":"2024-08-27T03:58:49.751411+0000","last_fullsized":"2024-08-27T03:58:49.751411+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.751052+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:58:46.654336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399097,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":18975,"num_write":950,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1781,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.102975+0000","last_change":"2024-08-27T02:31:06.464775+0000","last_active":"2024-08-27T03:56:35.102975+0000","last_peered":"2024-08-27T03:56:35.102975+0000","last_clean":"2024-08-27T03:56:35.102975+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:56:35.102975+0000","last_undegraded":"2024-08-27T03:56:35.102975+0000","last_fullsized":"2024-08-27T03:56:35.102975+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'354","reported_seq":1000,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.571939+0000","last_change":"2024-08-27T03:58:40.571939+0000","last_active":"2024-08-27T03:58:40.571939+0000","last_peered":"2024-08-27T03:58:40.571939+0000","last_clean":"2024-08-27T03:58:40.571939+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:40.571939+0000","last_undegraded":"2024-08-27T03:58:40.571939+0000","last_fullsized":"2024-08-27T03:58:40.571939+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.571595+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:38.897362+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5643582,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":18874,"num_write":1149,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'903","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.999999+0000","last_change":"2024-08-27T02:31:06.441463+0000","last_active":"2024-08-27T03:58:02.999999+0000","last_peered":"2024-08-27T03:58:02.999999+0000","last_clean":"2024-08-27T03:58:02.999999+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:02.999999+0000","last_undegraded":"2024-08-27T03:58:02.999999+0000","last_fullsized":"2024-08-27T03:58:02.999999+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'344","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.157025+0000","last_change":"2024-08-27T03:58:47.157025+0000","last_active":"2024-08-27T03:58:47.157025+0000","last_peered":"2024-08-27T03:58:47.157025+0000","last_clean":"2024-08-27T03:58:47.157025+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:47.157025+0000","last_undegraded":"2024-08-27T03:58:47.157025+0000","last_fullsized":"2024-08-27T03:58:47.157025+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.156774+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:35.049139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550512,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":6557,"num_write":1048,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'921","reported_seq":2469,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.495835+0000","last_change":"2024-08-27T03:58:48.495835+0000","last_active":"2024-08-27T03:58:48.495835+0000","last_peered":"2024-08-27T03:58:48.495835+0000","last_clean":"2024-08-27T03:58:48.495835+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:58:48.495835+0000","last_undegraded":"2024-08-27T03:58:48.495835+0000","last_fullsized":"2024-08-27T03:58:48.495835+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'921","last_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_deep_scrub":"267'921","last_deep_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.495658+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":900,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:05.944519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'771","reported_seq":2540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.680623+0000","last_change":"2024-08-27T03:58:54.680623+0000","last_active":"2024-08-27T03:58:54.680623+0000","last_peered":"2024-08-27T03:58:54.680623+0000","last_clean":"2024-08-27T03:58:54.680623+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:58:54.680623+0000","last_undegraded":"2024-08-27T03:58:54.680623+0000","last_fullsized":"2024-08-27T03:58:54.680623+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.680350+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:58.085130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2268,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.859587+0000","last_change":"2024-08-27T03:58:47.859587+0000","last_active":"2024-08-27T03:58:47.859587+0000","last_peered":"2024-08-27T03:58:47.859587+0000","last_clean":"2024-08-27T03:58:47.859587+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:47.859587+0000","last_undegraded":"2024-08-27T03:58:47.859587+0000","last_fullsized":"2024-08-27T03:58:47.859587+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.859361+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:30.873158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":9006,"num_write":957,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'790","reported_seq":2426,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.887806+0000","last_change":"2024-08-27T03:58:51.887806+0000","last_active":"2024-08-27T03:58:51.887806+0000","last_peered":"2024-08-27T03:58:51.887806+0000","last_clean":"2024-08-27T03:58:51.887806+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:58:51.887806+0000","last_undegraded":"2024-08-27T03:58:51.887806+0000","last_fullsized":"2024-08-27T03:58:51.887806+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.887607+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:17.606029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'361","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.731951+0000","last_change":"2024-08-27T03:58:44.731951+0000","last_active":"2024-08-27T03:58:44.731951+0000","last_peered":"2024-08-27T03:58:44.731951+0000","last_clean":"2024-08-27T03:58:44.731951+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:44.731951+0000","last_undegraded":"2024-08-27T03:58:44.731951+0000","last_fullsized":"2024-08-27T03:58:44.731951+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.731678+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:19.085584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":653,"num_read_kb":8370,"num_write":1179,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'489","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.815492+0000","last_change":"2024-08-27T03:58:53.815492+0000","last_active":"2024-08-27T03:58:53.815492+0000","last_peered":"2024-08-27T03:58:53.815492+0000","last_clean":"2024-08-27T03:58:53.815492+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:58:53.815492+0000","last_undegraded":"2024-08-27T03:58:53.815492+0000","last_fullsized":"2024-08-27T03:58:53.815492+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'489","last_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_deep_scrub":"267'489","last_deep_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.815307+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:09.901922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'337","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.776413+0000","last_change":"2024-08-27T03:58:41.776413+0000","last_active":"2024-08-27T03:58:41.776413+0000","last_peered":"2024-08-27T03:58:41.776413+0000","last_clean":"2024-08-27T03:58:41.776413+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:41.776413+0000","last_undegraded":"2024-08-27T03:58:41.776413+0000","last_fullsized":"2024-08-27T03:58:41.776413+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.776192+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:09.715672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569152,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":11498,"num_write":1125,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'685","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.544933+0000","last_change":"2024-08-27T03:58:45.544933+0000","last_active":"2024-08-27T03:58:45.544933+0000","last_peered":"2024-08-27T03:58:45.544933+0000","last_clean":"2024-08-27T03:58:45.544933+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:45.544933+0000","last_undegraded":"2024-08-27T03:58:45.544933+0000","last_fullsized":"2024-08-27T03:58:45.544933+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'685","last_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_deep_scrub":"267'685","last_deep_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.544744+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:02.504356+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'369","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.683165+0000","last_change":"2024-08-27T03:58:41.683165+0000","last_active":"2024-08-27T03:58:41.683165+0000","last_peered":"2024-08-27T03:58:41.683165+0000","last_clean":"2024-08-27T03:58:41.683165+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:41.683165+0000","last_undegraded":"2024-08-27T03:58:41.683165+0000","last_fullsized":"2024-08-27T03:58:41.683165+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.682887+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:10:56.014716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":144736,"num_write":1195,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'478","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.516219+0000","last_change":"2024-08-27T03:58:47.516219+0000","last_active":"2024-08-27T03:58:47.516219+0000","last_peered":"2024-08-27T03:58:47.516219+0000","last_clean":"2024-08-27T03:58:47.516219+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:58:47.516219+0000","last_undegraded":"2024-08-27T03:58:47.516219+0000","last_fullsized":"2024-08-27T03:58:47.516219+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.516030+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:54.405917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'335","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.141517+0000","last_change":"2024-08-27T03:58:45.141517+0000","last_active":"2024-08-27T03:58:45.141517+0000","last_peered":"2024-08-27T03:58:45.141517+0000","last_clean":"2024-08-27T03:58:45.141517+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:45.141517+0000","last_undegraded":"2024-08-27T03:58:45.141517+0000","last_fullsized":"2024-08-27T03:58:45.141517+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.141297+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:20.006199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":571,"num_read_kb":47085,"num_write":1065,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'764","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090961+0000","last_change":"2024-08-27T02:31:06.457069+0000","last_active":"2024-08-27T03:55:45.090961+0000","last_peered":"2024-08-27T03:55:45.090961+0000","last_clean":"2024-08-27T03:55:45.090961+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:55:45.090961+0000","last_undegraded":"2024-08-27T03:55:45.090961+0000","last_fullsized":"2024-08-27T03:55:45.090961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:48.523132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'335","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.388100+0000","last_change":"2024-08-27T03:58:45.388100+0000","last_active":"2024-08-27T03:58:45.388100+0000","last_peered":"2024-08-27T03:58:45.388100+0000","last_clean":"2024-08-27T03:58:45.388100+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:45.388100+0000","last_undegraded":"2024-08-27T03:58:45.388100+0000","last_fullsized":"2024-08-27T03:58:45.388100+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.387860+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:01.932292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14802,"num_write":998,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.850365+0000","last_change":"2024-08-27T02:31:14.508871+0000","last_active":"2024-08-27T03:56:44.850365+0000","last_peered":"2024-08-27T03:56:44.850365+0000","last_clean":"2024-08-27T03:56:44.850365+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:56:44.850365+0000","last_undegraded":"2024-08-27T03:56:44.850365+0000","last_fullsized":"2024-08-27T03:56:44.850365+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:53:01.791364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'629","reported_seq":2356,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.184869+0000","last_change":"2024-08-27T03:58:50.184869+0000","last_active":"2024-08-27T03:58:50.184869+0000","last_peered":"2024-08-27T03:58:50.184869+0000","last_clean":"2024-08-27T03:58:50.184869+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:50.184869+0000","last_undegraded":"2024-08-27T03:58:50.184869+0000","last_fullsized":"2024-08-27T03:58:50.184869+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'629","last_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_deep_scrub":"267'629","last_deep_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.184685+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:30.419124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4069,"num_omap_keys":16,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'362","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.829663+0000","last_change":"2024-08-27T03:58:48.829663+0000","last_active":"2024-08-27T03:58:48.829663+0000","last_peered":"2024-08-27T03:58:48.829663+0000","last_clean":"2024-08-27T03:58:48.829663+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:48.829663+0000","last_undegraded":"2024-08-27T03:58:48.829663+0000","last_fullsized":"2024-08-27T03:58:48.829663+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.829448+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:32.990578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":48228,"num_write":1146,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875703+0000","last_change":"2024-08-27T02:31:08.475606+0000","last_active":"2024-08-27T03:55:44.875703+0000","last_peered":"2024-08-27T03:55:44.875703+0000","last_clean":"2024-08-27T03:55:44.875703+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:55:44.875703+0000","last_undegraded":"2024-08-27T03:55:44.875703+0000","last_fullsized":"2024-08-27T03:55:44.875703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:10.435910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'372","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.993826+0000","last_change":"2024-08-27T02:31:10.474061+0000","last_active":"2024-08-27T03:58:30.993826+0000","last_peered":"2024-08-27T03:58:30.993826+0000","last_clean":"2024-08-27T03:58:30.993826+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:30.993826+0000","last_undegraded":"2024-08-27T03:58:30.993826+0000","last_fullsized":"2024-08-27T03:58:30.993826+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:14.597433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45479,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1191,"num_write":460,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.301263+0000","last_change":"2024-08-27T02:31:12.513470+0000","last_active":"2024-08-27T03:55:50.301263+0000","last_peered":"2024-08-27T03:55:50.301263+0000","last_clean":"2024-08-27T03:55:50.301263+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:55:50.301263+0000","last_undegraded":"2024-08-27T03:55:50.301263+0000","last_fullsized":"2024-08-27T03:55:50.301263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:25:27.177108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'139","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.882775+0000","last_change":"2024-08-27T02:31:14.508729+0000","last_active":"2024-08-27T03:56:14.882775+0000","last_peered":"2024-08-27T03:56:14.882775+0000","last_clean":"2024-08-27T03:56:14.882775+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:56:14.882775+0000","last_undegraded":"2024-08-27T03:56:14.882775+0000","last_fullsized":"2024-08-27T03:56:14.882775+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'818","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.767544+0000","last_change":"2024-08-27T03:58:51.767544+0000","last_active":"2024-08-27T03:58:51.767544+0000","last_peered":"2024-08-27T03:58:51.767544+0000","last_clean":"2024-08-27T03:58:51.767544+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:58:51.767544+0000","last_undegraded":"2024-08-27T03:58:51.767544+0000","last_fullsized":"2024-08-27T03:58:51.767544+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.767367+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:30:16.877533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'315","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.405258+0000","last_change":"2024-08-27T03:58:40.405258+0000","last_active":"2024-08-27T03:58:40.405258+0000","last_peered":"2024-08-27T03:58:40.405258+0000","last_clean":"2024-08-27T03:58:40.405258+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:40.405258+0000","last_undegraded":"2024-08-27T03:58:40.405258+0000","last_fullsized":"2024-08-27T03:58:40.405258+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.404999+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:33:03.889980+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":392,"num_read_kb":13675,"num_write":949,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.892074+0000","last_change":"2024-08-27T02:31:08.444125+0000","last_active":"2024-08-27T03:55:34.892074+0000","last_peered":"2024-08-27T03:55:34.892074+0000","last_clean":"2024-08-27T03:55:34.892074+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:55:34.892074+0000","last_undegraded":"2024-08-27T03:55:34.892074+0000","last_fullsized":"2024-08-27T03:55:34.892074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:50.658905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'118","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.091053+0000","last_change":"2024-08-27T02:31:10.463462+0000","last_active":"2024-08-27T03:55:45.091053+0000","last_peered":"2024-08-27T03:55:45.091053+0000","last_clean":"2024-08-27T03:55:45.091053+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:55:45.091053+0000","last_undegraded":"2024-08-27T03:55:45.091053+0000","last_fullsized":"2024-08-27T03:55:45.091053+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:05.726630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.092259+0000","last_change":"2024-08-27T02:31:12.524180+0000","last_active":"2024-08-27T03:55:50.092259+0000","last_peered":"2024-08-27T03:55:50.092259+0000","last_clean":"2024-08-27T03:55:50.092259+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:55:50.092259+0000","last_undegraded":"2024-08-27T03:55:50.092259+0000","last_fullsized":"2024-08-27T03:55:50.092259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:17:50.877434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'140","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.833370+0000","last_change":"2024-08-27T02:31:14.511765+0000","last_active":"2024-08-27T03:56:44.833370+0000","last_peered":"2024-08-27T03:56:44.833370+0000","last_clean":"2024-08-27T03:56:44.833370+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:56:44.833370+0000","last_undegraded":"2024-08-27T03:56:44.833370+0000","last_fullsized":"2024-08-27T03:56:44.833370+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.414992+0000","last_change":"2024-08-27T03:58:48.414992+0000","last_active":"2024-08-27T03:58:48.414992+0000","last_peered":"2024-08-27T03:58:48.414992+0000","last_clean":"2024-08-27T03:58:48.414992+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:58:48.414992+0000","last_undegraded":"2024-08-27T03:58:48.414992+0000","last_fullsized":"2024-08-27T03:58:48.414992+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.414803+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:21.445680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'379","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.593093+0000","last_change":"2024-08-27T03:58:37.593093+0000","last_active":"2024-08-27T03:58:37.593093+0000","last_peered":"2024-08-27T03:58:37.593093+0000","last_clean":"2024-08-27T03:58:37.593093+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:37.593093+0000","last_undegraded":"2024-08-27T03:58:37.593093+0000","last_fullsized":"2024-08-27T03:58:37.593093+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.592948+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:31.585133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":34086,"num_write":1252,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727614+0000","last_change":"2024-08-27T02:31:08.475047+0000","last_active":"2024-08-27T03:58:28.727614+0000","last_peered":"2024-08-27T03:58:28.727614+0000","last_clean":"2024-08-27T03:58:28.727614+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:58:28.727614+0000","last_undegraded":"2024-08-27T03:58:28.727614+0000","last_fullsized":"2024-08-27T03:58:28.727614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:00:07.644027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'154","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.068764+0000","last_change":"2024-08-27T02:31:10.464314+0000","last_active":"2024-08-27T03:55:25.068764+0000","last_peered":"2024-08-27T03:55:25.068764+0000","last_clean":"2024-08-27T03:55:25.068764+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:55:25.068764+0000","last_undegraded":"2024-08-27T03:55:25.068764+0000","last_fullsized":"2024-08-27T03:55:25.068764+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:19.772117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'698","reported_seq":2536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.991256+0000","last_change":"2024-08-27T02:31:12.509703+0000","last_active":"2024-08-27T03:58:28.991256+0000","last_peered":"2024-08-27T03:58:28.991256+0000","last_clean":"2024-08-27T03:58:28.991256+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:58:28.991256+0000","last_undegraded":"2024-08-27T03:58:28.991256+0000","last_fullsized":"2024-08-27T03:58:28.991256+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":601,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:41.710475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'177","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.975837+0000","last_change":"2024-08-27T02:31:15.025741+0000","last_active":"2024-08-27T03:58:02.975837+0000","last_peered":"2024-08-27T03:58:02.975837+0000","last_clean":"2024-08-27T03:58:02.975837+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:58:02.975837+0000","last_undegraded":"2024-08-27T03:58:02.975837+0000","last_fullsized":"2024-08-27T03:58:02.975837+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'586","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.205600+0000","last_change":"2024-08-27T03:58:52.205600+0000","last_active":"2024-08-27T03:58:52.205600+0000","last_peered":"2024-08-27T03:58:52.205600+0000","last_clean":"2024-08-27T03:58:52.205600+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:58:52.205600+0000","last_undegraded":"2024-08-27T03:58:52.205600+0000","last_fullsized":"2024-08-27T03:58:52.205600+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'586","last_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_deep_scrub":"267'586","last_deep_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.205406+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:50:44.375635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'340","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.757370+0000","last_change":"2024-08-27T03:58:43.757370+0000","last_active":"2024-08-27T03:58:43.757370+0000","last_peered":"2024-08-27T03:58:43.757370+0000","last_clean":"2024-08-27T03:58:43.757370+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:43.757370+0000","last_undegraded":"2024-08-27T03:58:43.757370+0000","last_fullsized":"2024-08-27T03:58:43.757370+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.757154+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:26.623631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":443,"num_read_kb":7480,"num_write":1117,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875767+0000","last_change":"2024-08-27T02:31:08.476876+0000","last_active":"2024-08-27T03:55:44.875767+0000","last_peered":"2024-08-27T03:55:44.875767+0000","last_clean":"2024-08-27T03:55:44.875767+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:55:44.875767+0000","last_undegraded":"2024-08-27T03:55:44.875767+0000","last_fullsized":"2024-08-27T03:55:44.875767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:49:16.770918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'290","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.333168+0000","last_change":"2024-08-27T02:31:10.638091+0000","last_active":"2024-08-27T03:58:30.333168+0000","last_peered":"2024-08-27T03:58:30.333168+0000","last_clean":"2024-08-27T03:58:30.333168+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:58:30.333168+0000","last_undegraded":"2024-08-27T03:58:30.333168+0000","last_fullsized":"2024-08-27T03:58:30.333168+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:14.620860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'731","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.163701+0000","last_change":"2024-08-27T02:31:12.505687+0000","last_active":"2024-08-27T03:58:31.163701+0000","last_peered":"2024-08-27T03:58:31.163701+0000","last_clean":"2024-08-27T03:58:31.163701+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:58:31.163701+0000","last_undegraded":"2024-08-27T03:58:31.163701+0000","last_fullsized":"2024-08-27T03:58:31.163701+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:36:59.690511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1269","reported_seq":2839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.726782+0000","last_change":"2024-08-27T03:58:50.726782+0000","last_active":"2024-08-27T03:58:50.726782+0000","last_peered":"2024-08-27T03:58:50.726782+0000","last_clean":"2024-08-27T03:58:50.726782+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:58:50.726782+0000","last_undegraded":"2024-08-27T03:58:50.726782+0000","last_fullsized":"2024-08-27T03:58:50.726782+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1269","last_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_deep_scrub":"267'1269","last_deep_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.726573+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":1200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:40:04.847159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'352","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.902156+0000","last_change":"2024-08-27T03:58:43.902156+0000","last_active":"2024-08-27T03:58:43.902156+0000","last_peered":"2024-08-27T03:58:43.902156+0000","last_clean":"2024-08-27T03:58:43.902156+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:43.902156+0000","last_undegraded":"2024-08-27T03:58:43.902156+0000","last_fullsized":"2024-08-27T03:58:43.902156+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.901882+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:44.473839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":34000,"num_write":1087,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:40.298359+0000","last_change":"2024-08-27T02:31:08.468116+0000","last_active":"2024-08-27T03:55:40.298359+0000","last_peered":"2024-08-27T03:55:40.298359+0000","last_clean":"2024-08-27T03:55:40.298359+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:55:40.298359+0000","last_undegraded":"2024-08-27T03:55:40.298359+0000","last_fullsized":"2024-08-27T03:55:40.298359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:45:43.021123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'399","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.277174+0000","last_change":"2024-08-27T02:31:10.633487+0000","last_active":"2024-08-27T03:58:31.277174+0000","last_peered":"2024-08-27T03:58:31.277174+0000","last_clean":"2024-08-27T03:58:31.277174+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:58:31.277174+0000","last_undegraded":"2024-08-27T03:58:31.277174+0000","last_fullsized":"2024-08-27T03:58:31.277174+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:27:37.705984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44175,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":1186,"num_write":474,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:31.058784+0000","last_change":"2024-08-27T02:31:12.508561+0000","last_active":"2024-08-27T03:54:31.058784+0000","last_peered":"2024-08-27T03:54:31.058784+0000","last_clean":"2024-08-27T03:54:31.058784+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:54:31.058784+0000","last_undegraded":"2024-08-27T03:54:31.058784+0000","last_fullsized":"2024-08-27T03:54:31.058784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:32:48.985390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'588","reported_seq":1429,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.941080+0000","last_change":"2024-08-27T02:31:14.510230+0000","last_active":"2024-08-27T03:58:03.941080+0000","last_peered":"2024-08-27T03:58:03.941080+0000","last_clean":"2024-08-27T03:58:03.941080+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:58:03.941080+0000","last_undegraded":"2024-08-27T03:58:03.941080+0000","last_fullsized":"2024-08-27T03:58:03.941080+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1459","reported_seq":2962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.678164+0000","last_change":"2024-08-27T03:58:50.678164+0000","last_active":"2024-08-27T03:58:50.678164+0000","last_peered":"2024-08-27T03:58:50.678164+0000","last_clean":"2024-08-27T03:58:50.678164+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:58:50.678164+0000","last_undegraded":"2024-08-27T03:58:50.678164+0000","last_fullsized":"2024-08-27T03:58:50.678164+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1459","last_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_deep_scrub":"267'1459","last_deep_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.677969+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:05:44.968990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'373","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.897914+0000","last_change":"2024-08-27T03:58:40.897763+0000","last_active":"2024-08-27T03:58:40.897914+0000","last_peered":"2024-08-27T03:58:40.897914+0000","last_clean":"2024-08-27T03:58:40.897914+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:40.897914+0000","last_undegraded":"2024-08-27T03:58:40.897914+0000","last_fullsized":"2024-08-27T03:58:40.897914+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.897535+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:28:11.789719+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400081,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":644,"num_read_kb":2850,"num_write":1271,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.446962+0000","last_change":"2024-08-27T03:58:50.446962+0000","last_active":"2024-08-27T03:58:50.446962+0000","last_peered":"2024-08-27T03:58:50.446962+0000","last_clean":"2024-08-27T03:58:50.446962+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:58:50.446962+0000","last_undegraded":"2024-08-27T03:58:50.446962+0000","last_fullsized":"2024-08-27T03:58:50.446962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.446779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:37.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'307","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.551627+0000","last_change":"2024-08-27T02:31:10.465779+0000","last_active":"2024-08-27T03:58:29.551627+0000","last_peered":"2024-08-27T03:58:29.551627+0000","last_clean":"2024-08-27T03:58:29.551627+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:58:29.551627+0000","last_undegraded":"2024-08-27T03:58:29.551627+0000","last_fullsized":"2024-08-27T03:58:29.551627+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900276+0000","last_change":"2024-08-27T02:31:12.506224+0000","last_active":"2024-08-27T03:56:09.900276+0000","last_peered":"2024-08-27T03:56:09.900276+0000","last_clean":"2024-08-27T03:56:09.900276+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:56:09.900276+0000","last_undegraded":"2024-08-27T03:56:09.900276+0000","last_fullsized":"2024-08-27T03:56:09.900276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:37.170525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2395","reported_seq":4230,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:51.601038+0000","last_change":"2024-08-27T02:31:14.514506+0000","last_active":"2024-08-27T03:57:51.601038+0000","last_peered":"2024-08-27T03:57:51.601038+0000","last_clean":"2024-08-27T03:57:51.601038+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:57:51.601038+0000","last_undegraded":"2024-08-27T03:57:51.601038+0000","last_fullsized":"2024-08-27T03:57:51.601038+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":2300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'442","reported_seq":1947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.728545+0000","last_change":"2024-08-27T03:58:46.728545+0000","last_active":"2024-08-27T03:58:46.728545+0000","last_peered":"2024-08-27T03:58:46.728545+0000","last_clean":"2024-08-27T03:58:46.728545+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:58:46.728545+0000","last_undegraded":"2024-08-27T03:58:46.728545+0000","last_fullsized":"2024-08-27T03:58:46.728545+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.728340+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:06.435241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'337","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.909461+0000","last_change":"2024-08-27T03:58:42.909307+0000","last_active":"2024-08-27T03:58:42.909461+0000","last_peered":"2024-08-27T03:58:42.909461+0000","last_clean":"2024-08-27T03:58:42.909461+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:42.909461+0000","last_undegraded":"2024-08-27T03:58:42.909461+0000","last_fullsized":"2024-08-27T03:58:42.909461+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.909045+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:53.647196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1998258,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":51263,"num_write":1130,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.501182+0000","last_change":"2024-08-27T03:58:52.501054+0000","last_active":"2024-08-27T03:58:52.501182+0000","last_peered":"2024-08-27T03:58:52.501182+0000","last_clean":"2024-08-27T03:58:52.501182+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:58:52.501182+0000","last_undegraded":"2024-08-27T03:58:52.501182+0000","last_fullsized":"2024-08-27T03:58:52.501182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.500871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:38.128581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'361","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.406263+0000","last_change":"2024-08-27T02:31:10.476799+0000","last_active":"2024-08-27T03:58:31.406263+0000","last_peered":"2024-08-27T03:58:31.406263+0000","last_clean":"2024-08-27T03:58:31.406263+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:58:31.406263+0000","last_undegraded":"2024-08-27T03:58:31.406263+0000","last_fullsized":"2024-08-27T03:58:31.406263+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:52:11.386500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":1205,"num_write":456,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'720","reported_seq":4951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.335657+0000","last_change":"2024-08-27T02:31:12.515783+0000","last_active":"2024-08-27T03:58:30.335657+0000","last_peered":"2024-08-27T03:58:30.335657+0000","last_clean":"2024-08-27T03:58:30.335657+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:58:30.335657+0000","last_undegraded":"2024-08-27T03:58:30.335657+0000","last_fullsized":"2024-08-27T03:58:30.335657+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:57.983153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'170","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.633450+0000","last_change":"2024-08-27T02:31:14.512105+0000","last_active":"2024-08-27T03:58:02.633450+0000","last_peered":"2024-08-27T03:58:02.633450+0000","last_clean":"2024-08-27T03:58:02.633450+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:58:02.633450+0000","last_undegraded":"2024-08-27T03:58:02.633450+0000","last_fullsized":"2024-08-27T03:58:02.633450+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:45:04.697202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'799","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.365595+0000","last_change":"2024-08-27T03:58:46.365457+0000","last_active":"2024-08-27T03:58:46.365595+0000","last_peered":"2024-08-27T03:58:46.365595+0000","last_clean":"2024-08-27T03:58:46.365595+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:46.365595+0000","last_undegraded":"2024-08-27T03:58:46.365595+0000","last_fullsized":"2024-08-27T03:58:46.365595+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'799","last_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_deep_scrub":"267'799","last_deep_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.365257+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:38.841374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'306","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.677763+0000","last_change":"2024-08-27T03:58:40.677586+0000","last_active":"2024-08-27T03:58:40.677763+0000","last_peered":"2024-08-27T03:58:40.677763+0000","last_clean":"2024-08-27T03:58:40.677763+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:40.677763+0000","last_undegraded":"2024-08-27T03:58:40.677763+0000","last_fullsized":"2024-08-27T03:58:40.677763+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.677362+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:13:35.785593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437736,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":7344,"num_write":963,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.471473+0000","last_change":"2024-08-27T03:58:51.471473+0000","last_active":"2024-08-27T03:58:51.471473+0000","last_peered":"2024-08-27T03:58:51.471473+0000","last_clean":"2024-08-27T03:58:51.471473+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:58:51.471473+0000","last_undegraded":"2024-08-27T03:58:51.471473+0000","last_fullsized":"2024-08-27T03:58:51.471473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.471186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:37:00.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'496","reported_seq":1173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.564486+0000","last_change":"2024-08-27T02:31:10.476948+0000","last_active":"2024-08-27T03:58:31.564486+0000","last_peered":"2024-08-27T03:58:31.564486+0000","last_clean":"2024-08-27T03:58:31.564486+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:58:31.564486+0000","last_undegraded":"2024-08-27T03:58:31.564486+0000","last_fullsized":"2024-08-27T03:58:31.564486+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:15:08.613306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73530,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2086,"num_write":702,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.073445+0000","last_change":"2024-08-27T02:31:12.497480+0000","last_active":"2024-08-27T03:55:45.073445+0000","last_peered":"2024-08-27T03:55:45.073445+0000","last_clean":"2024-08-27T03:55:45.073445+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:55:45.073445+0000","last_undegraded":"2024-08-27T03:55:45.073445+0000","last_fullsized":"2024-08-27T03:55:45.073445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:37:27.672439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'129","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.500987+0000","last_change":"2024-08-27T02:31:14.509810+0000","last_active":"2024-08-27T03:56:44.500987+0000","last_peered":"2024-08-27T03:56:44.500987+0000","last_clean":"2024-08-27T03:56:44.500987+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:56:44.500987+0000","last_undegraded":"2024-08-27T03:56:44.500987+0000","last_fullsized":"2024-08-27T03:56:44.500987+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:19:36.713125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'444","reported_seq":1982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.708558+0000","last_change":"2024-08-27T03:58:43.708403+0000","last_active":"2024-08-27T03:58:43.708558+0000","last_peered":"2024-08-27T03:58:43.708558+0000","last_clean":"2024-08-27T03:58:43.708558+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:58:43.708558+0000","last_undegraded":"2024-08-27T03:58:43.708558+0000","last_fullsized":"2024-08-27T03:58:43.708558+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.708210+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:51:30.618879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'311","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.180394+0000","last_change":"2024-08-27T03:58:42.180228+0000","last_active":"2024-08-27T03:58:42.180394+0000","last_peered":"2024-08-27T03:58:42.180394+0000","last_clean":"2024-08-27T03:58:42.180394+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:42.180394+0000","last_undegraded":"2024-08-27T03:58:42.180394+0000","last_fullsized":"2024-08-27T03:58:42.180394+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.179951+0000","objects_scrubbed":12,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:16.625194+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490466,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":3133,"num_write":1058,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.542454+0000","last_change":"2024-08-27T03:58:53.542226+0000","last_active":"2024-08-27T03:58:53.542454+0000","last_peered":"2024-08-27T03:58:53.542454+0000","last_clean":"2024-08-27T03:58:53.542454+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:58:53.542454+0000","last_undegraded":"2024-08-27T03:58:53.542454+0000","last_fullsized":"2024-08-27T03:58:53.542454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.541954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:03.310498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'317","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.874350+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.874350+0000","last_peered":"2024-08-27T03:58:29.874350+0000","last_clean":"2024-08-27T03:58:29.874350+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:58:29.874350+0000","last_undegraded":"2024-08-27T03:58:29.874350+0000","last_fullsized":"2024-08-27T03:58:29.874350+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.498208+0000","last_change":"2024-08-27T02:31:12.518013+0000","last_active":"2024-08-27T03:54:40.498208+0000","last_peered":"2024-08-27T03:54:40.498208+0000","last_clean":"2024-08-27T03:54:40.498208+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:54:40.498208+0000","last_undegraded":"2024-08-27T03:54:40.498208+0000","last_fullsized":"2024-08-27T03:54:40.498208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:35:06.086496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'122","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:39.920813+0000","last_change":"2024-08-27T02:31:14.508708+0000","last_active":"2024-08-27T03:57:39.920813+0000","last_peered":"2024-08-27T03:57:39.920813+0000","last_clean":"2024-08-27T03:57:39.920813+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:57:39.920813+0000","last_undegraded":"2024-08-27T03:57:39.920813+0000","last_fullsized":"2024-08-27T03:57:39.920813+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:18.139046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'306","reported_seq":1707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.720598+0000","last_change":"2024-08-27T03:58:45.720430+0000","last_active":"2024-08-27T03:58:45.720598+0000","last_peered":"2024-08-27T03:58:45.720598+0000","last_clean":"2024-08-27T03:58:45.720598+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:58:45.720598+0000","last_undegraded":"2024-08-27T03:58:45.720598+0000","last_fullsized":"2024-08-27T03:58:45.720598+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.720239+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:13:56.970539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1145,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'321","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.795951+0000","last_change":"2024-08-27T03:58:39.795951+0000","last_active":"2024-08-27T03:58:39.795951+0000","last_peered":"2024-08-27T03:58:39.795951+0000","last_clean":"2024-08-27T03:58:39.795951+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:39.795951+0000","last_undegraded":"2024-08-27T03:58:39.795951+0000","last_fullsized":"2024-08-27T03:58:39.795951+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.795741+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:23.816179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":447,"num_read_kb":5526,"num_write":1006,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.988502+0000","last_change":"2024-08-27T03:58:52.988368+0000","last_active":"2024-08-27T03:58:52.988502+0000","last_peered":"2024-08-27T03:58:52.988502+0000","last_clean":"2024-08-27T03:58:52.988502+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:58:52.988502+0000","last_undegraded":"2024-08-27T03:58:52.988502+0000","last_fullsized":"2024-08-27T03:58:52.988502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.988149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:55.540473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'383","reported_seq":1021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.561448+0000","last_change":"2024-08-27T03:58:54.561448+0000","last_active":"2024-08-27T03:58:54.561448+0000","last_peered":"2024-08-27T03:58:54.561448+0000","last_clean":"2024-08-27T03:58:54.561448+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:54.561448+0000","last_undegraded":"2024-08-27T03:58:54.561448+0000","last_fullsized":"2024-08-27T03:58:54.561448+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.561237+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:34.180367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'671","reported_seq":2560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.992508+0000","last_change":"2024-08-27T02:31:12.508008+0000","last_active":"2024-08-27T03:58:28.992508+0000","last_peered":"2024-08-27T03:58:28.992508+0000","last_clean":"2024-08-27T03:58:28.992508+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:28.992508+0000","last_undegraded":"2024-08-27T03:58:28.992508+0000","last_fullsized":"2024-08-27T03:58:28.992508+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:20.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'97","reported_seq":610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:41.088914+0000","last_change":"2024-08-27T02:31:14.503409+0000","last_active":"2024-08-27T03:56:41.088914+0000","last_peered":"2024-08-27T03:56:41.088914+0000","last_clean":"2024-08-27T03:56:41.088914+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:56:41.088914+0000","last_undegraded":"2024-08-27T03:56:41.088914+0000","last_fullsized":"2024-08-27T03:56:41.088914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'839","reported_seq":2594,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.683482+0000","last_change":"2024-08-27T03:58:44.683311+0000","last_active":"2024-08-27T03:58:44.683482+0000","last_peered":"2024-08-27T03:58:44.683482+0000","last_clean":"2024-08-27T03:58:44.683482+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:58:44.683482+0000","last_undegraded":"2024-08-27T03:58:44.683482+0000","last_fullsized":"2024-08-27T03:58:44.683482+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.683090+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:40:01.412803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'328","reported_seq":1142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.709167+0000","last_change":"2024-08-27T03:58:37.709167+0000","last_active":"2024-08-27T03:58:37.709167+0000","last_peered":"2024-08-27T03:58:37.709167+0000","last_clean":"2024-08-27T03:58:37.709167+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:37.709167+0000","last_undegraded":"2024-08-27T03:58:37.709167+0000","last_fullsized":"2024-08-27T03:58:37.709167+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.708679+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:51:40.565196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185741,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":802,"num_read_kb":112858,"num_write":1079,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1365,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.741436+0000","last_change":"2024-08-27T02:31:08.472253+0000","last_active":"2024-08-27T03:58:28.741436+0000","last_peered":"2024-08-27T03:58:28.741436+0000","last_clean":"2024-08-27T03:58:28.741436+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:28.741436+0000","last_undegraded":"2024-08-27T03:58:28.741436+0000","last_fullsized":"2024-08-27T03:58:28.741436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:32:23.121770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'117","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.908716+0000","last_change":"2024-08-27T02:31:10.637623+0000","last_active":"2024-08-27T03:56:39.908716+0000","last_peered":"2024-08-27T03:56:39.908716+0000","last_clean":"2024-08-27T03:56:39.908716+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:56:39.908716+0000","last_undegraded":"2024-08-27T03:56:39.908716+0000","last_fullsized":"2024-08-27T03:56:39.908716+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'692","reported_seq":3064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.997646+0000","last_change":"2024-08-27T02:31:12.491000+0000","last_active":"2024-08-27T03:58:28.997646+0000","last_peered":"2024-08-27T03:58:28.997646+0000","last_clean":"2024-08-27T03:58:28.997646+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:28.997646+0000","last_undegraded":"2024-08-27T03:58:28.997646+0000","last_fullsized":"2024-08-27T03:58:28.997646+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:38.876627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'122","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.104109+0000","last_change":"2024-08-27T02:31:14.511270+0000","last_active":"2024-08-27T03:56:40.104109+0000","last_peered":"2024-08-27T03:56:40.104109+0000","last_clean":"2024-08-27T03:56:40.104109+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:56:40.104109+0000","last_undegraded":"2024-08-27T03:56:40.104109+0000","last_fullsized":"2024-08-27T03:56:40.104109+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2348,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.209172+0000","last_change":"2024-08-27T03:58:45.209172+0000","last_active":"2024-08-27T03:58:45.209172+0000","last_peered":"2024-08-27T03:58:45.209172+0000","last_clean":"2024-08-27T03:58:45.209172+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:58:45.209172+0000","last_undegraded":"2024-08-27T03:58:45.209172+0000","last_fullsized":"2024-08-27T03:58:45.209172+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'786","last_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_deep_scrub":"267'786","last_deep_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.208970+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:19.947547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'384","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.079881+0000","last_change":"2024-08-27T03:58:39.079881+0000","last_active":"2024-08-27T03:58:39.079881+0000","last_peered":"2024-08-27T03:58:39.079881+0000","last_clean":"2024-08-27T03:58:39.079881+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:39.079881+0000","last_undegraded":"2024-08-27T03:58:39.079881+0000","last_fullsized":"2024-08-27T03:58:39.079881+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.079659+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:55:08.844282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":741,"num_read_kb":1678,"num_write":1218,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.104417+0000","last_change":"2024-08-27T02:31:08.477595+0000","last_active":"2024-08-27T03:56:40.104417+0000","last_peered":"2024-08-27T03:56:40.104417+0000","last_clean":"2024-08-27T03:56:40.104417+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:56:40.104417+0000","last_undegraded":"2024-08-27T03:56:40.104417+0000","last_fullsized":"2024-08-27T03:56:40.104417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'402","reported_seq":1058,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.067015+0000","last_change":"2024-08-27T02:31:10.469889+0000","last_active":"2024-08-27T03:58:31.067015+0000","last_peered":"2024-08-27T03:58:31.067015+0000","last_clean":"2024-08-27T03:58:31.067015+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:58:31.067015+0000","last_undegraded":"2024-08-27T03:58:31.067015+0000","last_fullsized":"2024-08-27T03:58:31.067015+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46460,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":1211,"num_write":486,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.634237+0000","last_change":"2024-08-27T03:58:54.634237+0000","last_active":"2024-08-27T03:58:54.634237+0000","last_peered":"2024-08-27T03:58:54.634237+0000","last_clean":"2024-08-27T03:58:54.634237+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:58:54.634237+0000","last_undegraded":"2024-08-27T03:58:54.634237+0000","last_fullsized":"2024-08-27T03:58:54.634237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.634062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:29:28.972507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'228","reported_seq":771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.636257+0000","last_change":"2024-08-27T02:31:14.492927+0000","last_active":"2024-08-27T03:56:42.636257+0000","last_peered":"2024-08-27T03:56:42.636257+0000","last_clean":"2024-08-27T03:56:42.636257+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:56:42.636257+0000","last_undegraded":"2024-08-27T03:56:42.636257+0000","last_fullsized":"2024-08-27T03:56:42.636257+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'527","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.697377+0000","last_change":"2024-08-27T03:58:45.697240+0000","last_active":"2024-08-27T03:58:45.697377+0000","last_peered":"2024-08-27T03:58:45.697377+0000","last_clean":"2024-08-27T03:58:45.697377+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:45.697377+0000","last_undegraded":"2024-08-27T03:58:45.697377+0000","last_fullsized":"2024-08-27T03:58:45.697377+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'527","last_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_deep_scrub":"267'527","last_deep_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.697061+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:09:58.090847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":635,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.931282+0000","last_change":"2024-08-27T03:58:39.931282+0000","last_active":"2024-08-27T03:58:39.931282+0000","last_peered":"2024-08-27T03:58:39.931282+0000","last_clean":"2024-08-27T03:58:39.931282+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:58:39.931282+0000","last_undegraded":"2024-08-27T03:58:39.931282+0000","last_fullsized":"2024-08-27T03:58:39.931282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.931095+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:05.232163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.617117+0000","last_change":"2024-08-27T03:58:38.617117+0000","last_active":"2024-08-27T03:58:38.617117+0000","last_peered":"2024-08-27T03:58:38.617117+0000","last_clean":"2024-08-27T03:58:38.617117+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:58:38.617117+0000","last_undegraded":"2024-08-27T03:58:38.617117+0000","last_fullsized":"2024-08-27T03:58:38.617117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.616933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:18:37.622258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'304","reported_seq":1178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.092930+0000","last_change":"2024-08-27T03:58:37.092930+0000","last_active":"2024-08-27T03:58:37.092930+0000","last_peered":"2024-08-27T03:58:37.092930+0000","last_clean":"2024-08-27T03:58:37.092930+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:37.092930+0000","last_undegraded":"2024-08-27T03:58:37.092930+0000","last_fullsized":"2024-08-27T03:58:37.092930+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'304","last_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_deep_scrub":"267'304","last_deep_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.092840+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:11:02.137368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":118351,"num_write":1022,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.906076+0000","last_change":"2024-08-27T03:58:53.906076+0000","last_active":"2024-08-27T03:58:53.906076+0000","last_peered":"2024-08-27T03:58:53.906076+0000","last_clean":"2024-08-27T03:58:53.906076+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:58:53.906076+0000","last_undegraded":"2024-08-27T03:58:53.906076+0000","last_fullsized":"2024-08-27T03:58:53.906076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.905892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:27:49.003970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'733","reported_seq":1475,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.876245+0000","last_change":"2024-08-27T02:31:10.463138+0000","last_active":"2024-08-27T03:58:31.876245+0000","last_peered":"2024-08-27T03:58:31.876245+0000","last_clean":"2024-08-27T03:58:31.876245+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:58:31.876245+0000","last_undegraded":"2024-08-27T03:58:31.876245+0000","last_fullsized":"2024-08-27T03:58:31.876245+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:46:40.351745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136746,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1442,"num_read_kb":3290,"num_write":1350,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294607+0000","last_change":"2024-08-27T02:31:12.521459+0000","last_active":"2024-08-27T03:55:45.294607+0000","last_peered":"2024-08-27T03:55:45.294607+0000","last_clean":"2024-08-27T03:55:45.294607+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:55:45.294607+0000","last_undegraded":"2024-08-27T03:55:45.294607+0000","last_fullsized":"2024-08-27T03:55:45.294607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:35:48.852493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'207","reported_seq":906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.606155+0000","last_change":"2024-08-27T02:31:14.512251+0000","last_active":"2024-08-27T03:56:44.606155+0000","last_peered":"2024-08-27T03:56:44.606155+0000","last_clean":"2024-08-27T03:56:44.606155+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:56:44.606155+0000","last_undegraded":"2024-08-27T03:56:44.606155+0000","last_fullsized":"2024-08-27T03:56:44.606155+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:31.795991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1519","reported_seq":3083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.414552+0000","last_change":"2024-08-27T03:58:47.414552+0000","last_active":"2024-08-27T03:58:47.414552+0000","last_peered":"2024-08-27T03:58:47.414552+0000","last_clean":"2024-08-27T03:58:47.414552+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:58:47.414552+0000","last_undegraded":"2024-08-27T03:58:47.414552+0000","last_fullsized":"2024-08-27T03:58:47.414552+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1519","last_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_deep_scrub":"267'1519","last_deep_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.414375+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":1500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:57.554800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.857903+0000","last_change":"2024-08-27T03:58:41.857903+0000","last_active":"2024-08-27T03:58:41.857903+0000","last_peered":"2024-08-27T03:58:41.857903+0000","last_clean":"2024-08-27T03:58:41.857903+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:58:41.857903+0000","last_undegraded":"2024-08-27T03:58:41.857903+0000","last_fullsized":"2024-08-27T03:58:41.857903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.857697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:28:49.679382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'389","reported_seq":1157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.456247+0000","last_change":"2024-08-27T03:58:39.456247+0000","last_active":"2024-08-27T03:58:39.456247+0000","last_peered":"2024-08-27T03:58:39.456247+0000","last_clean":"2024-08-27T03:58:39.456247+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:39.456247+0000","last_undegraded":"2024-08-27T03:58:39.456247+0000","last_fullsized":"2024-08-27T03:58:39.456247+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.455922+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:28:43.685014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458876,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":824,"num_read_kb":13511,"num_write":1117,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"37'5","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:28.727332+0000","last_change":"2024-08-27T02:31:08.472147+0000","last_active":"2024-08-27T03:58:28.727332+0000","last_peered":"2024-08-27T03:58:28.727332+0000","last_clean":"2024-08-27T03:58:28.727332+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:28.727332+0000","last_undegraded":"2024-08-27T03:58:28.727332+0000","last_fullsized":"2024-08-27T03:58:28.727332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:05:58.557262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1339","reported_seq":3326,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.877491+0000","last_change":"2024-08-27T02:31:10.466706+0000","last_active":"2024-08-27T03:58:31.877491+0000","last_peered":"2024-08-27T03:58:31.877491+0000","last_clean":"2024-08-27T03:58:31.877491+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:31.877491+0000","last_undegraded":"2024-08-27T03:58:31.877491+0000","last_fullsized":"2024-08-27T03:58:31.877491+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137506,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2076,"num_read_kb":3979,"num_write":1262,"num_write_kb":1030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:55.287626+0000","last_change":"2024-08-27T02:31:12.508877+0000","last_active":"2024-08-27T03:54:55.287626+0000","last_peered":"2024-08-27T03:54:55.287626+0000","last_clean":"2024-08-27T03:54:55.287626+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:54:55.287626+0000","last_undegraded":"2024-08-27T03:54:55.287626+0000","last_fullsized":"2024-08-27T03:54:55.287626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:19:12.131410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'164","reported_seq":701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.929974+0000","last_change":"2024-08-27T02:31:15.023823+0000","last_active":"2024-08-27T03:58:03.929974+0000","last_peered":"2024-08-27T03:58:03.929974+0000","last_clean":"2024-08-27T03:58:03.929974+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:58:03.929974+0000","last_undegraded":"2024-08-27T03:58:03.929974+0000","last_fullsized":"2024-08-27T03:58:03.929974+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:40:47.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.587280+0000","last_change":"2024-08-27T03:58:43.587280+0000","last_active":"2024-08-27T03:58:43.587280+0000","last_peered":"2024-08-27T03:58:43.587280+0000","last_clean":"2024-08-27T03:58:43.587280+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:58:43.587280+0000","last_undegraded":"2024-08-27T03:58:43.587280+0000","last_fullsized":"2024-08-27T03:58:43.587280+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.587095+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:03.769401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.604535+0000","last_change":"2024-08-27T03:58:36.604535+0000","last_active":"2024-08-27T03:58:36.604535+0000","last_peered":"2024-08-27T03:58:36.604535+0000","last_clean":"2024-08-27T03:58:36.604535+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:58:36.604535+0000","last_undegraded":"2024-08-27T03:58:36.604535+0000","last_fullsized":"2024-08-27T03:58:36.604535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.604457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:03:12.862350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'400","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.071524+0000","last_change":"2024-08-27T03:58:38.071524+0000","last_active":"2024-08-27T03:58:38.071524+0000","last_peered":"2024-08-27T03:58:38.071524+0000","last_clean":"2024-08-27T03:58:38.071524+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:38.071524+0000","last_undegraded":"2024-08-27T03:58:38.071524+0000","last_fullsized":"2024-08-27T03:58:38.071524+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.071425+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:30:14.243648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":29601,"num_write":1270,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.460375+0000","last_change":"2024-08-27T03:58:49.460375+0000","last_active":"2024-08-27T03:58:49.460375+0000","last_peered":"2024-08-27T03:58:49.460375+0000","last_clean":"2024-08-27T03:58:49.460375+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:58:49.460375+0000","last_undegraded":"2024-08-27T03:58:49.460375+0000","last_fullsized":"2024-08-27T03:58:49.460375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.460156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:20.731797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'327","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.502580+0000","last_change":"2024-08-27T02:31:10.637428+0000","last_active":"2024-08-27T03:58:03.502580+0000","last_peered":"2024-08-27T03:58:03.502580+0000","last_clean":"2024-08-27T03:58:03.502580+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:03.502580+0000","last_undegraded":"2024-08-27T03:58:03.502580+0000","last_fullsized":"2024-08-27T03:58:03.502580+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:29.250940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.308230+0000","last_change":"2024-08-27T02:31:12.518266+0000","last_active":"2024-08-27T03:56:40.308230+0000","last_peered":"2024-08-27T03:56:40.308230+0000","last_clean":"2024-08-27T03:56:40.308230+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:56:40.308230+0000","last_undegraded":"2024-08-27T03:56:40.308230+0000","last_fullsized":"2024-08-27T03:56:40.308230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'259","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.909802+0000","last_change":"2024-08-27T02:31:14.514321+0000","last_active":"2024-08-27T03:56:44.909802+0000","last_peered":"2024-08-27T03:56:44.909802+0000","last_clean":"2024-08-27T03:56:44.909802+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:56:44.909802+0000","last_undegraded":"2024-08-27T03:56:44.909802+0000","last_fullsized":"2024-08-27T03:56:44.909802+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:43:02.468724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.177188+0000","last_change":"2024-08-27T03:58:46.177188+0000","last_active":"2024-08-27T03:58:46.177188+0000","last_peered":"2024-08-27T03:58:46.177188+0000","last_clean":"2024-08-27T03:58:46.177188+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:58:46.177188+0000","last_undegraded":"2024-08-27T03:58:46.177188+0000","last_fullsized":"2024-08-27T03:58:46.177188+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.177002+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:00:50.953987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.658282+0000","last_change":"2024-08-27T03:58:37.658282+0000","last_active":"2024-08-27T03:58:37.658282+0000","last_peered":"2024-08-27T03:58:37.658282+0000","last_clean":"2024-08-27T03:58:37.658282+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:58:37.658282+0000","last_undegraded":"2024-08-27T03:58:37.658282+0000","last_fullsized":"2024-08-27T03:58:37.658282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.658091+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:22.087261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'346","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.730918+0000","last_change":"2024-08-27T03:58:38.730918+0000","last_active":"2024-08-27T03:58:38.730918+0000","last_peered":"2024-08-27T03:58:38.730918+0000","last_clean":"2024-08-27T03:58:38.730918+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:38.730918+0000","last_undegraded":"2024-08-27T03:58:38.730918+0000","last_fullsized":"2024-08-27T03:58:38.730918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.730550+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:48:41.072429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573788,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":426,"num_read_kb":9573,"num_write":1083,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.464923+0000","last_change":"2024-08-27T03:58:51.464782+0000","last_active":"2024-08-27T03:58:51.464923+0000","last_peered":"2024-08-27T03:58:51.464923+0000","last_clean":"2024-08-27T03:58:51.464923+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:58:51.464923+0000","last_undegraded":"2024-08-27T03:58:51.464923+0000","last_fullsized":"2024-08-27T03:58:51.464923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.464600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:07.725251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'172","reported_seq":758,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:01.706772+0000","last_change":"2024-08-27T02:31:10.467429+0000","last_active":"2024-08-27T03:58:01.706772+0000","last_peered":"2024-08-27T03:58:01.706772+0000","last_clean":"2024-08-27T03:58:01.706772+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:58:01.706772+0000","last_undegraded":"2024-08-27T03:58:01.706772+0000","last_fullsized":"2024-08-27T03:58:01.706772+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.607849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.675155+0000","last_change":"2024-08-27T03:58:53.675155+0000","last_active":"2024-08-27T03:58:53.675155+0000","last_peered":"2024-08-27T03:58:53.675155+0000","last_clean":"2024-08-27T03:58:53.675155+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:58:53.675155+0000","last_undegraded":"2024-08-27T03:58:53.675155+0000","last_fullsized":"2024-08-27T03:58:53.675155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.674951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:48.890985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875506+0000","last_change":"2024-08-27T02:31:14.502543+0000","last_active":"2024-08-27T03:55:44.875506+0000","last_peered":"2024-08-27T03:55:44.875506+0000","last_clean":"2024-08-27T03:55:44.875506+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:55:44.875506+0000","last_undegraded":"2024-08-27T03:55:44.875506+0000","last_fullsized":"2024-08-27T03:55:44.875506+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:40:33.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1265","reported_seq":2845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.167609+0000","last_change":"2024-08-27T03:58:44.167609+0000","last_active":"2024-08-27T03:58:44.167609+0000","last_peered":"2024-08-27T03:58:44.167609+0000","last_clean":"2024-08-27T03:58:44.167609+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:58:44.167609+0000","last_undegraded":"2024-08-27T03:58:44.167609+0000","last_fullsized":"2024-08-27T03:58:44.167609+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1265","last_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_deep_scrub":"267'1265","last_deep_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.167407+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:51:52.232154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'345","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.629743+0000","last_change":"2024-08-27T03:58:39.629743+0000","last_active":"2024-08-27T03:58:39.629743+0000","last_peered":"2024-08-27T03:58:39.629743+0000","last_clean":"2024-08-27T03:58:39.629743+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:39.629743+0000","last_undegraded":"2024-08-27T03:58:39.629743+0000","last_fullsized":"2024-08-27T03:58:39.629743+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.629340+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:32.213907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":946,"num_write":1113,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.053529+0000","last_change":"2024-08-27T03:58:37.053529+0000","last_active":"2024-08-27T03:58:37.053529+0000","last_peered":"2024-08-27T03:58:37.053529+0000","last_clean":"2024-08-27T03:58:37.053529+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:58:37.053529+0000","last_undegraded":"2024-08-27T03:58:37.053529+0000","last_fullsized":"2024-08-27T03:58:37.053529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.053430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:25.862689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.306967+0000","last_change":"2024-08-27T02:31:08.472606+0000","last_active":"2024-08-27T03:56:35.306967+0000","last_peered":"2024-08-27T03:56:35.306967+0000","last_clean":"2024-08-27T03:56:35.306967+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:56:35.306967+0000","last_undegraded":"2024-08-27T03:56:35.306967+0000","last_fullsized":"2024-08-27T03:56:35.306967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'664","reported_seq":1388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.416703+0000","last_change":"2024-08-27T02:31:10.465002+0000","last_active":"2024-08-27T03:58:30.416703+0000","last_peered":"2024-08-27T03:58:30.416703+0000","last_clean":"2024-08-27T03:58:30.416703+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:30.416703+0000","last_undegraded":"2024-08-27T03:58:30.416703+0000","last_fullsized":"2024-08-27T03:58:30.416703+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:48:12.137313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1780,"num_read_kb":2961,"num_write":2352,"num_write_kb":2124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.104051+0000","last_change":"2024-08-27T02:31:12.500222+0000","last_active":"2024-08-27T03:56:40.104051+0000","last_peered":"2024-08-27T03:56:40.104051+0000","last_clean":"2024-08-27T03:56:40.104051+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:56:40.104051+0000","last_undegraded":"2024-08-27T03:56:40.104051+0000","last_fullsized":"2024-08-27T03:56:40.104051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'145","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.589165+0000","last_change":"2024-08-27T02:31:15.026476+0000","last_active":"2024-08-27T03:56:38.589165+0000","last_peered":"2024-08-27T03:56:38.589165+0000","last_clean":"2024-08-27T03:56:38.589165+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:56:38.589165+0000","last_undegraded":"2024-08-27T03:56:38.589165+0000","last_fullsized":"2024-08-27T03:56:38.589165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:06.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'762","reported_seq":2257,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.341748+0000","last_change":"2024-08-27T03:58:44.341748+0000","last_active":"2024-08-27T03:58:44.341748+0000","last_peered":"2024-08-27T03:58:44.341748+0000","last_clean":"2024-08-27T03:58:44.341748+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:58:44.341748+0000","last_undegraded":"2024-08-27T03:58:44.341748+0000","last_fullsized":"2024-08-27T03:58:44.341748+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.341567+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:18:33.526418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'372","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.092398+0000","last_change":"2024-08-27T03:58:39.092398+0000","last_active":"2024-08-27T03:58:39.092398+0000","last_peered":"2024-08-27T03:58:39.092398+0000","last_clean":"2024-08-27T03:58:39.092398+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:39.092398+0000","last_undegraded":"2024-08-27T03:58:39.092398+0000","last_fullsized":"2024-08-27T03:58:39.092398+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.092090+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:46:48.988935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254745,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":622,"num_read_kb":96022,"num_write":1186,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.886716+0000","last_change":"2024-08-27T03:58:38.886592+0000","last_active":"2024-08-27T03:58:38.886716+0000","last_peered":"2024-08-27T03:58:38.886716+0000","last_clean":"2024-08-27T03:58:38.886716+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:58:38.886716+0000","last_undegraded":"2024-08-27T03:58:38.886716+0000","last_fullsized":"2024-08-27T03:58:38.886716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.886440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:43.605161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.688066+0000","last_change":"2024-08-27T03:58:49.688066+0000","last_active":"2024-08-27T03:58:49.688066+0000","last_peered":"2024-08-27T03:58:49.688066+0000","last_clean":"2024-08-27T03:58:49.688066+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:58:49.688066+0000","last_undegraded":"2024-08-27T03:58:49.688066+0000","last_fullsized":"2024-08-27T03:58:49.688066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.687882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:24:23.995310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'221","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.046535+0000","last_change":"2024-08-27T03:58:55.046535+0000","last_active":"2024-08-27T03:58:55.046535+0000","last_peered":"2024-08-27T03:58:55.046535+0000","last_clean":"2024-08-27T03:58:55.046535+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:58:55.046535+0000","last_undegraded":"2024-08-27T03:58:55.046535+0000","last_fullsized":"2024-08-27T03:58:55.046535+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.046291+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:24.558926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'720","reported_seq":2959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.366191+0000","last_change":"2024-08-27T02:31:12.507006+0000","last_active":"2024-08-27T03:58:31.366191+0000","last_peered":"2024-08-27T03:58:31.366191+0000","last_clean":"2024-08-27T03:58:31.366191+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:58:31.366191+0000","last_undegraded":"2024-08-27T03:58:31.366191+0000","last_fullsized":"2024-08-27T03:58:31.366191+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:59.445792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:09.915872+0000","last_change":"2024-08-27T02:31:15.023353+0000","last_active":"2024-08-27T03:57:09.915872+0000","last_peered":"2024-08-27T03:57:09.915872+0000","last_clean":"2024-08-27T03:57:09.915872+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:57:09.915872+0000","last_undegraded":"2024-08-27T03:57:09.915872+0000","last_fullsized":"2024-08-27T03:57:09.915872+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:35:33.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'410","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.125477+0000","last_change":"2024-08-27T03:58:48.125477+0000","last_active":"2024-08-27T03:58:48.125477+0000","last_peered":"2024-08-27T03:58:48.125477+0000","last_clean":"2024-08-27T03:58:48.125477+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:58:48.125477+0000","last_undegraded":"2024-08-27T03:58:48.125477+0000","last_fullsized":"2024-08-27T03:58:48.125477+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.125306+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:32:51.563488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'331","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.056444+0000","last_change":"2024-08-27T03:58:38.056444+0000","last_active":"2024-08-27T03:58:38.056444+0000","last_peered":"2024-08-27T03:58:38.056444+0000","last_clean":"2024-08-27T03:58:38.056444+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:38.056444+0000","last_undegraded":"2024-08-27T03:58:38.056444+0000","last_fullsized":"2024-08-27T03:58:38.056444+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.056349+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:34:53.352346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":4604,"num_write":1019,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.038731+0000","last_change":"2024-08-27T03:58:36.038731+0000","last_active":"2024-08-27T03:58:36.038731+0000","last_peered":"2024-08-27T03:58:36.038731+0000","last_clean":"2024-08-27T03:58:36.038731+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:58:36.038731+0000","last_undegraded":"2024-08-27T03:58:36.038731+0000","last_fullsized":"2024-08-27T03:58:36.038731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.038657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:07:04.224982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.102785+0000","last_change":"2024-08-27T02:31:08.458894+0000","last_active":"2024-08-27T03:56:35.102785+0000","last_peered":"2024-08-27T03:56:35.102785+0000","last_clean":"2024-08-27T03:56:35.102785+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:56:35.102785+0000","last_undegraded":"2024-08-27T03:56:35.102785+0000","last_fullsized":"2024-08-27T03:56:35.102785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'160","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.102896+0000","last_change":"2024-08-27T02:31:10.461453+0000","last_active":"2024-08-27T03:56:35.102896+0000","last_peered":"2024-08-27T03:56:35.102896+0000","last_clean":"2024-08-27T03:56:35.102896+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:56:35.102896+0000","last_undegraded":"2024-08-27T03:56:35.102896+0000","last_fullsized":"2024-08-27T03:56:35.102896+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'732","reported_seq":4716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.883766+0000","last_change":"2024-08-27T02:31:12.506051+0000","last_active":"2024-08-27T03:58:31.883766+0000","last_peered":"2024-08-27T03:58:31.883766+0000","last_clean":"2024-08-27T03:58:31.883766+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:58:31.883766+0000","last_undegraded":"2024-08-27T03:58:31.883766+0000","last_fullsized":"2024-08-27T03:58:31.883766+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'206","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.485251+0000","last_change":"2024-08-27T02:31:14.511228+0000","last_active":"2024-08-27T03:56:44.485251+0000","last_peered":"2024-08-27T03:56:44.485251+0000","last_clean":"2024-08-27T03:56:44.485251+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:56:44.485251+0000","last_undegraded":"2024-08-27T03:56:44.485251+0000","last_fullsized":"2024-08-27T03:56:44.485251+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:49:37.070870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'398","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.667019+0000","last_change":"2024-08-27T03:58:42.667019+0000","last_active":"2024-08-27T03:58:42.667019+0000","last_peered":"2024-08-27T03:58:42.667019+0000","last_clean":"2024-08-27T03:58:42.667019+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:58:42.667019+0000","last_undegraded":"2024-08-27T03:58:42.667019+0000","last_fullsized":"2024-08-27T03:58:42.667019+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.666809+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:34.834037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'349","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:35.413562+0000","last_change":"2024-08-27T03:58:35.413562+0000","last_active":"2024-08-27T03:58:35.413562+0000","last_peered":"2024-08-27T03:58:35.413562+0000","last_clean":"2024-08-27T03:58:35.413562+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:35.413562+0000","last_undegraded":"2024-08-27T03:58:35.413562+0000","last_fullsized":"2024-08-27T03:58:35.413562+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_clean_scrub_stamp":"2024-08-27T03:58:35.413408+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:28:38.132282+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044381,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":35253,"num_write":1103,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.749803+0000","last_change":"2024-08-27T03:58:38.749803+0000","last_active":"2024-08-27T03:58:38.749803+0000","last_peered":"2024-08-27T03:58:38.749803+0000","last_clean":"2024-08-27T03:58:38.749803+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:58:38.749803+0000","last_undegraded":"2024-08-27T03:58:38.749803+0000","last_fullsized":"2024-08-27T03:58:38.749803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.749605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:52:37.408314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.891808+0000","last_change":"2024-08-27T02:31:08.470557+0000","last_active":"2024-08-27T03:55:34.891808+0000","last_peered":"2024-08-27T03:55:34.891808+0000","last_clean":"2024-08-27T03:55:34.891808+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:55:34.891808+0000","last_undegraded":"2024-08-27T03:55:34.891808+0000","last_fullsized":"2024-08-27T03:55:34.891808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:16.200643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'797","reported_seq":1554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.923104+0000","last_change":"2024-08-27T02:31:10.635066+0000","last_active":"2024-08-27T03:58:30.923104+0000","last_peered":"2024-08-27T03:58:30.923104+0000","last_clean":"2024-08-27T03:58:30.923104+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:30.923104+0000","last_undegraded":"2024-08-27T03:58:30.923104+0000","last_fullsized":"2024-08-27T03:58:30.923104+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135678,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1416,"num_read_kb":3420,"num_write":1150,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.908585+0000","last_change":"2024-08-27T02:31:12.504645+0000","last_active":"2024-08-27T03:56:39.908585+0000","last_peered":"2024-08-27T03:56:39.908585+0000","last_clean":"2024-08-27T03:56:39.908585+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:56:39.908585+0000","last_undegraded":"2024-08-27T03:56:39.908585+0000","last_fullsized":"2024-08-27T03:56:39.908585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.858183+0000","last_change":"2024-08-27T02:31:14.522454+0000","last_active":"2024-08-27T03:54:29.858183+0000","last_peered":"2024-08-27T03:54:29.858183+0000","last_clean":"2024-08-27T03:54:29.858183+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:54:29.858183+0000","last_undegraded":"2024-08-27T03:54:29.858183+0000","last_fullsized":"2024-08-27T03:54:29.858183+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:07.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'163","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.994364+0000","last_change":"2024-08-27T02:31:14.511332+0000","last_active":"2024-08-27T03:56:44.994364+0000","last_peered":"2024-08-27T03:56:44.994364+0000","last_clean":"2024-08-27T03:56:44.994364+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:56:44.994364+0000","last_undegraded":"2024-08-27T03:56:44.994364+0000","last_fullsized":"2024-08-27T03:56:44.994364+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'938","reported_seq":2451,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.710186+0000","last_change":"2024-08-27T03:58:48.710186+0000","last_active":"2024-08-27T03:58:48.710186+0000","last_peered":"2024-08-27T03:58:48.710186+0000","last_clean":"2024-08-27T03:58:48.710186+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:58:48.710186+0000","last_undegraded":"2024-08-27T03:58:48.710186+0000","last_fullsized":"2024-08-27T03:58:48.710186+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'938","last_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_deep_scrub":"267'938","last_deep_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.709995+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":900,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.597316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":688,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'378","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.720844+0000","last_change":"2024-08-27T03:58:40.720844+0000","last_active":"2024-08-27T03:58:40.720844+0000","last_peered":"2024-08-27T03:58:40.720844+0000","last_clean":"2024-08-27T03:58:40.720844+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:40.720844+0000","last_undegraded":"2024-08-27T03:58:40.720844+0000","last_fullsized":"2024-08-27T03:58:40.720844+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'378","last_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_deep_scrub":"267'378","last_deep_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.720612+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:35.862070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263226,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":507,"num_write":1144,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.031052+0000","last_change":"2024-08-27T03:58:51.031052+0000","last_active":"2024-08-27T03:58:51.031052+0000","last_peered":"2024-08-27T03:58:51.031052+0000","last_clean":"2024-08-27T03:58:51.031052+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:58:51.031052+0000","last_undegraded":"2024-08-27T03:58:51.031052+0000","last_fullsized":"2024-08-27T03:58:51.031052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.030870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:16.544510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'280","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.333806+0000","last_change":"2024-08-27T02:31:10.463641+0000","last_active":"2024-08-27T03:58:31.333806+0000","last_peered":"2024-08-27T03:58:31.333806+0000","last_clean":"2024-08-27T03:58:31.333806+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:58:31.333806+0000","last_undegraded":"2024-08-27T03:58:31.333806+0000","last_fullsized":"2024-08-27T03:58:31.333806+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:35:43.609652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":955,"num_write":350,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:14.886578+0000","last_change":"2024-08-27T02:31:12.505279+0000","last_active":"2024-08-27T03:55:14.886578+0000","last_peered":"2024-08-27T03:55:14.886578+0000","last_clean":"2024-08-27T03:55:14.886578+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:55:14.886578+0000","last_undegraded":"2024-08-27T03:55:14.886578+0000","last_fullsized":"2024-08-27T03:55:14.886578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:28:41.364605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.893070+0000","last_change":"2024-08-27T02:31:14.521163+0000","last_active":"2024-08-27T03:55:39.893070+0000","last_peered":"2024-08-27T03:55:39.893070+0000","last_clean":"2024-08-27T03:55:39.893070+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:55:39.893070+0000","last_undegraded":"2024-08-27T03:55:39.893070+0000","last_fullsized":"2024-08-27T03:55:39.893070+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:59:46.536741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'380","reported_seq":1855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.148934+0000","last_change":"2024-08-27T03:58:47.148934+0000","last_active":"2024-08-27T03:58:47.148934+0000","last_peered":"2024-08-27T03:58:47.148934+0000","last_clean":"2024-08-27T03:58:47.148934+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:58:47.148934+0000","last_undegraded":"2024-08-27T03:58:47.148934+0000","last_fullsized":"2024-08-27T03:58:47.148934+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.148744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:27.163059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'319","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.889227+0000","last_change":"2024-08-27T03:58:44.889227+0000","last_active":"2024-08-27T03:58:44.889227+0000","last_peered":"2024-08-27T03:58:44.889227+0000","last_clean":"2024-08-27T03:58:44.889227+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:44.889227+0000","last_undegraded":"2024-08-27T03:58:44.889227+0000","last_fullsized":"2024-08-27T03:58:44.889227+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.888880+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:13:45.821566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":2061,"num_write":967,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:09.885122+0000","last_change":"2024-08-27T02:31:08.461957+0000","last_active":"2024-08-27T03:55:09.885122+0000","last_peered":"2024-08-27T03:55:09.885122+0000","last_clean":"2024-08-27T03:55:09.885122+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:55:09.885122+0000","last_undegraded":"2024-08-27T03:55:09.885122+0000","last_fullsized":"2024-08-27T03:55:09.885122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:42.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'55","reported_seq":585,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.285806+0000","last_change":"2024-08-27T02:31:10.464843+0000","last_active":"2024-08-27T03:55:10.285806+0000","last_peered":"2024-08-27T03:55:10.285806+0000","last_clean":"2024-08-27T03:55:10.285806+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:55:10.285806+0000","last_undegraded":"2024-08-27T03:55:10.285806+0000","last_fullsized":"2024-08-27T03:55:10.285806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:47:45.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.292286+0000","last_change":"2024-08-27T02:31:12.506193+0000","last_active":"2024-08-27T03:55:15.292286+0000","last_peered":"2024-08-27T03:55:15.292286+0000","last_clean":"2024-08-27T03:55:15.292286+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:55:15.292286+0000","last_undegraded":"2024-08-27T03:55:15.292286+0000","last_fullsized":"2024-08-27T03:55:15.292286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:31:44.393834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'182","reported_seq":719,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:42.702547+0000","last_change":"2024-08-27T02:31:14.517907+0000","last_active":"2024-08-27T03:56:42.702547+0000","last_peered":"2024-08-27T03:56:42.702547+0000","last_clean":"2024-08-27T03:56:42.702547+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:56:42.702547+0000","last_undegraded":"2024-08-27T03:56:42.702547+0000","last_fullsized":"2024-08-27T03:56:42.702547+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'412","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.133915+0000","last_change":"2024-08-27T03:58:49.133915+0000","last_active":"2024-08-27T03:58:49.133915+0000","last_peered":"2024-08-27T03:58:49.133915+0000","last_clean":"2024-08-27T03:58:49.133915+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:58:49.133915+0000","last_undegraded":"2024-08-27T03:58:49.133915+0000","last_fullsized":"2024-08-27T03:58:49.133915+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.133730+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:26:03.612785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'324","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.768146+0000","last_change":"2024-08-27T03:58:48.768146+0000","last_active":"2024-08-27T03:58:48.768146+0000","last_peered":"2024-08-27T03:58:48.768146+0000","last_clean":"2024-08-27T03:58:48.768146+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:48.768146+0000","last_undegraded":"2024-08-27T03:58:48.768146+0000","last_fullsized":"2024-08-27T03:58:48.768146+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.767843+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:56.225287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525410,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":30350,"num_write":1025,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:10.290942+0000","last_change":"2024-08-27T02:31:08.450903+0000","last_active":"2024-08-27T03:55:10.290942+0000","last_peered":"2024-08-27T03:55:10.290942+0000","last_clean":"2024-08-27T03:55:10.290942+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:55:10.290942+0000","last_undegraded":"2024-08-27T03:55:10.290942+0000","last_fullsized":"2024-08-27T03:55:10.290942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:21.462233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'341","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.262090+0000","last_change":"2024-08-27T02:31:10.467565+0000","last_active":"2024-08-27T03:58:30.262090+0000","last_peered":"2024-08-27T03:58:30.262090+0000","last_clean":"2024-08-27T03:58:30.262090+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:58:30.262090+0000","last_undegraded":"2024-08-27T03:58:30.262090+0000","last_fullsized":"2024-08-27T03:58:30.262090+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:04:40.132706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1247,"num_write":450,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449445+0000","last_change":"2024-08-27T02:31:12.502528+0000","last_active":"2024-08-27T03:55:15.449445+0000","last_peered":"2024-08-27T03:55:15.449445+0000","last_clean":"2024-08-27T03:55:15.449445+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:55:15.449445+0000","last_undegraded":"2024-08-27T03:55:15.449445+0000","last_fullsized":"2024-08-27T03:55:15.449445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:14.781588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'114","reported_seq":627,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.882881+0000","last_change":"2024-08-27T02:31:14.521917+0000","last_active":"2024-08-27T03:56:14.882881+0000","last_peered":"2024-08-27T03:56:14.882881+0000","last_clean":"2024-08-27T03:56:14.882881+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:56:14.882881+0000","last_undegraded":"2024-08-27T03:56:14.882881+0000","last_fullsized":"2024-08-27T03:56:14.882881+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'420","reported_seq":1947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.187656+0000","last_change":"2024-08-27T03:58:51.187656+0000","last_active":"2024-08-27T03:58:51.187656+0000","last_peered":"2024-08-27T03:58:51.187656+0000","last_clean":"2024-08-27T03:58:51.187656+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:51.187656+0000","last_undegraded":"2024-08-27T03:58:51.187656+0000","last_fullsized":"2024-08-27T03:58:51.187656+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'420","last_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_deep_scrub":"267'420","last_deep_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.187454+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:01:20.975620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'331","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.480918+0000","last_change":"2024-08-27T03:58:37.480918+0000","last_active":"2024-08-27T03:58:37.480918+0000","last_peered":"2024-08-27T03:58:37.480918+0000","last_clean":"2024-08-27T03:58:37.480918+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:37.480918+0000","last_undegraded":"2024-08-27T03:58:37.480918+0000","last_fullsized":"2024-08-27T03:58:37.480918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.480830+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:01:53.901179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1018782,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":16403,"num_write":1128,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.652421+0000","last_change":"2024-08-27T03:58:51.652421+0000","last_active":"2024-08-27T03:58:51.652421+0000","last_peered":"2024-08-27T03:58:51.652421+0000","last_clean":"2024-08-27T03:58:51.652421+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:58:51.652421+0000","last_undegraded":"2024-08-27T03:58:51.652421+0000","last_fullsized":"2024-08-27T03:58:51.652421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.652254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:21:22.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'281","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.033952+0000","last_change":"2024-08-27T02:31:10.476895+0000","last_active":"2024-08-27T03:58:30.033952+0000","last_peered":"2024-08-27T03:58:30.033952+0000","last_clean":"2024-08-27T03:58:30.033952+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:58:30.033952+0000","last_undegraded":"2024-08-27T03:58:30.033952+0000","last_fullsized":"2024-08-27T03:58:30.033952+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:34:48.785917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287158+0000","last_change":"2024-08-27T02:31:12.521407+0000","last_active":"2024-08-27T03:55:15.287158+0000","last_peered":"2024-08-27T03:55:15.287158+0000","last_clean":"2024-08-27T03:55:15.287158+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:55:15.287158+0000","last_undegraded":"2024-08-27T03:55:15.287158+0000","last_fullsized":"2024-08-27T03:55:15.287158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T02:41:44.290066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'839","reported_seq":2423,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.689531+0000","last_change":"2024-08-27T03:58:47.689531+0000","last_active":"2024-08-27T03:58:47.689531+0000","last_peered":"2024-08-27T03:58:47.689531+0000","last_clean":"2024-08-27T03:58:47.689531+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:58:47.689531+0000","last_undegraded":"2024-08-27T03:58:47.689531+0000","last_fullsized":"2024-08-27T03:58:47.689531+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.689347+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:53:38.179127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1651,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'418","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.127698+0000","last_change":"2024-08-27T03:58:40.127698+0000","last_active":"2024-08-27T03:58:40.127698+0000","last_peered":"2024-08-27T03:58:40.127698+0000","last_clean":"2024-08-27T03:58:40.127698+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:40.127698+0000","last_undegraded":"2024-08-27T03:58:40.127698+0000","last_fullsized":"2024-08-27T03:58:40.127698+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'418","last_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_deep_scrub":"267'418","last_deep_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.127457+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:37.962208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":762,"num_read_kb":11072,"num_write":1374,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.531651+0000","last_change":"2024-08-27T03:58:54.531651+0000","last_active":"2024-08-27T03:58:54.531651+0000","last_peered":"2024-08-27T03:58:54.531651+0000","last_clean":"2024-08-27T03:58:54.531651+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:58:54.531651+0000","last_undegraded":"2024-08-27T03:58:54.531651+0000","last_fullsized":"2024-08-27T03:58:54.531651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.531461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:09:04.172792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'556","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.024667+0000","last_change":"2024-08-27T03:58:54.024667+0000","last_active":"2024-08-27T03:58:54.024667+0000","last_peered":"2024-08-27T03:58:54.024667+0000","last_clean":"2024-08-27T03:58:54.024667+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:54.024667+0000","last_undegraded":"2024-08-27T03:58:54.024667+0000","last_fullsized":"2024-08-27T03:58:54.024667+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'556","last_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_deep_scrub":"267'556","last_deep_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.024451+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:17.790125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":990,"num_read_kb":2409,"num_write":858,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23904,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.882908+0000","last_change":"2024-08-27T02:31:12.513046+0000","last_active":"2024-08-27T03:56:14.882908+0000","last_peered":"2024-08-27T03:56:14.882908+0000","last_clean":"2024-08-27T03:56:14.882908+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:56:14.882908+0000","last_undegraded":"2024-08-27T03:56:14.882908+0000","last_fullsized":"2024-08-27T03:56:14.882908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'140","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.320188+0000","last_change":"2024-08-27T02:31:15.026496+0000","last_active":"2024-08-27T03:56:39.320188+0000","last_peered":"2024-08-27T03:56:39.320188+0000","last_clean":"2024-08-27T03:56:39.320188+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:56:39.320188+0000","last_undegraded":"2024-08-27T03:56:39.320188+0000","last_fullsized":"2024-08-27T03:56:39.320188+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:25.778670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1183","reported_seq":2631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.466497+0000","last_change":"2024-08-27T03:58:49.466497+0000","last_active":"2024-08-27T03:58:49.466497+0000","last_peered":"2024-08-27T03:58:49.466497+0000","last_clean":"2024-08-27T03:58:49.466497+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:58:49.466497+0000","last_undegraded":"2024-08-27T03:58:49.466497+0000","last_fullsized":"2024-08-27T03:58:49.466497+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1183","last_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_deep_scrub":"267'1183","last_deep_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.466324+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:09.565854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'349","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.092246+0000","last_change":"2024-08-27T03:58:41.092246+0000","last_active":"2024-08-27T03:58:41.092246+0000","last_peered":"2024-08-27T03:58:41.092246+0000","last_clean":"2024-08-27T03:58:41.092246+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:41.092246+0000","last_undegraded":"2024-08-27T03:58:41.092246+0000","last_fullsized":"2024-08-27T03:58:41.092246+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.092033+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:47:27.087478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":41676,"num_write":1093,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.666378+0000","last_change":"2024-08-27T03:58:52.666378+0000","last_active":"2024-08-27T03:58:52.666378+0000","last_peered":"2024-08-27T03:58:52.666378+0000","last_clean":"2024-08-27T03:58:52.666378+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:58:52.666378+0000","last_undegraded":"2024-08-27T03:58:52.666378+0000","last_fullsized":"2024-08-27T03:58:52.666378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.666203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:19:46.181291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'350","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.105011+0000","last_change":"2024-08-27T02:31:10.477408+0000","last_active":"2024-08-27T03:58:30.105011+0000","last_peered":"2024-08-27T03:58:30.105011+0000","last_clean":"2024-08-27T03:58:30.105011+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:58:30.105011+0000","last_undegraded":"2024-08-27T03:58:30.105011+0000","last_fullsized":"2024-08-27T03:58:30.105011+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.060998+0000","last_change":"2024-08-27T03:58:56.060998+0000","last_active":"2024-08-27T03:58:56.060998+0000","last_peered":"2024-08-27T03:58:56.060998+0000","last_clean":"2024-08-27T03:58:56.060998+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:58:56.060998+0000","last_undegraded":"2024-08-27T03:58:56.060998+0000","last_fullsized":"2024-08-27T03:58:56.060998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.060804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:43.231476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":699,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.449386+0000","last_change":"2024-08-27T02:31:14.521472+0000","last_active":"2024-08-27T03:55:15.449386+0000","last_peered":"2024-08-27T03:55:15.449386+0000","last_clean":"2024-08-27T03:55:15.449386+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:55:15.449386+0000","last_undegraded":"2024-08-27T03:55:15.449386+0000","last_fullsized":"2024-08-27T03:55:15.449386+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:13.751034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'699","reported_seq":2143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.218908+0000","last_change":"2024-08-27T03:58:53.218908+0000","last_active":"2024-08-27T03:58:53.218908+0000","last_peered":"2024-08-27T03:58:53.218908+0000","last_clean":"2024-08-27T03:58:53.218908+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:58:53.218908+0000","last_undegraded":"2024-08-27T03:58:53.218908+0000","last_fullsized":"2024-08-27T03:58:53.218908+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'699","last_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_deep_scrub":"267'699","last_deep_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.218695+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:33.400240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'333","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.695058+0000","last_change":"2024-08-27T03:58:39.695058+0000","last_active":"2024-08-27T03:58:39.695058+0000","last_peered":"2024-08-27T03:58:39.695058+0000","last_clean":"2024-08-27T03:58:39.695058+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:39.695058+0000","last_undegraded":"2024-08-27T03:58:39.695058+0000","last_fullsized":"2024-08-27T03:58:39.695058+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.694836+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:12.785434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":27841,"num_write":1117,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.096764+0000","last_change":"2024-08-27T02:31:08.461902+0000","last_active":"2024-08-27T03:56:10.096764+0000","last_peered":"2024-08-27T03:56:10.096764+0000","last_clean":"2024-08-27T03:56:10.096764+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:56:10.096764+0000","last_undegraded":"2024-08-27T03:56:10.096764+0000","last_fullsized":"2024-08-27T03:56:10.096764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'323","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.648798+0000","last_change":"2024-08-27T02:31:10.636027+0000","last_active":"2024-08-27T03:58:31.648798+0000","last_peered":"2024-08-27T03:58:31.648798+0000","last_clean":"2024-08-27T03:58:31.648798+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:58:31.648798+0000","last_undegraded":"2024-08-27T03:58:31.648798+0000","last_fullsized":"2024-08-27T03:58:31.648798+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66592,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1228,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:31.071793+0000","last_change":"2024-08-27T02:31:12.498318+0000","last_active":"2024-08-27T03:55:31.071793+0000","last_peered":"2024-08-27T03:55:31.071793+0000","last_clean":"2024-08-27T03:55:31.071793+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:55:31.071793+0000","last_undegraded":"2024-08-27T03:55:31.071793+0000","last_fullsized":"2024-08-27T03:55:31.071793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:41.474651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:03.928313+0000","last_change":"2024-08-27T02:31:14.521960+0000","last_active":"2024-08-27T03:58:03.928313+0000","last_peered":"2024-08-27T03:58:03.928313+0000","last_clean":"2024-08-27T03:58:03.928313+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:58:03.928313+0000","last_undegraded":"2024-08-27T03:58:03.928313+0000","last_fullsized":"2024-08-27T03:58:03.928313+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:38:31.904177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'790","reported_seq":2428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.556897+0000","last_change":"2024-08-27T03:58:46.556897+0000","last_active":"2024-08-27T03:58:46.556897+0000","last_peered":"2024-08-27T03:58:46.556897+0000","last_clean":"2024-08-27T03:58:46.556897+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:58:46.556897+0000","last_undegraded":"2024-08-27T03:58:46.556897+0000","last_fullsized":"2024-08-27T03:58:46.556897+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.556708+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:05.148074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'325","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.454132+0000","last_change":"2024-08-27T03:58:38.454132+0000","last_active":"2024-08-27T03:58:38.454132+0000","last_peered":"2024-08-27T03:58:38.454132+0000","last_clean":"2024-08-27T03:58:38.454132+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:38.454132+0000","last_undegraded":"2024-08-27T03:58:38.454132+0000","last_fullsized":"2024-08-27T03:58:38.454132+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.453909+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:53.794488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399355,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":2807,"num_write":1070,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:11.081055+0000","last_change":"2024-08-27T02:31:08.471391+0000","last_active":"2024-08-27T03:56:11.081055+0000","last_peered":"2024-08-27T03:56:11.081055+0000","last_clean":"2024-08-27T03:56:11.081055+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:56:11.081055+0000","last_undegraded":"2024-08-27T03:56:11.081055+0000","last_fullsized":"2024-08-27T03:56:11.081055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'131","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:25.086304+0000","last_change":"2024-08-27T02:31:10.635520+0000","last_active":"2024-08-27T03:55:25.086304+0000","last_peered":"2024-08-27T03:55:25.086304+0000","last_clean":"2024-08-27T03:55:25.086304+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:55:25.086304+0000","last_undegraded":"2024-08-27T03:55:25.086304+0000","last_fullsized":"2024-08-27T03:55:25.086304+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:36:27.001114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'693","reported_seq":2819,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.879965+0000","last_change":"2024-08-27T02:31:12.490737+0000","last_active":"2024-08-27T03:58:31.879965+0000","last_peered":"2024-08-27T03:58:31.879965+0000","last_clean":"2024-08-27T03:58:31.879965+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:31.879965+0000","last_undegraded":"2024-08-27T03:58:31.879965+0000","last_fullsized":"2024-08-27T03:58:31.879965+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'112","reported_seq":615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.583823+0000","last_change":"2024-08-27T02:31:14.516613+0000","last_active":"2024-08-27T03:56:38.583823+0000","last_peered":"2024-08-27T03:56:38.583823+0000","last_clean":"2024-08-27T03:56:38.583823+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:56:38.583823+0000","last_undegraded":"2024-08-27T03:56:38.583823+0000","last_fullsized":"2024-08-27T03:56:38.583823+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:26:30.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'791","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.714950+0000","last_change":"2024-08-27T03:58:49.714950+0000","last_active":"2024-08-27T03:58:49.714950+0000","last_peered":"2024-08-27T03:58:49.714950+0000","last_clean":"2024-08-27T03:58:49.714950+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:58:49.714950+0000","last_undegraded":"2024-08-27T03:58:49.714950+0000","last_fullsized":"2024-08-27T03:58:49.714950+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'791","last_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_deep_scrub":"267'791","last_deep_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.714771+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:52.868288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'298","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.775582+0000","last_change":"2024-08-27T03:58:46.775582+0000","last_active":"2024-08-27T03:58:46.775582+0000","last_peered":"2024-08-27T03:58:46.775582+0000","last_clean":"2024-08-27T03:58:46.775582+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:46.775582+0000","last_undegraded":"2024-08-27T03:58:46.775582+0000","last_fullsized":"2024-08-27T03:58:46.775582+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.775293+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:09.222532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550499,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":12943,"num_write":990,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306144+0000","last_change":"2024-08-27T02:31:08.447203+0000","last_active":"2024-08-27T03:56:10.306144+0000","last_peered":"2024-08-27T03:56:10.306144+0000","last_clean":"2024-08-27T03:56:10.306144+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:56:10.306144+0000","last_undegraded":"2024-08-27T03:56:10.306144+0000","last_fullsized":"2024-08-27T03:56:10.306144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'379","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.397888+0000","last_change":"2024-08-27T02:31:10.469484+0000","last_active":"2024-08-27T03:58:29.397888+0000","last_peered":"2024-08-27T03:58:29.397888+0000","last_clean":"2024-08-27T03:58:29.397888+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:58:29.397888+0000","last_undegraded":"2024-08-27T03:58:29.397888+0000","last_fullsized":"2024-08-27T03:58:29.397888+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:28:12.752267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:50.295363+0000","last_change":"2024-08-27T02:31:12.517594+0000","last_active":"2024-08-27T03:55:50.295363+0000","last_peered":"2024-08-27T03:55:50.295363+0000","last_clean":"2024-08-27T03:55:50.295363+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:55:50.295363+0000","last_undegraded":"2024-08-27T03:55:50.295363+0000","last_fullsized":"2024-08-27T03:55:50.295363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:58:27.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'112","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:44.818594+0000","last_change":"2024-08-27T02:31:14.523873+0000","last_active":"2024-08-27T03:56:44.818594+0000","last_peered":"2024-08-27T03:56:44.818594+0000","last_clean":"2024-08-27T03:56:44.818594+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:56:44.818594+0000","last_undegraded":"2024-08-27T03:56:44.818594+0000","last_fullsized":"2024-08-27T03:56:44.818594+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:56.720396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'377","reported_seq":1871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.746460+0000","last_change":"2024-08-27T03:58:46.746460+0000","last_active":"2024-08-27T03:58:46.746460+0000","last_peered":"2024-08-27T03:58:46.746460+0000","last_clean":"2024-08-27T03:58:46.746460+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:58:46.746460+0000","last_undegraded":"2024-08-27T03:58:46.746460+0000","last_fullsized":"2024-08-27T03:58:46.746460+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.746284+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:21.089772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'325","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.707957+0000","last_change":"2024-08-27T03:58:41.707957+0000","last_active":"2024-08-27T03:58:41.707957+0000","last_peered":"2024-08-27T03:58:41.707957+0000","last_clean":"2024-08-27T03:58:41.707957+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:41.707957+0000","last_undegraded":"2024-08-27T03:58:41.707957+0000","last_fullsized":"2024-08-27T03:58:41.707957+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.707686+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:44.940323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":8306,"num_write":1045,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.881714+0000","last_change":"2024-08-27T02:31:08.463927+0000","last_active":"2024-08-27T03:56:09.881714+0000","last_peered":"2024-08-27T03:56:09.881714+0000","last_clean":"2024-08-27T03:56:09.881714+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:56:09.881714+0000","last_undegraded":"2024-08-27T03:56:09.881714+0000","last_fullsized":"2024-08-27T03:56:09.881714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'268","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.468339+0000","last_change":"2024-08-27T02:31:10.470453+0000","last_active":"2024-08-27T03:58:29.468339+0000","last_peered":"2024-08-27T03:58:29.468339+0000","last_clean":"2024-08-27T03:58:29.468339+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:58:29.468339+0000","last_undegraded":"2024-08-27T03:58:29.468339+0000","last_fullsized":"2024-08-27T03:58:29.468339+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:25:46.212245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.459171+0000","last_change":"2024-08-27T02:31:12.494052+0000","last_active":"2024-08-27T03:56:00.459171+0000","last_peered":"2024-08-27T03:56:00.459171+0000","last_clean":"2024-08-27T03:56:00.459171+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:56:00.459171+0000","last_undegraded":"2024-08-27T03:56:00.459171+0000","last_fullsized":"2024-08-27T03:56:00.459171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:47:24.014947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'135","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.343269+0000","last_change":"2024-08-27T02:31:15.027895+0000","last_active":"2024-08-27T03:56:39.343269+0000","last_peered":"2024-08-27T03:56:39.343269+0000","last_clean":"2024-08-27T03:56:39.343269+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:56:39.343269+0000","last_undegraded":"2024-08-27T03:56:39.343269+0000","last_fullsized":"2024-08-27T03:56:39.343269+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:31:36.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'737","reported_seq":2240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.265124+0000","last_change":"2024-08-27T03:58:54.265124+0000","last_active":"2024-08-27T03:58:54.265124+0000","last_peered":"2024-08-27T03:58:54.265124+0000","last_clean":"2024-08-27T03:58:54.265124+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:58:54.265124+0000","last_undegraded":"2024-08-27T03:58:54.265124+0000","last_fullsized":"2024-08-27T03:58:54.265124+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'737","last_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_deep_scrub":"267'737","last_deep_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.264928+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:37:38.355010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.153507+0000","last_change":"2024-08-27T03:58:41.153507+0000","last_active":"2024-08-27T03:58:41.153507+0000","last_peered":"2024-08-27T03:58:41.153507+0000","last_clean":"2024-08-27T03:58:41.153507+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:41.153507+0000","last_undegraded":"2024-08-27T03:58:41.153507+0000","last_fullsized":"2024-08-27T03:58:41.153507+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.153232+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:31.829289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":19461,"num_write":1109,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.090711+0000","last_change":"2024-08-27T02:31:08.468289+0000","last_active":"2024-08-27T03:55:45.090711+0000","last_peered":"2024-08-27T03:55:45.090711+0000","last_clean":"2024-08-27T03:55:45.090711+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:55:45.090711+0000","last_undegraded":"2024-08-27T03:55:45.090711+0000","last_fullsized":"2024-08-27T03:55:45.090711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:07.418186+0000","last_clean_scrub_stamp":"2024-08-27T02:31:07.418186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:51:14.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'279","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.487341+0000","last_change":"2024-08-27T02:31:10.474659+0000","last_active":"2024-08-27T03:58:31.487341+0000","last_peered":"2024-08-27T03:58:31.487341+0000","last_clean":"2024-08-27T03:58:31.487341+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:58:31.487341+0000","last_undegraded":"2024-08-27T03:58:31.487341+0000","last_fullsized":"2024-08-27T03:58:31.487341+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1176,"num_write":390,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.097836+0000","last_change":"2024-08-27T02:31:12.494960+0000","last_active":"2024-08-27T03:56:15.097836+0000","last_peered":"2024-08-27T03:56:15.097836+0000","last_clean":"2024-08-27T03:56:15.097836+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:56:15.097836+0000","last_undegraded":"2024-08-27T03:56:15.097836+0000","last_fullsized":"2024-08-27T03:56:15.097836+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'178","reported_seq":1652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:38.531902+0000","last_change":"2024-08-27T02:31:14.521123+0000","last_active":"2024-08-27T03:56:38.531902+0000","last_peered":"2024-08-27T03:56:38.531902+0000","last_clean":"2024-08-27T03:56:38.531902+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:56:38.531902+0000","last_undegraded":"2024-08-27T03:56:38.531902+0000","last_fullsized":"2024-08-27T03:56:38.531902+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:15.425652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'552","reported_seq":2377,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.721278+0000","last_change":"2024-08-27T03:58:47.721278+0000","last_active":"2024-08-27T03:58:47.721278+0000","last_peered":"2024-08-27T03:58:47.721278+0000","last_clean":"2024-08-27T03:58:47.721278+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:58:47.721278+0000","last_undegraded":"2024-08-27T03:58:47.721278+0000","last_fullsized":"2024-08-27T03:58:47.721278+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'552","last_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_deep_scrub":"267'552","last_deep_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.721071+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:43:33.741639+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'295","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.460166+0000","last_change":"2024-08-27T03:58:36.460166+0000","last_active":"2024-08-27T03:58:36.460166+0000","last_peered":"2024-08-27T03:58:36.460166+0000","last_clean":"2024-08-27T03:58:36.460166+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:36.460166+0000","last_undegraded":"2024-08-27T03:58:36.460166+0000","last_fullsized":"2024-08-27T03:58:36.460166+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.460054+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:47.971880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":5169,"num_write":1020,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.024903+0000","last_change":"2024-08-27T03:58:52.024903+0000","last_active":"2024-08-27T03:58:52.024903+0000","last_peered":"2024-08-27T03:58:52.024903+0000","last_clean":"2024-08-27T03:58:52.024903+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:58:52.024903+0000","last_undegraded":"2024-08-27T03:58:52.024903+0000","last_fullsized":"2024-08-27T03:58:52.024903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.024712+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:21.647892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'304","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.719306+0000","last_change":"2024-08-27T02:31:10.462249+0000","last_active":"2024-08-27T03:58:31.719306+0000","last_peered":"2024-08-27T03:58:31.719306+0000","last_clean":"2024-08-27T03:58:31.719306+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:58:31.719306+0000","last_undegraded":"2024-08-27T03:58:31.719306+0000","last_fullsized":"2024-08-27T03:58:31.719306+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:09.431185+0000","last_clean_scrub_stamp":"2024-08-27T02:31:09.431185+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1035,"num_write":382,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.302006+0000","last_change":"2024-08-27T02:31:12.523057+0000","last_active":"2024-08-27T03:56:15.302006+0000","last_peered":"2024-08-27T03:56:15.302006+0000","last_clean":"2024-08-27T03:56:15.302006+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:56:15.302006+0000","last_undegraded":"2024-08-27T03:56:15.302006+0000","last_fullsized":"2024-08-27T03:56:15.302006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:11.460507+0000","last_clean_scrub_stamp":"2024-08-27T02:31:11.460507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'144","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.904543+0000","last_change":"2024-08-27T02:31:14.506679+0000","last_active":"2024-08-27T03:58:02.904543+0000","last_peered":"2024-08-27T03:58:02.904543+0000","last_clean":"2024-08-27T03:58:02.904543+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:58:02.904543+0000","last_undegraded":"2024-08-27T03:58:02.904543+0000","last_fullsized":"2024-08-27T03:58:02.904543+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:33.099195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'735","reported_seq":2165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.025008+0000","last_change":"2024-08-27T03:58:50.025008+0000","last_active":"2024-08-27T03:58:50.025008+0000","last_peered":"2024-08-27T03:58:50.025008+0000","last_clean":"2024-08-27T03:58:50.025008+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:58:50.025008+0000","last_undegraded":"2024-08-27T03:58:50.025008+0000","last_fullsized":"2024-08-27T03:58:50.025008+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.024830+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:49:32.647435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'329","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.800869+0000","last_change":"2024-08-27T03:58:42.800869+0000","last_active":"2024-08-27T03:58:42.800869+0000","last_peered":"2024-08-27T03:58:42.800869+0000","last_clean":"2024-08-27T03:58:42.800869+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:42.800869+0000","last_undegraded":"2024-08-27T03:58:42.800869+0000","last_fullsized":"2024-08-27T03:58:42.800869+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.800622+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:33:49.686872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":48183,"num_write":1083,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'442","reported_seq":1929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.120033+0000","last_change":"2024-08-27T03:58:48.120033+0000","last_active":"2024-08-27T03:58:48.120033+0000","last_peered":"2024-08-27T03:58:48.120033+0000","last_clean":"2024-08-27T03:58:48.120033+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:58:48.120033+0000","last_undegraded":"2024-08-27T03:58:48.120033+0000","last_fullsized":"2024-08-27T03:58:48.120033+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.119733+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:29.430226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3054,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'381","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.564535+0000","last_change":"2024-08-27T03:58:38.564535+0000","last_active":"2024-08-27T03:58:38.564535+0000","last_peered":"2024-08-27T03:58:38.564535+0000","last_clean":"2024-08-27T03:58:38.564535+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:38.564535+0000","last_undegraded":"2024-08-27T03:58:38.564535+0000","last_fullsized":"2024-08-27T03:58:38.564535+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.564446+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:04.060769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4832339,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":9918,"num_write":1168,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'478","reported_seq":2162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.793519+0000","last_change":"2024-08-27T03:58:52.793519+0000","last_active":"2024-08-27T03:58:52.793519+0000","last_peered":"2024-08-27T03:58:52.793519+0000","last_clean":"2024-08-27T03:58:52.793519+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:58:52.793519+0000","last_undegraded":"2024-08-27T03:58:52.793519+0000","last_fullsized":"2024-08-27T03:58:52.793519+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.793225+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:15:04.836952+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'405","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.611512+0000","last_change":"2024-08-27T03:58:41.611512+0000","last_active":"2024-08-27T03:58:41.611512+0000","last_peered":"2024-08-27T03:58:41.611512+0000","last_clean":"2024-08-27T03:58:41.611512+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:41.611512+0000","last_undegraded":"2024-08-27T03:58:41.611512+0000","last_fullsized":"2024-08-27T03:58:41.611512+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.611152+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:19.609163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":15883,"num_write":1180,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'572","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.069728+0000","last_change":"2024-08-27T03:58:49.069728+0000","last_active":"2024-08-27T03:58:49.069728+0000","last_peered":"2024-08-27T03:58:49.069728+0000","last_clean":"2024-08-27T03:58:49.069728+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:58:49.069728+0000","last_undegraded":"2024-08-27T03:58:49.069728+0000","last_fullsized":"2024-08-27T03:58:49.069728+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'572","last_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_deep_scrub":"267'572","last_deep_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.069503+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:29:30.858578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'308","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.438198+0000","last_change":"2024-08-27T03:58:41.438047+0000","last_active":"2024-08-27T03:58:41.438198+0000","last_peered":"2024-08-27T03:58:41.438198+0000","last_clean":"2024-08-27T03:58:41.438198+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:41.438198+0000","last_undegraded":"2024-08-27T03:58:41.438198+0000","last_fullsized":"2024-08-27T03:58:41.438198+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.437794+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:06.786909+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":27259,"num_write":1007,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'606","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.938985+0000","last_change":"2024-08-27T02:31:06.461548+0000","last_active":"2024-08-27T03:58:02.938985+0000","last_peered":"2024-08-27T03:58:02.938985+0000","last_clean":"2024-08-27T03:58:02.938985+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:02.938985+0000","last_undegraded":"2024-08-27T03:58:02.938985+0000","last_fullsized":"2024-08-27T03:58:02.938985+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":500,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:54:26.910185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'362","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.146680+0000","last_change":"2024-08-27T03:58:43.146680+0000","last_active":"2024-08-27T03:58:43.146680+0000","last_peered":"2024-08-27T03:58:43.146680+0000","last_clean":"2024-08-27T03:58:43.146680+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:43.146680+0000","last_undegraded":"2024-08-27T03:58:43.146680+0000","last_fullsized":"2024-08-27T03:58:43.146680+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.146441+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:58:04.187894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589954,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":45255,"num_write":1058,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'439","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.642061+0000","last_change":"2024-08-27T03:58:51.642061+0000","last_active":"2024-08-27T03:58:51.642061+0000","last_peered":"2024-08-27T03:58:51.642061+0000","last_clean":"2024-08-27T03:58:51.642061+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:58:51.642061+0000","last_undegraded":"2024-08-27T03:58:51.642061+0000","last_fullsized":"2024-08-27T03:58:51.642061+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.641812+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:39.903323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'354","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.112270+0000","last_change":"2024-08-27T03:58:40.112270+0000","last_active":"2024-08-27T03:58:40.112270+0000","last_peered":"2024-08-27T03:58:40.112270+0000","last_clean":"2024-08-27T03:58:40.112270+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:40.112270+0000","last_undegraded":"2024-08-27T03:58:40.112270+0000","last_fullsized":"2024-08-27T03:58:40.112270+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.112024+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:55:42.841093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":26119,"num_write":1309,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'574","reported_seq":2442,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.995616+0000","last_change":"2024-08-27T02:31:06.447514+0000","last_active":"2024-08-27T03:58:02.995616+0000","last_peered":"2024-08-27T03:58:02.995616+0000","last_clean":"2024-08-27T03:58:02.995616+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:02.995616+0000","last_undegraded":"2024-08-27T03:58:02.995616+0000","last_fullsized":"2024-08-27T03:58:02.995616+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'308","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.582428+0000","last_change":"2024-08-27T03:58:39.582428+0000","last_active":"2024-08-27T03:58:39.582428+0000","last_peered":"2024-08-27T03:58:39.582428+0000","last_clean":"2024-08-27T03:58:39.582428+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:39.582428+0000","last_undegraded":"2024-08-27T03:58:39.582428+0000","last_fullsized":"2024-08-27T03:58:39.582428+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.582204+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:55:21.476541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307067,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":100247,"num_write":1030,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'454","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.736038+0000","last_change":"2024-08-27T03:58:48.736038+0000","last_active":"2024-08-27T03:58:48.736038+0000","last_peered":"2024-08-27T03:58:48.736038+0000","last_clean":"2024-08-27T03:58:48.736038+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:58:48.736038+0000","last_undegraded":"2024-08-27T03:58:48.736038+0000","last_fullsized":"2024-08-27T03:58:48.736038+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.735856+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:12:29.368472+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2019,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'357","reported_seq":1060,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.173217+0000","last_change":"2024-08-27T03:58:44.173217+0000","last_active":"2024-08-27T03:58:44.173217+0000","last_peered":"2024-08-27T03:58:44.173217+0000","last_clean":"2024-08-27T03:58:44.173217+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:44.173217+0000","last_undegraded":"2024-08-27T03:58:44.173217+0000","last_fullsized":"2024-08-27T03:58:44.173217+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.172971+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:58.313423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":565,"num_read_kb":99962,"num_write":1217,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'362","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.516342+0000","last_change":"2024-08-27T03:58:50.516342+0000","last_active":"2024-08-27T03:58:50.516342+0000","last_peered":"2024-08-27T03:58:50.516342+0000","last_clean":"2024-08-27T03:58:50.516342+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:50.516342+0000","last_undegraded":"2024-08-27T03:58:50.516342+0000","last_fullsized":"2024-08-27T03:58:50.516342+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.516132+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:42.736992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'281","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.755250+0000","last_change":"2024-08-27T03:58:43.755250+0000","last_active":"2024-08-27T03:58:43.755250+0000","last_peered":"2024-08-27T03:58:43.755250+0000","last_clean":"2024-08-27T03:58:43.755250+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:43.755250+0000","last_undegraded":"2024-08-27T03:58:43.755250+0000","last_fullsized":"2024-08-27T03:58:43.755250+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'281","last_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_deep_scrub":"267'281","last_deep_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.755021+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:17:25.889381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":397,"num_read_kb":6749,"num_write":934,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'640","reported_seq":2336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.655397+0000","last_change":"2024-08-27T03:58:53.655397+0000","last_active":"2024-08-27T03:58:53.655397+0000","last_peered":"2024-08-27T03:58:53.655397+0000","last_clean":"2024-08-27T03:58:53.655397+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:58:53.655397+0000","last_undegraded":"2024-08-27T03:58:53.655397+0000","last_fullsized":"2024-08-27T03:58:53.655397+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'640","last_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_deep_scrub":"267'640","last_deep_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.655199+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:10:17.157916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.138975+0000","last_change":"2024-08-27T03:58:46.138796+0000","last_active":"2024-08-27T03:58:46.138975+0000","last_peered":"2024-08-27T03:58:46.138975+0000","last_clean":"2024-08-27T03:58:46.138975+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:46.138975+0000","last_undegraded":"2024-08-27T03:58:46.138975+0000","last_fullsized":"2024-08-27T03:58:46.138975+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.138421+0000","objects_scrubbed":14,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:00:21.270930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2798159,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":560,"num_read_kb":2754,"num_write":1269,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'438","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.558545+0000","last_change":"2024-08-27T03:58:44.558545+0000","last_active":"2024-08-27T03:58:44.558545+0000","last_peered":"2024-08-27T03:58:44.558545+0000","last_clean":"2024-08-27T03:58:44.558545+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:58:44.558545+0000","last_undegraded":"2024-08-27T03:58:44.558545+0000","last_fullsized":"2024-08-27T03:58:44.558545+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.558365+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:06:32.373887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'313","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.746753+0000","last_change":"2024-08-27T03:58:42.746489+0000","last_active":"2024-08-27T03:58:42.746753+0000","last_peered":"2024-08-27T03:58:42.746753+0000","last_clean":"2024-08-27T03:58:42.746753+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:42.746753+0000","last_undegraded":"2024-08-27T03:58:42.746753+0000","last_fullsized":"2024-08-27T03:58:42.746753+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.746119+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:28:53.493047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":2564,"num_write":1048,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'614","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.680745+0000","last_change":"2024-08-27T03:58:52.680599+0000","last_active":"2024-08-27T03:58:52.680745+0000","last_peered":"2024-08-27T03:58:52.680745+0000","last_clean":"2024-08-27T03:58:52.680745+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:58:52.680745+0000","last_undegraded":"2024-08-27T03:58:52.680745+0000","last_fullsized":"2024-08-27T03:58:52.680745+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'614","last_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_deep_scrub":"267'614","last_deep_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.680388+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:22.858376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3063,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":1135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.392992+0000","last_change":"2024-08-27T03:58:42.392831+0000","last_active":"2024-08-27T03:58:42.392992+0000","last_peered":"2024-08-27T03:58:42.392992+0000","last_clean":"2024-08-27T03:58:42.392992+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:42.392992+0000","last_undegraded":"2024-08-27T03:58:42.392992+0000","last_fullsized":"2024-08-27T03:58:42.392992+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.392600+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:02.371839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":686594,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":79613,"num_write":1033,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'505","reported_seq":2138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.928880+0000","last_change":"2024-08-27T03:58:52.928741+0000","last_active":"2024-08-27T03:58:52.928880+0000","last_peered":"2024-08-27T03:58:52.928880+0000","last_clean":"2024-08-27T03:58:52.928880+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:58:52.928880+0000","last_undegraded":"2024-08-27T03:58:52.928880+0000","last_fullsized":"2024-08-27T03:58:52.928880+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'505","last_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_deep_scrub":"267'505","last_deep_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.928533+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:07.897474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'307","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.809517+0000","last_change":"2024-08-27T03:58:40.809278+0000","last_active":"2024-08-27T03:58:40.809517+0000","last_peered":"2024-08-27T03:58:40.809517+0000","last_clean":"2024-08-27T03:58:40.809517+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:40.809517+0000","last_undegraded":"2024-08-27T03:58:40.809517+0000","last_fullsized":"2024-08-27T03:58:40.809517+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.808995+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:03:10.468667+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911567,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":603,"num_read_kb":25477,"num_write":981,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'803","reported_seq":2706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.528961+0000","last_change":"2024-08-27T03:58:53.528826+0000","last_active":"2024-08-27T03:58:53.528961+0000","last_peered":"2024-08-27T03:58:53.528961+0000","last_clean":"2024-08-27T03:58:53.528961+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:53.528961+0000","last_undegraded":"2024-08-27T03:58:53.528961+0000","last_fullsized":"2024-08-27T03:58:53.528961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'803","last_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_deep_scrub":"267'803","last_deep_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.528622+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:57.111154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'311","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.903809+0000","last_change":"2024-08-27T03:58:46.903809+0000","last_active":"2024-08-27T03:58:46.903809+0000","last_peered":"2024-08-27T03:58:46.903809+0000","last_clean":"2024-08-27T03:58:46.903809+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:46.903809+0000","last_undegraded":"2024-08-27T03:58:46.903809+0000","last_fullsized":"2024-08-27T03:58:46.903809+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.903570+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:32:09.302081+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311643,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":75812,"num_write":989,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'417","reported_seq":1898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.908524+0000","last_change":"2024-08-27T02:31:06.460970+0000","last_active":"2024-08-27T03:56:39.908524+0000","last_peered":"2024-08-27T03:56:39.908524+0000","last_clean":"2024-08-27T03:56:39.908524+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:56:39.908524+0000","last_undegraded":"2024-08-27T03:56:39.908524+0000","last_fullsized":"2024-08-27T03:56:39.908524+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'422","reported_seq":1349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.595085+0000","last_change":"2024-08-27T03:58:42.595085+0000","last_active":"2024-08-27T03:58:42.595085+0000","last_peered":"2024-08-27T03:58:42.595085+0000","last_clean":"2024-08-27T03:58:42.595085+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:42.595085+0000","last_undegraded":"2024-08-27T03:58:42.595085+0000","last_fullsized":"2024-08-27T03:58:42.595085+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.594805+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:16.906357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1005,"num_read_kb":143555,"num_write":1198,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'387","reported_seq":1799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.901866+0000","last_change":"2024-08-27T03:58:45.901866+0000","last_active":"2024-08-27T03:58:45.901866+0000","last_peered":"2024-08-27T03:58:45.901866+0000","last_clean":"2024-08-27T03:58:45.901866+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:58:45.901866+0000","last_undegraded":"2024-08-27T03:58:45.901866+0000","last_fullsized":"2024-08-27T03:58:45.901866+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.901684+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:11:59.846712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'359","reported_seq":1058,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.749864+0000","last_change":"2024-08-27T03:58:44.749864+0000","last_active":"2024-08-27T03:58:44.749864+0000","last_peered":"2024-08-27T03:58:44.749864+0000","last_clean":"2024-08-27T03:58:44.749864+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:44.749864+0000","last_undegraded":"2024-08-27T03:58:44.749864+0000","last_fullsized":"2024-08-27T03:58:44.749864+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.749636+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:42.137274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":596,"num_read_kb":11844,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'342","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.754972+0000","last_change":"2024-08-27T03:58:45.754972+0000","last_active":"2024-08-27T03:58:45.754972+0000","last_peered":"2024-08-27T03:58:45.754972+0000","last_clean":"2024-08-27T03:58:45.754972+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:45.754972+0000","last_undegraded":"2024-08-27T03:58:45.754972+0000","last_fullsized":"2024-08-27T03:58:45.754972+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.754732+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:10.198393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":4948,"num_write":1064,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'381","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:00.298368+0000","last_change":"2024-08-27T02:31:39.753199+0000","last_active":"2024-08-27T03:56:00.298368+0000","last_peered":"2024-08-27T03:56:00.298368+0000","last_clean":"2024-08-27T03:56:00.298368+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:56:00.298368+0000","last_undegraded":"2024-08-27T03:56:00.298368+0000","last_fullsized":"2024-08-27T03:56:00.298368+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:05.411380+0000","last_clean_scrub_stamp":"2024-08-27T02:31:05.411380+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:20:26.815028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'342","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.113500+0000","last_change":"2024-08-27T03:58:42.113500+0000","last_active":"2024-08-27T03:58:42.113500+0000","last_peered":"2024-08-27T03:58:42.113500+0000","last_clean":"2024-08-27T03:58:42.113500+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:42.113500+0000","last_undegraded":"2024-08-27T03:58:42.113500+0000","last_fullsized":"2024-08-27T03:58:42.113500+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.113238+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:33.105083+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381353,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":621,"num_read_kb":18083,"num_write":1130,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.823347+0000","last_change":"2024-08-27T03:58:54.823347+0000","last_active":"2024-08-27T03:58:54.823347+0000","last_peered":"2024-08-27T03:58:54.823347+0000","last_clean":"2024-08-27T03:58:54.823347+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:54.823347+0000","last_undegraded":"2024-08-27T03:58:54.823347+0000","last_fullsized":"2024-08-27T03:58:54.823347+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'698","last_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_deep_scrub":"267'698","last_deep_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.823157+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:51:42.227530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1592,"ondisk_log_size":1592,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":456,"ondisk_log_size":456,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1439020,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19446,"num_read_kb":39405,"num_write":16215,"num_write_kb":11798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23904,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1976,"ondisk_log_size":1976,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37716,"num_omap_keys":153,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4089,"ondisk_log_size":4089,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65339946,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":35598,"num_read_kb":1916438,"num_write":70403,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89604096,"data_stored":89604096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3354,"ondisk_log_size":3354,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":208074,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198799,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510500,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192136,"kb_used_data":12472,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94179704,"statfs":{"total":96636764160,"available":96440016896,"internally_reserved":0,"allocated":12771328,"data_stored":10781565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543209,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339224,"kb_used_data":15112,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94032616,"statfs":{"total":96636764160,"available":96289398784,"internally_reserved":0,"allocated":15474688,"data_stored":13471118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543210,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305116,"kb_used_data":17100,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94066724,"statfs":{"total":96636764160,"available":96324325376,"internally_reserved":0,"allocated":17510400,"data_stored":15551496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543207,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162756,"kb_used_data":15028,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94209084,"statfs":{"total":96636764160,"available":96470102016,"internally_reserved":0,"allocated":15388672,"data_stored":13349611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543206,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134208,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94237632,"statfs":{"total":96636764160,"available":96499335168,"internally_reserved":0,"allocated":17350656,"data_stored":15406568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543208,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293612,"kb_used_data":13916,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94078228,"statfs":{"total":96636764160,"available":96336105472,"internally_reserved":0,"allocated":14249984,"data_stored":12236496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543210,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113428,"kb_used_data":14212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94258412,"statfs":{"total":96636764160,"available":96520613888,"internally_reserved":0,"allocated":14553088,"data_stored":12591031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543208,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301160,"kb_used_data":17368,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94070680,"statfs":{"total":96636764160,"available":96328376320,"internally_reserved":0,"allocated":17784832,"data_stored":15748401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":12861440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8486912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10297344,"data_stored":10297344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9940992,"data_stored":9940992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13115392,"data_stored":13115392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11055104,"data_stored":11055104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13258752,"data_stored":13258752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10588160,"data_stored":10588160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T03:58:59.113 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.114 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.115 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.116 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.116 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.116 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.116 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.116 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.116 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.116 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.117 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.118 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.119 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.120 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.120 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.120 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.120 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.120 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.121 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.121 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.122 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.123 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.124 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.125 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.126 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.127 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.128 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.129 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.130 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.130 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.130 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.130 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.130 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.130 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.130 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.131 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.132 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.133 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.134 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.135 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.136 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.137 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.138 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.139 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.140 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.141 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-08-27T02:31:07.418186+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=7, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.142 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.143 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-08-27T02:31:09.431185+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=9, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.143 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-08-27T02:31:11.460507+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=11, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.143 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.143 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.143 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.143 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.144 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-08-27T02:31:05.411380+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=5, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:58:59.144 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-27T03:59:19.146 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T03:59:19.513 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:59:19.527 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T03:59:19.544 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2916,"stamp":"2024-08-27T03:59:19.314378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67386791,"num_objects":861,"num_object_clones":0,"num_object_copies":2456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":287806,"num_read_kb":2575721,"num_write":159683,"num_write_kb":2372746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":724949,"num_omap_keys":1740,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12899,"ondisk_log_size":12899,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1841640,"kb_used_data":122152,"kb_used_omap":12,"kb_used_meta":1719347,"kb_avail":753133080,"statfs":{"total":773094113280,"available":771208273920,"internally_reserved":0,"allocated":125083648,"data_stored":109136286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1760611889},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17447,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009073"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.875576+0000","last_change":"2024-08-27T03:10:45.291800+0000","last_active":"2024-08-27T03:55:44.875576+0000","last_peered":"2024-08-27T03:55:44.875576+0000","last_clean":"2024-08-27T03:55:44.875576+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:55:44.875576+0000","last_undegraded":"2024-08-27T03:55:44.875576+0000","last_fullsized":"2024-08-27T03:55:44.875576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:23:36.039939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.913854+0000","last_change":"2024-08-27T02:50:55.799193+0000","last_active":"2024-08-27T03:58:24.913854+0000","last_peered":"2024-08-27T03:58:24.913854+0000","last_clean":"2024-08-27T03:58:24.913854+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:58:24.913854+0000","last_undegraded":"2024-08-27T03:58:24.913854+0000","last_fullsized":"2024-08-27T03:58:24.913854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:21:44.106748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.896443+0000","last_change":"2024-08-27T02:50:51.735635+0000","last_active":"2024-08-27T03:55:54.896443+0000","last_peered":"2024-08-27T03:55:54.896443+0000","last_clean":"2024-08-27T03:55:54.896443+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:55:54.896443+0000","last_undegraded":"2024-08-27T03:55:54.896443+0000","last_fullsized":"2024-08-27T03:55:54.896443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:15:41.686947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.292121+0000","last_change":"2024-08-27T02:46:49.663999+0000","last_active":"2024-08-27T03:55:35.292121+0000","last_peered":"2024-08-27T03:55:35.292121+0000","last_clean":"2024-08-27T03:55:35.292121+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:55:35.292121+0000","last_undegraded":"2024-08-27T03:55:35.292121+0000","last_fullsized":"2024-08-27T03:55:35.292121+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:06:26.935384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.746197+0000","last_change":"2024-08-27T03:59:08.746197+0000","last_active":"2024-08-27T03:59:08.746197+0000","last_peered":"2024-08-27T03:59:08.746197+0000","last_clean":"2024-08-27T03:59:08.746197+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:59:08.746197+0000","last_undegraded":"2024-08-27T03:59:08.746197+0000","last_fullsized":"2024-08-27T03:59:08.746197+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.746006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.746006+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.746006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:47:08.897021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:25.128164+0000","last_change":"2024-08-27T02:50:55.775244+0000","last_active":"2024-08-27T03:58:25.128164+0000","last_peered":"2024-08-27T03:58:25.128164+0000","last_clean":"2024-08-27T03:58:25.128164+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:58:25.128164+0000","last_undegraded":"2024-08-27T03:58:25.128164+0000","last_fullsized":"2024-08-27T03:58:25.128164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:30.406512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.201955+0000","last_change":"2024-08-27T03:59:09.201955+0000","last_active":"2024-08-27T03:59:09.201955+0000","last_peered":"2024-08-27T03:59:09.201955+0000","last_clean":"2024-08-27T03:59:09.201955+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:59:09.201955+0000","last_undegraded":"2024-08-27T03:59:09.201955+0000","last_fullsized":"2024-08-27T03:59:09.201955+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.201764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.201764+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.201764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:29:18.110424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.598339+0000","last_change":"2024-08-27T03:58:58.598204+0000","last_active":"2024-08-27T03:58:58.598339+0000","last_peered":"2024-08-27T03:58:58.598339+0000","last_clean":"2024-08-27T03:58:58.598339+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:58:58.598339+0000","last_undegraded":"2024-08-27T03:58:58.598339+0000","last_fullsized":"2024-08-27T03:58:58.598339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.598012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.598012+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.598012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:05:32.629463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.407284+0000","last_change":"2024-08-27T03:59:13.407284+0000","last_active":"2024-08-27T03:59:13.407284+0000","last_peered":"2024-08-27T03:59:13.407284+0000","last_clean":"2024-08-27T03:59:13.407284+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:59:13.407284+0000","last_undegraded":"2024-08-27T03:59:13.407284+0000","last_fullsized":"2024-08-27T03:59:13.407284+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:13.407108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:13.407108+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.407108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:52:47.993833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290928+0000","last_change":"2024-08-27T02:50:55.791602+0000","last_active":"2024-08-27T03:55:30.290928+0000","last_peered":"2024-08-27T03:55:30.290928+0000","last_clean":"2024-08-27T03:55:30.290928+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:55:30.290928+0000","last_undegraded":"2024-08-27T03:55:30.290928+0000","last_fullsized":"2024-08-27T03:55:30.290928+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:05.925142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'11","reported_seq":92,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.632523+0000","last_change":"2024-08-27T03:59:04.632379+0000","last_active":"2024-08-27T03:59:04.632523+0000","last_peered":"2024-08-27T03:59:04.632523+0000","last_clean":"2024-08-27T03:59:04.632523+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:59:04.632523+0000","last_undegraded":"2024-08-27T03:59:04.632523+0000","last_fullsized":"2024-08-27T03:59:04.632523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-08-27T03:59:04.632165+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-08-27T03:59:04.632165+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.632165+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:22:34.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21563,"num_write":16,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:20.494185+0000","last_change":"2024-08-27T02:46:49.653398+0000","last_active":"2024-08-27T03:54:20.494185+0000","last_peered":"2024-08-27T03:54:20.494185+0000","last_clean":"2024-08-27T03:54:20.494185+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:54:20.494185+0000","last_undegraded":"2024-08-27T03:54:20.494185+0000","last_fullsized":"2024-08-27T03:54:20.494185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:50.129103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871224+0000","last_change":"2024-08-27T03:10:45.281316+0000","last_active":"2024-08-27T03:54:29.871224+0000","last_peered":"2024-08-27T03:54:29.871224+0000","last_clean":"2024-08-27T03:54:29.871224+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:54:29.871224+0000","last_undegraded":"2024-08-27T03:54:29.871224+0000","last_fullsized":"2024-08-27T03:54:29.871224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:26.936076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:14.916766+0000","last_change":"2024-08-27T02:50:55.794295+0000","last_active":"2024-08-27T03:57:14.916766+0000","last_peered":"2024-08-27T03:57:14.916766+0000","last_clean":"2024-08-27T03:57:14.916766+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:57:14.916766+0000","last_undegraded":"2024-08-27T03:57:14.916766+0000","last_fullsized":"2024-08-27T03:57:14.916766+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.087490+0000","last_change":"2024-08-27T02:50:51.720342+0000","last_active":"2024-08-27T03:55:30.087490+0000","last_peered":"2024-08-27T03:55:30.087490+0000","last_clean":"2024-08-27T03:55:30.087490+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:55:30.087490+0000","last_undegraded":"2024-08-27T03:55:30.087490+0000","last_fullsized":"2024-08-27T03:55:30.087490+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:16:13.056385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868989+0000","last_change":"2024-08-27T02:46:49.680620+0000","last_active":"2024-08-27T03:54:19.868989+0000","last_peered":"2024-08-27T03:54:19.868989+0000","last_clean":"2024-08-27T03:54:19.868989+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:54:19.868989+0000","last_undegraded":"2024-08-27T03:54:19.868989+0000","last_fullsized":"2024-08-27T03:54:19.868989+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:46:31.779704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:59.913777+0000","last_change":"2024-08-27T03:10:45.289727+0000","last_active":"2024-08-27T03:56:59.913777+0000","last_peered":"2024-08-27T03:56:59.913777+0000","last_clean":"2024-08-27T03:56:59.913777+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:56:59.913777+0000","last_undegraded":"2024-08-27T03:56:59.913777+0000","last_fullsized":"2024-08-27T03:56:59.913777+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:29.886332+0000","last_change":"2024-08-27T02:50:55.806362+0000","last_active":"2024-08-27T03:56:29.886332+0000","last_peered":"2024-08-27T03:56:29.886332+0000","last_clean":"2024-08-27T03:56:29.886332+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:56:29.886332+0000","last_undegraded":"2024-08-27T03:56:29.886332+0000","last_fullsized":"2024-08-27T03:56:29.886332+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.282979+0000","last_change":"2024-08-27T02:50:51.720059+0000","last_active":"2024-08-27T03:58:31.282979+0000","last_peered":"2024-08-27T03:58:31.282979+0000","last_clean":"2024-08-27T03:58:31.282979+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:58:31.282979+0000","last_undegraded":"2024-08-27T03:58:31.282979+0000","last_fullsized":"2024-08-27T03:58:31.282979+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:19.868908+0000","last_change":"2024-08-27T02:46:49.675252+0000","last_active":"2024-08-27T03:54:19.868908+0000","last_peered":"2024-08-27T03:54:19.868908+0000","last_clean":"2024-08-27T03:54:19.868908+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:54:19.868908+0000","last_undegraded":"2024-08-27T03:54:19.868908+0000","last_fullsized":"2024-08-27T03:54:19.868908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:11.184532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.174375+0000","last_change":"2024-08-27T03:59:14.174375+0000","last_active":"2024-08-27T03:59:14.174375+0000","last_peered":"2024-08-27T03:59:14.174375+0000","last_clean":"2024-08-27T03:59:14.174375+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:59:14.174375+0000","last_undegraded":"2024-08-27T03:59:14.174375+0000","last_fullsized":"2024-08-27T03:59:14.174375+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:14.174178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:14.174178+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.174178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:51:05.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.453969+0000","last_change":"2024-08-27T03:59:11.453969+0000","last_active":"2024-08-27T03:59:11.453969+0000","last_peered":"2024-08-27T03:59:11.453969+0000","last_clean":"2024-08-27T03:59:11.453969+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:59:11.453969+0000","last_undegraded":"2024-08-27T03:59:11.453969+0000","last_fullsized":"2024-08-27T03:59:11.453969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:11.453796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:11.453796+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.453796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:09:33.686927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.879641+0000","last_change":"2024-08-27T02:50:51.707799+0000","last_active":"2024-08-27T03:58:29.879641+0000","last_peered":"2024-08-27T03:58:29.879641+0000","last_clean":"2024-08-27T03:58:29.879641+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:58:29.879641+0000","last_undegraded":"2024-08-27T03:58:29.879641+0000","last_fullsized":"2024-08-27T03:58:29.879641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.481621+0000","last_change":"2024-08-27T03:59:06.481621+0000","last_active":"2024-08-27T03:59:06.481621+0000","last_peered":"2024-08-27T03:59:06.481621+0000","last_clean":"2024-08-27T03:59:06.481621+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:59:06.481621+0000","last_undegraded":"2024-08-27T03:59:06.481621+0000","last_fullsized":"2024-08-27T03:59:06.481621+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'18","last_scrub_stamp":"2024-08-27T03:59:06.481436+0000","last_deep_scrub":"267'18","last_deep_scrub_stamp":"2024-08-27T03:59:06.481436+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.481436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:11:24.160204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299701+0000","last_change":"2024-08-27T03:10:45.293045+0000","last_active":"2024-08-27T03:55:45.299701+0000","last_peered":"2024-08-27T03:55:45.299701+0000","last_clean":"2024-08-27T03:55:45.299701+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:55:45.299701+0000","last_undegraded":"2024-08-27T03:55:45.299701+0000","last_fullsized":"2024-08-27T03:55:45.299701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:53:47.782276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'6","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.455410+0000","last_change":"2024-08-27T03:59:12.455410+0000","last_active":"2024-08-27T03:59:12.455410+0000","last_peered":"2024-08-27T03:59:12.455410+0000","last_clean":"2024-08-27T03:59:12.455410+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:59:12.455410+0000","last_undegraded":"2024-08-27T03:59:12.455410+0000","last_fullsized":"2024-08-27T03:59:12.455410+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:12.455234+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:12.455234+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.455234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:00:39.579700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.841038+0000","last_change":"2024-08-27T02:50:51.738475+0000","last_active":"2024-08-27T03:58:30.841038+0000","last_peered":"2024-08-27T03:58:30.841038+0000","last_clean":"2024-08-27T03:58:30.841038+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:58:30.841038+0000","last_undegraded":"2024-08-27T03:58:30.841038+0000","last_fullsized":"2024-08-27T03:58:30.841038+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:26:56.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:40.497953+0000","last_change":"2024-08-27T02:46:49.647868+0000","last_active":"2024-08-27T03:54:40.497953+0000","last_peered":"2024-08-27T03:54:40.497953+0000","last_clean":"2024-08-27T03:54:40.497953+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:54:40.497953+0000","last_undegraded":"2024-08-27T03:54:40.497953+0000","last_fullsized":"2024-08-27T03:54:40.497953+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:28:45.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":32,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299830+0000","last_change":"2024-08-27T03:10:45.284842+0000","last_active":"2024-08-27T03:55:45.299830+0000","last_peered":"2024-08-27T03:55:45.299830+0000","last_clean":"2024-08-27T03:55:45.299830+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:55:45.299830+0000","last_undegraded":"2024-08-27T03:55:45.299830+0000","last_fullsized":"2024-08-27T03:55:45.299830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:45:04.454859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930510+0000","last_change":"2024-08-27T02:50:55.778273+0000","last_active":"2024-08-27T03:58:24.930510+0000","last_peered":"2024-08-27T03:58:24.930510+0000","last_clean":"2024-08-27T03:58:24.930510+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:58:24.930510+0000","last_undegraded":"2024-08-27T03:58:24.930510+0000","last_fullsized":"2024-08-27T03:58:24.930510+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:13:39.897663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.296625+0000","last_change":"2024-08-27T02:50:51.714543+0000","last_active":"2024-08-27T03:55:55.296625+0000","last_peered":"2024-08-27T03:55:55.296625+0000","last_clean":"2024-08-27T03:55:55.296625+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:55:55.296625+0000","last_undegraded":"2024-08-27T03:55:55.296625+0000","last_fullsized":"2024-08-27T03:55:55.296625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:34.299020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.208053+0000","last_change":"2024-08-27T03:59:07.208053+0000","last_active":"2024-08-27T03:59:07.208053+0000","last_peered":"2024-08-27T03:59:07.208053+0000","last_clean":"2024-08-27T03:59:07.208053+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:59:07.208053+0000","last_undegraded":"2024-08-27T03:59:07.208053+0000","last_fullsized":"2024-08-27T03:59:07.208053+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'51","last_scrub_stamp":"2024-08-27T03:59:07.207859+0000","last_deep_scrub":"267'51","last_deep_scrub_stamp":"2024-08-27T03:59:07.207859+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.207859+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:50:28.317913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.198216+0000","last_change":"2024-08-27T03:59:15.198216+0000","last_active":"2024-08-27T03:59:15.198216+0000","last_peered":"2024-08-27T03:59:15.198216+0000","last_clean":"2024-08-27T03:59:15.198216+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:59:15.198216+0000","last_undegraded":"2024-08-27T03:59:15.198216+0000","last_fullsized":"2024-08-27T03:59:15.198216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:15.198031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:15.198031+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.198031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:17:06.883269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.654528+0000","last_change":"2024-08-27T02:50:55.800701+0000","last_active":"2024-08-27T03:58:29.654528+0000","last_peered":"2024-08-27T03:58:29.654528+0000","last_clean":"2024-08-27T03:58:29.654528+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:58:29.654528+0000","last_undegraded":"2024-08-27T03:58:29.654528+0000","last_fullsized":"2024-08-27T03:58:29.654528+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:26:22.225737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'2","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:31.146232+0000","last_change":"2024-08-27T02:50:51.725068+0000","last_active":"2024-08-27T03:58:31.146232+0000","last_peered":"2024-08-27T03:58:31.146232+0000","last_clean":"2024-08-27T03:58:31.146232+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:58:31.146232+0000","last_undegraded":"2024-08-27T03:58:31.146232+0000","last_fullsized":"2024-08-27T03:58:31.146232+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:30.495980+0000","last_change":"2024-08-27T02:46:49.654801+0000","last_active":"2024-08-27T03:54:30.495980+0000","last_peered":"2024-08-27T03:54:30.495980+0000","last_clean":"2024-08-27T03:54:30.495980+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:54:30.495980+0000","last_undegraded":"2024-08-27T03:54:30.495980+0000","last_fullsized":"2024-08-27T03:54:30.495980+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:08.448754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.702701+0000","last_change":"2024-08-27T03:59:07.702701+0000","last_active":"2024-08-27T03:59:07.702701+0000","last_peered":"2024-08-27T03:59:07.702701+0000","last_clean":"2024-08-27T03:59:07.702701+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:59:07.702701+0000","last_undegraded":"2024-08-27T03:59:07.702701+0000","last_fullsized":"2024-08-27T03:59:07.702701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:07.702512+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:07.702512+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.702512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:36:10.239915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.499627+0000","last_change":"2024-08-27T02:51:41.064218+0000","last_active":"2024-08-27T03:54:50.499627+0000","last_peered":"2024-08-27T03:54:50.499627+0000","last_clean":"2024-08-27T03:54:50.499627+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:54:50.499627+0000","last_undegraded":"2024-08-27T03:54:50.499627+0000","last_fullsized":"2024-08-27T03:54:50.499627+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:59:05.157815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306276+0000","last_change":"2024-08-27T02:50:51.728712+0000","last_active":"2024-08-27T03:56:10.306276+0000","last_peered":"2024-08-27T03:56:10.306276+0000","last_clean":"2024-08-27T03:56:10.306276+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:56:10.306276+0000","last_undegraded":"2024-08-27T03:56:10.306276+0000","last_fullsized":"2024-08-27T03:56:10.306276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:43:32.708072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":308,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:29.871387+0000","last_change":"2024-08-27T02:46:49.674700+0000","last_active":"2024-08-27T03:54:29.871387+0000","last_peered":"2024-08-27T03:54:29.871387+0000","last_clean":"2024-08-27T03:54:29.871387+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:54:29.871387+0000","last_undegraded":"2024-08-27T03:54:29.871387+0000","last_fullsized":"2024-08-27T03:54:29.871387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:39:28.639475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:05.289661+0000","last_change":"2024-08-27T03:10:45.293007+0000","last_active":"2024-08-27T03:55:05.289661+0000","last_peered":"2024-08-27T03:55:05.289661+0000","last_clean":"2024-08-27T03:55:05.289661+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:55:05.289661+0000","last_undegraded":"2024-08-27T03:55:05.289661+0000","last_fullsized":"2024-08-27T03:55:05.289661+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:23:00.597660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900537+0000","last_change":"2024-08-27T02:50:55.799828+0000","last_active":"2024-08-27T03:56:09.900537+0000","last_peered":"2024-08-27T03:56:09.900537+0000","last_clean":"2024-08-27T03:56:09.900537+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:56:09.900537+0000","last_undegraded":"2024-08-27T03:56:09.900537+0000","last_fullsized":"2024-08-27T03:56:09.900537+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:54.431380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.638221+0000","last_change":"2024-08-27T03:59:02.638221+0000","last_active":"2024-08-27T03:59:02.638221+0000","last_peered":"2024-08-27T03:59:02.638221+0000","last_clean":"2024-08-27T03:59:02.638221+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:59:02.638221+0000","last_undegraded":"2024-08-27T03:59:02.638221+0000","last_fullsized":"2024-08-27T03:59:02.638221+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:02.637934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:02.637934+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.637934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:19.825120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.631616+0000","last_change":"2024-08-27T03:59:00.631616+0000","last_active":"2024-08-27T03:59:00.631616+0000","last_peered":"2024-08-27T03:59:00.631616+0000","last_clean":"2024-08-27T03:59:00.631616+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:59:00.631616+0000","last_undegraded":"2024-08-27T03:59:00.631616+0000","last_fullsized":"2024-08-27T03:59:00.631616+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-08-27T03:59:00.631344+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-08-27T03:59:00.631344+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.631344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:59.147750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:04.866169+0000","last_change":"2024-08-27T03:10:45.298256+0000","last_active":"2024-08-27T03:55:04.866169+0000","last_peered":"2024-08-27T03:55:04.866169+0000","last_clean":"2024-08-27T03:55:04.866169+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:55:04.866169+0000","last_undegraded":"2024-08-27T03:55:04.866169+0000","last_fullsized":"2024-08-27T03:55:04.866169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:20:23.614816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.841187+0000","last_change":"2024-08-27T02:50:55.769990+0000","last_active":"2024-08-27T03:58:30.841187+0000","last_peered":"2024-08-27T03:58:30.841187+0000","last_clean":"2024-08-27T03:58:30.841187+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:58:30.841187+0000","last_undegraded":"2024-08-27T03:58:30.841187+0000","last_fullsized":"2024-08-27T03:58:30.841187+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:30.128153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.809126+0000","last_change":"2024-08-27T02:50:51.699776+0000","last_active":"2024-08-27T03:58:29.809126+0000","last_peered":"2024-08-27T03:58:29.809126+0000","last_clean":"2024-08-27T03:58:29.809126+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:58:29.809126+0000","last_undegraded":"2024-08-27T03:58:29.809126+0000","last_fullsized":"2024-08-27T03:58:29.809126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:54:50.286162+0000","last_change":"2024-08-27T02:46:49.665181+0000","last_active":"2024-08-27T03:54:50.286162+0000","last_peered":"2024-08-27T03:54:50.286162+0000","last_clean":"2024-08-27T03:54:50.286162+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:54:50.286162+0000","last_undegraded":"2024-08-27T03:54:50.286162+0000","last_fullsized":"2024-08-27T03:54:50.286162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:14:42.937470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.908776+0000","last_change":"2024-08-27T03:10:45.289487+0000","last_active":"2024-08-27T03:56:39.908776+0000","last_peered":"2024-08-27T03:56:39.908776+0000","last_clean":"2024-08-27T03:56:39.908776+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:56:39.908776+0000","last_undegraded":"2024-08-27T03:56:39.908776+0000","last_fullsized":"2024-08-27T03:56:39.908776+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.339150+0000","last_change":"2024-08-27T02:50:55.787899+0000","last_active":"2024-08-27T03:58:30.339150+0000","last_peered":"2024-08-27T03:58:30.339150+0000","last_clean":"2024-08-27T03:58:30.339150+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:58:30.339150+0000","last_undegraded":"2024-08-27T03:58:30.339150+0000","last_fullsized":"2024-08-27T03:58:30.339150+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.097716+0000","last_change":"2024-08-27T02:50:51.710484+0000","last_active":"2024-08-27T03:56:15.097716+0000","last_peered":"2024-08-27T03:56:15.097716+0000","last_clean":"2024-08-27T03:56:15.097716+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:56:15.097716+0000","last_undegraded":"2024-08-27T03:56:15.097716+0000","last_fullsized":"2024-08-27T03:56:15.097716+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:35:36.294957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.746494+0000","last_change":"2024-08-27T03:59:13.746494+0000","last_active":"2024-08-27T03:59:13.746494+0000","last_peered":"2024-08-27T03:59:13.746494+0000","last_clean":"2024-08-27T03:59:13.746494+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:59:13.746494+0000","last_undegraded":"2024-08-27T03:59:13.746494+0000","last_fullsized":"2024-08-27T03:59:13.746494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-08-27T03:59:13.746262+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-08-27T03:59:13.746262+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.746262+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:39:18.859681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:40.308347+0000","last_change":"2024-08-27T03:10:45.282295+0000","last_active":"2024-08-27T03:56:40.308347+0000","last_peered":"2024-08-27T03:56:40.308347+0000","last_clean":"2024-08-27T03:56:40.308347+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:56:40.308347+0000","last_undegraded":"2024-08-27T03:56:40.308347+0000","last_fullsized":"2024-08-27T03:56:40.308347+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.165657+0000","last_change":"2024-08-27T03:59:13.165657+0000","last_active":"2024-08-27T03:59:13.165657+0000","last_peered":"2024-08-27T03:59:13.165657+0000","last_clean":"2024-08-27T03:59:13.165657+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:59:13.165657+0000","last_undegraded":"2024-08-27T03:59:13.165657+0000","last_fullsized":"2024-08-27T03:59:13.165657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:13.165473+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:13.165473+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.165473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:55:33.719279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.901513+0000","last_change":"2024-08-27T02:50:51.730019+0000","last_active":"2024-08-27T03:56:14.901513+0000","last_peered":"2024-08-27T03:56:14.901513+0000","last_clean":"2024-08-27T03:56:14.901513+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:56:14.901513+0000","last_undegraded":"2024-08-27T03:56:14.901513+0000","last_fullsized":"2024-08-27T03:56:14.901513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:32:46.716300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:50.310568+0000","last_change":"2024-08-27T02:46:49.666192+0000","last_active":"2024-08-27T03:56:50.310568+0000","last_peered":"2024-08-27T03:56:50.310568+0000","last_clean":"2024-08-27T03:56:50.310568+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:56:50.310568+0000","last_undegraded":"2024-08-27T03:56:50.310568+0000","last_fullsized":"2024-08-27T03:56:50.310568+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287223+0000","last_change":"2024-08-27T03:10:45.283329+0000","last_active":"2024-08-27T03:55:15.287223+0000","last_peered":"2024-08-27T03:55:15.287223+0000","last_clean":"2024-08-27T03:55:15.287223+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:55:15.287223+0000","last_undegraded":"2024-08-27T03:55:15.287223+0000","last_fullsized":"2024-08-27T03:55:15.287223+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:08.644016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.901666+0000","last_change":"2024-08-27T02:50:55.783336+0000","last_active":"2024-08-27T03:56:14.901666+0000","last_peered":"2024-08-27T03:56:14.901666+0000","last_clean":"2024-08-27T03:56:14.901666+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:56:14.901666+0000","last_undegraded":"2024-08-27T03:56:14.901666+0000","last_fullsized":"2024-08-27T03:56:14.901666+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:19.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.502670+0000","last_change":"2024-08-27T03:59:08.502670+0000","last_active":"2024-08-27T03:59:08.502670+0000","last_peered":"2024-08-27T03:59:08.502670+0000","last_clean":"2024-08-27T03:59:08.502670+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:59:08.502670+0000","last_undegraded":"2024-08-27T03:59:08.502670+0000","last_fullsized":"2024-08-27T03:59:08.502670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.502492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.502492+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.502492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:16:58.852923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.645772+0000","last_change":"2024-08-27T03:59:13.645772+0000","last_active":"2024-08-27T03:59:13.645772+0000","last_peered":"2024-08-27T03:59:13.645772+0000","last_clean":"2024-08-27T03:59:13.645772+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:59:13.645772+0000","last_undegraded":"2024-08-27T03:59:13.645772+0000","last_fullsized":"2024-08-27T03:59:13.645772+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:13.645584+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:13.645584+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.645584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:05:02.912963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.908740+0000","last_change":"2024-08-27T03:10:45.266598+0000","last_active":"2024-08-27T03:56:39.908740+0000","last_peered":"2024-08-27T03:56:39.908740+0000","last_clean":"2024-08-27T03:56:39.908740+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:56:39.908740+0000","last_undegraded":"2024-08-27T03:56:39.908740+0000","last_fullsized":"2024-08-27T03:56:39.908740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.500122+0000","last_change":"2024-08-27T03:59:10.500122+0000","last_active":"2024-08-27T03:59:10.500122+0000","last_peered":"2024-08-27T03:59:10.500122+0000","last_clean":"2024-08-27T03:59:10.500122+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:59:10.500122+0000","last_undegraded":"2024-08-27T03:59:10.500122+0000","last_fullsized":"2024-08-27T03:59:10.500122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:10.499937+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:10.499937+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.499937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:27.141860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:14.882842+0000","last_change":"2024-08-27T02:50:51.722290+0000","last_active":"2024-08-27T03:56:14.882842+0000","last_peered":"2024-08-27T03:56:14.882842+0000","last_clean":"2024-08-27T03:56:14.882842+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:56:14.882842+0000","last_undegraded":"2024-08-27T03:56:14.882842+0000","last_fullsized":"2024-08-27T03:56:14.882842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:01.517101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:49.910844+0000","last_change":"2024-08-27T02:46:49.673825+0000","last_active":"2024-08-27T03:56:49.910844+0000","last_peered":"2024-08-27T03:56:49.910844+0000","last_clean":"2024-08-27T03:56:49.910844+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:56:49.910844+0000","last_undegraded":"2024-08-27T03:56:49.910844+0000","last_fullsized":"2024-08-27T03:56:49.910844+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.679670+0000","last_change":"2024-08-27T03:59:05.679670+0000","last_active":"2024-08-27T03:59:05.679670+0000","last_peered":"2024-08-27T03:59:05.679670+0000","last_clean":"2024-08-27T03:59:05.679670+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:59:05.679670+0000","last_undegraded":"2024-08-27T03:59:05.679670+0000","last_fullsized":"2024-08-27T03:59:05.679670+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.679493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.679493+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.679493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:01.999447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'2","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930741+0000","last_change":"2024-08-27T02:50:55.782955+0000","last_active":"2024-08-27T03:58:24.930741+0000","last_peered":"2024-08-27T03:58:24.930741+0000","last_clean":"2024-08-27T03:58:24.930741+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:58:24.930741+0000","last_undegraded":"2024-08-27T03:58:24.930741+0000","last_fullsized":"2024-08-27T03:58:24.930741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:13.729427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.306233+0000","last_change":"2024-08-27T02:50:51.737202+0000","last_active":"2024-08-27T03:56:10.306233+0000","last_peered":"2024-08-27T03:56:10.306233+0000","last_clean":"2024-08-27T03:56:10.306233+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:56:10.306233+0000","last_undegraded":"2024-08-27T03:56:10.306233+0000","last_fullsized":"2024-08-27T03:56:10.306233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:37:36.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'155","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:54.912534+0000","last_change":"2024-08-27T02:46:49.680563+0000","last_active":"2024-08-27T03:56:54.912534+0000","last_peered":"2024-08-27T03:56:54.912534+0000","last_clean":"2024-08-27T03:56:54.912534+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:56:54.912534+0000","last_undegraded":"2024-08-27T03:56:54.912534+0000","last_fullsized":"2024-08-27T03:56:54.912534+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299565+0000","last_change":"2024-08-27T03:10:45.284394+0000","last_active":"2024-08-27T03:55:45.299565+0000","last_peered":"2024-08-27T03:55:45.299565+0000","last_clean":"2024-08-27T03:55:45.299565+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:55:45.299565+0000","last_undegraded":"2024-08-27T03:55:45.299565+0000","last_fullsized":"2024-08-27T03:55:45.299565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:20:56.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930627+0000","last_change":"2024-08-27T02:50:55.783274+0000","last_active":"2024-08-27T03:58:24.930627+0000","last_peered":"2024-08-27T03:58:24.930627+0000","last_clean":"2024-08-27T03:58:24.930627+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:58:24.930627+0000","last_undegraded":"2024-08-27T03:58:24.930627+0000","last_fullsized":"2024-08-27T03:58:24.930627+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:45:25.580491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.638510+0000","last_change":"2024-08-27T03:59:01.638510+0000","last_active":"2024-08-27T03:59:01.638510+0000","last_peered":"2024-08-27T03:59:01.638510+0000","last_clean":"2024-08-27T03:59:01.638510+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:59:01.638510+0000","last_undegraded":"2024-08-27T03:59:01.638510+0000","last_fullsized":"2024-08-27T03:59:01.638510+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:01.638302+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:01.638302+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.638302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:11.517225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:34.887749+0000","last_change":"2024-08-27T02:46:49.663826+0000","last_active":"2024-08-27T03:56:34.887749+0000","last_peered":"2024-08-27T03:56:34.887749+0000","last_clean":"2024-08-27T03:56:34.887749+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:56:34.887749+0000","last_undegraded":"2024-08-27T03:56:34.887749+0000","last_fullsized":"2024-08-27T03:56:34.887749+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.389568+0000","last_change":"2024-08-27T03:59:14.389568+0000","last_active":"2024-08-27T03:59:14.389568+0000","last_peered":"2024-08-27T03:59:14.389568+0000","last_clean":"2024-08-27T03:59:14.389568+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:59:14.389568+0000","last_undegraded":"2024-08-27T03:59:14.389568+0000","last_fullsized":"2024-08-27T03:59:14.389568+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:14.389366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:14.389366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.389366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:04.259428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.153822+0000","last_change":"2024-08-27T03:59:10.153822+0000","last_active":"2024-08-27T03:59:10.153822+0000","last_peered":"2024-08-27T03:59:10.153822+0000","last_clean":"2024-08-27T03:59:10.153822+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:59:10.153822+0000","last_undegraded":"2024-08-27T03:59:10.153822+0000","last_fullsized":"2024-08-27T03:59:10.153822+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:10.153624+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:10.153624+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.153624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:08:51.528708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300859+0000","last_change":"2024-08-27T02:50:51.714350+0000","last_active":"2024-08-27T03:56:10.300859+0000","last_peered":"2024-08-27T03:56:10.300859+0000","last_clean":"2024-08-27T03:56:10.300859+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:56:10.300859+0000","last_undegraded":"2024-08-27T03:56:10.300859+0000","last_fullsized":"2024-08-27T03:56:10.300859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:27:51.967867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'96","reported_seq":434,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.531752+0000","last_change":"2024-08-27T03:59:05.531752+0000","last_active":"2024-08-27T03:59:05.531752+0000","last_peered":"2024-08-27T03:59:05.531752+0000","last_clean":"2024-08-27T03:59:05.531752+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:59:05.531752+0000","last_undegraded":"2024-08-27T03:59:05.531752+0000","last_fullsized":"2024-08-27T03:59:05.531752+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'96","last_scrub_stamp":"2024-08-27T03:59:05.531561+0000","last_deep_scrub":"267'96","last_deep_scrub_stamp":"2024-08-27T03:59:05.531561+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.531561+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:56:33.875961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1485,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307291+0000","last_change":"2024-08-27T03:10:45.299758+0000","last_active":"2024-08-27T03:56:15.307291+0000","last_peered":"2024-08-27T03:56:15.307291+0000","last_clean":"2024-08-27T03:56:15.307291+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:56:15.307291+0000","last_undegraded":"2024-08-27T03:56:15.307291+0000","last_fullsized":"2024-08-27T03:56:15.307291+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:03.273910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:24.930815+0000","last_change":"2024-08-27T02:50:55.792739+0000","last_active":"2024-08-27T03:58:24.930815+0000","last_peered":"2024-08-27T03:58:24.930815+0000","last_clean":"2024-08-27T03:58:24.930815+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:58:24.930815+0000","last_undegraded":"2024-08-27T03:58:24.930815+0000","last_fullsized":"2024-08-27T03:58:24.930815+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:43:53.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.233160+0000","last_change":"2024-08-27T03:59:08.233160+0000","last_active":"2024-08-27T03:59:08.233160+0000","last_peered":"2024-08-27T03:59:08.233160+0000","last_clean":"2024-08-27T03:59:08.233160+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:59:08.233160+0000","last_undegraded":"2024-08-27T03:59:08.233160+0000","last_fullsized":"2024-08-27T03:59:08.233160+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.232970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.232970+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.232970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:55.808443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.590134+0000","last_change":"2024-08-27T03:58:57.590134+0000","last_active":"2024-08-27T03:58:57.590134+0000","last_peered":"2024-08-27T03:58:57.590134+0000","last_clean":"2024-08-27T03:58:57.590134+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:58:57.590134+0000","last_undegraded":"2024-08-27T03:58:57.590134+0000","last_fullsized":"2024-08-27T03:58:57.590134+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-08-27T03:58:57.589932+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-08-27T03:58:57.589932+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.589932+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:12:51.810737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.894119+0000","last_change":"2024-08-27T03:10:45.290159+0000","last_active":"2024-08-27T03:55:44.894119+0000","last_peered":"2024-08-27T03:55:44.894119+0000","last_clean":"2024-08-27T03:55:44.894119+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:55:44.894119+0000","last_undegraded":"2024-08-27T03:55:44.894119+0000","last_fullsized":"2024-08-27T03:55:44.894119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:46:58.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093241+0000","last_change":"2024-08-27T02:50:55.801909+0000","last_active":"2024-08-27T03:55:55.093241+0000","last_peered":"2024-08-27T03:55:55.093241+0000","last_clean":"2024-08-27T03:55:55.093241+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:55:55.093241+0000","last_undegraded":"2024-08-27T03:55:55.093241+0000","last_fullsized":"2024-08-27T03:55:55.093241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:21:22.557931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.326037+0000","last_change":"2024-08-27T02:50:51.714694+0000","last_active":"2024-08-27T03:58:05.326037+0000","last_peered":"2024-08-27T03:58:05.326037+0000","last_clean":"2024-08-27T03:58:05.326037+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:58:05.326037+0000","last_undegraded":"2024-08-27T03:58:05.326037+0000","last_fullsized":"2024-08-27T03:58:05.326037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:09.799135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.306814+0000","last_change":"2024-08-27T02:46:49.660909+0000","last_active":"2024-08-27T03:56:35.306814+0000","last_peered":"2024-08-27T03:56:35.306814+0000","last_clean":"2024-08-27T03:56:35.306814+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:56:35.306814+0000","last_undegraded":"2024-08-27T03:56:35.306814+0000","last_fullsized":"2024-08-27T03:56:35.306814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302508+0000","last_change":"2024-08-27T03:10:45.301566+0000","last_active":"2024-08-27T03:55:55.302508+0000","last_peered":"2024-08-27T03:55:55.302508+0000","last_clean":"2024-08-27T03:55:55.302508+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:55:55.302508+0000","last_undegraded":"2024-08-27T03:55:55.302508+0000","last_fullsized":"2024-08-27T03:55:55.302508+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:57:00.105752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302217+0000","last_change":"2024-08-27T02:50:55.793032+0000","last_active":"2024-08-27T03:55:55.302217+0000","last_peered":"2024-08-27T03:55:55.302217+0000","last_clean":"2024-08-27T03:55:55.302217+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:55:55.302217+0000","last_undegraded":"2024-08-27T03:55:55.302217+0000","last_fullsized":"2024-08-27T03:55:55.302217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:41:51.131027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.150947+0000","last_change":"2024-08-27T03:59:11.150947+0000","last_active":"2024-08-27T03:59:11.150947+0000","last_peered":"2024-08-27T03:59:11.150947+0000","last_clean":"2024-08-27T03:59:11.150947+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:59:11.150947+0000","last_undegraded":"2024-08-27T03:59:11.150947+0000","last_fullsized":"2024-08-27T03:59:11.150947+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:11.150744+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:11.150744+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.150744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:18:57.866275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.792966+0000","last_change":"2024-08-27T03:59:14.792966+0000","last_active":"2024-08-27T03:59:14.792966+0000","last_peered":"2024-08-27T03:59:14.792966+0000","last_clean":"2024-08-27T03:59:14.792966+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:59:14.792966+0000","last_undegraded":"2024-08-27T03:59:14.792966+0000","last_fullsized":"2024-08-27T03:59:14.792966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-08-27T03:59:14.792770+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-08-27T03:59:14.792770+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.792770+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:55:04.139575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.299649+0000","last_change":"2024-08-27T03:10:45.282178+0000","last_active":"2024-08-27T03:55:45.299649+0000","last_peered":"2024-08-27T03:55:45.299649+0000","last_clean":"2024-08-27T03:55:45.299649+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:55:45.299649+0000","last_undegraded":"2024-08-27T03:55:45.299649+0000","last_fullsized":"2024-08-27T03:55:45.299649+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:24:50.331973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.153198+0000","last_change":"2024-08-27T03:59:12.153198+0000","last_active":"2024-08-27T03:59:12.153198+0000","last_peered":"2024-08-27T03:59:12.153198+0000","last_clean":"2024-08-27T03:59:12.153198+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:59:12.153198+0000","last_undegraded":"2024-08-27T03:59:12.153198+0000","last_fullsized":"2024-08-27T03:59:12.153198+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:12.153011+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:12.153011+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.153011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:09.108425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'12","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:29.878575+0000","last_change":"2024-08-27T02:50:51.706023+0000","last_active":"2024-08-27T03:58:29.878575+0000","last_peered":"2024-08-27T03:58:29.878575+0000","last_clean":"2024-08-27T03:58:29.878575+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:58:29.878575+0000","last_undegraded":"2024-08-27T03:58:29.878575+0000","last_fullsized":"2024-08-27T03:58:29.878575+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:01:06.191127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":17,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900237+0000","last_change":"2024-08-27T02:46:49.681215+0000","last_active":"2024-08-27T03:56:09.900237+0000","last_peered":"2024-08-27T03:56:09.900237+0000","last_clean":"2024-08-27T03:56:09.900237+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:56:09.900237+0000","last_undegraded":"2024-08-27T03:56:09.900237+0000","last_fullsized":"2024-08-27T03:56:09.900237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:36:59.655983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294482+0000","last_change":"2024-08-27T03:10:45.266749+0000","last_active":"2024-08-27T03:55:45.294482+0000","last_peered":"2024-08-27T03:55:45.294482+0000","last_clean":"2024-08-27T03:55:45.294482+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:55:45.294482+0000","last_undegraded":"2024-08-27T03:55:45.294482+0000","last_fullsized":"2024-08-27T03:55:45.294482+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:25:14.767363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.307348+0000","last_change":"2024-08-27T02:50:55.806234+0000","last_active":"2024-08-27T03:56:15.307348+0000","last_peered":"2024-08-27T03:56:15.307348+0000","last_clean":"2024-08-27T03:56:15.307348+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:56:15.307348+0000","last_undegraded":"2024-08-27T03:56:15.307348+0000","last_fullsized":"2024-08-27T03:56:15.307348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:26.269206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.639046+0000","last_change":"2024-08-27T03:59:14.639046+0000","last_active":"2024-08-27T03:59:14.639046+0000","last_peered":"2024-08-27T03:59:14.639046+0000","last_clean":"2024-08-27T03:59:14.639046+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:59:14.639046+0000","last_undegraded":"2024-08-27T03:59:14.639046+0000","last_fullsized":"2024-08-27T03:59:14.639046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:14.638829+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:14.638829+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.638829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:24:11.059602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.523841+0000","last_change":"2024-08-27T03:59:04.523841+0000","last_active":"2024-08-27T03:59:04.523841+0000","last_peered":"2024-08-27T03:59:04.523841+0000","last_clean":"2024-08-27T03:59:04.523841+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:59:04.523841+0000","last_undegraded":"2024-08-27T03:59:04.523841+0000","last_fullsized":"2024-08-27T03:59:04.523841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-08-27T03:59:04.523658+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-08-27T03:59:04.523658+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.523658+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:30:21.823486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.312150+0000","last_change":"2024-08-27T03:10:45.299158+0000","last_active":"2024-08-27T03:56:35.312150+0000","last_peered":"2024-08-27T03:56:35.312150+0000","last_clean":"2024-08-27T03:56:35.312150+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:56:35.312150+0000","last_undegraded":"2024-08-27T03:56:35.312150+0000","last_fullsized":"2024-08-27T03:56:35.312150+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:45.294519+0000","last_change":"2024-08-27T02:50:55.778021+0000","last_active":"2024-08-27T03:55:45.294519+0000","last_peered":"2024-08-27T03:55:45.294519+0000","last_clean":"2024-08-27T03:55:45.294519+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:55:45.294519+0000","last_undegraded":"2024-08-27T03:55:45.294519+0000","last_fullsized":"2024-08-27T03:55:45.294519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:18:53.906397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.326804+0000","last_change":"2024-08-27T02:50:51.715619+0000","last_active":"2024-08-27T03:57:35.326804+0000","last_peered":"2024-08-27T03:57:35.326804+0000","last_clean":"2024-08-27T03:57:35.326804+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:57:35.326804+0000","last_undegraded":"2024-08-27T03:57:35.326804+0000","last_fullsized":"2024-08-27T03:57:35.326804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:22:37.492353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:10.300942+0000","last_change":"2024-08-27T02:46:49.677851+0000","last_active":"2024-08-27T03:56:10.300942+0000","last_peered":"2024-08-27T03:56:10.300942+0000","last_clean":"2024-08-27T03:56:10.300942+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:56:10.300942+0000","last_undegraded":"2024-08-27T03:56:10.300942+0000","last_fullsized":"2024-08-27T03:56:10.300942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:42:32.601632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:34.887556+0000","last_change":"2024-08-27T03:10:45.277501+0000","last_active":"2024-08-27T03:56:34.887556+0000","last_peered":"2024-08-27T03:56:34.887556+0000","last_clean":"2024-08-27T03:56:34.887556+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:56:34.887556+0000","last_undegraded":"2024-08-27T03:56:34.887556+0000","last_fullsized":"2024-08-27T03:56:34.887556+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:30.290804+0000","last_change":"2024-08-27T02:50:55.775204+0000","last_active":"2024-08-27T03:55:30.290804+0000","last_peered":"2024-08-27T03:55:30.290804+0000","last_clean":"2024-08-27T03:55:30.290804+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:55:30.290804+0000","last_undegraded":"2024-08-27T03:55:30.290804+0000","last_fullsized":"2024-08-27T03:55:30.290804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:27:44.097101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.650423+0000","last_change":"2024-08-27T03:59:03.650423+0000","last_active":"2024-08-27T03:59:03.650423+0000","last_peered":"2024-08-27T03:59:03.650423+0000","last_clean":"2024-08-27T03:59:03.650423+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:59:03.650423+0000","last_undegraded":"2024-08-27T03:59:03.650423+0000","last_fullsized":"2024-08-27T03:59:03.650423+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:03.650243+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:03.650243+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.650243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:28.974883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.525787+0000","last_change":"2024-08-27T03:59:03.525787+0000","last_active":"2024-08-27T03:59:03.525787+0000","last_peered":"2024-08-27T03:59:03.525787+0000","last_clean":"2024-08-27T03:59:03.525787+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:59:03.525787+0000","last_undegraded":"2024-08-27T03:59:03.525787+0000","last_fullsized":"2024-08-27T03:59:03.525787+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-08-27T03:59:03.525614+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-08-27T03:59:03.525614+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.525614+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:28:22.588616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:51.091460+0000","last_change":"2024-08-27T03:10:45.304634+0000","last_active":"2024-08-27T03:56:51.091460+0000","last_peered":"2024-08-27T03:56:51.091460+0000","last_clean":"2024-08-27T03:56:51.091460+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:56:51.091460+0000","last_undegraded":"2024-08-27T03:56:51.091460+0000","last_fullsized":"2024-08-27T03:56:51.091460+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.302531+0000","last_change":"2024-08-27T02:50:55.800079+0000","last_active":"2024-08-27T03:55:55.302531+0000","last_peered":"2024-08-27T03:55:55.302531+0000","last_clean":"2024-08-27T03:55:55.302531+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:55:55.302531+0000","last_undegraded":"2024-08-27T03:55:55.302531+0000","last_fullsized":"2024-08-27T03:55:55.302531+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:24:12.115726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:54.878104+0000","last_change":"2024-08-27T02:50:51.722487+0000","last_active":"2024-08-27T03:55:54.878104+0000","last_peered":"2024-08-27T03:55:54.878104+0000","last_clean":"2024-08-27T03:55:54.878104+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:55:54.878104+0000","last_undegraded":"2024-08-27T03:55:54.878104+0000","last_fullsized":"2024-08-27T03:55:54.878104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:03.625739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.730948+0000","last_change":"2024-08-27T03:59:11.730948+0000","last_active":"2024-08-27T03:59:11.730948+0000","last_peered":"2024-08-27T03:59:11.730948+0000","last_clean":"2024-08-27T03:59:11.730948+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:59:11.730948+0000","last_undegraded":"2024-08-27T03:59:11.730948+0000","last_fullsized":"2024-08-27T03:59:11.730948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-08-27T03:59:11.730760+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-08-27T03:59:11.730760+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.730760+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:27:36.382148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.102740+0000","last_change":"2024-08-27T03:10:45.294675+0000","last_active":"2024-08-27T03:56:35.102740+0000","last_peered":"2024-08-27T03:56:35.102740+0000","last_clean":"2024-08-27T03:56:35.102740+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:56:35.102740+0000","last_undegraded":"2024-08-27T03:56:35.102740+0000","last_fullsized":"2024-08-27T03:56:35.102740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:55.093451+0000","last_change":"2024-08-27T02:50:55.767291+0000","last_active":"2024-08-27T03:55:55.093451+0000","last_peered":"2024-08-27T03:55:55.093451+0000","last_clean":"2024-08-27T03:55:55.093451+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:55:55.093451+0000","last_undegraded":"2024-08-27T03:55:55.093451+0000","last_fullsized":"2024-08-27T03:55:55.093451+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:34.369306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:05.334012+0000","last_change":"2024-08-27T02:50:51.715173+0000","last_active":"2024-08-27T03:58:05.334012+0000","last_peered":"2024-08-27T03:58:05.334012+0000","last_clean":"2024-08-27T03:58:05.334012+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:58:05.334012+0000","last_undegraded":"2024-08-27T03:58:05.334012+0000","last_fullsized":"2024-08-27T03:58:05.334012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:01:41.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.093946+0000","last_change":"2024-08-27T03:59:03.093946+0000","last_active":"2024-08-27T03:59:03.093946+0000","last_peered":"2024-08-27T03:59:03.093946+0000","last_clean":"2024-08-27T03:59:03.093946+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:59:03.093946+0000","last_undegraded":"2024-08-27T03:59:03.093946+0000","last_fullsized":"2024-08-27T03:59:03.093946+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:03.093759+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:03.093759+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.093759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:35.506595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.690609+0000","last_change":"2024-08-27T03:59:06.690609+0000","last_active":"2024-08-27T03:59:06.690609+0000","last_peered":"2024-08-27T03:59:06.690609+0000","last_clean":"2024-08-27T03:59:06.690609+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:59:06.690609+0000","last_undegraded":"2024-08-27T03:59:06.690609+0000","last_fullsized":"2024-08-27T03:59:06.690609+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:06.690423+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:06.690423+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.690423+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:03.414071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:30.039145+0000","last_change":"2024-08-27T02:50:55.776653+0000","last_active":"2024-08-27T03:58:30.039145+0000","last_peered":"2024-08-27T03:58:30.039145+0000","last_clean":"2024-08-27T03:58:30.039145+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:58:30.039145+0000","last_undegraded":"2024-08-27T03:58:30.039145+0000","last_fullsized":"2024-08-27T03:58:30.039145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:30:47.655678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:15.321898+0000","last_change":"2024-08-27T02:50:51.712698+0000","last_active":"2024-08-27T03:57:15.321898+0000","last_peered":"2024-08-27T03:57:15.321898+0000","last_clean":"2024-08-27T03:57:15.321898+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:57:15.321898+0000","last_undegraded":"2024-08-27T03:57:15.321898+0000","last_fullsized":"2024-08-27T03:57:15.321898+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:34.873157+0000","last_change":"2024-08-27T02:46:49.666166+0000","last_active":"2024-08-27T03:55:34.873157+0000","last_peered":"2024-08-27T03:55:34.873157+0000","last_clean":"2024-08-27T03:55:34.873157+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:55:34.873157+0000","last_undegraded":"2024-08-27T03:55:34.873157+0000","last_fullsized":"2024-08-27T03:55:34.873157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:59:52.040406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:15.302157+0000","last_change":"2024-08-27T03:10:45.289668+0000","last_active":"2024-08-27T03:56:15.302157+0000","last_peered":"2024-08-27T03:56:15.302157+0000","last_clean":"2024-08-27T03:56:15.302157+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:56:15.302157+0000","last_undegraded":"2024-08-27T03:56:15.302157+0000","last_fullsized":"2024-08-27T03:56:15.302157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:59:24.929800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:14.896687+0000","last_change":"2024-08-27T02:50:55.777558+0000","last_active":"2024-08-27T03:57:14.896687+0000","last_peered":"2024-08-27T03:57:14.896687+0000","last_clean":"2024-08-27T03:57:14.896687+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:57:14.896687+0000","last_undegraded":"2024-08-27T03:57:14.896687+0000","last_fullsized":"2024-08-27T03:57:14.896687+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'7","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.326696+0000","last_change":"2024-08-27T02:50:51.718684+0000","last_active":"2024-08-27T03:57:35.326696+0000","last_peered":"2024-08-27T03:57:35.326696+0000","last_clean":"2024-08-27T03:57:35.326696+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:57:35.326696+0000","last_undegraded":"2024-08-27T03:57:35.326696+0000","last_fullsized":"2024-08-27T03:57:35.326696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:50.667815+0000","last_clean_scrub_stamp":"2024-08-27T02:50:50.667815+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:58:00.220312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:35.088488+0000","last_change":"2024-08-27T02:46:49.666930+0000","last_active":"2024-08-27T03:55:35.088488+0000","last_peered":"2024-08-27T03:55:35.088488+0000","last_clean":"2024-08-27T03:55:35.088488+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:55:35.088488+0000","last_undegraded":"2024-08-27T03:55:35.088488+0000","last_fullsized":"2024-08-27T03:55:35.088488+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:46:48.608077+0000","last_clean_scrub_stamp":"2024-08-27T02:46:48.608077+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:46.255173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.307001+0000","last_change":"2024-08-27T03:10:45.281649+0000","last_active":"2024-08-27T03:56:35.307001+0000","last_peered":"2024-08-27T03:56:35.307001+0000","last_clean":"2024-08-27T03:56:35.307001+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:56:35.307001+0000","last_undegraded":"2024-08-27T03:56:35.307001+0000","last_fullsized":"2024-08-27T03:56:35.307001+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.514241+0000","last_change":"2024-08-27T03:59:09.514241+0000","last_active":"2024-08-27T03:59:09.514241+0000","last_peered":"2024-08-27T03:59:09.514241+0000","last_clean":"2024-08-27T03:59:09.514241+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:59:09.514241+0000","last_undegraded":"2024-08-27T03:59:09.514241+0000","last_fullsized":"2024-08-27T03:59:09.514241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:09.513996+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:09.513996+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.513996+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:26:56.665749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.143578+0000","last_change":"2024-08-27T03:59:04.143578+0000","last_active":"2024-08-27T03:59:04.143578+0000","last_peered":"2024-08-27T03:59:04.143578+0000","last_clean":"2024-08-27T03:59:04.143578+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:59:04.143578+0000","last_undegraded":"2024-08-27T03:59:04.143578+0000","last_fullsized":"2024-08-27T03:59:04.143578+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:04.143381+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:04.143381+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.143381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:58.843764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.572873+0000","last_change":"2024-08-27T03:59:02.572873+0000","last_active":"2024-08-27T03:59:02.572873+0000","last_peered":"2024-08-27T03:59:02.572873+0000","last_clean":"2024-08-27T03:59:02.572873+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:59:02.572873+0000","last_undegraded":"2024-08-27T03:59:02.572873+0000","last_fullsized":"2024-08-27T03:59:02.572873+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-08-27T03:59:02.572691+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-08-27T03:59:02.572691+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.572691+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:55:05.386884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:45.314631+0000","last_change":"2024-08-27T03:10:45.290709+0000","last_active":"2024-08-27T03:56:45.314631+0000","last_peered":"2024-08-27T03:56:45.314631+0000","last_clean":"2024-08-27T03:56:45.314631+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:56:45.314631+0000","last_undegraded":"2024-08-27T03:56:45.314631+0000","last_fullsized":"2024-08-27T03:56:45.314631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:35.116553+0000","last_change":"2024-08-27T02:50:55.772109+0000","last_active":"2024-08-27T03:57:35.116553+0000","last_peered":"2024-08-27T03:57:35.116553+0000","last_clean":"2024-08-27T03:57:35.116553+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:57:35.116553+0000","last_undegraded":"2024-08-27T03:57:35.116553+0000","last_fullsized":"2024-08-27T03:57:35.116553+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:34.257753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.460384+0000","last_change":"2024-08-27T03:59:07.460384+0000","last_active":"2024-08-27T03:59:07.460384+0000","last_peered":"2024-08-27T03:59:07.460384+0000","last_clean":"2024-08-27T03:59:07.460384+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:59:07.460384+0000","last_undegraded":"2024-08-27T03:59:07.460384+0000","last_fullsized":"2024-08-27T03:59:07.460384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.460195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.460195+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.460195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:08.655162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.739008+0000","last_change":"2024-08-27T03:59:10.739008+0000","last_active":"2024-08-27T03:59:10.739008+0000","last_peered":"2024-08-27T03:59:10.739008+0000","last_clean":"2024-08-27T03:59:10.739008+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:59:10.739008+0000","last_undegraded":"2024-08-27T03:59:10.739008+0000","last_fullsized":"2024-08-27T03:59:10.739008+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-08-27T03:59:10.738816+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-08-27T03:59:10.738816+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.738816+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:43:09.357876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'314","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.926129+0000","last_change":"2024-08-27T03:58:50.926129+0000","last_active":"2024-08-27T03:58:50.926129+0000","last_peered":"2024-08-27T03:58:50.926129+0000","last_clean":"2024-08-27T03:58:50.926129+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:50.926129+0000","last_undegraded":"2024-08-27T03:58:50.926129+0000","last_fullsized":"2024-08-27T03:58:50.926129+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'314","last_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_deep_scrub":"267'314","last_deep_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.925876+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:38:38.135877+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291497,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":22191,"num_write":1009,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'460","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.853734+0000","last_change":"2024-08-27T03:58:55.853734+0000","last_active":"2024-08-27T03:58:55.853734+0000","last_peered":"2024-08-27T03:58:55.853734+0000","last_clean":"2024-08-27T03:58:55.853734+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:58:55.853734+0000","last_undegraded":"2024-08-27T03:58:55.853734+0000","last_fullsized":"2024-08-27T03:58:55.853734+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'460","last_scrub_stamp":"2024-08-27T03:58:55.853540+0000","last_deep_scrub":"267'460","last_deep_scrub_stamp":"2024-08-27T03:58:55.853540+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.853540+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:33:53.439285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'361","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.144884+0000","last_change":"2024-08-27T03:58:43.144884+0000","last_active":"2024-08-27T03:58:43.144884+0000","last_peered":"2024-08-27T03:58:43.144884+0000","last_clean":"2024-08-27T03:58:43.144884+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:43.144884+0000","last_undegraded":"2024-08-27T03:58:43.144884+0000","last_fullsized":"2024-08-27T03:58:43.144884+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.144636+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:39.143444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424748,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":39942,"num_write":1277,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'826","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.895174+0000","last_change":"2024-08-27T03:58:54.895174+0000","last_active":"2024-08-27T03:58:54.895174+0000","last_peered":"2024-08-27T03:58:54.895174+0000","last_clean":"2024-08-27T03:58:54.895174+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:58:54.895174+0000","last_undegraded":"2024-08-27T03:58:54.895174+0000","last_fullsized":"2024-08-27T03:58:54.895174+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.894988+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:39:10.133666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'282","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.368824+0000","last_change":"2024-08-27T03:58:43.368824+0000","last_active":"2024-08-27T03:58:43.368824+0000","last_peered":"2024-08-27T03:58:43.368824+0000","last_clean":"2024-08-27T03:58:43.368824+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:43.368824+0000","last_undegraded":"2024-08-27T03:58:43.368824+0000","last_fullsized":"2024-08-27T03:58:43.368824+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'282","last_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_deep_scrub":"267'282","last_deep_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.368595+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:28.412078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":449,"num_write":920,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1217","reported_seq":2740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.707989+0000","last_change":"2024-08-27T03:58:56.707989+0000","last_active":"2024-08-27T03:58:56.707989+0000","last_peered":"2024-08-27T03:58:56.707989+0000","last_clean":"2024-08-27T03:58:56.707989+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:58:56.707989+0000","last_undegraded":"2024-08-27T03:58:56.707989+0000","last_fullsized":"2024-08-27T03:58:56.707989+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1217","last_scrub_stamp":"2024-08-27T03:58:56.707808+0000","last_deep_scrub":"267'1217","last_deep_scrub_stamp":"2024-08-27T03:58:56.707808+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.707808+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":1200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:14:15.277648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'320","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.810209+0000","last_change":"2024-08-27T03:58:47.810209+0000","last_active":"2024-08-27T03:58:47.810209+0000","last_peered":"2024-08-27T03:58:47.810209+0000","last_clean":"2024-08-27T03:58:47.810209+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:47.810209+0000","last_undegraded":"2024-08-27T03:58:47.810209+0000","last_fullsized":"2024-08-27T03:58:47.810209+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.809968+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:11:53.480777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":3871,"num_write":1091,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'481","reported_seq":2144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.508513+0000","last_change":"2024-08-27T03:58:52.508513+0000","last_active":"2024-08-27T03:58:52.508513+0000","last_peered":"2024-08-27T03:58:52.508513+0000","last_clean":"2024-08-27T03:58:52.508513+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:58:52.508513+0000","last_undegraded":"2024-08-27T03:58:52.508513+0000","last_fullsized":"2024-08-27T03:58:52.508513+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.508324+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:43.578410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'389","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.872905+0000","last_change":"2024-08-27T03:58:49.872905+0000","last_active":"2024-08-27T03:58:49.872905+0000","last_peered":"2024-08-27T03:58:49.872905+0000","last_clean":"2024-08-27T03:58:49.872905+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:49.872905+0000","last_undegraded":"2024-08-27T03:58:49.872905+0000","last_fullsized":"2024-08-27T03:58:49.872905+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.872597+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:20.188046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493421,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":17279,"num_write":1203,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'494","reported_seq":2083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.643833+0000","last_change":"2024-08-27T03:58:50.643833+0000","last_active":"2024-08-27T03:58:50.643833+0000","last_peered":"2024-08-27T03:58:50.643833+0000","last_clean":"2024-08-27T03:58:50.643833+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:58:50.643833+0000","last_undegraded":"2024-08-27T03:58:50.643833+0000","last_fullsized":"2024-08-27T03:58:50.643833+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.643652+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:41:35.221530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'334","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.751411+0000","last_change":"2024-08-27T03:58:49.751411+0000","last_active":"2024-08-27T03:58:49.751411+0000","last_peered":"2024-08-27T03:58:49.751411+0000","last_clean":"2024-08-27T03:58:49.751411+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:49.751411+0000","last_undegraded":"2024-08-27T03:58:49.751411+0000","last_fullsized":"2024-08-27T03:58:49.751411+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.751052+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:58:46.654336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399097,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":18975,"num_write":950,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.673806+0000","last_change":"2024-08-27T03:58:57.673806+0000","last_active":"2024-08-27T03:58:57.673806+0000","last_peered":"2024-08-27T03:58:57.673806+0000","last_clean":"2024-08-27T03:58:57.673806+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:58:57.673806+0000","last_undegraded":"2024-08-27T03:58:57.673806+0000","last_fullsized":"2024-08-27T03:58:57.673806+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-08-27T03:58:57.673567+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-08-27T03:58:57.673567+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.673567+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:53:05.248666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'354","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.572124+0000","last_change":"2024-08-27T03:58:40.571939+0000","last_active":"2024-08-27T03:58:40.572124+0000","last_peered":"2024-08-27T03:58:40.572124+0000","last_clean":"2024-08-27T03:58:40.572124+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:40.572124+0000","last_undegraded":"2024-08-27T03:58:40.572124+0000","last_fullsized":"2024-08-27T03:58:40.572124+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.571595+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:38.897362+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5643582,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":18874,"num_write":1149,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'906","reported_seq":2475,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.892418+0000","last_change":"2024-08-27T03:58:56.892418+0000","last_active":"2024-08-27T03:58:56.892418+0000","last_peered":"2024-08-27T03:58:56.892418+0000","last_clean":"2024-08-27T03:58:56.892418+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:56.892418+0000","last_undegraded":"2024-08-27T03:58:56.892418+0000","last_fullsized":"2024-08-27T03:58:56.892418+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'906","last_scrub_stamp":"2024-08-27T03:58:56.892228+0000","last_deep_scrub":"267'906","last_deep_scrub_stamp":"2024-08-27T03:58:56.892228+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.892228+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:38:37.236736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1752,"num_omap_keys":7,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'344","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.157025+0000","last_change":"2024-08-27T03:58:47.157025+0000","last_active":"2024-08-27T03:58:47.157025+0000","last_peered":"2024-08-27T03:58:47.157025+0000","last_clean":"2024-08-27T03:58:47.157025+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:47.157025+0000","last_undegraded":"2024-08-27T03:58:47.157025+0000","last_fullsized":"2024-08-27T03:58:47.157025+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.156774+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:35.049139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550512,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":6557,"num_write":1048,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'921","reported_seq":2469,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.495835+0000","last_change":"2024-08-27T03:58:48.495835+0000","last_active":"2024-08-27T03:58:48.495835+0000","last_peered":"2024-08-27T03:58:48.495835+0000","last_clean":"2024-08-27T03:58:48.495835+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:58:48.495835+0000","last_undegraded":"2024-08-27T03:58:48.495835+0000","last_fullsized":"2024-08-27T03:58:48.495835+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'921","last_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_deep_scrub":"267'921","last_deep_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.495658+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":900,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:05.944519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'771","reported_seq":2540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.680623+0000","last_change":"2024-08-27T03:58:54.680623+0000","last_active":"2024-08-27T03:58:54.680623+0000","last_peered":"2024-08-27T03:58:54.680623+0000","last_clean":"2024-08-27T03:58:54.680623+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:58:54.680623+0000","last_undegraded":"2024-08-27T03:58:54.680623+0000","last_fullsized":"2024-08-27T03:58:54.680623+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.680350+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:58.085130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2268,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.859587+0000","last_change":"2024-08-27T03:58:47.859587+0000","last_active":"2024-08-27T03:58:47.859587+0000","last_peered":"2024-08-27T03:58:47.859587+0000","last_clean":"2024-08-27T03:58:47.859587+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:47.859587+0000","last_undegraded":"2024-08-27T03:58:47.859587+0000","last_fullsized":"2024-08-27T03:58:47.859587+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.859361+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:30.873158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":9006,"num_write":957,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'790","reported_seq":2426,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.887806+0000","last_change":"2024-08-27T03:58:51.887806+0000","last_active":"2024-08-27T03:58:51.887806+0000","last_peered":"2024-08-27T03:58:51.887806+0000","last_clean":"2024-08-27T03:58:51.887806+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:58:51.887806+0000","last_undegraded":"2024-08-27T03:58:51.887806+0000","last_fullsized":"2024-08-27T03:58:51.887806+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.887607+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:17.606029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'361","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.731951+0000","last_change":"2024-08-27T03:58:44.731951+0000","last_active":"2024-08-27T03:58:44.731951+0000","last_peered":"2024-08-27T03:58:44.731951+0000","last_clean":"2024-08-27T03:58:44.731951+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:44.731951+0000","last_undegraded":"2024-08-27T03:58:44.731951+0000","last_fullsized":"2024-08-27T03:58:44.731951+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.731678+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:19.085584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":653,"num_read_kb":8370,"num_write":1179,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'489","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.815492+0000","last_change":"2024-08-27T03:58:53.815492+0000","last_active":"2024-08-27T03:58:53.815492+0000","last_peered":"2024-08-27T03:58:53.815492+0000","last_clean":"2024-08-27T03:58:53.815492+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:58:53.815492+0000","last_undegraded":"2024-08-27T03:58:53.815492+0000","last_fullsized":"2024-08-27T03:58:53.815492+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'489","last_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_deep_scrub":"267'489","last_deep_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.815307+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:09.901922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'337","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.776413+0000","last_change":"2024-08-27T03:58:41.776413+0000","last_active":"2024-08-27T03:58:41.776413+0000","last_peered":"2024-08-27T03:58:41.776413+0000","last_clean":"2024-08-27T03:58:41.776413+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:41.776413+0000","last_undegraded":"2024-08-27T03:58:41.776413+0000","last_fullsized":"2024-08-27T03:58:41.776413+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.776192+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:09.715672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569152,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":11498,"num_write":1125,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'685","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.544933+0000","last_change":"2024-08-27T03:58:45.544933+0000","last_active":"2024-08-27T03:58:45.544933+0000","last_peered":"2024-08-27T03:58:45.544933+0000","last_clean":"2024-08-27T03:58:45.544933+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:45.544933+0000","last_undegraded":"2024-08-27T03:58:45.544933+0000","last_fullsized":"2024-08-27T03:58:45.544933+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'685","last_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_deep_scrub":"267'685","last_deep_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.544744+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:02.504356+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'369","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.683165+0000","last_change":"2024-08-27T03:58:41.683165+0000","last_active":"2024-08-27T03:58:41.683165+0000","last_peered":"2024-08-27T03:58:41.683165+0000","last_clean":"2024-08-27T03:58:41.683165+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:41.683165+0000","last_undegraded":"2024-08-27T03:58:41.683165+0000","last_fullsized":"2024-08-27T03:58:41.683165+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.682887+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:10:56.014716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":144736,"num_write":1195,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'478","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.516219+0000","last_change":"2024-08-27T03:58:47.516219+0000","last_active":"2024-08-27T03:58:47.516219+0000","last_peered":"2024-08-27T03:58:47.516219+0000","last_clean":"2024-08-27T03:58:47.516219+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:58:47.516219+0000","last_undegraded":"2024-08-27T03:58:47.516219+0000","last_fullsized":"2024-08-27T03:58:47.516219+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.516030+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:54.405917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'335","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.141517+0000","last_change":"2024-08-27T03:58:45.141517+0000","last_active":"2024-08-27T03:58:45.141517+0000","last_peered":"2024-08-27T03:58:45.141517+0000","last_clean":"2024-08-27T03:58:45.141517+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:45.141517+0000","last_undegraded":"2024-08-27T03:58:45.141517+0000","last_fullsized":"2024-08-27T03:58:45.141517+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.141297+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:20.006199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":571,"num_read_kb":47085,"num_write":1065,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'766","reported_seq":2229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.718201+0000","last_change":"2024-08-27T03:58:55.718201+0000","last_active":"2024-08-27T03:58:55.718201+0000","last_peered":"2024-08-27T03:58:55.718201+0000","last_clean":"2024-08-27T03:58:55.718201+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:58:55.718201+0000","last_undegraded":"2024-08-27T03:58:55.718201+0000","last_fullsized":"2024-08-27T03:58:55.718201+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'766","last_scrub_stamp":"2024-08-27T03:58:55.718017+0000","last_deep_scrub":"267'766","last_deep_scrub_stamp":"2024-08-27T03:58:55.718017+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.718017+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:06:22.226590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'335","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.388100+0000","last_change":"2024-08-27T03:58:45.388100+0000","last_active":"2024-08-27T03:58:45.388100+0000","last_peered":"2024-08-27T03:58:45.388100+0000","last_clean":"2024-08-27T03:58:45.388100+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:45.388100+0000","last_undegraded":"2024-08-27T03:58:45.388100+0000","last_fullsized":"2024-08-27T03:58:45.388100+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.387860+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:01.932292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14802,"num_write":998,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'133","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.639980+0000","last_change":"2024-08-27T03:59:12.639980+0000","last_active":"2024-08-27T03:59:12.639980+0000","last_peered":"2024-08-27T03:59:12.639980+0000","last_clean":"2024-08-27T03:59:12.639980+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:59:12.639980+0000","last_undegraded":"2024-08-27T03:59:12.639980+0000","last_fullsized":"2024-08-27T03:59:12.639980+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'133","last_scrub_stamp":"2024-08-27T03:59:12.639781+0000","last_deep_scrub":"267'133","last_deep_scrub_stamp":"2024-08-27T03:59:12.639781+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.639781+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:44:25.359793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'629","reported_seq":2356,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.184869+0000","last_change":"2024-08-27T03:58:50.184869+0000","last_active":"2024-08-27T03:58:50.184869+0000","last_peered":"2024-08-27T03:58:50.184869+0000","last_clean":"2024-08-27T03:58:50.184869+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:50.184869+0000","last_undegraded":"2024-08-27T03:58:50.184869+0000","last_fullsized":"2024-08-27T03:58:50.184869+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'629","last_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_deep_scrub":"267'629","last_deep_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.184685+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:30.419124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4069,"num_omap_keys":16,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'362","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.829663+0000","last_change":"2024-08-27T03:58:48.829663+0000","last_active":"2024-08-27T03:58:48.829663+0000","last_peered":"2024-08-27T03:58:48.829663+0000","last_clean":"2024-08-27T03:58:48.829663+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:48.829663+0000","last_undegraded":"2024-08-27T03:58:48.829663+0000","last_fullsized":"2024-08-27T03:58:48.829663+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.829448+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:32.990578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":48228,"num_write":1146,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.795920+0000","last_change":"2024-08-27T03:58:59.795920+0000","last_active":"2024-08-27T03:58:59.795920+0000","last_peered":"2024-08-27T03:58:59.795920+0000","last_clean":"2024-08-27T03:58:59.795920+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:58:59.795920+0000","last_undegraded":"2024-08-27T03:58:59.795920+0000","last_fullsized":"2024-08-27T03:58:59.795920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.795734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.795734+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.795734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:33:27.557373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'377","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.526382+0000","last_change":"2024-08-27T03:58:58.526382+0000","last_active":"2024-08-27T03:58:58.526382+0000","last_peered":"2024-08-27T03:58:58.526382+0000","last_clean":"2024-08-27T03:58:58.526382+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:58.526382+0000","last_undegraded":"2024-08-27T03:58:58.526382+0000","last_fullsized":"2024-08-27T03:58:58.526382+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-08-27T03:58:58.526170+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-08-27T03:58:58.526170+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.526170+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:48:28.463191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45479,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1191,"num_write":460,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.807411+0000","last_change":"2024-08-27T03:59:07.807411+0000","last_active":"2024-08-27T03:59:07.807411+0000","last_peered":"2024-08-27T03:59:07.807411+0000","last_clean":"2024-08-27T03:59:07.807411+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:59:07.807411+0000","last_undegraded":"2024-08-27T03:59:07.807411+0000","last_fullsized":"2024-08-27T03:59:07.807411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.807225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.807225+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.807225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:34:57.632321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'143","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.966959+0000","last_change":"2024-08-27T03:59:12.966959+0000","last_active":"2024-08-27T03:59:12.966959+0000","last_peered":"2024-08-27T03:59:12.966959+0000","last_clean":"2024-08-27T03:59:12.966959+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:59:12.966959+0000","last_undegraded":"2024-08-27T03:59:12.966959+0000","last_fullsized":"2024-08-27T03:59:12.966959+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'143","last_scrub_stamp":"2024-08-27T03:59:12.966769+0000","last_deep_scrub":"267'143","last_deep_scrub_stamp":"2024-08-27T03:59:12.966769+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.966769+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:04.722562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'818","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.767544+0000","last_change":"2024-08-27T03:58:51.767544+0000","last_active":"2024-08-27T03:58:51.767544+0000","last_peered":"2024-08-27T03:58:51.767544+0000","last_clean":"2024-08-27T03:58:51.767544+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:58:51.767544+0000","last_undegraded":"2024-08-27T03:58:51.767544+0000","last_fullsized":"2024-08-27T03:58:51.767544+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.767367+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:30:16.877533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'315","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.405258+0000","last_change":"2024-08-27T03:58:40.405258+0000","last_active":"2024-08-27T03:58:40.405258+0000","last_peered":"2024-08-27T03:58:40.405258+0000","last_clean":"2024-08-27T03:58:40.405258+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:40.405258+0000","last_undegraded":"2024-08-27T03:58:40.405258+0000","last_fullsized":"2024-08-27T03:58:40.405258+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.404999+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:33:03.889980+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":392,"num_read_kb":13675,"num_write":949,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.306836+0000","last_change":"2024-08-27T03:59:00.306836+0000","last_active":"2024-08-27T03:59:00.306836+0000","last_peered":"2024-08-27T03:59:00.306836+0000","last_clean":"2024-08-27T03:59:00.306836+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:59:00.306836+0000","last_undegraded":"2024-08-27T03:59:00.306836+0000","last_fullsized":"2024-08-27T03:59:00.306836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.306628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.306628+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.306628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:15:18.222713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'122","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.672926+0000","last_change":"2024-08-27T03:59:04.672926+0000","last_active":"2024-08-27T03:59:04.672926+0000","last_peered":"2024-08-27T03:59:04.672926+0000","last_clean":"2024-08-27T03:59:04.672926+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:59:04.672926+0000","last_undegraded":"2024-08-27T03:59:04.672926+0000","last_fullsized":"2024-08-27T03:59:04.672926+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-08-27T03:59:04.672640+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-08-27T03:59:04.672640+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.672640+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:54:10.069916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.628390+0000","last_change":"2024-08-27T03:59:07.628390+0000","last_active":"2024-08-27T03:59:07.628390+0000","last_peered":"2024-08-27T03:59:07.628390+0000","last_clean":"2024-08-27T03:59:07.628390+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:59:07.628390+0000","last_undegraded":"2024-08-27T03:59:07.628390+0000","last_fullsized":"2024-08-27T03:59:07.628390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.628186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.628186+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.628186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:35.325697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'144","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.590569+0000","last_change":"2024-08-27T03:59:13.590569+0000","last_active":"2024-08-27T03:59:13.590569+0000","last_peered":"2024-08-27T03:59:13.590569+0000","last_clean":"2024-08-27T03:59:13.590569+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:59:13.590569+0000","last_undegraded":"2024-08-27T03:59:13.590569+0000","last_fullsized":"2024-08-27T03:59:13.590569+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'144","last_scrub_stamp":"2024-08-27T03:59:13.590366+0000","last_deep_scrub":"267'144","last_deep_scrub_stamp":"2024-08-27T03:59:13.590366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.590366+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:03.170715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.414992+0000","last_change":"2024-08-27T03:58:48.414992+0000","last_active":"2024-08-27T03:58:48.414992+0000","last_peered":"2024-08-27T03:58:48.414992+0000","last_clean":"2024-08-27T03:58:48.414992+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:58:48.414992+0000","last_undegraded":"2024-08-27T03:58:48.414992+0000","last_fullsized":"2024-08-27T03:58:48.414992+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.414803+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:21.445680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'379","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.593093+0000","last_change":"2024-08-27T03:58:37.593093+0000","last_active":"2024-08-27T03:58:37.593093+0000","last_peered":"2024-08-27T03:58:37.593093+0000","last_clean":"2024-08-27T03:58:37.593093+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:37.593093+0000","last_undegraded":"2024-08-27T03:58:37.593093+0000","last_fullsized":"2024-08-27T03:58:37.593093+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.592948+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:31.585133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":34086,"num_write":1252,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"267'4","reported_seq":951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.286362+0000","last_change":"2024-08-27T03:59:01.286362+0000","last_active":"2024-08-27T03:59:01.286362+0000","last_peered":"2024-08-27T03:59:01.286362+0000","last_clean":"2024-08-27T03:59:01.286362+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:59:01.286362+0000","last_undegraded":"2024-08-27T03:59:01.286362+0000","last_fullsized":"2024-08-27T03:59:01.286362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:01.286155+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:01.286155+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.286155+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:57:27.108308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'161","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.578673+0000","last_change":"2024-08-27T03:58:56.578673+0000","last_active":"2024-08-27T03:58:56.578673+0000","last_peered":"2024-08-27T03:58:56.578673+0000","last_clean":"2024-08-27T03:58:56.578673+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:58:56.578673+0000","last_undegraded":"2024-08-27T03:58:56.578673+0000","last_fullsized":"2024-08-27T03:58:56.578673+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-08-27T03:58:56.578466+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-08-27T03:58:56.578466+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.578466+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:29:51.165504+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'699","reported_seq":2545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.829790+0000","last_change":"2024-08-27T03:59:06.829790+0000","last_active":"2024-08-27T03:59:06.829790+0000","last_peered":"2024-08-27T03:59:06.829790+0000","last_clean":"2024-08-27T03:59:06.829790+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:59:06.829790+0000","last_undegraded":"2024-08-27T03:59:06.829790+0000","last_fullsized":"2024-08-27T03:59:06.829790+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'699","last_scrub_stamp":"2024-08-27T03:59:06.829502+0000","last_deep_scrub":"267'699","last_deep_scrub_stamp":"2024-08-27T03:59:06.829502+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.829502+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":601,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:50:43.865968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'177","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:02.975837+0000","last_change":"2024-08-27T02:31:15.025741+0000","last_active":"2024-08-27T03:58:02.975837+0000","last_peered":"2024-08-27T03:58:02.975837+0000","last_clean":"2024-08-27T03:58:02.975837+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:58:02.975837+0000","last_undegraded":"2024-08-27T03:58:02.975837+0000","last_fullsized":"2024-08-27T03:58:02.975837+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'586","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.205600+0000","last_change":"2024-08-27T03:58:52.205600+0000","last_active":"2024-08-27T03:58:52.205600+0000","last_peered":"2024-08-27T03:58:52.205600+0000","last_clean":"2024-08-27T03:58:52.205600+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:58:52.205600+0000","last_undegraded":"2024-08-27T03:58:52.205600+0000","last_fullsized":"2024-08-27T03:58:52.205600+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'586","last_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_deep_scrub":"267'586","last_deep_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.205406+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:50:44.375635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'340","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.757370+0000","last_change":"2024-08-27T03:58:43.757370+0000","last_active":"2024-08-27T03:58:43.757370+0000","last_peered":"2024-08-27T03:58:43.757370+0000","last_clean":"2024-08-27T03:58:43.757370+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:43.757370+0000","last_undegraded":"2024-08-27T03:58:43.757370+0000","last_fullsized":"2024-08-27T03:58:43.757370+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.757154+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:26.623631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":443,"num_read_kb":7480,"num_write":1117,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.813487+0000","last_change":"2024-08-27T03:59:00.813487+0000","last_active":"2024-08-27T03:59:00.813487+0000","last_peered":"2024-08-27T03:59:00.813487+0000","last_clean":"2024-08-27T03:59:00.813487+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:59:00.813487+0000","last_undegraded":"2024-08-27T03:59:00.813487+0000","last_fullsized":"2024-08-27T03:59:00.813487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.813232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.813232+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.813232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:02:51.715518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'295","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.933820+0000","last_change":"2024-08-27T03:59:01.933820+0000","last_active":"2024-08-27T03:59:01.933820+0000","last_peered":"2024-08-27T03:59:01.933820+0000","last_clean":"2024-08-27T03:59:01.933820+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:59:01.933820+0000","last_undegraded":"2024-08-27T03:59:01.933820+0000","last_fullsized":"2024-08-27T03:59:01.933820+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-08-27T03:59:01.933556+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-08-27T03:59:01.933556+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.933556+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:29:06.683563+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'732","reported_seq":2841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.442211+0000","last_change":"2024-08-27T03:59:13.442211+0000","last_active":"2024-08-27T03:59:13.442211+0000","last_peered":"2024-08-27T03:59:13.442211+0000","last_clean":"2024-08-27T03:59:13.442211+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:59:13.442211+0000","last_undegraded":"2024-08-27T03:59:13.442211+0000","last_fullsized":"2024-08-27T03:59:13.442211+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'732","last_scrub_stamp":"2024-08-27T03:59:13.442031+0000","last_deep_scrub":"267'732","last_deep_scrub_stamp":"2024-08-27T03:59:13.442031+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.442031+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:04.125170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1269","reported_seq":2839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.726782+0000","last_change":"2024-08-27T03:58:50.726782+0000","last_active":"2024-08-27T03:58:50.726782+0000","last_peered":"2024-08-27T03:58:50.726782+0000","last_clean":"2024-08-27T03:58:50.726782+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:58:50.726782+0000","last_undegraded":"2024-08-27T03:58:50.726782+0000","last_fullsized":"2024-08-27T03:58:50.726782+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1269","last_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_deep_scrub":"267'1269","last_deep_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.726573+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":1200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:40:04.847159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'352","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.902356+0000","last_change":"2024-08-27T03:58:43.902156+0000","last_active":"2024-08-27T03:58:43.902356+0000","last_peered":"2024-08-27T03:58:43.902356+0000","last_clean":"2024-08-27T03:58:43.902356+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:43.902356+0000","last_undegraded":"2024-08-27T03:58:43.902356+0000","last_fullsized":"2024-08-27T03:58:43.902356+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.901882+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:44.473839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":34000,"num_write":1087,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.909819+0000","last_change":"2024-08-27T03:58:55.909819+0000","last_active":"2024-08-27T03:58:55.909819+0000","last_peered":"2024-08-27T03:58:55.909819+0000","last_clean":"2024-08-27T03:58:55.909819+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:58:55.909819+0000","last_undegraded":"2024-08-27T03:58:55.909819+0000","last_fullsized":"2024-08-27T03:58:55.909819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:55.909634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:55.909634+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.909634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:36:23.804649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'409","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.812240+0000","last_change":"2024-08-27T03:59:04.812240+0000","last_active":"2024-08-27T03:59:04.812240+0000","last_peered":"2024-08-27T03:59:04.812240+0000","last_clean":"2024-08-27T03:59:04.812240+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:59:04.812240+0000","last_undegraded":"2024-08-27T03:59:04.812240+0000","last_fullsized":"2024-08-27T03:59:04.812240+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-08-27T03:59:04.812027+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-08-27T03:59:04.812027+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.812027+0000","objects_scrubbed":10,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:19:17.728321+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44175,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":1186,"num_write":474,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.166416+0000","last_change":"2024-08-27T03:59:05.166416+0000","last_active":"2024-08-27T03:59:05.166416+0000","last_peered":"2024-08-27T03:59:05.166416+0000","last_clean":"2024-08-27T03:59:05.166416+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:59:05.166416+0000","last_undegraded":"2024-08-27T03:59:05.166416+0000","last_fullsized":"2024-08-27T03:59:05.166416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.166222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.166222+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.166222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:08.593273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'591","reported_seq":1440,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.991865+0000","last_change":"2024-08-27T03:59:13.991865+0000","last_active":"2024-08-27T03:59:13.991865+0000","last_peered":"2024-08-27T03:59:13.991865+0000","last_clean":"2024-08-27T03:59:13.991865+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:59:13.991865+0000","last_undegraded":"2024-08-27T03:59:13.991865+0000","last_fullsized":"2024-08-27T03:59:13.991865+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'591","last_scrub_stamp":"2024-08-27T03:59:13.991679+0000","last_deep_scrub":"267'591","last_deep_scrub_stamp":"2024-08-27T03:59:13.991679+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.991679+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:34.432969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1459","reported_seq":2962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.678164+0000","last_change":"2024-08-27T03:58:50.678164+0000","last_active":"2024-08-27T03:58:50.678164+0000","last_peered":"2024-08-27T03:58:50.678164+0000","last_clean":"2024-08-27T03:58:50.678164+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:58:50.678164+0000","last_undegraded":"2024-08-27T03:58:50.678164+0000","last_fullsized":"2024-08-27T03:58:50.678164+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1459","last_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_deep_scrub":"267'1459","last_deep_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.677969+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:05:44.968990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'373","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.897914+0000","last_change":"2024-08-27T03:58:40.897763+0000","last_active":"2024-08-27T03:58:40.897914+0000","last_peered":"2024-08-27T03:58:40.897914+0000","last_clean":"2024-08-27T03:58:40.897914+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:40.897914+0000","last_undegraded":"2024-08-27T03:58:40.897914+0000","last_fullsized":"2024-08-27T03:58:40.897914+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.897535+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:28:11.789719+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400081,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":644,"num_read_kb":2850,"num_write":1271,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.446962+0000","last_change":"2024-08-27T03:58:50.446962+0000","last_active":"2024-08-27T03:58:50.446962+0000","last_peered":"2024-08-27T03:58:50.446962+0000","last_clean":"2024-08-27T03:58:50.446962+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:58:50.446962+0000","last_undegraded":"2024-08-27T03:58:50.446962+0000","last_fullsized":"2024-08-27T03:58:50.446962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.446779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:37.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'312","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.356278+0000","last_change":"2024-08-27T03:59:03.356278+0000","last_active":"2024-08-27T03:59:03.356278+0000","last_peered":"2024-08-27T03:59:03.356278+0000","last_clean":"2024-08-27T03:59:03.356278+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:59:03.356278+0000","last_undegraded":"2024-08-27T03:59:03.356278+0000","last_fullsized":"2024-08-27T03:59:03.356278+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-08-27T03:59:03.356083+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-08-27T03:59:03.356083+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.356083+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:28:02.032416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.452725+0000","last_change":"2024-08-27T03:59:11.452725+0000","last_active":"2024-08-27T03:59:11.452725+0000","last_peered":"2024-08-27T03:59:11.452725+0000","last_clean":"2024-08-27T03:59:11.452725+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:59:11.452725+0000","last_undegraded":"2024-08-27T03:59:11.452725+0000","last_fullsized":"2024-08-27T03:59:11.452725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:11.452489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:11.452489+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.452489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:53:42.936078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2397","reported_seq":4240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.612748+0000","last_change":"2024-08-27T03:58:59.612748+0000","last_active":"2024-08-27T03:58:59.612748+0000","last_peered":"2024-08-27T03:58:59.612748+0000","last_clean":"2024-08-27T03:58:59.612748+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:58:59.612748+0000","last_undegraded":"2024-08-27T03:58:59.612748+0000","last_fullsized":"2024-08-27T03:58:59.612748+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2397","last_scrub_stamp":"2024-08-27T03:58:59.612560+0000","last_deep_scrub":"267'2397","last_deep_scrub_stamp":"2024-08-27T03:58:59.612560+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.612560+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":2300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:19:39.008794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'442","reported_seq":1947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.728545+0000","last_change":"2024-08-27T03:58:46.728545+0000","last_active":"2024-08-27T03:58:46.728545+0000","last_peered":"2024-08-27T03:58:46.728545+0000","last_clean":"2024-08-27T03:58:46.728545+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:58:46.728545+0000","last_undegraded":"2024-08-27T03:58:46.728545+0000","last_fullsized":"2024-08-27T03:58:46.728545+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.728340+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:06.435241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'337","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.909461+0000","last_change":"2024-08-27T03:58:42.909307+0000","last_active":"2024-08-27T03:58:42.909461+0000","last_peered":"2024-08-27T03:58:42.909461+0000","last_clean":"2024-08-27T03:58:42.909461+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:42.909461+0000","last_undegraded":"2024-08-27T03:58:42.909461+0000","last_fullsized":"2024-08-27T03:58:42.909461+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.909045+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:53.647196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1998258,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":51263,"num_write":1130,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.501182+0000","last_change":"2024-08-27T03:58:52.501054+0000","last_active":"2024-08-27T03:58:52.501182+0000","last_peered":"2024-08-27T03:58:52.501182+0000","last_clean":"2024-08-27T03:58:52.501182+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:58:52.501182+0000","last_undegraded":"2024-08-27T03:58:52.501182+0000","last_fullsized":"2024-08-27T03:58:52.501182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.500871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:38.128581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'369","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.919018+0000","last_change":"2024-08-27T03:59:00.919018+0000","last_active":"2024-08-27T03:59:00.919018+0000","last_peered":"2024-08-27T03:59:00.919018+0000","last_clean":"2024-08-27T03:59:00.919018+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:59:00.919018+0000","last_undegraded":"2024-08-27T03:59:00.919018+0000","last_fullsized":"2024-08-27T03:59:00.919018+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-08-27T03:59:00.918768+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-08-27T03:59:00.918768+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.918768+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:41:01.877708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":1205,"num_write":456,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'721","reported_seq":4960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.429142+0000","last_change":"2024-08-27T03:59:03.429142+0000","last_active":"2024-08-27T03:59:03.429142+0000","last_peered":"2024-08-27T03:59:03.429142+0000","last_clean":"2024-08-27T03:59:03.429142+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:59:03.429142+0000","last_undegraded":"2024-08-27T03:59:03.429142+0000","last_fullsized":"2024-08-27T03:59:03.429142+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'721","last_scrub_stamp":"2024-08-27T03:59:03.428951+0000","last_deep_scrub":"267'721","last_deep_scrub_stamp":"2024-08-27T03:59:03.428951+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.428951+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:09.865002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'173","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.593053+0000","last_change":"2024-08-27T03:59:10.593053+0000","last_active":"2024-08-27T03:59:10.593053+0000","last_peered":"2024-08-27T03:59:10.593053+0000","last_clean":"2024-08-27T03:59:10.593053+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:59:10.593053+0000","last_undegraded":"2024-08-27T03:59:10.593053+0000","last_fullsized":"2024-08-27T03:59:10.593053+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-08-27T03:59:10.592870+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-08-27T03:59:10.592870+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.592870+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:15.224143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'799","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.365595+0000","last_change":"2024-08-27T03:58:46.365457+0000","last_active":"2024-08-27T03:58:46.365595+0000","last_peered":"2024-08-27T03:58:46.365595+0000","last_clean":"2024-08-27T03:58:46.365595+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:46.365595+0000","last_undegraded":"2024-08-27T03:58:46.365595+0000","last_fullsized":"2024-08-27T03:58:46.365595+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'799","last_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_deep_scrub":"267'799","last_deep_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.365257+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:38.841374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'306","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.677763+0000","last_change":"2024-08-27T03:58:40.677586+0000","last_active":"2024-08-27T03:58:40.677763+0000","last_peered":"2024-08-27T03:58:40.677763+0000","last_clean":"2024-08-27T03:58:40.677763+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:40.677763+0000","last_undegraded":"2024-08-27T03:58:40.677763+0000","last_fullsized":"2024-08-27T03:58:40.677763+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.677362+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:13:35.785593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437736,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":7344,"num_write":963,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.471473+0000","last_change":"2024-08-27T03:58:51.471473+0000","last_active":"2024-08-27T03:58:51.471473+0000","last_peered":"2024-08-27T03:58:51.471473+0000","last_clean":"2024-08-27T03:58:51.471473+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:58:51.471473+0000","last_undegraded":"2024-08-27T03:58:51.471473+0000","last_fullsized":"2024-08-27T03:58:51.471473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.471186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:37:00.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'502","reported_seq":1187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.558075+0000","last_change":"2024-08-27T03:59:00.558075+0000","last_active":"2024-08-27T03:59:00.558075+0000","last_peered":"2024-08-27T03:59:00.558075+0000","last_clean":"2024-08-27T03:59:00.558075+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:59:00.558075+0000","last_undegraded":"2024-08-27T03:59:00.558075+0000","last_fullsized":"2024-08-27T03:59:00.558075+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'502","last_scrub_stamp":"2024-08-27T03:59:00.557849+0000","last_deep_scrub":"267'502","last_deep_scrub_stamp":"2024-08-27T03:59:00.557849+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.557849+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:16.615000+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73530,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2086,"num_write":702,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.619192+0000","last_change":"2024-08-27T03:58:59.619192+0000","last_active":"2024-08-27T03:58:59.619192+0000","last_peered":"2024-08-27T03:58:59.619192+0000","last_clean":"2024-08-27T03:58:59.619192+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:58:59.619192+0000","last_undegraded":"2024-08-27T03:58:59.619192+0000","last_fullsized":"2024-08-27T03:58:59.619192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.619006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.619006+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.619006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:28:08.565324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'131","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.087976+0000","last_change":"2024-08-27T03:59:00.087976+0000","last_active":"2024-08-27T03:59:00.087976+0000","last_peered":"2024-08-27T03:59:00.087976+0000","last_clean":"2024-08-27T03:59:00.087976+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:59:00.087976+0000","last_undegraded":"2024-08-27T03:59:00.087976+0000","last_fullsized":"2024-08-27T03:59:00.087976+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-08-27T03:59:00.087746+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-08-27T03:59:00.087746+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.087746+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:20.853635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'444","reported_seq":1982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.708558+0000","last_change":"2024-08-27T03:58:43.708403+0000","last_active":"2024-08-27T03:58:43.708558+0000","last_peered":"2024-08-27T03:58:43.708558+0000","last_clean":"2024-08-27T03:58:43.708558+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:58:43.708558+0000","last_undegraded":"2024-08-27T03:58:43.708558+0000","last_fullsized":"2024-08-27T03:58:43.708558+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.708210+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:51:30.618879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'311","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.180394+0000","last_change":"2024-08-27T03:58:42.180228+0000","last_active":"2024-08-27T03:58:42.180394+0000","last_peered":"2024-08-27T03:58:42.180394+0000","last_clean":"2024-08-27T03:58:42.180394+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:42.180394+0000","last_undegraded":"2024-08-27T03:58:42.180394+0000","last_fullsized":"2024-08-27T03:58:42.180394+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.179951+0000","objects_scrubbed":12,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:16.625194+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490466,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":3133,"num_write":1058,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.542454+0000","last_change":"2024-08-27T03:58:53.542226+0000","last_active":"2024-08-27T03:58:53.542454+0000","last_peered":"2024-08-27T03:58:53.542454+0000","last_clean":"2024-08-27T03:58:53.542454+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:58:53.542454+0000","last_undegraded":"2024-08-27T03:58:53.542454+0000","last_fullsized":"2024-08-27T03:58:53.542454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.541954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:03.310498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'324","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.695103+0000","last_change":"2024-08-27T03:59:03.695103+0000","last_active":"2024-08-27T03:59:03.695103+0000","last_peered":"2024-08-27T03:59:03.695103+0000","last_clean":"2024-08-27T03:59:03.695103+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:59:03.695103+0000","last_undegraded":"2024-08-27T03:59:03.695103+0000","last_fullsized":"2024-08-27T03:59:03.695103+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-08-27T03:59:03.694903+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-08-27T03:59:03.694903+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.694903+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:37:33.840824+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.508966+0000","last_change":"2024-08-27T03:59:05.508803+0000","last_active":"2024-08-27T03:59:05.508966+0000","last_peered":"2024-08-27T03:59:05.508966+0000","last_clean":"2024-08-27T03:59:05.508966+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:59:05.508966+0000","last_undegraded":"2024-08-27T03:59:05.508966+0000","last_fullsized":"2024-08-27T03:59:05.508966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.508630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.508630+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.508630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:46:36.101798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'126","reported_seq":652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.448587+0000","last_change":"2024-08-27T03:59:14.448587+0000","last_active":"2024-08-27T03:59:14.448587+0000","last_peered":"2024-08-27T03:59:14.448587+0000","last_clean":"2024-08-27T03:59:14.448587+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:59:14.448587+0000","last_undegraded":"2024-08-27T03:59:14.448587+0000","last_fullsized":"2024-08-27T03:59:14.448587+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-08-27T03:59:14.448374+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-08-27T03:59:14.448374+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.448374+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:19:46.371369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'306","reported_seq":1707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.720598+0000","last_change":"2024-08-27T03:58:45.720430+0000","last_active":"2024-08-27T03:58:45.720598+0000","last_peered":"2024-08-27T03:58:45.720598+0000","last_clean":"2024-08-27T03:58:45.720598+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:58:45.720598+0000","last_undegraded":"2024-08-27T03:58:45.720598+0000","last_fullsized":"2024-08-27T03:58:45.720598+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.720239+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:13:56.970539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1145,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'321","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.795951+0000","last_change":"2024-08-27T03:58:39.795951+0000","last_active":"2024-08-27T03:58:39.795951+0000","last_peered":"2024-08-27T03:58:39.795951+0000","last_clean":"2024-08-27T03:58:39.795951+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:39.795951+0000","last_undegraded":"2024-08-27T03:58:39.795951+0000","last_fullsized":"2024-08-27T03:58:39.795951+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.795741+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:23.816179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":447,"num_read_kb":5526,"num_write":1006,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.988502+0000","last_change":"2024-08-27T03:58:52.988368+0000","last_active":"2024-08-27T03:58:52.988502+0000","last_peered":"2024-08-27T03:58:52.988502+0000","last_clean":"2024-08-27T03:58:52.988502+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:58:52.988502+0000","last_undegraded":"2024-08-27T03:58:52.988502+0000","last_fullsized":"2024-08-27T03:58:52.988502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.988149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:55.540473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'383","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.561586+0000","last_change":"2024-08-27T03:58:54.561448+0000","last_active":"2024-08-27T03:58:54.561586+0000","last_peered":"2024-08-27T03:58:54.561586+0000","last_clean":"2024-08-27T03:58:54.561586+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:54.561586+0000","last_undegraded":"2024-08-27T03:58:54.561586+0000","last_fullsized":"2024-08-27T03:58:54.561586+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.561237+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:34.180367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'671","reported_seq":2569,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.564764+0000","last_change":"2024-08-27T03:58:55.564627+0000","last_active":"2024-08-27T03:58:55.564764+0000","last_peered":"2024-08-27T03:58:55.564764+0000","last_clean":"2024-08-27T03:58:55.564764+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:55.564764+0000","last_undegraded":"2024-08-27T03:58:55.564764+0000","last_fullsized":"2024-08-27T03:58:55.564764+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'671","last_scrub_stamp":"2024-08-27T03:58:55.564443+0000","last_deep_scrub":"267'671","last_deep_scrub_stamp":"2024-08-27T03:58:55.564443+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.564443+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:46.587213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'100","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.085509+0000","last_change":"2024-08-27T03:59:01.085509+0000","last_active":"2024-08-27T03:59:01.085509+0000","last_peered":"2024-08-27T03:59:01.085509+0000","last_clean":"2024-08-27T03:59:01.085509+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:59:01.085509+0000","last_undegraded":"2024-08-27T03:59:01.085509+0000","last_fullsized":"2024-08-27T03:59:01.085509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-08-27T03:59:01.085321+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-08-27T03:59:01.085321+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.085321+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:20:16.069103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'839","reported_seq":2594,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.683482+0000","last_change":"2024-08-27T03:58:44.683311+0000","last_active":"2024-08-27T03:58:44.683482+0000","last_peered":"2024-08-27T03:58:44.683482+0000","last_clean":"2024-08-27T03:58:44.683482+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:58:44.683482+0000","last_undegraded":"2024-08-27T03:58:44.683482+0000","last_fullsized":"2024-08-27T03:58:44.683482+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.683090+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:40:01.412803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'328","reported_seq":1142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.709167+0000","last_change":"2024-08-27T03:58:37.709167+0000","last_active":"2024-08-27T03:58:37.709167+0000","last_peered":"2024-08-27T03:58:37.709167+0000","last_clean":"2024-08-27T03:58:37.709167+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:37.709167+0000","last_undegraded":"2024-08-27T03:58:37.709167+0000","last_fullsized":"2024-08-27T03:58:37.709167+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.708679+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:51:40.565196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185741,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":802,"num_read_kb":112858,"num_write":1079,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1375,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.836398+0000","last_change":"2024-08-27T03:58:58.836398+0000","last_active":"2024-08-27T03:58:58.836398+0000","last_peered":"2024-08-27T03:58:58.836398+0000","last_clean":"2024-08-27T03:58:58.836398+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:58.836398+0000","last_undegraded":"2024-08-27T03:58:58.836398+0000","last_fullsized":"2024-08-27T03:58:58.836398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:58:58.836197+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:58:58.836197+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.836197+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:38:25.191657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'122","reported_seq":690,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.320351+0000","last_change":"2024-08-27T03:59:04.320351+0000","last_active":"2024-08-27T03:59:04.320351+0000","last_peered":"2024-08-27T03:59:04.320351+0000","last_clean":"2024-08-27T03:59:04.320351+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:59:04.320351+0000","last_undegraded":"2024-08-27T03:59:04.320351+0000","last_fullsized":"2024-08-27T03:59:04.320351+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-08-27T03:59:04.320135+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-08-27T03:59:04.320135+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.320135+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:13:37.596149+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'692","reported_seq":3073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.628587+0000","last_change":"2024-08-27T03:58:55.628230+0000","last_active":"2024-08-27T03:58:55.628587+0000","last_peered":"2024-08-27T03:58:55.628587+0000","last_clean":"2024-08-27T03:58:55.628587+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:55.628587+0000","last_undegraded":"2024-08-27T03:58:55.628587+0000","last_fullsized":"2024-08-27T03:58:55.628587+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'692","last_scrub_stamp":"2024-08-27T03:58:55.627775+0000","last_deep_scrub":"267'692","last_deep_scrub_stamp":"2024-08-27T03:58:55.627775+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.627775+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:12:31.378425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'123","reported_seq":655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.649346+0000","last_change":"2024-08-27T03:59:11.649346+0000","last_active":"2024-08-27T03:59:11.649346+0000","last_peered":"2024-08-27T03:59:11.649346+0000","last_clean":"2024-08-27T03:59:11.649346+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:59:11.649346+0000","last_undegraded":"2024-08-27T03:59:11.649346+0000","last_fullsized":"2024-08-27T03:59:11.649346+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-08-27T03:59:11.649161+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-08-27T03:59:11.649161+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.649161+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:40.377878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.209300+0000","last_change":"2024-08-27T03:58:45.209172+0000","last_active":"2024-08-27T03:58:45.209300+0000","last_peered":"2024-08-27T03:58:45.209300+0000","last_clean":"2024-08-27T03:58:45.209300+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:58:45.209300+0000","last_undegraded":"2024-08-27T03:58:45.209300+0000","last_fullsized":"2024-08-27T03:58:45.209300+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'786","last_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_deep_scrub":"267'786","last_deep_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.208970+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:19.947547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'384","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.079881+0000","last_change":"2024-08-27T03:58:39.079881+0000","last_active":"2024-08-27T03:58:39.079881+0000","last_peered":"2024-08-27T03:58:39.079881+0000","last_clean":"2024-08-27T03:58:39.079881+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:39.079881+0000","last_undegraded":"2024-08-27T03:58:39.079881+0000","last_fullsized":"2024-08-27T03:58:39.079881+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.079659+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:55:08.844282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":741,"num_read_kb":1678,"num_write":1218,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.671459+0000","last_change":"2024-08-27T03:58:59.671459+0000","last_active":"2024-08-27T03:58:59.671459+0000","last_peered":"2024-08-27T03:58:59.671459+0000","last_clean":"2024-08-27T03:58:59.671459+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:58:59.671459+0000","last_undegraded":"2024-08-27T03:58:59.671459+0000","last_fullsized":"2024-08-27T03:58:59.671459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.671283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.671283+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.671283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:23.974901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'410","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.806276+0000","last_change":"2024-08-27T03:59:03.806276+0000","last_active":"2024-08-27T03:59:03.806276+0000","last_peered":"2024-08-27T03:59:03.806276+0000","last_clean":"2024-08-27T03:59:03.806276+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:59:03.806276+0000","last_undegraded":"2024-08-27T03:59:03.806276+0000","last_fullsized":"2024-08-27T03:59:03.806276+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:59:03.806081+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:59:03.806081+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.806081+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:23:15.635294+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46460,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":1211,"num_write":486,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.634370+0000","last_change":"2024-08-27T03:58:54.634237+0000","last_active":"2024-08-27T03:58:54.634370+0000","last_peered":"2024-08-27T03:58:54.634370+0000","last_clean":"2024-08-27T03:58:54.634370+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:58:54.634370+0000","last_undegraded":"2024-08-27T03:58:54.634370+0000","last_fullsized":"2024-08-27T03:58:54.634370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.634062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:29:28.972507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'231","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.167795+0000","last_change":"2024-08-27T03:59:06.167795+0000","last_active":"2024-08-27T03:59:06.167795+0000","last_peered":"2024-08-27T03:59:06.167795+0000","last_clean":"2024-08-27T03:59:06.167795+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:59:06.167795+0000","last_undegraded":"2024-08-27T03:59:06.167795+0000","last_fullsized":"2024-08-27T03:59:06.167795+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-08-27T03:59:06.167567+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-08-27T03:59:06.167567+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.167567+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:11:12.479825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'527","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.697377+0000","last_change":"2024-08-27T03:58:45.697240+0000","last_active":"2024-08-27T03:58:45.697377+0000","last_peered":"2024-08-27T03:58:45.697377+0000","last_clean":"2024-08-27T03:58:45.697377+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:45.697377+0000","last_undegraded":"2024-08-27T03:58:45.697377+0000","last_fullsized":"2024-08-27T03:58:45.697377+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'527","last_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_deep_scrub":"267'527","last_deep_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.697061+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:09:58.090847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.931420+0000","last_change":"2024-08-27T03:58:39.931282+0000","last_active":"2024-08-27T03:58:39.931420+0000","last_peered":"2024-08-27T03:58:39.931420+0000","last_clean":"2024-08-27T03:58:39.931420+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:58:39.931420+0000","last_undegraded":"2024-08-27T03:58:39.931420+0000","last_fullsized":"2024-08-27T03:58:39.931420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.931095+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:05.232163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.617117+0000","last_change":"2024-08-27T03:58:38.617117+0000","last_active":"2024-08-27T03:58:38.617117+0000","last_peered":"2024-08-27T03:58:38.617117+0000","last_clean":"2024-08-27T03:58:38.617117+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:58:38.617117+0000","last_undegraded":"2024-08-27T03:58:38.617117+0000","last_fullsized":"2024-08-27T03:58:38.617117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.616933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:18:37.622258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'304","reported_seq":1178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.092930+0000","last_change":"2024-08-27T03:58:37.092930+0000","last_active":"2024-08-27T03:58:37.092930+0000","last_peered":"2024-08-27T03:58:37.092930+0000","last_clean":"2024-08-27T03:58:37.092930+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:37.092930+0000","last_undegraded":"2024-08-27T03:58:37.092930+0000","last_fullsized":"2024-08-27T03:58:37.092930+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'304","last_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_deep_scrub":"267'304","last_deep_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.092840+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:11:02.137368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":118351,"num_write":1022,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.906076+0000","last_change":"2024-08-27T03:58:53.906076+0000","last_active":"2024-08-27T03:58:53.906076+0000","last_peered":"2024-08-27T03:58:53.906076+0000","last_clean":"2024-08-27T03:58:53.906076+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:58:53.906076+0000","last_undegraded":"2024-08-27T03:58:53.906076+0000","last_fullsized":"2024-08-27T03:58:53.906076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.905892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:27:49.003970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'740","reported_seq":1490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.822717+0000","last_change":"2024-08-27T03:59:02.822717+0000","last_active":"2024-08-27T03:59:02.822717+0000","last_peered":"2024-08-27T03:59:02.822717+0000","last_clean":"2024-08-27T03:59:02.822717+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:59:02.822717+0000","last_undegraded":"2024-08-27T03:59:02.822717+0000","last_fullsized":"2024-08-27T03:59:02.822717+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'740","last_scrub_stamp":"2024-08-27T03:59:02.822503+0000","last_deep_scrub":"267'740","last_deep_scrub_stamp":"2024-08-27T03:59:02.822503+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.822503+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:50:40.430031+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136746,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1442,"num_read_kb":3290,"num_write":1350,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89174,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.503009+0000","last_change":"2024-08-27T03:59:01.503009+0000","last_active":"2024-08-27T03:59:01.503009+0000","last_peered":"2024-08-27T03:59:01.503009+0000","last_clean":"2024-08-27T03:59:01.503009+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:59:01.503009+0000","last_undegraded":"2024-08-27T03:59:01.503009+0000","last_fullsized":"2024-08-27T03:59:01.503009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.502832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.502832+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.502832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:42:04.484327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'209","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.607407+0000","last_change":"2024-08-27T03:59:00.607407+0000","last_active":"2024-08-27T03:59:00.607407+0000","last_peered":"2024-08-27T03:59:00.607407+0000","last_clean":"2024-08-27T03:59:00.607407+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:59:00.607407+0000","last_undegraded":"2024-08-27T03:59:00.607407+0000","last_fullsized":"2024-08-27T03:59:00.607407+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'209","last_scrub_stamp":"2024-08-27T03:59:00.607219+0000","last_deep_scrub":"267'209","last_deep_scrub_stamp":"2024-08-27T03:59:00.607219+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.607219+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:29:47.730006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1519","reported_seq":3083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.414552+0000","last_change":"2024-08-27T03:58:47.414552+0000","last_active":"2024-08-27T03:58:47.414552+0000","last_peered":"2024-08-27T03:58:47.414552+0000","last_clean":"2024-08-27T03:58:47.414552+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:58:47.414552+0000","last_undegraded":"2024-08-27T03:58:47.414552+0000","last_fullsized":"2024-08-27T03:58:47.414552+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1519","last_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_deep_scrub":"267'1519","last_deep_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.414375+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":1500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:57.554800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.858129+0000","last_change":"2024-08-27T03:58:41.857903+0000","last_active":"2024-08-27T03:58:41.858129+0000","last_peered":"2024-08-27T03:58:41.858129+0000","last_clean":"2024-08-27T03:58:41.858129+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:58:41.858129+0000","last_undegraded":"2024-08-27T03:58:41.858129+0000","last_fullsized":"2024-08-27T03:58:41.858129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.857697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:28:49.679382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'389","reported_seq":1157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.456247+0000","last_change":"2024-08-27T03:58:39.456247+0000","last_active":"2024-08-27T03:58:39.456247+0000","last_peered":"2024-08-27T03:58:39.456247+0000","last_clean":"2024-08-27T03:58:39.456247+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:39.456247+0000","last_undegraded":"2024-08-27T03:58:39.456247+0000","last_fullsized":"2024-08-27T03:58:39.456247+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.455922+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:28:43.685014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458876,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":824,"num_read_kb":13511,"num_write":1117,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"267'6","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.884625+0000","last_change":"2024-08-27T03:58:57.884625+0000","last_active":"2024-08-27T03:58:57.884625+0000","last_peered":"2024-08-27T03:58:57.884625+0000","last_clean":"2024-08-27T03:58:57.884625+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:57.884625+0000","last_undegraded":"2024-08-27T03:58:57.884625+0000","last_fullsized":"2024-08-27T03:58:57.884625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:58:57.884430+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:58:57.884430+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.884430+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:46:28.135856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1347","reported_seq":3342,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.104908+0000","last_change":"2024-08-27T03:58:57.104908+0000","last_active":"2024-08-27T03:58:57.104908+0000","last_peered":"2024-08-27T03:58:57.104908+0000","last_clean":"2024-08-27T03:58:57.104908+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:57.104908+0000","last_undegraded":"2024-08-27T03:58:57.104908+0000","last_fullsized":"2024-08-27T03:58:57.104908+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1347","last_scrub_stamp":"2024-08-27T03:58:57.104692+0000","last_deep_scrub":"267'1347","last_deep_scrub_stamp":"2024-08-27T03:58:57.104692+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.104692+0000","objects_scrubbed":12,"log_size":47,"log_dups_size":1300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:35:19.289204+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137506,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2076,"num_read_kb":3979,"num_write":1262,"num_write_kb":1030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.893194+0000","last_change":"2024-08-27T03:59:03.893040+0000","last_active":"2024-08-27T03:59:03.893194+0000","last_peered":"2024-08-27T03:59:03.893194+0000","last_clean":"2024-08-27T03:59:03.893194+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:59:03.893194+0000","last_undegraded":"2024-08-27T03:59:03.893194+0000","last_fullsized":"2024-08-27T03:59:03.893194+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:03.892863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:03.892863+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.892863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:19.756166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'166","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.094133+0000","last_change":"2024-08-27T03:59:02.094133+0000","last_active":"2024-08-27T03:59:02.094133+0000","last_peered":"2024-08-27T03:59:02.094133+0000","last_clean":"2024-08-27T03:59:02.094133+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:59:02.094133+0000","last_undegraded":"2024-08-27T03:59:02.094133+0000","last_fullsized":"2024-08-27T03:59:02.094133+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:02.093895+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:02.093895+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.093895+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:38:46.246473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.587280+0000","last_change":"2024-08-27T03:58:43.587280+0000","last_active":"2024-08-27T03:58:43.587280+0000","last_peered":"2024-08-27T03:58:43.587280+0000","last_clean":"2024-08-27T03:58:43.587280+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:58:43.587280+0000","last_undegraded":"2024-08-27T03:58:43.587280+0000","last_fullsized":"2024-08-27T03:58:43.587280+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.587095+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:03.769401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.604535+0000","last_change":"2024-08-27T03:58:36.604535+0000","last_active":"2024-08-27T03:58:36.604535+0000","last_peered":"2024-08-27T03:58:36.604535+0000","last_clean":"2024-08-27T03:58:36.604535+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:58:36.604535+0000","last_undegraded":"2024-08-27T03:58:36.604535+0000","last_fullsized":"2024-08-27T03:58:36.604535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.604457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:03:12.862350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'400","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.071524+0000","last_change":"2024-08-27T03:58:38.071524+0000","last_active":"2024-08-27T03:58:38.071524+0000","last_peered":"2024-08-27T03:58:38.071524+0000","last_clean":"2024-08-27T03:58:38.071524+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:38.071524+0000","last_undegraded":"2024-08-27T03:58:38.071524+0000","last_fullsized":"2024-08-27T03:58:38.071524+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.071425+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:30:14.243648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":29601,"num_write":1270,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.460375+0000","last_change":"2024-08-27T03:58:49.460375+0000","last_active":"2024-08-27T03:58:49.460375+0000","last_peered":"2024-08-27T03:58:49.460375+0000","last_clean":"2024-08-27T03:58:49.460375+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:58:49.460375+0000","last_undegraded":"2024-08-27T03:58:49.460375+0000","last_fullsized":"2024-08-27T03:58:49.460375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.460156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:20.731797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'336","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.948545+0000","last_change":"2024-08-27T03:58:59.948262+0000","last_active":"2024-08-27T03:58:59.948545+0000","last_peered":"2024-08-27T03:58:59.948545+0000","last_clean":"2024-08-27T03:58:59.948545+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:59.948545+0000","last_undegraded":"2024-08-27T03:58:59.948545+0000","last_fullsized":"2024-08-27T03:58:59.948545+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-08-27T03:58:59.947989+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-08-27T03:58:59.947989+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.947989+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:34:29.854493+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.465714+0000","last_change":"2024-08-27T03:59:04.465714+0000","last_active":"2024-08-27T03:59:04.465714+0000","last_peered":"2024-08-27T03:59:04.465714+0000","last_clean":"2024-08-27T03:59:04.465714+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:59:04.465714+0000","last_undegraded":"2024-08-27T03:59:04.465714+0000","last_fullsized":"2024-08-27T03:59:04.465714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:04.465518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:04.465518+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.465518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:49.559949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'259","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:45.085862+0000","last_change":"2024-08-27T02:31:14.514321+0000","last_active":"2024-08-27T03:56:45.085862+0000","last_peered":"2024-08-27T03:56:45.085862+0000","last_clean":"2024-08-27T03:56:45.085862+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:56:45.085862+0000","last_undegraded":"2024-08-27T03:56:45.085862+0000","last_fullsized":"2024-08-27T03:56:45.085862+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.177188+0000","last_change":"2024-08-27T03:58:46.177188+0000","last_active":"2024-08-27T03:58:46.177188+0000","last_peered":"2024-08-27T03:58:46.177188+0000","last_clean":"2024-08-27T03:58:46.177188+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:58:46.177188+0000","last_undegraded":"2024-08-27T03:58:46.177188+0000","last_fullsized":"2024-08-27T03:58:46.177188+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.177002+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:00:50.953987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.658282+0000","last_change":"2024-08-27T03:58:37.658282+0000","last_active":"2024-08-27T03:58:37.658282+0000","last_peered":"2024-08-27T03:58:37.658282+0000","last_clean":"2024-08-27T03:58:37.658282+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:58:37.658282+0000","last_undegraded":"2024-08-27T03:58:37.658282+0000","last_fullsized":"2024-08-27T03:58:37.658282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.658091+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:22.087261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'346","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.730918+0000","last_change":"2024-08-27T03:58:38.730918+0000","last_active":"2024-08-27T03:58:38.730918+0000","last_peered":"2024-08-27T03:58:38.730918+0000","last_clean":"2024-08-27T03:58:38.730918+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:38.730918+0000","last_undegraded":"2024-08-27T03:58:38.730918+0000","last_fullsized":"2024-08-27T03:58:38.730918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.730550+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:48:41.072429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573788,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":426,"num_read_kb":9573,"num_write":1083,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.464923+0000","last_change":"2024-08-27T03:58:51.464782+0000","last_active":"2024-08-27T03:58:51.464923+0000","last_peered":"2024-08-27T03:58:51.464923+0000","last_clean":"2024-08-27T03:58:51.464923+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:58:51.464923+0000","last_undegraded":"2024-08-27T03:58:51.464923+0000","last_fullsized":"2024-08-27T03:58:51.464923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.464600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:07.725251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'179","reported_seq":773,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.322303+0000","last_change":"2024-08-27T03:59:02.322303+0000","last_active":"2024-08-27T03:59:02.322303+0000","last_peered":"2024-08-27T03:59:02.322303+0000","last_clean":"2024-08-27T03:59:02.322303+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:59:02.322303+0000","last_undegraded":"2024-08-27T03:59:02.322303+0000","last_fullsized":"2024-08-27T03:59:02.322303+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'179","last_scrub_stamp":"2024-08-27T03:59:02.322101+0000","last_deep_scrub":"267'179","last_deep_scrub_stamp":"2024-08-27T03:59:02.322101+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.322101+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:39:59.680636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.675155+0000","last_change":"2024-08-27T03:58:53.675155+0000","last_active":"2024-08-27T03:58:53.675155+0000","last_peered":"2024-08-27T03:58:53.675155+0000","last_clean":"2024-08-27T03:58:53.675155+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:58:53.675155+0000","last_undegraded":"2024-08-27T03:58:53.675155+0000","last_fullsized":"2024-08-27T03:58:53.675155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.674951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:48.890985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.809753+0000","last_change":"2024-08-27T03:59:08.809753+0000","last_active":"2024-08-27T03:59:08.809753+0000","last_peered":"2024-08-27T03:59:08.809753+0000","last_clean":"2024-08-27T03:59:08.809753+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:59:08.809753+0000","last_undegraded":"2024-08-27T03:59:08.809753+0000","last_fullsized":"2024-08-27T03:59:08.809753+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-08-27T03:59:08.809576+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-08-27T03:59:08.809576+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.809576+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:59:08.997058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1265","reported_seq":2845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.167609+0000","last_change":"2024-08-27T03:58:44.167609+0000","last_active":"2024-08-27T03:58:44.167609+0000","last_peered":"2024-08-27T03:58:44.167609+0000","last_clean":"2024-08-27T03:58:44.167609+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:58:44.167609+0000","last_undegraded":"2024-08-27T03:58:44.167609+0000","last_fullsized":"2024-08-27T03:58:44.167609+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1265","last_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_deep_scrub":"267'1265","last_deep_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.167407+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:51:52.232154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'345","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.629995+0000","last_change":"2024-08-27T03:58:39.629743+0000","last_active":"2024-08-27T03:58:39.629995+0000","last_peered":"2024-08-27T03:58:39.629995+0000","last_clean":"2024-08-27T03:58:39.629995+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:39.629995+0000","last_undegraded":"2024-08-27T03:58:39.629995+0000","last_fullsized":"2024-08-27T03:58:39.629995+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.629340+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:32.213907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":946,"num_write":1113,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.053529+0000","last_change":"2024-08-27T03:58:37.053529+0000","last_active":"2024-08-27T03:58:37.053529+0000","last_peered":"2024-08-27T03:58:37.053529+0000","last_clean":"2024-08-27T03:58:37.053529+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:58:37.053529+0000","last_undegraded":"2024-08-27T03:58:37.053529+0000","last_fullsized":"2024-08-27T03:58:37.053529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.053430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:25.862689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.564981+0000","last_change":"2024-08-27T03:58:56.564981+0000","last_active":"2024-08-27T03:58:56.564981+0000","last_peered":"2024-08-27T03:58:56.564981+0000","last_clean":"2024-08-27T03:58:56.564981+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:58:56.564981+0000","last_undegraded":"2024-08-27T03:58:56.564981+0000","last_fullsized":"2024-08-27T03:58:56.564981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.564773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.564773+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.564773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:00.629402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'673","reported_seq":1405,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.555135+0000","last_change":"2024-08-27T03:58:57.555135+0000","last_active":"2024-08-27T03:58:57.555135+0000","last_peered":"2024-08-27T03:58:57.555135+0000","last_clean":"2024-08-27T03:58:57.555135+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:57.555135+0000","last_undegraded":"2024-08-27T03:58:57.555135+0000","last_fullsized":"2024-08-27T03:58:57.555135+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'673","last_scrub_stamp":"2024-08-27T03:58:57.554887+0000","last_deep_scrub":"267'673","last_deep_scrub_stamp":"2024-08-27T03:58:57.554887+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.554887+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:24:06.050565+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1780,"num_read_kb":2961,"num_write":2352,"num_write_kb":2124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506974,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.635550+0000","last_change":"2024-08-27T03:59:06.635550+0000","last_active":"2024-08-27T03:59:06.635550+0000","last_peered":"2024-08-27T03:59:06.635550+0000","last_clean":"2024-08-27T03:59:06.635550+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:59:06.635550+0000","last_undegraded":"2024-08-27T03:59:06.635550+0000","last_fullsized":"2024-08-27T03:59:06.635550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:06.635361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:06.635361+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.635361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:26:52.842862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'150","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.551862+0000","last_change":"2024-08-27T03:59:11.551862+0000","last_active":"2024-08-27T03:59:11.551862+0000","last_peered":"2024-08-27T03:59:11.551862+0000","last_clean":"2024-08-27T03:59:11.551862+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:59:11.551862+0000","last_undegraded":"2024-08-27T03:59:11.551862+0000","last_fullsized":"2024-08-27T03:59:11.551862+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'150","last_scrub_stamp":"2024-08-27T03:59:11.551659+0000","last_deep_scrub":"267'150","last_deep_scrub_stamp":"2024-08-27T03:59:11.551659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.551659+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:34:36.621710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'762","reported_seq":2257,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.341748+0000","last_change":"2024-08-27T03:58:44.341748+0000","last_active":"2024-08-27T03:58:44.341748+0000","last_peered":"2024-08-27T03:58:44.341748+0000","last_clean":"2024-08-27T03:58:44.341748+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:58:44.341748+0000","last_undegraded":"2024-08-27T03:58:44.341748+0000","last_fullsized":"2024-08-27T03:58:44.341748+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.341567+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:18:33.526418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'372","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.092398+0000","last_change":"2024-08-27T03:58:39.092398+0000","last_active":"2024-08-27T03:58:39.092398+0000","last_peered":"2024-08-27T03:58:39.092398+0000","last_clean":"2024-08-27T03:58:39.092398+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:39.092398+0000","last_undegraded":"2024-08-27T03:58:39.092398+0000","last_fullsized":"2024-08-27T03:58:39.092398+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.092090+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:46:48.988935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254745,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":622,"num_read_kb":96022,"num_write":1186,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.886716+0000","last_change":"2024-08-27T03:58:38.886592+0000","last_active":"2024-08-27T03:58:38.886716+0000","last_peered":"2024-08-27T03:58:38.886716+0000","last_clean":"2024-08-27T03:58:38.886716+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:58:38.886716+0000","last_undegraded":"2024-08-27T03:58:38.886716+0000","last_fullsized":"2024-08-27T03:58:38.886716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.886440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:43.605161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.688066+0000","last_change":"2024-08-27T03:58:49.688066+0000","last_active":"2024-08-27T03:58:49.688066+0000","last_peered":"2024-08-27T03:58:49.688066+0000","last_clean":"2024-08-27T03:58:49.688066+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:58:49.688066+0000","last_undegraded":"2024-08-27T03:58:49.688066+0000","last_fullsized":"2024-08-27T03:58:49.688066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.687882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:24:23.995310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'221","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.046535+0000","last_change":"2024-08-27T03:58:55.046535+0000","last_active":"2024-08-27T03:58:55.046535+0000","last_peered":"2024-08-27T03:58:55.046535+0000","last_clean":"2024-08-27T03:58:55.046535+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:58:55.046535+0000","last_undegraded":"2024-08-27T03:58:55.046535+0000","last_fullsized":"2024-08-27T03:58:55.046535+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.046291+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:24.558926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'721","reported_seq":2968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.784407+0000","last_change":"2024-08-27T03:59:05.784407+0000","last_active":"2024-08-27T03:59:05.784407+0000","last_peered":"2024-08-27T03:59:05.784407+0000","last_clean":"2024-08-27T03:59:05.784407+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:59:05.784407+0000","last_undegraded":"2024-08-27T03:59:05.784407+0000","last_fullsized":"2024-08-27T03:59:05.784407+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'721","last_scrub_stamp":"2024-08-27T03:59:05.784225+0000","last_deep_scrub":"267'721","last_deep_scrub_stamp":"2024-08-27T03:59:05.784225+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.784225+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:19:08.880831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'137","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:57:09.915872+0000","last_change":"2024-08-27T02:31:15.023353+0000","last_active":"2024-08-27T03:57:09.915872+0000","last_peered":"2024-08-27T03:57:09.915872+0000","last_clean":"2024-08-27T03:57:09.915872+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:57:09.915872+0000","last_undegraded":"2024-08-27T03:57:09.915872+0000","last_fullsized":"2024-08-27T03:57:09.915872+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:35:33.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'410","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.125477+0000","last_change":"2024-08-27T03:58:48.125477+0000","last_active":"2024-08-27T03:58:48.125477+0000","last_peered":"2024-08-27T03:58:48.125477+0000","last_clean":"2024-08-27T03:58:48.125477+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:58:48.125477+0000","last_undegraded":"2024-08-27T03:58:48.125477+0000","last_fullsized":"2024-08-27T03:58:48.125477+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.125306+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:32:51.563488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'331","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.056444+0000","last_change":"2024-08-27T03:58:38.056444+0000","last_active":"2024-08-27T03:58:38.056444+0000","last_peered":"2024-08-27T03:58:38.056444+0000","last_clean":"2024-08-27T03:58:38.056444+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:38.056444+0000","last_undegraded":"2024-08-27T03:58:38.056444+0000","last_fullsized":"2024-08-27T03:58:38.056444+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.056349+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:34:53.352346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":4604,"num_write":1019,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.038731+0000","last_change":"2024-08-27T03:58:36.038731+0000","last_active":"2024-08-27T03:58:36.038731+0000","last_peered":"2024-08-27T03:58:36.038731+0000","last_clean":"2024-08-27T03:58:36.038731+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:58:36.038731+0000","last_undegraded":"2024-08-27T03:58:36.038731+0000","last_fullsized":"2024-08-27T03:58:36.038731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.038657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:07:04.224982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.715676+0000","last_change":"2024-08-27T03:58:58.715676+0000","last_active":"2024-08-27T03:58:58.715676+0000","last_peered":"2024-08-27T03:58:58.715676+0000","last_clean":"2024-08-27T03:58:58.715676+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:58:58.715676+0000","last_undegraded":"2024-08-27T03:58:58.715676+0000","last_fullsized":"2024-08-27T03:58:58.715676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.715406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.715406+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.715406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:00:01.173207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'166","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.716206+0000","last_change":"2024-08-27T03:59:02.716206+0000","last_active":"2024-08-27T03:59:02.716206+0000","last_peered":"2024-08-27T03:59:02.716206+0000","last_clean":"2024-08-27T03:59:02.716206+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:59:02.716206+0000","last_undegraded":"2024-08-27T03:59:02.716206+0000","last_fullsized":"2024-08-27T03:59:02.716206+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:02.716019+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:02.716019+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.716019+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:11:32.329036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'733","reported_seq":4725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.436967+0000","last_change":"2024-08-27T03:59:10.436967+0000","last_active":"2024-08-27T03:59:10.436967+0000","last_peered":"2024-08-27T03:59:10.436967+0000","last_clean":"2024-08-27T03:59:10.436967+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:59:10.436967+0000","last_undegraded":"2024-08-27T03:59:10.436967+0000","last_fullsized":"2024-08-27T03:59:10.436967+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'733","last_scrub_stamp":"2024-08-27T03:59:10.436785+0000","last_deep_scrub":"267'733","last_deep_scrub_stamp":"2024-08-27T03:59:10.436785+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.436785+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:25:23.754801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'212","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.527373+0000","last_change":"2024-08-27T03:59:08.527373+0000","last_active":"2024-08-27T03:59:08.527373+0000","last_peered":"2024-08-27T03:59:08.527373+0000","last_clean":"2024-08-27T03:59:08.527373+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:59:08.527373+0000","last_undegraded":"2024-08-27T03:59:08.527373+0000","last_fullsized":"2024-08-27T03:59:08.527373+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-08-27T03:59:08.527059+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-08-27T03:59:08.527059+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.527059+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:05:08.280061+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'398","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.667019+0000","last_change":"2024-08-27T03:58:42.667019+0000","last_active":"2024-08-27T03:58:42.667019+0000","last_peered":"2024-08-27T03:58:42.667019+0000","last_clean":"2024-08-27T03:58:42.667019+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:58:42.667019+0000","last_undegraded":"2024-08-27T03:58:42.667019+0000","last_fullsized":"2024-08-27T03:58:42.667019+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.666809+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:34.834037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'349","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:35.413562+0000","last_change":"2024-08-27T03:58:35.413562+0000","last_active":"2024-08-27T03:58:35.413562+0000","last_peered":"2024-08-27T03:58:35.413562+0000","last_clean":"2024-08-27T03:58:35.413562+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:35.413562+0000","last_undegraded":"2024-08-27T03:58:35.413562+0000","last_fullsized":"2024-08-27T03:58:35.413562+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_clean_scrub_stamp":"2024-08-27T03:58:35.413408+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:28:38.132282+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044381,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":35253,"num_write":1103,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.749803+0000","last_change":"2024-08-27T03:58:38.749803+0000","last_active":"2024-08-27T03:58:38.749803+0000","last_peered":"2024-08-27T03:58:38.749803+0000","last_clean":"2024-08-27T03:58:38.749803+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:58:38.749803+0000","last_undegraded":"2024-08-27T03:58:38.749803+0000","last_fullsized":"2024-08-27T03:58:38.749803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.749605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:52:37.408314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.327279+0000","last_change":"2024-08-27T03:58:57.327279+0000","last_active":"2024-08-27T03:58:57.327279+0000","last_peered":"2024-08-27T03:58:57.327279+0000","last_clean":"2024-08-27T03:58:57.327279+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:58:57.327279+0000","last_undegraded":"2024-08-27T03:58:57.327279+0000","last_fullsized":"2024-08-27T03:58:57.327279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.327076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.327076+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.327076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:23:48.404239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'803","reported_seq":1568,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.955750+0000","last_change":"2024-08-27T03:58:58.955750+0000","last_active":"2024-08-27T03:58:58.955750+0000","last_peered":"2024-08-27T03:58:58.955750+0000","last_clean":"2024-08-27T03:58:58.955750+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:58.955750+0000","last_undegraded":"2024-08-27T03:58:58.955750+0000","last_fullsized":"2024-08-27T03:58:58.955750+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'803","last_scrub_stamp":"2024-08-27T03:58:58.955545+0000","last_deep_scrub":"267'803","last_deep_scrub_stamp":"2024-08-27T03:58:58.955545+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.955545+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:28:17.120438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135678,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1416,"num_read_kb":3420,"num_write":1150,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.400087+0000","last_change":"2024-08-27T03:59:09.400087+0000","last_active":"2024-08-27T03:59:09.400087+0000","last_peered":"2024-08-27T03:59:09.400087+0000","last_clean":"2024-08-27T03:59:09.400087+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:59:09.400087+0000","last_undegraded":"2024-08-27T03:59:09.400087+0000","last_fullsized":"2024-08-27T03:59:09.400087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.399810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.399810+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.399810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:59:49.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'121","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.848896+0000","last_change":"2024-08-27T03:59:09.848896+0000","last_active":"2024-08-27T03:59:09.848896+0000","last_peered":"2024-08-27T03:59:09.848896+0000","last_clean":"2024-08-27T03:59:09.848896+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:59:09.848896+0000","last_undegraded":"2024-08-27T03:59:09.848896+0000","last_fullsized":"2024-08-27T03:59:09.848896+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'121","last_scrub_stamp":"2024-08-27T03:59:09.848709+0000","last_deep_scrub":"267'121","last_deep_scrub_stamp":"2024-08-27T03:59:09.848709+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.848709+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:32:24.307293+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'166","reported_seq":759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.623165+0000","last_change":"2024-08-27T03:59:14.623165+0000","last_active":"2024-08-27T03:59:14.623165+0000","last_peered":"2024-08-27T03:59:14.623165+0000","last_clean":"2024-08-27T03:59:14.623165+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:59:14.623165+0000","last_undegraded":"2024-08-27T03:59:14.623165+0000","last_fullsized":"2024-08-27T03:59:14.623165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:14.622958+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:14.622958+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.622958+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:35:16.828219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'938","reported_seq":2451,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.710186+0000","last_change":"2024-08-27T03:58:48.710186+0000","last_active":"2024-08-27T03:58:48.710186+0000","last_peered":"2024-08-27T03:58:48.710186+0000","last_clean":"2024-08-27T03:58:48.710186+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:58:48.710186+0000","last_undegraded":"2024-08-27T03:58:48.710186+0000","last_fullsized":"2024-08-27T03:58:48.710186+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'938","last_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_deep_scrub":"267'938","last_deep_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.709995+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":900,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.597316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":688,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'378","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.720844+0000","last_change":"2024-08-27T03:58:40.720844+0000","last_active":"2024-08-27T03:58:40.720844+0000","last_peered":"2024-08-27T03:58:40.720844+0000","last_clean":"2024-08-27T03:58:40.720844+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:40.720844+0000","last_undegraded":"2024-08-27T03:58:40.720844+0000","last_fullsized":"2024-08-27T03:58:40.720844+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'378","last_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_deep_scrub":"267'378","last_deep_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.720612+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:35.862070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263226,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":507,"num_write":1144,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.031052+0000","last_change":"2024-08-27T03:58:51.031052+0000","last_active":"2024-08-27T03:58:51.031052+0000","last_peered":"2024-08-27T03:58:51.031052+0000","last_clean":"2024-08-27T03:58:51.031052+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:58:51.031052+0000","last_undegraded":"2024-08-27T03:58:51.031052+0000","last_fullsized":"2024-08-27T03:58:51.031052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.030870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:16.544510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'286","reported_seq":910,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.320437+0000","last_change":"2024-08-27T03:59:05.320437+0000","last_active":"2024-08-27T03:59:05.320437+0000","last_peered":"2024-08-27T03:59:05.320437+0000","last_clean":"2024-08-27T03:59:05.320437+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:59:05.320437+0000","last_undegraded":"2024-08-27T03:59:05.320437+0000","last_fullsized":"2024-08-27T03:59:05.320437+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'286","last_scrub_stamp":"2024-08-27T03:59:05.320190+0000","last_deep_scrub":"267'286","last_deep_scrub_stamp":"2024-08-27T03:59:05.320190+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.320190+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:35:50.176774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":955,"num_write":350,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.459614+0000","last_change":"2024-08-27T03:59:12.459614+0000","last_active":"2024-08-27T03:59:12.459614+0000","last_peered":"2024-08-27T03:59:12.459614+0000","last_clean":"2024-08-27T03:59:12.459614+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:59:12.459614+0000","last_undegraded":"2024-08-27T03:59:12.459614+0000","last_fullsized":"2024-08-27T03:59:12.459614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:12.459442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:12.459442+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.459442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:25:35.692272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:39.893070+0000","last_change":"2024-08-27T02:31:14.521163+0000","last_active":"2024-08-27T03:55:39.893070+0000","last_peered":"2024-08-27T03:55:39.893070+0000","last_clean":"2024-08-27T03:55:39.893070+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:55:39.893070+0000","last_undegraded":"2024-08-27T03:55:39.893070+0000","last_fullsized":"2024-08-27T03:55:39.893070+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:59:46.536741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'380","reported_seq":1855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.148934+0000","last_change":"2024-08-27T03:58:47.148934+0000","last_active":"2024-08-27T03:58:47.148934+0000","last_peered":"2024-08-27T03:58:47.148934+0000","last_clean":"2024-08-27T03:58:47.148934+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:58:47.148934+0000","last_undegraded":"2024-08-27T03:58:47.148934+0000","last_fullsized":"2024-08-27T03:58:47.148934+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.148744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:27.163059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'319","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.889227+0000","last_change":"2024-08-27T03:58:44.889227+0000","last_active":"2024-08-27T03:58:44.889227+0000","last_peered":"2024-08-27T03:58:44.889227+0000","last_clean":"2024-08-27T03:58:44.889227+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:44.889227+0000","last_undegraded":"2024-08-27T03:58:44.889227+0000","last_fullsized":"2024-08-27T03:58:44.889227+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.888880+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:13:45.821566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":2061,"num_write":967,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.296199+0000","last_change":"2024-08-27T03:58:58.296199+0000","last_active":"2024-08-27T03:58:58.296199+0000","last_peered":"2024-08-27T03:58:58.296199+0000","last_clean":"2024-08-27T03:58:58.296199+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:58:58.296199+0000","last_undegraded":"2024-08-27T03:58:58.296199+0000","last_fullsized":"2024-08-27T03:58:58.296199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.296017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.296017+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.296017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:15.246385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'58","reported_seq":596,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.507278+0000","last_change":"2024-08-27T03:58:59.507278+0000","last_active":"2024-08-27T03:58:59.507278+0000","last_peered":"2024-08-27T03:58:59.507278+0000","last_clean":"2024-08-27T03:58:59.507278+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:58:59.507278+0000","last_undegraded":"2024-08-27T03:58:59.507278+0000","last_fullsized":"2024-08-27T03:58:59.507278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'58","last_scrub_stamp":"2024-08-27T03:58:59.507104+0000","last_deep_scrub":"267'58","last_deep_scrub_stamp":"2024-08-27T03:58:59.507104+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.507104+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:25:51.054843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.841846+0000","last_change":"2024-08-27T03:59:05.841846+0000","last_active":"2024-08-27T03:59:05.841846+0000","last_peered":"2024-08-27T03:59:05.841846+0000","last_clean":"2024-08-27T03:59:05.841846+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:59:05.841846+0000","last_undegraded":"2024-08-27T03:59:05.841846+0000","last_fullsized":"2024-08-27T03:59:05.841846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.841662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.841662+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.841662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:02.161033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'186","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.562826+0000","last_change":"2024-08-27T03:59:12.562826+0000","last_active":"2024-08-27T03:59:12.562826+0000","last_peered":"2024-08-27T03:59:12.562826+0000","last_clean":"2024-08-27T03:59:12.562826+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:59:12.562826+0000","last_undegraded":"2024-08-27T03:59:12.562826+0000","last_fullsized":"2024-08-27T03:59:12.562826+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-08-27T03:59:12.562630+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-08-27T03:59:12.562630+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.562630+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:12:56.115345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'412","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.133915+0000","last_change":"2024-08-27T03:58:49.133915+0000","last_active":"2024-08-27T03:58:49.133915+0000","last_peered":"2024-08-27T03:58:49.133915+0000","last_clean":"2024-08-27T03:58:49.133915+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:58:49.133915+0000","last_undegraded":"2024-08-27T03:58:49.133915+0000","last_fullsized":"2024-08-27T03:58:49.133915+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.133730+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:26:03.612785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'324","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.768146+0000","last_change":"2024-08-27T03:58:48.768146+0000","last_active":"2024-08-27T03:58:48.768146+0000","last_peered":"2024-08-27T03:58:48.768146+0000","last_clean":"2024-08-27T03:58:48.768146+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:48.768146+0000","last_undegraded":"2024-08-27T03:58:48.768146+0000","last_fullsized":"2024-08-27T03:58:48.768146+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.767843+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:56.225287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525410,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":30350,"num_write":1025,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.956467+0000","last_change":"2024-08-27T03:58:56.956467+0000","last_active":"2024-08-27T03:58:56.956467+0000","last_peered":"2024-08-27T03:58:56.956467+0000","last_clean":"2024-08-27T03:58:56.956467+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:58:56.956467+0000","last_undegraded":"2024-08-27T03:58:56.956467+0000","last_fullsized":"2024-08-27T03:58:56.956467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.956265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.956265+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.956265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:45:45.975142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'346","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.344247+0000","last_change":"2024-08-27T03:59:06.344247+0000","last_active":"2024-08-27T03:59:06.344247+0000","last_peered":"2024-08-27T03:59:06.344247+0000","last_clean":"2024-08-27T03:59:06.344247+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:59:06.344247+0000","last_undegraded":"2024-08-27T03:59:06.344247+0000","last_fullsized":"2024-08-27T03:59:06.344247+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:59:06.344011+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:59:06.344011+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.344011+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:44.497759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1247,"num_write":450,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.667135+0000","last_change":"2024-08-27T03:58:56.667135+0000","last_active":"2024-08-27T03:58:56.667135+0000","last_peered":"2024-08-27T03:58:56.667135+0000","last_clean":"2024-08-27T03:58:56.667135+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:58:56.667135+0000","last_undegraded":"2024-08-27T03:58:56.667135+0000","last_fullsized":"2024-08-27T03:58:56.667135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.666955+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.666955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:43:34.487076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'115","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.926555+0000","last_change":"2024-08-27T03:59:11.926555+0000","last_active":"2024-08-27T03:59:11.926555+0000","last_peered":"2024-08-27T03:59:11.926555+0000","last_clean":"2024-08-27T03:59:11.926555+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:59:11.926555+0000","last_undegraded":"2024-08-27T03:59:11.926555+0000","last_fullsized":"2024-08-27T03:59:11.926555+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'115","last_scrub_stamp":"2024-08-27T03:59:11.926366+0000","last_deep_scrub":"267'115","last_deep_scrub_stamp":"2024-08-27T03:59:11.926366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.926366+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:33:30.256381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'420","reported_seq":1947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.187656+0000","last_change":"2024-08-27T03:58:51.187656+0000","last_active":"2024-08-27T03:58:51.187656+0000","last_peered":"2024-08-27T03:58:51.187656+0000","last_clean":"2024-08-27T03:58:51.187656+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:51.187656+0000","last_undegraded":"2024-08-27T03:58:51.187656+0000","last_fullsized":"2024-08-27T03:58:51.187656+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'420","last_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_deep_scrub":"267'420","last_deep_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.187454+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:01:20.975620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'331","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.480918+0000","last_change":"2024-08-27T03:58:37.480918+0000","last_active":"2024-08-27T03:58:37.480918+0000","last_peered":"2024-08-27T03:58:37.480918+0000","last_clean":"2024-08-27T03:58:37.480918+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:37.480918+0000","last_undegraded":"2024-08-27T03:58:37.480918+0000","last_fullsized":"2024-08-27T03:58:37.480918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.480830+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:01:53.901179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1018782,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":16403,"num_write":1128,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.652421+0000","last_change":"2024-08-27T03:58:51.652421+0000","last_active":"2024-08-27T03:58:51.652421+0000","last_peered":"2024-08-27T03:58:51.652421+0000","last_clean":"2024-08-27T03:58:51.652421+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:58:51.652421+0000","last_undegraded":"2024-08-27T03:58:51.652421+0000","last_fullsized":"2024-08-27T03:58:51.652421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.652254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:21:22.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'285","reported_seq":881,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.945012+0000","last_change":"2024-08-27T03:59:02.945012+0000","last_active":"2024-08-27T03:59:02.945012+0000","last_peered":"2024-08-27T03:59:02.945012+0000","last_clean":"2024-08-27T03:59:02.945012+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:59:02.945012+0000","last_undegraded":"2024-08-27T03:59:02.945012+0000","last_fullsized":"2024-08-27T03:59:02.945012+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-08-27T03:59:02.944806+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-08-27T03:59:02.944806+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.944806+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:46:18.316088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.474818+0000","last_change":"2024-08-27T03:59:02.474818+0000","last_active":"2024-08-27T03:59:02.474818+0000","last_peered":"2024-08-27T03:59:02.474818+0000","last_clean":"2024-08-27T03:59:02.474818+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:59:02.474818+0000","last_undegraded":"2024-08-27T03:59:02.474818+0000","last_fullsized":"2024-08-27T03:59:02.474818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:02.474632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:02.474632+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.474632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:03:54.952348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'839","reported_seq":2423,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.689531+0000","last_change":"2024-08-27T03:58:47.689531+0000","last_active":"2024-08-27T03:58:47.689531+0000","last_peered":"2024-08-27T03:58:47.689531+0000","last_clean":"2024-08-27T03:58:47.689531+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:58:47.689531+0000","last_undegraded":"2024-08-27T03:58:47.689531+0000","last_fullsized":"2024-08-27T03:58:47.689531+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.689347+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:53:38.179127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1651,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'418","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.127698+0000","last_change":"2024-08-27T03:58:40.127698+0000","last_active":"2024-08-27T03:58:40.127698+0000","last_peered":"2024-08-27T03:58:40.127698+0000","last_clean":"2024-08-27T03:58:40.127698+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:40.127698+0000","last_undegraded":"2024-08-27T03:58:40.127698+0000","last_fullsized":"2024-08-27T03:58:40.127698+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'418","last_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_deep_scrub":"267'418","last_deep_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.127457+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:37.962208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":762,"num_read_kb":11072,"num_write":1374,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.531651+0000","last_change":"2024-08-27T03:58:54.531651+0000","last_active":"2024-08-27T03:58:54.531651+0000","last_peered":"2024-08-27T03:58:54.531651+0000","last_clean":"2024-08-27T03:58:54.531651+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:58:54.531651+0000","last_undegraded":"2024-08-27T03:58:54.531651+0000","last_fullsized":"2024-08-27T03:58:54.531651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.531461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:09:04.172792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'556","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.024667+0000","last_change":"2024-08-27T03:58:54.024667+0000","last_active":"2024-08-27T03:58:54.024667+0000","last_peered":"2024-08-27T03:58:54.024667+0000","last_clean":"2024-08-27T03:58:54.024667+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:54.024667+0000","last_undegraded":"2024-08-27T03:58:54.024667+0000","last_fullsized":"2024-08-27T03:58:54.024667+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'556","last_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_deep_scrub":"267'556","last_deep_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.024451+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:17.790125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":990,"num_read_kb":2409,"num_write":858,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23904,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.764886+0000","last_change":"2024-08-27T03:59:07.764886+0000","last_active":"2024-08-27T03:59:07.764886+0000","last_peered":"2024-08-27T03:59:07.764886+0000","last_clean":"2024-08-27T03:59:07.764886+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:59:07.764886+0000","last_undegraded":"2024-08-27T03:59:07.764886+0000","last_fullsized":"2024-08-27T03:59:07.764886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.764707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.764707+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.764707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:07.171054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'140","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.320188+0000","last_change":"2024-08-27T02:31:15.026496+0000","last_active":"2024-08-27T03:56:39.320188+0000","last_peered":"2024-08-27T03:56:39.320188+0000","last_clean":"2024-08-27T03:56:39.320188+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:56:39.320188+0000","last_undegraded":"2024-08-27T03:56:39.320188+0000","last_fullsized":"2024-08-27T03:56:39.320188+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:25.778670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1183","reported_seq":2631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.466497+0000","last_change":"2024-08-27T03:58:49.466497+0000","last_active":"2024-08-27T03:58:49.466497+0000","last_peered":"2024-08-27T03:58:49.466497+0000","last_clean":"2024-08-27T03:58:49.466497+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:58:49.466497+0000","last_undegraded":"2024-08-27T03:58:49.466497+0000","last_fullsized":"2024-08-27T03:58:49.466497+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1183","last_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_deep_scrub":"267'1183","last_deep_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.466324+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:09.565854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'349","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.092246+0000","last_change":"2024-08-27T03:58:41.092246+0000","last_active":"2024-08-27T03:58:41.092246+0000","last_peered":"2024-08-27T03:58:41.092246+0000","last_clean":"2024-08-27T03:58:41.092246+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:41.092246+0000","last_undegraded":"2024-08-27T03:58:41.092246+0000","last_fullsized":"2024-08-27T03:58:41.092246+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.092033+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:47:27.087478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":41676,"num_write":1093,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.666378+0000","last_change":"2024-08-27T03:58:52.666378+0000","last_active":"2024-08-27T03:58:52.666378+0000","last_peered":"2024-08-27T03:58:52.666378+0000","last_clean":"2024-08-27T03:58:52.666378+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:58:52.666378+0000","last_undegraded":"2024-08-27T03:58:52.666378+0000","last_fullsized":"2024-08-27T03:58:52.666378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.666203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:19:46.181291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'358","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.865885+0000","last_change":"2024-08-27T03:59:04.865885+0000","last_active":"2024-08-27T03:59:04.865885+0000","last_peered":"2024-08-27T03:59:04.865885+0000","last_clean":"2024-08-27T03:59:04.865885+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:59:04.865885+0000","last_undegraded":"2024-08-27T03:59:04.865885+0000","last_fullsized":"2024-08-27T03:59:04.865885+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-08-27T03:59:04.865659+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-08-27T03:59:04.865659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.865659+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:03.014002+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.060998+0000","last_change":"2024-08-27T03:58:56.060998+0000","last_active":"2024-08-27T03:58:56.060998+0000","last_peered":"2024-08-27T03:58:56.060998+0000","last_clean":"2024-08-27T03:58:56.060998+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:58:56.060998+0000","last_undegraded":"2024-08-27T03:58:56.060998+0000","last_fullsized":"2024-08-27T03:58:56.060998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.060804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:43.231476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'180","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.606127+0000","last_change":"2024-08-27T03:59:01.606127+0000","last_active":"2024-08-27T03:59:01.606127+0000","last_peered":"2024-08-27T03:59:01.606127+0000","last_clean":"2024-08-27T03:59:01.606127+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:59:01.606127+0000","last_undegraded":"2024-08-27T03:59:01.606127+0000","last_fullsized":"2024-08-27T03:59:01.606127+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-08-27T03:59:01.605928+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-08-27T03:59:01.605928+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.605928+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:24:58.905577+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'699","reported_seq":2143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.218908+0000","last_change":"2024-08-27T03:58:53.218908+0000","last_active":"2024-08-27T03:58:53.218908+0000","last_peered":"2024-08-27T03:58:53.218908+0000","last_clean":"2024-08-27T03:58:53.218908+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:58:53.218908+0000","last_undegraded":"2024-08-27T03:58:53.218908+0000","last_fullsized":"2024-08-27T03:58:53.218908+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'699","last_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_deep_scrub":"267'699","last_deep_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.218695+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:33.400240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'333","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.695058+0000","last_change":"2024-08-27T03:58:39.695058+0000","last_active":"2024-08-27T03:58:39.695058+0000","last_peered":"2024-08-27T03:58:39.695058+0000","last_clean":"2024-08-27T03:58:39.695058+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:39.695058+0000","last_undegraded":"2024-08-27T03:58:39.695058+0000","last_fullsized":"2024-08-27T03:58:39.695058+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.694836+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:12.785434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":27841,"num_write":1117,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.677750+0000","last_change":"2024-08-27T03:59:01.677750+0000","last_active":"2024-08-27T03:59:01.677750+0000","last_peered":"2024-08-27T03:59:01.677750+0000","last_clean":"2024-08-27T03:59:01.677750+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:59:01.677750+0000","last_undegraded":"2024-08-27T03:59:01.677750+0000","last_fullsized":"2024-08-27T03:59:01.677750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.677560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.677560+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.677560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:47.407504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'329","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.430587+0000","last_change":"2024-08-27T03:59:08.430587+0000","last_active":"2024-08-27T03:59:08.430587+0000","last_peered":"2024-08-27T03:59:08.430587+0000","last_clean":"2024-08-27T03:59:08.430587+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:59:08.430587+0000","last_undegraded":"2024-08-27T03:59:08.430587+0000","last_fullsized":"2024-08-27T03:59:08.430587+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-08-27T03:59:08.430391+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-08-27T03:59:08.430391+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.430391+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.845904+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66592,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1228,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.064956+0000","last_change":"2024-08-27T03:58:59.064956+0000","last_active":"2024-08-27T03:58:59.064956+0000","last_peered":"2024-08-27T03:58:59.064956+0000","last_clean":"2024-08-27T03:58:59.064956+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:58:59.064956+0000","last_undegraded":"2024-08-27T03:58:59.064956+0000","last_fullsized":"2024-08-27T03:58:59.064956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.064853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.064853+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.064853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:33:49.395528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'120","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.902379+0000","last_change":"2024-08-27T03:59:10.902379+0000","last_active":"2024-08-27T03:59:10.902379+0000","last_peered":"2024-08-27T03:59:10.902379+0000","last_clean":"2024-08-27T03:59:10.902379+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:59:10.902379+0000","last_undegraded":"2024-08-27T03:59:10.902379+0000","last_fullsized":"2024-08-27T03:59:10.902379+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-08-27T03:59:10.902192+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-08-27T03:59:10.902192+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.902192+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:05:23.962757+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'790","reported_seq":2428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.556897+0000","last_change":"2024-08-27T03:58:46.556897+0000","last_active":"2024-08-27T03:58:46.556897+0000","last_peered":"2024-08-27T03:58:46.556897+0000","last_clean":"2024-08-27T03:58:46.556897+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:58:46.556897+0000","last_undegraded":"2024-08-27T03:58:46.556897+0000","last_fullsized":"2024-08-27T03:58:46.556897+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.556708+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:05.148074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'325","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.454132+0000","last_change":"2024-08-27T03:58:38.454132+0000","last_active":"2024-08-27T03:58:38.454132+0000","last_peered":"2024-08-27T03:58:38.454132+0000","last_clean":"2024-08-27T03:58:38.454132+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:38.454132+0000","last_undegraded":"2024-08-27T03:58:38.454132+0000","last_fullsized":"2024-08-27T03:58:38.454132+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.453909+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:53.794488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399355,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":2807,"num_write":1070,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.062298+0000","last_change":"2024-08-27T03:58:58.062298+0000","last_active":"2024-08-27T03:58:58.062298+0000","last_peered":"2024-08-27T03:58:58.062298+0000","last_clean":"2024-08-27T03:58:58.062298+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:58:58.062298+0000","last_undegraded":"2024-08-27T03:58:58.062298+0000","last_fullsized":"2024-08-27T03:58:58.062298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.062113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.062113+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.062113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:47:29.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'139","reported_seq":714,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.665112+0000","last_change":"2024-08-27T03:59:05.665112+0000","last_active":"2024-08-27T03:59:05.665112+0000","last_peered":"2024-08-27T03:59:05.665112+0000","last_clean":"2024-08-27T03:59:05.665112+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:59:05.665112+0000","last_undegraded":"2024-08-27T03:59:05.665112+0000","last_fullsized":"2024-08-27T03:59:05.665112+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'139","last_scrub_stamp":"2024-08-27T03:59:05.664863+0000","last_deep_scrub":"267'139","last_deep_scrub_stamp":"2024-08-27T03:59:05.664863+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.664863+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:03:13.985053+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14734,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'693","reported_seq":2827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.654742+0000","last_change":"2024-08-27T03:58:58.654742+0000","last_active":"2024-08-27T03:58:58.654742+0000","last_peered":"2024-08-27T03:58:58.654742+0000","last_clean":"2024-08-27T03:58:58.654742+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:58.654742+0000","last_undegraded":"2024-08-27T03:58:58.654742+0000","last_fullsized":"2024-08-27T03:58:58.654742+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'693","last_scrub_stamp":"2024-08-27T03:58:58.654530+0000","last_deep_scrub":"267'693","last_deep_scrub_stamp":"2024-08-27T03:58:58.654530+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.654530+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:19.149780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'113","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.804799+0000","last_change":"2024-08-27T03:59:08.804799+0000","last_active":"2024-08-27T03:59:08.804799+0000","last_peered":"2024-08-27T03:59:08.804799+0000","last_clean":"2024-08-27T03:59:08.804799+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:59:08.804799+0000","last_undegraded":"2024-08-27T03:59:08.804799+0000","last_fullsized":"2024-08-27T03:59:08.804799+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-08-27T03:59:08.804603+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-08-27T03:59:08.804603+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.804603+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:44.829031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'791","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.714950+0000","last_change":"2024-08-27T03:58:49.714950+0000","last_active":"2024-08-27T03:58:49.714950+0000","last_peered":"2024-08-27T03:58:49.714950+0000","last_clean":"2024-08-27T03:58:49.714950+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:58:49.714950+0000","last_undegraded":"2024-08-27T03:58:49.714950+0000","last_fullsized":"2024-08-27T03:58:49.714950+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'791","last_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_deep_scrub":"267'791","last_deep_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.714771+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:52.868288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'298","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.775582+0000","last_change":"2024-08-27T03:58:46.775582+0000","last_active":"2024-08-27T03:58:46.775582+0000","last_peered":"2024-08-27T03:58:46.775582+0000","last_clean":"2024-08-27T03:58:46.775582+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:46.775582+0000","last_undegraded":"2024-08-27T03:58:46.775582+0000","last_fullsized":"2024-08-27T03:58:46.775582+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.775293+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:09.222532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550499,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":12943,"num_write":990,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.938304+0000","last_change":"2024-08-27T03:58:57.938304+0000","last_active":"2024-08-27T03:58:57.938304+0000","last_peered":"2024-08-27T03:58:57.938304+0000","last_clean":"2024-08-27T03:58:57.938304+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:58:57.938304+0000","last_undegraded":"2024-08-27T03:58:57.938304+0000","last_fullsized":"2024-08-27T03:58:57.938304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.938116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.938116+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.938116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:03:11.911435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'390","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.783274+0000","last_change":"2024-08-27T03:59:06.783274+0000","last_active":"2024-08-27T03:59:06.783274+0000","last_peered":"2024-08-27T03:59:06.783274+0000","last_clean":"2024-08-27T03:59:06.783274+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:59:06.783274+0000","last_undegraded":"2024-08-27T03:59:06.783274+0000","last_fullsized":"2024-08-27T03:59:06.783274+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-08-27T03:59:06.783054+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-08-27T03:59:06.783054+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.783054+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:04:57.075877+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.528035+0000","last_change":"2024-08-27T03:59:06.528035+0000","last_active":"2024-08-27T03:59:06.528035+0000","last_peered":"2024-08-27T03:59:06.528035+0000","last_clean":"2024-08-27T03:59:06.528035+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:59:06.528035+0000","last_undegraded":"2024-08-27T03:59:06.528035+0000","last_fullsized":"2024-08-27T03:59:06.528035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:06.527836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:06.527836+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.527836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:40:14.529374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'115","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.741333+0000","last_change":"2024-08-27T03:59:12.741333+0000","last_active":"2024-08-27T03:59:12.741333+0000","last_peered":"2024-08-27T03:59:12.741333+0000","last_clean":"2024-08-27T03:59:12.741333+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:59:12.741333+0000","last_undegraded":"2024-08-27T03:59:12.741333+0000","last_fullsized":"2024-08-27T03:59:12.741333+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'115","last_scrub_stamp":"2024-08-27T03:59:12.741145+0000","last_deep_scrub":"267'115","last_deep_scrub_stamp":"2024-08-27T03:59:12.741145+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.741145+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:07.013617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'377","reported_seq":1871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.746460+0000","last_change":"2024-08-27T03:58:46.746460+0000","last_active":"2024-08-27T03:58:46.746460+0000","last_peered":"2024-08-27T03:58:46.746460+0000","last_clean":"2024-08-27T03:58:46.746460+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:58:46.746460+0000","last_undegraded":"2024-08-27T03:58:46.746460+0000","last_fullsized":"2024-08-27T03:58:46.746460+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.746284+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:21.089772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'325","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.707957+0000","last_change":"2024-08-27T03:58:41.707957+0000","last_active":"2024-08-27T03:58:41.707957+0000","last_peered":"2024-08-27T03:58:41.707957+0000","last_clean":"2024-08-27T03:58:41.707957+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:41.707957+0000","last_undegraded":"2024-08-27T03:58:41.707957+0000","last_fullsized":"2024-08-27T03:58:41.707957+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.707686+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:44.940323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":8306,"num_write":1045,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.824808+0000","last_change":"2024-08-27T03:59:01.824808+0000","last_active":"2024-08-27T03:59:01.824808+0000","last_peered":"2024-08-27T03:59:01.824808+0000","last_clean":"2024-08-27T03:59:01.824808+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:59:01.824808+0000","last_undegraded":"2024-08-27T03:59:01.824808+0000","last_fullsized":"2024-08-27T03:59:01.824808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.824623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.824623+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.824623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:47:19.318799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'273","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.523257+0000","last_change":"2024-08-27T03:59:07.523257+0000","last_active":"2024-08-27T03:59:07.523257+0000","last_peered":"2024-08-27T03:59:07.523257+0000","last_clean":"2024-08-27T03:59:07.523257+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:59:07.523257+0000","last_undegraded":"2024-08-27T03:59:07.523257+0000","last_fullsized":"2024-08-27T03:59:07.523257+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-08-27T03:59:07.523065+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-08-27T03:59:07.523065+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.523065+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:39.294903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.704026+0000","last_change":"2024-08-27T03:58:57.704026+0000","last_active":"2024-08-27T03:58:57.704026+0000","last_peered":"2024-08-27T03:58:57.704026+0000","last_clean":"2024-08-27T03:58:57.704026+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:58:57.704026+0000","last_undegraded":"2024-08-27T03:58:57.704026+0000","last_fullsized":"2024-08-27T03:58:57.704026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.703813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.703813+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.703813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:51:00.303752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'135","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.343269+0000","last_change":"2024-08-27T02:31:15.027895+0000","last_active":"2024-08-27T03:56:39.343269+0000","last_peered":"2024-08-27T03:56:39.343269+0000","last_clean":"2024-08-27T03:56:39.343269+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:56:39.343269+0000","last_undegraded":"2024-08-27T03:56:39.343269+0000","last_fullsized":"2024-08-27T03:56:39.343269+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:31:13.471865+0000","last_clean_scrub_stamp":"2024-08-27T02:31:13.471865+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:31:36.723623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'737","reported_seq":2240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.265124+0000","last_change":"2024-08-27T03:58:54.265124+0000","last_active":"2024-08-27T03:58:54.265124+0000","last_peered":"2024-08-27T03:58:54.265124+0000","last_clean":"2024-08-27T03:58:54.265124+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:58:54.265124+0000","last_undegraded":"2024-08-27T03:58:54.265124+0000","last_fullsized":"2024-08-27T03:58:54.265124+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'737","last_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_deep_scrub":"267'737","last_deep_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.264928+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:37:38.355010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.153507+0000","last_change":"2024-08-27T03:58:41.153507+0000","last_active":"2024-08-27T03:58:41.153507+0000","last_peered":"2024-08-27T03:58:41.153507+0000","last_clean":"2024-08-27T03:58:41.153507+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:41.153507+0000","last_undegraded":"2024-08-27T03:58:41.153507+0000","last_fullsized":"2024-08-27T03:58:41.153507+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.153232+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:31.829289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":19461,"num_write":1109,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.692107+0000","last_change":"2024-08-27T03:59:00.692107+0000","last_active":"2024-08-27T03:59:00.692107+0000","last_peered":"2024-08-27T03:59:00.692107+0000","last_clean":"2024-08-27T03:59:00.692107+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:59:00.692107+0000","last_undegraded":"2024-08-27T03:59:00.692107+0000","last_fullsized":"2024-08-27T03:59:00.692107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.691897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.691897+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.691897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:58.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'282","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.391622+0000","last_change":"2024-08-27T03:59:07.391622+0000","last_active":"2024-08-27T03:59:07.391622+0000","last_peered":"2024-08-27T03:59:07.391622+0000","last_clean":"2024-08-27T03:59:07.391622+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:59:07.391622+0000","last_undegraded":"2024-08-27T03:59:07.391622+0000","last_fullsized":"2024-08-27T03:59:07.391622+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'282","last_scrub_stamp":"2024-08-27T03:59:07.391429+0000","last_deep_scrub":"267'282","last_deep_scrub_stamp":"2024-08-27T03:59:07.391429+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.391429+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:47:31.823774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1176,"num_write":390,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.621075+0000","last_change":"2024-08-27T03:59:08.621075+0000","last_active":"2024-08-27T03:59:08.621075+0000","last_peered":"2024-08-27T03:59:08.621075+0000","last_clean":"2024-08-27T03:59:08.621075+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:59:08.621075+0000","last_undegraded":"2024-08-27T03:59:08.621075+0000","last_fullsized":"2024-08-27T03:59:08.621075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.620858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.620858+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.620858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:16:55.316384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'183","reported_seq":1665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.801735+0000","last_change":"2024-08-27T03:59:09.801735+0000","last_active":"2024-08-27T03:59:09.801735+0000","last_peered":"2024-08-27T03:59:09.801735+0000","last_clean":"2024-08-27T03:59:09.801735+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:59:09.801735+0000","last_undegraded":"2024-08-27T03:59:09.801735+0000","last_fullsized":"2024-08-27T03:59:09.801735+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-08-27T03:59:09.801532+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-08-27T03:59:09.801532+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.801532+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:55:31.827352+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'552","reported_seq":2377,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.721278+0000","last_change":"2024-08-27T03:58:47.721278+0000","last_active":"2024-08-27T03:58:47.721278+0000","last_peered":"2024-08-27T03:58:47.721278+0000","last_clean":"2024-08-27T03:58:47.721278+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:58:47.721278+0000","last_undegraded":"2024-08-27T03:58:47.721278+0000","last_fullsized":"2024-08-27T03:58:47.721278+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'552","last_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_deep_scrub":"267'552","last_deep_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.721071+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:43:33.741639+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'295","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.460166+0000","last_change":"2024-08-27T03:58:36.460166+0000","last_active":"2024-08-27T03:58:36.460166+0000","last_peered":"2024-08-27T03:58:36.460166+0000","last_clean":"2024-08-27T03:58:36.460166+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:36.460166+0000","last_undegraded":"2024-08-27T03:58:36.460166+0000","last_fullsized":"2024-08-27T03:58:36.460166+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.460054+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:47.971880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":5169,"num_write":1020,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.024903+0000","last_change":"2024-08-27T03:58:52.024903+0000","last_active":"2024-08-27T03:58:52.024903+0000","last_peered":"2024-08-27T03:58:52.024903+0000","last_clean":"2024-08-27T03:58:52.024903+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:58:52.024903+0000","last_undegraded":"2024-08-27T03:58:52.024903+0000","last_fullsized":"2024-08-27T03:58:52.024903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.024712+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:21.647892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'310","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.626979+0000","last_change":"2024-08-27T03:59:09.626979+0000","last_active":"2024-08-27T03:59:09.626979+0000","last_peered":"2024-08-27T03:59:09.626979+0000","last_clean":"2024-08-27T03:59:09.626979+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:59:09.626979+0000","last_undegraded":"2024-08-27T03:59:09.626979+0000","last_fullsized":"2024-08-27T03:59:09.626979+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'310","last_scrub_stamp":"2024-08-27T03:59:09.626754+0000","last_deep_scrub":"267'310","last_deep_scrub_stamp":"2024-08-27T03:59:09.626754+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.626754+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:02:45.876241+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1035,"num_write":382,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.544042+0000","last_change":"2024-08-27T03:59:09.544042+0000","last_active":"2024-08-27T03:59:09.544042+0000","last_peered":"2024-08-27T03:59:09.544042+0000","last_clean":"2024-08-27T03:59:09.544042+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:59:09.544042+0000","last_undegraded":"2024-08-27T03:59:09.544042+0000","last_fullsized":"2024-08-27T03:59:09.544042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.543866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.543866+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.543866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:12:51.370345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'147","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.629559+0000","last_change":"2024-08-27T03:59:10.629559+0000","last_active":"2024-08-27T03:59:10.629559+0000","last_peered":"2024-08-27T03:59:10.629559+0000","last_clean":"2024-08-27T03:59:10.629559+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:59:10.629559+0000","last_undegraded":"2024-08-27T03:59:10.629559+0000","last_fullsized":"2024-08-27T03:59:10.629559+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-08-27T03:59:10.629375+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-08-27T03:59:10.629375+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.629375+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:56:39.220441+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'735","reported_seq":2165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.025008+0000","last_change":"2024-08-27T03:58:50.025008+0000","last_active":"2024-08-27T03:58:50.025008+0000","last_peered":"2024-08-27T03:58:50.025008+0000","last_clean":"2024-08-27T03:58:50.025008+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:58:50.025008+0000","last_undegraded":"2024-08-27T03:58:50.025008+0000","last_fullsized":"2024-08-27T03:58:50.025008+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.024830+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:49:32.647435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'329","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.800869+0000","last_change":"2024-08-27T03:58:42.800869+0000","last_active":"2024-08-27T03:58:42.800869+0000","last_peered":"2024-08-27T03:58:42.800869+0000","last_clean":"2024-08-27T03:58:42.800869+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:42.800869+0000","last_undegraded":"2024-08-27T03:58:42.800869+0000","last_fullsized":"2024-08-27T03:58:42.800869+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.800622+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:33:49.686872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":48183,"num_write":1083,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'442","reported_seq":1929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.120033+0000","last_change":"2024-08-27T03:58:48.120033+0000","last_active":"2024-08-27T03:58:48.120033+0000","last_peered":"2024-08-27T03:58:48.120033+0000","last_clean":"2024-08-27T03:58:48.120033+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:58:48.120033+0000","last_undegraded":"2024-08-27T03:58:48.120033+0000","last_fullsized":"2024-08-27T03:58:48.120033+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.119733+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:29.430226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3054,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'381","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.564535+0000","last_change":"2024-08-27T03:58:38.564535+0000","last_active":"2024-08-27T03:58:38.564535+0000","last_peered":"2024-08-27T03:58:38.564535+0000","last_clean":"2024-08-27T03:58:38.564535+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:38.564535+0000","last_undegraded":"2024-08-27T03:58:38.564535+0000","last_fullsized":"2024-08-27T03:58:38.564535+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.564446+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:04.060769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4832339,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":9918,"num_write":1168,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'478","reported_seq":2162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.793519+0000","last_change":"2024-08-27T03:58:52.793519+0000","last_active":"2024-08-27T03:58:52.793519+0000","last_peered":"2024-08-27T03:58:52.793519+0000","last_clean":"2024-08-27T03:58:52.793519+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:58:52.793519+0000","last_undegraded":"2024-08-27T03:58:52.793519+0000","last_fullsized":"2024-08-27T03:58:52.793519+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.793225+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:15:04.836952+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'405","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.611678+0000","last_change":"2024-08-27T03:58:41.611512+0000","last_active":"2024-08-27T03:58:41.611678+0000","last_peered":"2024-08-27T03:58:41.611678+0000","last_clean":"2024-08-27T03:58:41.611678+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:41.611678+0000","last_undegraded":"2024-08-27T03:58:41.611678+0000","last_fullsized":"2024-08-27T03:58:41.611678+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.611152+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:19.609163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":15883,"num_write":1180,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'572","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.069728+0000","last_change":"2024-08-27T03:58:49.069728+0000","last_active":"2024-08-27T03:58:49.069728+0000","last_peered":"2024-08-27T03:58:49.069728+0000","last_clean":"2024-08-27T03:58:49.069728+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:58:49.069728+0000","last_undegraded":"2024-08-27T03:58:49.069728+0000","last_fullsized":"2024-08-27T03:58:49.069728+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'572","last_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_deep_scrub":"267'572","last_deep_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.069503+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:29:30.858578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'308","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.438198+0000","last_change":"2024-08-27T03:58:41.438047+0000","last_active":"2024-08-27T03:58:41.438198+0000","last_peered":"2024-08-27T03:58:41.438198+0000","last_clean":"2024-08-27T03:58:41.438198+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:41.438198+0000","last_undegraded":"2024-08-27T03:58:41.438198+0000","last_fullsized":"2024-08-27T03:58:41.438198+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.437794+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:06.786909+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":27259,"num_write":1007,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'609","reported_seq":2176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.308907+0000","last_change":"2024-08-27T03:58:55.308752+0000","last_active":"2024-08-27T03:58:55.308907+0000","last_peered":"2024-08-27T03:58:55.308907+0000","last_clean":"2024-08-27T03:58:55.308907+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:55.308907+0000","last_undegraded":"2024-08-27T03:58:55.308907+0000","last_fullsized":"2024-08-27T03:58:55.308907+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'609","last_scrub_stamp":"2024-08-27T03:58:55.308542+0000","last_deep_scrub":"267'609","last_deep_scrub_stamp":"2024-08-27T03:58:55.308542+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.308542+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:15:31.633356+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'362","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.146680+0000","last_change":"2024-08-27T03:58:43.146680+0000","last_active":"2024-08-27T03:58:43.146680+0000","last_peered":"2024-08-27T03:58:43.146680+0000","last_clean":"2024-08-27T03:58:43.146680+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:43.146680+0000","last_undegraded":"2024-08-27T03:58:43.146680+0000","last_fullsized":"2024-08-27T03:58:43.146680+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.146441+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:58:04.187894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589954,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":45255,"num_write":1058,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'439","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.642061+0000","last_change":"2024-08-27T03:58:51.642061+0000","last_active":"2024-08-27T03:58:51.642061+0000","last_peered":"2024-08-27T03:58:51.642061+0000","last_clean":"2024-08-27T03:58:51.642061+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:58:51.642061+0000","last_undegraded":"2024-08-27T03:58:51.642061+0000","last_fullsized":"2024-08-27T03:58:51.642061+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.641812+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:39.903323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'354","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.112270+0000","last_change":"2024-08-27T03:58:40.112270+0000","last_active":"2024-08-27T03:58:40.112270+0000","last_peered":"2024-08-27T03:58:40.112270+0000","last_clean":"2024-08-27T03:58:40.112270+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:40.112270+0000","last_undegraded":"2024-08-27T03:58:40.112270+0000","last_fullsized":"2024-08-27T03:58:40.112270+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.112024+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:55:42.841093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":26119,"num_write":1309,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'576","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.310387+0000","last_change":"2024-08-27T03:58:56.310387+0000","last_active":"2024-08-27T03:58:56.310387+0000","last_peered":"2024-08-27T03:58:56.310387+0000","last_clean":"2024-08-27T03:58:56.310387+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:56.310387+0000","last_undegraded":"2024-08-27T03:58:56.310387+0000","last_fullsized":"2024-08-27T03:58:56.310387+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'576","last_scrub_stamp":"2024-08-27T03:58:56.310189+0000","last_deep_scrub":"267'576","last_deep_scrub_stamp":"2024-08-27T03:58:56.310189+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.310189+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:08.825046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2552,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'308","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.582428+0000","last_change":"2024-08-27T03:58:39.582428+0000","last_active":"2024-08-27T03:58:39.582428+0000","last_peered":"2024-08-27T03:58:39.582428+0000","last_clean":"2024-08-27T03:58:39.582428+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:39.582428+0000","last_undegraded":"2024-08-27T03:58:39.582428+0000","last_fullsized":"2024-08-27T03:58:39.582428+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.582204+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:55:21.476541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307067,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":100247,"num_write":1030,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'454","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.736038+0000","last_change":"2024-08-27T03:58:48.736038+0000","last_active":"2024-08-27T03:58:48.736038+0000","last_peered":"2024-08-27T03:58:48.736038+0000","last_clean":"2024-08-27T03:58:48.736038+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:58:48.736038+0000","last_undegraded":"2024-08-27T03:58:48.736038+0000","last_fullsized":"2024-08-27T03:58:48.736038+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.735856+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:12:29.368472+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2019,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'357","reported_seq":1060,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.173217+0000","last_change":"2024-08-27T03:58:44.173217+0000","last_active":"2024-08-27T03:58:44.173217+0000","last_peered":"2024-08-27T03:58:44.173217+0000","last_clean":"2024-08-27T03:58:44.173217+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:44.173217+0000","last_undegraded":"2024-08-27T03:58:44.173217+0000","last_fullsized":"2024-08-27T03:58:44.173217+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.172971+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:58.313423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":565,"num_read_kb":99962,"num_write":1217,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'362","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.516342+0000","last_change":"2024-08-27T03:58:50.516342+0000","last_active":"2024-08-27T03:58:50.516342+0000","last_peered":"2024-08-27T03:58:50.516342+0000","last_clean":"2024-08-27T03:58:50.516342+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:50.516342+0000","last_undegraded":"2024-08-27T03:58:50.516342+0000","last_fullsized":"2024-08-27T03:58:50.516342+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.516132+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:42.736992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'281","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.755250+0000","last_change":"2024-08-27T03:58:43.755250+0000","last_active":"2024-08-27T03:58:43.755250+0000","last_peered":"2024-08-27T03:58:43.755250+0000","last_clean":"2024-08-27T03:58:43.755250+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:43.755250+0000","last_undegraded":"2024-08-27T03:58:43.755250+0000","last_fullsized":"2024-08-27T03:58:43.755250+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'281","last_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_deep_scrub":"267'281","last_deep_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.755021+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:17:25.889381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":397,"num_read_kb":6749,"num_write":934,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'640","reported_seq":2336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.655397+0000","last_change":"2024-08-27T03:58:53.655397+0000","last_active":"2024-08-27T03:58:53.655397+0000","last_peered":"2024-08-27T03:58:53.655397+0000","last_clean":"2024-08-27T03:58:53.655397+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:58:53.655397+0000","last_undegraded":"2024-08-27T03:58:53.655397+0000","last_fullsized":"2024-08-27T03:58:53.655397+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'640","last_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_deep_scrub":"267'640","last_deep_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.655199+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:10:17.157916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.138975+0000","last_change":"2024-08-27T03:58:46.138796+0000","last_active":"2024-08-27T03:58:46.138975+0000","last_peered":"2024-08-27T03:58:46.138975+0000","last_clean":"2024-08-27T03:58:46.138975+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:46.138975+0000","last_undegraded":"2024-08-27T03:58:46.138975+0000","last_fullsized":"2024-08-27T03:58:46.138975+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.138421+0000","objects_scrubbed":14,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:00:21.270930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2798159,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":560,"num_read_kb":2754,"num_write":1269,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'438","reported_seq":1962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.558722+0000","last_change":"2024-08-27T03:58:44.558545+0000","last_active":"2024-08-27T03:58:44.558722+0000","last_peered":"2024-08-27T03:58:44.558722+0000","last_clean":"2024-08-27T03:58:44.558722+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:58:44.558722+0000","last_undegraded":"2024-08-27T03:58:44.558722+0000","last_fullsized":"2024-08-27T03:58:44.558722+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.558365+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:06:32.373887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'313","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.746753+0000","last_change":"2024-08-27T03:58:42.746489+0000","last_active":"2024-08-27T03:58:42.746753+0000","last_peered":"2024-08-27T03:58:42.746753+0000","last_clean":"2024-08-27T03:58:42.746753+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:42.746753+0000","last_undegraded":"2024-08-27T03:58:42.746753+0000","last_fullsized":"2024-08-27T03:58:42.746753+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.746119+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:28:53.493047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":2564,"num_write":1048,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'614","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.680745+0000","last_change":"2024-08-27T03:58:52.680599+0000","last_active":"2024-08-27T03:58:52.680745+0000","last_peered":"2024-08-27T03:58:52.680745+0000","last_clean":"2024-08-27T03:58:52.680745+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:58:52.680745+0000","last_undegraded":"2024-08-27T03:58:52.680745+0000","last_fullsized":"2024-08-27T03:58:52.680745+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'614","last_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_deep_scrub":"267'614","last_deep_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.680388+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:22.858376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3063,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":1135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.392992+0000","last_change":"2024-08-27T03:58:42.392831+0000","last_active":"2024-08-27T03:58:42.392992+0000","last_peered":"2024-08-27T03:58:42.392992+0000","last_clean":"2024-08-27T03:58:42.392992+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:42.392992+0000","last_undegraded":"2024-08-27T03:58:42.392992+0000","last_fullsized":"2024-08-27T03:58:42.392992+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.392600+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:02.371839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":686594,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":79613,"num_write":1033,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'505","reported_seq":2138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.928880+0000","last_change":"2024-08-27T03:58:52.928741+0000","last_active":"2024-08-27T03:58:52.928880+0000","last_peered":"2024-08-27T03:58:52.928880+0000","last_clean":"2024-08-27T03:58:52.928880+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:58:52.928880+0000","last_undegraded":"2024-08-27T03:58:52.928880+0000","last_fullsized":"2024-08-27T03:58:52.928880+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'505","last_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_deep_scrub":"267'505","last_deep_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.928533+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:07.897474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'307","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.809517+0000","last_change":"2024-08-27T03:58:40.809278+0000","last_active":"2024-08-27T03:58:40.809517+0000","last_peered":"2024-08-27T03:58:40.809517+0000","last_clean":"2024-08-27T03:58:40.809517+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:40.809517+0000","last_undegraded":"2024-08-27T03:58:40.809517+0000","last_fullsized":"2024-08-27T03:58:40.809517+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.808995+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:03:10.468667+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911567,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":603,"num_read_kb":25477,"num_write":981,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'803","reported_seq":2706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.528961+0000","last_change":"2024-08-27T03:58:53.528826+0000","last_active":"2024-08-27T03:58:53.528961+0000","last_peered":"2024-08-27T03:58:53.528961+0000","last_clean":"2024-08-27T03:58:53.528961+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:53.528961+0000","last_undegraded":"2024-08-27T03:58:53.528961+0000","last_fullsized":"2024-08-27T03:58:53.528961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'803","last_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_deep_scrub":"267'803","last_deep_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.528622+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:57.111154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'311","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.903956+0000","last_change":"2024-08-27T03:58:46.903809+0000","last_active":"2024-08-27T03:58:46.903956+0000","last_peered":"2024-08-27T03:58:46.903956+0000","last_clean":"2024-08-27T03:58:46.903956+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:46.903956+0000","last_undegraded":"2024-08-27T03:58:46.903956+0000","last_fullsized":"2024-08-27T03:58:46.903956+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.903570+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:32:09.302081+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311643,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":75812,"num_write":989,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'418","reported_seq":1907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.297174+0000","last_change":"2024-08-27T03:58:59.297174+0000","last_active":"2024-08-27T03:58:59.297174+0000","last_peered":"2024-08-27T03:58:59.297174+0000","last_clean":"2024-08-27T03:58:59.297174+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:58:59.297174+0000","last_undegraded":"2024-08-27T03:58:59.297174+0000","last_fullsized":"2024-08-27T03:58:59.297174+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'418","last_scrub_stamp":"2024-08-27T03:58:59.296967+0000","last_deep_scrub":"267'418","last_deep_scrub_stamp":"2024-08-27T03:58:59.296967+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.296967+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:42.487638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'422","reported_seq":1349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.595085+0000","last_change":"2024-08-27T03:58:42.595085+0000","last_active":"2024-08-27T03:58:42.595085+0000","last_peered":"2024-08-27T03:58:42.595085+0000","last_clean":"2024-08-27T03:58:42.595085+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:42.595085+0000","last_undegraded":"2024-08-27T03:58:42.595085+0000","last_fullsized":"2024-08-27T03:58:42.595085+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.594805+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:16.906357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1005,"num_read_kb":143555,"num_write":1198,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'387","reported_seq":1799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.901866+0000","last_change":"2024-08-27T03:58:45.901866+0000","last_active":"2024-08-27T03:58:45.901866+0000","last_peered":"2024-08-27T03:58:45.901866+0000","last_clean":"2024-08-27T03:58:45.901866+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:58:45.901866+0000","last_undegraded":"2024-08-27T03:58:45.901866+0000","last_fullsized":"2024-08-27T03:58:45.901866+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.901684+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:11:59.846712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'359","reported_seq":1058,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.749864+0000","last_change":"2024-08-27T03:58:44.749864+0000","last_active":"2024-08-27T03:58:44.749864+0000","last_peered":"2024-08-27T03:58:44.749864+0000","last_clean":"2024-08-27T03:58:44.749864+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:44.749864+0000","last_undegraded":"2024-08-27T03:58:44.749864+0000","last_fullsized":"2024-08-27T03:58:44.749864+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.749636+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:42.137274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":596,"num_read_kb":11844,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'342","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.754972+0000","last_change":"2024-08-27T03:58:45.754972+0000","last_active":"2024-08-27T03:58:45.754972+0000","last_peered":"2024-08-27T03:58:45.754972+0000","last_clean":"2024-08-27T03:58:45.754972+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:45.754972+0000","last_undegraded":"2024-08-27T03:58:45.754972+0000","last_fullsized":"2024-08-27T03:58:45.754972+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.754732+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:10.198393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":4948,"num_write":1064,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'382","reported_seq":2040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.532613+0000","last_change":"2024-08-27T03:58:55.532613+0000","last_active":"2024-08-27T03:58:55.532613+0000","last_peered":"2024-08-27T03:58:55.532613+0000","last_clean":"2024-08-27T03:58:55.532613+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:58:55.532613+0000","last_undegraded":"2024-08-27T03:58:55.532613+0000","last_fullsized":"2024-08-27T03:58:55.532613+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-08-27T03:58:55.532420+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-08-27T03:58:55.532420+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.532420+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:42:31.047679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'342","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.113500+0000","last_change":"2024-08-27T03:58:42.113500+0000","last_active":"2024-08-27T03:58:42.113500+0000","last_peered":"2024-08-27T03:58:42.113500+0000","last_clean":"2024-08-27T03:58:42.113500+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:42.113500+0000","last_undegraded":"2024-08-27T03:58:42.113500+0000","last_fullsized":"2024-08-27T03:58:42.113500+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.113238+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:33.105083+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381353,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":621,"num_read_kb":18083,"num_write":1130,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.823347+0000","last_change":"2024-08-27T03:58:54.823347+0000","last_active":"2024-08-27T03:58:54.823347+0000","last_peered":"2024-08-27T03:58:54.823347+0000","last_clean":"2024-08-27T03:58:54.823347+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:54.823347+0000","last_undegraded":"2024-08-27T03:58:54.823347+0000","last_fullsized":"2024-08-27T03:58:54.823347+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'698","last_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_deep_scrub":"267'698","last_deep_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.823157+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:51:42.227530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1485,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1041,"ondisk_log_size":1041,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1265,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1568,"ondisk_log_size":1568,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":461,"ondisk_log_size":461,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1439020,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19446,"num_read_kb":39405,"num_write":16215,"num_write_kb":11798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677494,"num_omap_keys":1546,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44329,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4105,"ondisk_log_size":4105,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65339946,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":35598,"num_read_kb":1916438,"num_write":70403,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89604096,"data_stored":89604096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3354,"ondisk_log_size":3354,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":208074,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198799,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510504,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192136,"kb_used_data":12472,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94179704,"statfs":{"total":96636764160,"available":96440016896,"internally_reserved":0,"allocated":12771328,"data_stored":10781565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543213,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339224,"kb_used_data":15112,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94032616,"statfs":{"total":96636764160,"available":96289398784,"internally_reserved":0,"allocated":15474688,"data_stored":13471118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543214,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305116,"kb_used_data":17100,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94066724,"statfs":{"total":96636764160,"available":96324325376,"internally_reserved":0,"allocated":17510400,"data_stored":15551496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543211,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162756,"kb_used_data":15028,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94209084,"statfs":{"total":96636764160,"available":96470102016,"internally_reserved":0,"allocated":15388672,"data_stored":13349611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543210,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134208,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94237632,"statfs":{"total":96636764160,"available":96499335168,"internally_reserved":0,"allocated":17350656,"data_stored":15406568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543212,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293612,"kb_used_data":13916,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94078228,"statfs":{"total":96636764160,"available":96336105472,"internally_reserved":0,"allocated":14249984,"data_stored":12236496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543214,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113428,"kb_used_data":14212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94258412,"statfs":{"total":96636764160,"available":96520613888,"internally_reserved":0,"allocated":14553088,"data_stored":12591031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543212,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301160,"kb_used_data":17368,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94070680,"statfs":{"total":96636764160,"available":96328376320,"internally_reserved":0,"allocated":17784832,"data_stored":15748401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":12861440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8486912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10297344,"data_stored":10297344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9940992,"data_stored":9940992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13115392,"data_stored":13115392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11055104,"data_stored":11055104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13258752,"data_stored":13258752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10588160,"data_stored":10588160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T03:59:19.560 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.560 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.560 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.560 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.561 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.562 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.563 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.564 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.565 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.566 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.567 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.568 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.569 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.570 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.570 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-08-27T02:50:50.667815+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=50, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.570 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-08-27T02:46:48.608077+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=46, tm_sec=48, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.570 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.570 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.570 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.571 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.572 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.572 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.573 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.573 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.573 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-08-27T02:31:13.471865+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=31, tm_sec=13, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:19.574 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-27T03:59:39.575 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T03:59:39.945 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T03:59:39.958 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T03:59:39.964 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2926,"stamp":"2024-08-27T03:59:39.328609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67386791,"num_objects":861,"num_object_clones":0,"num_object_copies":2456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":287806,"num_read_kb":2575721,"num_write":159683,"num_write_kb":2372746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728816,"num_omap_keys":1758,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12919,"ondisk_log_size":12919,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1841640,"kb_used_data":122152,"kb_used_omap":12,"kb_used_meta":1719347,"kb_avail":753133080,"statfs":{"total":773094113280,"available":771208273920,"internally_reserved":0,"allocated":125083648,"data_stored":109136286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1760611889},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":610,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008899"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.898174+0000","last_change":"2024-08-27T03:59:22.898174+0000","last_active":"2024-08-27T03:59:22.898174+0000","last_peered":"2024-08-27T03:59:22.898174+0000","last_clean":"2024-08-27T03:59:22.898174+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:59:22.898174+0000","last_undegraded":"2024-08-27T03:59:22.898174+0000","last_fullsized":"2024-08-27T03:59:22.898174+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:22.897989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:22.897989+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.897989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:26.784629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.940068+0000","last_change":"2024-08-27T03:59:21.940068+0000","last_active":"2024-08-27T03:59:21.940068+0000","last_peered":"2024-08-27T03:59:21.940068+0000","last_clean":"2024-08-27T03:59:21.940068+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:59:21.940068+0000","last_undegraded":"2024-08-27T03:59:21.940068+0000","last_fullsized":"2024-08-27T03:59:21.940068+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-08-27T03:59:21.939885+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-08-27T03:59:21.939885+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.939885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:54:44.231898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:27.281295+0000","last_change":"2024-08-27T03:59:27.281295+0000","last_active":"2024-08-27T03:59:27.281295+0000","last_peered":"2024-08-27T03:59:27.281295+0000","last_clean":"2024-08-27T03:59:27.281295+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:59:27.281295+0000","last_undegraded":"2024-08-27T03:59:27.281295+0000","last_fullsized":"2024-08-27T03:59:27.281295+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:27.281104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:27.281104+0000","last_clean_scrub_stamp":"2024-08-27T03:59:27.281104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:57:19.347139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.579783+0000","last_change":"2024-08-27T03:59:22.579783+0000","last_active":"2024-08-27T03:59:22.579783+0000","last_peered":"2024-08-27T03:59:22.579783+0000","last_clean":"2024-08-27T03:59:22.579783+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:59:22.579783+0000","last_undegraded":"2024-08-27T03:59:22.579783+0000","last_fullsized":"2024-08-27T03:59:22.579783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'44","last_scrub_stamp":"2024-08-27T03:59:22.579596+0000","last_deep_scrub":"267'44","last_deep_scrub_stamp":"2024-08-27T03:59:22.579596+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.579596+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:48:13.517742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.746197+0000","last_change":"2024-08-27T03:59:08.746197+0000","last_active":"2024-08-27T03:59:08.746197+0000","last_peered":"2024-08-27T03:59:08.746197+0000","last_clean":"2024-08-27T03:59:08.746197+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:59:08.746197+0000","last_undegraded":"2024-08-27T03:59:08.746197+0000","last_fullsized":"2024-08-27T03:59:08.746197+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.746006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.746006+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.746006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:47:08.897021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.632392+0000","last_change":"2024-08-27T03:59:24.632392+0000","last_active":"2024-08-27T03:59:24.632392+0000","last_peered":"2024-08-27T03:59:24.632392+0000","last_clean":"2024-08-27T03:59:24.632392+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:59:24.632392+0000","last_undegraded":"2024-08-27T03:59:24.632392+0000","last_fullsized":"2024-08-27T03:59:24.632392+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:24.632207+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:24.632207+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.632207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:42:34.372242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.201955+0000","last_change":"2024-08-27T03:59:09.201955+0000","last_active":"2024-08-27T03:59:09.201955+0000","last_peered":"2024-08-27T03:59:09.201955+0000","last_clean":"2024-08-27T03:59:09.201955+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:59:09.201955+0000","last_undegraded":"2024-08-27T03:59:09.201955+0000","last_fullsized":"2024-08-27T03:59:09.201955+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.201764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.201764+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.201764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:29:18.110424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.598339+0000","last_change":"2024-08-27T03:58:58.598204+0000","last_active":"2024-08-27T03:58:58.598339+0000","last_peered":"2024-08-27T03:58:58.598339+0000","last_clean":"2024-08-27T03:58:58.598339+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:58:58.598339+0000","last_undegraded":"2024-08-27T03:58:58.598339+0000","last_fullsized":"2024-08-27T03:58:58.598339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.598012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.598012+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.598012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:05:32.629463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.407284+0000","last_change":"2024-08-27T03:59:13.407284+0000","last_active":"2024-08-27T03:59:13.407284+0000","last_peered":"2024-08-27T03:59:13.407284+0000","last_clean":"2024-08-27T03:59:13.407284+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:59:13.407284+0000","last_undegraded":"2024-08-27T03:59:13.407284+0000","last_fullsized":"2024-08-27T03:59:13.407284+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:13.407108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:13.407108+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.407108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:52:47.993833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:29.761905+0000","last_change":"2024-08-27T03:59:29.761905+0000","last_active":"2024-08-27T03:59:29.761905+0000","last_peered":"2024-08-27T03:59:29.761905+0000","last_clean":"2024-08-27T03:59:29.761905+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:59:29.761905+0000","last_undegraded":"2024-08-27T03:59:29.761905+0000","last_fullsized":"2024-08-27T03:59:29.761905+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:29.761704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:29.761704+0000","last_clean_scrub_stamp":"2024-08-27T03:59:29.761704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:05.585728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'11","reported_seq":92,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.632523+0000","last_change":"2024-08-27T03:59:04.632379+0000","last_active":"2024-08-27T03:59:04.632523+0000","last_peered":"2024-08-27T03:59:04.632523+0000","last_clean":"2024-08-27T03:59:04.632523+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:59:04.632523+0000","last_undegraded":"2024-08-27T03:59:04.632523+0000","last_fullsized":"2024-08-27T03:59:04.632523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-08-27T03:59:04.632165+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-08-27T03:59:04.632165+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.632165+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:22:34.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21563,"num_write":16,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.605077+0000","last_change":"2024-08-27T03:59:20.605077+0000","last_active":"2024-08-27T03:59:20.605077+0000","last_peered":"2024-08-27T03:59:20.605077+0000","last_clean":"2024-08-27T03:59:20.605077+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:59:20.605077+0000","last_undegraded":"2024-08-27T03:59:20.605077+0000","last_fullsized":"2024-08-27T03:59:20.605077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'55","last_scrub_stamp":"2024-08-27T03:59:20.604839+0000","last_deep_scrub":"267'55","last_deep_scrub_stamp":"2024-08-27T03:59:20.604839+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.604839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:12:15.827096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:54.912244+0000","last_change":"2024-08-27T03:10:45.281316+0000","last_active":"2024-08-27T03:56:54.912244+0000","last_peered":"2024-08-27T03:56:54.912244+0000","last_clean":"2024-08-27T03:56:54.912244+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:56:54.912244+0000","last_undegraded":"2024-08-27T03:56:54.912244+0000","last_fullsized":"2024-08-27T03:56:54.912244+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:34.277052+0000","last_change":"2024-08-27T03:59:34.277052+0000","last_active":"2024-08-27T03:59:34.277052+0000","last_peered":"2024-08-27T03:59:34.277052+0000","last_clean":"2024-08-27T03:59:34.277052+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:59:34.277052+0000","last_undegraded":"2024-08-27T03:59:34.277052+0000","last_fullsized":"2024-08-27T03:59:34.277052+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:34.276853+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:34.276853+0000","last_clean_scrub_stamp":"2024-08-27T03:59:34.276853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:14.491300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.632665+0000","last_change":"2024-08-27T03:59:18.632665+0000","last_active":"2024-08-27T03:59:18.632665+0000","last_peered":"2024-08-27T03:59:18.632665+0000","last_clean":"2024-08-27T03:59:18.632665+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:59:18.632665+0000","last_undegraded":"2024-08-27T03:59:18.632665+0000","last_fullsized":"2024-08-27T03:59:18.632665+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-08-27T03:59:18.632471+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-08-27T03:59:18.632471+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.632471+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:24:13.280986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.275578+0000","last_change":"2024-08-27T03:59:24.275578+0000","last_active":"2024-08-27T03:59:24.275578+0000","last_peered":"2024-08-27T03:59:24.275578+0000","last_clean":"2024-08-27T03:59:24.275578+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:59:24.275578+0000","last_undegraded":"2024-08-27T03:59:24.275578+0000","last_fullsized":"2024-08-27T03:59:24.275578+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-08-27T03:59:24.275358+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-08-27T03:59:24.275358+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.275358+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:31.516678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:59.913777+0000","last_change":"2024-08-27T03:10:45.289727+0000","last_active":"2024-08-27T03:56:59.913777+0000","last_peered":"2024-08-27T03:56:59.913777+0000","last_clean":"2024-08-27T03:56:59.913777+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:56:59.913777+0000","last_undegraded":"2024-08-27T03:56:59.913777+0000","last_fullsized":"2024-08-27T03:56:59.913777+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.974067+0000","last_change":"2024-08-27T03:59:20.974067+0000","last_active":"2024-08-27T03:59:20.974067+0000","last_peered":"2024-08-27T03:59:20.974067+0000","last_clean":"2024-08-27T03:59:20.974067+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:59:20.974067+0000","last_undegraded":"2024-08-27T03:59:20.974067+0000","last_fullsized":"2024-08-27T03:59:20.974067+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:20.973799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:20.973799+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.973799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:31:43.803727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.670058+0000","last_change":"2024-08-27T03:59:26.670058+0000","last_active":"2024-08-27T03:59:26.670058+0000","last_peered":"2024-08-27T03:59:26.670058+0000","last_clean":"2024-08-27T03:59:26.670058+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:59:26.670058+0000","last_undegraded":"2024-08-27T03:59:26.670058+0000","last_fullsized":"2024-08-27T03:59:26.670058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:26.669870+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:26.669870+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.669870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:06:11.134632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.311623+0000","last_change":"2024-08-27T03:59:26.311623+0000","last_active":"2024-08-27T03:59:26.311623+0000","last_peered":"2024-08-27T03:59:26.311623+0000","last_clean":"2024-08-27T03:59:26.311623+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:59:26.311623+0000","last_undegraded":"2024-08-27T03:59:26.311623+0000","last_fullsized":"2024-08-27T03:59:26.311623+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-08-27T03:59:26.311428+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-08-27T03:59:26.311428+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.311428+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:30:40.400030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.174375+0000","last_change":"2024-08-27T03:59:14.174375+0000","last_active":"2024-08-27T03:59:14.174375+0000","last_peered":"2024-08-27T03:59:14.174375+0000","last_clean":"2024-08-27T03:59:14.174375+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:59:14.174375+0000","last_undegraded":"2024-08-27T03:59:14.174375+0000","last_fullsized":"2024-08-27T03:59:14.174375+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:14.174178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:14.174178+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.174178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:51:05.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.453969+0000","last_change":"2024-08-27T03:59:11.453969+0000","last_active":"2024-08-27T03:59:11.453969+0000","last_peered":"2024-08-27T03:59:11.453969+0000","last_clean":"2024-08-27T03:59:11.453969+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:59:11.453969+0000","last_undegraded":"2024-08-27T03:59:11.453969+0000","last_fullsized":"2024-08-27T03:59:11.453969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:11.453796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:11.453796+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.453796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:09:33.686927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.668632+0000","last_change":"2024-08-27T03:59:17.668632+0000","last_active":"2024-08-27T03:59:17.668632+0000","last_peered":"2024-08-27T03:59:17.668632+0000","last_clean":"2024-08-27T03:59:17.668632+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:59:17.668632+0000","last_undegraded":"2024-08-27T03:59:17.668632+0000","last_fullsized":"2024-08-27T03:59:17.668632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:17.668428+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:17.668428+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.668428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:11.426359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.481791+0000","last_change":"2024-08-27T03:59:06.481621+0000","last_active":"2024-08-27T03:59:06.481791+0000","last_peered":"2024-08-27T03:59:06.481791+0000","last_clean":"2024-08-27T03:59:06.481791+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:59:06.481791+0000","last_undegraded":"2024-08-27T03:59:06.481791+0000","last_fullsized":"2024-08-27T03:59:06.481791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'18","last_scrub_stamp":"2024-08-27T03:59:06.481436+0000","last_deep_scrub":"267'18","last_deep_scrub_stamp":"2024-08-27T03:59:06.481436+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.481436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:11:24.160204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:33.641781+0000","last_change":"2024-08-27T03:59:33.641781+0000","last_active":"2024-08-27T03:59:33.641781+0000","last_peered":"2024-08-27T03:59:33.641781+0000","last_clean":"2024-08-27T03:59:33.641781+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:59:33.641781+0000","last_undegraded":"2024-08-27T03:59:33.641781+0000","last_fullsized":"2024-08-27T03:59:33.641781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:33.641589+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:33.641589+0000","last_clean_scrub_stamp":"2024-08-27T03:59:33.641589+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:23:27.267816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'6","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.455410+0000","last_change":"2024-08-27T03:59:12.455410+0000","last_active":"2024-08-27T03:59:12.455410+0000","last_peered":"2024-08-27T03:59:12.455410+0000","last_clean":"2024-08-27T03:59:12.455410+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:59:12.455410+0000","last_undegraded":"2024-08-27T03:59:12.455410+0000","last_fullsized":"2024-08-27T03:59:12.455410+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:12.455234+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:12.455234+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.455234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:00:39.579700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.668639+0000","last_change":"2024-08-27T03:59:19.668639+0000","last_active":"2024-08-27T03:59:19.668639+0000","last_peered":"2024-08-27T03:59:19.668639+0000","last_clean":"2024-08-27T03:59:19.668639+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:59:19.668639+0000","last_undegraded":"2024-08-27T03:59:19.668639+0000","last_fullsized":"2024-08-27T03:59:19.668639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:19.668427+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:19.668427+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.668427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:48:59.060196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.584642+0000","last_change":"2024-08-27T03:59:18.584481+0000","last_active":"2024-08-27T03:59:18.584642+0000","last_peered":"2024-08-27T03:59:18.584642+0000","last_clean":"2024-08-27T03:59:18.584642+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:59:18.584642+0000","last_undegraded":"2024-08-27T03:59:18.584642+0000","last_fullsized":"2024-08-27T03:59:18.584642+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-08-27T03:59:18.584259+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-08-27T03:59:18.584259+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.584259+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:00.237348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:32.679267+0000","last_change":"2024-08-27T03:59:32.679267+0000","last_active":"2024-08-27T03:59:32.679267+0000","last_peered":"2024-08-27T03:59:32.679267+0000","last_clean":"2024-08-27T03:59:32.679267+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:59:32.679267+0000","last_undegraded":"2024-08-27T03:59:32.679267+0000","last_fullsized":"2024-08-27T03:59:32.679267+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:32.679040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:32.679040+0000","last_clean_scrub_stamp":"2024-08-27T03:59:32.679040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:24.818619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:33.313508+0000","last_change":"2024-08-27T03:59:33.313508+0000","last_active":"2024-08-27T03:59:33.313508+0000","last_peered":"2024-08-27T03:59:33.313508+0000","last_clean":"2024-08-27T03:59:33.313508+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:59:33.313508+0000","last_undegraded":"2024-08-27T03:59:33.313508+0000","last_fullsized":"2024-08-27T03:59:33.313508+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:33.313317+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:33.313317+0000","last_clean_scrub_stamp":"2024-08-27T03:59:33.313317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:48:55.833964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:27.693840+0000","last_change":"2024-08-27T03:59:27.693840+0000","last_active":"2024-08-27T03:59:27.693840+0000","last_peered":"2024-08-27T03:59:27.693840+0000","last_clean":"2024-08-27T03:59:27.693840+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:59:27.693840+0000","last_undegraded":"2024-08-27T03:59:27.693840+0000","last_fullsized":"2024-08-27T03:59:27.693840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:27.693596+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:27.693596+0000","last_clean_scrub_stamp":"2024-08-27T03:59:27.693596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:23:29.345599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":213,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.208211+0000","last_change":"2024-08-27T03:59:07.208053+0000","last_active":"2024-08-27T03:59:07.208211+0000","last_peered":"2024-08-27T03:59:07.208211+0000","last_clean":"2024-08-27T03:59:07.208211+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:59:07.208211+0000","last_undegraded":"2024-08-27T03:59:07.208211+0000","last_fullsized":"2024-08-27T03:59:07.208211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'51","last_scrub_stamp":"2024-08-27T03:59:07.207859+0000","last_deep_scrub":"267'51","last_deep_scrub_stamp":"2024-08-27T03:59:07.207859+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.207859+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:50:28.317913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.198216+0000","last_change":"2024-08-27T03:59:15.198216+0000","last_active":"2024-08-27T03:59:15.198216+0000","last_peered":"2024-08-27T03:59:15.198216+0000","last_clean":"2024-08-27T03:59:15.198216+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:59:15.198216+0000","last_undegraded":"2024-08-27T03:59:15.198216+0000","last_fullsized":"2024-08-27T03:59:15.198216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:15.198031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:15.198031+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.198031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:17:06.883269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:32.263759+0000","last_change":"2024-08-27T03:59:32.263759+0000","last_active":"2024-08-27T03:59:32.263759+0000","last_peered":"2024-08-27T03:59:32.263759+0000","last_clean":"2024-08-27T03:59:32.263759+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:59:32.263759+0000","last_undegraded":"2024-08-27T03:59:32.263759+0000","last_fullsized":"2024-08-27T03:59:32.263759+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-08-27T03:59:32.263579+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-08-27T03:59:32.263579+0000","last_clean_scrub_stamp":"2024-08-27T03:59:32.263579+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:45.212117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.992428+0000","last_change":"2024-08-27T03:59:18.992428+0000","last_active":"2024-08-27T03:59:18.992428+0000","last_peered":"2024-08-27T03:59:18.992428+0000","last_clean":"2024-08-27T03:59:18.992428+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:59:18.992428+0000","last_undegraded":"2024-08-27T03:59:18.992428+0000","last_fullsized":"2024-08-27T03:59:18.992428+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:18.992246+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:18.992246+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.992246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:28:14.456890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.623193+0000","last_change":"2024-08-27T03:59:19.623022+0000","last_active":"2024-08-27T03:59:19.623193+0000","last_peered":"2024-08-27T03:59:19.623193+0000","last_clean":"2024-08-27T03:59:19.623193+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:59:19.623193+0000","last_undegraded":"2024-08-27T03:59:19.623193+0000","last_fullsized":"2024-08-27T03:59:19.623193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-08-27T03:59:19.622818+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-08-27T03:59:19.622818+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.622818+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:52.161048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.702701+0000","last_change":"2024-08-27T03:59:07.702701+0000","last_active":"2024-08-27T03:59:07.702701+0000","last_peered":"2024-08-27T03:59:07.702701+0000","last_clean":"2024-08-27T03:59:07.702701+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:59:07.702701+0000","last_undegraded":"2024-08-27T03:59:07.702701+0000","last_fullsized":"2024-08-27T03:59:07.702701+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:07.702512+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:07.702512+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.702512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:36:10.239915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:31.771372+0000","last_change":"2024-08-27T03:59:31.771234+0000","last_active":"2024-08-27T03:59:31.771372+0000","last_peered":"2024-08-27T03:59:31.771372+0000","last_clean":"2024-08-27T03:59:31.771372+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:59:31.771372+0000","last_undegraded":"2024-08-27T03:59:31.771372+0000","last_fullsized":"2024-08-27T03:59:31.771372+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:31.771029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:31.771029+0000","last_clean_scrub_stamp":"2024-08-27T03:59:31.771029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:10.053583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.727851+0000","last_change":"2024-08-27T03:59:21.727851+0000","last_active":"2024-08-27T03:59:21.727851+0000","last_peered":"2024-08-27T03:59:21.727851+0000","last_clean":"2024-08-27T03:59:21.727851+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:59:21.727851+0000","last_undegraded":"2024-08-27T03:59:21.727851+0000","last_fullsized":"2024-08-27T03:59:21.727851+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-08-27T03:59:21.727651+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-08-27T03:59:21.727651+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.727651+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:39:12.306382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":317,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.307658+0000","last_change":"2024-08-27T03:59:21.307658+0000","last_active":"2024-08-27T03:59:21.307658+0000","last_peered":"2024-08-27T03:59:21.307658+0000","last_clean":"2024-08-27T03:59:21.307658+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:59:21.307658+0000","last_undegraded":"2024-08-27T03:59:21.307658+0000","last_fullsized":"2024-08-27T03:59:21.307658+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-08-27T03:59:21.307471+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-08-27T03:59:21.307471+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.307471+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:52.992247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:31.677950+0000","last_change":"2024-08-27T03:59:31.677950+0000","last_active":"2024-08-27T03:59:31.677950+0000","last_peered":"2024-08-27T03:59:31.677950+0000","last_clean":"2024-08-27T03:59:31.677950+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:59:31.677950+0000","last_undegraded":"2024-08-27T03:59:31.677950+0000","last_fullsized":"2024-08-27T03:59:31.677950+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:31.677738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:31.677738+0000","last_clean_scrub_stamp":"2024-08-27T03:59:31.677738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:53.414642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:09.900537+0000","last_change":"2024-08-27T02:50:55.799828+0000","last_active":"2024-08-27T03:56:09.900537+0000","last_peered":"2024-08-27T03:56:09.900537+0000","last_clean":"2024-08-27T03:56:09.900537+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:56:09.900537+0000","last_undegraded":"2024-08-27T03:56:09.900537+0000","last_fullsized":"2024-08-27T03:56:09.900537+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T02:50:54.731776+0000","last_clean_scrub_stamp":"2024-08-27T02:50:54.731776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:54.431380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.638221+0000","last_change":"2024-08-27T03:59:02.638221+0000","last_active":"2024-08-27T03:59:02.638221+0000","last_peered":"2024-08-27T03:59:02.638221+0000","last_clean":"2024-08-27T03:59:02.638221+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:59:02.638221+0000","last_undegraded":"2024-08-27T03:59:02.638221+0000","last_fullsized":"2024-08-27T03:59:02.638221+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:02.637934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:02.637934+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.637934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:19.825120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.631858+0000","last_change":"2024-08-27T03:59:00.631616+0000","last_active":"2024-08-27T03:59:00.631858+0000","last_peered":"2024-08-27T03:59:00.631858+0000","last_clean":"2024-08-27T03:59:00.631858+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:59:00.631858+0000","last_undegraded":"2024-08-27T03:59:00.631858+0000","last_fullsized":"2024-08-27T03:59:00.631858+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-08-27T03:59:00.631344+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-08-27T03:59:00.631344+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.631344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:59.147750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.825268+0000","last_change":"2024-08-27T03:59:24.825268+0000","last_active":"2024-08-27T03:59:24.825268+0000","last_peered":"2024-08-27T03:59:24.825268+0000","last_clean":"2024-08-27T03:59:24.825268+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:59:24.825268+0000","last_undegraded":"2024-08-27T03:59:24.825268+0000","last_fullsized":"2024-08-27T03:59:24.825268+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:24.825086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:24.825086+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.825086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:35.585187+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.619457+0000","last_change":"2024-08-27T03:59:22.619457+0000","last_active":"2024-08-27T03:59:22.619457+0000","last_peered":"2024-08-27T03:59:22.619457+0000","last_clean":"2024-08-27T03:59:22.619457+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:59:22.619457+0000","last_undegraded":"2024-08-27T03:59:22.619457+0000","last_fullsized":"2024-08-27T03:59:22.619457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:22.619257+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:22.619257+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.619257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:55:21.580911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.623564+0000","last_change":"2024-08-27T03:59:25.623564+0000","last_active":"2024-08-27T03:59:25.623564+0000","last_peered":"2024-08-27T03:59:25.623564+0000","last_clean":"2024-08-27T03:59:25.623564+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:59:25.623564+0000","last_undegraded":"2024-08-27T03:59:25.623564+0000","last_fullsized":"2024-08-27T03:59:25.623564+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:25.623389+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:25.623389+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.623389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:17:45.359254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.800933+0000","last_change":"2024-08-27T03:59:16.800796+0000","last_active":"2024-08-27T03:59:16.800933+0000","last_peered":"2024-08-27T03:59:16.800933+0000","last_clean":"2024-08-27T03:59:16.800933+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:59:16.800933+0000","last_undegraded":"2024-08-27T03:59:16.800933+0000","last_fullsized":"2024-08-27T03:59:16.800933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-08-27T03:59:16.800626+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-08-27T03:59:16.800626+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.800626+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:44:59.363430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":33,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.908776+0000","last_change":"2024-08-27T03:10:45.289487+0000","last_active":"2024-08-27T03:56:39.908776+0000","last_peered":"2024-08-27T03:56:39.908776+0000","last_clean":"2024-08-27T03:56:39.908776+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:56:39.908776+0000","last_undegraded":"2024-08-27T03:56:39.908776+0000","last_fullsized":"2024-08-27T03:56:39.908776+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.249493+0000","last_change":"2024-08-27T03:59:17.249493+0000","last_active":"2024-08-27T03:59:17.249493+0000","last_peered":"2024-08-27T03:59:17.249493+0000","last_clean":"2024-08-27T03:59:17.249493+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:59:17.249493+0000","last_undegraded":"2024-08-27T03:59:17.249493+0000","last_fullsized":"2024-08-27T03:59:17.249493+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:17.249309+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:17.249309+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.249309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:47:30.912020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.690441+0000","last_change":"2024-08-27T03:59:16.690441+0000","last_active":"2024-08-27T03:59:16.690441+0000","last_peered":"2024-08-27T03:59:16.690441+0000","last_clean":"2024-08-27T03:59:16.690441+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:59:16.690441+0000","last_undegraded":"2024-08-27T03:59:16.690441+0000","last_fullsized":"2024-08-27T03:59:16.690441+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:16.690255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:16.690255+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.690255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:56:56.493716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.746494+0000","last_change":"2024-08-27T03:59:13.746494+0000","last_active":"2024-08-27T03:59:13.746494+0000","last_peered":"2024-08-27T03:59:13.746494+0000","last_clean":"2024-08-27T03:59:13.746494+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:59:13.746494+0000","last_undegraded":"2024-08-27T03:59:13.746494+0000","last_fullsized":"2024-08-27T03:59:13.746494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-08-27T03:59:13.746262+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-08-27T03:59:13.746262+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.746262+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:39:18.859681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:33.815734+0000","last_change":"2024-08-27T03:59:33.815734+0000","last_active":"2024-08-27T03:59:33.815734+0000","last_peered":"2024-08-27T03:59:33.815734+0000","last_clean":"2024-08-27T03:59:33.815734+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:59:33.815734+0000","last_undegraded":"2024-08-27T03:59:33.815734+0000","last_fullsized":"2024-08-27T03:59:33.815734+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:33.815541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:33.815541+0000","last_clean_scrub_stamp":"2024-08-27T03:59:33.815541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:43:00.928795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.165657+0000","last_change":"2024-08-27T03:59:13.165657+0000","last_active":"2024-08-27T03:59:13.165657+0000","last_peered":"2024-08-27T03:59:13.165657+0000","last_clean":"2024-08-27T03:59:13.165657+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:59:13.165657+0000","last_undegraded":"2024-08-27T03:59:13.165657+0000","last_fullsized":"2024-08-27T03:59:13.165657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:13.165473+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:13.165473+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.165473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:55:33.719279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:30.310097+0000","last_change":"2024-08-27T03:59:30.310097+0000","last_active":"2024-08-27T03:59:30.310097+0000","last_peered":"2024-08-27T03:59:30.310097+0000","last_clean":"2024-08-27T03:59:30.310097+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:59:30.310097+0000","last_undegraded":"2024-08-27T03:59:30.310097+0000","last_fullsized":"2024-08-27T03:59:30.310097+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:30.309910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:30.309910+0000","last_clean_scrub_stamp":"2024-08-27T03:59:30.309910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:03:51.661348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.544285+0000","last_change":"2024-08-27T03:59:17.544285+0000","last_active":"2024-08-27T03:59:17.544285+0000","last_peered":"2024-08-27T03:59:17.544285+0000","last_clean":"2024-08-27T03:59:17.544285+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:59:17.544285+0000","last_undegraded":"2024-08-27T03:59:17.544285+0000","last_fullsized":"2024-08-27T03:59:17.544285+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-08-27T03:59:17.544059+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-08-27T03:59:17.544059+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.544059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:01.603813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:15.287223+0000","last_change":"2024-08-27T03:10:45.283329+0000","last_active":"2024-08-27T03:55:15.287223+0000","last_peered":"2024-08-27T03:55:15.287223+0000","last_clean":"2024-08-27T03:55:15.287223+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:55:15.287223+0000","last_undegraded":"2024-08-27T03:55:15.287223+0000","last_fullsized":"2024-08-27T03:55:15.287223+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:08.644016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:31.292985+0000","last_change":"2024-08-27T03:59:31.292985+0000","last_active":"2024-08-27T03:59:31.292985+0000","last_peered":"2024-08-27T03:59:31.292985+0000","last_clean":"2024-08-27T03:59:31.292985+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:59:31.292985+0000","last_undegraded":"2024-08-27T03:59:31.292985+0000","last_fullsized":"2024-08-27T03:59:31.292985+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:31.292809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:31.292809+0000","last_clean_scrub_stamp":"2024-08-27T03:59:31.292809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:58.298334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.502670+0000","last_change":"2024-08-27T03:59:08.502670+0000","last_active":"2024-08-27T03:59:08.502670+0000","last_peered":"2024-08-27T03:59:08.502670+0000","last_clean":"2024-08-27T03:59:08.502670+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:59:08.502670+0000","last_undegraded":"2024-08-27T03:59:08.502670+0000","last_fullsized":"2024-08-27T03:59:08.502670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.502492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.502492+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.502492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:16:58.852923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.645772+0000","last_change":"2024-08-27T03:59:13.645772+0000","last_active":"2024-08-27T03:59:13.645772+0000","last_peered":"2024-08-27T03:59:13.645772+0000","last_clean":"2024-08-27T03:59:13.645772+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:59:13.645772+0000","last_undegraded":"2024-08-27T03:59:13.645772+0000","last_fullsized":"2024-08-27T03:59:13.645772+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:13.645584+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:13.645584+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.645584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:05:02.912963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:39.908740+0000","last_change":"2024-08-27T03:10:45.266598+0000","last_active":"2024-08-27T03:56:39.908740+0000","last_peered":"2024-08-27T03:56:39.908740+0000","last_clean":"2024-08-27T03:56:39.908740+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:56:39.908740+0000","last_undegraded":"2024-08-27T03:56:39.908740+0000","last_fullsized":"2024-08-27T03:56:39.908740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.500122+0000","last_change":"2024-08-27T03:59:10.500122+0000","last_active":"2024-08-27T03:59:10.500122+0000","last_peered":"2024-08-27T03:59:10.500122+0000","last_clean":"2024-08-27T03:59:10.500122+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:59:10.500122+0000","last_undegraded":"2024-08-27T03:59:10.500122+0000","last_fullsized":"2024-08-27T03:59:10.500122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:10.499937+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:10.499937+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.499937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:27.141860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.960306+0000","last_change":"2024-08-27T03:59:17.960306+0000","last_active":"2024-08-27T03:59:17.960306+0000","last_peered":"2024-08-27T03:59:17.960306+0000","last_clean":"2024-08-27T03:59:17.960306+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:59:17.960306+0000","last_undegraded":"2024-08-27T03:59:17.960306+0000","last_fullsized":"2024-08-27T03:59:17.960306+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:17.960124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:17.960124+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.960124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:22.112483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.355298+0000","last_change":"2024-08-27T03:59:20.355298+0000","last_active":"2024-08-27T03:59:20.355298+0000","last_peered":"2024-08-27T03:59:20.355298+0000","last_clean":"2024-08-27T03:59:20.355298+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:59:20.355298+0000","last_undegraded":"2024-08-27T03:59:20.355298+0000","last_fullsized":"2024-08-27T03:59:20.355298+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-08-27T03:59:20.355015+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-08-27T03:59:20.355015+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.355015+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:23.871904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.679670+0000","last_change":"2024-08-27T03:59:05.679670+0000","last_active":"2024-08-27T03:59:05.679670+0000","last_peered":"2024-08-27T03:59:05.679670+0000","last_clean":"2024-08-27T03:59:05.679670+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:59:05.679670+0000","last_undegraded":"2024-08-27T03:59:05.679670+0000","last_fullsized":"2024-08-27T03:59:05.679670+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.679493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.679493+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.679493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:01.999447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.280550+0000","last_change":"2024-08-27T03:59:25.280550+0000","last_active":"2024-08-27T03:59:25.280550+0000","last_peered":"2024-08-27T03:59:25.280550+0000","last_clean":"2024-08-27T03:59:25.280550+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:59:25.280550+0000","last_undegraded":"2024-08-27T03:59:25.280550+0000","last_fullsized":"2024-08-27T03:59:25.280550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:25.280358+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:25.280358+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.280358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:19:19.222017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.725149+0000","last_change":"2024-08-27T03:59:20.725149+0000","last_active":"2024-08-27T03:59:20.725149+0000","last_peered":"2024-08-27T03:59:20.725149+0000","last_clean":"2024-08-27T03:59:20.725149+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:59:20.725149+0000","last_undegraded":"2024-08-27T03:59:20.725149+0000","last_fullsized":"2024-08-27T03:59:20.725149+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:20.724884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:20.724884+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.724884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:30.637590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'156","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.305922+0000","last_change":"2024-08-27T03:59:23.305922+0000","last_active":"2024-08-27T03:59:23.305922+0000","last_peered":"2024-08-27T03:59:23.305922+0000","last_clean":"2024-08-27T03:59:23.305922+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:59:23.305922+0000","last_undegraded":"2024-08-27T03:59:23.305922+0000","last_fullsized":"2024-08-27T03:59:23.305922+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-08-27T03:59:23.305691+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-08-27T03:59:23.305691+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.305691+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:03:09.487642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2000,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:28.749771+0000","last_change":"2024-08-27T03:59:28.749771+0000","last_active":"2024-08-27T03:59:28.749771+0000","last_peered":"2024-08-27T03:59:28.749771+0000","last_clean":"2024-08-27T03:59:28.749771+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:59:28.749771+0000","last_undegraded":"2024-08-27T03:59:28.749771+0000","last_fullsized":"2024-08-27T03:59:28.749771+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:28.749474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:28.749474+0000","last_clean_scrub_stamp":"2024-08-27T03:59:28.749474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:44.194892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:28.322065+0000","last_change":"2024-08-27T03:59:28.322065+0000","last_active":"2024-08-27T03:59:28.322065+0000","last_peered":"2024-08-27T03:59:28.322065+0000","last_clean":"2024-08-27T03:59:28.322065+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:59:28.322065+0000","last_undegraded":"2024-08-27T03:59:28.322065+0000","last_fullsized":"2024-08-27T03:59:28.322065+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:28.321874+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:28.321874+0000","last_clean_scrub_stamp":"2024-08-27T03:59:28.321874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:20:27.343067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.638510+0000","last_change":"2024-08-27T03:59:01.638510+0000","last_active":"2024-08-27T03:59:01.638510+0000","last_peered":"2024-08-27T03:59:01.638510+0000","last_clean":"2024-08-27T03:59:01.638510+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:59:01.638510+0000","last_undegraded":"2024-08-27T03:59:01.638510+0000","last_fullsized":"2024-08-27T03:59:01.638510+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:01.638302+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:01.638302+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.638302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:11.517225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.983575+0000","last_change":"2024-08-27T03:59:16.983575+0000","last_active":"2024-08-27T03:59:16.983575+0000","last_peered":"2024-08-27T03:59:16.983575+0000","last_clean":"2024-08-27T03:59:16.983575+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:59:16.983575+0000","last_undegraded":"2024-08-27T03:59:16.983575+0000","last_fullsized":"2024-08-27T03:59:16.983575+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:16.983384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:16.983384+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.983384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:29.390855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.389568+0000","last_change":"2024-08-27T03:59:14.389568+0000","last_active":"2024-08-27T03:59:14.389568+0000","last_peered":"2024-08-27T03:59:14.389568+0000","last_clean":"2024-08-27T03:59:14.389568+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:59:14.389568+0000","last_undegraded":"2024-08-27T03:59:14.389568+0000","last_fullsized":"2024-08-27T03:59:14.389568+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:14.389366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:14.389366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.389366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:04.259428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.153822+0000","last_change":"2024-08-27T03:59:10.153822+0000","last_active":"2024-08-27T03:59:10.153822+0000","last_peered":"2024-08-27T03:59:10.153822+0000","last_clean":"2024-08-27T03:59:10.153822+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:59:10.153822+0000","last_undegraded":"2024-08-27T03:59:10.153822+0000","last_fullsized":"2024-08-27T03:59:10.153822+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:10.153624+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:10.153624+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.153624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:08:51.528708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.610831+0000","last_change":"2024-08-27T03:59:23.610831+0000","last_active":"2024-08-27T03:59:23.610831+0000","last_peered":"2024-08-27T03:59:23.610831+0000","last_clean":"2024-08-27T03:59:23.610831+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:59:23.610831+0000","last_undegraded":"2024-08-27T03:59:23.610831+0000","last_fullsized":"2024-08-27T03:59:23.610831+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:23.610648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:23.610648+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.610648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:42:36.521011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'96","reported_seq":434,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.531752+0000","last_change":"2024-08-27T03:59:05.531752+0000","last_active":"2024-08-27T03:59:05.531752+0000","last_peered":"2024-08-27T03:59:05.531752+0000","last_clean":"2024-08-27T03:59:05.531752+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:59:05.531752+0000","last_undegraded":"2024-08-27T03:59:05.531752+0000","last_fullsized":"2024-08-27T03:59:05.531752+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'96","last_scrub_stamp":"2024-08-27T03:59:05.531561+0000","last_deep_scrub":"267'96","last_deep_scrub_stamp":"2024-08-27T03:59:05.531561+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.531561+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:56:33.875961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1485,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:27.736830+0000","last_change":"2024-08-27T03:59:27.736830+0000","last_active":"2024-08-27T03:59:27.736830+0000","last_peered":"2024-08-27T03:59:27.736830+0000","last_clean":"2024-08-27T03:59:27.736830+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:59:27.736830+0000","last_undegraded":"2024-08-27T03:59:27.736830+0000","last_fullsized":"2024-08-27T03:59:27.736830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:27.736643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:27.736643+0000","last_clean_scrub_stamp":"2024-08-27T03:59:27.736643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:07:41.530873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:29.359551+0000","last_change":"2024-08-27T03:59:29.359551+0000","last_active":"2024-08-27T03:59:29.359551+0000","last_peered":"2024-08-27T03:59:29.359551+0000","last_clean":"2024-08-27T03:59:29.359551+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:59:29.359551+0000","last_undegraded":"2024-08-27T03:59:29.359551+0000","last_fullsized":"2024-08-27T03:59:29.359551+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:29.359374+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:29.359374+0000","last_clean_scrub_stamp":"2024-08-27T03:59:29.359374+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:21:53.118898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.233160+0000","last_change":"2024-08-27T03:59:08.233160+0000","last_active":"2024-08-27T03:59:08.233160+0000","last_peered":"2024-08-27T03:59:08.233160+0000","last_clean":"2024-08-27T03:59:08.233160+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:59:08.233160+0000","last_undegraded":"2024-08-27T03:59:08.233160+0000","last_fullsized":"2024-08-27T03:59:08.233160+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.232970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.232970+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.232970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:55.808443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.590134+0000","last_change":"2024-08-27T03:58:57.590134+0000","last_active":"2024-08-27T03:58:57.590134+0000","last_peered":"2024-08-27T03:58:57.590134+0000","last_clean":"2024-08-27T03:58:57.590134+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:58:57.590134+0000","last_undegraded":"2024-08-27T03:58:57.590134+0000","last_fullsized":"2024-08-27T03:58:57.590134+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-08-27T03:58:57.589932+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-08-27T03:58:57.589932+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.589932+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:12:51.810737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":34,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:55:44.894119+0000","last_change":"2024-08-27T03:10:45.290159+0000","last_active":"2024-08-27T03:55:44.894119+0000","last_peered":"2024-08-27T03:55:44.894119+0000","last_clean":"2024-08-27T03:55:44.894119+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:55:44.894119+0000","last_undegraded":"2024-08-27T03:55:44.894119+0000","last_fullsized":"2024-08-27T03:55:44.894119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:46:58.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.672357+0000","last_change":"2024-08-27T03:59:20.672357+0000","last_active":"2024-08-27T03:59:20.672357+0000","last_peered":"2024-08-27T03:59:20.672357+0000","last_clean":"2024-08-27T03:59:20.672357+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:59:20.672357+0000","last_undegraded":"2024-08-27T03:59:20.672357+0000","last_fullsized":"2024-08-27T03:59:20.672357+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:20.672154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:20.672154+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.672154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:03:31.647134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.591777+0000","last_change":"2024-08-27T03:59:21.591777+0000","last_active":"2024-08-27T03:59:21.591777+0000","last_peered":"2024-08-27T03:59:21.591777+0000","last_clean":"2024-08-27T03:59:21.591777+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:59:21.591777+0000","last_undegraded":"2024-08-27T03:59:21.591777+0000","last_fullsized":"2024-08-27T03:59:21.591777+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:21.591498+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:21.591498+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.591498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:04:24.135983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.588000+0000","last_change":"2024-08-27T03:59:15.588000+0000","last_active":"2024-08-27T03:59:15.588000+0000","last_peered":"2024-08-27T03:59:15.588000+0000","last_clean":"2024-08-27T03:59:15.588000+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:59:15.588000+0000","last_undegraded":"2024-08-27T03:59:15.588000+0000","last_fullsized":"2024-08-27T03:59:15.588000+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-08-27T03:59:15.587816+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-08-27T03:59:15.587816+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.587816+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:30:59.601294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:30.711693+0000","last_change":"2024-08-27T03:59:30.711693+0000","last_active":"2024-08-27T03:59:30.711693+0000","last_peered":"2024-08-27T03:59:30.711693+0000","last_clean":"2024-08-27T03:59:30.711693+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:59:30.711693+0000","last_undegraded":"2024-08-27T03:59:30.711693+0000","last_fullsized":"2024-08-27T03:59:30.711693+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:30.711502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:30.711502+0000","last_clean_scrub_stamp":"2024-08-27T03:59:30.711502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:21:19.275916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.775584+0000","last_change":"2024-08-27T03:59:23.775584+0000","last_active":"2024-08-27T03:59:23.775584+0000","last_peered":"2024-08-27T03:59:23.775584+0000","last_clean":"2024-08-27T03:59:23.775584+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:59:23.775584+0000","last_undegraded":"2024-08-27T03:59:23.775584+0000","last_fullsized":"2024-08-27T03:59:23.775584+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:23.775407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:23.775407+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.775407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:41:23.099815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.150947+0000","last_change":"2024-08-27T03:59:11.150947+0000","last_active":"2024-08-27T03:59:11.150947+0000","last_peered":"2024-08-27T03:59:11.150947+0000","last_clean":"2024-08-27T03:59:11.150947+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:59:11.150947+0000","last_undegraded":"2024-08-27T03:59:11.150947+0000","last_fullsized":"2024-08-27T03:59:11.150947+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:11.150744+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:11.150744+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.150744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:18:57.866275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.792966+0000","last_change":"2024-08-27T03:59:14.792966+0000","last_active":"2024-08-27T03:59:14.792966+0000","last_peered":"2024-08-27T03:59:14.792966+0000","last_clean":"2024-08-27T03:59:14.792966+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:59:14.792966+0000","last_undegraded":"2024-08-27T03:59:14.792966+0000","last_fullsized":"2024-08-27T03:59:14.792966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-08-27T03:59:14.792770+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-08-27T03:59:14.792770+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.792770+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:55:04.139575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:29.739593+0000","last_change":"2024-08-27T03:59:29.739593+0000","last_active":"2024-08-27T03:59:29.739593+0000","last_peered":"2024-08-27T03:59:29.739593+0000","last_clean":"2024-08-27T03:59:29.739593+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:59:29.739593+0000","last_undegraded":"2024-08-27T03:59:29.739593+0000","last_fullsized":"2024-08-27T03:59:29.739593+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:29.739341+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:29.739341+0000","last_clean_scrub_stamp":"2024-08-27T03:59:29.739341+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:04.051506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.153198+0000","last_change":"2024-08-27T03:59:12.153198+0000","last_active":"2024-08-27T03:59:12.153198+0000","last_peered":"2024-08-27T03:59:12.153198+0000","last_clean":"2024-08-27T03:59:12.153198+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:59:12.153198+0000","last_undegraded":"2024-08-27T03:59:12.153198+0000","last_fullsized":"2024-08-27T03:59:12.153198+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:12.153011+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:12.153011+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.153011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:09.108425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'12","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.651294+0000","last_change":"2024-08-27T03:59:24.651294+0000","last_active":"2024-08-27T03:59:24.651294+0000","last_peered":"2024-08-27T03:59:24.651294+0000","last_clean":"2024-08-27T03:59:24.651294+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:59:24.651294+0000","last_undegraded":"2024-08-27T03:59:24.651294+0000","last_fullsized":"2024-08-27T03:59:24.651294+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-08-27T03:59:24.651111+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-08-27T03:59:24.651111+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.651111+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:16:52.437242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":17,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.340068+0000","last_change":"2024-08-27T03:59:22.340068+0000","last_active":"2024-08-27T03:59:22.340068+0000","last_peered":"2024-08-27T03:59:22.340068+0000","last_clean":"2024-08-27T03:59:22.340068+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:59:22.340068+0000","last_undegraded":"2024-08-27T03:59:22.340068+0000","last_fullsized":"2024-08-27T03:59:22.340068+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-08-27T03:59:22.339862+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-08-27T03:59:22.339862+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.339862+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:11:21.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:34.807169+0000","last_change":"2024-08-27T03:59:34.807169+0000","last_active":"2024-08-27T03:59:34.807169+0000","last_peered":"2024-08-27T03:59:34.807169+0000","last_clean":"2024-08-27T03:59:34.807169+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:59:34.807169+0000","last_undegraded":"2024-08-27T03:59:34.807169+0000","last_fullsized":"2024-08-27T03:59:34.807169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:34.806975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:34.806975+0000","last_clean_scrub_stamp":"2024-08-27T03:59:34.806975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:01:37.469956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.781173+0000","last_change":"2024-08-27T03:59:24.781173+0000","last_active":"2024-08-27T03:59:24.781173+0000","last_peered":"2024-08-27T03:59:24.781173+0000","last_clean":"2024-08-27T03:59:24.781173+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:59:24.781173+0000","last_undegraded":"2024-08-27T03:59:24.781173+0000","last_fullsized":"2024-08-27T03:59:24.781173+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-08-27T03:59:24.780987+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-08-27T03:59:24.780987+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.780987+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:59:53.842370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.639046+0000","last_change":"2024-08-27T03:59:14.639046+0000","last_active":"2024-08-27T03:59:14.639046+0000","last_peered":"2024-08-27T03:59:14.639046+0000","last_clean":"2024-08-27T03:59:14.639046+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:59:14.639046+0000","last_undegraded":"2024-08-27T03:59:14.639046+0000","last_fullsized":"2024-08-27T03:59:14.639046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:14.638829+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:14.638829+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.638829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:24:11.059602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.523841+0000","last_change":"2024-08-27T03:59:04.523841+0000","last_active":"2024-08-27T03:59:04.523841+0000","last_peered":"2024-08-27T03:59:04.523841+0000","last_clean":"2024-08-27T03:59:04.523841+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:59:04.523841+0000","last_undegraded":"2024-08-27T03:59:04.523841+0000","last_fullsized":"2024-08-27T03:59:04.523841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-08-27T03:59:04.523658+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-08-27T03:59:04.523658+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.523658+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:30:21.823486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.807451+0000","last_change":"2024-08-27T03:59:25.807451+0000","last_active":"2024-08-27T03:59:25.807451+0000","last_peered":"2024-08-27T03:59:25.807451+0000","last_clean":"2024-08-27T03:59:25.807451+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:59:25.807451+0000","last_undegraded":"2024-08-27T03:59:25.807451+0000","last_fullsized":"2024-08-27T03:59:25.807451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:25.807270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:25.807270+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.807270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:57.046837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:30.744899+0000","last_change":"2024-08-27T03:59:30.744899+0000","last_active":"2024-08-27T03:59:30.744899+0000","last_peered":"2024-08-27T03:59:30.744899+0000","last_clean":"2024-08-27T03:59:30.744899+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:59:30.744899+0000","last_undegraded":"2024-08-27T03:59:30.744899+0000","last_fullsized":"2024-08-27T03:59:30.744899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:30.744684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:30.744684+0000","last_clean_scrub_stamp":"2024-08-27T03:59:30.744684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:54:54.153329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.767551+0000","last_change":"2024-08-27T03:59:18.767551+0000","last_active":"2024-08-27T03:59:18.767551+0000","last_peered":"2024-08-27T03:59:18.767551+0000","last_clean":"2024-08-27T03:59:18.767551+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:59:18.767551+0000","last_undegraded":"2024-08-27T03:59:18.767551+0000","last_fullsized":"2024-08-27T03:59:18.767551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:18.767356+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:18.767356+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.767356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:16:16.737821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.559223+0000","last_change":"2024-08-27T03:59:16.559223+0000","last_active":"2024-08-27T03:59:16.559223+0000","last_peered":"2024-08-27T03:59:16.559223+0000","last_clean":"2024-08-27T03:59:16.559223+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:59:16.559223+0000","last_undegraded":"2024-08-27T03:59:16.559223+0000","last_fullsized":"2024-08-27T03:59:16.559223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-08-27T03:59:16.559046+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-08-27T03:59:16.559046+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.559046+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:14.790574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.861842+0000","last_change":"2024-08-27T03:59:23.861842+0000","last_active":"2024-08-27T03:59:23.861842+0000","last_peered":"2024-08-27T03:59:23.861842+0000","last_clean":"2024-08-27T03:59:23.861842+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:59:23.861842+0000","last_undegraded":"2024-08-27T03:59:23.861842+0000","last_fullsized":"2024-08-27T03:59:23.861842+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:23.861671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:23.861671+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.861671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:36:58.634021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:28.723869+0000","last_change":"2024-08-27T03:59:28.723869+0000","last_active":"2024-08-27T03:59:28.723869+0000","last_peered":"2024-08-27T03:59:28.723869+0000","last_clean":"2024-08-27T03:59:28.723869+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:59:28.723869+0000","last_undegraded":"2024-08-27T03:59:28.723869+0000","last_fullsized":"2024-08-27T03:59:28.723869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:28.723659+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:28.723659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:28.723659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:00:21.556214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.650423+0000","last_change":"2024-08-27T03:59:03.650423+0000","last_active":"2024-08-27T03:59:03.650423+0000","last_peered":"2024-08-27T03:59:03.650423+0000","last_clean":"2024-08-27T03:59:03.650423+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:59:03.650423+0000","last_undegraded":"2024-08-27T03:59:03.650423+0000","last_fullsized":"2024-08-27T03:59:03.650423+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:03.650243+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:03.650243+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.650243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:28.974883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.525787+0000","last_change":"2024-08-27T03:59:03.525787+0000","last_active":"2024-08-27T03:59:03.525787+0000","last_peered":"2024-08-27T03:59:03.525787+0000","last_clean":"2024-08-27T03:59:03.525787+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:59:03.525787+0000","last_undegraded":"2024-08-27T03:59:03.525787+0000","last_fullsized":"2024-08-27T03:59:03.525787+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-08-27T03:59:03.525614+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-08-27T03:59:03.525614+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.525614+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:28:22.588616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.214450+0000","last_change":"2024-08-27T03:59:18.214450+0000","last_active":"2024-08-27T03:59:18.214450+0000","last_peered":"2024-08-27T03:59:18.214450+0000","last_clean":"2024-08-27T03:59:18.214450+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:59:18.214450+0000","last_undegraded":"2024-08-27T03:59:18.214450+0000","last_fullsized":"2024-08-27T03:59:18.214450+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:18.214263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:18.214263+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.214263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:01:14.307392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.735866+0000","last_change":"2024-08-27T03:59:22.735866+0000","last_active":"2024-08-27T03:59:22.735866+0000","last_peered":"2024-08-27T03:59:22.735866+0000","last_clean":"2024-08-27T03:59:22.735866+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:59:22.735866+0000","last_undegraded":"2024-08-27T03:59:22.735866+0000","last_fullsized":"2024-08-27T03:59:22.735866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:22.735656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:22.735656+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.735656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:03.620500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.993429+0000","last_change":"2024-08-27T03:59:15.993429+0000","last_active":"2024-08-27T03:59:15.993429+0000","last_peered":"2024-08-27T03:59:15.993429+0000","last_clean":"2024-08-27T03:59:15.993429+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:59:15.993429+0000","last_undegraded":"2024-08-27T03:59:15.993429+0000","last_fullsized":"2024-08-27T03:59:15.993429+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:15.993239+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:15.993239+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.993239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:20:54.939203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.730948+0000","last_change":"2024-08-27T03:59:11.730948+0000","last_active":"2024-08-27T03:59:11.730948+0000","last_peered":"2024-08-27T03:59:11.730948+0000","last_clean":"2024-08-27T03:59:11.730948+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:59:11.730948+0000","last_undegraded":"2024-08-27T03:59:11.730948+0000","last_fullsized":"2024-08-27T03:59:11.730948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-08-27T03:59:11.730760+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-08-27T03:59:11.730760+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.730760+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:27:36.382148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.647463+0000","last_change":"2024-08-27T03:59:26.647463+0000","last_active":"2024-08-27T03:59:26.647463+0000","last_peered":"2024-08-27T03:59:26.647463+0000","last_clean":"2024-08-27T03:59:26.647463+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:59:26.647463+0000","last_undegraded":"2024-08-27T03:59:26.647463+0000","last_fullsized":"2024-08-27T03:59:26.647463+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:26.647273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:26.647273+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.647273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:22.857086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.662021+0000","last_change":"2024-08-27T03:59:21.662021+0000","last_active":"2024-08-27T03:59:21.662021+0000","last_peered":"2024-08-27T03:59:21.662021+0000","last_clean":"2024-08-27T03:59:21.662021+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:59:21.662021+0000","last_undegraded":"2024-08-27T03:59:21.662021+0000","last_fullsized":"2024-08-27T03:59:21.662021+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-08-27T03:59:21.661830+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-08-27T03:59:21.661830+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.661830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:12:14.557630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.750478+0000","last_change":"2024-08-27T03:59:19.750478+0000","last_active":"2024-08-27T03:59:19.750478+0000","last_peered":"2024-08-27T03:59:19.750478+0000","last_clean":"2024-08-27T03:59:19.750478+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:59:19.750478+0000","last_undegraded":"2024-08-27T03:59:19.750478+0000","last_fullsized":"2024-08-27T03:59:19.750478+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:19.750264+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:19.750264+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.750264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:39:14.438681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.093946+0000","last_change":"2024-08-27T03:59:03.093946+0000","last_active":"2024-08-27T03:59:03.093946+0000","last_peered":"2024-08-27T03:59:03.093946+0000","last_clean":"2024-08-27T03:59:03.093946+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:59:03.093946+0000","last_undegraded":"2024-08-27T03:59:03.093946+0000","last_fullsized":"2024-08-27T03:59:03.093946+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:03.093759+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:03.093759+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.093759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:35.506595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.690609+0000","last_change":"2024-08-27T03:59:06.690609+0000","last_active":"2024-08-27T03:59:06.690609+0000","last_peered":"2024-08-27T03:59:06.690609+0000","last_clean":"2024-08-27T03:59:06.690609+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:59:06.690609+0000","last_undegraded":"2024-08-27T03:59:06.690609+0000","last_fullsized":"2024-08-27T03:59:06.690609+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:06.690423+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:06.690423+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.690423+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:03.414071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.206071+0000","last_change":"2024-08-27T03:59:16.206071+0000","last_active":"2024-08-27T03:59:16.206071+0000","last_peered":"2024-08-27T03:59:16.206071+0000","last_clean":"2024-08-27T03:59:16.206071+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:59:16.206071+0000","last_undegraded":"2024-08-27T03:59:16.206071+0000","last_fullsized":"2024-08-27T03:59:16.206071+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:16.205853+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:16.205853+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.205853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:54:10.654151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.839799+0000","last_change":"2024-08-27T03:59:15.839799+0000","last_active":"2024-08-27T03:59:15.839799+0000","last_peered":"2024-08-27T03:59:15.839799+0000","last_clean":"2024-08-27T03:59:15.839799+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:59:15.839799+0000","last_undegraded":"2024-08-27T03:59:15.839799+0000","last_fullsized":"2024-08-27T03:59:15.839799+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:15.839621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:15.839621+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.839621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:10:07.169155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":181,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.005826+0000","last_change":"2024-08-27T03:59:15.005826+0000","last_active":"2024-08-27T03:59:15.005826+0000","last_peered":"2024-08-27T03:59:15.005826+0000","last_clean":"2024-08-27T03:59:15.005826+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:59:15.005826+0000","last_undegraded":"2024-08-27T03:59:15.005826+0000","last_fullsized":"2024-08-27T03:59:15.005826+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-08-27T03:59:15.005608+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-08-27T03:59:15.005608+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.005608+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:41:26.816501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:32.783818+0000","last_change":"2024-08-27T03:59:32.783818+0000","last_active":"2024-08-27T03:59:32.783818+0000","last_peered":"2024-08-27T03:59:32.783818+0000","last_clean":"2024-08-27T03:59:32.783818+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:59:32.783818+0000","last_undegraded":"2024-08-27T03:59:32.783818+0000","last_fullsized":"2024-08-27T03:59:32.783818+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:32.783634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:32.783634+0000","last_clean_scrub_stamp":"2024-08-27T03:59:32.783634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:04.658953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.949014+0000","last_change":"2024-08-27T03:59:19.949014+0000","last_active":"2024-08-27T03:59:19.949014+0000","last_peered":"2024-08-27T03:59:19.949014+0000","last_clean":"2024-08-27T03:59:19.949014+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:59:19.949014+0000","last_undegraded":"2024-08-27T03:59:19.949014+0000","last_fullsized":"2024-08-27T03:59:19.949014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:19.948809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:19.948809+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.948809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:48.780433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'7","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.797720+0000","last_change":"2024-08-27T03:59:17.797720+0000","last_active":"2024-08-27T03:59:17.797720+0000","last_peered":"2024-08-27T03:59:17.797720+0000","last_clean":"2024-08-27T03:59:17.797720+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:59:17.797720+0000","last_undegraded":"2024-08-27T03:59:17.797720+0000","last_fullsized":"2024-08-27T03:59:17.797720+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-08-27T03:59:17.797536+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-08-27T03:59:17.797536+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.797536+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:47:48.490744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.659155+0000","last_change":"2024-08-27T03:59:15.659155+0000","last_active":"2024-08-27T03:59:15.659155+0000","last_peered":"2024-08-27T03:59:15.659155+0000","last_clean":"2024-08-27T03:59:15.659155+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:59:15.659155+0000","last_undegraded":"2024-08-27T03:59:15.659155+0000","last_fullsized":"2024-08-27T03:59:15.659155+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-08-27T03:59:15.658975+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-08-27T03:59:15.658975+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.658975+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:54:34.713580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:56:35.307001+0000","last_change":"2024-08-27T03:10:45.281649+0000","last_active":"2024-08-27T03:56:35.307001+0000","last_peered":"2024-08-27T03:56:35.307001+0000","last_clean":"2024-08-27T03:56:35.307001+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:56:35.307001+0000","last_undegraded":"2024-08-27T03:56:35.307001+0000","last_fullsized":"2024-08-27T03:56:35.307001+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:10:44.232885+0000","last_clean_scrub_stamp":"2024-08-27T03:10:44.232885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.514241+0000","last_change":"2024-08-27T03:59:09.514241+0000","last_active":"2024-08-27T03:59:09.514241+0000","last_peered":"2024-08-27T03:59:09.514241+0000","last_clean":"2024-08-27T03:59:09.514241+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:59:09.514241+0000","last_undegraded":"2024-08-27T03:59:09.514241+0000","last_fullsized":"2024-08-27T03:59:09.514241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:09.513996+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:09.513996+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.513996+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:26:56.665749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.143757+0000","last_change":"2024-08-27T03:59:04.143578+0000","last_active":"2024-08-27T03:59:04.143757+0000","last_peered":"2024-08-27T03:59:04.143757+0000","last_clean":"2024-08-27T03:59:04.143757+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:59:04.143757+0000","last_undegraded":"2024-08-27T03:59:04.143757+0000","last_fullsized":"2024-08-27T03:59:04.143757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:04.143381+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:04.143381+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.143381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:58.843764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.572873+0000","last_change":"2024-08-27T03:59:02.572873+0000","last_active":"2024-08-27T03:59:02.572873+0000","last_peered":"2024-08-27T03:59:02.572873+0000","last_clean":"2024-08-27T03:59:02.572873+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:59:02.572873+0000","last_undegraded":"2024-08-27T03:59:02.572873+0000","last_fullsized":"2024-08-27T03:59:02.572873+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-08-27T03:59:02.572691+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-08-27T03:59:02.572691+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.572691+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:55:05.386884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.776814+0000","last_change":"2024-08-27T03:59:26.776814+0000","last_active":"2024-08-27T03:59:26.776814+0000","last_peered":"2024-08-27T03:59:26.776814+0000","last_clean":"2024-08-27T03:59:26.776814+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:59:26.776814+0000","last_undegraded":"2024-08-27T03:59:26.776814+0000","last_fullsized":"2024-08-27T03:59:26.776814+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:26.776620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:26.776620+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.776620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:19:43.578391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.655465+0000","last_change":"2024-08-27T03:59:23.655465+0000","last_active":"2024-08-27T03:59:23.655465+0000","last_peered":"2024-08-27T03:59:23.655465+0000","last_clean":"2024-08-27T03:59:23.655465+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:59:23.655465+0000","last_undegraded":"2024-08-27T03:59:23.655465+0000","last_fullsized":"2024-08-27T03:59:23.655465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:23.655183+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:23.655183+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.655183+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:22:29.289317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.460384+0000","last_change":"2024-08-27T03:59:07.460384+0000","last_active":"2024-08-27T03:59:07.460384+0000","last_peered":"2024-08-27T03:59:07.460384+0000","last_clean":"2024-08-27T03:59:07.460384+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:59:07.460384+0000","last_undegraded":"2024-08-27T03:59:07.460384+0000","last_fullsized":"2024-08-27T03:59:07.460384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.460195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.460195+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.460195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:08.655162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.739008+0000","last_change":"2024-08-27T03:59:10.739008+0000","last_active":"2024-08-27T03:59:10.739008+0000","last_peered":"2024-08-27T03:59:10.739008+0000","last_clean":"2024-08-27T03:59:10.739008+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:59:10.739008+0000","last_undegraded":"2024-08-27T03:59:10.739008+0000","last_fullsized":"2024-08-27T03:59:10.739008+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-08-27T03:59:10.738816+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-08-27T03:59:10.738816+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.738816+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:43:09.357876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'314","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.926129+0000","last_change":"2024-08-27T03:58:50.926129+0000","last_active":"2024-08-27T03:58:50.926129+0000","last_peered":"2024-08-27T03:58:50.926129+0000","last_clean":"2024-08-27T03:58:50.926129+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:50.926129+0000","last_undegraded":"2024-08-27T03:58:50.926129+0000","last_fullsized":"2024-08-27T03:58:50.926129+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'314","last_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_deep_scrub":"267'314","last_deep_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.925876+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:38:38.135877+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291497,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":22191,"num_write":1009,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'460","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.853734+0000","last_change":"2024-08-27T03:58:55.853734+0000","last_active":"2024-08-27T03:58:55.853734+0000","last_peered":"2024-08-27T03:58:55.853734+0000","last_clean":"2024-08-27T03:58:55.853734+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:58:55.853734+0000","last_undegraded":"2024-08-27T03:58:55.853734+0000","last_fullsized":"2024-08-27T03:58:55.853734+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'460","last_scrub_stamp":"2024-08-27T03:58:55.853540+0000","last_deep_scrub":"267'460","last_deep_scrub_stamp":"2024-08-27T03:58:55.853540+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.853540+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:33:53.439285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'361","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.144884+0000","last_change":"2024-08-27T03:58:43.144884+0000","last_active":"2024-08-27T03:58:43.144884+0000","last_peered":"2024-08-27T03:58:43.144884+0000","last_clean":"2024-08-27T03:58:43.144884+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:43.144884+0000","last_undegraded":"2024-08-27T03:58:43.144884+0000","last_fullsized":"2024-08-27T03:58:43.144884+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.144636+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:39.143444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424748,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":39942,"num_write":1277,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'826","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.895174+0000","last_change":"2024-08-27T03:58:54.895174+0000","last_active":"2024-08-27T03:58:54.895174+0000","last_peered":"2024-08-27T03:58:54.895174+0000","last_clean":"2024-08-27T03:58:54.895174+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:58:54.895174+0000","last_undegraded":"2024-08-27T03:58:54.895174+0000","last_fullsized":"2024-08-27T03:58:54.895174+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.894988+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:39:10.133666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'282","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.368824+0000","last_change":"2024-08-27T03:58:43.368824+0000","last_active":"2024-08-27T03:58:43.368824+0000","last_peered":"2024-08-27T03:58:43.368824+0000","last_clean":"2024-08-27T03:58:43.368824+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:43.368824+0000","last_undegraded":"2024-08-27T03:58:43.368824+0000","last_fullsized":"2024-08-27T03:58:43.368824+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'282","last_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_deep_scrub":"267'282","last_deep_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.368595+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:28.412078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":449,"num_write":920,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1217","reported_seq":2740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.707989+0000","last_change":"2024-08-27T03:58:56.707989+0000","last_active":"2024-08-27T03:58:56.707989+0000","last_peered":"2024-08-27T03:58:56.707989+0000","last_clean":"2024-08-27T03:58:56.707989+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:58:56.707989+0000","last_undegraded":"2024-08-27T03:58:56.707989+0000","last_fullsized":"2024-08-27T03:58:56.707989+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1217","last_scrub_stamp":"2024-08-27T03:58:56.707808+0000","last_deep_scrub":"267'1217","last_deep_scrub_stamp":"2024-08-27T03:58:56.707808+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.707808+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":1200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:14:15.277648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'320","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.810370+0000","last_change":"2024-08-27T03:58:47.810209+0000","last_active":"2024-08-27T03:58:47.810370+0000","last_peered":"2024-08-27T03:58:47.810370+0000","last_clean":"2024-08-27T03:58:47.810370+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:47.810370+0000","last_undegraded":"2024-08-27T03:58:47.810370+0000","last_fullsized":"2024-08-27T03:58:47.810370+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.809968+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:11:53.480777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":3871,"num_write":1091,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'481","reported_seq":2144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.508513+0000","last_change":"2024-08-27T03:58:52.508513+0000","last_active":"2024-08-27T03:58:52.508513+0000","last_peered":"2024-08-27T03:58:52.508513+0000","last_clean":"2024-08-27T03:58:52.508513+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:58:52.508513+0000","last_undegraded":"2024-08-27T03:58:52.508513+0000","last_fullsized":"2024-08-27T03:58:52.508513+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.508324+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:43.578410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'389","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.872905+0000","last_change":"2024-08-27T03:58:49.872905+0000","last_active":"2024-08-27T03:58:49.872905+0000","last_peered":"2024-08-27T03:58:49.872905+0000","last_clean":"2024-08-27T03:58:49.872905+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:49.872905+0000","last_undegraded":"2024-08-27T03:58:49.872905+0000","last_fullsized":"2024-08-27T03:58:49.872905+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.872597+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:20.188046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493421,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":17279,"num_write":1203,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'494","reported_seq":2084,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.644002+0000","last_change":"2024-08-27T03:58:50.643833+0000","last_active":"2024-08-27T03:58:50.644002+0000","last_peered":"2024-08-27T03:58:50.644002+0000","last_clean":"2024-08-27T03:58:50.644002+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:58:50.644002+0000","last_undegraded":"2024-08-27T03:58:50.644002+0000","last_fullsized":"2024-08-27T03:58:50.644002+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.643652+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:41:35.221530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'334","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.751411+0000","last_change":"2024-08-27T03:58:49.751411+0000","last_active":"2024-08-27T03:58:49.751411+0000","last_peered":"2024-08-27T03:58:49.751411+0000","last_clean":"2024-08-27T03:58:49.751411+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:49.751411+0000","last_undegraded":"2024-08-27T03:58:49.751411+0000","last_fullsized":"2024-08-27T03:58:49.751411+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.751052+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:58:46.654336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399097,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":18975,"num_write":950,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.673806+0000","last_change":"2024-08-27T03:58:57.673806+0000","last_active":"2024-08-27T03:58:57.673806+0000","last_peered":"2024-08-27T03:58:57.673806+0000","last_clean":"2024-08-27T03:58:57.673806+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:58:57.673806+0000","last_undegraded":"2024-08-27T03:58:57.673806+0000","last_fullsized":"2024-08-27T03:58:57.673806+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-08-27T03:58:57.673567+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-08-27T03:58:57.673567+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.673567+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:53:05.248666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'354","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.572124+0000","last_change":"2024-08-27T03:58:40.571939+0000","last_active":"2024-08-27T03:58:40.572124+0000","last_peered":"2024-08-27T03:58:40.572124+0000","last_clean":"2024-08-27T03:58:40.572124+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:40.572124+0000","last_undegraded":"2024-08-27T03:58:40.572124+0000","last_fullsized":"2024-08-27T03:58:40.572124+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.571595+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:38.897362+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5643582,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":18874,"num_write":1149,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'906","reported_seq":2475,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.892418+0000","last_change":"2024-08-27T03:58:56.892418+0000","last_active":"2024-08-27T03:58:56.892418+0000","last_peered":"2024-08-27T03:58:56.892418+0000","last_clean":"2024-08-27T03:58:56.892418+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:56.892418+0000","last_undegraded":"2024-08-27T03:58:56.892418+0000","last_fullsized":"2024-08-27T03:58:56.892418+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'906","last_scrub_stamp":"2024-08-27T03:58:56.892228+0000","last_deep_scrub":"267'906","last_deep_scrub_stamp":"2024-08-27T03:58:56.892228+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.892228+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:38:37.236736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1752,"num_omap_keys":7,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'344","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.157025+0000","last_change":"2024-08-27T03:58:47.157025+0000","last_active":"2024-08-27T03:58:47.157025+0000","last_peered":"2024-08-27T03:58:47.157025+0000","last_clean":"2024-08-27T03:58:47.157025+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:47.157025+0000","last_undegraded":"2024-08-27T03:58:47.157025+0000","last_fullsized":"2024-08-27T03:58:47.157025+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.156774+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:35.049139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550512,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":6557,"num_write":1048,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'921","reported_seq":2469,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.495835+0000","last_change":"2024-08-27T03:58:48.495835+0000","last_active":"2024-08-27T03:58:48.495835+0000","last_peered":"2024-08-27T03:58:48.495835+0000","last_clean":"2024-08-27T03:58:48.495835+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:58:48.495835+0000","last_undegraded":"2024-08-27T03:58:48.495835+0000","last_fullsized":"2024-08-27T03:58:48.495835+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'921","last_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_deep_scrub":"267'921","last_deep_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.495658+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":900,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:05.944519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'771","reported_seq":2540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.680623+0000","last_change":"2024-08-27T03:58:54.680623+0000","last_active":"2024-08-27T03:58:54.680623+0000","last_peered":"2024-08-27T03:58:54.680623+0000","last_clean":"2024-08-27T03:58:54.680623+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:58:54.680623+0000","last_undegraded":"2024-08-27T03:58:54.680623+0000","last_fullsized":"2024-08-27T03:58:54.680623+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.680350+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:58.085130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2268,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.859587+0000","last_change":"2024-08-27T03:58:47.859587+0000","last_active":"2024-08-27T03:58:47.859587+0000","last_peered":"2024-08-27T03:58:47.859587+0000","last_clean":"2024-08-27T03:58:47.859587+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:47.859587+0000","last_undegraded":"2024-08-27T03:58:47.859587+0000","last_fullsized":"2024-08-27T03:58:47.859587+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.859361+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:30.873158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":9006,"num_write":957,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'790","reported_seq":2426,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.887806+0000","last_change":"2024-08-27T03:58:51.887806+0000","last_active":"2024-08-27T03:58:51.887806+0000","last_peered":"2024-08-27T03:58:51.887806+0000","last_clean":"2024-08-27T03:58:51.887806+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:58:51.887806+0000","last_undegraded":"2024-08-27T03:58:51.887806+0000","last_fullsized":"2024-08-27T03:58:51.887806+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.887607+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:17.606029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'361","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.731951+0000","last_change":"2024-08-27T03:58:44.731951+0000","last_active":"2024-08-27T03:58:44.731951+0000","last_peered":"2024-08-27T03:58:44.731951+0000","last_clean":"2024-08-27T03:58:44.731951+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:44.731951+0000","last_undegraded":"2024-08-27T03:58:44.731951+0000","last_fullsized":"2024-08-27T03:58:44.731951+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.731678+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:19.085584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":653,"num_read_kb":8370,"num_write":1179,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'489","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.815492+0000","last_change":"2024-08-27T03:58:53.815492+0000","last_active":"2024-08-27T03:58:53.815492+0000","last_peered":"2024-08-27T03:58:53.815492+0000","last_clean":"2024-08-27T03:58:53.815492+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:58:53.815492+0000","last_undegraded":"2024-08-27T03:58:53.815492+0000","last_fullsized":"2024-08-27T03:58:53.815492+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'489","last_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_deep_scrub":"267'489","last_deep_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.815307+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:09.901922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'337","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.776413+0000","last_change":"2024-08-27T03:58:41.776413+0000","last_active":"2024-08-27T03:58:41.776413+0000","last_peered":"2024-08-27T03:58:41.776413+0000","last_clean":"2024-08-27T03:58:41.776413+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:41.776413+0000","last_undegraded":"2024-08-27T03:58:41.776413+0000","last_fullsized":"2024-08-27T03:58:41.776413+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.776192+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:09.715672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569152,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":11498,"num_write":1125,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'685","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.544933+0000","last_change":"2024-08-27T03:58:45.544933+0000","last_active":"2024-08-27T03:58:45.544933+0000","last_peered":"2024-08-27T03:58:45.544933+0000","last_clean":"2024-08-27T03:58:45.544933+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:45.544933+0000","last_undegraded":"2024-08-27T03:58:45.544933+0000","last_fullsized":"2024-08-27T03:58:45.544933+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'685","last_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_deep_scrub":"267'685","last_deep_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.544744+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:02.504356+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'369","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.683165+0000","last_change":"2024-08-27T03:58:41.683165+0000","last_active":"2024-08-27T03:58:41.683165+0000","last_peered":"2024-08-27T03:58:41.683165+0000","last_clean":"2024-08-27T03:58:41.683165+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:41.683165+0000","last_undegraded":"2024-08-27T03:58:41.683165+0000","last_fullsized":"2024-08-27T03:58:41.683165+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.682887+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:10:56.014716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":144736,"num_write":1195,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'478","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.516219+0000","last_change":"2024-08-27T03:58:47.516219+0000","last_active":"2024-08-27T03:58:47.516219+0000","last_peered":"2024-08-27T03:58:47.516219+0000","last_clean":"2024-08-27T03:58:47.516219+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:58:47.516219+0000","last_undegraded":"2024-08-27T03:58:47.516219+0000","last_fullsized":"2024-08-27T03:58:47.516219+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.516030+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:54.405917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'335","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.141517+0000","last_change":"2024-08-27T03:58:45.141517+0000","last_active":"2024-08-27T03:58:45.141517+0000","last_peered":"2024-08-27T03:58:45.141517+0000","last_clean":"2024-08-27T03:58:45.141517+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:45.141517+0000","last_undegraded":"2024-08-27T03:58:45.141517+0000","last_fullsized":"2024-08-27T03:58:45.141517+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.141297+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:20.006199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":571,"num_read_kb":47085,"num_write":1065,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'766","reported_seq":2229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.718201+0000","last_change":"2024-08-27T03:58:55.718201+0000","last_active":"2024-08-27T03:58:55.718201+0000","last_peered":"2024-08-27T03:58:55.718201+0000","last_clean":"2024-08-27T03:58:55.718201+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:58:55.718201+0000","last_undegraded":"2024-08-27T03:58:55.718201+0000","last_fullsized":"2024-08-27T03:58:55.718201+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'766","last_scrub_stamp":"2024-08-27T03:58:55.718017+0000","last_deep_scrub":"267'766","last_deep_scrub_stamp":"2024-08-27T03:58:55.718017+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.718017+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:06:22.226590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'335","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.388100+0000","last_change":"2024-08-27T03:58:45.388100+0000","last_active":"2024-08-27T03:58:45.388100+0000","last_peered":"2024-08-27T03:58:45.388100+0000","last_clean":"2024-08-27T03:58:45.388100+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:45.388100+0000","last_undegraded":"2024-08-27T03:58:45.388100+0000","last_fullsized":"2024-08-27T03:58:45.388100+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.387860+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:01.932292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14802,"num_write":998,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'133","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.639980+0000","last_change":"2024-08-27T03:59:12.639980+0000","last_active":"2024-08-27T03:59:12.639980+0000","last_peered":"2024-08-27T03:59:12.639980+0000","last_clean":"2024-08-27T03:59:12.639980+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:59:12.639980+0000","last_undegraded":"2024-08-27T03:59:12.639980+0000","last_fullsized":"2024-08-27T03:59:12.639980+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'133","last_scrub_stamp":"2024-08-27T03:59:12.639781+0000","last_deep_scrub":"267'133","last_deep_scrub_stamp":"2024-08-27T03:59:12.639781+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.639781+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:44:25.359793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'629","reported_seq":2356,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.184869+0000","last_change":"2024-08-27T03:58:50.184869+0000","last_active":"2024-08-27T03:58:50.184869+0000","last_peered":"2024-08-27T03:58:50.184869+0000","last_clean":"2024-08-27T03:58:50.184869+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:50.184869+0000","last_undegraded":"2024-08-27T03:58:50.184869+0000","last_fullsized":"2024-08-27T03:58:50.184869+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'629","last_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_deep_scrub":"267'629","last_deep_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.184685+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:30.419124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4069,"num_omap_keys":16,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'362","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.829663+0000","last_change":"2024-08-27T03:58:48.829663+0000","last_active":"2024-08-27T03:58:48.829663+0000","last_peered":"2024-08-27T03:58:48.829663+0000","last_clean":"2024-08-27T03:58:48.829663+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:48.829663+0000","last_undegraded":"2024-08-27T03:58:48.829663+0000","last_fullsized":"2024-08-27T03:58:48.829663+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.829448+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:32.990578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":48228,"num_write":1146,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.795920+0000","last_change":"2024-08-27T03:58:59.795920+0000","last_active":"2024-08-27T03:58:59.795920+0000","last_peered":"2024-08-27T03:58:59.795920+0000","last_clean":"2024-08-27T03:58:59.795920+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:58:59.795920+0000","last_undegraded":"2024-08-27T03:58:59.795920+0000","last_fullsized":"2024-08-27T03:58:59.795920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.795734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.795734+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.795734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:33:27.557373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'377","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.526382+0000","last_change":"2024-08-27T03:58:58.526382+0000","last_active":"2024-08-27T03:58:58.526382+0000","last_peered":"2024-08-27T03:58:58.526382+0000","last_clean":"2024-08-27T03:58:58.526382+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:58.526382+0000","last_undegraded":"2024-08-27T03:58:58.526382+0000","last_fullsized":"2024-08-27T03:58:58.526382+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-08-27T03:58:58.526170+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-08-27T03:58:58.526170+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.526170+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:48:28.463191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45479,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1191,"num_write":460,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.807411+0000","last_change":"2024-08-27T03:59:07.807411+0000","last_active":"2024-08-27T03:59:07.807411+0000","last_peered":"2024-08-27T03:59:07.807411+0000","last_clean":"2024-08-27T03:59:07.807411+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:59:07.807411+0000","last_undegraded":"2024-08-27T03:59:07.807411+0000","last_fullsized":"2024-08-27T03:59:07.807411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.807225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.807225+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.807225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:34:57.632321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'143","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.966959+0000","last_change":"2024-08-27T03:59:12.966959+0000","last_active":"2024-08-27T03:59:12.966959+0000","last_peered":"2024-08-27T03:59:12.966959+0000","last_clean":"2024-08-27T03:59:12.966959+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:59:12.966959+0000","last_undegraded":"2024-08-27T03:59:12.966959+0000","last_fullsized":"2024-08-27T03:59:12.966959+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'143","last_scrub_stamp":"2024-08-27T03:59:12.966769+0000","last_deep_scrub":"267'143","last_deep_scrub_stamp":"2024-08-27T03:59:12.966769+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.966769+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:04.722562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'818","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.767544+0000","last_change":"2024-08-27T03:58:51.767544+0000","last_active":"2024-08-27T03:58:51.767544+0000","last_peered":"2024-08-27T03:58:51.767544+0000","last_clean":"2024-08-27T03:58:51.767544+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:58:51.767544+0000","last_undegraded":"2024-08-27T03:58:51.767544+0000","last_fullsized":"2024-08-27T03:58:51.767544+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.767367+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:30:16.877533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'315","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.405258+0000","last_change":"2024-08-27T03:58:40.405258+0000","last_active":"2024-08-27T03:58:40.405258+0000","last_peered":"2024-08-27T03:58:40.405258+0000","last_clean":"2024-08-27T03:58:40.405258+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:40.405258+0000","last_undegraded":"2024-08-27T03:58:40.405258+0000","last_fullsized":"2024-08-27T03:58:40.405258+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.404999+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:33:03.889980+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":392,"num_read_kb":13675,"num_write":949,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.306836+0000","last_change":"2024-08-27T03:59:00.306836+0000","last_active":"2024-08-27T03:59:00.306836+0000","last_peered":"2024-08-27T03:59:00.306836+0000","last_clean":"2024-08-27T03:59:00.306836+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:59:00.306836+0000","last_undegraded":"2024-08-27T03:59:00.306836+0000","last_fullsized":"2024-08-27T03:59:00.306836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.306628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.306628+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.306628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:15:18.222713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'122","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.672926+0000","last_change":"2024-08-27T03:59:04.672926+0000","last_active":"2024-08-27T03:59:04.672926+0000","last_peered":"2024-08-27T03:59:04.672926+0000","last_clean":"2024-08-27T03:59:04.672926+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:59:04.672926+0000","last_undegraded":"2024-08-27T03:59:04.672926+0000","last_fullsized":"2024-08-27T03:59:04.672926+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-08-27T03:59:04.672640+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-08-27T03:59:04.672640+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.672640+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:54:10.069916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.628390+0000","last_change":"2024-08-27T03:59:07.628390+0000","last_active":"2024-08-27T03:59:07.628390+0000","last_peered":"2024-08-27T03:59:07.628390+0000","last_clean":"2024-08-27T03:59:07.628390+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:59:07.628390+0000","last_undegraded":"2024-08-27T03:59:07.628390+0000","last_fullsized":"2024-08-27T03:59:07.628390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.628186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.628186+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.628186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:35.325697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'144","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.590569+0000","last_change":"2024-08-27T03:59:13.590569+0000","last_active":"2024-08-27T03:59:13.590569+0000","last_peered":"2024-08-27T03:59:13.590569+0000","last_clean":"2024-08-27T03:59:13.590569+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:59:13.590569+0000","last_undegraded":"2024-08-27T03:59:13.590569+0000","last_fullsized":"2024-08-27T03:59:13.590569+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'144","last_scrub_stamp":"2024-08-27T03:59:13.590366+0000","last_deep_scrub":"267'144","last_deep_scrub_stamp":"2024-08-27T03:59:13.590366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.590366+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:03.170715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.414992+0000","last_change":"2024-08-27T03:58:48.414992+0000","last_active":"2024-08-27T03:58:48.414992+0000","last_peered":"2024-08-27T03:58:48.414992+0000","last_clean":"2024-08-27T03:58:48.414992+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:58:48.414992+0000","last_undegraded":"2024-08-27T03:58:48.414992+0000","last_fullsized":"2024-08-27T03:58:48.414992+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.414803+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:21.445680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'379","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.593093+0000","last_change":"2024-08-27T03:58:37.593093+0000","last_active":"2024-08-27T03:58:37.593093+0000","last_peered":"2024-08-27T03:58:37.593093+0000","last_clean":"2024-08-27T03:58:37.593093+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:37.593093+0000","last_undegraded":"2024-08-27T03:58:37.593093+0000","last_fullsized":"2024-08-27T03:58:37.593093+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.592948+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:31.585133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":34086,"num_write":1252,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"267'4","reported_seq":951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.286362+0000","last_change":"2024-08-27T03:59:01.286362+0000","last_active":"2024-08-27T03:59:01.286362+0000","last_peered":"2024-08-27T03:59:01.286362+0000","last_clean":"2024-08-27T03:59:01.286362+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:59:01.286362+0000","last_undegraded":"2024-08-27T03:59:01.286362+0000","last_fullsized":"2024-08-27T03:59:01.286362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:01.286155+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:01.286155+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.286155+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:57:27.108308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'161","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.578673+0000","last_change":"2024-08-27T03:58:56.578673+0000","last_active":"2024-08-27T03:58:56.578673+0000","last_peered":"2024-08-27T03:58:56.578673+0000","last_clean":"2024-08-27T03:58:56.578673+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:58:56.578673+0000","last_undegraded":"2024-08-27T03:58:56.578673+0000","last_fullsized":"2024-08-27T03:58:56.578673+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-08-27T03:58:56.578466+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-08-27T03:58:56.578466+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.578466+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:29:51.165504+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'699","reported_seq":2545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.829790+0000","last_change":"2024-08-27T03:59:06.829790+0000","last_active":"2024-08-27T03:59:06.829790+0000","last_peered":"2024-08-27T03:59:06.829790+0000","last_clean":"2024-08-27T03:59:06.829790+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:59:06.829790+0000","last_undegraded":"2024-08-27T03:59:06.829790+0000","last_fullsized":"2024-08-27T03:59:06.829790+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'699","last_scrub_stamp":"2024-08-27T03:59:06.829502+0000","last_deep_scrub":"267'699","last_deep_scrub_stamp":"2024-08-27T03:59:06.829502+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.829502+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":601,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:50:43.865968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'182","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.638342+0000","last_change":"2024-08-27T03:59:25.638342+0000","last_active":"2024-08-27T03:59:25.638342+0000","last_peered":"2024-08-27T03:59:25.638342+0000","last_clean":"2024-08-27T03:59:25.638342+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:59:25.638342+0000","last_undegraded":"2024-08-27T03:59:25.638342+0000","last_fullsized":"2024-08-27T03:59:25.638342+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'182","last_scrub_stamp":"2024-08-27T03:59:25.638115+0000","last_deep_scrub":"267'182","last_deep_scrub_stamp":"2024-08-27T03:59:25.638115+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.638115+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:38:48.349445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'586","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.205600+0000","last_change":"2024-08-27T03:58:52.205600+0000","last_active":"2024-08-27T03:58:52.205600+0000","last_peered":"2024-08-27T03:58:52.205600+0000","last_clean":"2024-08-27T03:58:52.205600+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:58:52.205600+0000","last_undegraded":"2024-08-27T03:58:52.205600+0000","last_fullsized":"2024-08-27T03:58:52.205600+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'586","last_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_deep_scrub":"267'586","last_deep_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.205406+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:50:44.375635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'340","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.757370+0000","last_change":"2024-08-27T03:58:43.757370+0000","last_active":"2024-08-27T03:58:43.757370+0000","last_peered":"2024-08-27T03:58:43.757370+0000","last_clean":"2024-08-27T03:58:43.757370+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:43.757370+0000","last_undegraded":"2024-08-27T03:58:43.757370+0000","last_fullsized":"2024-08-27T03:58:43.757370+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.757154+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:26.623631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":443,"num_read_kb":7480,"num_write":1117,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.813487+0000","last_change":"2024-08-27T03:59:00.813487+0000","last_active":"2024-08-27T03:59:00.813487+0000","last_peered":"2024-08-27T03:59:00.813487+0000","last_clean":"2024-08-27T03:59:00.813487+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:59:00.813487+0000","last_undegraded":"2024-08-27T03:59:00.813487+0000","last_fullsized":"2024-08-27T03:59:00.813487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.813232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.813232+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.813232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:02:51.715518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'295","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.933820+0000","last_change":"2024-08-27T03:59:01.933820+0000","last_active":"2024-08-27T03:59:01.933820+0000","last_peered":"2024-08-27T03:59:01.933820+0000","last_clean":"2024-08-27T03:59:01.933820+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:59:01.933820+0000","last_undegraded":"2024-08-27T03:59:01.933820+0000","last_fullsized":"2024-08-27T03:59:01.933820+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-08-27T03:59:01.933556+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-08-27T03:59:01.933556+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.933556+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:29:06.683563+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'732","reported_seq":2841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.442211+0000","last_change":"2024-08-27T03:59:13.442211+0000","last_active":"2024-08-27T03:59:13.442211+0000","last_peered":"2024-08-27T03:59:13.442211+0000","last_clean":"2024-08-27T03:59:13.442211+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:59:13.442211+0000","last_undegraded":"2024-08-27T03:59:13.442211+0000","last_fullsized":"2024-08-27T03:59:13.442211+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'732","last_scrub_stamp":"2024-08-27T03:59:13.442031+0000","last_deep_scrub":"267'732","last_deep_scrub_stamp":"2024-08-27T03:59:13.442031+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.442031+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:04.125170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1269","reported_seq":2839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.726782+0000","last_change":"2024-08-27T03:58:50.726782+0000","last_active":"2024-08-27T03:58:50.726782+0000","last_peered":"2024-08-27T03:58:50.726782+0000","last_clean":"2024-08-27T03:58:50.726782+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:58:50.726782+0000","last_undegraded":"2024-08-27T03:58:50.726782+0000","last_fullsized":"2024-08-27T03:58:50.726782+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1269","last_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_deep_scrub":"267'1269","last_deep_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.726573+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":1200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:40:04.847159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'352","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.902356+0000","last_change":"2024-08-27T03:58:43.902156+0000","last_active":"2024-08-27T03:58:43.902356+0000","last_peered":"2024-08-27T03:58:43.902356+0000","last_clean":"2024-08-27T03:58:43.902356+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:43.902356+0000","last_undegraded":"2024-08-27T03:58:43.902356+0000","last_fullsized":"2024-08-27T03:58:43.902356+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.901882+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:44.473839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":34000,"num_write":1087,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.909819+0000","last_change":"2024-08-27T03:58:55.909819+0000","last_active":"2024-08-27T03:58:55.909819+0000","last_peered":"2024-08-27T03:58:55.909819+0000","last_clean":"2024-08-27T03:58:55.909819+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:58:55.909819+0000","last_undegraded":"2024-08-27T03:58:55.909819+0000","last_fullsized":"2024-08-27T03:58:55.909819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:55.909634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:55.909634+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.909634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:36:23.804649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'409","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.812240+0000","last_change":"2024-08-27T03:59:04.812240+0000","last_active":"2024-08-27T03:59:04.812240+0000","last_peered":"2024-08-27T03:59:04.812240+0000","last_clean":"2024-08-27T03:59:04.812240+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:59:04.812240+0000","last_undegraded":"2024-08-27T03:59:04.812240+0000","last_fullsized":"2024-08-27T03:59:04.812240+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-08-27T03:59:04.812027+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-08-27T03:59:04.812027+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.812027+0000","objects_scrubbed":10,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:19:17.728321+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44175,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":1186,"num_write":474,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.166416+0000","last_change":"2024-08-27T03:59:05.166416+0000","last_active":"2024-08-27T03:59:05.166416+0000","last_peered":"2024-08-27T03:59:05.166416+0000","last_clean":"2024-08-27T03:59:05.166416+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:59:05.166416+0000","last_undegraded":"2024-08-27T03:59:05.166416+0000","last_fullsized":"2024-08-27T03:59:05.166416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.166222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.166222+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.166222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:08.593273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'591","reported_seq":1440,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.991865+0000","last_change":"2024-08-27T03:59:13.991865+0000","last_active":"2024-08-27T03:59:13.991865+0000","last_peered":"2024-08-27T03:59:13.991865+0000","last_clean":"2024-08-27T03:59:13.991865+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:59:13.991865+0000","last_undegraded":"2024-08-27T03:59:13.991865+0000","last_fullsized":"2024-08-27T03:59:13.991865+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'591","last_scrub_stamp":"2024-08-27T03:59:13.991679+0000","last_deep_scrub":"267'591","last_deep_scrub_stamp":"2024-08-27T03:59:13.991679+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.991679+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:34.432969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1459","reported_seq":2962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.678164+0000","last_change":"2024-08-27T03:58:50.678164+0000","last_active":"2024-08-27T03:58:50.678164+0000","last_peered":"2024-08-27T03:58:50.678164+0000","last_clean":"2024-08-27T03:58:50.678164+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:58:50.678164+0000","last_undegraded":"2024-08-27T03:58:50.678164+0000","last_fullsized":"2024-08-27T03:58:50.678164+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1459","last_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_deep_scrub":"267'1459","last_deep_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.677969+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:05:44.968990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'373","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.897914+0000","last_change":"2024-08-27T03:58:40.897763+0000","last_active":"2024-08-27T03:58:40.897914+0000","last_peered":"2024-08-27T03:58:40.897914+0000","last_clean":"2024-08-27T03:58:40.897914+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:40.897914+0000","last_undegraded":"2024-08-27T03:58:40.897914+0000","last_fullsized":"2024-08-27T03:58:40.897914+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.897535+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:28:11.789719+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400081,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":644,"num_read_kb":2850,"num_write":1271,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.446962+0000","last_change":"2024-08-27T03:58:50.446962+0000","last_active":"2024-08-27T03:58:50.446962+0000","last_peered":"2024-08-27T03:58:50.446962+0000","last_clean":"2024-08-27T03:58:50.446962+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:58:50.446962+0000","last_undegraded":"2024-08-27T03:58:50.446962+0000","last_fullsized":"2024-08-27T03:58:50.446962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.446779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:37.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'312","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.356278+0000","last_change":"2024-08-27T03:59:03.356278+0000","last_active":"2024-08-27T03:59:03.356278+0000","last_peered":"2024-08-27T03:59:03.356278+0000","last_clean":"2024-08-27T03:59:03.356278+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:59:03.356278+0000","last_undegraded":"2024-08-27T03:59:03.356278+0000","last_fullsized":"2024-08-27T03:59:03.356278+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-08-27T03:59:03.356083+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-08-27T03:59:03.356083+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.356083+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:28:02.032416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.452725+0000","last_change":"2024-08-27T03:59:11.452725+0000","last_active":"2024-08-27T03:59:11.452725+0000","last_peered":"2024-08-27T03:59:11.452725+0000","last_clean":"2024-08-27T03:59:11.452725+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:59:11.452725+0000","last_undegraded":"2024-08-27T03:59:11.452725+0000","last_fullsized":"2024-08-27T03:59:11.452725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:11.452489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:11.452489+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.452489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:53:42.936078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2397","reported_seq":4240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.612748+0000","last_change":"2024-08-27T03:58:59.612748+0000","last_active":"2024-08-27T03:58:59.612748+0000","last_peered":"2024-08-27T03:58:59.612748+0000","last_clean":"2024-08-27T03:58:59.612748+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:58:59.612748+0000","last_undegraded":"2024-08-27T03:58:59.612748+0000","last_fullsized":"2024-08-27T03:58:59.612748+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2397","last_scrub_stamp":"2024-08-27T03:58:59.612560+0000","last_deep_scrub":"267'2397","last_deep_scrub_stamp":"2024-08-27T03:58:59.612560+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.612560+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":2300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:19:39.008794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'442","reported_seq":1947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.728545+0000","last_change":"2024-08-27T03:58:46.728545+0000","last_active":"2024-08-27T03:58:46.728545+0000","last_peered":"2024-08-27T03:58:46.728545+0000","last_clean":"2024-08-27T03:58:46.728545+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:58:46.728545+0000","last_undegraded":"2024-08-27T03:58:46.728545+0000","last_fullsized":"2024-08-27T03:58:46.728545+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.728340+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:06.435241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'337","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.909461+0000","last_change":"2024-08-27T03:58:42.909307+0000","last_active":"2024-08-27T03:58:42.909461+0000","last_peered":"2024-08-27T03:58:42.909461+0000","last_clean":"2024-08-27T03:58:42.909461+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:42.909461+0000","last_undegraded":"2024-08-27T03:58:42.909461+0000","last_fullsized":"2024-08-27T03:58:42.909461+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.909045+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:53.647196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1998258,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":51263,"num_write":1130,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.501182+0000","last_change":"2024-08-27T03:58:52.501054+0000","last_active":"2024-08-27T03:58:52.501182+0000","last_peered":"2024-08-27T03:58:52.501182+0000","last_clean":"2024-08-27T03:58:52.501182+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:58:52.501182+0000","last_undegraded":"2024-08-27T03:58:52.501182+0000","last_fullsized":"2024-08-27T03:58:52.501182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.500871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:38.128581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'369","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.919018+0000","last_change":"2024-08-27T03:59:00.919018+0000","last_active":"2024-08-27T03:59:00.919018+0000","last_peered":"2024-08-27T03:59:00.919018+0000","last_clean":"2024-08-27T03:59:00.919018+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:59:00.919018+0000","last_undegraded":"2024-08-27T03:59:00.919018+0000","last_fullsized":"2024-08-27T03:59:00.919018+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-08-27T03:59:00.918768+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-08-27T03:59:00.918768+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.918768+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:41:01.877708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":1205,"num_write":456,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'721","reported_seq":4960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.429142+0000","last_change":"2024-08-27T03:59:03.429142+0000","last_active":"2024-08-27T03:59:03.429142+0000","last_peered":"2024-08-27T03:59:03.429142+0000","last_clean":"2024-08-27T03:59:03.429142+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:59:03.429142+0000","last_undegraded":"2024-08-27T03:59:03.429142+0000","last_fullsized":"2024-08-27T03:59:03.429142+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'721","last_scrub_stamp":"2024-08-27T03:59:03.428951+0000","last_deep_scrub":"267'721","last_deep_scrub_stamp":"2024-08-27T03:59:03.428951+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.428951+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:09.865002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'173","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.593053+0000","last_change":"2024-08-27T03:59:10.593053+0000","last_active":"2024-08-27T03:59:10.593053+0000","last_peered":"2024-08-27T03:59:10.593053+0000","last_clean":"2024-08-27T03:59:10.593053+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:59:10.593053+0000","last_undegraded":"2024-08-27T03:59:10.593053+0000","last_fullsized":"2024-08-27T03:59:10.593053+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-08-27T03:59:10.592870+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-08-27T03:59:10.592870+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.592870+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:15.224143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'799","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.365595+0000","last_change":"2024-08-27T03:58:46.365457+0000","last_active":"2024-08-27T03:58:46.365595+0000","last_peered":"2024-08-27T03:58:46.365595+0000","last_clean":"2024-08-27T03:58:46.365595+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:46.365595+0000","last_undegraded":"2024-08-27T03:58:46.365595+0000","last_fullsized":"2024-08-27T03:58:46.365595+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'799","last_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_deep_scrub":"267'799","last_deep_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.365257+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:38.841374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'306","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.677763+0000","last_change":"2024-08-27T03:58:40.677586+0000","last_active":"2024-08-27T03:58:40.677763+0000","last_peered":"2024-08-27T03:58:40.677763+0000","last_clean":"2024-08-27T03:58:40.677763+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:40.677763+0000","last_undegraded":"2024-08-27T03:58:40.677763+0000","last_fullsized":"2024-08-27T03:58:40.677763+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.677362+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:13:35.785593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437736,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":7344,"num_write":963,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.471473+0000","last_change":"2024-08-27T03:58:51.471473+0000","last_active":"2024-08-27T03:58:51.471473+0000","last_peered":"2024-08-27T03:58:51.471473+0000","last_clean":"2024-08-27T03:58:51.471473+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:58:51.471473+0000","last_undegraded":"2024-08-27T03:58:51.471473+0000","last_fullsized":"2024-08-27T03:58:51.471473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.471186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:37:00.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'502","reported_seq":1187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.558075+0000","last_change":"2024-08-27T03:59:00.558075+0000","last_active":"2024-08-27T03:59:00.558075+0000","last_peered":"2024-08-27T03:59:00.558075+0000","last_clean":"2024-08-27T03:59:00.558075+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:59:00.558075+0000","last_undegraded":"2024-08-27T03:59:00.558075+0000","last_fullsized":"2024-08-27T03:59:00.558075+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'502","last_scrub_stamp":"2024-08-27T03:59:00.557849+0000","last_deep_scrub":"267'502","last_deep_scrub_stamp":"2024-08-27T03:59:00.557849+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.557849+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:16.615000+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73530,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2086,"num_write":702,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.619192+0000","last_change":"2024-08-27T03:58:59.619192+0000","last_active":"2024-08-27T03:58:59.619192+0000","last_peered":"2024-08-27T03:58:59.619192+0000","last_clean":"2024-08-27T03:58:59.619192+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:58:59.619192+0000","last_undegraded":"2024-08-27T03:58:59.619192+0000","last_fullsized":"2024-08-27T03:58:59.619192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.619006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.619006+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.619006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:28:08.565324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'131","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.087976+0000","last_change":"2024-08-27T03:59:00.087976+0000","last_active":"2024-08-27T03:59:00.087976+0000","last_peered":"2024-08-27T03:59:00.087976+0000","last_clean":"2024-08-27T03:59:00.087976+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:59:00.087976+0000","last_undegraded":"2024-08-27T03:59:00.087976+0000","last_fullsized":"2024-08-27T03:59:00.087976+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-08-27T03:59:00.087746+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-08-27T03:59:00.087746+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.087746+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:20.853635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'444","reported_seq":1982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.708558+0000","last_change":"2024-08-27T03:58:43.708403+0000","last_active":"2024-08-27T03:58:43.708558+0000","last_peered":"2024-08-27T03:58:43.708558+0000","last_clean":"2024-08-27T03:58:43.708558+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:58:43.708558+0000","last_undegraded":"2024-08-27T03:58:43.708558+0000","last_fullsized":"2024-08-27T03:58:43.708558+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.708210+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:51:30.618879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'311","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.180394+0000","last_change":"2024-08-27T03:58:42.180228+0000","last_active":"2024-08-27T03:58:42.180394+0000","last_peered":"2024-08-27T03:58:42.180394+0000","last_clean":"2024-08-27T03:58:42.180394+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:42.180394+0000","last_undegraded":"2024-08-27T03:58:42.180394+0000","last_fullsized":"2024-08-27T03:58:42.180394+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.179951+0000","objects_scrubbed":12,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:16.625194+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490466,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":3133,"num_write":1058,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.542454+0000","last_change":"2024-08-27T03:58:53.542226+0000","last_active":"2024-08-27T03:58:53.542454+0000","last_peered":"2024-08-27T03:58:53.542454+0000","last_clean":"2024-08-27T03:58:53.542454+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:58:53.542454+0000","last_undegraded":"2024-08-27T03:58:53.542454+0000","last_fullsized":"2024-08-27T03:58:53.542454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.541954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:03.310498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'324","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.695103+0000","last_change":"2024-08-27T03:59:03.695103+0000","last_active":"2024-08-27T03:59:03.695103+0000","last_peered":"2024-08-27T03:59:03.695103+0000","last_clean":"2024-08-27T03:59:03.695103+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:59:03.695103+0000","last_undegraded":"2024-08-27T03:59:03.695103+0000","last_fullsized":"2024-08-27T03:59:03.695103+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-08-27T03:59:03.694903+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-08-27T03:59:03.694903+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.694903+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:37:33.840824+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.508966+0000","last_change":"2024-08-27T03:59:05.508803+0000","last_active":"2024-08-27T03:59:05.508966+0000","last_peered":"2024-08-27T03:59:05.508966+0000","last_clean":"2024-08-27T03:59:05.508966+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:59:05.508966+0000","last_undegraded":"2024-08-27T03:59:05.508966+0000","last_fullsized":"2024-08-27T03:59:05.508966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.508630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.508630+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.508630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:46:36.101798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'126","reported_seq":652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.448587+0000","last_change":"2024-08-27T03:59:14.448587+0000","last_active":"2024-08-27T03:59:14.448587+0000","last_peered":"2024-08-27T03:59:14.448587+0000","last_clean":"2024-08-27T03:59:14.448587+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:59:14.448587+0000","last_undegraded":"2024-08-27T03:59:14.448587+0000","last_fullsized":"2024-08-27T03:59:14.448587+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-08-27T03:59:14.448374+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-08-27T03:59:14.448374+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.448374+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:19:46.371369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'306","reported_seq":1707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.720598+0000","last_change":"2024-08-27T03:58:45.720430+0000","last_active":"2024-08-27T03:58:45.720598+0000","last_peered":"2024-08-27T03:58:45.720598+0000","last_clean":"2024-08-27T03:58:45.720598+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:58:45.720598+0000","last_undegraded":"2024-08-27T03:58:45.720598+0000","last_fullsized":"2024-08-27T03:58:45.720598+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.720239+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:13:56.970539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1145,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'321","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.795951+0000","last_change":"2024-08-27T03:58:39.795951+0000","last_active":"2024-08-27T03:58:39.795951+0000","last_peered":"2024-08-27T03:58:39.795951+0000","last_clean":"2024-08-27T03:58:39.795951+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:39.795951+0000","last_undegraded":"2024-08-27T03:58:39.795951+0000","last_fullsized":"2024-08-27T03:58:39.795951+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.795741+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:23.816179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":447,"num_read_kb":5526,"num_write":1006,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.988502+0000","last_change":"2024-08-27T03:58:52.988368+0000","last_active":"2024-08-27T03:58:52.988502+0000","last_peered":"2024-08-27T03:58:52.988502+0000","last_clean":"2024-08-27T03:58:52.988502+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:58:52.988502+0000","last_undegraded":"2024-08-27T03:58:52.988502+0000","last_fullsized":"2024-08-27T03:58:52.988502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.988149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:55.540473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'383","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.561586+0000","last_change":"2024-08-27T03:58:54.561448+0000","last_active":"2024-08-27T03:58:54.561586+0000","last_peered":"2024-08-27T03:58:54.561586+0000","last_clean":"2024-08-27T03:58:54.561586+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:54.561586+0000","last_undegraded":"2024-08-27T03:58:54.561586+0000","last_fullsized":"2024-08-27T03:58:54.561586+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.561237+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:34.180367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'671","reported_seq":2569,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.564764+0000","last_change":"2024-08-27T03:58:55.564627+0000","last_active":"2024-08-27T03:58:55.564764+0000","last_peered":"2024-08-27T03:58:55.564764+0000","last_clean":"2024-08-27T03:58:55.564764+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:55.564764+0000","last_undegraded":"2024-08-27T03:58:55.564764+0000","last_fullsized":"2024-08-27T03:58:55.564764+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'671","last_scrub_stamp":"2024-08-27T03:58:55.564443+0000","last_deep_scrub":"267'671","last_deep_scrub_stamp":"2024-08-27T03:58:55.564443+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.564443+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:46.587213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'100","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.085509+0000","last_change":"2024-08-27T03:59:01.085509+0000","last_active":"2024-08-27T03:59:01.085509+0000","last_peered":"2024-08-27T03:59:01.085509+0000","last_clean":"2024-08-27T03:59:01.085509+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:59:01.085509+0000","last_undegraded":"2024-08-27T03:59:01.085509+0000","last_fullsized":"2024-08-27T03:59:01.085509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-08-27T03:59:01.085321+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-08-27T03:59:01.085321+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.085321+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:20:16.069103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'839","reported_seq":2594,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.683482+0000","last_change":"2024-08-27T03:58:44.683311+0000","last_active":"2024-08-27T03:58:44.683482+0000","last_peered":"2024-08-27T03:58:44.683482+0000","last_clean":"2024-08-27T03:58:44.683482+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:58:44.683482+0000","last_undegraded":"2024-08-27T03:58:44.683482+0000","last_fullsized":"2024-08-27T03:58:44.683482+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.683090+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:40:01.412803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'328","reported_seq":1142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.709167+0000","last_change":"2024-08-27T03:58:37.709167+0000","last_active":"2024-08-27T03:58:37.709167+0000","last_peered":"2024-08-27T03:58:37.709167+0000","last_clean":"2024-08-27T03:58:37.709167+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:37.709167+0000","last_undegraded":"2024-08-27T03:58:37.709167+0000","last_fullsized":"2024-08-27T03:58:37.709167+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.708679+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:51:40.565196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185741,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":802,"num_read_kb":112858,"num_write":1079,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1376,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.836591+0000","last_change":"2024-08-27T03:58:58.836398+0000","last_active":"2024-08-27T03:58:58.836591+0000","last_peered":"2024-08-27T03:58:58.836591+0000","last_clean":"2024-08-27T03:58:58.836591+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:58.836591+0000","last_undegraded":"2024-08-27T03:58:58.836591+0000","last_fullsized":"2024-08-27T03:58:58.836591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:58:58.836197+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:58:58.836197+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.836197+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:38:25.191657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'122","reported_seq":690,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.320351+0000","last_change":"2024-08-27T03:59:04.320351+0000","last_active":"2024-08-27T03:59:04.320351+0000","last_peered":"2024-08-27T03:59:04.320351+0000","last_clean":"2024-08-27T03:59:04.320351+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:59:04.320351+0000","last_undegraded":"2024-08-27T03:59:04.320351+0000","last_fullsized":"2024-08-27T03:59:04.320351+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-08-27T03:59:04.320135+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-08-27T03:59:04.320135+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.320135+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:13:37.596149+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'692","reported_seq":3073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.628587+0000","last_change":"2024-08-27T03:58:55.628230+0000","last_active":"2024-08-27T03:58:55.628587+0000","last_peered":"2024-08-27T03:58:55.628587+0000","last_clean":"2024-08-27T03:58:55.628587+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:55.628587+0000","last_undegraded":"2024-08-27T03:58:55.628587+0000","last_fullsized":"2024-08-27T03:58:55.628587+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'692","last_scrub_stamp":"2024-08-27T03:58:55.627775+0000","last_deep_scrub":"267'692","last_deep_scrub_stamp":"2024-08-27T03:58:55.627775+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.627775+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:12:31.378425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'123","reported_seq":655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.649346+0000","last_change":"2024-08-27T03:59:11.649346+0000","last_active":"2024-08-27T03:59:11.649346+0000","last_peered":"2024-08-27T03:59:11.649346+0000","last_clean":"2024-08-27T03:59:11.649346+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:59:11.649346+0000","last_undegraded":"2024-08-27T03:59:11.649346+0000","last_fullsized":"2024-08-27T03:59:11.649346+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-08-27T03:59:11.649161+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-08-27T03:59:11.649161+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.649161+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:40.377878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.209300+0000","last_change":"2024-08-27T03:58:45.209172+0000","last_active":"2024-08-27T03:58:45.209300+0000","last_peered":"2024-08-27T03:58:45.209300+0000","last_clean":"2024-08-27T03:58:45.209300+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:58:45.209300+0000","last_undegraded":"2024-08-27T03:58:45.209300+0000","last_fullsized":"2024-08-27T03:58:45.209300+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'786","last_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_deep_scrub":"267'786","last_deep_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.208970+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:19.947547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'384","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.079881+0000","last_change":"2024-08-27T03:58:39.079881+0000","last_active":"2024-08-27T03:58:39.079881+0000","last_peered":"2024-08-27T03:58:39.079881+0000","last_clean":"2024-08-27T03:58:39.079881+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:39.079881+0000","last_undegraded":"2024-08-27T03:58:39.079881+0000","last_fullsized":"2024-08-27T03:58:39.079881+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.079659+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:55:08.844282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":741,"num_read_kb":1678,"num_write":1218,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.671459+0000","last_change":"2024-08-27T03:58:59.671459+0000","last_active":"2024-08-27T03:58:59.671459+0000","last_peered":"2024-08-27T03:58:59.671459+0000","last_clean":"2024-08-27T03:58:59.671459+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:58:59.671459+0000","last_undegraded":"2024-08-27T03:58:59.671459+0000","last_fullsized":"2024-08-27T03:58:59.671459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.671283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.671283+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.671283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:23.974901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'410","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.806276+0000","last_change":"2024-08-27T03:59:03.806276+0000","last_active":"2024-08-27T03:59:03.806276+0000","last_peered":"2024-08-27T03:59:03.806276+0000","last_clean":"2024-08-27T03:59:03.806276+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:59:03.806276+0000","last_undegraded":"2024-08-27T03:59:03.806276+0000","last_fullsized":"2024-08-27T03:59:03.806276+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:59:03.806081+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:59:03.806081+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.806081+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:23:15.635294+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46460,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":1211,"num_write":486,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.634370+0000","last_change":"2024-08-27T03:58:54.634237+0000","last_active":"2024-08-27T03:58:54.634370+0000","last_peered":"2024-08-27T03:58:54.634370+0000","last_clean":"2024-08-27T03:58:54.634370+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:58:54.634370+0000","last_undegraded":"2024-08-27T03:58:54.634370+0000","last_fullsized":"2024-08-27T03:58:54.634370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.634062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:29:28.972507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'231","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.167795+0000","last_change":"2024-08-27T03:59:06.167795+0000","last_active":"2024-08-27T03:59:06.167795+0000","last_peered":"2024-08-27T03:59:06.167795+0000","last_clean":"2024-08-27T03:59:06.167795+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:59:06.167795+0000","last_undegraded":"2024-08-27T03:59:06.167795+0000","last_fullsized":"2024-08-27T03:59:06.167795+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-08-27T03:59:06.167567+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-08-27T03:59:06.167567+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.167567+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:11:12.479825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'527","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.697377+0000","last_change":"2024-08-27T03:58:45.697240+0000","last_active":"2024-08-27T03:58:45.697377+0000","last_peered":"2024-08-27T03:58:45.697377+0000","last_clean":"2024-08-27T03:58:45.697377+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:45.697377+0000","last_undegraded":"2024-08-27T03:58:45.697377+0000","last_fullsized":"2024-08-27T03:58:45.697377+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'527","last_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_deep_scrub":"267'527","last_deep_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.697061+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:09:58.090847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.931420+0000","last_change":"2024-08-27T03:58:39.931282+0000","last_active":"2024-08-27T03:58:39.931420+0000","last_peered":"2024-08-27T03:58:39.931420+0000","last_clean":"2024-08-27T03:58:39.931420+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:58:39.931420+0000","last_undegraded":"2024-08-27T03:58:39.931420+0000","last_fullsized":"2024-08-27T03:58:39.931420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.931095+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:05.232163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.617117+0000","last_change":"2024-08-27T03:58:38.617117+0000","last_active":"2024-08-27T03:58:38.617117+0000","last_peered":"2024-08-27T03:58:38.617117+0000","last_clean":"2024-08-27T03:58:38.617117+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:58:38.617117+0000","last_undegraded":"2024-08-27T03:58:38.617117+0000","last_fullsized":"2024-08-27T03:58:38.617117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.616933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:18:37.622258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'304","reported_seq":1178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.092930+0000","last_change":"2024-08-27T03:58:37.092930+0000","last_active":"2024-08-27T03:58:37.092930+0000","last_peered":"2024-08-27T03:58:37.092930+0000","last_clean":"2024-08-27T03:58:37.092930+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:37.092930+0000","last_undegraded":"2024-08-27T03:58:37.092930+0000","last_fullsized":"2024-08-27T03:58:37.092930+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'304","last_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_deep_scrub":"267'304","last_deep_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.092840+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:11:02.137368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":118351,"num_write":1022,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.906076+0000","last_change":"2024-08-27T03:58:53.906076+0000","last_active":"2024-08-27T03:58:53.906076+0000","last_peered":"2024-08-27T03:58:53.906076+0000","last_clean":"2024-08-27T03:58:53.906076+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:58:53.906076+0000","last_undegraded":"2024-08-27T03:58:53.906076+0000","last_fullsized":"2024-08-27T03:58:53.906076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.905892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:27:49.003970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'740","reported_seq":1490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.822717+0000","last_change":"2024-08-27T03:59:02.822717+0000","last_active":"2024-08-27T03:59:02.822717+0000","last_peered":"2024-08-27T03:59:02.822717+0000","last_clean":"2024-08-27T03:59:02.822717+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:59:02.822717+0000","last_undegraded":"2024-08-27T03:59:02.822717+0000","last_fullsized":"2024-08-27T03:59:02.822717+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'740","last_scrub_stamp":"2024-08-27T03:59:02.822503+0000","last_deep_scrub":"267'740","last_deep_scrub_stamp":"2024-08-27T03:59:02.822503+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.822503+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:50:40.430031+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136746,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1442,"num_read_kb":3290,"num_write":1350,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89174,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.503009+0000","last_change":"2024-08-27T03:59:01.503009+0000","last_active":"2024-08-27T03:59:01.503009+0000","last_peered":"2024-08-27T03:59:01.503009+0000","last_clean":"2024-08-27T03:59:01.503009+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:59:01.503009+0000","last_undegraded":"2024-08-27T03:59:01.503009+0000","last_fullsized":"2024-08-27T03:59:01.503009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.502832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.502832+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.502832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:42:04.484327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'209","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.607407+0000","last_change":"2024-08-27T03:59:00.607407+0000","last_active":"2024-08-27T03:59:00.607407+0000","last_peered":"2024-08-27T03:59:00.607407+0000","last_clean":"2024-08-27T03:59:00.607407+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:59:00.607407+0000","last_undegraded":"2024-08-27T03:59:00.607407+0000","last_fullsized":"2024-08-27T03:59:00.607407+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'209","last_scrub_stamp":"2024-08-27T03:59:00.607219+0000","last_deep_scrub":"267'209","last_deep_scrub_stamp":"2024-08-27T03:59:00.607219+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.607219+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:29:47.730006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1519","reported_seq":3083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.414552+0000","last_change":"2024-08-27T03:58:47.414552+0000","last_active":"2024-08-27T03:58:47.414552+0000","last_peered":"2024-08-27T03:58:47.414552+0000","last_clean":"2024-08-27T03:58:47.414552+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:58:47.414552+0000","last_undegraded":"2024-08-27T03:58:47.414552+0000","last_fullsized":"2024-08-27T03:58:47.414552+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1519","last_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_deep_scrub":"267'1519","last_deep_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.414375+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":1500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:57.554800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.858129+0000","last_change":"2024-08-27T03:58:41.857903+0000","last_active":"2024-08-27T03:58:41.858129+0000","last_peered":"2024-08-27T03:58:41.858129+0000","last_clean":"2024-08-27T03:58:41.858129+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:58:41.858129+0000","last_undegraded":"2024-08-27T03:58:41.858129+0000","last_fullsized":"2024-08-27T03:58:41.858129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.857697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:28:49.679382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'389","reported_seq":1157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.456247+0000","last_change":"2024-08-27T03:58:39.456247+0000","last_active":"2024-08-27T03:58:39.456247+0000","last_peered":"2024-08-27T03:58:39.456247+0000","last_clean":"2024-08-27T03:58:39.456247+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:39.456247+0000","last_undegraded":"2024-08-27T03:58:39.456247+0000","last_fullsized":"2024-08-27T03:58:39.456247+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.455922+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:28:43.685014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458876,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":824,"num_read_kb":13511,"num_write":1117,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"267'6","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.884625+0000","last_change":"2024-08-27T03:58:57.884625+0000","last_active":"2024-08-27T03:58:57.884625+0000","last_peered":"2024-08-27T03:58:57.884625+0000","last_clean":"2024-08-27T03:58:57.884625+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:57.884625+0000","last_undegraded":"2024-08-27T03:58:57.884625+0000","last_fullsized":"2024-08-27T03:58:57.884625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:58:57.884430+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:58:57.884430+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.884430+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:46:28.135856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1347","reported_seq":3342,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.104908+0000","last_change":"2024-08-27T03:58:57.104908+0000","last_active":"2024-08-27T03:58:57.104908+0000","last_peered":"2024-08-27T03:58:57.104908+0000","last_clean":"2024-08-27T03:58:57.104908+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:57.104908+0000","last_undegraded":"2024-08-27T03:58:57.104908+0000","last_fullsized":"2024-08-27T03:58:57.104908+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1347","last_scrub_stamp":"2024-08-27T03:58:57.104692+0000","last_deep_scrub":"267'1347","last_deep_scrub_stamp":"2024-08-27T03:58:57.104692+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.104692+0000","objects_scrubbed":12,"log_size":47,"log_dups_size":1300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:35:19.289204+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137506,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2076,"num_read_kb":3979,"num_write":1262,"num_write_kb":1030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.893194+0000","last_change":"2024-08-27T03:59:03.893040+0000","last_active":"2024-08-27T03:59:03.893194+0000","last_peered":"2024-08-27T03:59:03.893194+0000","last_clean":"2024-08-27T03:59:03.893194+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:59:03.893194+0000","last_undegraded":"2024-08-27T03:59:03.893194+0000","last_fullsized":"2024-08-27T03:59:03.893194+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:03.892863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:03.892863+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.892863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:19.756166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'166","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.094133+0000","last_change":"2024-08-27T03:59:02.094133+0000","last_active":"2024-08-27T03:59:02.094133+0000","last_peered":"2024-08-27T03:59:02.094133+0000","last_clean":"2024-08-27T03:59:02.094133+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:59:02.094133+0000","last_undegraded":"2024-08-27T03:59:02.094133+0000","last_fullsized":"2024-08-27T03:59:02.094133+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:02.093895+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:02.093895+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.093895+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:38:46.246473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.587280+0000","last_change":"2024-08-27T03:58:43.587280+0000","last_active":"2024-08-27T03:58:43.587280+0000","last_peered":"2024-08-27T03:58:43.587280+0000","last_clean":"2024-08-27T03:58:43.587280+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:58:43.587280+0000","last_undegraded":"2024-08-27T03:58:43.587280+0000","last_fullsized":"2024-08-27T03:58:43.587280+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.587095+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:03.769401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.604535+0000","last_change":"2024-08-27T03:58:36.604535+0000","last_active":"2024-08-27T03:58:36.604535+0000","last_peered":"2024-08-27T03:58:36.604535+0000","last_clean":"2024-08-27T03:58:36.604535+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:58:36.604535+0000","last_undegraded":"2024-08-27T03:58:36.604535+0000","last_fullsized":"2024-08-27T03:58:36.604535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.604457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:03:12.862350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'400","reported_seq":1115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.071580+0000","last_change":"2024-08-27T03:58:38.071524+0000","last_active":"2024-08-27T03:58:38.071580+0000","last_peered":"2024-08-27T03:58:38.071580+0000","last_clean":"2024-08-27T03:58:38.071580+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:38.071580+0000","last_undegraded":"2024-08-27T03:58:38.071580+0000","last_fullsized":"2024-08-27T03:58:38.071580+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.071425+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:30:14.243648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":29601,"num_write":1270,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.460375+0000","last_change":"2024-08-27T03:58:49.460375+0000","last_active":"2024-08-27T03:58:49.460375+0000","last_peered":"2024-08-27T03:58:49.460375+0000","last_clean":"2024-08-27T03:58:49.460375+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:58:49.460375+0000","last_undegraded":"2024-08-27T03:58:49.460375+0000","last_fullsized":"2024-08-27T03:58:49.460375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.460156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:20.731797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'336","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.948545+0000","last_change":"2024-08-27T03:58:59.948262+0000","last_active":"2024-08-27T03:58:59.948545+0000","last_peered":"2024-08-27T03:58:59.948545+0000","last_clean":"2024-08-27T03:58:59.948545+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:59.948545+0000","last_undegraded":"2024-08-27T03:58:59.948545+0000","last_fullsized":"2024-08-27T03:58:59.948545+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-08-27T03:58:59.947989+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-08-27T03:58:59.947989+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.947989+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:34:29.854493+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.465714+0000","last_change":"2024-08-27T03:59:04.465714+0000","last_active":"2024-08-27T03:59:04.465714+0000","last_peered":"2024-08-27T03:59:04.465714+0000","last_clean":"2024-08-27T03:59:04.465714+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:59:04.465714+0000","last_undegraded":"2024-08-27T03:59:04.465714+0000","last_fullsized":"2024-08-27T03:59:04.465714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:04.465518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:04.465518+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.465518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:49.559949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'261","reported_seq":885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.435803+0000","last_change":"2024-08-27T03:59:16.435803+0000","last_active":"2024-08-27T03:59:16.435803+0000","last_peered":"2024-08-27T03:59:16.435803+0000","last_clean":"2024-08-27T03:59:16.435803+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:59:16.435803+0000","last_undegraded":"2024-08-27T03:59:16.435803+0000","last_fullsized":"2024-08-27T03:59:16.435803+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'261","last_scrub_stamp":"2024-08-27T03:59:16.435591+0000","last_deep_scrub":"267'261","last_deep_scrub_stamp":"2024-08-27T03:59:16.435591+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.435591+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:34.411555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.177188+0000","last_change":"2024-08-27T03:58:46.177188+0000","last_active":"2024-08-27T03:58:46.177188+0000","last_peered":"2024-08-27T03:58:46.177188+0000","last_clean":"2024-08-27T03:58:46.177188+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:58:46.177188+0000","last_undegraded":"2024-08-27T03:58:46.177188+0000","last_fullsized":"2024-08-27T03:58:46.177188+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.177002+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:00:50.953987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.658282+0000","last_change":"2024-08-27T03:58:37.658282+0000","last_active":"2024-08-27T03:58:37.658282+0000","last_peered":"2024-08-27T03:58:37.658282+0000","last_clean":"2024-08-27T03:58:37.658282+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:58:37.658282+0000","last_undegraded":"2024-08-27T03:58:37.658282+0000","last_fullsized":"2024-08-27T03:58:37.658282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.658091+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:22.087261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'346","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.730918+0000","last_change":"2024-08-27T03:58:38.730918+0000","last_active":"2024-08-27T03:58:38.730918+0000","last_peered":"2024-08-27T03:58:38.730918+0000","last_clean":"2024-08-27T03:58:38.730918+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:38.730918+0000","last_undegraded":"2024-08-27T03:58:38.730918+0000","last_fullsized":"2024-08-27T03:58:38.730918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.730550+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:48:41.072429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573788,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":426,"num_read_kb":9573,"num_write":1083,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.464923+0000","last_change":"2024-08-27T03:58:51.464782+0000","last_active":"2024-08-27T03:58:51.464923+0000","last_peered":"2024-08-27T03:58:51.464923+0000","last_clean":"2024-08-27T03:58:51.464923+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:58:51.464923+0000","last_undegraded":"2024-08-27T03:58:51.464923+0000","last_fullsized":"2024-08-27T03:58:51.464923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.464600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:07.725251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'179","reported_seq":773,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.322303+0000","last_change":"2024-08-27T03:59:02.322303+0000","last_active":"2024-08-27T03:59:02.322303+0000","last_peered":"2024-08-27T03:59:02.322303+0000","last_clean":"2024-08-27T03:59:02.322303+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:59:02.322303+0000","last_undegraded":"2024-08-27T03:59:02.322303+0000","last_fullsized":"2024-08-27T03:59:02.322303+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'179","last_scrub_stamp":"2024-08-27T03:59:02.322101+0000","last_deep_scrub":"267'179","last_deep_scrub_stamp":"2024-08-27T03:59:02.322101+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.322101+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:39:59.680636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.675155+0000","last_change":"2024-08-27T03:58:53.675155+0000","last_active":"2024-08-27T03:58:53.675155+0000","last_peered":"2024-08-27T03:58:53.675155+0000","last_clean":"2024-08-27T03:58:53.675155+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:58:53.675155+0000","last_undegraded":"2024-08-27T03:58:53.675155+0000","last_fullsized":"2024-08-27T03:58:53.675155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.674951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:48.890985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.809753+0000","last_change":"2024-08-27T03:59:08.809753+0000","last_active":"2024-08-27T03:59:08.809753+0000","last_peered":"2024-08-27T03:59:08.809753+0000","last_clean":"2024-08-27T03:59:08.809753+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:59:08.809753+0000","last_undegraded":"2024-08-27T03:59:08.809753+0000","last_fullsized":"2024-08-27T03:59:08.809753+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-08-27T03:59:08.809576+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-08-27T03:59:08.809576+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.809576+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:59:08.997058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1265","reported_seq":2845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.167609+0000","last_change":"2024-08-27T03:58:44.167609+0000","last_active":"2024-08-27T03:58:44.167609+0000","last_peered":"2024-08-27T03:58:44.167609+0000","last_clean":"2024-08-27T03:58:44.167609+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:58:44.167609+0000","last_undegraded":"2024-08-27T03:58:44.167609+0000","last_fullsized":"2024-08-27T03:58:44.167609+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1265","last_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_deep_scrub":"267'1265","last_deep_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.167407+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:51:52.232154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'345","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.629995+0000","last_change":"2024-08-27T03:58:39.629743+0000","last_active":"2024-08-27T03:58:39.629995+0000","last_peered":"2024-08-27T03:58:39.629995+0000","last_clean":"2024-08-27T03:58:39.629995+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:39.629995+0000","last_undegraded":"2024-08-27T03:58:39.629995+0000","last_fullsized":"2024-08-27T03:58:39.629995+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.629340+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:32.213907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":946,"num_write":1113,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.053529+0000","last_change":"2024-08-27T03:58:37.053529+0000","last_active":"2024-08-27T03:58:37.053529+0000","last_peered":"2024-08-27T03:58:37.053529+0000","last_clean":"2024-08-27T03:58:37.053529+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:58:37.053529+0000","last_undegraded":"2024-08-27T03:58:37.053529+0000","last_fullsized":"2024-08-27T03:58:37.053529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.053430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:25.862689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.564981+0000","last_change":"2024-08-27T03:58:56.564981+0000","last_active":"2024-08-27T03:58:56.564981+0000","last_peered":"2024-08-27T03:58:56.564981+0000","last_clean":"2024-08-27T03:58:56.564981+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:58:56.564981+0000","last_undegraded":"2024-08-27T03:58:56.564981+0000","last_fullsized":"2024-08-27T03:58:56.564981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.564773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.564773+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.564773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:00.629402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'673","reported_seq":1406,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.555278+0000","last_change":"2024-08-27T03:58:57.555135+0000","last_active":"2024-08-27T03:58:57.555278+0000","last_peered":"2024-08-27T03:58:57.555278+0000","last_clean":"2024-08-27T03:58:57.555278+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:57.555278+0000","last_undegraded":"2024-08-27T03:58:57.555278+0000","last_fullsized":"2024-08-27T03:58:57.555278+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'673","last_scrub_stamp":"2024-08-27T03:58:57.554887+0000","last_deep_scrub":"267'673","last_deep_scrub_stamp":"2024-08-27T03:58:57.554887+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.554887+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:24:06.050565+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1780,"num_read_kb":2961,"num_write":2352,"num_write_kb":2124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506974,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.635550+0000","last_change":"2024-08-27T03:59:06.635550+0000","last_active":"2024-08-27T03:59:06.635550+0000","last_peered":"2024-08-27T03:59:06.635550+0000","last_clean":"2024-08-27T03:59:06.635550+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:59:06.635550+0000","last_undegraded":"2024-08-27T03:59:06.635550+0000","last_fullsized":"2024-08-27T03:59:06.635550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:06.635361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:06.635361+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.635361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:26:52.842862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'150","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.551862+0000","last_change":"2024-08-27T03:59:11.551862+0000","last_active":"2024-08-27T03:59:11.551862+0000","last_peered":"2024-08-27T03:59:11.551862+0000","last_clean":"2024-08-27T03:59:11.551862+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:59:11.551862+0000","last_undegraded":"2024-08-27T03:59:11.551862+0000","last_fullsized":"2024-08-27T03:59:11.551862+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'150","last_scrub_stamp":"2024-08-27T03:59:11.551659+0000","last_deep_scrub":"267'150","last_deep_scrub_stamp":"2024-08-27T03:59:11.551659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.551659+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:34:36.621710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'762","reported_seq":2257,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.341748+0000","last_change":"2024-08-27T03:58:44.341748+0000","last_active":"2024-08-27T03:58:44.341748+0000","last_peered":"2024-08-27T03:58:44.341748+0000","last_clean":"2024-08-27T03:58:44.341748+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:58:44.341748+0000","last_undegraded":"2024-08-27T03:58:44.341748+0000","last_fullsized":"2024-08-27T03:58:44.341748+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.341567+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:18:33.526418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'372","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.092398+0000","last_change":"2024-08-27T03:58:39.092398+0000","last_active":"2024-08-27T03:58:39.092398+0000","last_peered":"2024-08-27T03:58:39.092398+0000","last_clean":"2024-08-27T03:58:39.092398+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:39.092398+0000","last_undegraded":"2024-08-27T03:58:39.092398+0000","last_fullsized":"2024-08-27T03:58:39.092398+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.092090+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:46:48.988935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254745,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":622,"num_read_kb":96022,"num_write":1186,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.886716+0000","last_change":"2024-08-27T03:58:38.886592+0000","last_active":"2024-08-27T03:58:38.886716+0000","last_peered":"2024-08-27T03:58:38.886716+0000","last_clean":"2024-08-27T03:58:38.886716+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:58:38.886716+0000","last_undegraded":"2024-08-27T03:58:38.886716+0000","last_fullsized":"2024-08-27T03:58:38.886716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.886440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:43.605161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.688066+0000","last_change":"2024-08-27T03:58:49.688066+0000","last_active":"2024-08-27T03:58:49.688066+0000","last_peered":"2024-08-27T03:58:49.688066+0000","last_clean":"2024-08-27T03:58:49.688066+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:58:49.688066+0000","last_undegraded":"2024-08-27T03:58:49.688066+0000","last_fullsized":"2024-08-27T03:58:49.688066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.687882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:24:23.995310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'221","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.046535+0000","last_change":"2024-08-27T03:58:55.046535+0000","last_active":"2024-08-27T03:58:55.046535+0000","last_peered":"2024-08-27T03:58:55.046535+0000","last_clean":"2024-08-27T03:58:55.046535+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:58:55.046535+0000","last_undegraded":"2024-08-27T03:58:55.046535+0000","last_fullsized":"2024-08-27T03:58:55.046535+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.046291+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:24.558926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'721","reported_seq":2968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.784407+0000","last_change":"2024-08-27T03:59:05.784407+0000","last_active":"2024-08-27T03:59:05.784407+0000","last_peered":"2024-08-27T03:59:05.784407+0000","last_clean":"2024-08-27T03:59:05.784407+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:59:05.784407+0000","last_undegraded":"2024-08-27T03:59:05.784407+0000","last_fullsized":"2024-08-27T03:59:05.784407+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'721","last_scrub_stamp":"2024-08-27T03:59:05.784225+0000","last_deep_scrub":"267'721","last_deep_scrub_stamp":"2024-08-27T03:59:05.784225+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.784225+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:19:08.880831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'141","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.462466+0000","last_change":"2024-08-27T03:59:15.462199+0000","last_active":"2024-08-27T03:59:15.462466+0000","last_peered":"2024-08-27T03:59:15.462466+0000","last_clean":"2024-08-27T03:59:15.462466+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:59:15.462466+0000","last_undegraded":"2024-08-27T03:59:15.462466+0000","last_fullsized":"2024-08-27T03:59:15.462466+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-08-27T03:59:15.461965+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-08-27T03:59:15.461965+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.461965+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:58.666628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'410","reported_seq":1945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.125639+0000","last_change":"2024-08-27T03:58:48.125477+0000","last_active":"2024-08-27T03:58:48.125639+0000","last_peered":"2024-08-27T03:58:48.125639+0000","last_clean":"2024-08-27T03:58:48.125639+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:58:48.125639+0000","last_undegraded":"2024-08-27T03:58:48.125639+0000","last_fullsized":"2024-08-27T03:58:48.125639+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.125306+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:32:51.563488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'331","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.056444+0000","last_change":"2024-08-27T03:58:38.056444+0000","last_active":"2024-08-27T03:58:38.056444+0000","last_peered":"2024-08-27T03:58:38.056444+0000","last_clean":"2024-08-27T03:58:38.056444+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:38.056444+0000","last_undegraded":"2024-08-27T03:58:38.056444+0000","last_fullsized":"2024-08-27T03:58:38.056444+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.056349+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:34:53.352346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":4604,"num_write":1019,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.038731+0000","last_change":"2024-08-27T03:58:36.038731+0000","last_active":"2024-08-27T03:58:36.038731+0000","last_peered":"2024-08-27T03:58:36.038731+0000","last_clean":"2024-08-27T03:58:36.038731+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:58:36.038731+0000","last_undegraded":"2024-08-27T03:58:36.038731+0000","last_fullsized":"2024-08-27T03:58:36.038731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.038657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:07:04.224982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.715676+0000","last_change":"2024-08-27T03:58:58.715676+0000","last_active":"2024-08-27T03:58:58.715676+0000","last_peered":"2024-08-27T03:58:58.715676+0000","last_clean":"2024-08-27T03:58:58.715676+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:58:58.715676+0000","last_undegraded":"2024-08-27T03:58:58.715676+0000","last_fullsized":"2024-08-27T03:58:58.715676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.715406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.715406+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.715406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:00:01.173207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'166","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.716206+0000","last_change":"2024-08-27T03:59:02.716206+0000","last_active":"2024-08-27T03:59:02.716206+0000","last_peered":"2024-08-27T03:59:02.716206+0000","last_clean":"2024-08-27T03:59:02.716206+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:59:02.716206+0000","last_undegraded":"2024-08-27T03:59:02.716206+0000","last_fullsized":"2024-08-27T03:59:02.716206+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:02.716019+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:02.716019+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.716019+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:11:32.329036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'733","reported_seq":4725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.436967+0000","last_change":"2024-08-27T03:59:10.436967+0000","last_active":"2024-08-27T03:59:10.436967+0000","last_peered":"2024-08-27T03:59:10.436967+0000","last_clean":"2024-08-27T03:59:10.436967+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:59:10.436967+0000","last_undegraded":"2024-08-27T03:59:10.436967+0000","last_fullsized":"2024-08-27T03:59:10.436967+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'733","last_scrub_stamp":"2024-08-27T03:59:10.436785+0000","last_deep_scrub":"267'733","last_deep_scrub_stamp":"2024-08-27T03:59:10.436785+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.436785+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:25:23.754801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'212","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.527373+0000","last_change":"2024-08-27T03:59:08.527373+0000","last_active":"2024-08-27T03:59:08.527373+0000","last_peered":"2024-08-27T03:59:08.527373+0000","last_clean":"2024-08-27T03:59:08.527373+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:59:08.527373+0000","last_undegraded":"2024-08-27T03:59:08.527373+0000","last_fullsized":"2024-08-27T03:59:08.527373+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-08-27T03:59:08.527059+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-08-27T03:59:08.527059+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.527059+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:05:08.280061+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'398","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.667019+0000","last_change":"2024-08-27T03:58:42.667019+0000","last_active":"2024-08-27T03:58:42.667019+0000","last_peered":"2024-08-27T03:58:42.667019+0000","last_clean":"2024-08-27T03:58:42.667019+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:58:42.667019+0000","last_undegraded":"2024-08-27T03:58:42.667019+0000","last_fullsized":"2024-08-27T03:58:42.667019+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.666809+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:34.834037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'349","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:35.413562+0000","last_change":"2024-08-27T03:58:35.413562+0000","last_active":"2024-08-27T03:58:35.413562+0000","last_peered":"2024-08-27T03:58:35.413562+0000","last_clean":"2024-08-27T03:58:35.413562+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:35.413562+0000","last_undegraded":"2024-08-27T03:58:35.413562+0000","last_fullsized":"2024-08-27T03:58:35.413562+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_clean_scrub_stamp":"2024-08-27T03:58:35.413408+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:28:38.132282+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044381,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":35253,"num_write":1103,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.749803+0000","last_change":"2024-08-27T03:58:38.749803+0000","last_active":"2024-08-27T03:58:38.749803+0000","last_peered":"2024-08-27T03:58:38.749803+0000","last_clean":"2024-08-27T03:58:38.749803+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:58:38.749803+0000","last_undegraded":"2024-08-27T03:58:38.749803+0000","last_fullsized":"2024-08-27T03:58:38.749803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.749605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:52:37.408314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.327411+0000","last_change":"2024-08-27T03:58:57.327279+0000","last_active":"2024-08-27T03:58:57.327411+0000","last_peered":"2024-08-27T03:58:57.327411+0000","last_clean":"2024-08-27T03:58:57.327411+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:58:57.327411+0000","last_undegraded":"2024-08-27T03:58:57.327411+0000","last_fullsized":"2024-08-27T03:58:57.327411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.327076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.327076+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.327076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:23:48.404239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'803","reported_seq":1568,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.955750+0000","last_change":"2024-08-27T03:58:58.955750+0000","last_active":"2024-08-27T03:58:58.955750+0000","last_peered":"2024-08-27T03:58:58.955750+0000","last_clean":"2024-08-27T03:58:58.955750+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:58.955750+0000","last_undegraded":"2024-08-27T03:58:58.955750+0000","last_fullsized":"2024-08-27T03:58:58.955750+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'803","last_scrub_stamp":"2024-08-27T03:58:58.955545+0000","last_deep_scrub":"267'803","last_deep_scrub_stamp":"2024-08-27T03:58:58.955545+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.955545+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:28:17.120438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135678,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1416,"num_read_kb":3420,"num_write":1150,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.400087+0000","last_change":"2024-08-27T03:59:09.400087+0000","last_active":"2024-08-27T03:59:09.400087+0000","last_peered":"2024-08-27T03:59:09.400087+0000","last_clean":"2024-08-27T03:59:09.400087+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:59:09.400087+0000","last_undegraded":"2024-08-27T03:59:09.400087+0000","last_fullsized":"2024-08-27T03:59:09.400087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.399810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.399810+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.399810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:59:49.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'121","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.848896+0000","last_change":"2024-08-27T03:59:09.848896+0000","last_active":"2024-08-27T03:59:09.848896+0000","last_peered":"2024-08-27T03:59:09.848896+0000","last_clean":"2024-08-27T03:59:09.848896+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:59:09.848896+0000","last_undegraded":"2024-08-27T03:59:09.848896+0000","last_fullsized":"2024-08-27T03:59:09.848896+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'121","last_scrub_stamp":"2024-08-27T03:59:09.848709+0000","last_deep_scrub":"267'121","last_deep_scrub_stamp":"2024-08-27T03:59:09.848709+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.848709+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:32:24.307293+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'166","reported_seq":759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.623165+0000","last_change":"2024-08-27T03:59:14.623165+0000","last_active":"2024-08-27T03:59:14.623165+0000","last_peered":"2024-08-27T03:59:14.623165+0000","last_clean":"2024-08-27T03:59:14.623165+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:59:14.623165+0000","last_undegraded":"2024-08-27T03:59:14.623165+0000","last_fullsized":"2024-08-27T03:59:14.623165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:14.622958+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:14.622958+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.622958+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:35:16.828219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'938","reported_seq":2451,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.710186+0000","last_change":"2024-08-27T03:58:48.710186+0000","last_active":"2024-08-27T03:58:48.710186+0000","last_peered":"2024-08-27T03:58:48.710186+0000","last_clean":"2024-08-27T03:58:48.710186+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:58:48.710186+0000","last_undegraded":"2024-08-27T03:58:48.710186+0000","last_fullsized":"2024-08-27T03:58:48.710186+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'938","last_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_deep_scrub":"267'938","last_deep_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.709995+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":900,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.597316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":688,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'378","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.720844+0000","last_change":"2024-08-27T03:58:40.720844+0000","last_active":"2024-08-27T03:58:40.720844+0000","last_peered":"2024-08-27T03:58:40.720844+0000","last_clean":"2024-08-27T03:58:40.720844+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:40.720844+0000","last_undegraded":"2024-08-27T03:58:40.720844+0000","last_fullsized":"2024-08-27T03:58:40.720844+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'378","last_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_deep_scrub":"267'378","last_deep_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.720612+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:35.862070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263226,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":507,"num_write":1144,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.031052+0000","last_change":"2024-08-27T03:58:51.031052+0000","last_active":"2024-08-27T03:58:51.031052+0000","last_peered":"2024-08-27T03:58:51.031052+0000","last_clean":"2024-08-27T03:58:51.031052+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:58:51.031052+0000","last_undegraded":"2024-08-27T03:58:51.031052+0000","last_fullsized":"2024-08-27T03:58:51.031052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.030870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:16.544510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'286","reported_seq":910,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.320437+0000","last_change":"2024-08-27T03:59:05.320437+0000","last_active":"2024-08-27T03:59:05.320437+0000","last_peered":"2024-08-27T03:59:05.320437+0000","last_clean":"2024-08-27T03:59:05.320437+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:59:05.320437+0000","last_undegraded":"2024-08-27T03:59:05.320437+0000","last_fullsized":"2024-08-27T03:59:05.320437+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'286","last_scrub_stamp":"2024-08-27T03:59:05.320190+0000","last_deep_scrub":"267'286","last_deep_scrub_stamp":"2024-08-27T03:59:05.320190+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.320190+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:35:50.176774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":955,"num_write":350,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.459614+0000","last_change":"2024-08-27T03:59:12.459614+0000","last_active":"2024-08-27T03:59:12.459614+0000","last_peered":"2024-08-27T03:59:12.459614+0000","last_clean":"2024-08-27T03:59:12.459614+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:59:12.459614+0000","last_undegraded":"2024-08-27T03:59:12.459614+0000","last_fullsized":"2024-08-27T03:59:12.459614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:12.459442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:12.459442+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.459442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:25:35.692272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.402472+0000","last_change":"2024-08-27T03:59:19.402472+0000","last_active":"2024-08-27T03:59:19.402472+0000","last_peered":"2024-08-27T03:59:19.402472+0000","last_clean":"2024-08-27T03:59:19.402472+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:59:19.402472+0000","last_undegraded":"2024-08-27T03:59:19.402472+0000","last_fullsized":"2024-08-27T03:59:19.402472+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'114","last_scrub_stamp":"2024-08-27T03:59:19.402257+0000","last_deep_scrub":"267'114","last_deep_scrub_stamp":"2024-08-27T03:59:19.402257+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.402257+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:04:11.664844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'380","reported_seq":1855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.148934+0000","last_change":"2024-08-27T03:58:47.148934+0000","last_active":"2024-08-27T03:58:47.148934+0000","last_peered":"2024-08-27T03:58:47.148934+0000","last_clean":"2024-08-27T03:58:47.148934+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:58:47.148934+0000","last_undegraded":"2024-08-27T03:58:47.148934+0000","last_fullsized":"2024-08-27T03:58:47.148934+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.148744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:27.163059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'319","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.889227+0000","last_change":"2024-08-27T03:58:44.889227+0000","last_active":"2024-08-27T03:58:44.889227+0000","last_peered":"2024-08-27T03:58:44.889227+0000","last_clean":"2024-08-27T03:58:44.889227+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:44.889227+0000","last_undegraded":"2024-08-27T03:58:44.889227+0000","last_fullsized":"2024-08-27T03:58:44.889227+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.888880+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:13:45.821566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":2061,"num_write":967,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.296199+0000","last_change":"2024-08-27T03:58:58.296199+0000","last_active":"2024-08-27T03:58:58.296199+0000","last_peered":"2024-08-27T03:58:58.296199+0000","last_clean":"2024-08-27T03:58:58.296199+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:58:58.296199+0000","last_undegraded":"2024-08-27T03:58:58.296199+0000","last_fullsized":"2024-08-27T03:58:58.296199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.296017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.296017+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.296017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:15.246385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'58","reported_seq":596,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.507278+0000","last_change":"2024-08-27T03:58:59.507278+0000","last_active":"2024-08-27T03:58:59.507278+0000","last_peered":"2024-08-27T03:58:59.507278+0000","last_clean":"2024-08-27T03:58:59.507278+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:58:59.507278+0000","last_undegraded":"2024-08-27T03:58:59.507278+0000","last_fullsized":"2024-08-27T03:58:59.507278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'58","last_scrub_stamp":"2024-08-27T03:58:59.507104+0000","last_deep_scrub":"267'58","last_deep_scrub_stamp":"2024-08-27T03:58:59.507104+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.507104+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:25:51.054843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.841846+0000","last_change":"2024-08-27T03:59:05.841846+0000","last_active":"2024-08-27T03:59:05.841846+0000","last_peered":"2024-08-27T03:59:05.841846+0000","last_clean":"2024-08-27T03:59:05.841846+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:59:05.841846+0000","last_undegraded":"2024-08-27T03:59:05.841846+0000","last_fullsized":"2024-08-27T03:59:05.841846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.841662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.841662+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.841662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:02.161033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'186","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.562826+0000","last_change":"2024-08-27T03:59:12.562826+0000","last_active":"2024-08-27T03:59:12.562826+0000","last_peered":"2024-08-27T03:59:12.562826+0000","last_clean":"2024-08-27T03:59:12.562826+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:59:12.562826+0000","last_undegraded":"2024-08-27T03:59:12.562826+0000","last_fullsized":"2024-08-27T03:59:12.562826+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-08-27T03:59:12.562630+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-08-27T03:59:12.562630+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.562630+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:12:56.115345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'412","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.133915+0000","last_change":"2024-08-27T03:58:49.133915+0000","last_active":"2024-08-27T03:58:49.133915+0000","last_peered":"2024-08-27T03:58:49.133915+0000","last_clean":"2024-08-27T03:58:49.133915+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:58:49.133915+0000","last_undegraded":"2024-08-27T03:58:49.133915+0000","last_fullsized":"2024-08-27T03:58:49.133915+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.133730+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:26:03.612785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'324","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.768146+0000","last_change":"2024-08-27T03:58:48.768146+0000","last_active":"2024-08-27T03:58:48.768146+0000","last_peered":"2024-08-27T03:58:48.768146+0000","last_clean":"2024-08-27T03:58:48.768146+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:48.768146+0000","last_undegraded":"2024-08-27T03:58:48.768146+0000","last_fullsized":"2024-08-27T03:58:48.768146+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.767843+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:56.225287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525410,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":30350,"num_write":1025,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.956467+0000","last_change":"2024-08-27T03:58:56.956467+0000","last_active":"2024-08-27T03:58:56.956467+0000","last_peered":"2024-08-27T03:58:56.956467+0000","last_clean":"2024-08-27T03:58:56.956467+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:58:56.956467+0000","last_undegraded":"2024-08-27T03:58:56.956467+0000","last_fullsized":"2024-08-27T03:58:56.956467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.956265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.956265+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.956265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:45:45.975142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'346","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.344247+0000","last_change":"2024-08-27T03:59:06.344247+0000","last_active":"2024-08-27T03:59:06.344247+0000","last_peered":"2024-08-27T03:59:06.344247+0000","last_clean":"2024-08-27T03:59:06.344247+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:59:06.344247+0000","last_undegraded":"2024-08-27T03:59:06.344247+0000","last_fullsized":"2024-08-27T03:59:06.344247+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:59:06.344011+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:59:06.344011+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.344011+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:44.497759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1247,"num_write":450,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.667135+0000","last_change":"2024-08-27T03:58:56.667135+0000","last_active":"2024-08-27T03:58:56.667135+0000","last_peered":"2024-08-27T03:58:56.667135+0000","last_clean":"2024-08-27T03:58:56.667135+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:58:56.667135+0000","last_undegraded":"2024-08-27T03:58:56.667135+0000","last_fullsized":"2024-08-27T03:58:56.667135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.666955+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.666955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:43:34.487076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'115","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.926555+0000","last_change":"2024-08-27T03:59:11.926555+0000","last_active":"2024-08-27T03:59:11.926555+0000","last_peered":"2024-08-27T03:59:11.926555+0000","last_clean":"2024-08-27T03:59:11.926555+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:59:11.926555+0000","last_undegraded":"2024-08-27T03:59:11.926555+0000","last_fullsized":"2024-08-27T03:59:11.926555+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'115","last_scrub_stamp":"2024-08-27T03:59:11.926366+0000","last_deep_scrub":"267'115","last_deep_scrub_stamp":"2024-08-27T03:59:11.926366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.926366+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:33:30.256381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'420","reported_seq":1947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.187656+0000","last_change":"2024-08-27T03:58:51.187656+0000","last_active":"2024-08-27T03:58:51.187656+0000","last_peered":"2024-08-27T03:58:51.187656+0000","last_clean":"2024-08-27T03:58:51.187656+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:51.187656+0000","last_undegraded":"2024-08-27T03:58:51.187656+0000","last_fullsized":"2024-08-27T03:58:51.187656+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'420","last_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_deep_scrub":"267'420","last_deep_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.187454+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:01:20.975620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'331","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.480918+0000","last_change":"2024-08-27T03:58:37.480918+0000","last_active":"2024-08-27T03:58:37.480918+0000","last_peered":"2024-08-27T03:58:37.480918+0000","last_clean":"2024-08-27T03:58:37.480918+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:37.480918+0000","last_undegraded":"2024-08-27T03:58:37.480918+0000","last_fullsized":"2024-08-27T03:58:37.480918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.480830+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:01:53.901179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1018782,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":16403,"num_write":1128,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.652421+0000","last_change":"2024-08-27T03:58:51.652421+0000","last_active":"2024-08-27T03:58:51.652421+0000","last_peered":"2024-08-27T03:58:51.652421+0000","last_clean":"2024-08-27T03:58:51.652421+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:58:51.652421+0000","last_undegraded":"2024-08-27T03:58:51.652421+0000","last_fullsized":"2024-08-27T03:58:51.652421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.652254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:21:22.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'285","reported_seq":881,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.945012+0000","last_change":"2024-08-27T03:59:02.945012+0000","last_active":"2024-08-27T03:59:02.945012+0000","last_peered":"2024-08-27T03:59:02.945012+0000","last_clean":"2024-08-27T03:59:02.945012+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:59:02.945012+0000","last_undegraded":"2024-08-27T03:59:02.945012+0000","last_fullsized":"2024-08-27T03:59:02.945012+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-08-27T03:59:02.944806+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-08-27T03:59:02.944806+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.944806+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:46:18.316088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.474818+0000","last_change":"2024-08-27T03:59:02.474818+0000","last_active":"2024-08-27T03:59:02.474818+0000","last_peered":"2024-08-27T03:59:02.474818+0000","last_clean":"2024-08-27T03:59:02.474818+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:59:02.474818+0000","last_undegraded":"2024-08-27T03:59:02.474818+0000","last_fullsized":"2024-08-27T03:59:02.474818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:02.474632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:02.474632+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.474632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:03:54.952348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'839","reported_seq":2423,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.689531+0000","last_change":"2024-08-27T03:58:47.689531+0000","last_active":"2024-08-27T03:58:47.689531+0000","last_peered":"2024-08-27T03:58:47.689531+0000","last_clean":"2024-08-27T03:58:47.689531+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:58:47.689531+0000","last_undegraded":"2024-08-27T03:58:47.689531+0000","last_fullsized":"2024-08-27T03:58:47.689531+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.689347+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:53:38.179127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1651,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'418","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.127698+0000","last_change":"2024-08-27T03:58:40.127698+0000","last_active":"2024-08-27T03:58:40.127698+0000","last_peered":"2024-08-27T03:58:40.127698+0000","last_clean":"2024-08-27T03:58:40.127698+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:40.127698+0000","last_undegraded":"2024-08-27T03:58:40.127698+0000","last_fullsized":"2024-08-27T03:58:40.127698+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'418","last_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_deep_scrub":"267'418","last_deep_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.127457+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:37.962208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":762,"num_read_kb":11072,"num_write":1374,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.531818+0000","last_change":"2024-08-27T03:58:54.531651+0000","last_active":"2024-08-27T03:58:54.531818+0000","last_peered":"2024-08-27T03:58:54.531818+0000","last_clean":"2024-08-27T03:58:54.531818+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:58:54.531818+0000","last_undegraded":"2024-08-27T03:58:54.531818+0000","last_fullsized":"2024-08-27T03:58:54.531818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.531461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:09:04.172792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'556","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.024667+0000","last_change":"2024-08-27T03:58:54.024667+0000","last_active":"2024-08-27T03:58:54.024667+0000","last_peered":"2024-08-27T03:58:54.024667+0000","last_clean":"2024-08-27T03:58:54.024667+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:54.024667+0000","last_undegraded":"2024-08-27T03:58:54.024667+0000","last_fullsized":"2024-08-27T03:58:54.024667+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'556","last_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_deep_scrub":"267'556","last_deep_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.024451+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:17.790125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":990,"num_read_kb":2409,"num_write":858,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23904,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.764886+0000","last_change":"2024-08-27T03:59:07.764886+0000","last_active":"2024-08-27T03:59:07.764886+0000","last_peered":"2024-08-27T03:59:07.764886+0000","last_clean":"2024-08-27T03:59:07.764886+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:59:07.764886+0000","last_undegraded":"2024-08-27T03:59:07.764886+0000","last_fullsized":"2024-08-27T03:59:07.764886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.764707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.764707+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.764707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:07.171054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'144","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.436590+0000","last_change":"2024-08-27T03:59:18.436590+0000","last_active":"2024-08-27T03:59:18.436590+0000","last_peered":"2024-08-27T03:59:18.436590+0000","last_clean":"2024-08-27T03:59:18.436590+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:59:18.436590+0000","last_undegraded":"2024-08-27T03:59:18.436590+0000","last_fullsized":"2024-08-27T03:59:18.436590+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'144","last_scrub_stamp":"2024-08-27T03:59:18.436397+0000","last_deep_scrub":"267'144","last_deep_scrub_stamp":"2024-08-27T03:59:18.436397+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.436397+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:42.457307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1183","reported_seq":2632,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.466634+0000","last_change":"2024-08-27T03:58:49.466497+0000","last_active":"2024-08-27T03:58:49.466634+0000","last_peered":"2024-08-27T03:58:49.466634+0000","last_clean":"2024-08-27T03:58:49.466634+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:58:49.466634+0000","last_undegraded":"2024-08-27T03:58:49.466634+0000","last_fullsized":"2024-08-27T03:58:49.466634+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1183","last_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_deep_scrub":"267'1183","last_deep_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.466324+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:09.565854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'349","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.092246+0000","last_change":"2024-08-27T03:58:41.092246+0000","last_active":"2024-08-27T03:58:41.092246+0000","last_peered":"2024-08-27T03:58:41.092246+0000","last_clean":"2024-08-27T03:58:41.092246+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:41.092246+0000","last_undegraded":"2024-08-27T03:58:41.092246+0000","last_fullsized":"2024-08-27T03:58:41.092246+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.092033+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:47:27.087478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":41676,"num_write":1093,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.666378+0000","last_change":"2024-08-27T03:58:52.666378+0000","last_active":"2024-08-27T03:58:52.666378+0000","last_peered":"2024-08-27T03:58:52.666378+0000","last_clean":"2024-08-27T03:58:52.666378+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:58:52.666378+0000","last_undegraded":"2024-08-27T03:58:52.666378+0000","last_fullsized":"2024-08-27T03:58:52.666378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.666203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:19:46.181291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'358","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.865885+0000","last_change":"2024-08-27T03:59:04.865885+0000","last_active":"2024-08-27T03:59:04.865885+0000","last_peered":"2024-08-27T03:59:04.865885+0000","last_clean":"2024-08-27T03:59:04.865885+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:59:04.865885+0000","last_undegraded":"2024-08-27T03:59:04.865885+0000","last_fullsized":"2024-08-27T03:59:04.865885+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-08-27T03:59:04.865659+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-08-27T03:59:04.865659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.865659+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:03.014002+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.060998+0000","last_change":"2024-08-27T03:58:56.060998+0000","last_active":"2024-08-27T03:58:56.060998+0000","last_peered":"2024-08-27T03:58:56.060998+0000","last_clean":"2024-08-27T03:58:56.060998+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:58:56.060998+0000","last_undegraded":"2024-08-27T03:58:56.060998+0000","last_fullsized":"2024-08-27T03:58:56.060998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.060804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:43.231476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'180","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.606127+0000","last_change":"2024-08-27T03:59:01.606127+0000","last_active":"2024-08-27T03:59:01.606127+0000","last_peered":"2024-08-27T03:59:01.606127+0000","last_clean":"2024-08-27T03:59:01.606127+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:59:01.606127+0000","last_undegraded":"2024-08-27T03:59:01.606127+0000","last_fullsized":"2024-08-27T03:59:01.606127+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-08-27T03:59:01.605928+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-08-27T03:59:01.605928+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.605928+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:24:58.905577+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'699","reported_seq":2143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.218908+0000","last_change":"2024-08-27T03:58:53.218908+0000","last_active":"2024-08-27T03:58:53.218908+0000","last_peered":"2024-08-27T03:58:53.218908+0000","last_clean":"2024-08-27T03:58:53.218908+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:58:53.218908+0000","last_undegraded":"2024-08-27T03:58:53.218908+0000","last_fullsized":"2024-08-27T03:58:53.218908+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'699","last_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_deep_scrub":"267'699","last_deep_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.218695+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:33.400240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'333","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.695058+0000","last_change":"2024-08-27T03:58:39.695058+0000","last_active":"2024-08-27T03:58:39.695058+0000","last_peered":"2024-08-27T03:58:39.695058+0000","last_clean":"2024-08-27T03:58:39.695058+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:39.695058+0000","last_undegraded":"2024-08-27T03:58:39.695058+0000","last_fullsized":"2024-08-27T03:58:39.695058+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.694836+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:12.785434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":27841,"num_write":1117,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.677750+0000","last_change":"2024-08-27T03:59:01.677750+0000","last_active":"2024-08-27T03:59:01.677750+0000","last_peered":"2024-08-27T03:59:01.677750+0000","last_clean":"2024-08-27T03:59:01.677750+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:59:01.677750+0000","last_undegraded":"2024-08-27T03:59:01.677750+0000","last_fullsized":"2024-08-27T03:59:01.677750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.677560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.677560+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.677560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:47.407504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'329","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.430587+0000","last_change":"2024-08-27T03:59:08.430587+0000","last_active":"2024-08-27T03:59:08.430587+0000","last_peered":"2024-08-27T03:59:08.430587+0000","last_clean":"2024-08-27T03:59:08.430587+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:59:08.430587+0000","last_undegraded":"2024-08-27T03:59:08.430587+0000","last_fullsized":"2024-08-27T03:59:08.430587+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-08-27T03:59:08.430391+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-08-27T03:59:08.430391+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.430391+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.845904+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66592,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1228,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.065028+0000","last_change":"2024-08-27T03:58:59.064956+0000","last_active":"2024-08-27T03:58:59.065028+0000","last_peered":"2024-08-27T03:58:59.065028+0000","last_clean":"2024-08-27T03:58:59.065028+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:58:59.065028+0000","last_undegraded":"2024-08-27T03:58:59.065028+0000","last_fullsized":"2024-08-27T03:58:59.065028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.064853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.064853+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.064853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:33:49.395528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'120","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.902379+0000","last_change":"2024-08-27T03:59:10.902379+0000","last_active":"2024-08-27T03:59:10.902379+0000","last_peered":"2024-08-27T03:59:10.902379+0000","last_clean":"2024-08-27T03:59:10.902379+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:59:10.902379+0000","last_undegraded":"2024-08-27T03:59:10.902379+0000","last_fullsized":"2024-08-27T03:59:10.902379+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-08-27T03:59:10.902192+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-08-27T03:59:10.902192+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.902192+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:05:23.962757+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'790","reported_seq":2428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.556897+0000","last_change":"2024-08-27T03:58:46.556897+0000","last_active":"2024-08-27T03:58:46.556897+0000","last_peered":"2024-08-27T03:58:46.556897+0000","last_clean":"2024-08-27T03:58:46.556897+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:58:46.556897+0000","last_undegraded":"2024-08-27T03:58:46.556897+0000","last_fullsized":"2024-08-27T03:58:46.556897+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.556708+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:05.148074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'325","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.454132+0000","last_change":"2024-08-27T03:58:38.454132+0000","last_active":"2024-08-27T03:58:38.454132+0000","last_peered":"2024-08-27T03:58:38.454132+0000","last_clean":"2024-08-27T03:58:38.454132+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:38.454132+0000","last_undegraded":"2024-08-27T03:58:38.454132+0000","last_fullsized":"2024-08-27T03:58:38.454132+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.453909+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:53.794488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399355,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":2807,"num_write":1070,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.062298+0000","last_change":"2024-08-27T03:58:58.062298+0000","last_active":"2024-08-27T03:58:58.062298+0000","last_peered":"2024-08-27T03:58:58.062298+0000","last_clean":"2024-08-27T03:58:58.062298+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:58:58.062298+0000","last_undegraded":"2024-08-27T03:58:58.062298+0000","last_fullsized":"2024-08-27T03:58:58.062298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.062113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.062113+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.062113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:47:29.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'139","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.665364+0000","last_change":"2024-08-27T03:59:05.665112+0000","last_active":"2024-08-27T03:59:05.665364+0000","last_peered":"2024-08-27T03:59:05.665364+0000","last_clean":"2024-08-27T03:59:05.665364+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:59:05.665364+0000","last_undegraded":"2024-08-27T03:59:05.665364+0000","last_fullsized":"2024-08-27T03:59:05.665364+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'139","last_scrub_stamp":"2024-08-27T03:59:05.664863+0000","last_deep_scrub":"267'139","last_deep_scrub_stamp":"2024-08-27T03:59:05.664863+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.664863+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:03:13.985053+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14734,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'693","reported_seq":2827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.654742+0000","last_change":"2024-08-27T03:58:58.654742+0000","last_active":"2024-08-27T03:58:58.654742+0000","last_peered":"2024-08-27T03:58:58.654742+0000","last_clean":"2024-08-27T03:58:58.654742+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:58.654742+0000","last_undegraded":"2024-08-27T03:58:58.654742+0000","last_fullsized":"2024-08-27T03:58:58.654742+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'693","last_scrub_stamp":"2024-08-27T03:58:58.654530+0000","last_deep_scrub":"267'693","last_deep_scrub_stamp":"2024-08-27T03:58:58.654530+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.654530+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:19.149780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'113","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.804799+0000","last_change":"2024-08-27T03:59:08.804799+0000","last_active":"2024-08-27T03:59:08.804799+0000","last_peered":"2024-08-27T03:59:08.804799+0000","last_clean":"2024-08-27T03:59:08.804799+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:59:08.804799+0000","last_undegraded":"2024-08-27T03:59:08.804799+0000","last_fullsized":"2024-08-27T03:59:08.804799+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-08-27T03:59:08.804603+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-08-27T03:59:08.804603+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.804603+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:44.829031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'791","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.714950+0000","last_change":"2024-08-27T03:58:49.714950+0000","last_active":"2024-08-27T03:58:49.714950+0000","last_peered":"2024-08-27T03:58:49.714950+0000","last_clean":"2024-08-27T03:58:49.714950+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:58:49.714950+0000","last_undegraded":"2024-08-27T03:58:49.714950+0000","last_fullsized":"2024-08-27T03:58:49.714950+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'791","last_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_deep_scrub":"267'791","last_deep_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.714771+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:52.868288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'298","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.775582+0000","last_change":"2024-08-27T03:58:46.775582+0000","last_active":"2024-08-27T03:58:46.775582+0000","last_peered":"2024-08-27T03:58:46.775582+0000","last_clean":"2024-08-27T03:58:46.775582+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:46.775582+0000","last_undegraded":"2024-08-27T03:58:46.775582+0000","last_fullsized":"2024-08-27T03:58:46.775582+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.775293+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:09.222532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550499,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":12943,"num_write":990,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.938304+0000","last_change":"2024-08-27T03:58:57.938304+0000","last_active":"2024-08-27T03:58:57.938304+0000","last_peered":"2024-08-27T03:58:57.938304+0000","last_clean":"2024-08-27T03:58:57.938304+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:58:57.938304+0000","last_undegraded":"2024-08-27T03:58:57.938304+0000","last_fullsized":"2024-08-27T03:58:57.938304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.938116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.938116+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.938116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:03:11.911435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'390","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.783274+0000","last_change":"2024-08-27T03:59:06.783274+0000","last_active":"2024-08-27T03:59:06.783274+0000","last_peered":"2024-08-27T03:59:06.783274+0000","last_clean":"2024-08-27T03:59:06.783274+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:59:06.783274+0000","last_undegraded":"2024-08-27T03:59:06.783274+0000","last_fullsized":"2024-08-27T03:59:06.783274+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-08-27T03:59:06.783054+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-08-27T03:59:06.783054+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.783054+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:04:57.075877+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.528035+0000","last_change":"2024-08-27T03:59:06.528035+0000","last_active":"2024-08-27T03:59:06.528035+0000","last_peered":"2024-08-27T03:59:06.528035+0000","last_clean":"2024-08-27T03:59:06.528035+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:59:06.528035+0000","last_undegraded":"2024-08-27T03:59:06.528035+0000","last_fullsized":"2024-08-27T03:59:06.528035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:06.527836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:06.527836+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.527836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:40:14.529374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'115","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.741333+0000","last_change":"2024-08-27T03:59:12.741333+0000","last_active":"2024-08-27T03:59:12.741333+0000","last_peered":"2024-08-27T03:59:12.741333+0000","last_clean":"2024-08-27T03:59:12.741333+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:59:12.741333+0000","last_undegraded":"2024-08-27T03:59:12.741333+0000","last_fullsized":"2024-08-27T03:59:12.741333+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'115","last_scrub_stamp":"2024-08-27T03:59:12.741145+0000","last_deep_scrub":"267'115","last_deep_scrub_stamp":"2024-08-27T03:59:12.741145+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.741145+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:07.013617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'377","reported_seq":1871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.746460+0000","last_change":"2024-08-27T03:58:46.746460+0000","last_active":"2024-08-27T03:58:46.746460+0000","last_peered":"2024-08-27T03:58:46.746460+0000","last_clean":"2024-08-27T03:58:46.746460+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:58:46.746460+0000","last_undegraded":"2024-08-27T03:58:46.746460+0000","last_fullsized":"2024-08-27T03:58:46.746460+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.746284+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:21.089772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'325","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.707957+0000","last_change":"2024-08-27T03:58:41.707957+0000","last_active":"2024-08-27T03:58:41.707957+0000","last_peered":"2024-08-27T03:58:41.707957+0000","last_clean":"2024-08-27T03:58:41.707957+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:41.707957+0000","last_undegraded":"2024-08-27T03:58:41.707957+0000","last_fullsized":"2024-08-27T03:58:41.707957+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.707686+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:44.940323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":8306,"num_write":1045,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.824808+0000","last_change":"2024-08-27T03:59:01.824808+0000","last_active":"2024-08-27T03:59:01.824808+0000","last_peered":"2024-08-27T03:59:01.824808+0000","last_clean":"2024-08-27T03:59:01.824808+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:59:01.824808+0000","last_undegraded":"2024-08-27T03:59:01.824808+0000","last_fullsized":"2024-08-27T03:59:01.824808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.824623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.824623+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.824623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:47:19.318799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'273","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.523257+0000","last_change":"2024-08-27T03:59:07.523257+0000","last_active":"2024-08-27T03:59:07.523257+0000","last_peered":"2024-08-27T03:59:07.523257+0000","last_clean":"2024-08-27T03:59:07.523257+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:59:07.523257+0000","last_undegraded":"2024-08-27T03:59:07.523257+0000","last_fullsized":"2024-08-27T03:59:07.523257+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-08-27T03:59:07.523065+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-08-27T03:59:07.523065+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.523065+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:39.294903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.704026+0000","last_change":"2024-08-27T03:58:57.704026+0000","last_active":"2024-08-27T03:58:57.704026+0000","last_peered":"2024-08-27T03:58:57.704026+0000","last_clean":"2024-08-27T03:58:57.704026+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:58:57.704026+0000","last_undegraded":"2024-08-27T03:58:57.704026+0000","last_fullsized":"2024-08-27T03:58:57.704026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.703813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.703813+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.703813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:51:00.303752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'137","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.405365+0000","last_change":"2024-08-27T03:59:17.405365+0000","last_active":"2024-08-27T03:59:17.405365+0000","last_peered":"2024-08-27T03:59:17.405365+0000","last_clean":"2024-08-27T03:59:17.405365+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:59:17.405365+0000","last_undegraded":"2024-08-27T03:59:17.405365+0000","last_fullsized":"2024-08-27T03:59:17.405365+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-08-27T03:59:17.405123+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-08-27T03:59:17.405123+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.405123+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:41:27.289310+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'737","reported_seq":2240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.265124+0000","last_change":"2024-08-27T03:58:54.265124+0000","last_active":"2024-08-27T03:58:54.265124+0000","last_peered":"2024-08-27T03:58:54.265124+0000","last_clean":"2024-08-27T03:58:54.265124+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:58:54.265124+0000","last_undegraded":"2024-08-27T03:58:54.265124+0000","last_fullsized":"2024-08-27T03:58:54.265124+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'737","last_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_deep_scrub":"267'737","last_deep_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.264928+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:37:38.355010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.153768+0000","last_change":"2024-08-27T03:58:41.153507+0000","last_active":"2024-08-27T03:58:41.153768+0000","last_peered":"2024-08-27T03:58:41.153768+0000","last_clean":"2024-08-27T03:58:41.153768+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:41.153768+0000","last_undegraded":"2024-08-27T03:58:41.153768+0000","last_fullsized":"2024-08-27T03:58:41.153768+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.153232+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:31.829289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":19461,"num_write":1109,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.692107+0000","last_change":"2024-08-27T03:59:00.692107+0000","last_active":"2024-08-27T03:59:00.692107+0000","last_peered":"2024-08-27T03:59:00.692107+0000","last_clean":"2024-08-27T03:59:00.692107+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:59:00.692107+0000","last_undegraded":"2024-08-27T03:59:00.692107+0000","last_fullsized":"2024-08-27T03:59:00.692107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.691897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.691897+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.691897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:58.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'282","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.391622+0000","last_change":"2024-08-27T03:59:07.391622+0000","last_active":"2024-08-27T03:59:07.391622+0000","last_peered":"2024-08-27T03:59:07.391622+0000","last_clean":"2024-08-27T03:59:07.391622+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:59:07.391622+0000","last_undegraded":"2024-08-27T03:59:07.391622+0000","last_fullsized":"2024-08-27T03:59:07.391622+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'282","last_scrub_stamp":"2024-08-27T03:59:07.391429+0000","last_deep_scrub":"267'282","last_deep_scrub_stamp":"2024-08-27T03:59:07.391429+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.391429+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:47:31.823774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1176,"num_write":390,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.621075+0000","last_change":"2024-08-27T03:59:08.621075+0000","last_active":"2024-08-27T03:59:08.621075+0000","last_peered":"2024-08-27T03:59:08.621075+0000","last_clean":"2024-08-27T03:59:08.621075+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:59:08.621075+0000","last_undegraded":"2024-08-27T03:59:08.621075+0000","last_fullsized":"2024-08-27T03:59:08.621075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.620858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.620858+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.620858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:16:55.316384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'183","reported_seq":1665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.801735+0000","last_change":"2024-08-27T03:59:09.801735+0000","last_active":"2024-08-27T03:59:09.801735+0000","last_peered":"2024-08-27T03:59:09.801735+0000","last_clean":"2024-08-27T03:59:09.801735+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:59:09.801735+0000","last_undegraded":"2024-08-27T03:59:09.801735+0000","last_fullsized":"2024-08-27T03:59:09.801735+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-08-27T03:59:09.801532+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-08-27T03:59:09.801532+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.801532+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:55:31.827352+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'552","reported_seq":2377,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.721278+0000","last_change":"2024-08-27T03:58:47.721278+0000","last_active":"2024-08-27T03:58:47.721278+0000","last_peered":"2024-08-27T03:58:47.721278+0000","last_clean":"2024-08-27T03:58:47.721278+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:58:47.721278+0000","last_undegraded":"2024-08-27T03:58:47.721278+0000","last_fullsized":"2024-08-27T03:58:47.721278+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'552","last_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_deep_scrub":"267'552","last_deep_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.721071+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:43:33.741639+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'295","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.460166+0000","last_change":"2024-08-27T03:58:36.460166+0000","last_active":"2024-08-27T03:58:36.460166+0000","last_peered":"2024-08-27T03:58:36.460166+0000","last_clean":"2024-08-27T03:58:36.460166+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:36.460166+0000","last_undegraded":"2024-08-27T03:58:36.460166+0000","last_fullsized":"2024-08-27T03:58:36.460166+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.460054+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:47.971880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":5169,"num_write":1020,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.024903+0000","last_change":"2024-08-27T03:58:52.024903+0000","last_active":"2024-08-27T03:58:52.024903+0000","last_peered":"2024-08-27T03:58:52.024903+0000","last_clean":"2024-08-27T03:58:52.024903+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:58:52.024903+0000","last_undegraded":"2024-08-27T03:58:52.024903+0000","last_fullsized":"2024-08-27T03:58:52.024903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.024712+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:21.647892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'310","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.626979+0000","last_change":"2024-08-27T03:59:09.626979+0000","last_active":"2024-08-27T03:59:09.626979+0000","last_peered":"2024-08-27T03:59:09.626979+0000","last_clean":"2024-08-27T03:59:09.626979+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:59:09.626979+0000","last_undegraded":"2024-08-27T03:59:09.626979+0000","last_fullsized":"2024-08-27T03:59:09.626979+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'310","last_scrub_stamp":"2024-08-27T03:59:09.626754+0000","last_deep_scrub":"267'310","last_deep_scrub_stamp":"2024-08-27T03:59:09.626754+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.626754+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:02:45.876241+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1035,"num_write":382,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.544042+0000","last_change":"2024-08-27T03:59:09.544042+0000","last_active":"2024-08-27T03:59:09.544042+0000","last_peered":"2024-08-27T03:59:09.544042+0000","last_clean":"2024-08-27T03:59:09.544042+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:59:09.544042+0000","last_undegraded":"2024-08-27T03:59:09.544042+0000","last_fullsized":"2024-08-27T03:59:09.544042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.543866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.543866+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.543866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:12:51.370345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'147","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.629559+0000","last_change":"2024-08-27T03:59:10.629559+0000","last_active":"2024-08-27T03:59:10.629559+0000","last_peered":"2024-08-27T03:59:10.629559+0000","last_clean":"2024-08-27T03:59:10.629559+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:59:10.629559+0000","last_undegraded":"2024-08-27T03:59:10.629559+0000","last_fullsized":"2024-08-27T03:59:10.629559+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-08-27T03:59:10.629375+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-08-27T03:59:10.629375+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.629375+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:56:39.220441+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'735","reported_seq":2165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.025008+0000","last_change":"2024-08-27T03:58:50.025008+0000","last_active":"2024-08-27T03:58:50.025008+0000","last_peered":"2024-08-27T03:58:50.025008+0000","last_clean":"2024-08-27T03:58:50.025008+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:58:50.025008+0000","last_undegraded":"2024-08-27T03:58:50.025008+0000","last_fullsized":"2024-08-27T03:58:50.025008+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.024830+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:49:32.647435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'329","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.800869+0000","last_change":"2024-08-27T03:58:42.800869+0000","last_active":"2024-08-27T03:58:42.800869+0000","last_peered":"2024-08-27T03:58:42.800869+0000","last_clean":"2024-08-27T03:58:42.800869+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:42.800869+0000","last_undegraded":"2024-08-27T03:58:42.800869+0000","last_fullsized":"2024-08-27T03:58:42.800869+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.800622+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:33:49.686872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":48183,"num_write":1083,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'442","reported_seq":1929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.120033+0000","last_change":"2024-08-27T03:58:48.120033+0000","last_active":"2024-08-27T03:58:48.120033+0000","last_peered":"2024-08-27T03:58:48.120033+0000","last_clean":"2024-08-27T03:58:48.120033+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:58:48.120033+0000","last_undegraded":"2024-08-27T03:58:48.120033+0000","last_fullsized":"2024-08-27T03:58:48.120033+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.119733+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:29.430226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3054,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'381","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.564535+0000","last_change":"2024-08-27T03:58:38.564535+0000","last_active":"2024-08-27T03:58:38.564535+0000","last_peered":"2024-08-27T03:58:38.564535+0000","last_clean":"2024-08-27T03:58:38.564535+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:38.564535+0000","last_undegraded":"2024-08-27T03:58:38.564535+0000","last_fullsized":"2024-08-27T03:58:38.564535+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.564446+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:04.060769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4832339,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":9918,"num_write":1168,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'478","reported_seq":2162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.793519+0000","last_change":"2024-08-27T03:58:52.793519+0000","last_active":"2024-08-27T03:58:52.793519+0000","last_peered":"2024-08-27T03:58:52.793519+0000","last_clean":"2024-08-27T03:58:52.793519+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:58:52.793519+0000","last_undegraded":"2024-08-27T03:58:52.793519+0000","last_fullsized":"2024-08-27T03:58:52.793519+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.793225+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:15:04.836952+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'405","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.611678+0000","last_change":"2024-08-27T03:58:41.611512+0000","last_active":"2024-08-27T03:58:41.611678+0000","last_peered":"2024-08-27T03:58:41.611678+0000","last_clean":"2024-08-27T03:58:41.611678+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:41.611678+0000","last_undegraded":"2024-08-27T03:58:41.611678+0000","last_fullsized":"2024-08-27T03:58:41.611678+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.611152+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:19.609163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":15883,"num_write":1180,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'572","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.069728+0000","last_change":"2024-08-27T03:58:49.069728+0000","last_active":"2024-08-27T03:58:49.069728+0000","last_peered":"2024-08-27T03:58:49.069728+0000","last_clean":"2024-08-27T03:58:49.069728+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:58:49.069728+0000","last_undegraded":"2024-08-27T03:58:49.069728+0000","last_fullsized":"2024-08-27T03:58:49.069728+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'572","last_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_deep_scrub":"267'572","last_deep_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.069503+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:29:30.858578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'308","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.438198+0000","last_change":"2024-08-27T03:58:41.438047+0000","last_active":"2024-08-27T03:58:41.438198+0000","last_peered":"2024-08-27T03:58:41.438198+0000","last_clean":"2024-08-27T03:58:41.438198+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:41.438198+0000","last_undegraded":"2024-08-27T03:58:41.438198+0000","last_fullsized":"2024-08-27T03:58:41.438198+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.437794+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:06.786909+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":27259,"num_write":1007,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'609","reported_seq":2176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.308907+0000","last_change":"2024-08-27T03:58:55.308752+0000","last_active":"2024-08-27T03:58:55.308907+0000","last_peered":"2024-08-27T03:58:55.308907+0000","last_clean":"2024-08-27T03:58:55.308907+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:55.308907+0000","last_undegraded":"2024-08-27T03:58:55.308907+0000","last_fullsized":"2024-08-27T03:58:55.308907+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'609","last_scrub_stamp":"2024-08-27T03:58:55.308542+0000","last_deep_scrub":"267'609","last_deep_scrub_stamp":"2024-08-27T03:58:55.308542+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.308542+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:15:31.633356+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'362","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.146680+0000","last_change":"2024-08-27T03:58:43.146680+0000","last_active":"2024-08-27T03:58:43.146680+0000","last_peered":"2024-08-27T03:58:43.146680+0000","last_clean":"2024-08-27T03:58:43.146680+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:43.146680+0000","last_undegraded":"2024-08-27T03:58:43.146680+0000","last_fullsized":"2024-08-27T03:58:43.146680+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.146441+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:58:04.187894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589954,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":45255,"num_write":1058,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'439","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.642061+0000","last_change":"2024-08-27T03:58:51.642061+0000","last_active":"2024-08-27T03:58:51.642061+0000","last_peered":"2024-08-27T03:58:51.642061+0000","last_clean":"2024-08-27T03:58:51.642061+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:58:51.642061+0000","last_undegraded":"2024-08-27T03:58:51.642061+0000","last_fullsized":"2024-08-27T03:58:51.642061+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.641812+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:39.903323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'354","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.112270+0000","last_change":"2024-08-27T03:58:40.112270+0000","last_active":"2024-08-27T03:58:40.112270+0000","last_peered":"2024-08-27T03:58:40.112270+0000","last_clean":"2024-08-27T03:58:40.112270+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:40.112270+0000","last_undegraded":"2024-08-27T03:58:40.112270+0000","last_fullsized":"2024-08-27T03:58:40.112270+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.112024+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:55:42.841093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":26119,"num_write":1309,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'576","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.310387+0000","last_change":"2024-08-27T03:58:56.310387+0000","last_active":"2024-08-27T03:58:56.310387+0000","last_peered":"2024-08-27T03:58:56.310387+0000","last_clean":"2024-08-27T03:58:56.310387+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:56.310387+0000","last_undegraded":"2024-08-27T03:58:56.310387+0000","last_fullsized":"2024-08-27T03:58:56.310387+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'576","last_scrub_stamp":"2024-08-27T03:58:56.310189+0000","last_deep_scrub":"267'576","last_deep_scrub_stamp":"2024-08-27T03:58:56.310189+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.310189+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:08.825046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2552,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'308","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.582428+0000","last_change":"2024-08-27T03:58:39.582428+0000","last_active":"2024-08-27T03:58:39.582428+0000","last_peered":"2024-08-27T03:58:39.582428+0000","last_clean":"2024-08-27T03:58:39.582428+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:39.582428+0000","last_undegraded":"2024-08-27T03:58:39.582428+0000","last_fullsized":"2024-08-27T03:58:39.582428+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.582204+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:55:21.476541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307067,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":100247,"num_write":1030,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'454","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.736038+0000","last_change":"2024-08-27T03:58:48.736038+0000","last_active":"2024-08-27T03:58:48.736038+0000","last_peered":"2024-08-27T03:58:48.736038+0000","last_clean":"2024-08-27T03:58:48.736038+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:58:48.736038+0000","last_undegraded":"2024-08-27T03:58:48.736038+0000","last_fullsized":"2024-08-27T03:58:48.736038+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.735856+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:12:29.368472+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2019,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'357","reported_seq":1060,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.173217+0000","last_change":"2024-08-27T03:58:44.173217+0000","last_active":"2024-08-27T03:58:44.173217+0000","last_peered":"2024-08-27T03:58:44.173217+0000","last_clean":"2024-08-27T03:58:44.173217+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:44.173217+0000","last_undegraded":"2024-08-27T03:58:44.173217+0000","last_fullsized":"2024-08-27T03:58:44.173217+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.172971+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:58.313423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":565,"num_read_kb":99962,"num_write":1217,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'362","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.516342+0000","last_change":"2024-08-27T03:58:50.516342+0000","last_active":"2024-08-27T03:58:50.516342+0000","last_peered":"2024-08-27T03:58:50.516342+0000","last_clean":"2024-08-27T03:58:50.516342+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:50.516342+0000","last_undegraded":"2024-08-27T03:58:50.516342+0000","last_fullsized":"2024-08-27T03:58:50.516342+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.516132+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:42.736992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'281","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.755250+0000","last_change":"2024-08-27T03:58:43.755250+0000","last_active":"2024-08-27T03:58:43.755250+0000","last_peered":"2024-08-27T03:58:43.755250+0000","last_clean":"2024-08-27T03:58:43.755250+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:43.755250+0000","last_undegraded":"2024-08-27T03:58:43.755250+0000","last_fullsized":"2024-08-27T03:58:43.755250+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'281","last_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_deep_scrub":"267'281","last_deep_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.755021+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:17:25.889381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":397,"num_read_kb":6749,"num_write":934,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'640","reported_seq":2336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.655397+0000","last_change":"2024-08-27T03:58:53.655397+0000","last_active":"2024-08-27T03:58:53.655397+0000","last_peered":"2024-08-27T03:58:53.655397+0000","last_clean":"2024-08-27T03:58:53.655397+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:58:53.655397+0000","last_undegraded":"2024-08-27T03:58:53.655397+0000","last_fullsized":"2024-08-27T03:58:53.655397+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'640","last_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_deep_scrub":"267'640","last_deep_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.655199+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:10:17.157916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.138975+0000","last_change":"2024-08-27T03:58:46.138796+0000","last_active":"2024-08-27T03:58:46.138975+0000","last_peered":"2024-08-27T03:58:46.138975+0000","last_clean":"2024-08-27T03:58:46.138975+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:46.138975+0000","last_undegraded":"2024-08-27T03:58:46.138975+0000","last_fullsized":"2024-08-27T03:58:46.138975+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.138421+0000","objects_scrubbed":14,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:00:21.270930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2798159,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":560,"num_read_kb":2754,"num_write":1269,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'438","reported_seq":1962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.558722+0000","last_change":"2024-08-27T03:58:44.558545+0000","last_active":"2024-08-27T03:58:44.558722+0000","last_peered":"2024-08-27T03:58:44.558722+0000","last_clean":"2024-08-27T03:58:44.558722+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:58:44.558722+0000","last_undegraded":"2024-08-27T03:58:44.558722+0000","last_fullsized":"2024-08-27T03:58:44.558722+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.558365+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:06:32.373887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'313","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.746753+0000","last_change":"2024-08-27T03:58:42.746489+0000","last_active":"2024-08-27T03:58:42.746753+0000","last_peered":"2024-08-27T03:58:42.746753+0000","last_clean":"2024-08-27T03:58:42.746753+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:42.746753+0000","last_undegraded":"2024-08-27T03:58:42.746753+0000","last_fullsized":"2024-08-27T03:58:42.746753+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.746119+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:28:53.493047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":2564,"num_write":1048,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'614","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.680745+0000","last_change":"2024-08-27T03:58:52.680599+0000","last_active":"2024-08-27T03:58:52.680745+0000","last_peered":"2024-08-27T03:58:52.680745+0000","last_clean":"2024-08-27T03:58:52.680745+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:58:52.680745+0000","last_undegraded":"2024-08-27T03:58:52.680745+0000","last_fullsized":"2024-08-27T03:58:52.680745+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'614","last_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_deep_scrub":"267'614","last_deep_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.680388+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:22.858376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3063,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":1135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.392992+0000","last_change":"2024-08-27T03:58:42.392831+0000","last_active":"2024-08-27T03:58:42.392992+0000","last_peered":"2024-08-27T03:58:42.392992+0000","last_clean":"2024-08-27T03:58:42.392992+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:42.392992+0000","last_undegraded":"2024-08-27T03:58:42.392992+0000","last_fullsized":"2024-08-27T03:58:42.392992+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.392600+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:02.371839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":686594,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":79613,"num_write":1033,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'505","reported_seq":2138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.928880+0000","last_change":"2024-08-27T03:58:52.928741+0000","last_active":"2024-08-27T03:58:52.928880+0000","last_peered":"2024-08-27T03:58:52.928880+0000","last_clean":"2024-08-27T03:58:52.928880+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:58:52.928880+0000","last_undegraded":"2024-08-27T03:58:52.928880+0000","last_fullsized":"2024-08-27T03:58:52.928880+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'505","last_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_deep_scrub":"267'505","last_deep_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.928533+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:07.897474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'307","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.809517+0000","last_change":"2024-08-27T03:58:40.809278+0000","last_active":"2024-08-27T03:58:40.809517+0000","last_peered":"2024-08-27T03:58:40.809517+0000","last_clean":"2024-08-27T03:58:40.809517+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:40.809517+0000","last_undegraded":"2024-08-27T03:58:40.809517+0000","last_fullsized":"2024-08-27T03:58:40.809517+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.808995+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:03:10.468667+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911567,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":603,"num_read_kb":25477,"num_write":981,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'803","reported_seq":2706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.528961+0000","last_change":"2024-08-27T03:58:53.528826+0000","last_active":"2024-08-27T03:58:53.528961+0000","last_peered":"2024-08-27T03:58:53.528961+0000","last_clean":"2024-08-27T03:58:53.528961+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:53.528961+0000","last_undegraded":"2024-08-27T03:58:53.528961+0000","last_fullsized":"2024-08-27T03:58:53.528961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'803","last_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_deep_scrub":"267'803","last_deep_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.528622+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:57.111154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'311","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.903956+0000","last_change":"2024-08-27T03:58:46.903809+0000","last_active":"2024-08-27T03:58:46.903956+0000","last_peered":"2024-08-27T03:58:46.903956+0000","last_clean":"2024-08-27T03:58:46.903956+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:46.903956+0000","last_undegraded":"2024-08-27T03:58:46.903956+0000","last_fullsized":"2024-08-27T03:58:46.903956+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.903570+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:32:09.302081+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311643,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":75812,"num_write":989,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'418","reported_seq":1907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.297174+0000","last_change":"2024-08-27T03:58:59.297174+0000","last_active":"2024-08-27T03:58:59.297174+0000","last_peered":"2024-08-27T03:58:59.297174+0000","last_clean":"2024-08-27T03:58:59.297174+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:58:59.297174+0000","last_undegraded":"2024-08-27T03:58:59.297174+0000","last_fullsized":"2024-08-27T03:58:59.297174+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'418","last_scrub_stamp":"2024-08-27T03:58:59.296967+0000","last_deep_scrub":"267'418","last_deep_scrub_stamp":"2024-08-27T03:58:59.296967+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.296967+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:42.487638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'422","reported_seq":1349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.595085+0000","last_change":"2024-08-27T03:58:42.595085+0000","last_active":"2024-08-27T03:58:42.595085+0000","last_peered":"2024-08-27T03:58:42.595085+0000","last_clean":"2024-08-27T03:58:42.595085+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:42.595085+0000","last_undegraded":"2024-08-27T03:58:42.595085+0000","last_fullsized":"2024-08-27T03:58:42.595085+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.594805+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:16.906357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1005,"num_read_kb":143555,"num_write":1198,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'387","reported_seq":1799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.901866+0000","last_change":"2024-08-27T03:58:45.901866+0000","last_active":"2024-08-27T03:58:45.901866+0000","last_peered":"2024-08-27T03:58:45.901866+0000","last_clean":"2024-08-27T03:58:45.901866+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:58:45.901866+0000","last_undegraded":"2024-08-27T03:58:45.901866+0000","last_fullsized":"2024-08-27T03:58:45.901866+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.901684+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:11:59.846712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'359","reported_seq":1058,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.749864+0000","last_change":"2024-08-27T03:58:44.749864+0000","last_active":"2024-08-27T03:58:44.749864+0000","last_peered":"2024-08-27T03:58:44.749864+0000","last_clean":"2024-08-27T03:58:44.749864+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:44.749864+0000","last_undegraded":"2024-08-27T03:58:44.749864+0000","last_fullsized":"2024-08-27T03:58:44.749864+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.749636+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:42.137274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":596,"num_read_kb":11844,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'342","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.754972+0000","last_change":"2024-08-27T03:58:45.754972+0000","last_active":"2024-08-27T03:58:45.754972+0000","last_peered":"2024-08-27T03:58:45.754972+0000","last_clean":"2024-08-27T03:58:45.754972+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:45.754972+0000","last_undegraded":"2024-08-27T03:58:45.754972+0000","last_fullsized":"2024-08-27T03:58:45.754972+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.754732+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:10.198393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":4948,"num_write":1064,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'382","reported_seq":2040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.532613+0000","last_change":"2024-08-27T03:58:55.532613+0000","last_active":"2024-08-27T03:58:55.532613+0000","last_peered":"2024-08-27T03:58:55.532613+0000","last_clean":"2024-08-27T03:58:55.532613+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:58:55.532613+0000","last_undegraded":"2024-08-27T03:58:55.532613+0000","last_fullsized":"2024-08-27T03:58:55.532613+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-08-27T03:58:55.532420+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-08-27T03:58:55.532420+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.532420+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:42:31.047679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'342","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.113500+0000","last_change":"2024-08-27T03:58:42.113500+0000","last_active":"2024-08-27T03:58:42.113500+0000","last_peered":"2024-08-27T03:58:42.113500+0000","last_clean":"2024-08-27T03:58:42.113500+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:42.113500+0000","last_undegraded":"2024-08-27T03:58:42.113500+0000","last_fullsized":"2024-08-27T03:58:42.113500+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.113238+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:33.105083+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381353,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":621,"num_read_kb":18083,"num_write":1130,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.823347+0000","last_change":"2024-08-27T03:58:54.823347+0000","last_active":"2024-08-27T03:58:54.823347+0000","last_peered":"2024-08-27T03:58:54.823347+0000","last_clean":"2024-08-27T03:58:54.823347+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:54.823347+0000","last_undegraded":"2024-08-27T03:58:54.823347+0000","last_fullsized":"2024-08-27T03:58:54.823347+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'698","last_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_deep_scrub":"267'698","last_deep_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.823157+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:51:42.227530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3485,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1042,"ondisk_log_size":1042,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1585,"ondisk_log_size":1585,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":461,"ondisk_log_size":461,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1439020,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19446,"num_read_kb":39405,"num_write":16215,"num_write_kb":11798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677494,"num_omap_keys":1546,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44329,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4105,"ondisk_log_size":4105,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65339946,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":35598,"num_read_kb":1916438,"num_write":70403,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89604096,"data_stored":89604096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3354,"ondisk_log_size":3354,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":208074,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198799,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510508,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192136,"kb_used_data":12472,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94179704,"statfs":{"total":96636764160,"available":96440016896,"internally_reserved":0,"allocated":12771328,"data_stored":10781565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543217,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339224,"kb_used_data":15112,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94032616,"statfs":{"total":96636764160,"available":96289398784,"internally_reserved":0,"allocated":15474688,"data_stored":13471118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543218,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305116,"kb_used_data":17100,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94066724,"statfs":{"total":96636764160,"available":96324325376,"internally_reserved":0,"allocated":17510400,"data_stored":15551496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543215,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162756,"kb_used_data":15028,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94209084,"statfs":{"total":96636764160,"available":96470102016,"internally_reserved":0,"allocated":15388672,"data_stored":13349611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543214,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134208,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94237632,"statfs":{"total":96636764160,"available":96499335168,"internally_reserved":0,"allocated":17350656,"data_stored":15406568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543216,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293612,"kb_used_data":13916,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94078228,"statfs":{"total":96636764160,"available":96336105472,"internally_reserved":0,"allocated":14249984,"data_stored":12236496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543218,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113428,"kb_used_data":14212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94258412,"statfs":{"total":96636764160,"available":96520613888,"internally_reserved":0,"allocated":14553088,"data_stored":12591031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543216,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301160,"kb_used_data":17368,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94070680,"statfs":{"total":96636764160,"available":96328376320,"internally_reserved":0,"allocated":17784832,"data_stored":15748401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":12861440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8486912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10297344,"data_stored":10297344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9940992,"data_stored":9940992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13115392,"data_stored":13115392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11055104,"data_stored":11055104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13258752,"data_stored":13258752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10588160,"data_stored":10588160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T03:59:39.981 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.981 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.981 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-08-27T02:50:54.731776+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=2, tm_min=50, tm_sec=54, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.982 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.982 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.982 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.982 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.983 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-08-27T03:10:44.232885+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=10, tm_sec=44, tm_wday=1, tm_yday=240, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=27, tm_hour=3, tm_min=58, tm_sec=33, tm_wday=1, tm_yday=240, tm_isdst=0) 2024-08-27T03:59:39.986 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-27T03:59:59.988 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-27T04:00:00.347 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-08-27T04:00:00.360 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-08-27T04:00:00.375 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":2936,"stamp":"2024-08-27T03:59:59.343450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67386791,"num_objects":861,"num_object_clones":0,"num_object_copies":2456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":861,"num_whiteouts":0,"num_read":287806,"num_read_kb":2575721,"num_write":159683,"num_write_kb":2372746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":729192,"num_omap_keys":1762,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12921,"ondisk_log_size":12921,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1841640,"kb_used_data":122152,"kb_used_omap":12,"kb_used_meta":1719347,"kb_avail":753133080,"statfs":{"total":773094113280,"available":771208273920,"internally_reserved":0,"allocated":125083648,"data_stored":109136286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1760611889},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009391"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.898174+0000","last_change":"2024-08-27T03:59:22.898174+0000","last_active":"2024-08-27T03:59:22.898174+0000","last_peered":"2024-08-27T03:59:22.898174+0000","last_clean":"2024-08-27T03:59:22.898174+0000","last_became_active":"2024-08-27T03:10:45.291068+0000","last_became_peered":"2024-08-27T03:10:45.291068+0000","last_unstale":"2024-08-27T03:59:22.898174+0000","last_undegraded":"2024-08-27T03:59:22.898174+0000","last_fullsized":"2024-08-27T03:59:22.898174+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:22.897989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:22.897989+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.897989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:26.784629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"267'9","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.940068+0000","last_change":"2024-08-27T03:59:21.940068+0000","last_active":"2024-08-27T03:59:21.940068+0000","last_peered":"2024-08-27T03:59:21.940068+0000","last_clean":"2024-08-27T03:59:21.940068+0000","last_became_active":"2024-08-27T02:50:55.798500+0000","last_became_peered":"2024-08-27T02:50:55.798500+0000","last_unstale":"2024-08-27T03:59:21.940068+0000","last_undegraded":"2024-08-27T03:59:21.940068+0000","last_fullsized":"2024-08-27T03:59:21.940068+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-08-27T03:59:21.939885+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-08-27T03:59:21.939885+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.939885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:54:44.231898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20480,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:27.281295+0000","last_change":"2024-08-27T03:59:27.281295+0000","last_active":"2024-08-27T03:59:27.281295+0000","last_peered":"2024-08-27T03:59:27.281295+0000","last_clean":"2024-08-27T03:59:27.281295+0000","last_became_active":"2024-08-27T02:50:51.728471+0000","last_became_peered":"2024-08-27T02:50:51.728471+0000","last_unstale":"2024-08-27T03:59:27.281295+0000","last_undegraded":"2024-08-27T03:59:27.281295+0000","last_fullsized":"2024-08-27T03:59:27.281295+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:27.281104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:27.281104+0000","last_clean_scrub_stamp":"2024-08-27T03:59:27.281104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:57:19.347139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'44","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.579932+0000","last_change":"2024-08-27T03:59:22.579783+0000","last_active":"2024-08-27T03:59:22.579932+0000","last_peered":"2024-08-27T03:59:22.579932+0000","last_clean":"2024-08-27T03:59:22.579932+0000","last_became_active":"2024-08-27T02:46:49.662829+0000","last_became_peered":"2024-08-27T02:46:49.662829+0000","last_unstale":"2024-08-27T03:59:22.579932+0000","last_undegraded":"2024-08-27T03:59:22.579932+0000","last_fullsized":"2024-08-27T03:59:22.579932+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'44","last_scrub_stamp":"2024-08-27T03:59:22.579596+0000","last_deep_scrub":"267'44","last_deep_scrub_stamp":"2024-08-27T03:59:22.579596+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.579596+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:48:13.517742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":160,"num_write":79,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.746197+0000","last_change":"2024-08-27T03:59:08.746197+0000","last_active":"2024-08-27T03:59:08.746197+0000","last_peered":"2024-08-27T03:59:08.746197+0000","last_clean":"2024-08-27T03:59:08.746197+0000","last_became_active":"2024-08-27T03:10:45.286157+0000","last_became_peered":"2024-08-27T03:10:45.286157+0000","last_unstale":"2024-08-27T03:59:08.746197+0000","last_undegraded":"2024-08-27T03:59:08.746197+0000","last_fullsized":"2024-08-27T03:59:08.746197+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.746006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.746006+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.746006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:47:08.897021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'4","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.632392+0000","last_change":"2024-08-27T03:59:24.632392+0000","last_active":"2024-08-27T03:59:24.632392+0000","last_peered":"2024-08-27T03:59:24.632392+0000","last_clean":"2024-08-27T03:59:24.632392+0000","last_became_active":"2024-08-27T02:50:55.770976+0000","last_became_peered":"2024-08-27T02:50:55.770976+0000","last_unstale":"2024-08-27T03:59:24.632392+0000","last_undegraded":"2024-08-27T03:59:24.632392+0000","last_fullsized":"2024-08-27T03:59:24.632392+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:24.632207+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:24.632207+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.632207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:42:34.372242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6673,"num_write":4,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.201955+0000","last_change":"2024-08-27T03:59:09.201955+0000","last_active":"2024-08-27T03:59:09.201955+0000","last_peered":"2024-08-27T03:59:09.201955+0000","last_clean":"2024-08-27T03:59:09.201955+0000","last_became_active":"2024-08-27T02:50:51.731507+0000","last_became_peered":"2024-08-27T02:50:51.731507+0000","last_unstale":"2024-08-27T03:59:09.201955+0000","last_undegraded":"2024-08-27T03:59:09.201955+0000","last_fullsized":"2024-08-27T03:59:09.201955+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.201764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.201764+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.201764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:29:18.110424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.598339+0000","last_change":"2024-08-27T03:58:58.598204+0000","last_active":"2024-08-27T03:58:58.598339+0000","last_peered":"2024-08-27T03:58:58.598339+0000","last_clean":"2024-08-27T03:58:58.598339+0000","last_became_active":"2024-08-27T02:46:49.676158+0000","last_became_peered":"2024-08-27T02:46:49.676158+0000","last_unstale":"2024-08-27T03:58:58.598339+0000","last_undegraded":"2024-08-27T03:58:58.598339+0000","last_fullsized":"2024-08-27T03:58:58.598339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.598012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.598012+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.598012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:05:32.629463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.407284+0000","last_change":"2024-08-27T03:59:13.407284+0000","last_active":"2024-08-27T03:59:13.407284+0000","last_peered":"2024-08-27T03:59:13.407284+0000","last_clean":"2024-08-27T03:59:13.407284+0000","last_became_active":"2024-08-27T03:10:45.289555+0000","last_became_peered":"2024-08-27T03:10:45.289555+0000","last_unstale":"2024-08-27T03:59:13.407284+0000","last_undegraded":"2024-08-27T03:59:13.407284+0000","last_fullsized":"2024-08-27T03:59:13.407284+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:13.407108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:13.407108+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.407108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:52:47.993833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:29.762041+0000","last_change":"2024-08-27T03:59:29.761905+0000","last_active":"2024-08-27T03:59:29.762041+0000","last_peered":"2024-08-27T03:59:29.762041+0000","last_clean":"2024-08-27T03:59:29.762041+0000","last_became_active":"2024-08-27T02:50:55.790826+0000","last_became_peered":"2024-08-27T02:50:55.790826+0000","last_unstale":"2024-08-27T03:59:29.762041+0000","last_undegraded":"2024-08-27T03:59:29.762041+0000","last_fullsized":"2024-08-27T03:59:29.762041+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:29.761704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:29.761704+0000","last_clean_scrub_stamp":"2024-08-27T03:59:29.761704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:05.585728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'11","reported_seq":92,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.632523+0000","last_change":"2024-08-27T03:59:04.632379+0000","last_active":"2024-08-27T03:59:04.632523+0000","last_peered":"2024-08-27T03:59:04.632523+0000","last_clean":"2024-08-27T03:59:04.632523+0000","last_became_active":"2024-08-27T02:50:51.727887+0000","last_became_peered":"2024-08-27T02:50:51.727887+0000","last_unstale":"2024-08-27T03:59:04.632523+0000","last_undegraded":"2024-08-27T03:59:04.632523+0000","last_fullsized":"2024-08-27T03:59:04.632523+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-08-27T03:59:04.632165+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-08-27T03:59:04.632165+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.632165+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:22:34.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21563,"num_write":16,"num_write_kb":16443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'55","reported_seq":220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.605077+0000","last_change":"2024-08-27T03:59:20.605077+0000","last_active":"2024-08-27T03:59:20.605077+0000","last_peered":"2024-08-27T03:59:20.605077+0000","last_clean":"2024-08-27T03:59:20.605077+0000","last_became_active":"2024-08-27T02:46:49.652512+0000","last_became_peered":"2024-08-27T02:46:49.652512+0000","last_unstale":"2024-08-27T03:59:20.605077+0000","last_undegraded":"2024-08-27T03:59:20.605077+0000","last_fullsized":"2024-08-27T03:59:20.605077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'55","last_scrub_stamp":"2024-08-27T03:59:20.604839+0000","last_deep_scrub":"267'55","last_deep_scrub_stamp":"2024-08-27T03:59:20.604839+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.604839+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:12:15.827096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":197,"num_write":100,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:39.369896+0000","last_change":"2024-08-27T03:59:39.369896+0000","last_active":"2024-08-27T03:59:39.369896+0000","last_peered":"2024-08-27T03:59:39.369896+0000","last_clean":"2024-08-27T03:59:39.369896+0000","last_became_active":"2024-08-27T03:10:45.280503+0000","last_became_peered":"2024-08-27T03:10:45.280503+0000","last_unstale":"2024-08-27T03:59:39.369896+0000","last_undegraded":"2024-08-27T03:59:39.369896+0000","last_fullsized":"2024-08-27T03:59:39.369896+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:39.369702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:39.369702+0000","last_clean_scrub_stamp":"2024-08-27T03:59:39.369702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:28:34.489452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:34.277052+0000","last_change":"2024-08-27T03:59:34.277052+0000","last_active":"2024-08-27T03:59:34.277052+0000","last_peered":"2024-08-27T03:59:34.277052+0000","last_clean":"2024-08-27T03:59:34.277052+0000","last_became_active":"2024-08-27T02:50:55.793586+0000","last_became_peered":"2024-08-27T02:50:55.793586+0000","last_unstale":"2024-08-27T03:59:34.277052+0000","last_undegraded":"2024-08-27T03:59:34.277052+0000","last_fullsized":"2024-08-27T03:59:34.277052+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:34.276853+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:34.276853+0000","last_clean_scrub_stamp":"2024-08-27T03:59:34.276853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:14.491300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.632805+0000","last_change":"2024-08-27T03:59:18.632665+0000","last_active":"2024-08-27T03:59:18.632805+0000","last_peered":"2024-08-27T03:59:18.632805+0000","last_clean":"2024-08-27T03:59:18.632805+0000","last_became_active":"2024-08-27T02:50:51.719701+0000","last_became_peered":"2024-08-27T02:50:51.719701+0000","last_unstale":"2024-08-27T03:59:18.632805+0000","last_undegraded":"2024-08-27T03:59:18.632805+0000","last_fullsized":"2024-08-27T03:59:18.632805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-08-27T03:59:18.632471+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-08-27T03:59:18.632471+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.632471+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:24:13.280986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'38","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.275578+0000","last_change":"2024-08-27T03:59:24.275578+0000","last_active":"2024-08-27T03:59:24.275578+0000","last_peered":"2024-08-27T03:59:24.275578+0000","last_clean":"2024-08-27T03:59:24.275578+0000","last_became_active":"2024-08-27T02:46:49.673632+0000","last_became_peered":"2024-08-27T02:46:49.673632+0000","last_unstale":"2024-08-27T03:59:24.275578+0000","last_undegraded":"2024-08-27T03:59:24.275578+0000","last_fullsized":"2024-08-27T03:59:24.275578+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-08-27T03:59:24.275358+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-08-27T03:59:24.275358+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.275358+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:31.516678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":146,"num_write":61,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:40.358234+0000","last_change":"2024-08-27T03:59:40.358234+0000","last_active":"2024-08-27T03:59:40.358234+0000","last_peered":"2024-08-27T03:59:40.358234+0000","last_clean":"2024-08-27T03:59:40.358234+0000","last_became_active":"2024-08-27T03:10:45.288800+0000","last_became_peered":"2024-08-27T03:10:45.288800+0000","last_unstale":"2024-08-27T03:59:40.358234+0000","last_undegraded":"2024-08-27T03:59:40.358234+0000","last_fullsized":"2024-08-27T03:59:40.358234+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:40.358049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:40.358049+0000","last_clean_scrub_stamp":"2024-08-27T03:59:40.358049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:48:32.332522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.974067+0000","last_change":"2024-08-27T03:59:20.974067+0000","last_active":"2024-08-27T03:59:20.974067+0000","last_peered":"2024-08-27T03:59:20.974067+0000","last_clean":"2024-08-27T03:59:20.974067+0000","last_became_active":"2024-08-27T02:50:55.805547+0000","last_became_peered":"2024-08-27T02:50:55.805547+0000","last_unstale":"2024-08-27T03:59:20.974067+0000","last_undegraded":"2024-08-27T03:59:20.974067+0000","last_fullsized":"2024-08-27T03:59:20.974067+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:20.973799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:20.973799+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.973799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:31:43.803727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.670058+0000","last_change":"2024-08-27T03:59:26.670058+0000","last_active":"2024-08-27T03:59:26.670058+0000","last_peered":"2024-08-27T03:59:26.670058+0000","last_clean":"2024-08-27T03:59:26.670058+0000","last_became_active":"2024-08-27T02:50:51.719086+0000","last_became_peered":"2024-08-27T02:50:51.719086+0000","last_unstale":"2024-08-27T03:59:26.670058+0000","last_undegraded":"2024-08-27T03:59:26.670058+0000","last_fullsized":"2024-08-27T03:59:26.670058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:26.669870+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:26.669870+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.669870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:06:11.134632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'26","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.311623+0000","last_change":"2024-08-27T03:59:26.311623+0000","last_active":"2024-08-27T03:59:26.311623+0000","last_peered":"2024-08-27T03:59:26.311623+0000","last_clean":"2024-08-27T03:59:26.311623+0000","last_became_active":"2024-08-27T02:46:49.674660+0000","last_became_peered":"2024-08-27T02:46:49.674660+0000","last_unstale":"2024-08-27T03:59:26.311623+0000","last_undegraded":"2024-08-27T03:59:26.311623+0000","last_fullsized":"2024-08-27T03:59:26.311623+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-08-27T03:59:26.311428+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-08-27T03:59:26.311428+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.311428+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:30:40.400030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":82,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.174375+0000","last_change":"2024-08-27T03:59:14.174375+0000","last_active":"2024-08-27T03:59:14.174375+0000","last_peered":"2024-08-27T03:59:14.174375+0000","last_clean":"2024-08-27T03:59:14.174375+0000","last_became_active":"2024-08-27T03:10:45.299811+0000","last_became_peered":"2024-08-27T03:10:45.299811+0000","last_unstale":"2024-08-27T03:59:14.174375+0000","last_undegraded":"2024-08-27T03:59:14.174375+0000","last_fullsized":"2024-08-27T03:59:14.174375+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:14.174178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:14.174178+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.174178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:51:05.667507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.453969+0000","last_change":"2024-08-27T03:59:11.453969+0000","last_active":"2024-08-27T03:59:11.453969+0000","last_peered":"2024-08-27T03:59:11.453969+0000","last_clean":"2024-08-27T03:59:11.453969+0000","last_became_active":"2024-08-27T02:50:55.789216+0000","last_became_peered":"2024-08-27T02:50:55.789216+0000","last_unstale":"2024-08-27T03:59:11.453969+0000","last_undegraded":"2024-08-27T03:59:11.453969+0000","last_fullsized":"2024-08-27T03:59:11.453969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:11.453796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:11.453796+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.453796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:09:33.686927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.668632+0000","last_change":"2024-08-27T03:59:17.668632+0000","last_active":"2024-08-27T03:59:17.668632+0000","last_peered":"2024-08-27T03:59:17.668632+0000","last_clean":"2024-08-27T03:59:17.668632+0000","last_became_active":"2024-08-27T02:50:51.707075+0000","last_became_peered":"2024-08-27T02:50:51.707075+0000","last_unstale":"2024-08-27T03:59:17.668632+0000","last_undegraded":"2024-08-27T03:59:17.668632+0000","last_fullsized":"2024-08-27T03:59:17.668632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:17.668428+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:17.668428+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.668428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:21:11.426359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'18","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.481791+0000","last_change":"2024-08-27T03:59:06.481621+0000","last_active":"2024-08-27T03:59:06.481791+0000","last_peered":"2024-08-27T03:59:06.481791+0000","last_clean":"2024-08-27T03:59:06.481791+0000","last_became_active":"2024-08-27T02:46:49.656375+0000","last_became_peered":"2024-08-27T02:46:49.656375+0000","last_unstale":"2024-08-27T03:59:06.481791+0000","last_undegraded":"2024-08-27T03:59:06.481791+0000","last_fullsized":"2024-08-27T03:59:06.481791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'18","last_scrub_stamp":"2024-08-27T03:59:06.481436+0000","last_deep_scrub":"267'18","last_deep_scrub_stamp":"2024-08-27T03:59:06.481436+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.481436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:11:24.160204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":39,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:33.641781+0000","last_change":"2024-08-27T03:59:33.641781+0000","last_active":"2024-08-27T03:59:33.641781+0000","last_peered":"2024-08-27T03:59:33.641781+0000","last_clean":"2024-08-27T03:59:33.641781+0000","last_became_active":"2024-08-27T03:10:45.292289+0000","last_became_peered":"2024-08-27T03:10:45.292289+0000","last_unstale":"2024-08-27T03:59:33.641781+0000","last_undegraded":"2024-08-27T03:59:33.641781+0000","last_fullsized":"2024-08-27T03:59:33.641781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:33.641589+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:33.641589+0000","last_clean_scrub_stamp":"2024-08-27T03:59:33.641589+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:23:27.267816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"267'6","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.455410+0000","last_change":"2024-08-27T03:59:12.455410+0000","last_active":"2024-08-27T03:59:12.455410+0000","last_peered":"2024-08-27T03:59:12.455410+0000","last_clean":"2024-08-27T03:59:12.455410+0000","last_became_active":"2024-08-27T02:50:55.766198+0000","last_became_peered":"2024-08-27T02:50:55.766198+0000","last_unstale":"2024-08-27T03:59:12.455410+0000","last_undegraded":"2024-08-27T03:59:12.455410+0000","last_fullsized":"2024-08-27T03:59:12.455410+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:12.455234+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:12.455234+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.455234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:00:39.579700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.668639+0000","last_change":"2024-08-27T03:59:19.668639+0000","last_active":"2024-08-27T03:59:19.668639+0000","last_peered":"2024-08-27T03:59:19.668639+0000","last_clean":"2024-08-27T03:59:19.668639+0000","last_became_active":"2024-08-27T02:50:51.737673+0000","last_became_peered":"2024-08-27T02:50:51.737673+0000","last_unstale":"2024-08-27T03:59:19.668639+0000","last_undegraded":"2024-08-27T03:59:19.668639+0000","last_fullsized":"2024-08-27T03:59:19.668639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:19.668427+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:19.668427+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.668427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:48:59.060196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'36","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.584642+0000","last_change":"2024-08-27T03:59:18.584481+0000","last_active":"2024-08-27T03:59:18.584642+0000","last_peered":"2024-08-27T03:59:18.584642+0000","last_clean":"2024-08-27T03:59:18.584642+0000","last_became_active":"2024-08-27T02:46:49.646957+0000","last_became_peered":"2024-08-27T02:46:49.646957+0000","last_unstale":"2024-08-27T03:59:18.584642+0000","last_undegraded":"2024-08-27T03:59:18.584642+0000","last_fullsized":"2024-08-27T03:59:18.584642+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-08-27T03:59:18.584259+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-08-27T03:59:18.584259+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.584259+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:46:00.237348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:32.679267+0000","last_change":"2024-08-27T03:59:32.679267+0000","last_active":"2024-08-27T03:59:32.679267+0000","last_peered":"2024-08-27T03:59:32.679267+0000","last_clean":"2024-08-27T03:59:32.679267+0000","last_became_active":"2024-08-27T03:10:45.284043+0000","last_became_peered":"2024-08-27T03:10:45.284043+0000","last_unstale":"2024-08-27T03:59:32.679267+0000","last_undegraded":"2024-08-27T03:59:32.679267+0000","last_fullsized":"2024-08-27T03:59:32.679267+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:32.679040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:32.679040+0000","last_clean_scrub_stamp":"2024-08-27T03:59:32.679040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:24.818619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:33.313508+0000","last_change":"2024-08-27T03:59:33.313508+0000","last_active":"2024-08-27T03:59:33.313508+0000","last_peered":"2024-08-27T03:59:33.313508+0000","last_clean":"2024-08-27T03:59:33.313508+0000","last_became_active":"2024-08-27T02:50:55.775764+0000","last_became_peered":"2024-08-27T02:50:55.775764+0000","last_unstale":"2024-08-27T03:59:33.313508+0000","last_undegraded":"2024-08-27T03:59:33.313508+0000","last_fullsized":"2024-08-27T03:59:33.313508+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:33.313317+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:33.313317+0000","last_clean_scrub_stamp":"2024-08-27T03:59:33.313317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:48:55.833964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:27.693840+0000","last_change":"2024-08-27T03:59:27.693840+0000","last_active":"2024-08-27T03:59:27.693840+0000","last_peered":"2024-08-27T03:59:27.693840+0000","last_clean":"2024-08-27T03:59:27.693840+0000","last_became_active":"2024-08-27T02:50:51.713575+0000","last_became_peered":"2024-08-27T02:50:51.713575+0000","last_unstale":"2024-08-27T03:59:27.693840+0000","last_undegraded":"2024-08-27T03:59:27.693840+0000","last_fullsized":"2024-08-27T03:59:27.693840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:27.693596+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:27.693596+0000","last_clean_scrub_stamp":"2024-08-27T03:59:27.693596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:23:29.345599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'51","reported_seq":213,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.208211+0000","last_change":"2024-08-27T03:59:07.208053+0000","last_active":"2024-08-27T03:59:07.208211+0000","last_peered":"2024-08-27T03:59:07.208211+0000","last_clean":"2024-08-27T03:59:07.208211+0000","last_became_active":"2024-08-27T02:46:49.667064+0000","last_became_peered":"2024-08-27T02:46:49.667064+0000","last_unstale":"2024-08-27T03:59:07.208211+0000","last_undegraded":"2024-08-27T03:59:07.208211+0000","last_fullsized":"2024-08-27T03:59:07.208211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'51","last_scrub_stamp":"2024-08-27T03:59:07.207859+0000","last_deep_scrub":"267'51","last_deep_scrub_stamp":"2024-08-27T03:59:07.207859+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.207859+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:50:28.317913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":185,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.198377+0000","last_change":"2024-08-27T03:59:15.198216+0000","last_active":"2024-08-27T03:59:15.198377+0000","last_peered":"2024-08-27T03:59:15.198377+0000","last_clean":"2024-08-27T03:59:15.198377+0000","last_became_active":"2024-08-27T03:10:45.283500+0000","last_became_peered":"2024-08-27T03:10:45.283500+0000","last_unstale":"2024-08-27T03:59:15.198377+0000","last_undegraded":"2024-08-27T03:59:15.198377+0000","last_fullsized":"2024-08-27T03:59:15.198377+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:15.198031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:15.198031+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.198031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:17:06.883269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'14","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:32.263759+0000","last_change":"2024-08-27T03:59:32.263759+0000","last_active":"2024-08-27T03:59:32.263759+0000","last_peered":"2024-08-27T03:59:32.263759+0000","last_clean":"2024-08-27T03:59:32.263759+0000","last_became_active":"2024-08-27T02:50:55.793898+0000","last_became_peered":"2024-08-27T02:50:55.793898+0000","last_unstale":"2024-08-27T03:59:32.263759+0000","last_undegraded":"2024-08-27T03:59:32.263759+0000","last_fullsized":"2024-08-27T03:59:32.263759+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-08-27T03:59:32.263579+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-08-27T03:59:32.263579+0000","last_clean_scrub_stamp":"2024-08-27T03:59:32.263579+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:45.212117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":34818,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.992428+0000","last_change":"2024-08-27T03:59:18.992428+0000","last_active":"2024-08-27T03:59:18.992428+0000","last_peered":"2024-08-27T03:59:18.992428+0000","last_clean":"2024-08-27T03:59:18.992428+0000","last_became_active":"2024-08-27T02:50:51.724589+0000","last_became_peered":"2024-08-27T02:50:51.724589+0000","last_unstale":"2024-08-27T03:59:18.992428+0000","last_undegraded":"2024-08-27T03:59:18.992428+0000","last_fullsized":"2024-08-27T03:59:18.992428+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:18.992246+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:18.992246+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.992246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:28:14.456890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'37","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.623193+0000","last_change":"2024-08-27T03:59:19.623022+0000","last_active":"2024-08-27T03:59:19.623193+0000","last_peered":"2024-08-27T03:59:19.623193+0000","last_clean":"2024-08-27T03:59:19.623193+0000","last_became_active":"2024-08-27T02:46:49.653919+0000","last_became_peered":"2024-08-27T02:46:49.653919+0000","last_unstale":"2024-08-27T03:59:19.623193+0000","last_undegraded":"2024-08-27T03:59:19.623193+0000","last_fullsized":"2024-08-27T03:59:19.623193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-08-27T03:59:19.622818+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-08-27T03:59:19.622818+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.622818+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:52.161048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":130,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.702832+0000","last_change":"2024-08-27T03:59:07.702701+0000","last_active":"2024-08-27T03:59:07.702832+0000","last_peered":"2024-08-27T03:59:07.702832+0000","last_clean":"2024-08-27T03:59:07.702832+0000","last_became_active":"2024-08-27T03:10:45.285769+0000","last_became_peered":"2024-08-27T03:10:45.285769+0000","last_unstale":"2024-08-27T03:59:07.702832+0000","last_undegraded":"2024-08-27T03:59:07.702832+0000","last_fullsized":"2024-08-27T03:59:07.702832+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:07.702512+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:07.702512+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.702512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:36:10.239915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:31.771372+0000","last_change":"2024-08-27T03:59:31.771234+0000","last_active":"2024-08-27T03:59:31.771372+0000","last_peered":"2024-08-27T03:59:31.771372+0000","last_clean":"2024-08-27T03:59:31.771372+0000","last_became_active":"2024-08-27T02:51:41.063241+0000","last_became_peered":"2024-08-27T02:51:41.063241+0000","last_unstale":"2024-08-27T03:59:31.771372+0000","last_undegraded":"2024-08-27T03:59:31.771372+0000","last_fullsized":"2024-08-27T03:59:31.771372+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:31.771029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:31.771029+0000","last_clean_scrub_stamp":"2024-08-27T03:59:31.771029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:10.053583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.727851+0000","last_change":"2024-08-27T03:59:21.727851+0000","last_active":"2024-08-27T03:59:21.727851+0000","last_peered":"2024-08-27T03:59:21.727851+0000","last_clean":"2024-08-27T03:59:21.727851+0000","last_became_active":"2024-08-27T02:50:51.727867+0000","last_became_peered":"2024-08-27T02:50:51.727867+0000","last_unstale":"2024-08-27T03:59:21.727851+0000","last_undegraded":"2024-08-27T03:59:21.727851+0000","last_fullsized":"2024-08-27T03:59:21.727851+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-08-27T03:59:21.727651+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-08-27T03:59:21.727651+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.727651+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:39:12.306382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'87","reported_seq":317,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.307658+0000","last_change":"2024-08-27T03:59:21.307658+0000","last_active":"2024-08-27T03:59:21.307658+0000","last_peered":"2024-08-27T03:59:21.307658+0000","last_clean":"2024-08-27T03:59:21.307658+0000","last_became_active":"2024-08-27T02:46:49.673497+0000","last_became_peered":"2024-08-27T02:46:49.673497+0000","last_unstale":"2024-08-27T03:59:21.307658+0000","last_undegraded":"2024-08-27T03:59:21.307658+0000","last_fullsized":"2024-08-27T03:59:21.307658+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-08-27T03:59:21.307471+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-08-27T03:59:21.307471+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.307471+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:52.992247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":135,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:31.678197+0000","last_change":"2024-08-27T03:59:31.677950+0000","last_active":"2024-08-27T03:59:31.678197+0000","last_peered":"2024-08-27T03:59:31.678197+0000","last_clean":"2024-08-27T03:59:31.678197+0000","last_became_active":"2024-08-27T03:10:45.292252+0000","last_became_peered":"2024-08-27T03:10:45.292252+0000","last_unstale":"2024-08-27T03:59:31.678197+0000","last_undegraded":"2024-08-27T03:59:31.678197+0000","last_fullsized":"2024-08-27T03:59:31.678197+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:31.677738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:31.677738+0000","last_clean_scrub_stamp":"2024-08-27T03:59:31.677738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:14:53.414642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:35.229672+0000","last_change":"2024-08-27T03:59:35.229672+0000","last_active":"2024-08-27T03:59:35.229672+0000","last_peered":"2024-08-27T03:59:35.229672+0000","last_clean":"2024-08-27T03:59:35.229672+0000","last_became_active":"2024-08-27T02:50:55.793682+0000","last_became_peered":"2024-08-27T02:50:55.793682+0000","last_unstale":"2024-08-27T03:59:35.229672+0000","last_undegraded":"2024-08-27T03:59:35.229672+0000","last_fullsized":"2024-08-27T03:59:35.229672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:35.229485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:35.229485+0000","last_clean_scrub_stamp":"2024-08-27T03:59:35.229485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:36:41.508452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.638221+0000","last_change":"2024-08-27T03:59:02.638221+0000","last_active":"2024-08-27T03:59:02.638221+0000","last_peered":"2024-08-27T03:59:02.638221+0000","last_clean":"2024-08-27T03:59:02.638221+0000","last_became_active":"2024-08-27T02:50:51.719832+0000","last_became_peered":"2024-08-27T02:50:51.719832+0000","last_unstale":"2024-08-27T03:59:02.638221+0000","last_undegraded":"2024-08-27T03:59:02.638221+0000","last_fullsized":"2024-08-27T03:59:02.638221+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:02.637934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:02.637934+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.637934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:19.825120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'29","reported_seq":151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.631858+0000","last_change":"2024-08-27T03:59:00.631616+0000","last_active":"2024-08-27T03:59:00.631858+0000","last_peered":"2024-08-27T03:59:00.631858+0000","last_clean":"2024-08-27T03:59:00.631858+0000","last_became_active":"2024-08-27T02:46:49.677187+0000","last_became_peered":"2024-08-27T02:46:49.677187+0000","last_unstale":"2024-08-27T03:59:00.631858+0000","last_undegraded":"2024-08-27T03:59:00.631858+0000","last_fullsized":"2024-08-27T03:59:00.631858+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-08-27T03:59:00.631344+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-08-27T03:59:00.631344+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.631344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:59.147750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.825400+0000","last_change":"2024-08-27T03:59:24.825268+0000","last_active":"2024-08-27T03:59:24.825400+0000","last_peered":"2024-08-27T03:59:24.825400+0000","last_clean":"2024-08-27T03:59:24.825400+0000","last_became_active":"2024-08-27T03:10:45.297722+0000","last_became_peered":"2024-08-27T03:10:45.297722+0000","last_unstale":"2024-08-27T03:59:24.825400+0000","last_undegraded":"2024-08-27T03:59:24.825400+0000","last_fullsized":"2024-08-27T03:59:24.825400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:24.825086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:24.825086+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.825086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:07:35.585187+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.619457+0000","last_change":"2024-08-27T03:59:22.619457+0000","last_active":"2024-08-27T03:59:22.619457+0000","last_peered":"2024-08-27T03:59:22.619457+0000","last_clean":"2024-08-27T03:59:22.619457+0000","last_became_active":"2024-08-27T02:50:55.769146+0000","last_became_peered":"2024-08-27T02:50:55.769146+0000","last_unstale":"2024-08-27T03:59:22.619457+0000","last_undegraded":"2024-08-27T03:59:22.619457+0000","last_fullsized":"2024-08-27T03:59:22.619457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:22.619257+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:22.619257+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.619257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:55:21.580911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.623564+0000","last_change":"2024-08-27T03:59:25.623564+0000","last_active":"2024-08-27T03:59:25.623564+0000","last_peered":"2024-08-27T03:59:25.623564+0000","last_clean":"2024-08-27T03:59:25.623564+0000","last_became_active":"2024-08-27T02:50:51.699016+0000","last_became_peered":"2024-08-27T02:50:51.699016+0000","last_unstale":"2024-08-27T03:59:25.623564+0000","last_undegraded":"2024-08-27T03:59:25.623564+0000","last_fullsized":"2024-08-27T03:59:25.623564+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:25.623389+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:25.623389+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.623389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:17:45.359254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'13","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.800933+0000","last_change":"2024-08-27T03:59:16.800796+0000","last_active":"2024-08-27T03:59:16.800933+0000","last_peered":"2024-08-27T03:59:16.800933+0000","last_clean":"2024-08-27T03:59:16.800933+0000","last_became_active":"2024-08-27T02:46:49.661999+0000","last_became_peered":"2024-08-27T02:46:49.661999+0000","last_unstale":"2024-08-27T03:59:16.800933+0000","last_undegraded":"2024-08-27T03:59:16.800933+0000","last_fullsized":"2024-08-27T03:59:16.800933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-08-27T03:59:16.800626+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-08-27T03:59:16.800626+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.800626+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:44:59.363430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:37.286423+0000","last_change":"2024-08-27T03:59:37.286423+0000","last_active":"2024-08-27T03:59:37.286423+0000","last_peered":"2024-08-27T03:59:37.286423+0000","last_clean":"2024-08-27T03:59:37.286423+0000","last_became_active":"2024-08-27T03:10:45.288069+0000","last_became_peered":"2024-08-27T03:10:45.288069+0000","last_unstale":"2024-08-27T03:59:37.286423+0000","last_undegraded":"2024-08-27T03:59:37.286423+0000","last_fullsized":"2024-08-27T03:59:37.286423+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:37.286237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:37.286237+0000","last_clean_scrub_stamp":"2024-08-27T03:59:37.286237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:07:54.394011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.249493+0000","last_change":"2024-08-27T03:59:17.249493+0000","last_active":"2024-08-27T03:59:17.249493+0000","last_peered":"2024-08-27T03:59:17.249493+0000","last_clean":"2024-08-27T03:59:17.249493+0000","last_became_active":"2024-08-27T02:50:55.787204+0000","last_became_peered":"2024-08-27T02:50:55.787204+0000","last_unstale":"2024-08-27T03:59:17.249493+0000","last_undegraded":"2024-08-27T03:59:17.249493+0000","last_fullsized":"2024-08-27T03:59:17.249493+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:17.249309+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:17.249309+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.249309+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:47:30.912020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.690441+0000","last_change":"2024-08-27T03:59:16.690441+0000","last_active":"2024-08-27T03:59:16.690441+0000","last_peered":"2024-08-27T03:59:16.690441+0000","last_clean":"2024-08-27T03:59:16.690441+0000","last_became_active":"2024-08-27T02:50:51.709770+0000","last_became_peered":"2024-08-27T02:50:51.709770+0000","last_unstale":"2024-08-27T03:59:16.690441+0000","last_undegraded":"2024-08-27T03:59:16.690441+0000","last_fullsized":"2024-08-27T03:59:16.690441+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:16.690255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:16.690255+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.690255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:56:56.493716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.746494+0000","last_change":"2024-08-27T03:59:13.746494+0000","last_active":"2024-08-27T03:59:13.746494+0000","last_peered":"2024-08-27T03:59:13.746494+0000","last_clean":"2024-08-27T03:59:13.746494+0000","last_became_active":"2024-08-27T02:46:49.667512+0000","last_became_peered":"2024-08-27T02:46:49.667512+0000","last_unstale":"2024-08-27T03:59:13.746494+0000","last_undegraded":"2024-08-27T03:59:13.746494+0000","last_fullsized":"2024-08-27T03:59:13.746494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-08-27T03:59:13.746262+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-08-27T03:59:13.746262+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.746262+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:39:18.859681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:33.815734+0000","last_change":"2024-08-27T03:59:33.815734+0000","last_active":"2024-08-27T03:59:33.815734+0000","last_peered":"2024-08-27T03:59:33.815734+0000","last_clean":"2024-08-27T03:59:33.815734+0000","last_became_active":"2024-08-27T03:10:45.281541+0000","last_became_peered":"2024-08-27T03:10:45.281541+0000","last_unstale":"2024-08-27T03:59:33.815734+0000","last_undegraded":"2024-08-27T03:59:33.815734+0000","last_fullsized":"2024-08-27T03:59:33.815734+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:33.815541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:33.815541+0000","last_clean_scrub_stamp":"2024-08-27T03:59:33.815541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:43:00.928795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.165657+0000","last_change":"2024-08-27T03:59:13.165657+0000","last_active":"2024-08-27T03:59:13.165657+0000","last_peered":"2024-08-27T03:59:13.165657+0000","last_clean":"2024-08-27T03:59:13.165657+0000","last_became_active":"2024-08-27T02:50:55.769089+0000","last_became_peered":"2024-08-27T02:50:55.769089+0000","last_unstale":"2024-08-27T03:59:13.165657+0000","last_undegraded":"2024-08-27T03:59:13.165657+0000","last_fullsized":"2024-08-27T03:59:13.165657+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:13.165473+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:13.165473+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.165473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:55:33.719279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:30.310097+0000","last_change":"2024-08-27T03:59:30.310097+0000","last_active":"2024-08-27T03:59:30.310097+0000","last_peered":"2024-08-27T03:59:30.310097+0000","last_clean":"2024-08-27T03:59:30.310097+0000","last_became_active":"2024-08-27T02:50:51.729313+0000","last_became_peered":"2024-08-27T02:50:51.729313+0000","last_unstale":"2024-08-27T03:59:30.310097+0000","last_undegraded":"2024-08-27T03:59:30.310097+0000","last_fullsized":"2024-08-27T03:59:30.310097+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:30.309910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:30.309910+0000","last_clean_scrub_stamp":"2024-08-27T03:59:30.309910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:03:51.661348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.544285+0000","last_change":"2024-08-27T03:59:17.544285+0000","last_active":"2024-08-27T03:59:17.544285+0000","last_peered":"2024-08-27T03:59:17.544285+0000","last_clean":"2024-08-27T03:59:17.544285+0000","last_became_active":"2024-08-27T02:46:49.665390+0000","last_became_peered":"2024-08-27T02:46:49.665390+0000","last_unstale":"2024-08-27T03:59:17.544285+0000","last_undegraded":"2024-08-27T03:59:17.544285+0000","last_fullsized":"2024-08-27T03:59:17.544285+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-08-27T03:59:17.544059+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-08-27T03:59:17.544059+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.544059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:01.603813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:36.844337+0000","last_change":"2024-08-27T03:59:36.844161+0000","last_active":"2024-08-27T03:59:36.844337+0000","last_peered":"2024-08-27T03:59:36.844337+0000","last_clean":"2024-08-27T03:59:36.844337+0000","last_became_active":"2024-08-27T03:10:45.278670+0000","last_became_peered":"2024-08-27T03:10:45.278670+0000","last_unstale":"2024-08-27T03:59:36.844337+0000","last_undegraded":"2024-08-27T03:59:36.844337+0000","last_fullsized":"2024-08-27T03:59:36.844337+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:36.843954+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:36.843954+0000","last_clean_scrub_stamp":"2024-08-27T03:59:36.843954+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:05:49.204180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:31.292985+0000","last_change":"2024-08-27T03:59:31.292985+0000","last_active":"2024-08-27T03:59:31.292985+0000","last_peered":"2024-08-27T03:59:31.292985+0000","last_clean":"2024-08-27T03:59:31.292985+0000","last_became_active":"2024-08-27T02:50:55.782546+0000","last_became_peered":"2024-08-27T02:50:55.782546+0000","last_unstale":"2024-08-27T03:59:31.292985+0000","last_undegraded":"2024-08-27T03:59:31.292985+0000","last_fullsized":"2024-08-27T03:59:31.292985+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:31.292809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:31.292809+0000","last_clean_scrub_stamp":"2024-08-27T03:59:31.292809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:58.298334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.502670+0000","last_change":"2024-08-27T03:59:08.502670+0000","last_active":"2024-08-27T03:59:08.502670+0000","last_peered":"2024-08-27T03:59:08.502670+0000","last_clean":"2024-08-27T03:59:08.502670+0000","last_became_active":"2024-08-27T02:50:51.737775+0000","last_became_peered":"2024-08-27T02:50:51.737775+0000","last_unstale":"2024-08-27T03:59:08.502670+0000","last_undegraded":"2024-08-27T03:59:08.502670+0000","last_fullsized":"2024-08-27T03:59:08.502670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.502492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.502492+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.502492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:16:58.852923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'8","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.645772+0000","last_change":"2024-08-27T03:59:13.645772+0000","last_active":"2024-08-27T03:59:13.645772+0000","last_peered":"2024-08-27T03:59:13.645772+0000","last_clean":"2024-08-27T03:59:13.645772+0000","last_became_active":"2024-08-27T02:46:49.653745+0000","last_became_peered":"2024-08-27T02:46:49.653745+0000","last_unstale":"2024-08-27T03:59:13.645772+0000","last_undegraded":"2024-08-27T03:59:13.645772+0000","last_fullsized":"2024-08-27T03:59:13.645772+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:13.645584+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:13.645584+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.645584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:05:02.912963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:36.270405+0000","last_change":"2024-08-27T03:59:36.270405+0000","last_active":"2024-08-27T03:59:36.270405+0000","last_peered":"2024-08-27T03:59:36.270405+0000","last_clean":"2024-08-27T03:59:36.270405+0000","last_became_active":"2024-08-27T03:10:45.265860+0000","last_became_peered":"2024-08-27T03:10:45.265860+0000","last_unstale":"2024-08-27T03:59:36.270405+0000","last_undegraded":"2024-08-27T03:59:36.270405+0000","last_fullsized":"2024-08-27T03:59:36.270405+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:36.270205+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:36.270205+0000","last_clean_scrub_stamp":"2024-08-27T03:59:36.270205+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:12:20.188380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.500122+0000","last_change":"2024-08-27T03:59:10.500122+0000","last_active":"2024-08-27T03:59:10.500122+0000","last_peered":"2024-08-27T03:59:10.500122+0000","last_clean":"2024-08-27T03:59:10.500122+0000","last_became_active":"2024-08-27T02:50:55.778005+0000","last_became_peered":"2024-08-27T02:50:55.778005+0000","last_unstale":"2024-08-27T03:59:10.500122+0000","last_undegraded":"2024-08-27T03:59:10.500122+0000","last_fullsized":"2024-08-27T03:59:10.500122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:10.499937+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:10.499937+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.499937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:36:27.141860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.960306+0000","last_change":"2024-08-27T03:59:17.960306+0000","last_active":"2024-08-27T03:59:17.960306+0000","last_peered":"2024-08-27T03:59:17.960306+0000","last_clean":"2024-08-27T03:59:17.960306+0000","last_became_active":"2024-08-27T02:50:51.721026+0000","last_became_peered":"2024-08-27T02:50:51.721026+0000","last_unstale":"2024-08-27T03:59:17.960306+0000","last_undegraded":"2024-08-27T03:59:17.960306+0000","last_fullsized":"2024-08-27T03:59:17.960306+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:17.960124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:17.960124+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.960124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:22.112483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'34","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.355298+0000","last_change":"2024-08-27T03:59:20.355298+0000","last_active":"2024-08-27T03:59:20.355298+0000","last_peered":"2024-08-27T03:59:20.355298+0000","last_clean":"2024-08-27T03:59:20.355298+0000","last_became_active":"2024-08-27T02:46:49.665692+0000","last_became_peered":"2024-08-27T02:46:49.665692+0000","last_unstale":"2024-08-27T03:59:20.355298+0000","last_undegraded":"2024-08-27T03:59:20.355298+0000","last_fullsized":"2024-08-27T03:59:20.355298+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-08-27T03:59:20.355015+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-08-27T03:59:20.355015+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.355015+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:23.871904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.679670+0000","last_change":"2024-08-27T03:59:05.679670+0000","last_active":"2024-08-27T03:59:05.679670+0000","last_peered":"2024-08-27T03:59:05.679670+0000","last_clean":"2024-08-27T03:59:05.679670+0000","last_became_active":"2024-08-27T03:10:45.286970+0000","last_became_peered":"2024-08-27T03:10:45.286970+0000","last_unstale":"2024-08-27T03:59:05.679670+0000","last_undegraded":"2024-08-27T03:59:05.679670+0000","last_fullsized":"2024-08-27T03:59:05.679670+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.679493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.679493+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.679493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:01.999447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.280550+0000","last_change":"2024-08-27T03:59:25.280550+0000","last_active":"2024-08-27T03:59:25.280550+0000","last_peered":"2024-08-27T03:59:25.280550+0000","last_clean":"2024-08-27T03:59:25.280550+0000","last_became_active":"2024-08-27T02:50:55.782195+0000","last_became_peered":"2024-08-27T02:50:55.782195+0000","last_unstale":"2024-08-27T03:59:25.280550+0000","last_undegraded":"2024-08-27T03:59:25.280550+0000","last_fullsized":"2024-08-27T03:59:25.280550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:25.280358+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:25.280358+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.280358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:19:19.222017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.725149+0000","last_change":"2024-08-27T03:59:20.725149+0000","last_active":"2024-08-27T03:59:20.725149+0000","last_peered":"2024-08-27T03:59:20.725149+0000","last_clean":"2024-08-27T03:59:20.725149+0000","last_became_active":"2024-08-27T02:50:51.736478+0000","last_became_peered":"2024-08-27T02:50:51.736478+0000","last_unstale":"2024-08-27T03:59:20.725149+0000","last_undegraded":"2024-08-27T03:59:20.725149+0000","last_fullsized":"2024-08-27T03:59:20.725149+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:20.724884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:20.724884+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.724884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:52:30.637590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'156","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.305922+0000","last_change":"2024-08-27T03:59:23.305922+0000","last_active":"2024-08-27T03:59:23.305922+0000","last_peered":"2024-08-27T03:59:23.305922+0000","last_clean":"2024-08-27T03:59:23.305922+0000","last_became_active":"2024-08-27T02:46:49.673603+0000","last_became_peered":"2024-08-27T02:46:49.673603+0000","last_unstale":"2024-08-27T03:59:23.305922+0000","last_undegraded":"2024-08-27T03:59:23.305922+0000","last_fullsized":"2024-08-27T03:59:23.305922+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-08-27T03:59:23.305691+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-08-27T03:59:23.305691+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.305691+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:03:09.487642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":675,"num_write":209,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2000,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:28.749771+0000","last_change":"2024-08-27T03:59:28.749771+0000","last_active":"2024-08-27T03:59:28.749771+0000","last_peered":"2024-08-27T03:59:28.749771+0000","last_clean":"2024-08-27T03:59:28.749771+0000","last_became_active":"2024-08-27T03:10:45.283667+0000","last_became_peered":"2024-08-27T03:10:45.283667+0000","last_unstale":"2024-08-27T03:59:28.749771+0000","last_undegraded":"2024-08-27T03:59:28.749771+0000","last_fullsized":"2024-08-27T03:59:28.749771+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:28.749474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:28.749474+0000","last_clean_scrub_stamp":"2024-08-27T03:59:28.749474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:44.194892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:28.322065+0000","last_change":"2024-08-27T03:59:28.322065+0000","last_active":"2024-08-27T03:59:28.322065+0000","last_peered":"2024-08-27T03:59:28.322065+0000","last_clean":"2024-08-27T03:59:28.322065+0000","last_became_active":"2024-08-27T02:50:55.782453+0000","last_became_peered":"2024-08-27T02:50:55.782453+0000","last_unstale":"2024-08-27T03:59:28.322065+0000","last_undegraded":"2024-08-27T03:59:28.322065+0000","last_fullsized":"2024-08-27T03:59:28.322065+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:28.321874+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:28.321874+0000","last_clean_scrub_stamp":"2024-08-27T03:59:28.321874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:20:27.343067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.638510+0000","last_change":"2024-08-27T03:59:01.638510+0000","last_active":"2024-08-27T03:59:01.638510+0000","last_peered":"2024-08-27T03:59:01.638510+0000","last_clean":"2024-08-27T03:59:01.638510+0000","last_became_active":"2024-08-27T02:50:51.711786+0000","last_became_peered":"2024-08-27T02:50:51.711786+0000","last_unstale":"2024-08-27T03:59:01.638510+0000","last_undegraded":"2024-08-27T03:59:01.638510+0000","last_fullsized":"2024-08-27T03:59:01.638510+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:01.638302+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:01.638302+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.638302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:58:11.517225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.983575+0000","last_change":"2024-08-27T03:59:16.983575+0000","last_active":"2024-08-27T03:59:16.983575+0000","last_peered":"2024-08-27T03:59:16.983575+0000","last_clean":"2024-08-27T03:59:16.983575+0000","last_became_active":"2024-08-27T02:46:49.662988+0000","last_became_peered":"2024-08-27T02:46:49.662988+0000","last_unstale":"2024-08-27T03:59:16.983575+0000","last_undegraded":"2024-08-27T03:59:16.983575+0000","last_fullsized":"2024-08-27T03:59:16.983575+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:16.983384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:16.983384+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.983384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:12:29.390855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.389568+0000","last_change":"2024-08-27T03:59:14.389568+0000","last_active":"2024-08-27T03:59:14.389568+0000","last_peered":"2024-08-27T03:59:14.389568+0000","last_clean":"2024-08-27T03:59:14.389568+0000","last_became_active":"2024-08-27T03:10:45.287154+0000","last_became_peered":"2024-08-27T03:10:45.287154+0000","last_unstale":"2024-08-27T03:59:14.389568+0000","last_undegraded":"2024-08-27T03:59:14.389568+0000","last_fullsized":"2024-08-27T03:59:14.389568+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:14.389366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:14.389366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.389366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:04.259428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'3","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.153822+0000","last_change":"2024-08-27T03:59:10.153822+0000","last_active":"2024-08-27T03:59:10.153822+0000","last_peered":"2024-08-27T03:59:10.153822+0000","last_clean":"2024-08-27T03:59:10.153822+0000","last_became_active":"2024-08-27T02:50:55.795866+0000","last_became_peered":"2024-08-27T02:50:55.795866+0000","last_unstale":"2024-08-27T03:59:10.153822+0000","last_undegraded":"2024-08-27T03:59:10.153822+0000","last_fullsized":"2024-08-27T03:59:10.153822+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:10.153624+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:10.153624+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.153624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:08:51.528708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.610831+0000","last_change":"2024-08-27T03:59:23.610831+0000","last_active":"2024-08-27T03:59:23.610831+0000","last_peered":"2024-08-27T03:59:23.610831+0000","last_clean":"2024-08-27T03:59:23.610831+0000","last_became_active":"2024-08-27T02:50:51.713610+0000","last_became_peered":"2024-08-27T02:50:51.713610+0000","last_unstale":"2024-08-27T03:59:23.610831+0000","last_undegraded":"2024-08-27T03:59:23.610831+0000","last_fullsized":"2024-08-27T03:59:23.610831+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:23.610648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:23.610648+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.610648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:42:36.521011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'96","reported_seq":434,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.531752+0000","last_change":"2024-08-27T03:59:05.531752+0000","last_active":"2024-08-27T03:59:05.531752+0000","last_peered":"2024-08-27T03:59:05.531752+0000","last_clean":"2024-08-27T03:59:05.531752+0000","last_became_active":"2024-08-27T02:46:49.667456+0000","last_became_peered":"2024-08-27T02:46:49.667456+0000","last_unstale":"2024-08-27T03:59:05.531752+0000","last_undegraded":"2024-08-27T03:59:05.531752+0000","last_fullsized":"2024-08-27T03:59:05.531752+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'96","last_scrub_stamp":"2024-08-27T03:59:05.531561+0000","last_deep_scrub":"267'96","last_deep_scrub_stamp":"2024-08-27T03:59:05.531561+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.531561+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:56:33.875961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":710,"num_read_kb":458,"num_write":123,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1485,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:27.736830+0000","last_change":"2024-08-27T03:59:27.736830+0000","last_active":"2024-08-27T03:59:27.736830+0000","last_peered":"2024-08-27T03:59:27.736830+0000","last_clean":"2024-08-27T03:59:27.736830+0000","last_became_active":"2024-08-27T03:10:45.298977+0000","last_became_peered":"2024-08-27T03:10:45.298977+0000","last_unstale":"2024-08-27T03:59:27.736830+0000","last_undegraded":"2024-08-27T03:59:27.736830+0000","last_fullsized":"2024-08-27T03:59:27.736830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:27.736643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:27.736643+0000","last_clean_scrub_stamp":"2024-08-27T03:59:27.736643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:07:41.530873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:29.359551+0000","last_change":"2024-08-27T03:59:29.359551+0000","last_active":"2024-08-27T03:59:29.359551+0000","last_peered":"2024-08-27T03:59:29.359551+0000","last_clean":"2024-08-27T03:59:29.359551+0000","last_became_active":"2024-08-27T02:50:55.782270+0000","last_became_peered":"2024-08-27T02:50:55.782270+0000","last_unstale":"2024-08-27T03:59:29.359551+0000","last_undegraded":"2024-08-27T03:59:29.359551+0000","last_fullsized":"2024-08-27T03:59:29.359551+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:29.359374+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:29.359374+0000","last_clean_scrub_stamp":"2024-08-27T03:59:29.359374+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:21:53.118898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.233160+0000","last_change":"2024-08-27T03:59:08.233160+0000","last_active":"2024-08-27T03:59:08.233160+0000","last_peered":"2024-08-27T03:59:08.233160+0000","last_clean":"2024-08-27T03:59:08.233160+0000","last_became_active":"2024-08-27T02:50:51.725159+0000","last_became_peered":"2024-08-27T02:50:51.725159+0000","last_unstale":"2024-08-27T03:59:08.233160+0000","last_undegraded":"2024-08-27T03:59:08.233160+0000","last_fullsized":"2024-08-27T03:59:08.233160+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.232970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.232970+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.232970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:00:55.808443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'17","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.590134+0000","last_change":"2024-08-27T03:58:57.590134+0000","last_active":"2024-08-27T03:58:57.590134+0000","last_peered":"2024-08-27T03:58:57.590134+0000","last_clean":"2024-08-27T03:58:57.590134+0000","last_became_active":"2024-08-27T02:46:49.680222+0000","last_became_peered":"2024-08-27T02:46:49.680222+0000","last_unstale":"2024-08-27T03:58:57.590134+0000","last_undegraded":"2024-08-27T03:58:57.590134+0000","last_fullsized":"2024-08-27T03:58:57.590134+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-08-27T03:58:57.589932+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-08-27T03:58:57.589932+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.589932+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:12:51.810737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:38.330279+0000","last_change":"2024-08-27T03:59:38.330279+0000","last_active":"2024-08-27T03:59:38.330279+0000","last_peered":"2024-08-27T03:59:38.330279+0000","last_clean":"2024-08-27T03:59:38.330279+0000","last_became_active":"2024-08-27T03:10:45.289015+0000","last_became_peered":"2024-08-27T03:10:45.289015+0000","last_unstale":"2024-08-27T03:59:38.330279+0000","last_undegraded":"2024-08-27T03:59:38.330279+0000","last_fullsized":"2024-08-27T03:59:38.330279+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:38.330082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:38.330082+0000","last_clean_scrub_stamp":"2024-08-27T03:59:38.330082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:15:43.534049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:20.672357+0000","last_change":"2024-08-27T03:59:20.672357+0000","last_active":"2024-08-27T03:59:20.672357+0000","last_peered":"2024-08-27T03:59:20.672357+0000","last_clean":"2024-08-27T03:59:20.672357+0000","last_became_active":"2024-08-27T02:50:55.801115+0000","last_became_peered":"2024-08-27T02:50:55.801115+0000","last_unstale":"2024-08-27T03:59:20.672357+0000","last_undegraded":"2024-08-27T03:59:20.672357+0000","last_fullsized":"2024-08-27T03:59:20.672357+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:20.672154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:20.672154+0000","last_clean_scrub_stamp":"2024-08-27T03:59:20.672154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:03:31.647134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.591777+0000","last_change":"2024-08-27T03:59:21.591777+0000","last_active":"2024-08-27T03:59:21.591777+0000","last_peered":"2024-08-27T03:59:21.591777+0000","last_clean":"2024-08-27T03:59:21.591777+0000","last_became_active":"2024-08-27T02:50:51.713966+0000","last_became_peered":"2024-08-27T02:50:51.713966+0000","last_unstale":"2024-08-27T03:59:21.591777+0000","last_undegraded":"2024-08-27T03:59:21.591777+0000","last_fullsized":"2024-08-27T03:59:21.591777+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:21.591498+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:21.591498+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.591498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:04:24.135983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'37","reported_seq":179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.588000+0000","last_change":"2024-08-27T03:59:15.588000+0000","last_active":"2024-08-27T03:59:15.588000+0000","last_peered":"2024-08-27T03:59:15.588000+0000","last_clean":"2024-08-27T03:59:15.588000+0000","last_became_active":"2024-08-27T02:46:49.660178+0000","last_became_peered":"2024-08-27T02:46:49.660178+0000","last_unstale":"2024-08-27T03:59:15.588000+0000","last_undegraded":"2024-08-27T03:59:15.588000+0000","last_fullsized":"2024-08-27T03:59:15.588000+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-08-27T03:59:15.587816+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-08-27T03:59:15.587816+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.587816+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:30:59.601294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":146,"num_write":62,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:30.711693+0000","last_change":"2024-08-27T03:59:30.711693+0000","last_active":"2024-08-27T03:59:30.711693+0000","last_peered":"2024-08-27T03:59:30.711693+0000","last_clean":"2024-08-27T03:59:30.711693+0000","last_became_active":"2024-08-27T03:10:45.300597+0000","last_became_peered":"2024-08-27T03:10:45.300597+0000","last_unstale":"2024-08-27T03:59:30.711693+0000","last_undegraded":"2024-08-27T03:59:30.711693+0000","last_fullsized":"2024-08-27T03:59:30.711693+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:30.711502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:30.711502+0000","last_clean_scrub_stamp":"2024-08-27T03:59:30.711502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:21:19.275916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.775584+0000","last_change":"2024-08-27T03:59:23.775584+0000","last_active":"2024-08-27T03:59:23.775584+0000","last_peered":"2024-08-27T03:59:23.775584+0000","last_clean":"2024-08-27T03:59:23.775584+0000","last_became_active":"2024-08-27T02:50:55.792357+0000","last_became_peered":"2024-08-27T02:50:55.792357+0000","last_unstale":"2024-08-27T03:59:23.775584+0000","last_undegraded":"2024-08-27T03:59:23.775584+0000","last_fullsized":"2024-08-27T03:59:23.775584+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:23.775407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:23.775407+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.775407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:41:23.099815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.150947+0000","last_change":"2024-08-27T03:59:11.150947+0000","last_active":"2024-08-27T03:59:11.150947+0000","last_peered":"2024-08-27T03:59:11.150947+0000","last_clean":"2024-08-27T03:59:11.150947+0000","last_became_active":"2024-08-27T02:50:51.725536+0000","last_became_peered":"2024-08-27T02:50:51.725536+0000","last_unstale":"2024-08-27T03:59:11.150947+0000","last_undegraded":"2024-08-27T03:59:11.150947+0000","last_fullsized":"2024-08-27T03:59:11.150947+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:11.150744+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:11.150744+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.150744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:18:57.866275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'21","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.792966+0000","last_change":"2024-08-27T03:59:14.792966+0000","last_active":"2024-08-27T03:59:14.792966+0000","last_peered":"2024-08-27T03:59:14.792966+0000","last_clean":"2024-08-27T03:59:14.792966+0000","last_became_active":"2024-08-27T02:46:49.655613+0000","last_became_peered":"2024-08-27T02:46:49.655613+0000","last_unstale":"2024-08-27T03:59:14.792966+0000","last_undegraded":"2024-08-27T03:59:14.792966+0000","last_fullsized":"2024-08-27T03:59:14.792966+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-08-27T03:59:14.792770+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-08-27T03:59:14.792770+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.792770+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:55:04.139575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":71,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:29.739593+0000","last_change":"2024-08-27T03:59:29.739593+0000","last_active":"2024-08-27T03:59:29.739593+0000","last_peered":"2024-08-27T03:59:29.739593+0000","last_clean":"2024-08-27T03:59:29.739593+0000","last_became_active":"2024-08-27T03:10:45.281126+0000","last_became_peered":"2024-08-27T03:10:45.281126+0000","last_unstale":"2024-08-27T03:59:29.739593+0000","last_undegraded":"2024-08-27T03:59:29.739593+0000","last_fullsized":"2024-08-27T03:59:29.739593+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:29.739341+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:29.739341+0000","last_clean_scrub_stamp":"2024-08-27T03:59:29.739341+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:04.051506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.153198+0000","last_change":"2024-08-27T03:59:12.153198+0000","last_active":"2024-08-27T03:59:12.153198+0000","last_peered":"2024-08-27T03:59:12.153198+0000","last_clean":"2024-08-27T03:59:12.153198+0000","last_became_active":"2024-08-27T02:50:55.769118+0000","last_became_peered":"2024-08-27T02:50:55.769118+0000","last_unstale":"2024-08-27T03:59:12.153198+0000","last_undegraded":"2024-08-27T03:59:12.153198+0000","last_fullsized":"2024-08-27T03:59:12.153198+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:12.153011+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:12.153011+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.153011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:09.108425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'12","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.651294+0000","last_change":"2024-08-27T03:59:24.651294+0000","last_active":"2024-08-27T03:59:24.651294+0000","last_peered":"2024-08-27T03:59:24.651294+0000","last_clean":"2024-08-27T03:59:24.651294+0000","last_became_active":"2024-08-27T02:50:51.705290+0000","last_became_peered":"2024-08-27T02:50:51.705290+0000","last_unstale":"2024-08-27T03:59:24.651294+0000","last_undegraded":"2024-08-27T03:59:24.651294+0000","last_fullsized":"2024-08-27T03:59:24.651294+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-08-27T03:59:24.651111+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-08-27T03:59:24.651111+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.651111+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:16:52.437242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":17,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.340068+0000","last_change":"2024-08-27T03:59:22.340068+0000","last_active":"2024-08-27T03:59:22.340068+0000","last_peered":"2024-08-27T03:59:22.340068+0000","last_clean":"2024-08-27T03:59:22.340068+0000","last_became_active":"2024-08-27T02:46:49.680780+0000","last_became_peered":"2024-08-27T02:46:49.680780+0000","last_unstale":"2024-08-27T03:59:22.340068+0000","last_undegraded":"2024-08-27T03:59:22.340068+0000","last_fullsized":"2024-08-27T03:59:22.340068+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-08-27T03:59:22.339862+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-08-27T03:59:22.339862+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.339862+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:11:21.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:34.807169+0000","last_change":"2024-08-27T03:59:34.807169+0000","last_active":"2024-08-27T03:59:34.807169+0000","last_peered":"2024-08-27T03:59:34.807169+0000","last_clean":"2024-08-27T03:59:34.807169+0000","last_became_active":"2024-08-27T03:10:45.265990+0000","last_became_peered":"2024-08-27T03:10:45.265990+0000","last_unstale":"2024-08-27T03:59:34.807169+0000","last_undegraded":"2024-08-27T03:59:34.807169+0000","last_fullsized":"2024-08-27T03:59:34.807169+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:34.806975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:34.806975+0000","last_clean_scrub_stamp":"2024-08-27T03:59:34.806975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:01:37.469956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:24.781173+0000","last_change":"2024-08-27T03:59:24.781173+0000","last_active":"2024-08-27T03:59:24.781173+0000","last_peered":"2024-08-27T03:59:24.781173+0000","last_clean":"2024-08-27T03:59:24.781173+0000","last_became_active":"2024-08-27T02:50:55.805614+0000","last_became_peered":"2024-08-27T02:50:55.805614+0000","last_unstale":"2024-08-27T03:59:24.781173+0000","last_undegraded":"2024-08-27T03:59:24.781173+0000","last_fullsized":"2024-08-27T03:59:24.781173+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-08-27T03:59:24.780987+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-08-27T03:59:24.780987+0000","last_clean_scrub_stamp":"2024-08-27T03:59:24.780987+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:59:53.842370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.639046+0000","last_change":"2024-08-27T03:59:14.639046+0000","last_active":"2024-08-27T03:59:14.639046+0000","last_peered":"2024-08-27T03:59:14.639046+0000","last_clean":"2024-08-27T03:59:14.639046+0000","last_became_active":"2024-08-27T02:50:51.726954+0000","last_became_peered":"2024-08-27T02:50:51.726954+0000","last_unstale":"2024-08-27T03:59:14.639046+0000","last_undegraded":"2024-08-27T03:59:14.639046+0000","last_fullsized":"2024-08-27T03:59:14.639046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:14.638829+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:14.638829+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.638829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:24:11.059602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'40","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.523841+0000","last_change":"2024-08-27T03:59:04.523841+0000","last_active":"2024-08-27T03:59:04.523841+0000","last_peered":"2024-08-27T03:59:04.523841+0000","last_clean":"2024-08-27T03:59:04.523841+0000","last_became_active":"2024-08-27T02:46:49.658047+0000","last_became_peered":"2024-08-27T02:46:49.658047+0000","last_unstale":"2024-08-27T03:59:04.523841+0000","last_undegraded":"2024-08-27T03:59:04.523841+0000","last_fullsized":"2024-08-27T03:59:04.523841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'40","last_scrub_stamp":"2024-08-27T03:59:04.523658+0000","last_deep_scrub":"267'40","last_deep_scrub_stamp":"2024-08-27T03:59:04.523658+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.523658+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:30:21.823486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":121,"num_write":81,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.807451+0000","last_change":"2024-08-27T03:59:25.807451+0000","last_active":"2024-08-27T03:59:25.807451+0000","last_peered":"2024-08-27T03:59:25.807451+0000","last_clean":"2024-08-27T03:59:25.807451+0000","last_became_active":"2024-08-27T03:10:45.298499+0000","last_became_peered":"2024-08-27T03:10:45.298499+0000","last_unstale":"2024-08-27T03:59:25.807451+0000","last_undegraded":"2024-08-27T03:59:25.807451+0000","last_fullsized":"2024-08-27T03:59:25.807451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:25.807270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:25.807270+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.807270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:57.046837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:30.745176+0000","last_change":"2024-08-27T03:59:30.744899+0000","last_active":"2024-08-27T03:59:30.745176+0000","last_peered":"2024-08-27T03:59:30.745176+0000","last_clean":"2024-08-27T03:59:30.745176+0000","last_became_active":"2024-08-27T02:50:55.775271+0000","last_became_peered":"2024-08-27T02:50:55.775271+0000","last_unstale":"2024-08-27T03:59:30.745176+0000","last_undegraded":"2024-08-27T03:59:30.745176+0000","last_fullsized":"2024-08-27T03:59:30.745176+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:30.744684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:30.744684+0000","last_clean_scrub_stamp":"2024-08-27T03:59:30.744684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:54:54.153329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.767733+0000","last_change":"2024-08-27T03:59:18.767551+0000","last_active":"2024-08-27T03:59:18.767733+0000","last_peered":"2024-08-27T03:59:18.767733+0000","last_clean":"2024-08-27T03:59:18.767733+0000","last_became_active":"2024-08-27T02:50:51.714901+0000","last_became_peered":"2024-08-27T02:50:51.714901+0000","last_unstale":"2024-08-27T03:59:18.767733+0000","last_undegraded":"2024-08-27T03:59:18.767733+0000","last_fullsized":"2024-08-27T03:59:18.767733+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:18.767356+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:18.767356+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.767356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:16:16.737821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'34","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.559223+0000","last_change":"2024-08-27T03:59:16.559223+0000","last_active":"2024-08-27T03:59:16.559223+0000","last_peered":"2024-08-27T03:59:16.559223+0000","last_clean":"2024-08-27T03:59:16.559223+0000","last_became_active":"2024-08-27T02:46:49.676876+0000","last_became_peered":"2024-08-27T02:46:49.676876+0000","last_unstale":"2024-08-27T03:59:16.559223+0000","last_undegraded":"2024-08-27T03:59:16.559223+0000","last_fullsized":"2024-08-27T03:59:16.559223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-08-27T03:59:16.559046+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-08-27T03:59:16.559046+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.559046+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:14.790574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":55,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.861842+0000","last_change":"2024-08-27T03:59:23.861842+0000","last_active":"2024-08-27T03:59:23.861842+0000","last_peered":"2024-08-27T03:59:23.861842+0000","last_clean":"2024-08-27T03:59:23.861842+0000","last_became_active":"2024-08-27T03:10:45.276757+0000","last_became_peered":"2024-08-27T03:10:45.276757+0000","last_unstale":"2024-08-27T03:59:23.861842+0000","last_undegraded":"2024-08-27T03:59:23.861842+0000","last_fullsized":"2024-08-27T03:59:23.861842+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:23.861671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:23.861671+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.861671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:36:58.634021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'8","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:28.724035+0000","last_change":"2024-08-27T03:59:28.723869+0000","last_active":"2024-08-27T03:59:28.724035+0000","last_peered":"2024-08-27T03:59:28.724035+0000","last_clean":"2024-08-27T03:59:28.724035+0000","last_became_active":"2024-08-27T02:50:55.774191+0000","last_became_peered":"2024-08-27T02:50:55.774191+0000","last_unstale":"2024-08-27T03:59:28.724035+0000","last_undegraded":"2024-08-27T03:59:28.724035+0000","last_fullsized":"2024-08-27T03:59:28.724035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:28.723659+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:28.723659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:28.723659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:00:21.556214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'6","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.650582+0000","last_change":"2024-08-27T03:59:03.650423+0000","last_active":"2024-08-27T03:59:03.650582+0000","last_peered":"2024-08-27T03:59:03.650582+0000","last_clean":"2024-08-27T03:59:03.650582+0000","last_became_active":"2024-08-27T02:50:51.710052+0000","last_became_peered":"2024-08-27T02:50:51.710052+0000","last_unstale":"2024-08-27T03:59:03.650582+0000","last_undegraded":"2024-08-27T03:59:03.650582+0000","last_fullsized":"2024-08-27T03:59:03.650582+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:59:03.650243+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:59:03.650243+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.650243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:02:28.974883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'34","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.525787+0000","last_change":"2024-08-27T03:59:03.525787+0000","last_active":"2024-08-27T03:59:03.525787+0000","last_peered":"2024-08-27T03:59:03.525787+0000","last_clean":"2024-08-27T03:59:03.525787+0000","last_became_active":"2024-08-27T02:46:49.655242+0000","last_became_peered":"2024-08-27T02:46:49.655242+0000","last_unstale":"2024-08-27T03:59:03.525787+0000","last_undegraded":"2024-08-27T03:59:03.525787+0000","last_fullsized":"2024-08-27T03:59:03.525787+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-08-27T03:59:03.525614+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-08-27T03:59:03.525614+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.525614+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:28:22.588616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":117,"num_write":66,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.214450+0000","last_change":"2024-08-27T03:59:18.214450+0000","last_active":"2024-08-27T03:59:18.214450+0000","last_peered":"2024-08-27T03:59:18.214450+0000","last_clean":"2024-08-27T03:59:18.214450+0000","last_became_active":"2024-08-27T03:10:45.303892+0000","last_became_peered":"2024-08-27T03:10:45.303892+0000","last_unstale":"2024-08-27T03:59:18.214450+0000","last_undegraded":"2024-08-27T03:59:18.214450+0000","last_fullsized":"2024-08-27T03:59:18.214450+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:18.214263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:18.214263+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.214263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:01:14.307392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:22.735866+0000","last_change":"2024-08-27T03:59:22.735866+0000","last_active":"2024-08-27T03:59:22.735866+0000","last_peered":"2024-08-27T03:59:22.735866+0000","last_clean":"2024-08-27T03:59:22.735866+0000","last_became_active":"2024-08-27T02:50:55.799277+0000","last_became_peered":"2024-08-27T02:50:55.799277+0000","last_unstale":"2024-08-27T03:59:22.735866+0000","last_undegraded":"2024-08-27T03:59:22.735866+0000","last_fullsized":"2024-08-27T03:59:22.735866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:22.735656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:22.735656+0000","last_clean_scrub_stamp":"2024-08-27T03:59:22.735656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:03.620500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.993429+0000","last_change":"2024-08-27T03:59:15.993429+0000","last_active":"2024-08-27T03:59:15.993429+0000","last_peered":"2024-08-27T03:59:15.993429+0000","last_clean":"2024-08-27T03:59:15.993429+0000","last_became_active":"2024-08-27T02:50:51.719952+0000","last_became_peered":"2024-08-27T02:50:51.719952+0000","last_unstale":"2024-08-27T03:59:15.993429+0000","last_undegraded":"2024-08-27T03:59:15.993429+0000","last_fullsized":"2024-08-27T03:59:15.993429+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-08-27T03:59:15.993239+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-08-27T03:59:15.993239+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.993239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:20:54.939203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'36","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.730948+0000","last_change":"2024-08-27T03:59:11.730948+0000","last_active":"2024-08-27T03:59:11.730948+0000","last_peered":"2024-08-27T03:59:11.730948+0000","last_clean":"2024-08-27T03:59:11.730948+0000","last_became_active":"2024-08-27T02:46:49.669983+0000","last_became_peered":"2024-08-27T02:46:49.669983+0000","last_unstale":"2024-08-27T03:59:11.730948+0000","last_undegraded":"2024-08-27T03:59:11.730948+0000","last_fullsized":"2024-08-27T03:59:11.730948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-08-27T03:59:11.730760+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-08-27T03:59:11.730760+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.730760+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:27:36.382148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":123,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.647463+0000","last_change":"2024-08-27T03:59:26.647463+0000","last_active":"2024-08-27T03:59:26.647463+0000","last_peered":"2024-08-27T03:59:26.647463+0000","last_clean":"2024-08-27T03:59:26.647463+0000","last_became_active":"2024-08-27T03:10:45.294129+0000","last_became_peered":"2024-08-27T03:10:45.294129+0000","last_unstale":"2024-08-27T03:59:26.647463+0000","last_undegraded":"2024-08-27T03:59:26.647463+0000","last_fullsized":"2024-08-27T03:59:26.647463+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:26.647273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:26.647273+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.647273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:22.857086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:21.662021+0000","last_change":"2024-08-27T03:59:21.662021+0000","last_active":"2024-08-27T03:59:21.662021+0000","last_peered":"2024-08-27T03:59:21.662021+0000","last_clean":"2024-08-27T03:59:21.662021+0000","last_became_active":"2024-08-27T02:50:55.766573+0000","last_became_peered":"2024-08-27T02:50:55.766573+0000","last_unstale":"2024-08-27T03:59:21.662021+0000","last_undegraded":"2024-08-27T03:59:21.662021+0000","last_fullsized":"2024-08-27T03:59:21.662021+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-08-27T03:59:21.661830+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-08-27T03:59:21.661830+0000","last_clean_scrub_stamp":"2024-08-27T03:59:21.661830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:12:14.557630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.750478+0000","last_change":"2024-08-27T03:59:19.750478+0000","last_active":"2024-08-27T03:59:19.750478+0000","last_peered":"2024-08-27T03:59:19.750478+0000","last_clean":"2024-08-27T03:59:19.750478+0000","last_became_active":"2024-08-27T02:50:51.714223+0000","last_became_peered":"2024-08-27T02:50:51.714223+0000","last_unstale":"2024-08-27T03:59:19.750478+0000","last_undegraded":"2024-08-27T03:59:19.750478+0000","last_fullsized":"2024-08-27T03:59:19.750478+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:19.750264+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:19.750264+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.750264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:39:14.438681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'5","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.094119+0000","last_change":"2024-08-27T03:59:03.093946+0000","last_active":"2024-08-27T03:59:03.094119+0000","last_peered":"2024-08-27T03:59:03.094119+0000","last_clean":"2024-08-27T03:59:03.094119+0000","last_became_active":"2024-08-27T02:46:49.659188+0000","last_became_peered":"2024-08-27T02:46:49.659188+0000","last_unstale":"2024-08-27T03:59:03.094119+0000","last_undegraded":"2024-08-27T03:59:03.094119+0000","last_fullsized":"2024-08-27T03:59:03.094119+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-08-27T03:59:03.093759+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-08-27T03:59:03.093759+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.093759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:35.506595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.690609+0000","last_change":"2024-08-27T03:59:06.690609+0000","last_active":"2024-08-27T03:59:06.690609+0000","last_peered":"2024-08-27T03:59:06.690609+0000","last_clean":"2024-08-27T03:59:06.690609+0000","last_became_active":"2024-08-27T03:10:45.301571+0000","last_became_peered":"2024-08-27T03:10:45.301571+0000","last_unstale":"2024-08-27T03:59:06.690609+0000","last_undegraded":"2024-08-27T03:59:06.690609+0000","last_fullsized":"2024-08-27T03:59:06.690609+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:59:06.690423+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:59:06.690423+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.690423+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:19:03.414071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.206359+0000","last_change":"2024-08-27T03:59:16.206071+0000","last_active":"2024-08-27T03:59:16.206359+0000","last_peered":"2024-08-27T03:59:16.206359+0000","last_clean":"2024-08-27T03:59:16.206359+0000","last_became_active":"2024-08-27T02:50:55.775899+0000","last_became_peered":"2024-08-27T02:50:55.775899+0000","last_unstale":"2024-08-27T03:59:16.206359+0000","last_undegraded":"2024-08-27T03:59:16.206359+0000","last_fullsized":"2024-08-27T03:59:16.206359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:16.205853+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:16.205853+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.205853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:54:10.654151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.839799+0000","last_change":"2024-08-27T03:59:15.839799+0000","last_active":"2024-08-27T03:59:15.839799+0000","last_peered":"2024-08-27T03:59:15.839799+0000","last_clean":"2024-08-27T03:59:15.839799+0000","last_became_active":"2024-08-27T02:50:51.711955+0000","last_became_peered":"2024-08-27T02:50:51.711955+0000","last_unstale":"2024-08-27T03:59:15.839799+0000","last_undegraded":"2024-08-27T03:59:15.839799+0000","last_fullsized":"2024-08-27T03:59:15.839799+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:15.839621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:15.839621+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.839621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:10:07.169155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'38","reported_seq":182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.006092+0000","last_change":"2024-08-27T03:59:15.005826+0000","last_active":"2024-08-27T03:59:15.006092+0000","last_peered":"2024-08-27T03:59:15.006092+0000","last_clean":"2024-08-27T03:59:15.006092+0000","last_became_active":"2024-08-27T02:46:49.665371+0000","last_became_peered":"2024-08-27T02:46:49.665371+0000","last_unstale":"2024-08-27T03:59:15.006092+0000","last_undegraded":"2024-08-27T03:59:15.006092+0000","last_fullsized":"2024-08-27T03:59:15.006092+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-08-27T03:59:15.005608+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-08-27T03:59:15.005608+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.005608+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:41:26.816501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:32.783818+0000","last_change":"2024-08-27T03:59:32.783818+0000","last_active":"2024-08-27T03:59:32.783818+0000","last_peered":"2024-08-27T03:59:32.783818+0000","last_clean":"2024-08-27T03:59:32.783818+0000","last_became_active":"2024-08-27T03:10:45.288907+0000","last_became_peered":"2024-08-27T03:10:45.288907+0000","last_unstale":"2024-08-27T03:59:32.783818+0000","last_undegraded":"2024-08-27T03:59:32.783818+0000","last_fullsized":"2024-08-27T03:59:32.783818+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:32.783634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:32.783634+0000","last_clean_scrub_stamp":"2024-08-27T03:59:32.783634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:08:04.658953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.949014+0000","last_change":"2024-08-27T03:59:19.949014+0000","last_active":"2024-08-27T03:59:19.949014+0000","last_peered":"2024-08-27T03:59:19.949014+0000","last_clean":"2024-08-27T03:59:19.949014+0000","last_became_active":"2024-08-27T02:50:55.776812+0000","last_became_peered":"2024-08-27T02:50:55.776812+0000","last_unstale":"2024-08-27T03:59:19.949014+0000","last_undegraded":"2024-08-27T03:59:19.949014+0000","last_fullsized":"2024-08-27T03:59:19.949014+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:19.948809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:19.948809+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.948809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:00:48.780433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'7","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.797882+0000","last_change":"2024-08-27T03:59:17.797720+0000","last_active":"2024-08-27T03:59:17.797882+0000","last_peered":"2024-08-27T03:59:17.797882+0000","last_clean":"2024-08-27T03:59:17.797882+0000","last_became_active":"2024-08-27T02:50:51.717907+0000","last_became_peered":"2024-08-27T02:50:51.717907+0000","last_unstale":"2024-08-27T03:59:17.797882+0000","last_undegraded":"2024-08-27T03:59:17.797882+0000","last_fullsized":"2024-08-27T03:59:17.797882+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-08-27T03:59:17.797536+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-08-27T03:59:17.797536+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.797536+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:47:48.490744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'20","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.659290+0000","last_change":"2024-08-27T03:59:15.659155+0000","last_active":"2024-08-27T03:59:15.659290+0000","last_peered":"2024-08-27T03:59:15.659290+0000","last_clean":"2024-08-27T03:59:15.659290+0000","last_became_active":"2024-08-27T02:46:49.666328+0000","last_became_peered":"2024-08-27T02:46:49.666328+0000","last_unstale":"2024-08-27T03:59:15.659290+0000","last_undegraded":"2024-08-27T03:59:15.659290+0000","last_fullsized":"2024-08-27T03:59:15.659290+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-08-27T03:59:15.658975+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-08-27T03:59:15.658975+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.658975+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:54:34.713580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:35.794165+0000","last_change":"2024-08-27T03:59:35.794165+0000","last_active":"2024-08-27T03:59:35.794165+0000","last_peered":"2024-08-27T03:59:35.794165+0000","last_clean":"2024-08-27T03:59:35.794165+0000","last_became_active":"2024-08-27T03:10:45.281005+0000","last_became_peered":"2024-08-27T03:10:45.281005+0000","last_unstale":"2024-08-27T03:59:35.794165+0000","last_undegraded":"2024-08-27T03:59:35.794165+0000","last_fullsized":"2024-08-27T03:59:35.794165+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:35.793969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:35.793969+0000","last_clean_scrub_stamp":"2024-08-27T03:59:35.793969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:53:08.696791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"267'3","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.514478+0000","last_change":"2024-08-27T03:59:09.514241+0000","last_active":"2024-08-27T03:59:09.514478+0000","last_peered":"2024-08-27T03:59:09.514478+0000","last_clean":"2024-08-27T03:59:09.514478+0000","last_became_active":"2024-08-27T02:50:55.789607+0000","last_became_peered":"2024-08-27T02:50:55.789607+0000","last_unstale":"2024-08-27T03:59:09.514478+0000","last_undegraded":"2024-08-27T03:59:09.514478+0000","last_fullsized":"2024-08-27T03:59:09.514478+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:09.513996+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:09.513996+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.513996+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:26:56.665749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'8","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.143757+0000","last_change":"2024-08-27T03:59:04.143578+0000","last_active":"2024-08-27T03:59:04.143757+0000","last_peered":"2024-08-27T03:59:04.143757+0000","last_clean":"2024-08-27T03:59:04.143757+0000","last_became_active":"2024-08-27T02:50:51.737596+0000","last_became_peered":"2024-08-27T02:50:51.737596+0000","last_unstale":"2024-08-27T03:59:04.143757+0000","last_undegraded":"2024-08-27T03:59:04.143757+0000","last_fullsized":"2024-08-27T03:59:04.143757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-08-27T03:59:04.143381+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-08-27T03:59:04.143381+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.143381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:58.843764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'37","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.573015+0000","last_change":"2024-08-27T03:59:02.572873+0000","last_active":"2024-08-27T03:59:02.573015+0000","last_peered":"2024-08-27T03:59:02.573015+0000","last_clean":"2024-08-27T03:59:02.573015+0000","last_became_active":"2024-08-27T02:46:49.637812+0000","last_became_peered":"2024-08-27T02:46:49.637812+0000","last_unstale":"2024-08-27T03:59:02.573015+0000","last_undegraded":"2024-08-27T03:59:02.573015+0000","last_fullsized":"2024-08-27T03:59:02.573015+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-08-27T03:59:02.572691+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-08-27T03:59:02.572691+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.572691+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:55:05.386884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":131,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:26.776814+0000","last_change":"2024-08-27T03:59:26.776814+0000","last_active":"2024-08-27T03:59:26.776814+0000","last_peered":"2024-08-27T03:59:26.776814+0000","last_clean":"2024-08-27T03:59:26.776814+0000","last_became_active":"2024-08-27T03:10:45.289990+0000","last_became_peered":"2024-08-27T03:10:45.289990+0000","last_unstale":"2024-08-27T03:59:26.776814+0000","last_undegraded":"2024-08-27T03:59:26.776814+0000","last_fullsized":"2024-08-27T03:59:26.776814+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:26.776620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:26.776620+0000","last_clean_scrub_stamp":"2024-08-27T03:59:26.776620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:19:43.578391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:23.655714+0000","last_change":"2024-08-27T03:59:23.655465+0000","last_active":"2024-08-27T03:59:23.655714+0000","last_peered":"2024-08-27T03:59:23.655714+0000","last_clean":"2024-08-27T03:59:23.655714+0000","last_became_active":"2024-08-27T02:50:55.771344+0000","last_became_peered":"2024-08-27T02:50:55.771344+0000","last_unstale":"2024-08-27T03:59:23.655714+0000","last_undegraded":"2024-08-27T03:59:23.655714+0000","last_fullsized":"2024-08-27T03:59:23.655714+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:59:23.655183+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:59:23.655183+0000","last_clean_scrub_stamp":"2024-08-27T03:59:23.655183+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:22:29.289317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.460585+0000","last_change":"2024-08-27T03:59:07.460384+0000","last_active":"2024-08-27T03:59:07.460585+0000","last_peered":"2024-08-27T03:59:07.460585+0000","last_clean":"2024-08-27T03:59:07.460585+0000","last_became_active":"2024-08-27T02:50:51.705177+0000","last_became_peered":"2024-08-27T02:50:51.705177+0000","last_unstale":"2024-08-27T03:59:07.460585+0000","last_undegraded":"2024-08-27T03:59:07.460585+0000","last_fullsized":"2024-08-27T03:59:07.460585+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.460195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.460195+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.460195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:08.655162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'26","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.739008+0000","last_change":"2024-08-27T03:59:10.739008+0000","last_active":"2024-08-27T03:59:10.739008+0000","last_peered":"2024-08-27T03:59:10.739008+0000","last_clean":"2024-08-27T03:59:10.739008+0000","last_became_active":"2024-08-27T02:46:49.666844+0000","last_became_peered":"2024-08-27T02:46:49.666844+0000","last_unstale":"2024-08-27T03:59:10.739008+0000","last_undegraded":"2024-08-27T03:59:10.739008+0000","last_fullsized":"2024-08-27T03:59:10.739008+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-08-27T03:59:10.738816+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-08-27T03:59:10.738816+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.738816+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:43:09.357876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'314","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.926129+0000","last_change":"2024-08-27T03:58:50.926129+0000","last_active":"2024-08-27T03:58:50.926129+0000","last_peered":"2024-08-27T03:58:50.926129+0000","last_clean":"2024-08-27T03:58:50.926129+0000","last_became_active":"2024-08-27T02:31:04.492737+0000","last_became_peered":"2024-08-27T02:31:04.492737+0000","last_unstale":"2024-08-27T03:58:50.926129+0000","last_undegraded":"2024-08-27T03:58:50.926129+0000","last_fullsized":"2024-08-27T03:58:50.926129+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'314","last_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_deep_scrub":"267'314","last_deep_scrub_stamp":"2024-08-27T03:58:50.925876+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.925876+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:38:38.135877+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291497,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":22191,"num_write":1009,"num_write_kb":38118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'460","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.853734+0000","last_change":"2024-08-27T03:58:55.853734+0000","last_active":"2024-08-27T03:58:55.853734+0000","last_peered":"2024-08-27T03:58:55.853734+0000","last_clean":"2024-08-27T03:58:55.853734+0000","last_became_active":"2024-08-27T02:31:06.458928+0000","last_became_peered":"2024-08-27T02:31:06.458928+0000","last_unstale":"2024-08-27T03:58:55.853734+0000","last_undegraded":"2024-08-27T03:58:55.853734+0000","last_fullsized":"2024-08-27T03:58:55.853734+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'460","last_scrub_stamp":"2024-08-27T03:58:55.853540+0000","last_deep_scrub":"267'460","last_deep_scrub_stamp":"2024-08-27T03:58:55.853540+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.853540+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:33:53.439285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2440,"num_write":518,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'361","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.144884+0000","last_change":"2024-08-27T03:58:43.144884+0000","last_active":"2024-08-27T03:58:43.144884+0000","last_peered":"2024-08-27T03:58:43.144884+0000","last_clean":"2024-08-27T03:58:43.144884+0000","last_became_active":"2024-08-27T02:31:04.454559+0000","last_became_peered":"2024-08-27T02:31:04.454559+0000","last_unstale":"2024-08-27T03:58:43.144884+0000","last_undegraded":"2024-08-27T03:58:43.144884+0000","last_fullsized":"2024-08-27T03:58:43.144884+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:43.144636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.144636+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:18:39.143444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424748,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":39942,"num_write":1277,"num_write_kb":32767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'826","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.895174+0000","last_change":"2024-08-27T03:58:54.895174+0000","last_active":"2024-08-27T03:58:54.895174+0000","last_peered":"2024-08-27T03:58:54.895174+0000","last_clean":"2024-08-27T03:58:54.895174+0000","last_became_active":"2024-08-27T02:31:06.453150+0000","last_became_peered":"2024-08-27T02:31:06.453150+0000","last_unstale":"2024-08-27T03:58:54.895174+0000","last_undegraded":"2024-08-27T03:58:54.895174+0000","last_fullsized":"2024-08-27T03:58:54.895174+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-08-27T03:58:54.894988+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.894988+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:39:10.133666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3909,"num_read_kb":3525,"num_write":1072,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'282","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.368824+0000","last_change":"2024-08-27T03:58:43.368824+0000","last_active":"2024-08-27T03:58:43.368824+0000","last_peered":"2024-08-27T03:58:43.368824+0000","last_clean":"2024-08-27T03:58:43.368824+0000","last_became_active":"2024-08-27T02:31:04.493055+0000","last_became_peered":"2024-08-27T02:31:04.493055+0000","last_unstale":"2024-08-27T03:58:43.368824+0000","last_undegraded":"2024-08-27T03:58:43.368824+0000","last_fullsized":"2024-08-27T03:58:43.368824+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'282","last_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_deep_scrub":"267'282","last_deep_scrub_stamp":"2024-08-27T03:58:43.368595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.368595+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:11:28.412078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262263,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":449,"num_write":920,"num_write_kb":28691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1217","reported_seq":2740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.707989+0000","last_change":"2024-08-27T03:58:56.707989+0000","last_active":"2024-08-27T03:58:56.707989+0000","last_peered":"2024-08-27T03:58:56.707989+0000","last_clean":"2024-08-27T03:58:56.707989+0000","last_became_active":"2024-08-27T02:31:06.463307+0000","last_became_peered":"2024-08-27T02:31:06.463307+0000","last_unstale":"2024-08-27T03:58:56.707989+0000","last_undegraded":"2024-08-27T03:58:56.707989+0000","last_fullsized":"2024-08-27T03:58:56.707989+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1217","last_scrub_stamp":"2024-08-27T03:58:56.707808+0000","last_deep_scrub":"267'1217","last_deep_scrub_stamp":"2024-08-27T03:58:56.707808+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.707808+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":1200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:14:15.277648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5286,"num_read_kb":4651,"num_write":1644,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'320","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.810370+0000","last_change":"2024-08-27T03:58:47.810209+0000","last_active":"2024-08-27T03:58:47.810370+0000","last_peered":"2024-08-27T03:58:47.810370+0000","last_clean":"2024-08-27T03:58:47.810370+0000","last_became_active":"2024-08-27T02:31:04.467204+0000","last_became_peered":"2024-08-27T02:31:04.467204+0000","last_unstale":"2024-08-27T03:58:47.810370+0000","last_undegraded":"2024-08-27T03:58:47.810370+0000","last_fullsized":"2024-08-27T03:58:47.810370+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:47.809968+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.809968+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:11:53.480777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":3871,"num_write":1091,"num_write_kb":13819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'481","reported_seq":2144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.508513+0000","last_change":"2024-08-27T03:58:52.508513+0000","last_active":"2024-08-27T03:58:52.508513+0000","last_peered":"2024-08-27T03:58:52.508513+0000","last_clean":"2024-08-27T03:58:52.508513+0000","last_became_active":"2024-08-27T02:31:06.452755+0000","last_became_peered":"2024-08-27T02:31:06.452755+0000","last_unstale":"2024-08-27T03:58:52.508513+0000","last_undegraded":"2024-08-27T03:58:52.508513+0000","last_fullsized":"2024-08-27T03:58:52.508513+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-08-27T03:58:52.508324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.508324+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:43.578410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2712,"num_read_kb":2560,"num_write":579,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'389","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.872905+0000","last_change":"2024-08-27T03:58:49.872905+0000","last_active":"2024-08-27T03:58:49.872905+0000","last_peered":"2024-08-27T03:58:49.872905+0000","last_clean":"2024-08-27T03:58:49.872905+0000","last_became_active":"2024-08-27T02:31:04.489077+0000","last_became_peered":"2024-08-27T02:31:04.489077+0000","last_unstale":"2024-08-27T03:58:49.872905+0000","last_undegraded":"2024-08-27T03:58:49.872905+0000","last_fullsized":"2024-08-27T03:58:49.872905+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:49.872597+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.872597+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:08:20.188046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493421,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":17279,"num_write":1203,"num_write_kb":38663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'494","reported_seq":2084,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.644002+0000","last_change":"2024-08-27T03:58:50.643833+0000","last_active":"2024-08-27T03:58:50.644002+0000","last_peered":"2024-08-27T03:58:50.644002+0000","last_clean":"2024-08-27T03:58:50.644002+0000","last_became_active":"2024-08-27T02:31:06.469183+0000","last_became_peered":"2024-08-27T02:31:06.469183+0000","last_unstale":"2024-08-27T03:58:50.644002+0000","last_undegraded":"2024-08-27T03:58:50.644002+0000","last_fullsized":"2024-08-27T03:58:50.644002+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-08-27T03:58:50.643652+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.643652+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:41:35.221530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2725,"num_read_kb":2545,"num_write":646,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'334","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.751411+0000","last_change":"2024-08-27T03:58:49.751411+0000","last_active":"2024-08-27T03:58:49.751411+0000","last_peered":"2024-08-27T03:58:49.751411+0000","last_clean":"2024-08-27T03:58:49.751411+0000","last_became_active":"2024-08-27T02:31:04.446263+0000","last_became_peered":"2024-08-27T02:31:04.446263+0000","last_unstale":"2024-08-27T03:58:49.751411+0000","last_undegraded":"2024-08-27T03:58:49.751411+0000","last_fullsized":"2024-08-27T03:58:49.751411+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-08-27T03:58:49.751052+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.751052+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:58:46.654336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399097,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":18975,"num_write":950,"num_write_kb":27902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'358","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.673806+0000","last_change":"2024-08-27T03:58:57.673806+0000","last_active":"2024-08-27T03:58:57.673806+0000","last_peered":"2024-08-27T03:58:57.673806+0000","last_clean":"2024-08-27T03:58:57.673806+0000","last_became_active":"2024-08-27T02:31:06.463854+0000","last_became_peered":"2024-08-27T02:31:06.463854+0000","last_unstale":"2024-08-27T03:58:57.673806+0000","last_undegraded":"2024-08-27T03:58:57.673806+0000","last_fullsized":"2024-08-27T03:58:57.673806+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-08-27T03:58:57.673567+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-08-27T03:58:57.673567+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.673567+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:53:05.248666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1950,"num_read_kb":1854,"num_write":416,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'354","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.572124+0000","last_change":"2024-08-27T03:58:40.571939+0000","last_active":"2024-08-27T03:58:40.572124+0000","last_peered":"2024-08-27T03:58:40.572124+0000","last_clean":"2024-08-27T03:58:40.572124+0000","last_became_active":"2024-08-27T02:31:39.746893+0000","last_became_peered":"2024-08-27T02:31:39.746893+0000","last_unstale":"2024-08-27T03:58:40.572124+0000","last_undegraded":"2024-08-27T03:58:40.572124+0000","last_fullsized":"2024-08-27T03:58:40.572124+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.571595+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.571595+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:38.897362+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5643582,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":18874,"num_write":1149,"num_write_kb":41944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"267'906","reported_seq":2475,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.892418+0000","last_change":"2024-08-27T03:58:56.892418+0000","last_active":"2024-08-27T03:58:56.892418+0000","last_peered":"2024-08-27T03:58:56.892418+0000","last_clean":"2024-08-27T03:58:56.892418+0000","last_became_active":"2024-08-27T02:31:06.440703+0000","last_became_peered":"2024-08-27T02:31:06.440703+0000","last_unstale":"2024-08-27T03:58:56.892418+0000","last_undegraded":"2024-08-27T03:58:56.892418+0000","last_fullsized":"2024-08-27T03:58:56.892418+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'906","last_scrub_stamp":"2024-08-27T03:58:56.892228+0000","last_deep_scrub":"267'906","last_deep_scrub_stamp":"2024-08-27T03:58:56.892228+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.892228+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:38:37.236736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4323,"num_read_kb":3845,"num_write":1242,"num_write_kb":488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1752,"num_omap_keys":7,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'344","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.157025+0000","last_change":"2024-08-27T03:58:47.157025+0000","last_active":"2024-08-27T03:58:47.157025+0000","last_peered":"2024-08-27T03:58:47.157025+0000","last_clean":"2024-08-27T03:58:47.157025+0000","last_became_active":"2024-08-27T02:31:04.460514+0000","last_became_peered":"2024-08-27T02:31:04.460514+0000","last_unstale":"2024-08-27T03:58:47.157025+0000","last_undegraded":"2024-08-27T03:58:47.157025+0000","last_fullsized":"2024-08-27T03:58:47.157025+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-08-27T03:58:47.156774+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.156774+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:35.049139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550512,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":6557,"num_write":1048,"num_write_kb":17192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'921","reported_seq":2469,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.495835+0000","last_change":"2024-08-27T03:58:48.495835+0000","last_active":"2024-08-27T03:58:48.495835+0000","last_peered":"2024-08-27T03:58:48.495835+0000","last_clean":"2024-08-27T03:58:48.495835+0000","last_became_active":"2024-08-27T02:31:06.458561+0000","last_became_peered":"2024-08-27T02:31:06.458561+0000","last_unstale":"2024-08-27T03:58:48.495835+0000","last_undegraded":"2024-08-27T03:58:48.495835+0000","last_fullsized":"2024-08-27T03:58:48.495835+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'921","last_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_deep_scrub":"267'921","last_deep_scrub_stamp":"2024-08-27T03:58:48.495658+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.495658+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":900,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:50:05.944519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4364,"num_read_kb":3872,"num_write":1297,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'771","reported_seq":2541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.680768+0000","last_change":"2024-08-27T03:58:54.680623+0000","last_active":"2024-08-27T03:58:54.680768+0000","last_peered":"2024-08-27T03:58:54.680768+0000","last_clean":"2024-08-27T03:58:54.680768+0000","last_became_active":"2024-08-27T02:31:06.465917+0000","last_became_peered":"2024-08-27T02:31:06.465917+0000","last_unstale":"2024-08-27T03:58:54.680768+0000","last_undegraded":"2024-08-27T03:58:54.680768+0000","last_fullsized":"2024-08-27T03:58:54.680768+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-08-27T03:58:54.680350+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.680350+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:58.085130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4017,"num_read_kb":3707,"num_write":1009,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2268,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'317","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.859587+0000","last_change":"2024-08-27T03:58:47.859587+0000","last_active":"2024-08-27T03:58:47.859587+0000","last_peered":"2024-08-27T03:58:47.859587+0000","last_clean":"2024-08-27T03:58:47.859587+0000","last_became_active":"2024-08-27T02:31:04.495314+0000","last_became_peered":"2024-08-27T02:31:04.495314+0000","last_unstale":"2024-08-27T03:58:47.859587+0000","last_undegraded":"2024-08-27T03:58:47.859587+0000","last_fullsized":"2024-08-27T03:58:47.859587+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-08-27T03:58:47.859361+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.859361+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:30.873158+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":9006,"num_write":957,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'790","reported_seq":2427,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.887957+0000","last_change":"2024-08-27T03:58:51.887806+0000","last_active":"2024-08-27T03:58:51.887957+0000","last_peered":"2024-08-27T03:58:51.887957+0000","last_clean":"2024-08-27T03:58:51.887957+0000","last_became_active":"2024-08-27T02:31:06.453511+0000","last_became_peered":"2024-08-27T02:31:06.453511+0000","last_unstale":"2024-08-27T03:58:51.887957+0000","last_undegraded":"2024-08-27T03:58:51.887957+0000","last_fullsized":"2024-08-27T03:58:51.887957+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:51.887607+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.887607+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:17.606029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3884,"num_read_kb":3537,"num_write":1033,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'361","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.731951+0000","last_change":"2024-08-27T03:58:44.731951+0000","last_active":"2024-08-27T03:58:44.731951+0000","last_peered":"2024-08-27T03:58:44.731951+0000","last_clean":"2024-08-27T03:58:44.731951+0000","last_became_active":"2024-08-27T02:31:04.457057+0000","last_became_peered":"2024-08-27T02:31:04.457057+0000","last_unstale":"2024-08-27T03:58:44.731951+0000","last_undegraded":"2024-08-27T03:58:44.731951+0000","last_fullsized":"2024-08-27T03:58:44.731951+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-08-27T03:58:44.731678+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.731678+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:19.085584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":653,"num_read_kb":8370,"num_write":1179,"num_write_kb":27894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'489","reported_seq":2254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.815492+0000","last_change":"2024-08-27T03:58:53.815492+0000","last_active":"2024-08-27T03:58:53.815492+0000","last_peered":"2024-08-27T03:58:53.815492+0000","last_clean":"2024-08-27T03:58:53.815492+0000","last_became_active":"2024-08-27T02:31:06.446558+0000","last_became_peered":"2024-08-27T02:31:06.446558+0000","last_unstale":"2024-08-27T03:58:53.815492+0000","last_undegraded":"2024-08-27T03:58:53.815492+0000","last_fullsized":"2024-08-27T03:58:53.815492+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'489","last_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_deep_scrub":"267'489","last_deep_scrub_stamp":"2024-08-27T03:58:53.815307+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.815307+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:19:09.901922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2718,"num_read_kb":2578,"num_write":557,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'337","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.776413+0000","last_change":"2024-08-27T03:58:41.776413+0000","last_active":"2024-08-27T03:58:41.776413+0000","last_peered":"2024-08-27T03:58:41.776413+0000","last_clean":"2024-08-27T03:58:41.776413+0000","last_became_active":"2024-08-27T02:31:39.806826+0000","last_became_peered":"2024-08-27T02:31:39.806826+0000","last_unstale":"2024-08-27T03:58:41.776413+0000","last_undegraded":"2024-08-27T03:58:41.776413+0000","last_fullsized":"2024-08-27T03:58:41.776413+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:41.776192+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.776192+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:41:09.715672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569152,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":11498,"num_write":1125,"num_write_kb":29195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'685","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.544933+0000","last_change":"2024-08-27T03:58:45.544933+0000","last_active":"2024-08-27T03:58:45.544933+0000","last_peered":"2024-08-27T03:58:45.544933+0000","last_clean":"2024-08-27T03:58:45.544933+0000","last_became_active":"2024-08-27T02:31:06.452668+0000","last_became_peered":"2024-08-27T02:31:06.452668+0000","last_unstale":"2024-08-27T03:58:45.544933+0000","last_undegraded":"2024-08-27T03:58:45.544933+0000","last_fullsized":"2024-08-27T03:58:45.544933+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'685","last_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_deep_scrub":"267'685","last_deep_scrub_stamp":"2024-08-27T03:58:45.544744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.544744+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:11:02.504356+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3529,"num_read_kb":3236,"num_write":1002,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'369","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.683165+0000","last_change":"2024-08-27T03:58:41.683165+0000","last_active":"2024-08-27T03:58:41.683165+0000","last_peered":"2024-08-27T03:58:41.683165+0000","last_clean":"2024-08-27T03:58:41.683165+0000","last_became_active":"2024-08-27T02:31:04.461425+0000","last_became_peered":"2024-08-27T02:31:04.461425+0000","last_unstale":"2024-08-27T03:58:41.683165+0000","last_undegraded":"2024-08-27T03:58:41.683165+0000","last_fullsized":"2024-08-27T03:58:41.683165+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-08-27T03:58:41.682887+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.682887+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:10:56.014716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":144736,"num_write":1195,"num_write_kb":38661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'478","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.516219+0000","last_change":"2024-08-27T03:58:47.516219+0000","last_active":"2024-08-27T03:58:47.516219+0000","last_peered":"2024-08-27T03:58:47.516219+0000","last_clean":"2024-08-27T03:58:47.516219+0000","last_became_active":"2024-08-27T02:31:06.455657+0000","last_became_peered":"2024-08-27T02:31:06.455657+0000","last_unstale":"2024-08-27T03:58:47.516219+0000","last_undegraded":"2024-08-27T03:58:47.516219+0000","last_fullsized":"2024-08-27T03:58:47.516219+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:47.516030+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.516030+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:37:54.405917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2529,"num_read_kb":2383,"num_write":566,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'335","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.141517+0000","last_change":"2024-08-27T03:58:45.141517+0000","last_active":"2024-08-27T03:58:45.141517+0000","last_peered":"2024-08-27T03:58:45.141517+0000","last_clean":"2024-08-27T03:58:45.141517+0000","last_became_active":"2024-08-27T02:31:04.449550+0000","last_became_peered":"2024-08-27T02:31:04.449550+0000","last_unstale":"2024-08-27T03:58:45.141517+0000","last_undegraded":"2024-08-27T03:58:45.141517+0000","last_fullsized":"2024-08-27T03:58:45.141517+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.141297+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.141297+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:27:20.006199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":571,"num_read_kb":47085,"num_write":1065,"num_write_kb":35898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'766","reported_seq":2229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.718201+0000","last_change":"2024-08-27T03:58:55.718201+0000","last_active":"2024-08-27T03:58:55.718201+0000","last_peered":"2024-08-27T03:58:55.718201+0000","last_clean":"2024-08-27T03:58:55.718201+0000","last_became_active":"2024-08-27T02:31:06.456242+0000","last_became_peered":"2024-08-27T02:31:06.456242+0000","last_unstale":"2024-08-27T03:58:55.718201+0000","last_undegraded":"2024-08-27T03:58:55.718201+0000","last_fullsized":"2024-08-27T03:58:55.718201+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'766","last_scrub_stamp":"2024-08-27T03:58:55.718017+0000","last_deep_scrub":"267'766","last_deep_scrub_stamp":"2024-08-27T03:58:55.718017+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.718017+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:06:22.226590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3549,"num_read_kb":3206,"num_write":1011,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'335","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.388100+0000","last_change":"2024-08-27T03:58:45.388100+0000","last_active":"2024-08-27T03:58:45.388100+0000","last_peered":"2024-08-27T03:58:45.388100+0000","last_clean":"2024-08-27T03:58:45.388100+0000","last_became_active":"2024-08-27T02:31:04.456224+0000","last_became_peered":"2024-08-27T02:31:04.456224+0000","last_unstale":"2024-08-27T03:58:45.388100+0000","last_undegraded":"2024-08-27T03:58:45.388100+0000","last_fullsized":"2024-08-27T03:58:45.388100+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-08-27T03:58:45.387860+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.387860+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:15:01.932292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14802,"num_write":998,"num_write_kb":35536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'133","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.639980+0000","last_change":"2024-08-27T03:59:12.639980+0000","last_active":"2024-08-27T03:59:12.639980+0000","last_peered":"2024-08-27T03:59:12.639980+0000","last_clean":"2024-08-27T03:59:12.639980+0000","last_became_active":"2024-08-27T02:31:14.508132+0000","last_became_peered":"2024-08-27T02:31:14.508132+0000","last_unstale":"2024-08-27T03:59:12.639980+0000","last_undegraded":"2024-08-27T03:59:12.639980+0000","last_fullsized":"2024-08-27T03:59:12.639980+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'133","last_scrub_stamp":"2024-08-27T03:59:12.639781+0000","last_deep_scrub":"267'133","last_deep_scrub_stamp":"2024-08-27T03:59:12.639781+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.639781+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:44:25.359793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":225,"num_read_kb":200,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'629","reported_seq":2356,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.184869+0000","last_change":"2024-08-27T03:58:50.184869+0000","last_active":"2024-08-27T03:58:50.184869+0000","last_peered":"2024-08-27T03:58:50.184869+0000","last_clean":"2024-08-27T03:58:50.184869+0000","last_became_active":"2024-08-27T02:31:06.446826+0000","last_became_peered":"2024-08-27T02:31:06.446826+0000","last_unstale":"2024-08-27T03:58:50.184869+0000","last_undegraded":"2024-08-27T03:58:50.184869+0000","last_fullsized":"2024-08-27T03:58:50.184869+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'629","last_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_deep_scrub":"267'629","last_deep_scrub_stamp":"2024-08-27T03:58:50.184685+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.184685+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:30.419124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3448,"num_read_kb":3131,"num_write":825,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4069,"num_omap_keys":16,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'362","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.829809+0000","last_change":"2024-08-27T03:58:48.829663+0000","last_active":"2024-08-27T03:58:48.829809+0000","last_peered":"2024-08-27T03:58:48.829809+0000","last_clean":"2024-08-27T03:58:48.829809+0000","last_became_active":"2024-08-27T02:31:04.492077+0000","last_became_peered":"2024-08-27T02:31:04.492077+0000","last_unstale":"2024-08-27T03:58:48.829809+0000","last_undegraded":"2024-08-27T03:58:48.829809+0000","last_fullsized":"2024-08-27T03:58:48.829809+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:48.829448+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.829448+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:32.990578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":48228,"num_write":1146,"num_write_kb":24133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.795920+0000","last_change":"2024-08-27T03:58:59.795920+0000","last_active":"2024-08-27T03:58:59.795920+0000","last_peered":"2024-08-27T03:58:59.795920+0000","last_clean":"2024-08-27T03:58:59.795920+0000","last_became_active":"2024-08-27T02:31:08.472708+0000","last_became_peered":"2024-08-27T02:31:08.472708+0000","last_unstale":"2024-08-27T03:58:59.795920+0000","last_undegraded":"2024-08-27T03:58:59.795920+0000","last_fullsized":"2024-08-27T03:58:59.795920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.795734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.795734+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.795734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:33:27.557373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'377","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.526382+0000","last_change":"2024-08-27T03:58:58.526382+0000","last_active":"2024-08-27T03:58:58.526382+0000","last_peered":"2024-08-27T03:58:58.526382+0000","last_clean":"2024-08-27T03:58:58.526382+0000","last_became_active":"2024-08-27T02:31:10.472935+0000","last_became_peered":"2024-08-27T02:31:10.472935+0000","last_unstale":"2024-08-27T03:58:58.526382+0000","last_undegraded":"2024-08-27T03:58:58.526382+0000","last_fullsized":"2024-08-27T03:58:58.526382+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-08-27T03:58:58.526170+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-08-27T03:58:58.526170+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.526170+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:48:28.463191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45479,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":590,"num_read_kb":1191,"num_write":460,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.807411+0000","last_change":"2024-08-27T03:59:07.807411+0000","last_active":"2024-08-27T03:59:07.807411+0000","last_peered":"2024-08-27T03:59:07.807411+0000","last_clean":"2024-08-27T03:59:07.807411+0000","last_became_active":"2024-08-27T02:31:12.512757+0000","last_became_peered":"2024-08-27T02:31:12.512757+0000","last_unstale":"2024-08-27T03:59:07.807411+0000","last_undegraded":"2024-08-27T03:59:07.807411+0000","last_fullsized":"2024-08-27T03:59:07.807411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.807225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.807225+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.807225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:34:57.632321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'143","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.966959+0000","last_change":"2024-08-27T03:59:12.966959+0000","last_active":"2024-08-27T03:59:12.966959+0000","last_peered":"2024-08-27T03:59:12.966959+0000","last_clean":"2024-08-27T03:59:12.966959+0000","last_became_active":"2024-08-27T02:31:14.507924+0000","last_became_peered":"2024-08-27T02:31:14.507924+0000","last_unstale":"2024-08-27T03:59:12.966959+0000","last_undegraded":"2024-08-27T03:59:12.966959+0000","last_fullsized":"2024-08-27T03:59:12.966959+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'143","last_scrub_stamp":"2024-08-27T03:59:12.966769+0000","last_deep_scrub":"267'143","last_deep_scrub_stamp":"2024-08-27T03:59:12.966769+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.966769+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:14:04.722562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":623,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":177,"num_read_kb":175,"num_write":255,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'818","reported_seq":2459,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.767544+0000","last_change":"2024-08-27T03:58:51.767544+0000","last_active":"2024-08-27T03:58:51.767544+0000","last_peered":"2024-08-27T03:58:51.767544+0000","last_clean":"2024-08-27T03:58:51.767544+0000","last_became_active":"2024-08-27T02:31:06.449613+0000","last_became_peered":"2024-08-27T02:31:06.449613+0000","last_unstale":"2024-08-27T03:58:51.767544+0000","last_undegraded":"2024-08-27T03:58:51.767544+0000","last_fullsized":"2024-08-27T03:58:51.767544+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-08-27T03:58:51.767367+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.767367+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:30:16.877533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3998,"num_read_kb":3616,"num_write":1082,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'315","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.405406+0000","last_change":"2024-08-27T03:58:40.405258+0000","last_active":"2024-08-27T03:58:40.405406+0000","last_peered":"2024-08-27T03:58:40.405406+0000","last_clean":"2024-08-27T03:58:40.405406+0000","last_became_active":"2024-08-27T02:31:04.492175+0000","last_became_peered":"2024-08-27T02:31:04.492175+0000","last_unstale":"2024-08-27T03:58:40.405406+0000","last_undegraded":"2024-08-27T03:58:40.405406+0000","last_fullsized":"2024-08-27T03:58:40.405406+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'315","last_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_deep_scrub":"267'315","last_deep_scrub_stamp":"2024-08-27T03:58:40.404999+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.404999+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:33:03.889980+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":392,"num_read_kb":13675,"num_write":949,"num_write_kb":31834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.306836+0000","last_change":"2024-08-27T03:59:00.306836+0000","last_active":"2024-08-27T03:59:00.306836+0000","last_peered":"2024-08-27T03:59:00.306836+0000","last_clean":"2024-08-27T03:59:00.306836+0000","last_became_active":"2024-08-27T02:31:08.443409+0000","last_became_peered":"2024-08-27T02:31:08.443409+0000","last_unstale":"2024-08-27T03:59:00.306836+0000","last_undegraded":"2024-08-27T03:59:00.306836+0000","last_fullsized":"2024-08-27T03:59:00.306836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.306628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.306628+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.306628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:15:18.222713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'122","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.672926+0000","last_change":"2024-08-27T03:59:04.672926+0000","last_active":"2024-08-27T03:59:04.672926+0000","last_peered":"2024-08-27T03:59:04.672926+0000","last_clean":"2024-08-27T03:59:04.672926+0000","last_became_active":"2024-08-27T02:31:10.462705+0000","last_became_peered":"2024-08-27T02:31:10.462705+0000","last_unstale":"2024-08-27T03:59:04.672926+0000","last_undegraded":"2024-08-27T03:59:04.672926+0000","last_fullsized":"2024-08-27T03:59:04.672926+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-08-27T03:59:04.672640+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-08-27T03:59:04.672640+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.672640+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:54:10.069916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.628390+0000","last_change":"2024-08-27T03:59:07.628390+0000","last_active":"2024-08-27T03:59:07.628390+0000","last_peered":"2024-08-27T03:59:07.628390+0000","last_clean":"2024-08-27T03:59:07.628390+0000","last_became_active":"2024-08-27T02:31:12.523383+0000","last_became_peered":"2024-08-27T02:31:12.523383+0000","last_unstale":"2024-08-27T03:59:07.628390+0000","last_undegraded":"2024-08-27T03:59:07.628390+0000","last_fullsized":"2024-08-27T03:59:07.628390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.628186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.628186+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.628186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:43:35.325697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'144","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.590569+0000","last_change":"2024-08-27T03:59:13.590569+0000","last_active":"2024-08-27T03:59:13.590569+0000","last_peered":"2024-08-27T03:59:13.590569+0000","last_clean":"2024-08-27T03:59:13.590569+0000","last_became_active":"2024-08-27T02:31:14.510929+0000","last_became_peered":"2024-08-27T02:31:14.510929+0000","last_unstale":"2024-08-27T03:59:13.590569+0000","last_undegraded":"2024-08-27T03:59:13.590569+0000","last_fullsized":"2024-08-27T03:59:13.590569+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'144","last_scrub_stamp":"2024-08-27T03:59:13.590366+0000","last_deep_scrub":"267'144","last_deep_scrub_stamp":"2024-08-27T03:59:13.590366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.590366+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:03.170715+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":348,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'410","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.414992+0000","last_change":"2024-08-27T03:58:48.414992+0000","last_active":"2024-08-27T03:58:48.414992+0000","last_peered":"2024-08-27T03:58:48.414992+0000","last_clean":"2024-08-27T03:58:48.414992+0000","last_became_active":"2024-08-27T02:31:06.447020+0000","last_became_peered":"2024-08-27T02:31:06.447020+0000","last_unstale":"2024-08-27T03:58:48.414992+0000","last_undegraded":"2024-08-27T03:58:48.414992+0000","last_fullsized":"2024-08-27T03:58:48.414992+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.414803+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.414803+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:47:21.445680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2227,"num_read_kb":2139,"num_write":442,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'379","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.593093+0000","last_change":"2024-08-27T03:58:37.593093+0000","last_active":"2024-08-27T03:58:37.593093+0000","last_peered":"2024-08-27T03:58:37.593093+0000","last_clean":"2024-08-27T03:58:37.593093+0000","last_became_active":"2024-08-27T02:31:38.758861+0000","last_became_peered":"2024-08-27T02:31:38.758861+0000","last_unstale":"2024-08-27T03:58:37.593093+0000","last_undegraded":"2024-08-27T03:58:37.593093+0000","last_fullsized":"2024-08-27T03:58:37.593093+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-08-27T03:58:37.592948+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.592948+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:31.585133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":662,"num_read_kb":34086,"num_write":1252,"num_write_kb":32683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"267'4","reported_seq":951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.286362+0000","last_change":"2024-08-27T03:59:01.286362+0000","last_active":"2024-08-27T03:59:01.286362+0000","last_peered":"2024-08-27T03:59:01.286362+0000","last_clean":"2024-08-27T03:59:01.286362+0000","last_became_active":"2024-08-27T02:31:08.474095+0000","last_became_peered":"2024-08-27T02:31:08.474095+0000","last_unstale":"2024-08-27T03:59:01.286362+0000","last_undegraded":"2024-08-27T03:59:01.286362+0000","last_fullsized":"2024-08-27T03:59:01.286362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:59:01.286155+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:59:01.286155+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.286155+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:57:27.108308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":643,"num_read_kb":641,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'161","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.578673+0000","last_change":"2024-08-27T03:58:56.578673+0000","last_active":"2024-08-27T03:58:56.578673+0000","last_peered":"2024-08-27T03:58:56.578673+0000","last_clean":"2024-08-27T03:58:56.578673+0000","last_became_active":"2024-08-27T02:31:10.463371+0000","last_became_peered":"2024-08-27T02:31:10.463371+0000","last_unstale":"2024-08-27T03:58:56.578673+0000","last_undegraded":"2024-08-27T03:58:56.578673+0000","last_fullsized":"2024-08-27T03:58:56.578673+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-08-27T03:58:56.578466+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-08-27T03:58:56.578466+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.578466+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:29:51.165504+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":194,"num_write":136,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'699","reported_seq":2545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.829790+0000","last_change":"2024-08-27T03:59:06.829790+0000","last_active":"2024-08-27T03:59:06.829790+0000","last_peered":"2024-08-27T03:59:06.829790+0000","last_clean":"2024-08-27T03:59:06.829790+0000","last_became_active":"2024-08-27T02:31:12.504641+0000","last_became_peered":"2024-08-27T02:31:12.504641+0000","last_unstale":"2024-08-27T03:59:06.829790+0000","last_undegraded":"2024-08-27T03:59:06.829790+0000","last_fullsized":"2024-08-27T03:59:06.829790+0000","mapping_epoch":33,"log_start":"267'601","ondisk_log_start":"267'601","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'699","last_scrub_stamp":"2024-08-27T03:59:06.829502+0000","last_deep_scrub":"267'699","last_deep_scrub_stamp":"2024-08-27T03:59:06.829502+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.829502+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":601,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:50:43.865968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'182","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:25.638342+0000","last_change":"2024-08-27T03:59:25.638342+0000","last_active":"2024-08-27T03:59:25.638342+0000","last_peered":"2024-08-27T03:59:25.638342+0000","last_clean":"2024-08-27T03:59:25.638342+0000","last_became_active":"2024-08-27T02:31:15.025122+0000","last_became_peered":"2024-08-27T02:31:15.025122+0000","last_unstale":"2024-08-27T03:59:25.638342+0000","last_undegraded":"2024-08-27T03:59:25.638342+0000","last_fullsized":"2024-08-27T03:59:25.638342+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'182","last_scrub_stamp":"2024-08-27T03:59:25.638115+0000","last_deep_scrub":"267'182","last_deep_scrub_stamp":"2024-08-27T03:59:25.638115+0000","last_clean_scrub_stamp":"2024-08-27T03:59:25.638115+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:38:48.349445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":395,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'586","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.205600+0000","last_change":"2024-08-27T03:58:52.205600+0000","last_active":"2024-08-27T03:58:52.205600+0000","last_peered":"2024-08-27T03:58:52.205600+0000","last_clean":"2024-08-27T03:58:52.205600+0000","last_became_active":"2024-08-27T02:31:06.459325+0000","last_became_peered":"2024-08-27T02:31:06.459325+0000","last_unstale":"2024-08-27T03:58:52.205600+0000","last_undegraded":"2024-08-27T03:58:52.205600+0000","last_fullsized":"2024-08-27T03:58:52.205600+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'586","last_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_deep_scrub":"267'586","last_deep_scrub_stamp":"2024-08-27T03:58:52.205406+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.205406+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:50:44.375635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3036,"num_read_kb":2794,"num_write":772,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'340","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.757519+0000","last_change":"2024-08-27T03:58:43.757370+0000","last_active":"2024-08-27T03:58:43.757519+0000","last_peered":"2024-08-27T03:58:43.757519+0000","last_clean":"2024-08-27T03:58:43.757519+0000","last_became_active":"2024-08-27T02:31:04.480819+0000","last_became_peered":"2024-08-27T02:31:04.480819+0000","last_unstale":"2024-08-27T03:58:43.757519+0000","last_undegraded":"2024-08-27T03:58:43.757519+0000","last_fullsized":"2024-08-27T03:58:43.757519+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-08-27T03:58:43.757154+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.757154+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:02:26.623631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":443,"num_read_kb":7480,"num_write":1117,"num_write_kb":40404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.813487+0000","last_change":"2024-08-27T03:59:00.813487+0000","last_active":"2024-08-27T03:59:00.813487+0000","last_peered":"2024-08-27T03:59:00.813487+0000","last_clean":"2024-08-27T03:59:00.813487+0000","last_became_active":"2024-08-27T02:31:08.476176+0000","last_became_peered":"2024-08-27T02:31:08.476176+0000","last_unstale":"2024-08-27T03:59:00.813487+0000","last_undegraded":"2024-08-27T03:59:00.813487+0000","last_fullsized":"2024-08-27T03:59:00.813487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.813232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.813232+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.813232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:02:51.715518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'295","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.933820+0000","last_change":"2024-08-27T03:59:01.933820+0000","last_active":"2024-08-27T03:59:01.933820+0000","last_peered":"2024-08-27T03:59:01.933820+0000","last_clean":"2024-08-27T03:59:01.933820+0000","last_became_active":"2024-08-27T02:31:10.636799+0000","last_became_peered":"2024-08-27T02:31:10.636799+0000","last_unstale":"2024-08-27T03:59:01.933820+0000","last_undegraded":"2024-08-27T03:59:01.933820+0000","last_fullsized":"2024-08-27T03:59:01.933820+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-08-27T03:59:01.933556+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-08-27T03:59:01.933556+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.933556+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:29:06.683563+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":1056,"num_write":374,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'732","reported_seq":2841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.442211+0000","last_change":"2024-08-27T03:59:13.442211+0000","last_active":"2024-08-27T03:59:13.442211+0000","last_peered":"2024-08-27T03:59:13.442211+0000","last_clean":"2024-08-27T03:59:13.442211+0000","last_became_active":"2024-08-27T02:31:12.504791+0000","last_became_peered":"2024-08-27T02:31:12.504791+0000","last_unstale":"2024-08-27T03:59:13.442211+0000","last_undegraded":"2024-08-27T03:59:13.442211+0000","last_fullsized":"2024-08-27T03:59:13.442211+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'732","last_scrub_stamp":"2024-08-27T03:59:13.442031+0000","last_deep_scrub":"267'732","last_deep_scrub_stamp":"2024-08-27T03:59:13.442031+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.442031+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:09:04.125170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'1269","reported_seq":2839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.726782+0000","last_change":"2024-08-27T03:58:50.726782+0000","last_active":"2024-08-27T03:58:50.726782+0000","last_peered":"2024-08-27T03:58:50.726782+0000","last_clean":"2024-08-27T03:58:50.726782+0000","last_became_active":"2024-08-27T02:31:06.442938+0000","last_became_peered":"2024-08-27T02:31:06.442938+0000","last_unstale":"2024-08-27T03:58:50.726782+0000","last_undegraded":"2024-08-27T03:58:50.726782+0000","last_fullsized":"2024-08-27T03:58:50.726782+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1269","last_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_deep_scrub":"267'1269","last_deep_scrub_stamp":"2024-08-27T03:58:50.726573+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.726573+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":1200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:40:04.847159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5636,"num_read_kb":4935,"num_write":1760,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'352","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.902356+0000","last_change":"2024-08-27T03:58:43.902156+0000","last_active":"2024-08-27T03:58:43.902356+0000","last_peered":"2024-08-27T03:58:43.902356+0000","last_clean":"2024-08-27T03:58:43.902356+0000","last_became_active":"2024-08-27T02:31:04.498973+0000","last_became_peered":"2024-08-27T02:31:04.498973+0000","last_unstale":"2024-08-27T03:58:43.902356+0000","last_undegraded":"2024-08-27T03:58:43.902356+0000","last_fullsized":"2024-08-27T03:58:43.902356+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-08-27T03:58:43.901882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.901882+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:51:44.473839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":34000,"num_write":1087,"num_write_kb":32180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.909819+0000","last_change":"2024-08-27T03:58:55.909819+0000","last_active":"2024-08-27T03:58:55.909819+0000","last_peered":"2024-08-27T03:58:55.909819+0000","last_clean":"2024-08-27T03:58:55.909819+0000","last_became_active":"2024-08-27T02:31:08.467329+0000","last_became_peered":"2024-08-27T02:31:08.467329+0000","last_unstale":"2024-08-27T03:58:55.909819+0000","last_undegraded":"2024-08-27T03:58:55.909819+0000","last_fullsized":"2024-08-27T03:58:55.909819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:55.909634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:55.909634+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.909634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:36:23.804649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'409","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.812240+0000","last_change":"2024-08-27T03:59:04.812240+0000","last_active":"2024-08-27T03:59:04.812240+0000","last_peered":"2024-08-27T03:59:04.812240+0000","last_clean":"2024-08-27T03:59:04.812240+0000","last_became_active":"2024-08-27T02:31:10.632722+0000","last_became_peered":"2024-08-27T02:31:10.632722+0000","last_unstale":"2024-08-27T03:59:04.812240+0000","last_undegraded":"2024-08-27T03:59:04.812240+0000","last_fullsized":"2024-08-27T03:59:04.812240+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-08-27T03:59:04.812027+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-08-27T03:59:04.812027+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.812027+0000","objects_scrubbed":10,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:19:17.728321+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44175,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":1186,"num_write":474,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.166416+0000","last_change":"2024-08-27T03:59:05.166416+0000","last_active":"2024-08-27T03:59:05.166416+0000","last_peered":"2024-08-27T03:59:05.166416+0000","last_clean":"2024-08-27T03:59:05.166416+0000","last_became_active":"2024-08-27T02:31:12.507810+0000","last_became_peered":"2024-08-27T02:31:12.507810+0000","last_unstale":"2024-08-27T03:59:05.166416+0000","last_undegraded":"2024-08-27T03:59:05.166416+0000","last_fullsized":"2024-08-27T03:59:05.166416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.166222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.166222+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.166222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:14:08.593273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'591","reported_seq":1440,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:13.991865+0000","last_change":"2024-08-27T03:59:13.991865+0000","last_active":"2024-08-27T03:59:13.991865+0000","last_peered":"2024-08-27T03:59:13.991865+0000","last_clean":"2024-08-27T03:59:13.991865+0000","last_became_active":"2024-08-27T02:31:14.507440+0000","last_became_peered":"2024-08-27T02:31:14.507440+0000","last_unstale":"2024-08-27T03:59:13.991865+0000","last_undegraded":"2024-08-27T03:59:13.991865+0000","last_fullsized":"2024-08-27T03:59:13.991865+0000","mapping_epoch":35,"log_start":"267'500","ondisk_log_start":"267'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'591","last_scrub_stamp":"2024-08-27T03:59:13.991679+0000","last_deep_scrub":"267'591","last_deep_scrub_stamp":"2024-08-27T03:59:13.991679+0000","last_clean_scrub_stamp":"2024-08-27T03:59:13.991679+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:05:34.432969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1339,"num_read_kb":1328,"num_write":1229,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1459","reported_seq":2962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.678164+0000","last_change":"2024-08-27T03:58:50.678164+0000","last_active":"2024-08-27T03:58:50.678164+0000","last_peered":"2024-08-27T03:58:50.678164+0000","last_clean":"2024-08-27T03:58:50.678164+0000","last_became_active":"2024-08-27T02:31:06.454706+0000","last_became_peered":"2024-08-27T02:31:06.454706+0000","last_unstale":"2024-08-27T03:58:50.678164+0000","last_undegraded":"2024-08-27T03:58:50.678164+0000","last_fullsized":"2024-08-27T03:58:50.678164+0000","mapping_epoch":27,"log_start":"267'1400","ondisk_log_start":"267'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1459","last_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_deep_scrub":"267'1459","last_deep_scrub_stamp":"2024-08-27T03:58:50.677969+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.677969+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:05:44.968990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6483,"num_read_kb":5700,"num_write":2049,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'373","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.897914+0000","last_change":"2024-08-27T03:58:40.897763+0000","last_active":"2024-08-27T03:58:40.897914+0000","last_peered":"2024-08-27T03:58:40.897914+0000","last_clean":"2024-08-27T03:58:40.897914+0000","last_became_active":"2024-08-27T02:31:04.492321+0000","last_became_peered":"2024-08-27T02:31:04.492321+0000","last_unstale":"2024-08-27T03:58:40.897914+0000","last_undegraded":"2024-08-27T03:58:40.897914+0000","last_fullsized":"2024-08-27T03:58:40.897914+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-08-27T03:58:40.897535+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.897535+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:28:11.789719+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400081,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":644,"num_read_kb":2850,"num_write":1271,"num_write_kb":9686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.446962+0000","last_change":"2024-08-27T03:58:50.446962+0000","last_active":"2024-08-27T03:58:50.446962+0000","last_peered":"2024-08-27T03:58:50.446962+0000","last_clean":"2024-08-27T03:58:50.446962+0000","last_became_active":"2024-08-27T02:31:08.460614+0000","last_became_peered":"2024-08-27T02:31:08.460614+0000","last_unstale":"2024-08-27T03:58:50.446962+0000","last_undegraded":"2024-08-27T03:58:50.446962+0000","last_fullsized":"2024-08-27T03:58:50.446962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:50.446779+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.446779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:18:37.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'312","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.356278+0000","last_change":"2024-08-27T03:59:03.356278+0000","last_active":"2024-08-27T03:59:03.356278+0000","last_peered":"2024-08-27T03:59:03.356278+0000","last_clean":"2024-08-27T03:59:03.356278+0000","last_became_active":"2024-08-27T02:31:10.465073+0000","last_became_peered":"2024-08-27T02:31:10.465073+0000","last_unstale":"2024-08-27T03:59:03.356278+0000","last_undegraded":"2024-08-27T03:59:03.356278+0000","last_fullsized":"2024-08-27T03:59:03.356278+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-08-27T03:59:03.356083+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-08-27T03:59:03.356083+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.356083+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:28:02.032416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44241,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":1191,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.452725+0000","last_change":"2024-08-27T03:59:11.452725+0000","last_active":"2024-08-27T03:59:11.452725+0000","last_peered":"2024-08-27T03:59:11.452725+0000","last_clean":"2024-08-27T03:59:11.452725+0000","last_became_active":"2024-08-27T02:31:12.505624+0000","last_became_peered":"2024-08-27T02:31:12.505624+0000","last_unstale":"2024-08-27T03:59:11.452725+0000","last_undegraded":"2024-08-27T03:59:11.452725+0000","last_fullsized":"2024-08-27T03:59:11.452725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:11.452489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:11.452489+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.452489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:53:42.936078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2397","reported_seq":4240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.612748+0000","last_change":"2024-08-27T03:58:59.612748+0000","last_active":"2024-08-27T03:58:59.612748+0000","last_peered":"2024-08-27T03:58:59.612748+0000","last_clean":"2024-08-27T03:58:59.612748+0000","last_became_active":"2024-08-27T02:31:14.513724+0000","last_became_peered":"2024-08-27T02:31:14.513724+0000","last_unstale":"2024-08-27T03:58:59.612748+0000","last_undegraded":"2024-08-27T03:58:59.612748+0000","last_fullsized":"2024-08-27T03:58:59.612748+0000","mapping_epoch":35,"log_start":"267'2300","ondisk_log_start":"267'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2397","last_scrub_stamp":"2024-08-27T03:58:59.612560+0000","last_deep_scrub":"267'2397","last_deep_scrub_stamp":"2024-08-27T03:58:59.612560+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.612560+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":2300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:19:39.008794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5987,"num_read_kb":5991,"num_write":4836,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'442","reported_seq":1947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.728545+0000","last_change":"2024-08-27T03:58:46.728545+0000","last_active":"2024-08-27T03:58:46.728545+0000","last_peered":"2024-08-27T03:58:46.728545+0000","last_clean":"2024-08-27T03:58:46.728545+0000","last_became_active":"2024-08-27T02:31:06.472660+0000","last_became_peered":"2024-08-27T02:31:06.472660+0000","last_unstale":"2024-08-27T03:58:46.728545+0000","last_undegraded":"2024-08-27T03:58:46.728545+0000","last_fullsized":"2024-08-27T03:58:46.728545+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:46.728340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.728340+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:13:06.435241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2132,"num_write":516,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":938,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'337","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.909461+0000","last_change":"2024-08-27T03:58:42.909307+0000","last_active":"2024-08-27T03:58:42.909461+0000","last_peered":"2024-08-27T03:58:42.909461+0000","last_clean":"2024-08-27T03:58:42.909461+0000","last_became_active":"2024-08-27T02:31:04.500904+0000","last_became_peered":"2024-08-27T02:31:04.500904+0000","last_unstale":"2024-08-27T03:58:42.909461+0000","last_undegraded":"2024-08-27T03:58:42.909461+0000","last_fullsized":"2024-08-27T03:58:42.909461+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'337","last_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_deep_scrub":"267'337","last_deep_scrub_stamp":"2024-08-27T03:58:42.909045+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.909045+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:53.647196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1998258,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":51263,"num_write":1130,"num_write_kb":44721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.501182+0000","last_change":"2024-08-27T03:58:52.501054+0000","last_active":"2024-08-27T03:58:52.501182+0000","last_peered":"2024-08-27T03:58:52.501182+0000","last_clean":"2024-08-27T03:58:52.501182+0000","last_became_active":"2024-08-27T02:31:08.462596+0000","last_became_peered":"2024-08-27T02:31:08.462596+0000","last_unstale":"2024-08-27T03:58:52.501182+0000","last_undegraded":"2024-08-27T03:58:52.501182+0000","last_fullsized":"2024-08-27T03:58:52.501182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.500871+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.500871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:22:38.128581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'369","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.919018+0000","last_change":"2024-08-27T03:59:00.919018+0000","last_active":"2024-08-27T03:59:00.919018+0000","last_peered":"2024-08-27T03:59:00.919018+0000","last_clean":"2024-08-27T03:59:00.919018+0000","last_became_active":"2024-08-27T02:31:10.475957+0000","last_became_peered":"2024-08-27T02:31:10.475957+0000","last_unstale":"2024-08-27T03:59:00.919018+0000","last_undegraded":"2024-08-27T03:59:00.919018+0000","last_fullsized":"2024-08-27T03:59:00.919018+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-08-27T03:59:00.918768+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-08-27T03:59:00.918768+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.918768+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:41:01.877708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":1205,"num_write":456,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'721","reported_seq":4960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.429142+0000","last_change":"2024-08-27T03:59:03.429142+0000","last_active":"2024-08-27T03:59:03.429142+0000","last_peered":"2024-08-27T03:59:03.429142+0000","last_clean":"2024-08-27T03:59:03.429142+0000","last_became_active":"2024-08-27T02:31:12.514979+0000","last_became_peered":"2024-08-27T02:31:12.514979+0000","last_unstale":"2024-08-27T03:59:03.429142+0000","last_undegraded":"2024-08-27T03:59:03.429142+0000","last_fullsized":"2024-08-27T03:59:03.429142+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'721","last_scrub_stamp":"2024-08-27T03:59:03.428951+0000","last_deep_scrub":"267'721","last_deep_scrub_stamp":"2024-08-27T03:59:03.428951+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.428951+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:15:09.865002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'173","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.593053+0000","last_change":"2024-08-27T03:59:10.593053+0000","last_active":"2024-08-27T03:59:10.593053+0000","last_peered":"2024-08-27T03:59:10.593053+0000","last_clean":"2024-08-27T03:59:10.593053+0000","last_became_active":"2024-08-27T02:31:14.511107+0000","last_became_peered":"2024-08-27T02:31:14.511107+0000","last_unstale":"2024-08-27T03:59:10.593053+0000","last_undegraded":"2024-08-27T03:59:10.593053+0000","last_fullsized":"2024-08-27T03:59:10.593053+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-08-27T03:59:10.592870+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-08-27T03:59:10.592870+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.592870+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:13:15.224143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":299,"num_write":415,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'799","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.365595+0000","last_change":"2024-08-27T03:58:46.365457+0000","last_active":"2024-08-27T03:58:46.365595+0000","last_peered":"2024-08-27T03:58:46.365595+0000","last_clean":"2024-08-27T03:58:46.365595+0000","last_became_active":"2024-08-27T02:31:06.446426+0000","last_became_peered":"2024-08-27T02:31:06.446426+0000","last_unstale":"2024-08-27T03:58:46.365595+0000","last_undegraded":"2024-08-27T03:58:46.365595+0000","last_fullsized":"2024-08-27T03:58:46.365595+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'799","last_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_deep_scrub":"267'799","last_deep_scrub_stamp":"2024-08-27T03:58:46.365257+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.365257+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:38.841374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3523,"num_write":1084,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'306","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.677763+0000","last_change":"2024-08-27T03:58:40.677586+0000","last_active":"2024-08-27T03:58:40.677763+0000","last_peered":"2024-08-27T03:58:40.677763+0000","last_clean":"2024-08-27T03:58:40.677763+0000","last_became_active":"2024-08-27T02:31:04.449706+0000","last_became_peered":"2024-08-27T02:31:04.449706+0000","last_unstale":"2024-08-27T03:58:40.677763+0000","last_undegraded":"2024-08-27T03:58:40.677763+0000","last_fullsized":"2024-08-27T03:58:40.677763+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:40.677362+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.677362+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:13:35.785593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437736,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":7344,"num_write":963,"num_write_kb":33186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.471473+0000","last_change":"2024-08-27T03:58:51.471473+0000","last_active":"2024-08-27T03:58:51.471473+0000","last_peered":"2024-08-27T03:58:51.471473+0000","last_clean":"2024-08-27T03:58:51.471473+0000","last_became_active":"2024-08-27T02:31:08.455022+0000","last_became_peered":"2024-08-27T02:31:08.455022+0000","last_unstale":"2024-08-27T03:58:51.471473+0000","last_undegraded":"2024-08-27T03:58:51.471473+0000","last_fullsized":"2024-08-27T03:58:51.471473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.471186+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.471186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:37:00.848131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'502","reported_seq":1187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.558075+0000","last_change":"2024-08-27T03:59:00.558075+0000","last_active":"2024-08-27T03:59:00.558075+0000","last_peered":"2024-08-27T03:59:00.558075+0000","last_clean":"2024-08-27T03:59:00.558075+0000","last_became_active":"2024-08-27T02:31:10.476523+0000","last_became_peered":"2024-08-27T02:31:10.476523+0000","last_unstale":"2024-08-27T03:59:00.558075+0000","last_undegraded":"2024-08-27T03:59:00.558075+0000","last_fullsized":"2024-08-27T03:59:00.558075+0000","mapping_epoch":31,"log_start":"267'400","ondisk_log_start":"267'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'502","last_scrub_stamp":"2024-08-27T03:59:00.557849+0000","last_deep_scrub":"267'502","last_deep_scrub_stamp":"2024-08-27T03:59:00.557849+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.557849+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:18:16.615000+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73530,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2086,"num_write":702,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.619192+0000","last_change":"2024-08-27T03:58:59.619192+0000","last_active":"2024-08-27T03:58:59.619192+0000","last_peered":"2024-08-27T03:58:59.619192+0000","last_clean":"2024-08-27T03:58:59.619192+0000","last_became_active":"2024-08-27T02:31:12.496758+0000","last_became_peered":"2024-08-27T02:31:12.496758+0000","last_unstale":"2024-08-27T03:58:59.619192+0000","last_undegraded":"2024-08-27T03:58:59.619192+0000","last_fullsized":"2024-08-27T03:58:59.619192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.619006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.619006+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.619006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:28:08.565324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'131","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.087976+0000","last_change":"2024-08-27T03:59:00.087976+0000","last_active":"2024-08-27T03:59:00.087976+0000","last_peered":"2024-08-27T03:59:00.087976+0000","last_clean":"2024-08-27T03:59:00.087976+0000","last_became_active":"2024-08-27T02:31:14.509038+0000","last_became_peered":"2024-08-27T02:31:14.509038+0000","last_unstale":"2024-08-27T03:59:00.087976+0000","last_undegraded":"2024-08-27T03:59:00.087976+0000","last_fullsized":"2024-08-27T03:59:00.087976+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-08-27T03:59:00.087746+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-08-27T03:59:00.087746+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.087746+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:08:20.853635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":131,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'444","reported_seq":1982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.708558+0000","last_change":"2024-08-27T03:58:43.708403+0000","last_active":"2024-08-27T03:58:43.708558+0000","last_peered":"2024-08-27T03:58:43.708558+0000","last_clean":"2024-08-27T03:58:43.708558+0000","last_became_active":"2024-08-27T02:31:06.466969+0000","last_became_peered":"2024-08-27T02:31:06.466969+0000","last_unstale":"2024-08-27T03:58:43.708558+0000","last_undegraded":"2024-08-27T03:58:43.708558+0000","last_fullsized":"2024-08-27T03:58:43.708558+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-08-27T03:58:43.708210+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.708210+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:51:30.618879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2210,"num_write":532,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'311","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.180394+0000","last_change":"2024-08-27T03:58:42.180228+0000","last_active":"2024-08-27T03:58:42.180394+0000","last_peered":"2024-08-27T03:58:42.180394+0000","last_clean":"2024-08-27T03:58:42.180394+0000","last_became_active":"2024-08-27T02:31:04.475478+0000","last_became_peered":"2024-08-27T02:31:04.475478+0000","last_unstale":"2024-08-27T03:58:42.180394+0000","last_undegraded":"2024-08-27T03:58:42.180394+0000","last_fullsized":"2024-08-27T03:58:42.180394+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:42.179951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.179951+0000","objects_scrubbed":12,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:54:16.625194+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490466,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":438,"num_read_kb":3133,"num_write":1058,"num_write_kb":18099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.542454+0000","last_change":"2024-08-27T03:58:53.542226+0000","last_active":"2024-08-27T03:58:53.542454+0000","last_peered":"2024-08-27T03:58:53.542454+0000","last_clean":"2024-08-27T03:58:53.542454+0000","last_became_active":"2024-08-27T02:31:08.454956+0000","last_became_peered":"2024-08-27T02:31:08.454956+0000","last_unstale":"2024-08-27T03:58:53.542454+0000","last_undegraded":"2024-08-27T03:58:53.542454+0000","last_fullsized":"2024-08-27T03:58:53.542454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.541954+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.541954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:03.310498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'324","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.695103+0000","last_change":"2024-08-27T03:59:03.695103+0000","last_active":"2024-08-27T03:59:03.695103+0000","last_peered":"2024-08-27T03:59:03.695103+0000","last_clean":"2024-08-27T03:59:03.695103+0000","last_became_active":"2024-08-27T02:31:10.468614+0000","last_became_peered":"2024-08-27T02:31:10.468614+0000","last_unstale":"2024-08-27T03:59:03.695103+0000","last_undegraded":"2024-08-27T03:59:03.695103+0000","last_fullsized":"2024-08-27T03:59:03.695103+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-08-27T03:59:03.694903+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-08-27T03:59:03.694903+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.694903+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:37:33.840824+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53541,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":1146,"num_write":466,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.508966+0000","last_change":"2024-08-27T03:59:05.508803+0000","last_active":"2024-08-27T03:59:05.508966+0000","last_peered":"2024-08-27T03:59:05.508966+0000","last_clean":"2024-08-27T03:59:05.508966+0000","last_became_active":"2024-08-27T02:31:12.515587+0000","last_became_peered":"2024-08-27T02:31:12.515587+0000","last_unstale":"2024-08-27T03:59:05.508966+0000","last_undegraded":"2024-08-27T03:59:05.508966+0000","last_fullsized":"2024-08-27T03:59:05.508966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.508630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.508630+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.508630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:46:36.101798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'126","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.448726+0000","last_change":"2024-08-27T03:59:14.448587+0000","last_active":"2024-08-27T03:59:14.448726+0000","last_peered":"2024-08-27T03:59:14.448726+0000","last_clean":"2024-08-27T03:59:14.448726+0000","last_became_active":"2024-08-27T02:31:14.507954+0000","last_became_peered":"2024-08-27T02:31:14.507954+0000","last_unstale":"2024-08-27T03:59:14.448726+0000","last_undegraded":"2024-08-27T03:59:14.448726+0000","last_fullsized":"2024-08-27T03:59:14.448726+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-08-27T03:59:14.448374+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-08-27T03:59:14.448374+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.448374+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:19:46.371369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":112,"num_write":291,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'306","reported_seq":1707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.720598+0000","last_change":"2024-08-27T03:58:45.720430+0000","last_active":"2024-08-27T03:58:45.720598+0000","last_peered":"2024-08-27T03:58:45.720598+0000","last_clean":"2024-08-27T03:58:45.720598+0000","last_became_active":"2024-08-27T02:31:06.454738+0000","last_became_peered":"2024-08-27T02:31:06.454738+0000","last_unstale":"2024-08-27T03:58:45.720598+0000","last_undegraded":"2024-08-27T03:58:45.720598+0000","last_fullsized":"2024-08-27T03:58:45.720598+0000","mapping_epoch":27,"log_start":"267'200","ondisk_log_start":"267'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-08-27T03:58:45.720239+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.720239+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:13:56.970539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1740,"num_read_kb":1681,"num_write":324,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1145,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'321","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.795951+0000","last_change":"2024-08-27T03:58:39.795951+0000","last_active":"2024-08-27T03:58:39.795951+0000","last_peered":"2024-08-27T03:58:39.795951+0000","last_clean":"2024-08-27T03:58:39.795951+0000","last_became_active":"2024-08-27T02:31:38.752014+0000","last_became_peered":"2024-08-27T02:31:38.752014+0000","last_unstale":"2024-08-27T03:58:39.795951+0000","last_undegraded":"2024-08-27T03:58:39.795951+0000","last_fullsized":"2024-08-27T03:58:39.795951+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'321","last_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_deep_scrub":"267'321","last_deep_scrub_stamp":"2024-08-27T03:58:39.795741+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.795741+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:58:23.816179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":447,"num_read_kb":5526,"num_write":1006,"num_write_kb":40746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1,7],"acting":[6,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.988502+0000","last_change":"2024-08-27T03:58:52.988368+0000","last_active":"2024-08-27T03:58:52.988502+0000","last_peered":"2024-08-27T03:58:52.988502+0000","last_clean":"2024-08-27T03:58:52.988502+0000","last_became_active":"2024-08-27T02:31:08.472648+0000","last_became_peered":"2024-08-27T02:31:08.472648+0000","last_unstale":"2024-08-27T03:58:52.988502+0000","last_undegraded":"2024-08-27T03:58:52.988502+0000","last_fullsized":"2024-08-27T03:58:52.988502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.988149+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.988149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:55.540473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'383","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.561586+0000","last_change":"2024-08-27T03:58:54.561448+0000","last_active":"2024-08-27T03:58:54.561586+0000","last_peered":"2024-08-27T03:58:54.561586+0000","last_clean":"2024-08-27T03:58:54.561586+0000","last_became_active":"2024-08-27T02:31:10.462182+0000","last_became_peered":"2024-08-27T02:31:10.462182+0000","last_unstale":"2024-08-27T03:58:54.561586+0000","last_undegraded":"2024-08-27T03:58:54.561586+0000","last_fullsized":"2024-08-27T03:58:54.561586+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-08-27T03:58:54.561237+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.561237+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:30:34.180367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46164,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":1361,"num_write":488,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'671","reported_seq":2569,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.564764+0000","last_change":"2024-08-27T03:58:55.564627+0000","last_active":"2024-08-27T03:58:55.564764+0000","last_peered":"2024-08-27T03:58:55.564764+0000","last_clean":"2024-08-27T03:58:55.564764+0000","last_became_active":"2024-08-27T02:31:12.507219+0000","last_became_peered":"2024-08-27T02:31:12.507219+0000","last_unstale":"2024-08-27T03:58:55.564764+0000","last_undegraded":"2024-08-27T03:58:55.564764+0000","last_fullsized":"2024-08-27T03:58:55.564764+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'671","last_scrub_stamp":"2024-08-27T03:58:55.564443+0000","last_deep_scrub":"267'671","last_deep_scrub_stamp":"2024-08-27T03:58:55.564443+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.564443+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:40:46.587213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'100","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.085509+0000","last_change":"2024-08-27T03:59:01.085509+0000","last_active":"2024-08-27T03:59:01.085509+0000","last_peered":"2024-08-27T03:59:01.085509+0000","last_clean":"2024-08-27T03:59:01.085509+0000","last_became_active":"2024-08-27T02:31:14.502716+0000","last_became_peered":"2024-08-27T02:31:14.502716+0000","last_unstale":"2024-08-27T03:59:01.085509+0000","last_undegraded":"2024-08-27T03:59:01.085509+0000","last_fullsized":"2024-08-27T03:59:01.085509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-08-27T03:59:01.085321+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-08-27T03:59:01.085321+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.085321+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:20:16.069103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":91,"num_write":225,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'839","reported_seq":2594,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.683482+0000","last_change":"2024-08-27T03:58:44.683311+0000","last_active":"2024-08-27T03:58:44.683482+0000","last_peered":"2024-08-27T03:58:44.683482+0000","last_clean":"2024-08-27T03:58:44.683482+0000","last_became_active":"2024-08-27T02:31:06.471126+0000","last_became_peered":"2024-08-27T02:31:06.471126+0000","last_unstale":"2024-08-27T03:58:44.683482+0000","last_undegraded":"2024-08-27T03:58:44.683482+0000","last_fullsized":"2024-08-27T03:58:44.683482+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:44.683090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.683090+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:40:01.412803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4180,"num_read_kb":3798,"num_write":1090,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'328","reported_seq":1143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.709450+0000","last_change":"2024-08-27T03:58:37.709167+0000","last_active":"2024-08-27T03:58:37.709450+0000","last_peered":"2024-08-27T03:58:37.709450+0000","last_clean":"2024-08-27T03:58:37.709450+0000","last_became_active":"2024-08-27T02:31:04.483616+0000","last_became_peered":"2024-08-27T02:31:04.483616+0000","last_unstale":"2024-08-27T03:58:37.709450+0000","last_undegraded":"2024-08-27T03:58:37.709450+0000","last_fullsized":"2024-08-27T03:58:37.709450+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-08-27T03:58:37.708679+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.708679+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:51:40.565196+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1185741,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":802,"num_read_kb":112858,"num_write":1079,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1376,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.836591+0000","last_change":"2024-08-27T03:58:58.836398+0000","last_active":"2024-08-27T03:58:58.836591+0000","last_peered":"2024-08-27T03:58:58.836591+0000","last_clean":"2024-08-27T03:58:58.836591+0000","last_became_active":"2024-08-27T02:31:08.471457+0000","last_became_peered":"2024-08-27T02:31:08.471457+0000","last_unstale":"2024-08-27T03:58:58.836591+0000","last_undegraded":"2024-08-27T03:58:58.836591+0000","last_fullsized":"2024-08-27T03:58:58.836591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-08-27T03:58:58.836197+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-08-27T03:58:58.836197+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.836197+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:38:25.191657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":845,"num_read_kb":845,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'122","reported_seq":690,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.320351+0000","last_change":"2024-08-27T03:59:04.320351+0000","last_active":"2024-08-27T03:59:04.320351+0000","last_peered":"2024-08-27T03:59:04.320351+0000","last_clean":"2024-08-27T03:59:04.320351+0000","last_became_active":"2024-08-27T02:31:10.636770+0000","last_became_peered":"2024-08-27T02:31:10.636770+0000","last_unstale":"2024-08-27T03:59:04.320351+0000","last_undegraded":"2024-08-27T03:59:04.320351+0000","last_fullsized":"2024-08-27T03:59:04.320351+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-08-27T03:59:04.320135+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-08-27T03:59:04.320135+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.320135+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:13:37.596149+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":90,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'692","reported_seq":3073,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.628587+0000","last_change":"2024-08-27T03:58:55.628230+0000","last_active":"2024-08-27T03:58:55.628587+0000","last_peered":"2024-08-27T03:58:55.628587+0000","last_clean":"2024-08-27T03:58:55.628587+0000","last_became_active":"2024-08-27T02:31:12.489590+0000","last_became_peered":"2024-08-27T02:31:12.489590+0000","last_unstale":"2024-08-27T03:58:55.628587+0000","last_undegraded":"2024-08-27T03:58:55.628587+0000","last_fullsized":"2024-08-27T03:58:55.628587+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'692","last_scrub_stamp":"2024-08-27T03:58:55.627775+0000","last_deep_scrub":"267'692","last_deep_scrub_stamp":"2024-08-27T03:58:55.627775+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.627775+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:12:31.378425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'123","reported_seq":655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.649346+0000","last_change":"2024-08-27T03:59:11.649346+0000","last_active":"2024-08-27T03:59:11.649346+0000","last_peered":"2024-08-27T03:59:11.649346+0000","last_clean":"2024-08-27T03:59:11.649346+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:59:11.649346+0000","last_undegraded":"2024-08-27T03:59:11.649346+0000","last_fullsized":"2024-08-27T03:59:11.649346+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-08-27T03:59:11.649161+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-08-27T03:59:11.649161+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.649161+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:04:40.377878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":106,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'786","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.209300+0000","last_change":"2024-08-27T03:58:45.209172+0000","last_active":"2024-08-27T03:58:45.209300+0000","last_peered":"2024-08-27T03:58:45.209300+0000","last_clean":"2024-08-27T03:58:45.209300+0000","last_became_active":"2024-08-27T02:31:06.459167+0000","last_became_peered":"2024-08-27T02:31:06.459167+0000","last_unstale":"2024-08-27T03:58:45.209300+0000","last_undegraded":"2024-08-27T03:58:45.209300+0000","last_fullsized":"2024-08-27T03:58:45.209300+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'786","last_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_deep_scrub":"267'786","last_deep_scrub_stamp":"2024-08-27T03:58:45.208970+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.208970+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:19.947547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3731,"num_read_kb":3369,"num_write":1017,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'384","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.080025+0000","last_change":"2024-08-27T03:58:39.079881+0000","last_active":"2024-08-27T03:58:39.080025+0000","last_peered":"2024-08-27T03:58:39.080025+0000","last_clean":"2024-08-27T03:58:39.080025+0000","last_became_active":"2024-08-27T02:31:04.475340+0000","last_became_peered":"2024-08-27T02:31:04.475340+0000","last_unstale":"2024-08-27T03:58:39.080025+0000","last_undegraded":"2024-08-27T03:58:39.080025+0000","last_fullsized":"2024-08-27T03:58:39.080025+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-08-27T03:58:39.079659+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.079659+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:55:08.844282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399110,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":741,"num_read_kb":1678,"num_write":1218,"num_write_kb":21982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.671459+0000","last_change":"2024-08-27T03:58:59.671459+0000","last_active":"2024-08-27T03:58:59.671459+0000","last_peered":"2024-08-27T03:58:59.671459+0000","last_clean":"2024-08-27T03:58:59.671459+0000","last_became_active":"2024-08-27T02:31:08.476799+0000","last_became_peered":"2024-08-27T02:31:08.476799+0000","last_unstale":"2024-08-27T03:58:59.671459+0000","last_undegraded":"2024-08-27T03:58:59.671459+0000","last_fullsized":"2024-08-27T03:58:59.671459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.671283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.671283+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.671283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:23.974901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'410","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.806276+0000","last_change":"2024-08-27T03:59:03.806276+0000","last_active":"2024-08-27T03:59:03.806276+0000","last_peered":"2024-08-27T03:59:03.806276+0000","last_clean":"2024-08-27T03:59:03.806276+0000","last_became_active":"2024-08-27T02:31:10.469120+0000","last_became_peered":"2024-08-27T02:31:10.469120+0000","last_unstale":"2024-08-27T03:59:03.806276+0000","last_undegraded":"2024-08-27T03:59:03.806276+0000","last_fullsized":"2024-08-27T03:59:03.806276+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:59:03.806081+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:59:03.806081+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.806081+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:23:15.635294+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46460,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":1211,"num_write":486,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.634370+0000","last_change":"2024-08-27T03:58:54.634237+0000","last_active":"2024-08-27T03:58:54.634370+0000","last_peered":"2024-08-27T03:58:54.634370+0000","last_clean":"2024-08-27T03:58:54.634370+0000","last_became_active":"2024-08-27T02:31:12.497244+0000","last_became_peered":"2024-08-27T02:31:12.497244+0000","last_unstale":"2024-08-27T03:58:54.634370+0000","last_undegraded":"2024-08-27T03:58:54.634370+0000","last_fullsized":"2024-08-27T03:58:54.634370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.634062+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.634062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:29:28.972507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'231","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.167795+0000","last_change":"2024-08-27T03:59:06.167795+0000","last_active":"2024-08-27T03:59:06.167795+0000","last_peered":"2024-08-27T03:59:06.167795+0000","last_clean":"2024-08-27T03:59:06.167795+0000","last_became_active":"2024-08-27T02:31:14.492115+0000","last_became_peered":"2024-08-27T02:31:14.492115+0000","last_unstale":"2024-08-27T03:59:06.167795+0000","last_undegraded":"2024-08-27T03:59:06.167795+0000","last_fullsized":"2024-08-27T03:59:06.167795+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-08-27T03:59:06.167567+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-08-27T03:59:06.167567+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.167567+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:11:12.479825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":222,"num_write":412,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'527","reported_seq":2146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.697377+0000","last_change":"2024-08-27T03:58:45.697240+0000","last_active":"2024-08-27T03:58:45.697377+0000","last_peered":"2024-08-27T03:58:45.697377+0000","last_clean":"2024-08-27T03:58:45.697377+0000","last_became_active":"2024-08-27T02:31:06.466340+0000","last_became_peered":"2024-08-27T02:31:06.466340+0000","last_unstale":"2024-08-27T03:58:45.697377+0000","last_undegraded":"2024-08-27T03:58:45.697377+0000","last_fullsized":"2024-08-27T03:58:45.697377+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'527","last_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_deep_scrub":"267'527","last_deep_scrub_stamp":"2024-08-27T03:58:45.697061+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.697061+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:09:58.090847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2816,"num_read_kb":2617,"num_write":658,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.931420+0000","last_change":"2024-08-27T03:58:39.931282+0000","last_active":"2024-08-27T03:58:39.931420+0000","last_peered":"2024-08-27T03:58:39.931420+0000","last_clean":"2024-08-27T03:58:39.931420+0000","last_became_active":"2024-08-27T02:30:47.726471+0000","last_became_peered":"2024-08-27T02:30:47.726471+0000","last_unstale":"2024-08-27T03:58:39.931420+0000","last_undegraded":"2024-08-27T03:58:39.931420+0000","last_fullsized":"2024-08-27T03:58:39.931420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-08-27T03:58:39.931095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.931095+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:59:05.232163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.617117+0000","last_change":"2024-08-27T03:58:38.617117+0000","last_active":"2024-08-27T03:58:38.617117+0000","last_peered":"2024-08-27T03:58:38.617117+0000","last_clean":"2024-08-27T03:58:38.617117+0000","last_became_active":"2024-08-27T02:30:52.214796+0000","last_became_peered":"2024-08-27T02:30:52.214796+0000","last_unstale":"2024-08-27T03:58:38.617117+0000","last_undegraded":"2024-08-27T03:58:38.617117+0000","last_fullsized":"2024-08-27T03:58:38.617117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:38.616933+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.616933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:18:37.622258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00091887900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'304","reported_seq":1178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.092930+0000","last_change":"2024-08-27T03:58:37.092930+0000","last_active":"2024-08-27T03:58:37.092930+0000","last_peered":"2024-08-27T03:58:37.092930+0000","last_clean":"2024-08-27T03:58:37.092930+0000","last_became_active":"2024-08-27T02:31:04.461003+0000","last_became_peered":"2024-08-27T02:31:04.461003+0000","last_unstale":"2024-08-27T03:58:37.092930+0000","last_undegraded":"2024-08-27T03:58:37.092930+0000","last_fullsized":"2024-08-27T03:58:37.092930+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'304","last_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_deep_scrub":"267'304","last_deep_scrub_stamp":"2024-08-27T03:58:37.092840+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.092840+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:11:02.137368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":118351,"num_write":1022,"num_write_kb":49321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.906076+0000","last_change":"2024-08-27T03:58:53.906076+0000","last_active":"2024-08-27T03:58:53.906076+0000","last_peered":"2024-08-27T03:58:53.906076+0000","last_clean":"2024-08-27T03:58:53.906076+0000","last_became_active":"2024-08-27T02:31:08.458586+0000","last_became_peered":"2024-08-27T02:31:08.458586+0000","last_unstale":"2024-08-27T03:58:53.906076+0000","last_undegraded":"2024-08-27T03:58:53.906076+0000","last_fullsized":"2024-08-27T03:58:53.906076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.905892+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.905892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:27:49.003970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'740","reported_seq":1490,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.822717+0000","last_change":"2024-08-27T03:59:02.822717+0000","last_active":"2024-08-27T03:59:02.822717+0000","last_peered":"2024-08-27T03:59:02.822717+0000","last_clean":"2024-08-27T03:59:02.822717+0000","last_became_active":"2024-08-27T02:31:10.462356+0000","last_became_peered":"2024-08-27T02:31:10.462356+0000","last_unstale":"2024-08-27T03:59:02.822717+0000","last_undegraded":"2024-08-27T03:59:02.822717+0000","last_fullsized":"2024-08-27T03:59:02.822717+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'740","last_scrub_stamp":"2024-08-27T03:59:02.822503+0000","last_deep_scrub":"267'740","last_deep_scrub_stamp":"2024-08-27T03:59:02.822503+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.822503+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:50:40.430031+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136746,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1442,"num_read_kb":3290,"num_write":1350,"num_write_kb":1169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89174,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.503009+0000","last_change":"2024-08-27T03:59:01.503009+0000","last_active":"2024-08-27T03:59:01.503009+0000","last_peered":"2024-08-27T03:59:01.503009+0000","last_clean":"2024-08-27T03:59:01.503009+0000","last_became_active":"2024-08-27T02:31:12.518064+0000","last_became_peered":"2024-08-27T02:31:12.518064+0000","last_unstale":"2024-08-27T03:59:01.503009+0000","last_undegraded":"2024-08-27T03:59:01.503009+0000","last_fullsized":"2024-08-27T03:59:01.503009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.502832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.502832+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.502832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:42:04.484327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'209","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.607407+0000","last_change":"2024-08-27T03:59:00.607407+0000","last_active":"2024-08-27T03:59:00.607407+0000","last_peered":"2024-08-27T03:59:00.607407+0000","last_clean":"2024-08-27T03:59:00.607407+0000","last_became_active":"2024-08-27T02:31:14.511465+0000","last_became_peered":"2024-08-27T02:31:14.511465+0000","last_unstale":"2024-08-27T03:59:00.607407+0000","last_undegraded":"2024-08-27T03:59:00.607407+0000","last_fullsized":"2024-08-27T03:59:00.607407+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'209","last_scrub_stamp":"2024-08-27T03:59:00.607219+0000","last_deep_scrub":"267'209","last_deep_scrub_stamp":"2024-08-27T03:59:00.607219+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.607219+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:29:47.730006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":411,"num_read_kb":409,"num_write":463,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'1519","reported_seq":3083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.414552+0000","last_change":"2024-08-27T03:58:47.414552+0000","last_active":"2024-08-27T03:58:47.414552+0000","last_peered":"2024-08-27T03:58:47.414552+0000","last_clean":"2024-08-27T03:58:47.414552+0000","last_became_active":"2024-08-27T02:31:06.447472+0000","last_became_peered":"2024-08-27T02:31:06.447472+0000","last_unstale":"2024-08-27T03:58:47.414552+0000","last_undegraded":"2024-08-27T03:58:47.414552+0000","last_fullsized":"2024-08-27T03:58:47.414552+0000","mapping_epoch":27,"log_start":"267'1500","ondisk_log_start":"267'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1519","last_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_deep_scrub":"267'1519","last_deep_scrub_stamp":"2024-08-27T03:58:47.414375+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.414375+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":1500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:58:57.554800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6627,"num_read_kb":5800,"num_write":2101,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.858129+0000","last_change":"2024-08-27T03:58:41.857903+0000","last_active":"2024-08-27T03:58:41.858129+0000","last_peered":"2024-08-27T03:58:41.858129+0000","last_clean":"2024-08-27T03:58:41.858129+0000","last_became_active":"2024-08-27T02:30:52.207721+0000","last_became_peered":"2024-08-27T02:30:52.207721+0000","last_unstale":"2024-08-27T03:58:41.858129+0000","last_undegraded":"2024-08-27T03:58:41.858129+0000","last_fullsized":"2024-08-27T03:58:41.858129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:41.857697+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.857697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:28:49.679382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012334729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'389","reported_seq":1157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.456247+0000","last_change":"2024-08-27T03:58:39.456247+0000","last_active":"2024-08-27T03:58:39.456247+0000","last_peered":"2024-08-27T03:58:39.456247+0000","last_clean":"2024-08-27T03:58:39.456247+0000","last_became_active":"2024-08-27T02:31:04.455171+0000","last_became_peered":"2024-08-27T02:31:04.455171+0000","last_unstale":"2024-08-27T03:58:39.456247+0000","last_undegraded":"2024-08-27T03:58:39.456247+0000","last_fullsized":"2024-08-27T03:58:39.456247+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-08-27T03:58:39.455922+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.455922+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:28:43.685014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458876,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":824,"num_read_kb":13511,"num_write":1117,"num_write_kb":18297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"267'6","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.884625+0000","last_change":"2024-08-27T03:58:57.884625+0000","last_active":"2024-08-27T03:58:57.884625+0000","last_peered":"2024-08-27T03:58:57.884625+0000","last_clean":"2024-08-27T03:58:57.884625+0000","last_became_active":"2024-08-27T02:31:08.471463+0000","last_became_peered":"2024-08-27T02:31:08.471463+0000","last_unstale":"2024-08-27T03:58:57.884625+0000","last_undegraded":"2024-08-27T03:58:57.884625+0000","last_fullsized":"2024-08-27T03:58:57.884625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-08-27T03:58:57.884430+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-08-27T03:58:57.884430+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.884430+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:46:28.135856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":1056,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1347","reported_seq":3342,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.104908+0000","last_change":"2024-08-27T03:58:57.104908+0000","last_active":"2024-08-27T03:58:57.104908+0000","last_peered":"2024-08-27T03:58:57.104908+0000","last_clean":"2024-08-27T03:58:57.104908+0000","last_became_active":"2024-08-27T02:31:10.466017+0000","last_became_peered":"2024-08-27T02:31:10.466017+0000","last_unstale":"2024-08-27T03:58:57.104908+0000","last_undegraded":"2024-08-27T03:58:57.104908+0000","last_fullsized":"2024-08-27T03:58:57.104908+0000","mapping_epoch":31,"log_start":"267'1300","ondisk_log_start":"267'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1347","last_scrub_stamp":"2024-08-27T03:58:57.104692+0000","last_deep_scrub":"267'1347","last_deep_scrub_stamp":"2024-08-27T03:58:57.104692+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.104692+0000","objects_scrubbed":12,"log_size":47,"log_dups_size":1300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:35:19.289204+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137506,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2076,"num_read_kb":3979,"num_write":1262,"num_write_kb":1030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:03.893194+0000","last_change":"2024-08-27T03:59:03.893040+0000","last_active":"2024-08-27T03:59:03.893194+0000","last_peered":"2024-08-27T03:59:03.893194+0000","last_clean":"2024-08-27T03:59:03.893194+0000","last_became_active":"2024-08-27T02:31:12.508093+0000","last_became_peered":"2024-08-27T02:31:12.508093+0000","last_unstale":"2024-08-27T03:59:03.893194+0000","last_undegraded":"2024-08-27T03:59:03.893194+0000","last_fullsized":"2024-08-27T03:59:03.893194+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:03.892863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:03.892863+0000","last_clean_scrub_stamp":"2024-08-27T03:59:03.892863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:18:19.756166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'166","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.094133+0000","last_change":"2024-08-27T03:59:02.094133+0000","last_active":"2024-08-27T03:59:02.094133+0000","last_peered":"2024-08-27T03:59:02.094133+0000","last_clean":"2024-08-27T03:59:02.094133+0000","last_became_active":"2024-08-27T02:31:15.022465+0000","last_became_peered":"2024-08-27T02:31:15.022465+0000","last_unstale":"2024-08-27T03:59:02.094133+0000","last_undegraded":"2024-08-27T03:59:02.094133+0000","last_fullsized":"2024-08-27T03:59:02.094133+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:02.093895+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:02.093895+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.093895+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:38:46.246473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":279,"num_read_kb":269,"num_write":369,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'471","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.587280+0000","last_change":"2024-08-27T03:58:43.587280+0000","last_active":"2024-08-27T03:58:43.587280+0000","last_peered":"2024-08-27T03:58:43.587280+0000","last_clean":"2024-08-27T03:58:43.587280+0000","last_became_active":"2024-08-27T02:31:39.754394+0000","last_became_peered":"2024-08-27T02:31:39.754394+0000","last_unstale":"2024-08-27T03:58:43.587280+0000","last_undegraded":"2024-08-27T03:58:43.587280+0000","last_fullsized":"2024-08-27T03:58:43.587280+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-08-27T03:58:43.587095+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.587095+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:41:03.769401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2470,"num_write":611,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.604535+0000","last_change":"2024-08-27T03:58:36.604535+0000","last_active":"2024-08-27T03:58:36.604535+0000","last_peered":"2024-08-27T03:58:36.604535+0000","last_clean":"2024-08-27T03:58:36.604535+0000","last_became_active":"2024-08-27T02:30:52.477389+0000","last_became_peered":"2024-08-27T02:30:52.477389+0000","last_unstale":"2024-08-27T03:58:36.604535+0000","last_undegraded":"2024-08-27T03:58:36.604535+0000","last_fullsized":"2024-08-27T03:58:36.604535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.604457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.604457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:03:12.862350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089495299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'400","reported_seq":1115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.071580+0000","last_change":"2024-08-27T03:58:38.071524+0000","last_active":"2024-08-27T03:58:38.071580+0000","last_peered":"2024-08-27T03:58:38.071580+0000","last_clean":"2024-08-27T03:58:38.071580+0000","last_became_active":"2024-08-27T02:31:04.460552+0000","last_became_peered":"2024-08-27T02:31:04.460552+0000","last_unstale":"2024-08-27T03:58:38.071580+0000","last_undegraded":"2024-08-27T03:58:38.071580+0000","last_fullsized":"2024-08-27T03:58:38.071580+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-08-27T03:58:38.071425+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.071425+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:30:14.243648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":29601,"num_write":1270,"num_write_kb":45756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.460375+0000","last_change":"2024-08-27T03:58:49.460375+0000","last_active":"2024-08-27T03:58:49.460375+0000","last_peered":"2024-08-27T03:58:49.460375+0000","last_clean":"2024-08-27T03:58:49.460375+0000","last_became_active":"2024-08-27T02:31:08.478783+0000","last_became_peered":"2024-08-27T02:31:08.478783+0000","last_unstale":"2024-08-27T03:58:49.460375+0000","last_undegraded":"2024-08-27T03:58:49.460375+0000","last_fullsized":"2024-08-27T03:58:49.460375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:49.460156+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.460156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:20:20.731797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'336","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.948545+0000","last_change":"2024-08-27T03:58:59.948262+0000","last_active":"2024-08-27T03:58:59.948545+0000","last_peered":"2024-08-27T03:58:59.948545+0000","last_clean":"2024-08-27T03:58:59.948545+0000","last_became_active":"2024-08-27T02:31:10.636659+0000","last_became_peered":"2024-08-27T02:31:10.636659+0000","last_unstale":"2024-08-27T03:58:59.948545+0000","last_undegraded":"2024-08-27T03:58:59.948545+0000","last_fullsized":"2024-08-27T03:58:59.948545+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-08-27T03:58:59.947989+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-08-27T03:58:59.947989+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.947989+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:34:29.854493+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":281,"num_write":273,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.465714+0000","last_change":"2024-08-27T03:59:04.465714+0000","last_active":"2024-08-27T03:59:04.465714+0000","last_peered":"2024-08-27T03:59:04.465714+0000","last_clean":"2024-08-27T03:59:04.465714+0000","last_became_active":"2024-08-27T02:31:12.517549+0000","last_became_peered":"2024-08-27T02:31:12.517549+0000","last_unstale":"2024-08-27T03:59:04.465714+0000","last_undegraded":"2024-08-27T03:59:04.465714+0000","last_fullsized":"2024-08-27T03:59:04.465714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:04.465518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:04.465518+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.465518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:02:49.559949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'261","reported_seq":885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:16.435803+0000","last_change":"2024-08-27T03:59:16.435803+0000","last_active":"2024-08-27T03:59:16.435803+0000","last_peered":"2024-08-27T03:59:16.435803+0000","last_clean":"2024-08-27T03:59:16.435803+0000","last_became_active":"2024-08-27T02:31:14.513628+0000","last_became_peered":"2024-08-27T02:31:14.513628+0000","last_unstale":"2024-08-27T03:59:16.435803+0000","last_undegraded":"2024-08-27T03:59:16.435803+0000","last_fullsized":"2024-08-27T03:59:16.435803+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'261","last_scrub_stamp":"2024-08-27T03:59:16.435591+0000","last_deep_scrub":"267'261","last_deep_scrub_stamp":"2024-08-27T03:59:16.435591+0000","last_clean_scrub_stamp":"2024-08-27T03:59:16.435591+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:34.411555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":510,"num_write":569,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'454","reported_seq":2051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.177188+0000","last_change":"2024-08-27T03:58:46.177188+0000","last_active":"2024-08-27T03:58:46.177188+0000","last_peered":"2024-08-27T03:58:46.177188+0000","last_clean":"2024-08-27T03:58:46.177188+0000","last_became_active":"2024-08-27T02:31:06.452892+0000","last_became_peered":"2024-08-27T02:31:06.452892+0000","last_unstale":"2024-08-27T03:58:46.177188+0000","last_undegraded":"2024-08-27T03:58:46.177188+0000","last_fullsized":"2024-08-27T03:58:46.177188+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:46.177002+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.177002+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:00:50.953987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2295,"num_read_kb":2183,"num_write":513,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.658282+0000","last_change":"2024-08-27T03:58:37.658282+0000","last_active":"2024-08-27T03:58:37.658282+0000","last_peered":"2024-08-27T03:58:37.658282+0000","last_clean":"2024-08-27T03:58:37.658282+0000","last_became_active":"2024-08-27T02:30:52.212903+0000","last_became_peered":"2024-08-27T02:30:52.212903+0000","last_unstale":"2024-08-27T03:58:37.658282+0000","last_undegraded":"2024-08-27T03:58:37.658282+0000","last_fullsized":"2024-08-27T03:58:37.658282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-08-27T03:58:37.658091+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.658091+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:22.087261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.003018733,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'346","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.730918+0000","last_change":"2024-08-27T03:58:38.730918+0000","last_active":"2024-08-27T03:58:38.730918+0000","last_peered":"2024-08-27T03:58:38.730918+0000","last_clean":"2024-08-27T03:58:38.730918+0000","last_became_active":"2024-08-27T02:31:04.445902+0000","last_became_peered":"2024-08-27T02:31:04.445902+0000","last_unstale":"2024-08-27T03:58:38.730918+0000","last_undegraded":"2024-08-27T03:58:38.730918+0000","last_fullsized":"2024-08-27T03:58:38.730918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:38.730550+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.730550+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:48:41.072429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1573788,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":426,"num_read_kb":9573,"num_write":1083,"num_write_kb":53565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.464923+0000","last_change":"2024-08-27T03:58:51.464782+0000","last_active":"2024-08-27T03:58:51.464923+0000","last_peered":"2024-08-27T03:58:51.464923+0000","last_clean":"2024-08-27T03:58:51.464923+0000","last_became_active":"2024-08-27T02:31:08.469270+0000","last_became_peered":"2024-08-27T02:31:08.469270+0000","last_unstale":"2024-08-27T03:58:51.464923+0000","last_undegraded":"2024-08-27T03:58:51.464923+0000","last_fullsized":"2024-08-27T03:58:51.464923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.464600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.464600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:07.725251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'179","reported_seq":773,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.322303+0000","last_change":"2024-08-27T03:59:02.322303+0000","last_active":"2024-08-27T03:59:02.322303+0000","last_peered":"2024-08-27T03:59:02.322303+0000","last_clean":"2024-08-27T03:59:02.322303+0000","last_became_active":"2024-08-27T02:31:10.466684+0000","last_became_peered":"2024-08-27T02:31:10.466684+0000","last_unstale":"2024-08-27T03:59:02.322303+0000","last_undegraded":"2024-08-27T03:59:02.322303+0000","last_fullsized":"2024-08-27T03:59:02.322303+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'179","last_scrub_stamp":"2024-08-27T03:59:02.322101+0000","last_deep_scrub":"267'179","last_deep_scrub_stamp":"2024-08-27T03:59:02.322101+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.322101+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:39:59.680636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":217,"num_read_kb":211,"num_write":158,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.675155+0000","last_change":"2024-08-27T03:58:53.675155+0000","last_active":"2024-08-27T03:58:53.675155+0000","last_peered":"2024-08-27T03:58:53.675155+0000","last_clean":"2024-08-27T03:58:53.675155+0000","last_became_active":"2024-08-27T02:31:12.522569+0000","last_became_peered":"2024-08-27T02:31:12.522569+0000","last_unstale":"2024-08-27T03:58:53.675155+0000","last_undegraded":"2024-08-27T03:58:53.675155+0000","last_fullsized":"2024-08-27T03:58:53.675155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:53.674951+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.674951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:00:48.890985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'131","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.809753+0000","last_change":"2024-08-27T03:59:08.809753+0000","last_active":"2024-08-27T03:59:08.809753+0000","last_peered":"2024-08-27T03:59:08.809753+0000","last_clean":"2024-08-27T03:59:08.809753+0000","last_became_active":"2024-08-27T02:31:14.501788+0000","last_became_peered":"2024-08-27T02:31:14.501788+0000","last_unstale":"2024-08-27T03:59:08.809753+0000","last_undegraded":"2024-08-27T03:59:08.809753+0000","last_fullsized":"2024-08-27T03:59:08.809753+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-08-27T03:59:08.809576+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-08-27T03:59:08.809576+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.809576+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:59:08.997058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":203,"num_write":338,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'1265","reported_seq":2845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.167609+0000","last_change":"2024-08-27T03:58:44.167609+0000","last_active":"2024-08-27T03:58:44.167609+0000","last_peered":"2024-08-27T03:58:44.167609+0000","last_clean":"2024-08-27T03:58:44.167609+0000","last_became_active":"2024-08-27T02:31:06.435764+0000","last_became_peered":"2024-08-27T02:31:06.435764+0000","last_unstale":"2024-08-27T03:58:44.167609+0000","last_undegraded":"2024-08-27T03:58:44.167609+0000","last_fullsized":"2024-08-27T03:58:44.167609+0000","mapping_epoch":27,"log_start":"267'1200","ondisk_log_start":"267'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1265","last_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_deep_scrub":"267'1265","last_deep_scrub_stamp":"2024-08-27T03:58:44.167407+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.167407+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:51:52.232154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5656,"num_read_kb":4946,"num_write":1743,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'345","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.629995+0000","last_change":"2024-08-27T03:58:39.629743+0000","last_active":"2024-08-27T03:58:39.629995+0000","last_peered":"2024-08-27T03:58:39.629995+0000","last_clean":"2024-08-27T03:58:39.629995+0000","last_became_active":"2024-08-27T02:31:04.447492+0000","last_became_peered":"2024-08-27T02:31:04.447492+0000","last_unstale":"2024-08-27T03:58:39.629995+0000","last_undegraded":"2024-08-27T03:58:39.629995+0000","last_fullsized":"2024-08-27T03:58:39.629995+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-08-27T03:58:39.629340+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.629340+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:56:32.213907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":946,"num_write":1113,"num_write_kb":23630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.053529+0000","last_change":"2024-08-27T03:58:37.053529+0000","last_active":"2024-08-27T03:58:37.053529+0000","last_peered":"2024-08-27T03:58:37.053529+0000","last_clean":"2024-08-27T03:58:37.053529+0000","last_became_active":"2024-08-27T02:30:52.745897+0000","last_became_peered":"2024-08-27T02:30:52.745897+0000","last_unstale":"2024-08-27T03:58:37.053529+0000","last_undegraded":"2024-08-27T03:58:37.053529+0000","last_fullsized":"2024-08-27T03:58:37.053529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:37.053430+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.053430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:08:25.862689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012203559999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.564981+0000","last_change":"2024-08-27T03:58:56.564981+0000","last_active":"2024-08-27T03:58:56.564981+0000","last_peered":"2024-08-27T03:58:56.564981+0000","last_clean":"2024-08-27T03:58:56.564981+0000","last_became_active":"2024-08-27T02:31:08.468398+0000","last_became_peered":"2024-08-27T02:31:08.468398+0000","last_unstale":"2024-08-27T03:58:56.564981+0000","last_undegraded":"2024-08-27T03:58:56.564981+0000","last_fullsized":"2024-08-27T03:58:56.564981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.564773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.564773+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.564773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:21:00.629402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'673","reported_seq":1406,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.555278+0000","last_change":"2024-08-27T03:58:57.555135+0000","last_active":"2024-08-27T03:58:57.555278+0000","last_peered":"2024-08-27T03:58:57.555278+0000","last_clean":"2024-08-27T03:58:57.555278+0000","last_became_active":"2024-08-27T02:31:10.464555+0000","last_became_peered":"2024-08-27T02:31:10.464555+0000","last_unstale":"2024-08-27T03:58:57.555278+0000","last_undegraded":"2024-08-27T03:58:57.555278+0000","last_fullsized":"2024-08-27T03:58:57.555278+0000","mapping_epoch":31,"log_start":"267'600","ondisk_log_start":"267'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'673","last_scrub_stamp":"2024-08-27T03:58:57.554887+0000","last_deep_scrub":"267'673","last_deep_scrub_stamp":"2024-08-27T03:58:57.554887+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.554887+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:24:06.050565+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1780,"num_read_kb":2961,"num_write":2352,"num_write_kb":2124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506974,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.635550+0000","last_change":"2024-08-27T03:59:06.635550+0000","last_active":"2024-08-27T03:59:06.635550+0000","last_peered":"2024-08-27T03:59:06.635550+0000","last_clean":"2024-08-27T03:59:06.635550+0000","last_became_active":"2024-08-27T02:31:12.499520+0000","last_became_peered":"2024-08-27T02:31:12.499520+0000","last_unstale":"2024-08-27T03:59:06.635550+0000","last_undegraded":"2024-08-27T03:59:06.635550+0000","last_fullsized":"2024-08-27T03:59:06.635550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:06.635361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:06.635361+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.635361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:26:52.842862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'150","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.551862+0000","last_change":"2024-08-27T03:59:11.551862+0000","last_active":"2024-08-27T03:59:11.551862+0000","last_peered":"2024-08-27T03:59:11.551862+0000","last_clean":"2024-08-27T03:59:11.551862+0000","last_became_active":"2024-08-27T02:31:15.025706+0000","last_became_peered":"2024-08-27T02:31:15.025706+0000","last_unstale":"2024-08-27T03:59:11.551862+0000","last_undegraded":"2024-08-27T03:59:11.551862+0000","last_fullsized":"2024-08-27T03:59:11.551862+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'150","last_scrub_stamp":"2024-08-27T03:59:11.551659+0000","last_deep_scrub":"267'150","last_deep_scrub_stamp":"2024-08-27T03:59:11.551659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.551659+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:34:36.621710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'762","reported_seq":2257,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.341748+0000","last_change":"2024-08-27T03:58:44.341748+0000","last_active":"2024-08-27T03:58:44.341748+0000","last_peered":"2024-08-27T03:58:44.341748+0000","last_clean":"2024-08-27T03:58:44.341748+0000","last_became_active":"2024-08-27T02:31:06.443153+0000","last_became_peered":"2024-08-27T02:31:06.443153+0000","last_unstale":"2024-08-27T03:58:44.341748+0000","last_undegraded":"2024-08-27T03:58:44.341748+0000","last_fullsized":"2024-08-27T03:58:44.341748+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-08-27T03:58:44.341567+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.341567+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:18:33.526418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3564,"num_read_kb":3212,"num_write":997,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'372","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.092398+0000","last_change":"2024-08-27T03:58:39.092398+0000","last_active":"2024-08-27T03:58:39.092398+0000","last_peered":"2024-08-27T03:58:39.092398+0000","last_clean":"2024-08-27T03:58:39.092398+0000","last_became_active":"2024-08-27T02:31:04.460174+0000","last_became_peered":"2024-08-27T02:31:04.460174+0000","last_unstale":"2024-08-27T03:58:39.092398+0000","last_undegraded":"2024-08-27T03:58:39.092398+0000","last_fullsized":"2024-08-27T03:58:39.092398+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-08-27T03:58:39.092090+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.092090+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:46:48.988935+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254745,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":622,"num_read_kb":96022,"num_write":1186,"num_write_kb":35670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.886716+0000","last_change":"2024-08-27T03:58:38.886592+0000","last_active":"2024-08-27T03:58:38.886716+0000","last_peered":"2024-08-27T03:58:38.886716+0000","last_clean":"2024-08-27T03:58:38.886716+0000","last_became_active":"2024-08-27T02:30:52.746131+0000","last_became_peered":"2024-08-27T02:30:52.746131+0000","last_unstale":"2024-08-27T03:58:38.886716+0000","last_undegraded":"2024-08-27T03:58:38.886716+0000","last_fullsized":"2024-08-27T03:58:38.886716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.886440+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.886440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:01:43.605161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012076140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.688066+0000","last_change":"2024-08-27T03:58:49.688066+0000","last_active":"2024-08-27T03:58:49.688066+0000","last_peered":"2024-08-27T03:58:49.688066+0000","last_clean":"2024-08-27T03:58:49.688066+0000","last_became_active":"2024-08-27T02:31:08.465130+0000","last_became_peered":"2024-08-27T02:31:08.465130+0000","last_unstale":"2024-08-27T03:58:49.688066+0000","last_undegraded":"2024-08-27T03:58:49.688066+0000","last_fullsized":"2024-08-27T03:58:49.688066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:49.687882+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.687882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:24:23.995310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'221","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.046535+0000","last_change":"2024-08-27T03:58:55.046535+0000","last_active":"2024-08-27T03:58:55.046535+0000","last_peered":"2024-08-27T03:58:55.046535+0000","last_clean":"2024-08-27T03:58:55.046535+0000","last_became_active":"2024-08-27T02:31:10.635109+0000","last_became_peered":"2024-08-27T02:31:10.635109+0000","last_unstale":"2024-08-27T03:58:55.046535+0000","last_undegraded":"2024-08-27T03:58:55.046535+0000","last_fullsized":"2024-08-27T03:58:55.046535+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'221","last_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_deep_scrub":"267'221","last_deep_scrub_stamp":"2024-08-27T03:58:55.046291+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.046291+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:50:24.558926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":280,"num_write":192,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'721","reported_seq":2969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.784586+0000","last_change":"2024-08-27T03:59:05.784407+0000","last_active":"2024-08-27T03:59:05.784586+0000","last_peered":"2024-08-27T03:59:05.784586+0000","last_clean":"2024-08-27T03:59:05.784586+0000","last_became_active":"2024-08-27T02:31:12.506193+0000","last_became_peered":"2024-08-27T02:31:12.506193+0000","last_unstale":"2024-08-27T03:59:05.784586+0000","last_undegraded":"2024-08-27T03:59:05.784586+0000","last_fullsized":"2024-08-27T03:59:05.784586+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'721","last_scrub_stamp":"2024-08-27T03:59:05.784225+0000","last_deep_scrub":"267'721","last_deep_scrub_stamp":"2024-08-27T03:59:05.784225+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.784225+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:19:08.880831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'141","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:15.462466+0000","last_change":"2024-08-27T03:59:15.462199+0000","last_active":"2024-08-27T03:59:15.462466+0000","last_peered":"2024-08-27T03:59:15.462466+0000","last_clean":"2024-08-27T03:59:15.462466+0000","last_became_active":"2024-08-27T02:31:15.022313+0000","last_became_peered":"2024-08-27T02:31:15.022313+0000","last_unstale":"2024-08-27T03:59:15.462466+0000","last_undegraded":"2024-08-27T03:59:15.462466+0000","last_fullsized":"2024-08-27T03:59:15.462466+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-08-27T03:59:15.461965+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-08-27T03:59:15.461965+0000","last_clean_scrub_stamp":"2024-08-27T03:59:15.461965+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:58.666628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":170,"num_write":338,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'410","reported_seq":1945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.125639+0000","last_change":"2024-08-27T03:58:48.125477+0000","last_active":"2024-08-27T03:58:48.125639+0000","last_peered":"2024-08-27T03:58:48.125639+0000","last_clean":"2024-08-27T03:58:48.125639+0000","last_became_active":"2024-08-27T02:31:06.458783+0000","last_became_peered":"2024-08-27T02:31:06.458783+0000","last_unstale":"2024-08-27T03:58:48.125639+0000","last_undegraded":"2024-08-27T03:58:48.125639+0000","last_fullsized":"2024-08-27T03:58:48.125639+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'410","last_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_deep_scrub":"267'410","last_deep_scrub_stamp":"2024-08-27T03:58:48.125306+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.125306+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:32:51.563488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2136,"num_read_kb":2039,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'331","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.056498+0000","last_change":"2024-08-27T03:58:38.056444+0000","last_active":"2024-08-27T03:58:38.056498+0000","last_peered":"2024-08-27T03:58:38.056498+0000","last_clean":"2024-08-27T03:58:38.056498+0000","last_became_active":"2024-08-27T02:31:04.476787+0000","last_became_peered":"2024-08-27T02:31:04.476787+0000","last_unstale":"2024-08-27T03:58:38.056498+0000","last_undegraded":"2024-08-27T03:58:38.056498+0000","last_fullsized":"2024-08-27T03:58:38.056498+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:38.056349+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.056349+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:34:53.352346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":4604,"num_write":1019,"num_write_kb":24060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.038778+0000","last_change":"2024-08-27T03:58:36.038731+0000","last_active":"2024-08-27T03:58:36.038778+0000","last_peered":"2024-08-27T03:58:36.038778+0000","last_clean":"2024-08-27T03:58:36.038778+0000","last_became_active":"2024-08-27T02:30:52.215649+0000","last_became_peered":"2024-08-27T02:30:52.215649+0000","last_unstale":"2024-08-27T03:58:36.038778+0000","last_undegraded":"2024-08-27T03:58:36.038778+0000","last_fullsized":"2024-08-27T03:58:36.038778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:36.038657+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.038657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:07:04.224982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.715676+0000","last_change":"2024-08-27T03:58:58.715676+0000","last_active":"2024-08-27T03:58:58.715676+0000","last_peered":"2024-08-27T03:58:58.715676+0000","last_clean":"2024-08-27T03:58:58.715676+0000","last_became_active":"2024-08-27T02:31:08.458125+0000","last_became_peered":"2024-08-27T02:31:08.458125+0000","last_unstale":"2024-08-27T03:58:58.715676+0000","last_undegraded":"2024-08-27T03:58:58.715676+0000","last_fullsized":"2024-08-27T03:58:58.715676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.715406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.715406+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.715406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:00:01.173207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'166","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.716206+0000","last_change":"2024-08-27T03:59:02.716206+0000","last_active":"2024-08-27T03:59:02.716206+0000","last_peered":"2024-08-27T03:59:02.716206+0000","last_clean":"2024-08-27T03:59:02.716206+0000","last_became_active":"2024-08-27T02:31:10.460326+0000","last_became_peered":"2024-08-27T02:31:10.460326+0000","last_unstale":"2024-08-27T03:59:02.716206+0000","last_undegraded":"2024-08-27T03:59:02.716206+0000","last_fullsized":"2024-08-27T03:59:02.716206+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:02.716019+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:02.716019+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.716019+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:11:32.329036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":192,"num_read_kb":186,"num_write":130,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'733","reported_seq":4725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.436967+0000","last_change":"2024-08-27T03:59:10.436967+0000","last_active":"2024-08-27T03:59:10.436967+0000","last_peered":"2024-08-27T03:59:10.436967+0000","last_clean":"2024-08-27T03:59:10.436967+0000","last_became_active":"2024-08-27T02:31:12.505366+0000","last_became_peered":"2024-08-27T02:31:12.505366+0000","last_unstale":"2024-08-27T03:59:10.436967+0000","last_undegraded":"2024-08-27T03:59:10.436967+0000","last_fullsized":"2024-08-27T03:59:10.436967+0000","mapping_epoch":33,"log_start":"267'700","ondisk_log_start":"267'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'733","last_scrub_stamp":"2024-08-27T03:59:10.436785+0000","last_deep_scrub":"267'733","last_deep_scrub_stamp":"2024-08-27T03:59:10.436785+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.436785+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:25:23.754801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'212","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.527373+0000","last_change":"2024-08-27T03:59:08.527373+0000","last_active":"2024-08-27T03:59:08.527373+0000","last_peered":"2024-08-27T03:59:08.527373+0000","last_clean":"2024-08-27T03:59:08.527373+0000","last_became_active":"2024-08-27T02:31:14.510443+0000","last_became_peered":"2024-08-27T02:31:14.510443+0000","last_unstale":"2024-08-27T03:59:08.527373+0000","last_undegraded":"2024-08-27T03:59:08.527373+0000","last_fullsized":"2024-08-27T03:59:08.527373+0000","mapping_epoch":35,"log_start":"267'200","ondisk_log_start":"267'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-08-27T03:59:08.527059+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-08-27T03:59:08.527059+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.527059+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:05:08.280061+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":143,"num_write":476,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'398","reported_seq":1961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.667019+0000","last_change":"2024-08-27T03:58:42.667019+0000","last_active":"2024-08-27T03:58:42.667019+0000","last_peered":"2024-08-27T03:58:42.667019+0000","last_clean":"2024-08-27T03:58:42.667019+0000","last_became_active":"2024-08-27T02:31:06.438925+0000","last_became_peered":"2024-08-27T02:31:06.438925+0000","last_unstale":"2024-08-27T03:58:42.667019+0000","last_undegraded":"2024-08-27T03:58:42.667019+0000","last_fullsized":"2024-08-27T03:58:42.667019+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-08-27T03:58:42.666809+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.666809+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:29:34.834037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2185,"num_read_kb":2087,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'349","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:35.413642+0000","last_change":"2024-08-27T03:58:35.413562+0000","last_active":"2024-08-27T03:58:35.413642+0000","last_peered":"2024-08-27T03:58:35.413642+0000","last_clean":"2024-08-27T03:58:35.413642+0000","last_became_active":"2024-08-27T02:31:04.492118+0000","last_became_peered":"2024-08-27T02:31:04.492118+0000","last_unstale":"2024-08-27T03:58:35.413642+0000","last_undegraded":"2024-08-27T03:58:35.413642+0000","last_fullsized":"2024-08-27T03:58:35.413642+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:35.413408+0000","last_clean_scrub_stamp":"2024-08-27T03:58:35.413408+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:28:38.132282+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2044381,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":35253,"num_write":1103,"num_write_kb":38132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.750039+0000","last_change":"2024-08-27T03:58:38.749803+0000","last_active":"2024-08-27T03:58:38.750039+0000","last_peered":"2024-08-27T03:58:38.750039+0000","last_clean":"2024-08-27T03:58:38.750039+0000","last_became_active":"2024-08-27T02:30:52.216430+0000","last_became_peered":"2024-08-27T02:30:52.216430+0000","last_unstale":"2024-08-27T03:58:38.750039+0000","last_undegraded":"2024-08-27T03:58:38.750039+0000","last_fullsized":"2024-08-27T03:58:38.750039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:38.749605+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.749605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:52:37.408314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077867400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.327411+0000","last_change":"2024-08-27T03:58:57.327279+0000","last_active":"2024-08-27T03:58:57.327411+0000","last_peered":"2024-08-27T03:58:57.327411+0000","last_clean":"2024-08-27T03:58:57.327411+0000","last_became_active":"2024-08-27T02:31:08.469815+0000","last_became_peered":"2024-08-27T02:31:08.469815+0000","last_unstale":"2024-08-27T03:58:57.327411+0000","last_undegraded":"2024-08-27T03:58:57.327411+0000","last_fullsized":"2024-08-27T03:58:57.327411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.327076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.327076+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.327076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:23:48.404239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'803","reported_seq":1568,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.955750+0000","last_change":"2024-08-27T03:58:58.955750+0000","last_active":"2024-08-27T03:58:58.955750+0000","last_peered":"2024-08-27T03:58:58.955750+0000","last_clean":"2024-08-27T03:58:58.955750+0000","last_became_active":"2024-08-27T02:31:10.634337+0000","last_became_peered":"2024-08-27T02:31:10.634337+0000","last_unstale":"2024-08-27T03:58:58.955750+0000","last_undegraded":"2024-08-27T03:58:58.955750+0000","last_fullsized":"2024-08-27T03:58:58.955750+0000","mapping_epoch":31,"log_start":"267'700","ondisk_log_start":"267'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'803","last_scrub_stamp":"2024-08-27T03:58:58.955545+0000","last_deep_scrub":"267'803","last_deep_scrub_stamp":"2024-08-27T03:58:58.955545+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.955545+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:28:17.120438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135678,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1416,"num_read_kb":3420,"num_write":1150,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.400087+0000","last_change":"2024-08-27T03:59:09.400087+0000","last_active":"2024-08-27T03:59:09.400087+0000","last_peered":"2024-08-27T03:59:09.400087+0000","last_clean":"2024-08-27T03:59:09.400087+0000","last_became_active":"2024-08-27T02:31:12.503989+0000","last_became_peered":"2024-08-27T02:31:12.503989+0000","last_unstale":"2024-08-27T03:59:09.400087+0000","last_undegraded":"2024-08-27T03:59:09.400087+0000","last_fullsized":"2024-08-27T03:59:09.400087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.399810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.399810+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.399810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T03:59:49.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'121","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.848896+0000","last_change":"2024-08-27T03:59:09.848896+0000","last_active":"2024-08-27T03:59:09.848896+0000","last_peered":"2024-08-27T03:59:09.848896+0000","last_clean":"2024-08-27T03:59:09.848896+0000","last_became_active":"2024-08-27T02:31:14.521812+0000","last_became_peered":"2024-08-27T02:31:14.521812+0000","last_unstale":"2024-08-27T03:59:09.848896+0000","last_undegraded":"2024-08-27T03:59:09.848896+0000","last_fullsized":"2024-08-27T03:59:09.848896+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'121","last_scrub_stamp":"2024-08-27T03:59:09.848709+0000","last_deep_scrub":"267'121","last_deep_scrub_stamp":"2024-08-27T03:59:09.848709+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.848709+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:32:24.307293+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'166","reported_seq":759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:14.623165+0000","last_change":"2024-08-27T03:59:14.623165+0000","last_active":"2024-08-27T03:59:14.623165+0000","last_peered":"2024-08-27T03:59:14.623165+0000","last_clean":"2024-08-27T03:59:14.623165+0000","last_became_active":"2024-08-27T02:31:14.510560+0000","last_became_peered":"2024-08-27T02:31:14.510560+0000","last_unstale":"2024-08-27T03:59:14.623165+0000","last_undegraded":"2024-08-27T03:59:14.623165+0000","last_fullsized":"2024-08-27T03:59:14.623165+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-08-27T03:59:14.622958+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-08-27T03:59:14.622958+0000","last_clean_scrub_stamp":"2024-08-27T03:59:14.622958+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:35:16.828219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":832,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":262,"num_read_kb":251,"num_write":387,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'938","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.710327+0000","last_change":"2024-08-27T03:58:48.710186+0000","last_active":"2024-08-27T03:58:48.710327+0000","last_peered":"2024-08-27T03:58:48.710327+0000","last_clean":"2024-08-27T03:58:48.710327+0000","last_became_active":"2024-08-27T02:31:06.456838+0000","last_became_peered":"2024-08-27T02:31:06.456838+0000","last_unstale":"2024-08-27T03:58:48.710327+0000","last_undegraded":"2024-08-27T03:58:48.710327+0000","last_fullsized":"2024-08-27T03:58:48.710327+0000","mapping_epoch":27,"log_start":"267'900","ondisk_log_start":"267'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'938","last_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_deep_scrub":"267'938","last_deep_scrub_stamp":"2024-08-27T03:58:48.709995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.709995+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":900,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:13:44.597316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4504,"num_read_kb":3987,"num_write":1305,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":688,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'378","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.720844+0000","last_change":"2024-08-27T03:58:40.720844+0000","last_active":"2024-08-27T03:58:40.720844+0000","last_peered":"2024-08-27T03:58:40.720844+0000","last_clean":"2024-08-27T03:58:40.720844+0000","last_became_active":"2024-08-27T02:31:04.461027+0000","last_became_peered":"2024-08-27T02:31:04.461027+0000","last_unstale":"2024-08-27T03:58:40.720844+0000","last_undegraded":"2024-08-27T03:58:40.720844+0000","last_fullsized":"2024-08-27T03:58:40.720844+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'378","last_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_deep_scrub":"267'378","last_deep_scrub_stamp":"2024-08-27T03:58:40.720612+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.720612+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:10:35.862070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263226,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":611,"num_read_kb":507,"num_write":1144,"num_write_kb":36542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.031176+0000","last_change":"2024-08-27T03:58:51.031052+0000","last_active":"2024-08-27T03:58:51.031176+0000","last_peered":"2024-08-27T03:58:51.031176+0000","last_clean":"2024-08-27T03:58:51.031176+0000","last_became_active":"2024-08-27T02:31:08.467949+0000","last_became_peered":"2024-08-27T02:31:08.467949+0000","last_unstale":"2024-08-27T03:58:51.031176+0000","last_undegraded":"2024-08-27T03:58:51.031176+0000","last_fullsized":"2024-08-27T03:58:51.031176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.030870+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.030870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:16.544510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'286","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.320576+0000","last_change":"2024-08-27T03:59:05.320437+0000","last_active":"2024-08-27T03:59:05.320576+0000","last_peered":"2024-08-27T03:59:05.320576+0000","last_clean":"2024-08-27T03:59:05.320576+0000","last_became_active":"2024-08-27T02:31:10.462649+0000","last_became_peered":"2024-08-27T02:31:10.462649+0000","last_unstale":"2024-08-27T03:59:05.320576+0000","last_undegraded":"2024-08-27T03:59:05.320576+0000","last_fullsized":"2024-08-27T03:59:05.320576+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'286","last_scrub_stamp":"2024-08-27T03:59:05.320190+0000","last_deep_scrub":"267'286","last_deep_scrub_stamp":"2024-08-27T03:59:05.320190+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.320190+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:35:50.176774+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":955,"num_write":350,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.459782+0000","last_change":"2024-08-27T03:59:12.459614+0000","last_active":"2024-08-27T03:59:12.459782+0000","last_peered":"2024-08-27T03:59:12.459782+0000","last_clean":"2024-08-27T03:59:12.459782+0000","last_became_active":"2024-08-27T02:31:12.504476+0000","last_became_peered":"2024-08-27T02:31:12.504476+0000","last_unstale":"2024-08-27T03:59:12.459782+0000","last_undegraded":"2024-08-27T03:59:12.459782+0000","last_fullsized":"2024-08-27T03:59:12.459782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:12.459442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:12.459442+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.459442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:25:35.692272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'114","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:19.402729+0000","last_change":"2024-08-27T03:59:19.402472+0000","last_active":"2024-08-27T03:59:19.402729+0000","last_peered":"2024-08-27T03:59:19.402729+0000","last_clean":"2024-08-27T03:59:19.402729+0000","last_became_active":"2024-08-27T02:31:14.520529+0000","last_became_peered":"2024-08-27T02:31:14.520529+0000","last_unstale":"2024-08-27T03:59:19.402729+0000","last_undegraded":"2024-08-27T03:59:19.402729+0000","last_fullsized":"2024-08-27T03:59:19.402729+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'114","last_scrub_stamp":"2024-08-27T03:59:19.402257+0000","last_deep_scrub":"267'114","last_deep_scrub_stamp":"2024-08-27T03:59:19.402257+0000","last_clean_scrub_stamp":"2024-08-27T03:59:19.402257+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:04:11.664844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'380","reported_seq":1856,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.149070+0000","last_change":"2024-08-27T03:58:47.148934+0000","last_active":"2024-08-27T03:58:47.149070+0000","last_peered":"2024-08-27T03:58:47.149070+0000","last_clean":"2024-08-27T03:58:47.149070+0000","last_became_active":"2024-08-27T02:31:06.473950+0000","last_became_peered":"2024-08-27T02:31:06.473950+0000","last_unstale":"2024-08-27T03:58:47.149070+0000","last_undegraded":"2024-08-27T03:58:47.149070+0000","last_fullsized":"2024-08-27T03:58:47.149070+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-08-27T03:58:47.148744+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.148744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:32:27.163059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2065,"num_read_kb":1960,"num_write":429,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'319","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.889227+0000","last_change":"2024-08-27T03:58:44.889227+0000","last_active":"2024-08-27T03:58:44.889227+0000","last_peered":"2024-08-27T03:58:44.889227+0000","last_clean":"2024-08-27T03:58:44.889227+0000","last_became_active":"2024-08-27T02:31:04.500594+0000","last_became_peered":"2024-08-27T02:31:04.500594+0000","last_unstale":"2024-08-27T03:58:44.889227+0000","last_undegraded":"2024-08-27T03:58:44.889227+0000","last_fullsized":"2024-08-27T03:58:44.889227+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-08-27T03:58:44.888880+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.888880+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:13:45.821566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":2061,"num_write":967,"num_write_kb":25323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.296377+0000","last_change":"2024-08-27T03:58:58.296199+0000","last_active":"2024-08-27T03:58:58.296377+0000","last_peered":"2024-08-27T03:58:58.296377+0000","last_clean":"2024-08-27T03:58:58.296377+0000","last_became_active":"2024-08-27T02:31:08.461308+0000","last_became_peered":"2024-08-27T02:31:08.461308+0000","last_unstale":"2024-08-27T03:58:58.296377+0000","last_undegraded":"2024-08-27T03:58:58.296377+0000","last_fullsized":"2024-08-27T03:58:58.296377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.296017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.296017+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.296017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:05:15.246385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'58","reported_seq":597,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.507410+0000","last_change":"2024-08-27T03:58:59.507278+0000","last_active":"2024-08-27T03:58:59.507410+0000","last_peered":"2024-08-27T03:58:59.507410+0000","last_clean":"2024-08-27T03:58:59.507410+0000","last_became_active":"2024-08-27T02:31:10.464421+0000","last_became_peered":"2024-08-27T02:31:10.464421+0000","last_unstale":"2024-08-27T03:58:59.507410+0000","last_undegraded":"2024-08-27T03:58:59.507410+0000","last_fullsized":"2024-08-27T03:58:59.507410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'58","last_scrub_stamp":"2024-08-27T03:58:59.507104+0000","last_deep_scrub":"267'58","last_deep_scrub_stamp":"2024-08-27T03:58:59.507104+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.507104+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:25:51.054843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.842018+0000","last_change":"2024-08-27T03:59:05.841846+0000","last_active":"2024-08-27T03:59:05.842018+0000","last_peered":"2024-08-27T03:59:05.842018+0000","last_clean":"2024-08-27T03:59:05.842018+0000","last_became_active":"2024-08-27T02:31:12.505404+0000","last_became_peered":"2024-08-27T02:31:12.505404+0000","last_unstale":"2024-08-27T03:59:05.842018+0000","last_undegraded":"2024-08-27T03:59:05.842018+0000","last_fullsized":"2024-08-27T03:59:05.842018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:05.841662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:05.841662+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.841662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:13:02.161033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'186","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.562826+0000","last_change":"2024-08-27T03:59:12.562826+0000","last_active":"2024-08-27T03:59:12.562826+0000","last_peered":"2024-08-27T03:59:12.562826+0000","last_clean":"2024-08-27T03:59:12.562826+0000","last_became_active":"2024-08-27T02:31:14.517225+0000","last_became_peered":"2024-08-27T02:31:14.517225+0000","last_unstale":"2024-08-27T03:59:12.562826+0000","last_undegraded":"2024-08-27T03:59:12.562826+0000","last_fullsized":"2024-08-27T03:59:12.562826+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-08-27T03:59:12.562630+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-08-27T03:59:12.562630+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.562630+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:12:56.115345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":403,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'412","reported_seq":1970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.134086+0000","last_change":"2024-08-27T03:58:49.133915+0000","last_active":"2024-08-27T03:58:49.134086+0000","last_peered":"2024-08-27T03:58:49.134086+0000","last_clean":"2024-08-27T03:58:49.134086+0000","last_became_active":"2024-08-27T02:31:06.458858+0000","last_became_peered":"2024-08-27T02:31:06.458858+0000","last_unstale":"2024-08-27T03:58:49.134086+0000","last_undegraded":"2024-08-27T03:58:49.134086+0000","last_fullsized":"2024-08-27T03:58:49.134086+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-08-27T03:58:49.133730+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.133730+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:26:03.612785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2201,"num_read_kb":2093,"num_write":470,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'324","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.768146+0000","last_change":"2024-08-27T03:58:48.768146+0000","last_active":"2024-08-27T03:58:48.768146+0000","last_peered":"2024-08-27T03:58:48.768146+0000","last_clean":"2024-08-27T03:58:48.768146+0000","last_became_active":"2024-08-27T02:31:04.476103+0000","last_became_peered":"2024-08-27T02:31:04.476103+0000","last_unstale":"2024-08-27T03:58:48.768146+0000","last_undegraded":"2024-08-27T03:58:48.768146+0000","last_fullsized":"2024-08-27T03:58:48.768146+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-08-27T03:58:48.767843+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.767843+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:56.225287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525410,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":30350,"num_write":1025,"num_write_kb":44477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.956608+0000","last_change":"2024-08-27T03:58:56.956467+0000","last_active":"2024-08-27T03:58:56.956608+0000","last_peered":"2024-08-27T03:58:56.956608+0000","last_clean":"2024-08-27T03:58:56.956608+0000","last_became_active":"2024-08-27T02:31:08.448888+0000","last_became_peered":"2024-08-27T02:31:08.448888+0000","last_unstale":"2024-08-27T03:58:56.956608+0000","last_undegraded":"2024-08-27T03:58:56.956608+0000","last_fullsized":"2024-08-27T03:58:56.956608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.956265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.956265+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.956265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:45:45.975142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'346","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.344497+0000","last_change":"2024-08-27T03:59:06.344247+0000","last_active":"2024-08-27T03:59:06.344497+0000","last_peered":"2024-08-27T03:59:06.344497+0000","last_clean":"2024-08-27T03:59:06.344497+0000","last_became_active":"2024-08-27T02:31:10.466738+0000","last_became_peered":"2024-08-27T02:31:10.466738+0000","last_unstale":"2024-08-27T03:59:06.344497+0000","last_undegraded":"2024-08-27T03:59:06.344497+0000","last_fullsized":"2024-08-27T03:59:06.344497+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:59:06.344011+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:59:06.344011+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.344011+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:57:44.497759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1247,"num_write":450,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.667271+0000","last_change":"2024-08-27T03:58:56.667135+0000","last_active":"2024-08-27T03:58:56.667271+0000","last_peered":"2024-08-27T03:58:56.667271+0000","last_clean":"2024-08-27T03:58:56.667271+0000","last_became_active":"2024-08-27T02:31:12.501804+0000","last_became_peered":"2024-08-27T02:31:12.501804+0000","last_unstale":"2024-08-27T03:58:56.667271+0000","last_undegraded":"2024-08-27T03:58:56.667271+0000","last_fullsized":"2024-08-27T03:58:56.667271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.666955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.666955+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.666955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:43:34.487076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'115","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:11.926555+0000","last_change":"2024-08-27T03:59:11.926555+0000","last_active":"2024-08-27T03:59:11.926555+0000","last_peered":"2024-08-27T03:59:11.926555+0000","last_clean":"2024-08-27T03:59:11.926555+0000","last_became_active":"2024-08-27T02:31:14.521173+0000","last_became_peered":"2024-08-27T02:31:14.521173+0000","last_unstale":"2024-08-27T03:59:11.926555+0000","last_undegraded":"2024-08-27T03:59:11.926555+0000","last_fullsized":"2024-08-27T03:59:11.926555+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'115","last_scrub_stamp":"2024-08-27T03:59:11.926366+0000","last_deep_scrub":"267'115","last_deep_scrub_stamp":"2024-08-27T03:59:11.926366+0000","last_clean_scrub_stamp":"2024-08-27T03:59:11.926366+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:33:30.256381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":101,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'420","reported_seq":1948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.187800+0000","last_change":"2024-08-27T03:58:51.187656+0000","last_active":"2024-08-27T03:58:51.187800+0000","last_peered":"2024-08-27T03:58:51.187800+0000","last_clean":"2024-08-27T03:58:51.187800+0000","last_became_active":"2024-08-27T02:31:06.450956+0000","last_became_peered":"2024-08-27T02:31:06.450956+0000","last_unstale":"2024-08-27T03:58:51.187800+0000","last_undegraded":"2024-08-27T03:58:51.187800+0000","last_fullsized":"2024-08-27T03:58:51.187800+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'420","last_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_deep_scrub":"267'420","last_deep_scrub_stamp":"2024-08-27T03:58:51.187454+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.187454+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:01:20.975620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2167,"num_read_kb":2056,"num_write":466,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'331","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:37.480918+0000","last_change":"2024-08-27T03:58:37.480918+0000","last_active":"2024-08-27T03:58:37.480918+0000","last_peered":"2024-08-27T03:58:37.480918+0000","last_clean":"2024-08-27T03:58:37.480918+0000","last_became_active":"2024-08-27T02:31:04.453093+0000","last_became_peered":"2024-08-27T02:31:04.453093+0000","last_unstale":"2024-08-27T03:58:37.480918+0000","last_undegraded":"2024-08-27T03:58:37.480918+0000","last_fullsized":"2024-08-27T03:58:37.480918+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'331","last_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_deep_scrub":"267'331","last_deep_scrub_stamp":"2024-08-27T03:58:37.480830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:37.480830+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:01:53.901179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1018782,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":16403,"num_write":1128,"num_write_kb":25930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.652610+0000","last_change":"2024-08-27T03:58:51.652421+0000","last_active":"2024-08-27T03:58:51.652610+0000","last_peered":"2024-08-27T03:58:51.652610+0000","last_clean":"2024-08-27T03:58:51.652610+0000","last_became_active":"2024-08-27T02:31:08.464130+0000","last_became_peered":"2024-08-27T02:31:08.464130+0000","last_unstale":"2024-08-27T03:58:51.652610+0000","last_undegraded":"2024-08-27T03:58:51.652610+0000","last_fullsized":"2024-08-27T03:58:51.652610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:51.652254+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.652254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:21:22.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'285","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.945166+0000","last_change":"2024-08-27T03:59:02.945012+0000","last_active":"2024-08-27T03:59:02.945166+0000","last_peered":"2024-08-27T03:59:02.945166+0000","last_clean":"2024-08-27T03:59:02.945166+0000","last_became_active":"2024-08-27T02:31:10.476044+0000","last_became_peered":"2024-08-27T02:31:10.476044+0000","last_unstale":"2024-08-27T03:59:02.945166+0000","last_undegraded":"2024-08-27T03:59:02.945166+0000","last_fullsized":"2024-08-27T03:59:02.945166+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-08-27T03:59:02.944806+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-08-27T03:59:02.944806+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.944806+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:46:18.316088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":1094,"num_write":376,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:02.475021+0000","last_change":"2024-08-27T03:59:02.474818+0000","last_active":"2024-08-27T03:59:02.475021+0000","last_peered":"2024-08-27T03:59:02.475021+0000","last_clean":"2024-08-27T03:59:02.475021+0000","last_became_active":"2024-08-27T02:31:12.517977+0000","last_became_peered":"2024-08-27T02:31:12.517977+0000","last_unstale":"2024-08-27T03:59:02.475021+0000","last_undegraded":"2024-08-27T03:59:02.475021+0000","last_fullsized":"2024-08-27T03:59:02.475021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:02.474632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:02.474632+0000","last_clean_scrub_stamp":"2024-08-27T03:59:02.474632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:03:54.952348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'839","reported_seq":2423,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.689531+0000","last_change":"2024-08-27T03:58:47.689531+0000","last_active":"2024-08-27T03:58:47.689531+0000","last_peered":"2024-08-27T03:58:47.689531+0000","last_clean":"2024-08-27T03:58:47.689531+0000","last_became_active":"2024-08-27T02:31:06.458410+0000","last_became_peered":"2024-08-27T02:31:06.458410+0000","last_unstale":"2024-08-27T03:58:47.689531+0000","last_undegraded":"2024-08-27T03:58:47.689531+0000","last_fullsized":"2024-08-27T03:58:47.689531+0000","mapping_epoch":27,"log_start":"267'800","ondisk_log_start":"267'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-08-27T03:58:47.689347+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.689347+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:53:38.179127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3619,"num_write":1116,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1651,"num_omap_keys":7,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'418","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.127698+0000","last_change":"2024-08-27T03:58:40.127698+0000","last_active":"2024-08-27T03:58:40.127698+0000","last_peered":"2024-08-27T03:58:40.127698+0000","last_clean":"2024-08-27T03:58:40.127698+0000","last_became_active":"2024-08-27T02:31:04.436816+0000","last_became_peered":"2024-08-27T02:31:04.436816+0000","last_unstale":"2024-08-27T03:58:40.127698+0000","last_undegraded":"2024-08-27T03:58:40.127698+0000","last_fullsized":"2024-08-27T03:58:40.127698+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'418","last_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_deep_scrub":"267'418","last_deep_scrub_stamp":"2024-08-27T03:58:40.127457+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.127457+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:36:37.962208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":762,"num_read_kb":11072,"num_write":1374,"num_write_kb":41555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.531818+0000","last_change":"2024-08-27T03:58:54.531651+0000","last_active":"2024-08-27T03:58:54.531818+0000","last_peered":"2024-08-27T03:58:54.531818+0000","last_clean":"2024-08-27T03:58:54.531818+0000","last_became_active":"2024-08-27T02:31:08.459510+0000","last_became_peered":"2024-08-27T02:31:08.459510+0000","last_unstale":"2024-08-27T03:58:54.531818+0000","last_undegraded":"2024-08-27T03:58:54.531818+0000","last_fullsized":"2024-08-27T03:58:54.531818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:54.531461+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.531461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:09:04.172792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'556","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.024667+0000","last_change":"2024-08-27T03:58:54.024667+0000","last_active":"2024-08-27T03:58:54.024667+0000","last_peered":"2024-08-27T03:58:54.024667+0000","last_clean":"2024-08-27T03:58:54.024667+0000","last_became_active":"2024-08-27T02:31:10.471321+0000","last_became_peered":"2024-08-27T02:31:10.471321+0000","last_unstale":"2024-08-27T03:58:54.024667+0000","last_undegraded":"2024-08-27T03:58:54.024667+0000","last_fullsized":"2024-08-27T03:58:54.024667+0000","mapping_epoch":31,"log_start":"267'500","ondisk_log_start":"267'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'556","last_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_deep_scrub":"267'556","last_deep_scrub_stamp":"2024-08-27T03:58:54.024451+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.024451+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:15:17.790125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":990,"num_read_kb":2409,"num_write":858,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23904,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.764886+0000","last_change":"2024-08-27T03:59:07.764886+0000","last_active":"2024-08-27T03:59:07.764886+0000","last_peered":"2024-08-27T03:59:07.764886+0000","last_clean":"2024-08-27T03:59:07.764886+0000","last_became_active":"2024-08-27T02:31:12.512275+0000","last_became_peered":"2024-08-27T02:31:12.512275+0000","last_unstale":"2024-08-27T03:59:07.764886+0000","last_undegraded":"2024-08-27T03:59:07.764886+0000","last_fullsized":"2024-08-27T03:59:07.764886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:07.764707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:07.764707+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.764707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:57:07.171054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'144","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:18.436754+0000","last_change":"2024-08-27T03:59:18.436590+0000","last_active":"2024-08-27T03:59:18.436754+0000","last_peered":"2024-08-27T03:59:18.436754+0000","last_clean":"2024-08-27T03:59:18.436754+0000","last_became_active":"2024-08-27T02:31:15.025495+0000","last_became_peered":"2024-08-27T02:31:15.025495+0000","last_unstale":"2024-08-27T03:59:18.436754+0000","last_undegraded":"2024-08-27T03:59:18.436754+0000","last_fullsized":"2024-08-27T03:59:18.436754+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'144","last_scrub_stamp":"2024-08-27T03:59:18.436397+0000","last_deep_scrub":"267'144","last_deep_scrub_stamp":"2024-08-27T03:59:18.436397+0000","last_clean_scrub_stamp":"2024-08-27T03:59:18.436397+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:50:42.457307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1030,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":182,"num_write":315,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'1183","reported_seq":2632,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.466634+0000","last_change":"2024-08-27T03:58:49.466497+0000","last_active":"2024-08-27T03:58:49.466634+0000","last_peered":"2024-08-27T03:58:49.466634+0000","last_clean":"2024-08-27T03:58:49.466634+0000","last_became_active":"2024-08-27T02:31:06.444449+0000","last_became_peered":"2024-08-27T02:31:06.444449+0000","last_unstale":"2024-08-27T03:58:49.466634+0000","last_undegraded":"2024-08-27T03:58:49.466634+0000","last_fullsized":"2024-08-27T03:58:49.466634+0000","mapping_epoch":27,"log_start":"267'1100","ondisk_log_start":"267'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1183","last_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_deep_scrub":"267'1183","last_deep_scrub_stamp":"2024-08-27T03:58:49.466324+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.466324+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:24:09.565854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5252,"num_read_kb":4602,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1263,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'349","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.092246+0000","last_change":"2024-08-27T03:58:41.092246+0000","last_active":"2024-08-27T03:58:41.092246+0000","last_peered":"2024-08-27T03:58:41.092246+0000","last_clean":"2024-08-27T03:58:41.092246+0000","last_became_active":"2024-08-27T02:31:04.451407+0000","last_became_peered":"2024-08-27T02:31:04.451407+0000","last_unstale":"2024-08-27T03:58:41.092246+0000","last_undegraded":"2024-08-27T03:58:41.092246+0000","last_fullsized":"2024-08-27T03:58:41.092246+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-08-27T03:58:41.092033+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.092033+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:47:27.087478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":41676,"num_write":1093,"num_write_kb":31796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.666378+0000","last_change":"2024-08-27T03:58:52.666378+0000","last_active":"2024-08-27T03:58:52.666378+0000","last_peered":"2024-08-27T03:58:52.666378+0000","last_clean":"2024-08-27T03:58:52.666378+0000","last_became_active":"2024-08-27T02:31:08.467363+0000","last_became_peered":"2024-08-27T02:31:08.467363+0000","last_unstale":"2024-08-27T03:58:52.666378+0000","last_undegraded":"2024-08-27T03:58:52.666378+0000","last_fullsized":"2024-08-27T03:58:52.666378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:52.666203+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.666203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:19:46.181291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'358","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:04.865885+0000","last_change":"2024-08-27T03:59:04.865885+0000","last_active":"2024-08-27T03:59:04.865885+0000","last_peered":"2024-08-27T03:59:04.865885+0000","last_clean":"2024-08-27T03:59:04.865885+0000","last_became_active":"2024-08-27T02:31:10.476790+0000","last_became_peered":"2024-08-27T02:31:10.476790+0000","last_unstale":"2024-08-27T03:59:04.865885+0000","last_undegraded":"2024-08-27T03:59:04.865885+0000","last_fullsized":"2024-08-27T03:59:04.865885+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-08-27T03:59:04.865659+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-08-27T03:59:04.865659+0000","last_clean_scrub_stamp":"2024-08-27T03:59:04.865659+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:37:03.014002+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44636,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":1171,"num_write":462,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.060998+0000","last_change":"2024-08-27T03:58:56.060998+0000","last_active":"2024-08-27T03:58:56.060998+0000","last_peered":"2024-08-27T03:58:56.060998+0000","last_clean":"2024-08-27T03:58:56.060998+0000","last_became_active":"2024-08-27T02:31:12.493002+0000","last_became_peered":"2024-08-27T02:31:12.493002+0000","last_unstale":"2024-08-27T03:58:56.060998+0000","last_undegraded":"2024-08-27T03:58:56.060998+0000","last_fullsized":"2024-08-27T03:58:56.060998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:56.060804+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.060804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:44:43.231476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'180","reported_seq":712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.606280+0000","last_change":"2024-08-27T03:59:01.606127+0000","last_active":"2024-08-27T03:59:01.606280+0000","last_peered":"2024-08-27T03:59:01.606280+0000","last_clean":"2024-08-27T03:59:01.606280+0000","last_became_active":"2024-08-27T02:31:14.520811+0000","last_became_peered":"2024-08-27T02:31:14.520811+0000","last_unstale":"2024-08-27T03:59:01.606280+0000","last_undegraded":"2024-08-27T03:59:01.606280+0000","last_fullsized":"2024-08-27T03:59:01.606280+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-08-27T03:59:01.605928+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-08-27T03:59:01.605928+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.605928+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:24:58.905577+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":217,"num_write":508,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'699","reported_seq":2143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.218908+0000","last_change":"2024-08-27T03:58:53.218908+0000","last_active":"2024-08-27T03:58:53.218908+0000","last_peered":"2024-08-27T03:58:53.218908+0000","last_clean":"2024-08-27T03:58:53.218908+0000","last_became_active":"2024-08-27T02:31:06.446199+0000","last_became_peered":"2024-08-27T02:31:06.446199+0000","last_unstale":"2024-08-27T03:58:53.218908+0000","last_undegraded":"2024-08-27T03:58:53.218908+0000","last_fullsized":"2024-08-27T03:58:53.218908+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'699","last_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_deep_scrub":"267'699","last_deep_scrub_stamp":"2024-08-27T03:58:53.218695+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.218695+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:40:33.400240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3359,"num_read_kb":3035,"num_write":925,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'333","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.695058+0000","last_change":"2024-08-27T03:58:39.695058+0000","last_active":"2024-08-27T03:58:39.695058+0000","last_peered":"2024-08-27T03:58:39.695058+0000","last_clean":"2024-08-27T03:58:39.695058+0000","last_became_active":"2024-08-27T02:31:04.483938+0000","last_became_peered":"2024-08-27T02:31:04.483938+0000","last_unstale":"2024-08-27T03:58:39.695058+0000","last_undegraded":"2024-08-27T03:58:39.695058+0000","last_fullsized":"2024-08-27T03:58:39.695058+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-08-27T03:58:39.694836+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.694836+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:02:12.785434+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":27841,"num_write":1117,"num_write_kb":25462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.677750+0000","last_change":"2024-08-27T03:59:01.677750+0000","last_active":"2024-08-27T03:59:01.677750+0000","last_peered":"2024-08-27T03:59:01.677750+0000","last_clean":"2024-08-27T03:59:01.677750+0000","last_became_active":"2024-08-27T02:31:08.461100+0000","last_became_peered":"2024-08-27T02:31:08.461100+0000","last_unstale":"2024-08-27T03:59:01.677750+0000","last_undegraded":"2024-08-27T03:59:01.677750+0000","last_fullsized":"2024-08-27T03:59:01.677750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.677560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.677560+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.677560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:39:47.407504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'329","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.430587+0000","last_change":"2024-08-27T03:59:08.430587+0000","last_active":"2024-08-27T03:59:08.430587+0000","last_peered":"2024-08-27T03:59:08.430587+0000","last_clean":"2024-08-27T03:59:08.430587+0000","last_became_active":"2024-08-27T02:31:10.635192+0000","last_became_peered":"2024-08-27T02:31:10.635192+0000","last_unstale":"2024-08-27T03:59:08.430587+0000","last_undegraded":"2024-08-27T03:59:08.430587+0000","last_fullsized":"2024-08-27T03:59:08.430587+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-08-27T03:59:08.430391+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-08-27T03:59:08.430391+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.430391+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:17:17.845904+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66592,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1228,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.065028+0000","last_change":"2024-08-27T03:58:59.064956+0000","last_active":"2024-08-27T03:58:59.065028+0000","last_peered":"2024-08-27T03:58:59.065028+0000","last_clean":"2024-08-27T03:58:59.065028+0000","last_became_active":"2024-08-27T02:31:12.497598+0000","last_became_peered":"2024-08-27T02:31:12.497598+0000","last_unstale":"2024-08-27T03:58:59.065028+0000","last_undegraded":"2024-08-27T03:58:59.065028+0000","last_fullsized":"2024-08-27T03:58:59.065028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:59.064853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:59.064853+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.064853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:33:49.395528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'120","reported_seq":650,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.902562+0000","last_change":"2024-08-27T03:59:10.902379+0000","last_active":"2024-08-27T03:59:10.902562+0000","last_peered":"2024-08-27T03:59:10.902562+0000","last_clean":"2024-08-27T03:59:10.902562+0000","last_became_active":"2024-08-27T02:31:14.521284+0000","last_became_peered":"2024-08-27T02:31:14.521284+0000","last_unstale":"2024-08-27T03:59:10.902562+0000","last_undegraded":"2024-08-27T03:59:10.902562+0000","last_fullsized":"2024-08-27T03:59:10.902562+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-08-27T03:59:10.902192+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-08-27T03:59:10.902192+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.902192+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:05:23.962757+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":131,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'790","reported_seq":2428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.556897+0000","last_change":"2024-08-27T03:58:46.556897+0000","last_active":"2024-08-27T03:58:46.556897+0000","last_peered":"2024-08-27T03:58:46.556897+0000","last_clean":"2024-08-27T03:58:46.556897+0000","last_became_active":"2024-08-27T02:31:06.452953+0000","last_became_peered":"2024-08-27T02:31:06.452953+0000","last_unstale":"2024-08-27T03:58:46.556897+0000","last_undegraded":"2024-08-27T03:58:46.556897+0000","last_fullsized":"2024-08-27T03:58:46.556897+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'790","last_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_deep_scrub":"267'790","last_deep_scrub_stamp":"2024-08-27T03:58:46.556708+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.556708+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:37:05.148074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3818,"num_read_kb":3474,"num_write":1025,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'325","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.454132+0000","last_change":"2024-08-27T03:58:38.454132+0000","last_active":"2024-08-27T03:58:38.454132+0000","last_peered":"2024-08-27T03:58:38.454132+0000","last_clean":"2024-08-27T03:58:38.454132+0000","last_became_active":"2024-08-27T02:31:04.466443+0000","last_became_peered":"2024-08-27T02:31:04.466443+0000","last_unstale":"2024-08-27T03:58:38.454132+0000","last_undegraded":"2024-08-27T03:58:38.454132+0000","last_fullsized":"2024-08-27T03:58:38.454132+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:38.453909+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.453909+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:58:53.794488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399355,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":2807,"num_write":1070,"num_write_kb":12967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.062298+0000","last_change":"2024-08-27T03:58:58.062298+0000","last_active":"2024-08-27T03:58:58.062298+0000","last_peered":"2024-08-27T03:58:58.062298+0000","last_clean":"2024-08-27T03:58:58.062298+0000","last_became_active":"2024-08-27T02:31:08.470412+0000","last_became_peered":"2024-08-27T02:31:08.470412+0000","last_unstale":"2024-08-27T03:58:58.062298+0000","last_undegraded":"2024-08-27T03:58:58.062298+0000","last_fullsized":"2024-08-27T03:58:58.062298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:58.062113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:58.062113+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.062113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:47:29.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'139","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:05.665364+0000","last_change":"2024-08-27T03:59:05.665112+0000","last_active":"2024-08-27T03:59:05.665364+0000","last_peered":"2024-08-27T03:59:05.665364+0000","last_clean":"2024-08-27T03:59:05.665364+0000","last_became_active":"2024-08-27T02:31:10.634674+0000","last_became_peered":"2024-08-27T02:31:10.634674+0000","last_unstale":"2024-08-27T03:59:05.665364+0000","last_undegraded":"2024-08-27T03:59:05.665364+0000","last_fullsized":"2024-08-27T03:59:05.665364+0000","mapping_epoch":31,"log_start":"267'100","ondisk_log_start":"267'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'139","last_scrub_stamp":"2024-08-27T03:59:05.664863+0000","last_deep_scrub":"267'139","last_deep_scrub_stamp":"2024-08-27T03:59:05.664863+0000","last_clean_scrub_stamp":"2024-08-27T03:59:05.664863+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:03:13.985053+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":162,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14734,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'693","reported_seq":2827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:58.654742+0000","last_change":"2024-08-27T03:58:58.654742+0000","last_active":"2024-08-27T03:58:58.654742+0000","last_peered":"2024-08-27T03:58:58.654742+0000","last_clean":"2024-08-27T03:58:58.654742+0000","last_became_active":"2024-08-27T02:31:12.489950+0000","last_became_peered":"2024-08-27T02:31:12.489950+0000","last_unstale":"2024-08-27T03:58:58.654742+0000","last_undegraded":"2024-08-27T03:58:58.654742+0000","last_fullsized":"2024-08-27T03:58:58.654742+0000","mapping_epoch":33,"log_start":"267'600","ondisk_log_start":"267'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'693","last_scrub_stamp":"2024-08-27T03:58:58.654530+0000","last_deep_scrub":"267'693","last_deep_scrub_stamp":"2024-08-27T03:58:58.654530+0000","last_clean_scrub_stamp":"2024-08-27T03:58:58.654530+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:44:19.149780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'113","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.804959+0000","last_change":"2024-08-27T03:59:08.804799+0000","last_active":"2024-08-27T03:59:08.804959+0000","last_peered":"2024-08-27T03:59:08.804959+0000","last_clean":"2024-08-27T03:59:08.804959+0000","last_became_active":"2024-08-27T02:31:14.515918+0000","last_became_peered":"2024-08-27T02:31:14.515918+0000","last_unstale":"2024-08-27T03:59:08.804959+0000","last_undegraded":"2024-08-27T03:59:08.804959+0000","last_fullsized":"2024-08-27T03:59:08.804959+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-08-27T03:59:08.804603+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-08-27T03:59:08.804603+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.804603+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:16:44.829031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'791","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.714950+0000","last_change":"2024-08-27T03:58:49.714950+0000","last_active":"2024-08-27T03:58:49.714950+0000","last_peered":"2024-08-27T03:58:49.714950+0000","last_clean":"2024-08-27T03:58:49.714950+0000","last_became_active":"2024-08-27T02:31:06.466883+0000","last_became_peered":"2024-08-27T02:31:06.466883+0000","last_unstale":"2024-08-27T03:58:49.714950+0000","last_undegraded":"2024-08-27T03:58:49.714950+0000","last_fullsized":"2024-08-27T03:58:49.714950+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'791","last_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_deep_scrub":"267'791","last_deep_scrub_stamp":"2024-08-27T03:58:49.714771+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.714771+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:47:52.868288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3910,"num_read_kb":3562,"num_write":1028,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'298","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.775582+0000","last_change":"2024-08-27T03:58:46.775582+0000","last_active":"2024-08-27T03:58:46.775582+0000","last_peered":"2024-08-27T03:58:46.775582+0000","last_clean":"2024-08-27T03:58:46.775582+0000","last_became_active":"2024-08-27T02:31:04.462790+0000","last_became_peered":"2024-08-27T02:31:04.462790+0000","last_unstale":"2024-08-27T03:58:46.775582+0000","last_undegraded":"2024-08-27T03:58:46.775582+0000","last_fullsized":"2024-08-27T03:58:46.775582+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-08-27T03:58:46.775293+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.775293+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:17:09.222532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550499,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":504,"num_read_kb":12943,"num_write":990,"num_write_kb":23023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.938304+0000","last_change":"2024-08-27T03:58:57.938304+0000","last_active":"2024-08-27T03:58:57.938304+0000","last_peered":"2024-08-27T03:58:57.938304+0000","last_clean":"2024-08-27T03:58:57.938304+0000","last_became_active":"2024-08-27T02:31:08.446269+0000","last_became_peered":"2024-08-27T02:31:08.446269+0000","last_unstale":"2024-08-27T03:58:57.938304+0000","last_undegraded":"2024-08-27T03:58:57.938304+0000","last_fullsized":"2024-08-27T03:58:57.938304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.938116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.938116+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.938116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:03:11.911435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'390","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.783274+0000","last_change":"2024-08-27T03:59:06.783274+0000","last_active":"2024-08-27T03:59:06.783274+0000","last_peered":"2024-08-27T03:59:06.783274+0000","last_clean":"2024-08-27T03:59:06.783274+0000","last_became_active":"2024-08-27T02:31:10.468759+0000","last_became_peered":"2024-08-27T02:31:10.468759+0000","last_unstale":"2024-08-27T03:59:06.783274+0000","last_undegraded":"2024-08-27T03:59:06.783274+0000","last_fullsized":"2024-08-27T03:59:06.783274+0000","mapping_epoch":31,"log_start":"267'300","ondisk_log_start":"267'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-08-27T03:59:06.783054+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-08-27T03:59:06.783054+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.783054+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:04:57.075877+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43349,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":596,"num_read_kb":1173,"num_write":464,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:06.528035+0000","last_change":"2024-08-27T03:59:06.528035+0000","last_active":"2024-08-27T03:59:06.528035+0000","last_peered":"2024-08-27T03:59:06.528035+0000","last_clean":"2024-08-27T03:59:06.528035+0000","last_became_active":"2024-08-27T02:31:12.516878+0000","last_became_peered":"2024-08-27T02:31:12.516878+0000","last_unstale":"2024-08-27T03:59:06.528035+0000","last_undegraded":"2024-08-27T03:59:06.528035+0000","last_fullsized":"2024-08-27T03:59:06.528035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:06.527836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:06.527836+0000","last_clean_scrub_stamp":"2024-08-27T03:59:06.527836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:40:14.529374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'115","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:12.741333+0000","last_change":"2024-08-27T03:59:12.741333+0000","last_active":"2024-08-27T03:59:12.741333+0000","last_peered":"2024-08-27T03:59:12.741333+0000","last_clean":"2024-08-27T03:59:12.741333+0000","last_became_active":"2024-08-27T02:31:14.522753+0000","last_became_peered":"2024-08-27T02:31:14.522753+0000","last_unstale":"2024-08-27T03:59:12.741333+0000","last_undegraded":"2024-08-27T03:59:12.741333+0000","last_fullsized":"2024-08-27T03:59:12.741333+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'115","last_scrub_stamp":"2024-08-27T03:59:12.741145+0000","last_deep_scrub":"267'115","last_deep_scrub_stamp":"2024-08-27T03:59:12.741145+0000","last_clean_scrub_stamp":"2024-08-27T03:59:12.741145+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:55:07.013617+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":137,"num_write":271,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'377","reported_seq":1871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.746460+0000","last_change":"2024-08-27T03:58:46.746460+0000","last_active":"2024-08-27T03:58:46.746460+0000","last_peered":"2024-08-27T03:58:46.746460+0000","last_clean":"2024-08-27T03:58:46.746460+0000","last_became_active":"2024-08-27T02:31:06.464270+0000","last_became_peered":"2024-08-27T02:31:06.464270+0000","last_unstale":"2024-08-27T03:58:46.746460+0000","last_undegraded":"2024-08-27T03:58:46.746460+0000","last_fullsized":"2024-08-27T03:58:46.746460+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-08-27T03:58:46.746284+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.746284+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:17:21.089772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2165,"num_read_kb":2072,"num_write":425,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'325","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.707957+0000","last_change":"2024-08-27T03:58:41.707957+0000","last_active":"2024-08-27T03:58:41.707957+0000","last_peered":"2024-08-27T03:58:41.707957+0000","last_clean":"2024-08-27T03:58:41.707957+0000","last_became_active":"2024-08-27T02:31:04.449361+0000","last_became_peered":"2024-08-27T02:31:04.449361+0000","last_unstale":"2024-08-27T03:58:41.707957+0000","last_undegraded":"2024-08-27T03:58:41.707957+0000","last_fullsized":"2024-08-27T03:58:41.707957+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'325","last_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_deep_scrub":"267'325","last_deep_scrub_stamp":"2024-08-27T03:58:41.707686+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.707686+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:04:44.940323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":8306,"num_write":1045,"num_write_kb":32507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:01.824808+0000","last_change":"2024-08-27T03:59:01.824808+0000","last_active":"2024-08-27T03:59:01.824808+0000","last_peered":"2024-08-27T03:59:01.824808+0000","last_clean":"2024-08-27T03:59:01.824808+0000","last_became_active":"2024-08-27T02:31:08.463155+0000","last_became_peered":"2024-08-27T02:31:08.463155+0000","last_unstale":"2024-08-27T03:59:01.824808+0000","last_undegraded":"2024-08-27T03:59:01.824808+0000","last_fullsized":"2024-08-27T03:59:01.824808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:01.824623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:01.824623+0000","last_clean_scrub_stamp":"2024-08-27T03:59:01.824623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:47:19.318799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'273","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.523257+0000","last_change":"2024-08-27T03:59:07.523257+0000","last_active":"2024-08-27T03:59:07.523257+0000","last_peered":"2024-08-27T03:59:07.523257+0000","last_clean":"2024-08-27T03:59:07.523257+0000","last_became_active":"2024-08-27T02:31:10.470023+0000","last_became_peered":"2024-08-27T02:31:10.470023+0000","last_unstale":"2024-08-27T03:59:07.523257+0000","last_undegraded":"2024-08-27T03:59:07.523257+0000","last_fullsized":"2024-08-27T03:59:07.523257+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-08-27T03:59:07.523065+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-08-27T03:59:07.523065+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.523065+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:22:39.294903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42854,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":997,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:57.704026+0000","last_change":"2024-08-27T03:58:57.704026+0000","last_active":"2024-08-27T03:58:57.704026+0000","last_peered":"2024-08-27T03:58:57.704026+0000","last_clean":"2024-08-27T03:58:57.704026+0000","last_became_active":"2024-08-27T02:31:12.493347+0000","last_became_peered":"2024-08-27T02:31:12.493347+0000","last_unstale":"2024-08-27T03:58:57.704026+0000","last_undegraded":"2024-08-27T03:58:57.704026+0000","last_fullsized":"2024-08-27T03:58:57.704026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:58:57.703813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:58:57.703813+0000","last_clean_scrub_stamp":"2024-08-27T03:58:57.703813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:51:00.303752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'137","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:17.405365+0000","last_change":"2024-08-27T03:59:17.405365+0000","last_active":"2024-08-27T03:59:17.405365+0000","last_peered":"2024-08-27T03:59:17.405365+0000","last_clean":"2024-08-27T03:59:17.405365+0000","last_became_active":"2024-08-27T02:31:15.027518+0000","last_became_peered":"2024-08-27T02:31:15.027518+0000","last_unstale":"2024-08-27T03:59:17.405365+0000","last_undegraded":"2024-08-27T03:59:17.405365+0000","last_fullsized":"2024-08-27T03:59:17.405365+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-08-27T03:59:17.405123+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-08-27T03:59:17.405123+0000","last_clean_scrub_stamp":"2024-08-27T03:59:17.405123+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:41:27.289310+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":929,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'737","reported_seq":2240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.265124+0000","last_change":"2024-08-27T03:58:54.265124+0000","last_active":"2024-08-27T03:58:54.265124+0000","last_peered":"2024-08-27T03:58:54.265124+0000","last_clean":"2024-08-27T03:58:54.265124+0000","last_became_active":"2024-08-27T02:31:06.446023+0000","last_became_peered":"2024-08-27T02:31:06.446023+0000","last_unstale":"2024-08-27T03:58:54.265124+0000","last_undegraded":"2024-08-27T03:58:54.265124+0000","last_fullsized":"2024-08-27T03:58:54.265124+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'737","last_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_deep_scrub":"267'737","last_deep_scrub_stamp":"2024-08-27T03:58:54.264928+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.264928+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:37:38.355010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3446,"num_read_kb":3123,"num_write":957,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.153768+0000","last_change":"2024-08-27T03:58:41.153507+0000","last_active":"2024-08-27T03:58:41.153768+0000","last_peered":"2024-08-27T03:58:41.153768+0000","last_clean":"2024-08-27T03:58:41.153768+0000","last_became_active":"2024-08-27T02:31:04.476101+0000","last_became_peered":"2024-08-27T02:31:04.476101+0000","last_unstale":"2024-08-27T03:58:41.153768+0000","last_undegraded":"2024-08-27T03:58:41.153768+0000","last_fullsized":"2024-08-27T03:58:41.153768+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-08-27T03:58:41.153232+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.153232+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:21:31.829289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":19461,"num_write":1109,"num_write_kb":36822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:00.692107+0000","last_change":"2024-08-27T03:59:00.692107+0000","last_active":"2024-08-27T03:59:00.692107+0000","last_peered":"2024-08-27T03:59:00.692107+0000","last_clean":"2024-08-27T03:59:00.692107+0000","last_became_active":"2024-08-27T02:31:08.467581+0000","last_became_peered":"2024-08-27T02:31:08.467581+0000","last_unstale":"2024-08-27T03:59:00.692107+0000","last_undegraded":"2024-08-27T03:59:00.692107+0000","last_fullsized":"2024-08-27T03:59:00.692107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:00.691897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:00.691897+0000","last_clean_scrub_stamp":"2024-08-27T03:59:00.691897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:54:58.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'282","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:07.391622+0000","last_change":"2024-08-27T03:59:07.391622+0000","last_active":"2024-08-27T03:59:07.391622+0000","last_peered":"2024-08-27T03:59:07.391622+0000","last_clean":"2024-08-27T03:59:07.391622+0000","last_became_active":"2024-08-27T02:31:10.473944+0000","last_became_peered":"2024-08-27T02:31:10.473944+0000","last_unstale":"2024-08-27T03:59:07.391622+0000","last_undegraded":"2024-08-27T03:59:07.391622+0000","last_fullsized":"2024-08-27T03:59:07.391622+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'282","last_scrub_stamp":"2024-08-27T03:59:07.391429+0000","last_deep_scrub":"267'282","last_deep_scrub_stamp":"2024-08-27T03:59:07.391429+0000","last_clean_scrub_stamp":"2024-08-27T03:59:07.391429+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:47:31.823774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1176,"num_write":390,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:08.621075+0000","last_change":"2024-08-27T03:59:08.621075+0000","last_active":"2024-08-27T03:59:08.621075+0000","last_peered":"2024-08-27T03:59:08.621075+0000","last_clean":"2024-08-27T03:59:08.621075+0000","last_became_active":"2024-08-27T02:31:12.492794+0000","last_became_peered":"2024-08-27T02:31:12.492794+0000","last_unstale":"2024-08-27T03:59:08.621075+0000","last_undegraded":"2024-08-27T03:59:08.621075+0000","last_fullsized":"2024-08-27T03:59:08.621075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:08.620858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:08.620858+0000","last_clean_scrub_stamp":"2024-08-27T03:59:08.620858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:16:55.316384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'183","reported_seq":1665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.801735+0000","last_change":"2024-08-27T03:59:09.801735+0000","last_active":"2024-08-27T03:59:09.801735+0000","last_peered":"2024-08-27T03:59:09.801735+0000","last_clean":"2024-08-27T03:59:09.801735+0000","last_became_active":"2024-08-27T02:31:14.520398+0000","last_became_peered":"2024-08-27T02:31:14.520398+0000","last_unstale":"2024-08-27T03:59:09.801735+0000","last_undegraded":"2024-08-27T03:59:09.801735+0000","last_fullsized":"2024-08-27T03:59:09.801735+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-08-27T03:59:09.801532+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-08-27T03:59:09.801532+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.801532+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:55:31.827352+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1216,"num_read_kb":1203,"num_write":406,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'552","reported_seq":2377,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:47.721278+0000","last_change":"2024-08-27T03:58:47.721278+0000","last_active":"2024-08-27T03:58:47.721278+0000","last_peered":"2024-08-27T03:58:47.721278+0000","last_clean":"2024-08-27T03:58:47.721278+0000","last_became_active":"2024-08-27T02:31:06.456800+0000","last_became_peered":"2024-08-27T02:31:06.456800+0000","last_unstale":"2024-08-27T03:58:47.721278+0000","last_undegraded":"2024-08-27T03:58:47.721278+0000","last_fullsized":"2024-08-27T03:58:47.721278+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'552","last_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_deep_scrub":"267'552","last_deep_scrub_stamp":"2024-08-27T03:58:47.721071+0000","last_clean_scrub_stamp":"2024-08-27T03:58:47.721071+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:43:33.741639+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3027,"num_read_kb":2839,"num_write":666,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'295","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:36.460166+0000","last_change":"2024-08-27T03:58:36.460166+0000","last_active":"2024-08-27T03:58:36.460166+0000","last_peered":"2024-08-27T03:58:36.460166+0000","last_clean":"2024-08-27T03:58:36.460166+0000","last_became_active":"2024-08-27T02:31:38.758118+0000","last_became_peered":"2024-08-27T02:31:38.758118+0000","last_unstale":"2024-08-27T03:58:36.460166+0000","last_undegraded":"2024-08-27T03:58:36.460166+0000","last_fullsized":"2024-08-27T03:58:36.460166+0000","mapping_epoch":38,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-08-27T03:58:36.460054+0000","last_clean_scrub_stamp":"2024-08-27T03:58:36.460054+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:43:47.971880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":5169,"num_write":1020,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.024903+0000","last_change":"2024-08-27T03:58:52.024903+0000","last_active":"2024-08-27T03:58:52.024903+0000","last_peered":"2024-08-27T03:58:52.024903+0000","last_clean":"2024-08-27T03:58:52.024903+0000","last_became_active":"2024-08-27T02:31:08.471009+0000","last_became_peered":"2024-08-27T02:31:08.471009+0000","last_unstale":"2024-08-27T03:58:52.024903+0000","last_undegraded":"2024-08-27T03:58:52.024903+0000","last_fullsized":"2024-08-27T03:58:52.024903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-08-27T03:58:52.024712+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.024712+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:07:21.647892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'310","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.626979+0000","last_change":"2024-08-27T03:59:09.626979+0000","last_active":"2024-08-27T03:59:09.626979+0000","last_peered":"2024-08-27T03:59:09.626979+0000","last_clean":"2024-08-27T03:59:09.626979+0000","last_became_active":"2024-08-27T02:31:10.460845+0000","last_became_peered":"2024-08-27T02:31:10.460845+0000","last_unstale":"2024-08-27T03:59:09.626979+0000","last_undegraded":"2024-08-27T03:59:09.626979+0000","last_fullsized":"2024-08-27T03:59:09.626979+0000","mapping_epoch":31,"log_start":"267'200","ondisk_log_start":"267'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'310","last_scrub_stamp":"2024-08-27T03:59:09.626754+0000","last_deep_scrub":"267'310","last_deep_scrub_stamp":"2024-08-27T03:59:09.626754+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.626754+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:02:45.876241+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41157,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1035,"num_write":382,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:09.544042+0000","last_change":"2024-08-27T03:59:09.544042+0000","last_active":"2024-08-27T03:59:09.544042+0000","last_peered":"2024-08-27T03:59:09.544042+0000","last_clean":"2024-08-27T03:59:09.544042+0000","last_became_active":"2024-08-27T02:31:12.522327+0000","last_became_peered":"2024-08-27T02:31:12.522327+0000","last_unstale":"2024-08-27T03:59:09.544042+0000","last_undegraded":"2024-08-27T03:59:09.544042+0000","last_fullsized":"2024-08-27T03:59:09.544042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-27T03:59:09.543866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-27T03:59:09.543866+0000","last_clean_scrub_stamp":"2024-08-27T03:59:09.543866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:12:51.370345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'147","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:59:10.629559+0000","last_change":"2024-08-27T03:59:10.629559+0000","last_active":"2024-08-27T03:59:10.629559+0000","last_peered":"2024-08-27T03:59:10.629559+0000","last_clean":"2024-08-27T03:59:10.629559+0000","last_became_active":"2024-08-27T02:31:14.505860+0000","last_became_peered":"2024-08-27T02:31:14.505860+0000","last_unstale":"2024-08-27T03:59:10.629559+0000","last_undegraded":"2024-08-27T03:59:10.629559+0000","last_fullsized":"2024-08-27T03:59:10.629559+0000","mapping_epoch":35,"log_start":"267'100","ondisk_log_start":"267'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-08-27T03:59:10.629375+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-08-27T03:59:10.629375+0000","last_clean_scrub_stamp":"2024-08-27T03:59:10.629375+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:56:39.220441+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":351,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'735","reported_seq":2166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.025212+0000","last_change":"2024-08-27T03:58:50.025008+0000","last_active":"2024-08-27T03:58:50.025212+0000","last_peered":"2024-08-27T03:58:50.025212+0000","last_clean":"2024-08-27T03:58:50.025212+0000","last_became_active":"2024-08-27T02:31:06.468945+0000","last_became_peered":"2024-08-27T02:31:06.468945+0000","last_unstale":"2024-08-27T03:58:50.025212+0000","last_undegraded":"2024-08-27T03:58:50.025212+0000","last_fullsized":"2024-08-27T03:58:50.025212+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-08-27T03:58:50.024830+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.024830+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:49:32.647435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3466,"num_read_kb":3129,"num_write":991,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'329","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.800869+0000","last_change":"2024-08-27T03:58:42.800869+0000","last_active":"2024-08-27T03:58:42.800869+0000","last_peered":"2024-08-27T03:58:42.800869+0000","last_clean":"2024-08-27T03:58:42.800869+0000","last_became_active":"2024-08-27T02:31:04.481780+0000","last_became_peered":"2024-08-27T02:31:04.481780+0000","last_unstale":"2024-08-27T03:58:42.800869+0000","last_undegraded":"2024-08-27T03:58:42.800869+0000","last_fullsized":"2024-08-27T03:58:42.800869+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-08-27T03:58:42.800622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.800622+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:33:49.686872+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":48183,"num_write":1083,"num_write_kb":37438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'442","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.120348+0000","last_change":"2024-08-27T03:58:48.120033+0000","last_active":"2024-08-27T03:58:48.120348+0000","last_peered":"2024-08-27T03:58:48.120348+0000","last_clean":"2024-08-27T03:58:48.120348+0000","last_became_active":"2024-08-27T02:31:06.449514+0000","last_became_peered":"2024-08-27T02:31:06.449514+0000","last_unstale":"2024-08-27T03:58:48.120348+0000","last_undegraded":"2024-08-27T03:58:48.120348+0000","last_fullsized":"2024-08-27T03:58:48.120348+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-08-27T03:58:48.119733+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.119733+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:41:29.430226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2451,"num_read_kb":2287,"num_write":567,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3054,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'381","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:38.564535+0000","last_change":"2024-08-27T03:58:38.564535+0000","last_active":"2024-08-27T03:58:38.564535+0000","last_peered":"2024-08-27T03:58:38.564535+0000","last_clean":"2024-08-27T03:58:38.564535+0000","last_became_active":"2024-08-27T02:31:04.477132+0000","last_became_peered":"2024-08-27T02:31:04.477132+0000","last_unstale":"2024-08-27T03:58:38.564535+0000","last_undegraded":"2024-08-27T03:58:38.564535+0000","last_fullsized":"2024-08-27T03:58:38.564535+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-08-27T03:58:38.564446+0000","last_clean_scrub_stamp":"2024-08-27T03:58:38.564446+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:38:04.060769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4832339,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":9918,"num_write":1168,"num_write_kb":31853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'478","reported_seq":2162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.793519+0000","last_change":"2024-08-27T03:58:52.793519+0000","last_active":"2024-08-27T03:58:52.793519+0000","last_peered":"2024-08-27T03:58:52.793519+0000","last_clean":"2024-08-27T03:58:52.793519+0000","last_became_active":"2024-08-27T02:31:06.448747+0000","last_became_peered":"2024-08-27T02:31:06.448747+0000","last_unstale":"2024-08-27T03:58:52.793519+0000","last_undegraded":"2024-08-27T03:58:52.793519+0000","last_fullsized":"2024-08-27T03:58:52.793519+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'478","last_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_deep_scrub":"267'478","last_deep_scrub_stamp":"2024-08-27T03:58:52.793225+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.793225+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:15:04.836952+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2634,"num_read_kb":2488,"num_write":549,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'405","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.611678+0000","last_change":"2024-08-27T03:58:41.611512+0000","last_active":"2024-08-27T03:58:41.611678+0000","last_peered":"2024-08-27T03:58:41.611678+0000","last_clean":"2024-08-27T03:58:41.611678+0000","last_became_active":"2024-08-27T02:31:38.748772+0000","last_became_peered":"2024-08-27T02:31:38.748772+0000","last_unstale":"2024-08-27T03:58:41.611678+0000","last_undegraded":"2024-08-27T03:58:41.611678+0000","last_fullsized":"2024-08-27T03:58:41.611678+0000","mapping_epoch":38,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-08-27T03:58:41.611152+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.611152+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:35:19.609163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":15883,"num_write":1180,"num_write_kb":23453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"267'572","reported_seq":2157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:49.069998+0000","last_change":"2024-08-27T03:58:49.069728+0000","last_active":"2024-08-27T03:58:49.069998+0000","last_peered":"2024-08-27T03:58:49.069998+0000","last_clean":"2024-08-27T03:58:49.069998+0000","last_became_active":"2024-08-27T02:31:06.443102+0000","last_became_peered":"2024-08-27T02:31:06.443102+0000","last_unstale":"2024-08-27T03:58:49.069998+0000","last_undegraded":"2024-08-27T03:58:49.069998+0000","last_fullsized":"2024-08-27T03:58:49.069998+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'572","last_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_deep_scrub":"267'572","last_deep_scrub_stamp":"2024-08-27T03:58:49.069503+0000","last_clean_scrub_stamp":"2024-08-27T03:58:49.069503+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:29:30.858578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2855,"num_read_kb":2613,"num_write":727,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'308","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:41.438198+0000","last_change":"2024-08-27T03:58:41.438047+0000","last_active":"2024-08-27T03:58:41.438198+0000","last_peered":"2024-08-27T03:58:41.438198+0000","last_clean":"2024-08-27T03:58:41.438198+0000","last_became_active":"2024-08-27T02:31:04.456576+0000","last_became_peered":"2024-08-27T02:31:04.456576+0000","last_unstale":"2024-08-27T03:58:41.438198+0000","last_undegraded":"2024-08-27T03:58:41.438198+0000","last_fullsized":"2024-08-27T03:58:41.438198+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:41.437794+0000","last_clean_scrub_stamp":"2024-08-27T03:58:41.437794+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:06.786909+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400040,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":27259,"num_write":1007,"num_write_kb":28964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'609","reported_seq":2176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.308907+0000","last_change":"2024-08-27T03:58:55.308752+0000","last_active":"2024-08-27T03:58:55.308907+0000","last_peered":"2024-08-27T03:58:55.308907+0000","last_clean":"2024-08-27T03:58:55.308907+0000","last_became_active":"2024-08-27T02:31:06.461203+0000","last_became_peered":"2024-08-27T02:31:06.461203+0000","last_unstale":"2024-08-27T03:58:55.308907+0000","last_undegraded":"2024-08-27T03:58:55.308907+0000","last_fullsized":"2024-08-27T03:58:55.308907+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'609","last_scrub_stamp":"2024-08-27T03:58:55.308542+0000","last_deep_scrub":"267'609","last_deep_scrub_stamp":"2024-08-27T03:58:55.308542+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.308542+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:15:31.633356+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3030,"num_read_kb":2734,"num_write":796,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'362","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.146828+0000","last_change":"2024-08-27T03:58:43.146680+0000","last_active":"2024-08-27T03:58:43.146828+0000","last_peered":"2024-08-27T03:58:43.146828+0000","last_clean":"2024-08-27T03:58:43.146828+0000","last_became_active":"2024-08-27T02:31:04.475397+0000","last_became_peered":"2024-08-27T02:31:04.475397+0000","last_unstale":"2024-08-27T03:58:43.146828+0000","last_undegraded":"2024-08-27T03:58:43.146828+0000","last_fullsized":"2024-08-27T03:58:43.146828+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:43.146441+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.146441+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:58:04.187894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589954,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":45255,"num_write":1058,"num_write_kb":41997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'439","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:51.642061+0000","last_change":"2024-08-27T03:58:51.642061+0000","last_active":"2024-08-27T03:58:51.642061+0000","last_peered":"2024-08-27T03:58:51.642061+0000","last_clean":"2024-08-27T03:58:51.642061+0000","last_became_active":"2024-08-27T02:31:06.460468+0000","last_became_peered":"2024-08-27T02:31:06.460468+0000","last_unstale":"2024-08-27T03:58:51.642061+0000","last_undegraded":"2024-08-27T03:58:51.642061+0000","last_fullsized":"2024-08-27T03:58:51.642061+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-08-27T03:58:51.641812+0000","last_clean_scrub_stamp":"2024-08-27T03:58:51.641812+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:17:39.903323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2466,"num_read_kb":2349,"num_write":494,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'354","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.112468+0000","last_change":"2024-08-27T03:58:40.112270+0000","last_active":"2024-08-27T03:58:40.112468+0000","last_peered":"2024-08-27T03:58:40.112468+0000","last_clean":"2024-08-27T03:58:40.112468+0000","last_became_active":"2024-08-27T02:31:04.468966+0000","last_became_peered":"2024-08-27T02:31:04.468966+0000","last_unstale":"2024-08-27T03:58:40.112468+0000","last_undegraded":"2024-08-27T03:58:40.112468+0000","last_fullsized":"2024-08-27T03:58:40.112468+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-08-27T03:58:40.112024+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.112024+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:55:42.841093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109517,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":604,"num_read_kb":26119,"num_write":1309,"num_write_kb":12017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'576","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:56.310387+0000","last_change":"2024-08-27T03:58:56.310387+0000","last_active":"2024-08-27T03:58:56.310387+0000","last_peered":"2024-08-27T03:58:56.310387+0000","last_clean":"2024-08-27T03:58:56.310387+0000","last_became_active":"2024-08-27T02:31:06.446644+0000","last_became_peered":"2024-08-27T02:31:06.446644+0000","last_unstale":"2024-08-27T03:58:56.310387+0000","last_undegraded":"2024-08-27T03:58:56.310387+0000","last_fullsized":"2024-08-27T03:58:56.310387+0000","mapping_epoch":27,"log_start":"267'500","ondisk_log_start":"267'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'576","last_scrub_stamp":"2024-08-27T03:58:56.310189+0000","last_deep_scrub":"267'576","last_deep_scrub_stamp":"2024-08-27T03:58:56.310189+0000","last_clean_scrub_stamp":"2024-08-27T03:58:56.310189+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:06:08.825046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3401,"num_read_kb":3210,"num_write":726,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2552,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'308","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:39.582428+0000","last_change":"2024-08-27T03:58:39.582428+0000","last_active":"2024-08-27T03:58:39.582428+0000","last_peered":"2024-08-27T03:58:39.582428+0000","last_clean":"2024-08-27T03:58:39.582428+0000","last_became_active":"2024-08-27T02:31:40.467777+0000","last_became_peered":"2024-08-27T02:31:40.467777+0000","last_unstale":"2024-08-27T03:58:39.582428+0000","last_undegraded":"2024-08-27T03:58:39.582428+0000","last_fullsized":"2024-08-27T03:58:39.582428+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-08-27T03:58:39.582204+0000","last_clean_scrub_stamp":"2024-08-27T03:58:39.582204+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:55:21.476541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307067,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":545,"num_read_kb":100247,"num_write":1030,"num_write_kb":44353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,5],"acting":[2,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'454","reported_seq":1955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:48.736038+0000","last_change":"2024-08-27T03:58:48.736038+0000","last_active":"2024-08-27T03:58:48.736038+0000","last_peered":"2024-08-27T03:58:48.736038+0000","last_clean":"2024-08-27T03:58:48.736038+0000","last_became_active":"2024-08-27T02:31:06.468982+0000","last_became_peered":"2024-08-27T02:31:06.468982+0000","last_unstale":"2024-08-27T03:58:48.736038+0000","last_undegraded":"2024-08-27T03:58:48.736038+0000","last_fullsized":"2024-08-27T03:58:48.736038+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-08-27T03:58:48.735856+0000","last_clean_scrub_stamp":"2024-08-27T03:58:48.735856+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:12:29.368472+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2359,"num_read_kb":2194,"num_write":556,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2019,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'357","reported_seq":1061,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.173372+0000","last_change":"2024-08-27T03:58:44.173217+0000","last_active":"2024-08-27T03:58:44.173372+0000","last_peered":"2024-08-27T03:58:44.173372+0000","last_clean":"2024-08-27T03:58:44.173372+0000","last_became_active":"2024-08-27T02:31:04.455230+0000","last_became_peered":"2024-08-27T02:31:04.455230+0000","last_unstale":"2024-08-27T03:58:44.173372+0000","last_undegraded":"2024-08-27T03:58:44.173372+0000","last_fullsized":"2024-08-27T03:58:44.173372+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-08-27T03:58:44.172971+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.172971+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:49:58.313423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":565,"num_read_kb":99962,"num_write":1217,"num_write_kb":58744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'362","reported_seq":1858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:50.516484+0000","last_change":"2024-08-27T03:58:50.516342+0000","last_active":"2024-08-27T03:58:50.516484+0000","last_peered":"2024-08-27T03:58:50.516484+0000","last_clean":"2024-08-27T03:58:50.516484+0000","last_became_active":"2024-08-27T02:31:06.461638+0000","last_became_peered":"2024-08-27T02:31:06.461638+0000","last_unstale":"2024-08-27T03:58:50.516484+0000","last_undegraded":"2024-08-27T03:58:50.516484+0000","last_fullsized":"2024-08-27T03:58:50.516484+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-08-27T03:58:50.516132+0000","last_clean_scrub_stamp":"2024-08-27T03:58:50.516132+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T09:22:42.736992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2066,"num_read_kb":1973,"num_write":402,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'281","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:43.755250+0000","last_change":"2024-08-27T03:58:43.755250+0000","last_active":"2024-08-27T03:58:43.755250+0000","last_peered":"2024-08-27T03:58:43.755250+0000","last_clean":"2024-08-27T03:58:43.755250+0000","last_became_active":"2024-08-27T02:31:04.445096+0000","last_became_peered":"2024-08-27T02:31:04.445096+0000","last_unstale":"2024-08-27T03:58:43.755250+0000","last_undegraded":"2024-08-27T03:58:43.755250+0000","last_fullsized":"2024-08-27T03:58:43.755250+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'281","last_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_deep_scrub":"267'281","last_deep_scrub_stamp":"2024-08-27T03:58:43.755021+0000","last_clean_scrub_stamp":"2024-08-27T03:58:43.755021+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T15:17:25.889381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":397,"num_read_kb":6749,"num_write":934,"num_write_kb":13196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'640","reported_seq":2337,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.655549+0000","last_change":"2024-08-27T03:58:53.655397+0000","last_active":"2024-08-27T03:58:53.655549+0000","last_peered":"2024-08-27T03:58:53.655549+0000","last_clean":"2024-08-27T03:58:53.655549+0000","last_became_active":"2024-08-27T02:31:06.454916+0000","last_became_peered":"2024-08-27T02:31:06.454916+0000","last_unstale":"2024-08-27T03:58:53.655549+0000","last_undegraded":"2024-08-27T03:58:53.655549+0000","last_fullsized":"2024-08-27T03:58:53.655549+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'640","last_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_deep_scrub":"267'640","last_deep_scrub_stamp":"2024-08-27T03:58:53.655199+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.655199+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:10:17.157916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3290,"num_read_kb":3057,"num_write":854,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.138975+0000","last_change":"2024-08-27T03:58:46.138796+0000","last_active":"2024-08-27T03:58:46.138975+0000","last_peered":"2024-08-27T03:58:46.138975+0000","last_clean":"2024-08-27T03:58:46.138975+0000","last_became_active":"2024-08-27T02:31:04.455225+0000","last_became_peered":"2024-08-27T02:31:04.455225+0000","last_unstale":"2024-08-27T03:58:46.138975+0000","last_undegraded":"2024-08-27T03:58:46.138975+0000","last_fullsized":"2024-08-27T03:58:46.138975+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-08-27T03:58:46.138421+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.138421+0000","objects_scrubbed":14,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:00:21.270930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2798159,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":560,"num_read_kb":2754,"num_write":1269,"num_write_kb":31486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'438","reported_seq":1962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.558722+0000","last_change":"2024-08-27T03:58:44.558545+0000","last_active":"2024-08-27T03:58:44.558722+0000","last_peered":"2024-08-27T03:58:44.558722+0000","last_clean":"2024-08-27T03:58:44.558722+0000","last_became_active":"2024-08-27T02:31:06.468834+0000","last_became_peered":"2024-08-27T02:31:06.468834+0000","last_unstale":"2024-08-27T03:58:44.558722+0000","last_undegraded":"2024-08-27T03:58:44.558722+0000","last_fullsized":"2024-08-27T03:58:44.558722+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-08-27T03:58:44.558365+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.558365+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:06:32.373887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2246,"num_read_kb":2116,"num_write":510,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'313","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.746753+0000","last_change":"2024-08-27T03:58:42.746489+0000","last_active":"2024-08-27T03:58:42.746753+0000","last_peered":"2024-08-27T03:58:42.746753+0000","last_clean":"2024-08-27T03:58:42.746753+0000","last_became_active":"2024-08-27T02:31:04.474031+0000","last_became_peered":"2024-08-27T02:31:04.474031+0000","last_unstale":"2024-08-27T03:58:42.746753+0000","last_undegraded":"2024-08-27T03:58:42.746753+0000","last_fullsized":"2024-08-27T03:58:42.746753+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'313","last_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_deep_scrub":"267'313","last_deep_scrub_stamp":"2024-08-27T03:58:42.746119+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.746119+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:28:53.493047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":2564,"num_write":1048,"num_write_kb":23477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'614","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.680745+0000","last_change":"2024-08-27T03:58:52.680599+0000","last_active":"2024-08-27T03:58:52.680745+0000","last_peered":"2024-08-27T03:58:52.680745+0000","last_clean":"2024-08-27T03:58:52.680745+0000","last_became_active":"2024-08-27T02:31:06.472429+0000","last_became_peered":"2024-08-27T02:31:06.472429+0000","last_unstale":"2024-08-27T03:58:52.680745+0000","last_undegraded":"2024-08-27T03:58:52.680745+0000","last_fullsized":"2024-08-27T03:58:52.680745+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'614","last_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_deep_scrub":"267'614","last_deep_scrub_stamp":"2024-08-27T03:58:52.680388+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.680388+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T07:01:22.858376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3100,"num_write":779,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3063,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'316","reported_seq":1135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.392992+0000","last_change":"2024-08-27T03:58:42.392831+0000","last_active":"2024-08-27T03:58:42.392992+0000","last_peered":"2024-08-27T03:58:42.392992+0000","last_clean":"2024-08-27T03:58:42.392992+0000","last_became_active":"2024-08-27T02:31:04.466519+0000","last_became_peered":"2024-08-27T02:31:04.466519+0000","last_unstale":"2024-08-27T03:58:42.392992+0000","last_undegraded":"2024-08-27T03:58:42.392992+0000","last_fullsized":"2024-08-27T03:58:42.392992+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-08-27T03:58:42.392600+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.392600+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:08:02.371839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":686594,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":824,"num_read_kb":79613,"num_write":1033,"num_write_kb":38309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'505","reported_seq":2138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:52.928880+0000","last_change":"2024-08-27T03:58:52.928741+0000","last_active":"2024-08-27T03:58:52.928880+0000","last_peered":"2024-08-27T03:58:52.928880+0000","last_clean":"2024-08-27T03:58:52.928880+0000","last_became_active":"2024-08-27T02:31:06.452707+0000","last_became_peered":"2024-08-27T02:31:06.452707+0000","last_unstale":"2024-08-27T03:58:52.928880+0000","last_undegraded":"2024-08-27T03:58:52.928880+0000","last_fullsized":"2024-08-27T03:58:52.928880+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'505","last_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_deep_scrub":"267'505","last_deep_scrub_stamp":"2024-08-27T03:58:52.928533+0000","last_clean_scrub_stamp":"2024-08-27T03:58:52.928533+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:48:07.897474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2762,"num_read_kb":2591,"num_write":632,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'307","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:40.809517+0000","last_change":"2024-08-27T03:58:40.809278+0000","last_active":"2024-08-27T03:58:40.809517+0000","last_peered":"2024-08-27T03:58:40.809517+0000","last_clean":"2024-08-27T03:58:40.809517+0000","last_became_active":"2024-08-27T02:31:04.492863+0000","last_became_peered":"2024-08-27T02:31:04.492863+0000","last_unstale":"2024-08-27T03:58:40.809517+0000","last_undegraded":"2024-08-27T03:58:40.809517+0000","last_fullsized":"2024-08-27T03:58:40.809517+0000","mapping_epoch":25,"log_start":"267'200","ondisk_log_start":"267'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-08-27T03:58:40.808995+0000","last_clean_scrub_stamp":"2024-08-27T03:58:40.808995+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T04:03:10.468667+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911567,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":603,"num_read_kb":25477,"num_write":981,"num_write_kb":22885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'803","reported_seq":2706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:53.528961+0000","last_change":"2024-08-27T03:58:53.528826+0000","last_active":"2024-08-27T03:58:53.528961+0000","last_peered":"2024-08-27T03:58:53.528961+0000","last_clean":"2024-08-27T03:58:53.528961+0000","last_became_active":"2024-08-27T02:31:06.446373+0000","last_became_peered":"2024-08-27T02:31:06.446373+0000","last_unstale":"2024-08-27T03:58:53.528961+0000","last_undegraded":"2024-08-27T03:58:53.528961+0000","last_fullsized":"2024-08-27T03:58:53.528961+0000","mapping_epoch":27,"log_start":"267'700","ondisk_log_start":"267'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'803","last_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_deep_scrub":"267'803","last_deep_scrub_stamp":"2024-08-27T03:58:53.528622+0000","last_clean_scrub_stamp":"2024-08-27T03:58:53.528622+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:11:57.111154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4316,"num_read_kb":3907,"num_write":1149,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'311","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:46.903956+0000","last_change":"2024-08-27T03:58:46.903809+0000","last_active":"2024-08-27T03:58:46.903956+0000","last_peered":"2024-08-27T03:58:46.903956+0000","last_clean":"2024-08-27T03:58:46.903956+0000","last_became_active":"2024-08-27T02:31:04.489685+0000","last_became_peered":"2024-08-27T02:31:04.489685+0000","last_unstale":"2024-08-27T03:58:46.903956+0000","last_undegraded":"2024-08-27T03:58:46.903956+0000","last_fullsized":"2024-08-27T03:58:46.903956+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-08-27T03:58:46.903570+0000","last_clean_scrub_stamp":"2024-08-27T03:58:46.903570+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T06:32:09.302081+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311643,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":75812,"num_write":989,"num_write_kb":62636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'418","reported_seq":1907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:59.297174+0000","last_change":"2024-08-27T03:58:59.297174+0000","last_active":"2024-08-27T03:58:59.297174+0000","last_peered":"2024-08-27T03:58:59.297174+0000","last_clean":"2024-08-27T03:58:59.297174+0000","last_became_active":"2024-08-27T02:31:06.459208+0000","last_became_peered":"2024-08-27T02:31:06.459208+0000","last_unstale":"2024-08-27T03:58:59.297174+0000","last_undegraded":"2024-08-27T03:58:59.297174+0000","last_fullsized":"2024-08-27T03:58:59.297174+0000","mapping_epoch":27,"log_start":"267'400","ondisk_log_start":"267'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'418","last_scrub_stamp":"2024-08-27T03:58:59.296967+0000","last_deep_scrub":"267'418","last_deep_scrub_stamp":"2024-08-27T03:58:59.296967+0000","last_clean_scrub_stamp":"2024-08-27T03:58:59.296967+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T11:16:42.487638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2221,"num_read_kb":2080,"num_write":494,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'422","reported_seq":1350,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.595235+0000","last_change":"2024-08-27T03:58:42.595085+0000","last_active":"2024-08-27T03:58:42.595235+0000","last_peered":"2024-08-27T03:58:42.595235+0000","last_clean":"2024-08-27T03:58:42.595235+0000","last_became_active":"2024-08-27T02:31:04.477148+0000","last_became_peered":"2024-08-27T02:31:04.477148+0000","last_unstale":"2024-08-27T03:58:42.595235+0000","last_undegraded":"2024-08-27T03:58:42.595235+0000","last_fullsized":"2024-08-27T03:58:42.595235+0000","mapping_epoch":25,"log_start":"267'400","ondisk_log_start":"267'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-08-27T03:58:42.594805+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.594805+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T14:14:16.906357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1005,"num_read_kb":143555,"num_write":1198,"num_write_kb":32807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'387","reported_seq":1799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.901866+0000","last_change":"2024-08-27T03:58:45.901866+0000","last_active":"2024-08-27T03:58:45.901866+0000","last_peered":"2024-08-27T03:58:45.901866+0000","last_clean":"2024-08-27T03:58:45.901866+0000","last_became_active":"2024-08-27T02:31:06.447407+0000","last_became_peered":"2024-08-27T02:31:06.447407+0000","last_unstale":"2024-08-27T03:58:45.901866+0000","last_undegraded":"2024-08-27T03:58:45.901866+0000","last_fullsized":"2024-08-27T03:58:45.901866+0000","mapping_epoch":27,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-08-27T03:58:45.901684+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.901684+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T05:11:59.846712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1976,"num_read_kb":1870,"num_write":445,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'359","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:44.750033+0000","last_change":"2024-08-27T03:58:44.749864+0000","last_active":"2024-08-27T03:58:44.750033+0000","last_peered":"2024-08-27T03:58:44.750033+0000","last_clean":"2024-08-27T03:58:44.750033+0000","last_became_active":"2024-08-27T02:31:04.468007+0000","last_became_peered":"2024-08-27T02:31:04.468007+0000","last_unstale":"2024-08-27T03:58:44.750033+0000","last_undegraded":"2024-08-27T03:58:44.750033+0000","last_fullsized":"2024-08-27T03:58:44.750033+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'359","last_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_deep_scrub":"267'359","last_deep_scrub_stamp":"2024-08-27T03:58:44.749636+0000","last_clean_scrub_stamp":"2024-08-27T03:58:44.749636+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T10:02:42.137274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":596,"num_read_kb":11844,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'342","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:45.755262+0000","last_change":"2024-08-27T03:58:45.754972+0000","last_active":"2024-08-27T03:58:45.755262+0000","last_peered":"2024-08-27T03:58:45.755262+0000","last_clean":"2024-08-27T03:58:45.755262+0000","last_became_active":"2024-08-27T02:31:04.469532+0000","last_became_peered":"2024-08-27T02:31:04.469532+0000","last_unstale":"2024-08-27T03:58:45.755262+0000","last_undegraded":"2024-08-27T03:58:45.755262+0000","last_fullsized":"2024-08-27T03:58:45.755262+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:45.754732+0000","last_clean_scrub_stamp":"2024-08-27T03:58:45.754732+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:52:10.198393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":4948,"num_write":1064,"num_write_kb":24400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'382","reported_seq":2040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:55.532613+0000","last_change":"2024-08-27T03:58:55.532613+0000","last_active":"2024-08-27T03:58:55.532613+0000","last_peered":"2024-08-27T03:58:55.532613+0000","last_clean":"2024-08-27T03:58:55.532613+0000","last_became_active":"2024-08-27T02:31:39.752823+0000","last_became_peered":"2024-08-27T02:31:39.752823+0000","last_unstale":"2024-08-27T03:58:55.532613+0000","last_undegraded":"2024-08-27T03:58:55.532613+0000","last_fullsized":"2024-08-27T03:58:55.532613+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":27,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-08-27T03:58:55.532420+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-08-27T03:58:55.532420+0000","last_clean_scrub_stamp":"2024-08-27T03:58:55.532420+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T08:42:31.047679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2209,"num_write":408,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'342","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:42.113677+0000","last_change":"2024-08-27T03:58:42.113500+0000","last_active":"2024-08-27T03:58:42.113677+0000","last_peered":"2024-08-27T03:58:42.113677+0000","last_clean":"2024-08-27T03:58:42.113677+0000","last_became_active":"2024-08-27T02:31:04.468363+0000","last_became_peered":"2024-08-27T02:31:04.468363+0000","last_unstale":"2024-08-27T03:58:42.113677+0000","last_undegraded":"2024-08-27T03:58:42.113677+0000","last_fullsized":"2024-08-27T03:58:42.113677+0000","mapping_epoch":25,"log_start":"267'300","ondisk_log_start":"267'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-08-27T03:58:42.113238+0000","last_clean_scrub_stamp":"2024-08-27T03:58:42.113238+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T13:58:33.105083+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381353,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":621,"num_read_kb":18083,"num_write":1130,"num_write_kb":33715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'698","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-08-27T03:58:54.823347+0000","last_change":"2024-08-27T03:58:54.823347+0000","last_active":"2024-08-27T03:58:54.823347+0000","last_peered":"2024-08-27T03:58:54.823347+0000","last_clean":"2024-08-27T03:58:54.823347+0000","last_became_active":"2024-08-27T02:31:06.440572+0000","last_became_peered":"2024-08-27T02:31:06.440572+0000","last_unstale":"2024-08-27T03:58:54.823347+0000","last_undegraded":"2024-08-27T03:58:54.823347+0000","last_fullsized":"2024-08-27T03:58:54.823347+0000","mapping_epoch":27,"log_start":"267'600","ondisk_log_start":"267'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'698","last_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_deep_scrub":"267'698","last_deep_scrub_stamp":"2024-08-27T03:58:54.823157+0000","last_clean_scrub_stamp":"2024-08-27T03:58:54.823157+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-28T12:51:42.227530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3318,"num_read_kb":3010,"num_write":932,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6086,"num_read_kb":4296,"num_write":1969,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3485,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1042,"ondisk_log_size":1042,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":14759,"num_read_kb":14440,"num_write":16551,"num_write_kb":4836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1585,"ondisk_log_size":1585,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":461,"ondisk_log_size":461,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1439020,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19446,"num_read_kb":39405,"num_write":16215,"num_write_kb":11798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677494,"num_omap_keys":1546,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2134,"num_read_kb":2542,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":209423,"num_read_kb":191660,"num_write":54080,"num_write_kb":18441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44329,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4105,"ondisk_log_size":4105,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65339946,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":35598,"num_read_kb":1916438,"num_write":70403,"num_write_kb":2054304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89604096,"data_stored":89604096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3354,"ondisk_log_size":3354,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":208074,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":198799,"num_write":161,"num_write_kb":140423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424510512,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192136,"kb_used_data":12472,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94179704,"statfs":{"total":96636764160,"available":96440016896,"internally_reserved":0,"allocated":12771328,"data_stored":10781565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543221,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339224,"kb_used_data":15112,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94032616,"statfs":{"total":96636764160,"available":96289398784,"internally_reserved":0,"allocated":15474688,"data_stored":13471118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543222,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305116,"kb_used_data":17100,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94066724,"statfs":{"total":96636764160,"available":96324325376,"internally_reserved":0,"allocated":17510400,"data_stored":15551496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543219,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162756,"kb_used_data":15028,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94209084,"statfs":{"total":96636764160,"available":96470102016,"internally_reserved":0,"allocated":15388672,"data_stored":13349611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543218,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134208,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94237632,"statfs":{"total":96636764160,"available":96499335168,"internally_reserved":0,"allocated":17350656,"data_stored":15406568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543220,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293612,"kb_used_data":13916,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94078228,"statfs":{"total":96636764160,"available":96336105472,"internally_reserved":0,"allocated":14249984,"data_stored":12236496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543222,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113428,"kb_used_data":14212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94258412,"statfs":{"total":96636764160,"available":96520613888,"internally_reserved":0,"allocated":14553088,"data_stored":12591031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543220,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301160,"kb_used_data":17368,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94070680,"statfs":{"total":96636764160,"available":96328376320,"internally_reserved":0,"allocated":17784832,"data_stored":15748401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":12861440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8486912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10297344,"data_stored":10297344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9940992,"data_stored":9940992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13115392,"data_stored":13115392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11055104,"data_stored":11055104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13258752,"data_stored":13258752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10588160,"data_stored":10588160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":7071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-27T04:00:00.395 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-27T04:00:00.755 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-27T04:00:00.755 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-27T04:00:00.755 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-27T04:00:00.755 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:06.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-08-27T04:00:06.859 INFO:tasks.ceph.osd.0:Stopped 2024-08-27T04:00:06.859 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-27T04:00:06.860 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:06.947 INFO:tasks.ceph.osd.1:Stopped 2024-08-27T04:00:06.948 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-27T04:00:06.948 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:12.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-08-27T04:00:12.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-08-27T04:00:13.049 INFO:tasks.ceph.osd.2:Stopped 2024-08-27T04:00:13.050 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-27T04:00:13.050 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:13.144 INFO:tasks.ceph.osd.3:Stopped 2024-08-27T04:00:13.144 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-27T04:00:13.144 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:13.239 INFO:tasks.ceph.osd.4:Stopped 2024-08-27T04:00:13.239 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-27T04:00:13.240 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:18.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-08-27T04:00:18.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-08-27T04:00:19.343 INFO:tasks.ceph.osd.5:Stopped 2024-08-27T04:00:19.344 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-27T04:00:19.344 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:19.414 INFO:tasks.ceph.osd.6:Stopped 2024-08-27T04:00:19.414 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-27T04:00:19.414 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:24.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-08-27T04:00:24.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-08-27T04:00:25.516 INFO:tasks.ceph.osd.7:Stopped 2024-08-27T04:00:25.516 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-27T04:00:25.517 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-27T04:00:25.517 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:25.547 INFO:tasks.ceph.mgr.y:Stopped 2024-08-27T04:00:25.547 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-27T04:00:25.547 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:25.579 INFO:tasks.ceph.mgr.x:Stopped 2024-08-27T04:00:25.579 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-27T04:00:25.579 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-27T04:00:25.580 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:25.622 INFO:tasks.ceph.mon.a:Stopped 2024-08-27T04:00:25.622 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-27T04:00:25.622 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:25.688 INFO:tasks.ceph.mon.c:Stopped 2024-08-27T04:00:25.689 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-27T04:00:25.689 INFO:teuthology.orchestra.run:waiting for 300 2024-08-27T04:00:25.718 INFO:tasks.ceph.mon.b:Stopped 2024-08-27T04:00:25.718 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-27T04:00:25.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-08-27T04:00:25.750 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T04:00:25.750 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-27T04:00:25.999 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T04:00:25.999 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-27T04:00:26.288 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T04:00:26.288 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-27T04:00:26.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T04:00:26.457 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-27T04:00:26.652 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T04:00:26.652 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-27T04:00:26.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T04:00:26.977 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-27T04:00:27.152 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T04:00:27.152 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-27T04:00:27.312 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T04:00:27.312 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-27T04:00:27.475 INFO:tasks.ceph:Archiving mon data... 2024-08-27T04:00:27.476 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/data/mon.a.tgz 2024-08-27T04:00:27.477 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-08-27T04:00:27.486 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.Ls9c5PhtCP 2024-08-27T04:00:27.486 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ls9c5PhtCP 2024-08-27T04:00:27.660 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.Ls9c5PhtCP 2024-08-27T04:00:27.724 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.Ls9c5PhtCP is 529KB 2024-08-27T04:00:27.786 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.Ls9c5PhtCP 2024-08-27T04:00:27.793 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/data/mon.c.tgz 2024-08-27T04:00:27.793 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-08-27T04:00:27.845 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.g4D5hcOt2Z 2024-08-27T04:00:27.845 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.g4D5hcOt2Z 2024-08-27T04:00:28.034 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.g4D5hcOt2Z 2024-08-27T04:00:28.096 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.g4D5hcOt2Z is 550KB 2024-08-27T04:00:28.158 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.g4D5hcOt2Z 2024-08-27T04:00:28.164 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/data/mon.b.tgz 2024-08-27T04:00:28.164 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-08-27T04:00:28.170 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.mwlcf4JIB9 2024-08-27T04:00:28.171 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mwlcf4JIB9 2024-08-27T04:00:28.361 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.mwlcf4JIB9 2024-08-27T04:00:28.427 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.mwlcf4JIB9 is 550KB 2024-08-27T04:00:28.489 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.mwlcf4JIB9 2024-08-27T04:00:28.494 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-27T04:00:28.494 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-27T04:00:28.498 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-27T04:00:28.618 DEBUG:tasks.ceph:valgrind exception message: valgrind error: UninitCondition RGWSelectObj_ObjStore_S3::run_s3select_on_csv(char const*, char const*, unsigned long) RGWSelectObj_ObjStore_S3::csv_processing(ceph::buffer::v15_2_0::list&, long, long) RGWGetObj_Decompress::handle_data(ceph::buffer::v15_2_0::list&, long, long) 2024-08-27T04:00:28.624 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-27T04:00:28.624 INFO:tasks.ceph:Archiving crash dumps... 2024-08-27T04:00:28.626 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/remote/smithi143/crash 2024-08-27T04:00:28.627 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-27T04:00:28.642 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/remote/smithi181/crash 2024-08-27T04:00:28.643 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-27T04:00:28.679 INFO:tasks.ceph:Compressing logs... 2024-08-27T04:00:28.680 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-27T04:00:28.689 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118673.log 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162858.log 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.118673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135806.log 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118673.log.gz 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41093.log 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162858.log.gz 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.135806.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.135806.log.gz 2024-08-27T04:00:28.715 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138216.log 2024-08-27T04:00:28.719 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137576.log 2024-08-27T04:00:28.719 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.138216.log: /var/log/ceph/ceph-client.admin.41093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32594.log 2024-08-27T04:00:28.719 INFO:teuthology.orchestra.run.smithi143.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.138216.log.gz 2024-08-27T04:00:28.719 INFO:teuthology.orchestra.run.smithi143.stderr:gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.125163.log 2024-08-27T04:00:28.719 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41093.log.gz 2024-08-27T04:00:28.719 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.137576.log: /var/log/ceph/ceph-client.admin.32594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137576.log.gz 2024-08-27T04:00:28.719 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134604.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32594.log.gz 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.125163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123393.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.134604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134604.log.gz 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95069.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.123393.log: /var/log/ceph/ceph-client.admin.32293.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.125163.log.gz 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.123393.log.gz 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.95069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93299.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.95069.log.gz 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67726.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:gzip/var/log/ceph/ceph-client.admin.93299.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.111592.log 2024-08-27T04:00:28.720 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.67726.log: gzip 82.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.93299.log.gz -- 2024-08-27T04:00:28.721 INFO:teuthology.orchestra.run.smithi143.stderr: /var/log/ceph/ceph-client.admin.65902.log 2024-08-27T04:00:28.723 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.111592.log: 84.9% -- replaced with /var/log/ceph/ceph-client.0.67726.log.gz 2024-08-27T04:00:28.723 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48273.log 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.111592.log.gz 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162909.log 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.65902.log: /var/log/ceph/ceph-client.admin.48273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165085.log 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.65902.log.gz 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162909.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.48273.log.gz 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162909.log.gz 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55496.log 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63251.log 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165085.log.gz 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:gzip/var/log/ceph/ceph-client.admin.55496.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.63251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164825.log 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.63251.log.gz 2024-08-27T04:00:28.724 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33279.log 2024-08-27T04:00:28.725 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164825.log.gz 2024-08-27T04:00:28.725 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51273.log 2024-08-27T04:00:28.725 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64720.log 2024-08-27T04:00:28.725 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.33279.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.33279.log.gz 2024-08-27T04:00:28.725 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58724.log 2024-08-27T04:00:28.729 INFO:teuthology.orchestra.run.smithi143.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51273.log.gz 2024-08-27T04:00:28.729 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.64720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54330.log 2024-08-27T04:00:28.729 INFO:teuthology.orchestra.run.smithi143.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.64720.log.gz 2024-08-27T04:00:28.729 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-08-27T04:00:28.729 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.58724.log: /var/log/ceph/ceph-client.admin.54330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31887.log 2024-08-27T04:00:28.729 INFO:teuthology.orchestra.run.smithi143.stderr: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.54330.log.gz 2024-08-27T04:00:28.729 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142705.log 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32494.log 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31887.log: /var/log/ceph/ceph-client.admin.142705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31887.log.gz 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41143.log 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.142705.log.gz 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135216.log 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32494.log.gz 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.151755.log 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41143.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.58724.log.gz 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.135216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126343.log 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.41143.log.gz 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.151755.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135216.log.gz 2024-08-27T04:00:28.730 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85629.log 2024-08-27T04:00:28.731 INFO:teuthology.orchestra.run.smithi143.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.151755.log.gz 2024-08-27T04:00:28.731 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.126343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120443.log 2024-08-27T04:00:28.731 INFO:teuthology.orchestra.run.smithi143.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.126343.log.gz 2024-08-27T04:00:28.731 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.85629.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.85629.log.gz 2024-08-27T04:00:28.731 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140626.log 2024-08-27T04:00:28.731 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32334.log 2024-08-27T04:00:28.736 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.120443.log: /var/log/ceph/ceph-client.admin.140626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68372.log 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.120443.log.gz 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.140626.log.gz 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32334.log.gzgzip 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.128114.log 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.68372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157065.log 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr: 51.1% -- replaced with /var/log/ceph/ceph-client.admin.68372.log.gz 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.128114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125753.log 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.128114.log.gz 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.157065.log: /var/log/ceph/ceph-client.admin.125753.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.157065.log.gz 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31877.log 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.125753.log.gz 2024-08-27T04:00:28.737 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68411.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31877.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gz --verbose 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr: -- /var/log/ceph/ceph-client.admin.59369.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.68411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103332.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:gzip/var/log/ceph/ceph-client.admin.59369.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.90349.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.103332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31266.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103332.log.gz 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.90349.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.90349.log.gz 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165163.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.68411.log.gz 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164981.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59369.log.gz 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31266.log.gz 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158835.log 2024-08-27T04:00:28.738 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165163.log.gz 2024-08-27T04:00:28.739 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164981.log.gz 2024-08-27T04:00:28.739 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.150575.log 2024-08-27T04:00:28.739 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.55496.log.gz 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37379.log 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.158835.log: /var/log/ceph/ceph-client.0.150575.log: 84.2%gzip -- replaced with /var/log/ceph/ceph-client.0.158835.log.gz -5 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93889.log 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.150575.log.gz 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.37379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91529.log 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37379.log.gz 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.93889.log: /var/log/ceph/ceph-client.admin.77959.log 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.91529.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93889.log.gz 2024-08-27T04:00:28.744 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103922.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91529.log.gz 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62599.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.77959.log: /var/log/ceph/ceph-client.admin.103922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165267.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77959.log.gz 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103922.log.gz 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.62599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53093.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42323.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165267.log.gz 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165189.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.53093.log.gz 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164929.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165189.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.42323.log.gz 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2024-08-27T04:00:28.745 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165189.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164929.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164721.log 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53777.log 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50683.log: /var/log/ceph/ceph-client.admin.164721.log: 0.0%gzip -5 --verbose 85.6% -- /var/log/ceph/ceph-client.admin.47093.log -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164721.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67084.log 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr: 60.2% -- replaced with /var/log/ceph/ceph-client.admin.53777.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121033.log 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.67084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145764.log 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.62599.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.67084.log.gz 2024-08-27T04:00:28.746 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.121033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32086.log 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.145764.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.145764.log.gz 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113362.log 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32086.log.gz 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69698.log 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.113362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.155885.log 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121033.log.gz 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.69698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113362.log.gz 2024-08-27T04:00:28.753 INFO:teuthology.orchestra.run.smithi143.stderr: 83.0%/var/log/ceph/ceph-client.0.155885.log: -- replaced with /var/log/ceph/ceph-client.admin.69698.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149385.log 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.155885.log.gz 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129294.log 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.149385.log: /var/log/ceph/ceph-client.admin.129294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112772.log 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.129294.log.gz 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144586.log 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41118.log 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.112772.log: /var/log/ceph/ceph-client.admin.144586.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.112772.log.gz 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106282.log 2024-08-27T04:00:28.754 INFO:teuthology.orchestra.run.smithi143.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.149385.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145175.log 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.144586.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41118.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.106282.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.106282.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54907.log 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.145175.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.145175.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143997.log 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.54907.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72058.log 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.143997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32333.log 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.72058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39323.log 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32333.log: 89.3% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32333.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72058.log.gz 93.2% -- replaced with /var/log/ceph/ceph-client.admin.143997.log.gz 2024-08-27T04:00:28.755 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.756 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42913.log 2024-08-27T04:00:28.764 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26668.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26620.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26668.log.gz 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26764.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26644.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26620.log.gz 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26764.log.gz 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26644.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26644.log.gz 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26692.log 2024-08-27T04:00:28.765 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26692.log.gz 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26740.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26788.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26716.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26740.log.gz 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26788.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26788.log.gz 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.26716.log: /var/log/ceph/ceph.audit.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26716.log.gz 2024-08-27T04:00:28.766 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-27T04:00:28.770 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.39323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162220.log 2024-08-27T04:00:28.770 INFO:teuthology.orchestra.run.smithi143.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.39323.log.gz 2024-08-27T04:00:28.770 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35627.log 2024-08-27T04:00:28.770 INFO:teuthology.orchestra.run.smithi143.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42913.log.gz 2024-08-27T04:00:28.770 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75008.log 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162220.log: /var/log/ceph/ceph-client.0.35627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31610.log 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35627.log.gz/var/log/ceph/ceph-client.admin.75008.log: 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.162220.log.gz 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.151165.log 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.75008.log.gz 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116902.log 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31610.log.gz 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57433.log 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.151165.log: /var/log/ceph/ceph-client.admin.116902.log: 84.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60014.log 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.0.151165.log.gz 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.57433.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.116902.log.gz 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32104.log 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.57433.log.gz 2024-08-27T04:00:28.771 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.60014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162195.log 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51863.log 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32104.log.gz 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70288.log 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162195.log.gz 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51863.log.gz 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54848.log 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32286.log 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.70288.log: /var/log/ceph/ceph-client.admin.54848.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.70288.log.gz 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.54848.log.gz 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89759.log 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133424.log 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32286.log.gz 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.89759.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89759.log.gz 2024-08-27T04:00:28.772 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.152345.log 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127524.log 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.133424.log: /var/log/ceph/ceph-client.0.152345.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.133424.log.gz 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr: 84.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89169.log 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.0.152345.log.gz 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.127524.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.127524.log.gz 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131064.log 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32105.log 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.89169.log: /var/log/ceph/ceph-client.admin.131064.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.89169.log.gz 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr: 85.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.131064.log.gz 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54243.log 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32105.log.gz 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92119.log 2024-08-27T04:00:28.773 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32078.log 2024-08-27T04:00:28.774 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-27T04:00:28.777 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54243.log: /var/log/ceph/ceph-client.admin.92119.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54243.log.gz 2024-08-27T04:00:28.777 INFO:teuthology.orchestra.run.smithi143.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.92119.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32299.log 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32078.log.gz 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141524.log 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100972.log 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32299.log.gz 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.141524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.141524.log.gz 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.100972.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100972.log.gz 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162170.log 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96839.log 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162170.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73828.log 2024-08-27T04:00:28.778 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.779 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.96839.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.96839.log.gz 2024-08-27T04:00:28.779 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164747.log 2024-08-27T04:00:28.779 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32102.log 2024-08-27T04:00:28.779 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.73828.log: /var/log/ceph/ceph-client.admin.164747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164747.log.gz 81.8% 2024-08-27T04:00:28.779 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73828.log.gz 2024-08-27T04:00:28.779 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54353.log 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165215.log 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32102.log: /var/log/ceph/ceph-client.admin.54353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr: 92.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.54353.log.gz 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.86809.log 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165215.log.gz 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102742.log 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136396.log 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.86809.log: /var/log/ceph/ceph-client.admin.102742.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.86809.log.gz 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.102742.log.gz 2024-08-27T04:00:28.781 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159425.log 2024-08-27T04:00:28.782 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.136396.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.136396.log.gz 2024-08-27T04:00:28.782 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139421.log 2024-08-27T04:00:28.782 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36211.log 2024-08-27T04:00:28.783 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.159425.log: /var/log/ceph/ceph-client.admin.139421.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.159425.log.gz 2024-08-27T04:00:28.783 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139421.log.gz 2024-08-27T04:00:28.783 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82089.log 2024-08-27T04:00:28.784 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54873.log 2024-08-27T04:00:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.36211.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36211.log.gz 2024-08-27T04:00:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.82089.log: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.60014.log.gz 2024-08-27T04:00:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105692.log 2024-08-27T04:00:28.785 INFO:teuthology.orchestra.run.smithi143.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82089.log.gz 2024-08-27T04:00:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31490.log 2024-08-27T04:00:28.785 INFO:teuthology.orchestra.run.smithi143.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.54873.log.gz 2024-08-27T04:00:28.785 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140036.log 2024-08-27T04:00:28.787 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.105692.log: /var/log/ceph/ceph-client.admin.31490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31689.log 2024-08-27T04:00:28.787 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31490.log.gz 2024-08-27T04:00:28.787 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.140036.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.105692.log.gz 2024-08-27T04:00:28.787 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134014.log 2024-08-27T04:00:28.788 INFO:teuthology.orchestra.run.smithi143.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140036.log.gz 2024-08-27T04:00:28.788 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31868.log 2024-08-27T04:00:28.788 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31689.log.gz 2024-08-27T04:00:28.788 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.134014.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.134014.log.gz 2024-08-27T04:00:28.788 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34453.log 2024-08-27T04:00:28.793 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31868.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31868.log.gz -5 2024-08-27T04:00:28.793 INFO:teuthology.orchestra.run.smithi143.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99792.log 2024-08-27T04:00:28.793 INFO:teuthology.orchestra.run.smithi143.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-27T04:00:28.793 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.34453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128704.log 2024-08-27T04:00:28.793 INFO:teuthology.orchestra.run.smithi143.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34453.log.gz 2024-08-27T04:00:28.793 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.99792.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.99792.log.gz/var/log/ceph/ceph-client.admin.128704.log: 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165346.log 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164851.log 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160967.log 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165346.log.gz 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164851.log.gz 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.128704.log.gz 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.164127.log 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.160967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92709.log 2024-08-27T04:00:28.794 INFO:teuthology.orchestra.run.smithi143.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.160967.log.gz/var/log/ceph/ceph-client.0.164127.log: 2024-08-27T04:00:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122213.log 2024-08-27T04:00:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.92709.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92709.log.gz 2024-08-27T04:00:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31685.log 2024-08-27T04:00:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.122213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-08-27T04:00:28.795 INFO:teuthology.orchestra.run.smithi143.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.122213.log.gz 2024-08-27T04:00:28.795 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31685.log.gz 2024-08-27T04:00:28.798 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32666.log 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165319.log 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32666.log.gz 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124573.log 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52503.log 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165319.log.gz 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.124573.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.124573.log.gz 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31558.log 2024-08-27T04:00:28.799 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.52503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26741.log 2024-08-27T04:00:28.800 INFO:teuthology.orchestra.run.smithi143.stderr: 86.3%/var/log/ceph/ceph-client.admin.31558.log: -- replaced with /var/log/ceph/ceph-client.admin.52503.log.gz 2024-08-27T04:00:28.800 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31558.log.gz 2024-08-27T04:00:28.800 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136986.log 2024-08-27T04:00:28.800 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.26741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31690.log 2024-08-27T04:00:28.800 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26741.log.gz 2024-08-27T04:00:28.800 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.136986.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.136986.log.gz 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164877.log 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165137.log 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31690.log.gz 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164877.log.gz 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137626.log 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161557.log 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165137.log.gz 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.137626.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.137626.log.gz 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2024-08-27T04:00:28.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.161557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147670.log 2024-08-27T04:00:28.805 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44733.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.161557.log.gz 2024-08-27T04:00:28.805 INFO:teuthology.orchestra.run.smithi143.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2024-08-27T04:00:28.805 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108642.log 2024-08-27T04:00:28.805 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.147670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126934.log 2024-08-27T04:00:28.805 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.108642.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.147670.log.gz 2024-08-27T04:00:28.806 INFO:teuthology.orchestra.run.smithi143.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.108642.log.gz 2024-08-27T04:00:28.806 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45913.log 2024-08-27T04:00:28.806 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.126934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50093.log 2024-08-27T04:00:28.807 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45913.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45913.log.gz 2024-08-27T04:00:28.807 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119853.log 2024-08-27T04:00:28.807 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.50093.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50093.log.gz 2024-08-27T04:00:28.808 INFO:teuthology.orchestra.run.smithi143.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.126934.log.gz 2024-08-27T04:00:28.808 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79729.log 2024-08-27T04:00:28.808 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148259.log 2024-08-27T04:00:28.809 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.119853.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.119853.log.gz 2024-08-27T04:00:28.809 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.79729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74418.log 2024-08-27T04:00:28.810 INFO:teuthology.orchestra.run.smithi143.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79729.log.gz 2024-08-27T04:00:28.810 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.148259.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.148259.log.gz 2024-08-27T04:00:28.811 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98612.log 2024-08-27T04:00:28.811 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.74418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.155295.log 2024-08-27T04:00:28.811 INFO:teuthology.orchestra.run.smithi143.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.74418.log.gz 2024-08-27T04:00:28.811 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.98612.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.98612.log.gz 2024-08-27T04:00:28.812 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-08-27T04:00:28.813 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.155295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134626.log 2024-08-27T04:00:28.813 INFO:teuthology.orchestra.run.smithi143.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.155295.log.gz/var/log/ceph/ops-log-ceph-client.admin.log: 2024-08-27T04:00:28.815 INFO:teuthology.orchestra.run.smithi143.stderr: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-08-27T04:00:28.816 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162934.log 2024-08-27T04:00:28.816 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.134626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157655.log 2024-08-27T04:00:28.816 INFO:teuthology.orchestra.run.smithi143.stderr: 87.4%/var/log/ceph/ceph-client.admin.162934.log: -- replaced with /var/log/ceph/ceph-client.admin.134626.log.gz 2024-08-27T04:00:28.817 INFO:teuthology.orchestra.run.smithi143.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.162934.log.gz 2024-08-27T04:00:28.817 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-27T04:00:28.818 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.157655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80909.log 2024-08-27T04:00:28.818 INFO:teuthology.orchestra.run.smithi143.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.157655.log.gz/var/log/ceph/ceph-osd.1.log: 2024-08-27T04:00:28.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111002.log 2024-08-27T04:00:28.821 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.80909.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.80909.log.gz 2024-08-27T04:00:28.821 INFO:teuthology.orchestra.run.smithi143.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.0.164127.log.gz 2024-08-27T04:00:28.821 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41733.log 2024-08-27T04:00:28.822 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53997.log 2024-08-27T04:00:28.822 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.111002.log: /var/log/ceph/ceph-client.admin.41733.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111002.log.gz 2024-08-27T04:00:28.823 INFO:teuthology.orchestra.run.smithi143.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.41733.log.gz 2024-08-27T04:00:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90939.log 2024-08-27T04:00:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78549.log 2024-08-27T04:00:28.823 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.53997.log: 57.9% -- replaced with /var/log/ceph/ceph-client.admin.53997.log.gz 2024-08-27T04:00:28.824 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.90939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32332.log 2024-08-27T04:00:28.824 INFO:teuthology.orchestra.run.smithi143.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.90939.log.gz 2024-08-27T04:00:28.824 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.78549.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.78549.log.gz 2024-08-27T04:00:28.825 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56788.log 2024-08-27T04:00:28.825 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85039.log 2024-08-27T04:00:28.825 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32332.log: /var/log/ceph/ceph-client.admin.56788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32332.log.gz 2024-08-27T04:00:28.826 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47683.log 2024-08-27T04:00:28.826 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.85039.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85039.log.gz 2024-08-27T04:00:28.827 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79139.log 2024-08-27T04:00:28.827 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47683.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.47683.log.gz 2024-08-27T04:00:28.828 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33863.log 2024-08-27T04:00:28.829 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.79139.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.79139.log.gz 2024-08-27T04:00:28.829 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104512.log 2024-08-27T04:00:28.829 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.33863.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.33863.log.gz 2024-08-27T04:00:28.830 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31636.log 2024-08-27T04:00:28.830 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.104512.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.104512.log.gz 2024-08-27T04:00:28.831 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32520.log 2024-08-27T04:00:28.831 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31636.log.gz 2024-08-27T04:00:28.832 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165007.log 2024-08-27T04:00:28.833 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32520.log.gz 2024-08-27T04:00:28.833 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114542.log 2024-08-27T04:00:28.833 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165007.log.gz 2024-08-27T04:00:28.834 INFO:teuthology.orchestra.run.smithi143.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.56788.log.gz 2024-08-27T04:00:28.834 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138806.log 2024-08-27T04:00:28.835 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75598.log 2024-08-27T04:00:28.835 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.114542.log: /var/log/ceph/ceph-client.admin.138806.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.114542.log.gz 2024-08-27T04:00:28.835 INFO:teuthology.orchestra.run.smithi143.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138806.log.gz 2024-08-27T04:00:28.835 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84449.log 2024-08-27T04:00:28.835 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-08-27T04:00:28.836 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.75598.log: /var/log/ceph/ceph-client.admin.84449.log: 82.1% 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84449.log.gz -- replaced with /var/log/ceph/ceph-client.admin.75598.log.gz 2024-08-27T04:00:28.836 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.836 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106872.log 2024-08-27T04:00:28.838 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38733.log 2024-08-27T04:00:28.839 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44143.log: /var/log/ceph/ceph-client.admin.106872.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz 2024-08-27T04:00:28.839 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106872.log.gz 2024-08-27T04:00:28.839 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21802.log 2024-08-27T04:00:28.839 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31882.log 2024-08-27T04:00:28.839 INFO:teuthology.orchestra.run.smithi143.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.38733.log.gz 2024-08-27T04:00:28.839 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.tmp-client.admin.21802.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21802.log.gz 2024-08-27T04:00:28.840 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160015.log 2024-08-27T04:00:28.840 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83859.log 2024-08-27T04:00:28.840 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31882.log.gz 2024-08-27T04:00:28.840 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.160015.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.160015.log.gz 2024-08-27T04:00:28.841 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118082.log 2024-08-27T04:00:28.842 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162147.log 2024-08-27T04:00:28.842 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.83859.log: /var/log/ceph/ceph-client.admin.118082.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.83859.log.gz 2024-08-27T04:00:28.842 INFO:teuthology.orchestra.run.smithi143.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.118082.log.gz 2024-08-27T04:00:28.842 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109232.log 2024-08-27T04:00:28.842 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.153525.log 2024-08-27T04:00:28.843 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162147.log: /var/log/ceph/ceph-client.admin.109232.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.162147.log.gz 2024-08-27T04:00:28.843 INFO:teuthology.orchestra.run.smithi143.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.109232.log.gz 2024-08-27T04:00:28.843 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54282.log 2024-08-27T04:00:28.843 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.153525.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.153525.log.gz 2024-08-27T04:00:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76779.log 2024-08-27T04:00:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-27T04:00:28.844 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54282.log.gz 2024-08-27T04:00:28.845 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.76779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116312.log 2024-08-27T04:00:28.845 INFO:teuthology.orchestra.run.smithi143.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.76779.log.gz 2024-08-27T04:00:28.860 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43503.log 2024-08-27T04:00:28.861 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.116312.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116312.log.gz 2024-08-27T04:00:28.861 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164955.log 2024-08-27T04:00:28.862 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43503.log.gz 2024-08-27T04:00:28.863 INFO:teuthology.orchestra.run.smithi143.stderr: 93.6% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71468.log 2024-08-27T04:00:28.863 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.863 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164955.log.gz 2024-08-27T04:00:28.865 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69001.log 2024-08-27T04:00:28.865 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.71468.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.71468.log.gz 2024-08-27T04:00:28.865 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61954.log 2024-08-27T04:00:28.865 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.69001.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.69001.log.gz 2024-08-27T04:00:28.865 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43528.log 2024-08-27T04:00:28.866 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164903.log 2024-08-27T04:00:28.866 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.61954.log: /var/log/ceph/ceph-client.admin.43528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43528.log.gz 2024-08-27T04:00:28.867 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61954.log.gz 2024-08-27T04:00:28.868 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94479.log 2024-08-27T04:00:28.868 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67136.log 2024-08-27T04:00:28.868 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164903.log.gz 2024-08-27T04:00:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.94479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146492.log 2024-08-27T04:00:28.869 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94479.log.gz 2024-08-27T04:00:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.67136.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.67136.log.gz 2024-08-27T04:00:28.870 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165241.log 2024-08-27T04:00:28.870 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131654.log 2024-08-27T04:00:28.871 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.146492.log: /var/log/ceph/ceph-client.admin.165241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165241.log.gz 91.8% -- replaced with /var/log/ceph/ceph-client.admin.146492.log.gz 2024-08-27T04:00:28.871 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:28.871 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70878.log 2024-08-27T04:00:28.872 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108052.log 2024-08-27T04:00:28.872 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.131654.log: /var/log/ceph/ceph-client.admin.70878.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.131654.log.gz 2024-08-27T04:00:28.873 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139396.log 2024-08-27T04:00:28.873 INFO:teuthology.orchestra.run.smithi143.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.70878.log.gz 2024-08-27T04:00:28.873 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.108052.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.108052.log.gz 2024-08-27T04:00:28.873 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31686.log 2024-08-27T04:00:28.874 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40503.log 2024-08-27T04:00:28.874 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.139396.log: /var/log/ceph/ceph-client.admin.31686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139396.log.gz 2024-08-27T04:00:28.874 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31686.log.gz 2024-08-27T04:00:28.874 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139446.log 2024-08-27T04:00:28.876 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87399.log 2024-08-27T04:00:28.876 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.40503.log: /var/log/ceph/ceph-client.admin.139446.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.40503.log.gz 2024-08-27T04:00:28.876 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31682.log 2024-08-27T04:00:28.876 INFO:teuthology.orchestra.run.smithi143.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.139446.log.gz 2024-08-27T04:00:28.876 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.87399.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.87399.log.gz 2024-08-27T04:00:28.876 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26594.log 2024-08-27T04:00:28.877 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31687.log 2024-08-27T04:00:28.878 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31682.log: /var/log/ceph/ceph-client.admin.26594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31682.log.gz 2024-08-27T04:00:28.878 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26594.log.gz 2024-08-27T04:00:28.878 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-27T04:00:28.879 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109822.log 2024-08-27T04:00:28.879 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31687.log: /var/log/ceph/ceph-mon.c.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31687.log.gz 2024-08-27T04:00:28.879 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164799.log 2024-08-27T04:00:28.879 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.109822.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.109822.log.gz 2024-08-27T04:00:28.880 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60659.log 2024-08-27T04:00:28.880 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164799.log.gz 2024-08-27T04:00:28.880 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39913.log 2024-08-27T04:00:28.883 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.60659.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.60659.log.gz 2024-08-27T04:00:28.883 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162883.log 2024-08-27T04:00:28.884 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.39913.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.39913.log.gz 2024-08-27T04:00:28.884 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165111.log 2024-08-27T04:00:28.885 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162883.log.gz 2024-08-27T04:00:28.885 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2024-08-27T04:00:28.886 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165111.log.gz 2024-08-27T04:00:28.886 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112182.log 2024-08-27T04:00:28.886 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2024-08-27T04:00:28.887 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142116.log 2024-08-27T04:00:28.887 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.112182.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112182.log.gz 2024-08-27T04:00:28.888 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32085.log 2024-08-27T04:00:28.891 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.142116.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142116.log.gz 2024-08-27T04:00:28.892 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121623.log 2024-08-27T04:00:28.892 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32085.log.gz 2024-08-27T04:00:28.893 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165033.log 2024-08-27T04:00:28.893 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.121623.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.121623.log.gz 2024-08-27T04:00:28.894 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86219.log 2024-08-27T04:00:28.894 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165033.log.gz 2024-08-27T04:00:28.895 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132244.log 2024-08-27T04:00:28.895 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.86219.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86219.log.gz 2024-08-27T04:00:28.896 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163531.log 2024-08-27T04:00:28.897 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.132244.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132244.log.gz 2024-08-27T04:00:28.897 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122803.log 2024-08-27T04:00:28.898 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.163531.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.163531.log.gz 2024-08-27T04:00:28.898 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99202.log 2024-08-27T04:00:28.899 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.122803.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.122803.log.gz 2024-08-27T04:00:28.899 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-08-27T04:00:28.900 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.99202.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.99202.log.gz 2024-08-27T04:00:28.901 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48863.log 2024-08-27T04:00:28.914 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-27T04:00:28.914 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48863.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.48863.log.gz 2024-08-27T04:00:28.928 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49503.log 2024-08-27T04:00:28.932 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.audit.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-27T04:00:28.932 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115132.log 2024-08-27T04:00:28.933 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49503.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49503.log.gz 2024-08-27T04:00:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165293.log 2024-08-27T04:00:28.949 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.115132.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115132.log.gz 2024-08-27T04:00:28.965 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36795.log 2024-08-27T04:00:28.965 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165293.log.gz 2024-08-27T04:00:28.972 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115722.log 2024-08-27T04:00:28.972 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.36795.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36795.log.gz 2024-08-27T04:00:28.980 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56142.log 2024-08-27T04:00:28.981 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.115722.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.115722.log.gz 2024-08-27T04:00:28.981 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117492.log 2024-08-27T04:00:28.982 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.56142.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.56142.log.gz 2024-08-27T04:00:28.988 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65312.log 2024-08-27T04:00:29.005 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.117492.log: 82.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.154115.log 2024-08-27T04:00:29.005 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117492.log.gz 2024-08-27T04:00:29.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-08-27T04:00:29.005 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.65312.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65312.log.gz 2024-08-27T04:00:29.016 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77369.log 2024-08-27T04:00:29.017 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.154115.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.154115.log.gz 2024-08-27T04:00:29.028 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165059.log 2024-08-27T04:00:29.029 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.77369.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.77369.log.gz 2024-08-27T04:00:29.040 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43553.log 2024-08-27T04:00:29.041 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165059.log.gz 2024-08-27T04:00:29.041 INFO:teuthology.orchestra.run.smithi143.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-08-27T04:00:29.044 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105102.log 2024-08-27T04:00:29.045 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43553.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.43553.log.gz 2024-08-27T04:00:29.045 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113952.log 2024-08-27T04:00:29.046 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.105102.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105102.log.gz 2024-08-27T04:00:29.046 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100382.log 2024-08-27T04:00:29.047 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.113952.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.113952.log.gz 2024-08-27T04:00:29.048 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88579.log 2024-08-27T04:00:29.049 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.100382.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100382.log.gz 2024-08-27T04:00:29.049 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-08-27T04:00:29.050 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.88579.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.88579.log.gz 2024-08-27T04:00:29.051 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32101.log 2024-08-27T04:00:29.051 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-08-27T04:00:29.051 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58079.log 2024-08-27T04:00:29.052 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32101.log.gz 2024-08-27T04:00:29.053 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107462.log 2024-08-27T04:00:29.058 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.58079.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.58079.log.gz 2024-08-27T04:00:29.058 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-08-27T04:00:29.059 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.107462.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.107462.log.gz 2024-08-27T04:00:29.059 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82679.log 2024-08-27T04:00:29.060 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 84.5% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-08-27T04:00:29.060 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81499.log 2024-08-27T04:00:29.061 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.82679.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82679.log.gz 2024-08-27T04:00:29.062 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76188.log 2024-08-27T04:00:29.064 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.81499.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.81499.log.gz 2024-08-27T04:00:29.064 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32546.log 2024-08-27T04:00:29.065 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.76188.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.76188.log.gz 2024-08-27T04:00:29.065 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129884.log 2024-08-27T04:00:29.066 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32546.log.gz 2024-08-27T04:00:29.066 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-08-27T04:00:29.067 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.129884.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.129884.log.gz 2024-08-27T04:00:29.067 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158245.log 2024-08-27T04:00:29.068 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-08-27T04:00:29.068 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46503.log 2024-08-27T04:00:29.069 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.158245.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.158245.log.gz 2024-08-27T04:00:29.069 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110412.log 2024-08-27T04:00:29.070 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46503.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.46503.log.gz 2024-08-27T04:00:29.071 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162810.log 2024-08-27T04:00:29.072 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.110412.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110412.log.gz 2024-08-27T04:00:29.072 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96249.log 2024-08-27T04:00:29.073 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162810.log: 25.6% -- replaced with /var/log/ceph/ceph-client.admin.162810.log.gz 2024-08-27T04:00:29.073 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137601.log 2024-08-27T04:00:29.075 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.96249.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96249.log.gz 2024-08-27T04:00:29.076 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31883.log 2024-08-27T04:00:29.076 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.137601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137601.log.gz 2024-08-27T04:00:29.077 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147081.log 2024-08-27T04:00:29.077 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31883.log.gz 2024-08-27T04:00:29.078 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.156475.log 2024-08-27T04:00:29.079 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.147081.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.147081.log.gz 2024-08-27T04:00:29.079 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102152.log 2024-08-27T04:00:29.080 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.156475.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.156475.log.gz 2024-08-27T04:00:29.080 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164773.log 2024-08-27T04:00:29.082 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.102152.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.102152.log.gz 2024-08-27T04:00:29.083 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98022.log 2024-08-27T04:00:29.084 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.164773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164773.log.gz 2024-08-27T04:00:29.084 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64131.log 2024-08-27T04:00:29.086 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.98022.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98022.log.gz 2024-08-27T04:00:29.086 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101562.log 2024-08-27T04:00:29.086 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.64131.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.64131.log.gz 2024-08-27T04:00:29.086 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31515.log 2024-08-27T04:00:29.088 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.101562.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.101562.log.gz 2024-08-27T04:00:29.088 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119263.log 2024-08-27T04:00:29.088 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31515.log.gz 2024-08-27T04:00:29.088 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32689.log 2024-08-27T04:00:29.089 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.119263.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.119263.log.gz 2024-08-27T04:00:29.090 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80319.log 2024-08-27T04:00:29.091 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.32689.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.32689.log.gz 2024-08-27T04:00:29.091 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72648.log 2024-08-27T04:00:29.092 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.80319.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.80319.log.gz 2024-08-27T04:00:29.092 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.152935.log 2024-08-27T04:00:29.094 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.72648.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.72648.log.gz 2024-08-27T04:00:29.094 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66493.log 2024-08-27T04:00:29.095 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.152935.log: 81.3% -- replaced with /var/log/ceph/ceph-client.0.152935.log.gz 2024-08-27T04:00:29.095 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31684.log 2024-08-27T04:00:29.096 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.66493.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.66493.log.gz 2024-08-27T04:00:29.096 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123983.log 2024-08-27T04:00:29.096 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31684.log.gz 2024-08-27T04:00:29.097 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83269.log 2024-08-27T04:00:29.098 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.123983.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.123983.log.gz 2024-08-27T04:00:29.098 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162833.log 2024-08-27T04:00:29.099 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.83269.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83269.log.gz 2024-08-27T04:00:29.099 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95659.log 2024-08-27T04:00:29.100 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.162833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162833.log.gz 2024-08-27T04:00:29.100 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51913.log 2024-08-27T04:00:29.101 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.95659.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.95659.log.gz 2024-08-27T04:00:29.101 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35037.log 2024-08-27T04:00:29.102 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.51913.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.51913.log.gz 2024-08-27T04:00:29.102 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31538.log 2024-08-27T04:00:29.103 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.35037.log: 81.6% -- replaced with /var/log/ceph/ceph-client.0.35037.log.gz 2024-08-27T04:00:29.103 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61304.log 2024-08-27T04:00:29.104 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31538.log.gz 2024-08-27T04:00:29.104 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49478.log 2024-08-27T04:00:29.106 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.61304.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61304.log.gz 2024-08-27T04:00:29.107 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165370.log 2024-08-27T04:00:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49478.log.gz 2024-08-27T04:00:29.109 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130474.log 2024-08-27T04:00:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.165370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165370.log.gz 2024-08-27T04:00:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132834.log 2024-08-27T04:00:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.130474.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.130474.log.gz 2024-08-27T04:00:29.110 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54068.log 2024-08-27T04:00:29.111 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.132834.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.132834.log.gz 2024-08-27T04:00:29.111 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32570.log 2024-08-27T04:00:29.112 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54068.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.54068.log.gz 2024-08-27T04:00:29.112 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31898.log 2024-08-27T04:00:29.113 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32570.log.gz 2024-08-27T04:00:29.113 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.154705.log 2024-08-27T04:00:29.114 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31898.log.gz 2024-08-27T04:00:29.114 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26834.log 2024-08-27T04:00:29.115 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.154705.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.154705.log.gz 2024-08-27T04:00:29.116 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97432.log 2024-08-27T04:00:29.119 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.26834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26834.log.gz 2024-08-27T04:00:29.119 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54305.log 2024-08-27T04:00:29.119 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.97432.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97432.log.gz 2024-08-27T04:00:29.119 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31584.log 2024-08-27T04:00:29.132 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.54305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31897.log 2024-08-27T04:00:29.133 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31584.log.gz 2024-08-27T04:00:29.135 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54305.log.gz 2024-08-27T04:00:29.135 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32106.log 2024-08-27T04:00:29.136 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.31897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31897.log.gz 2024-08-27T04:00:29.137 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73238.log 2024-08-27T04:00:29.137 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32106.log.gz 2024-08-27T04:00:29.138 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32618.log 2024-08-27T04:00:29.139 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.73238.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.73238.log.gz 2024-08-27T04:00:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149974.log 2024-08-27T04:00:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.32618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32618.log.gz 2024-08-27T04:00:29.140 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87989.log 2024-08-27T04:00:29.141 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.149974.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.149974.log.gz 2024-08-27T04:00:29.143 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.87989.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87989.log.gz 2024-08-27T04:00:29.599 INFO:teuthology.orchestra.run.smithi181.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-27T04:00:29.883 INFO:teuthology.orchestra.run.smithi181.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-27T04:00:30.469 INFO:teuthology.orchestra.run.smithi143.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-27T04:00:32.828 INFO:teuthology.orchestra.run.smithi143.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-27T04:00:33.065 INFO:teuthology.orchestra.run.smithi143.stderr: 92.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-08-27T04:00:38.761 INFO:teuthology.orchestra.run.smithi143.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-27T04:00:40.055 INFO:teuthology.orchestra.run.smithi143.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-27T04:00:40.685 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-27T04:00:40.836 INFO:teuthology.orchestra.run.smithi181.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-27T04:00:41.042 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-27T04:00:45.230 INFO:teuthology.orchestra.run.smithi181.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-27T04:00:45.231 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-08-27T04:00:45.231 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m16.503s 2024-08-27T04:00:45.231 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m52.910s 2024-08-27T04:00:45.231 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m1.896s 2024-08-27T04:00:45.449 INFO:teuthology.orchestra.run.smithi143.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-27T04:00:51.057 INFO:teuthology.orchestra.run.smithi143.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-27T04:00:51.059 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-08-27T04:00:51.059 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m22.367s 2024-08-27T04:00:51.059 INFO:teuthology.orchestra.run.smithi143.stderr:user 1m8.468s 2024-08-27T04:00:51.059 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m2.486s 2024-08-27T04:00:51.059 INFO:tasks.ceph:Archiving logs... 2024-08-27T04:00:51.060 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/remote/smithi143/log 2024-08-27T04:00:51.060 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-27T04:00:58.957 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/remote/smithi181/log 2024-08-27T04:00:58.958 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-27T04:01:05.237 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa/tasks/ceph.py", line 1975, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: UninitCondition RGWSelectObj_ObjStore_S3::run_s3select_on_csv(char const*, char const*, unsigned long) RGWSelectObj_ObjStore_S3::csv_processing(ceph::buffer::v15_2_0::list&, long, long) RGWGetObj_Decompress::handle_data(ceph::buffer::v15_2_0::list&, long, long) 2024-08-27T04:01:05.238 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-27T04:01:05.248 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa/tasks/ceph.py", line 1975, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_4d4c5e30374204f3b32f867e61bb4e1a3880f672/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d17b22856a85d7d49d47be692c778d4419f41641/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: UninitCondition RGWSelectObj_ObjStore_S3::run_s3select_on_csv(char const*, char const*, unsigned long) RGWSelectObj_ObjStore_S3::csv_processing(ceph::buffer::v15_2_0::list&, long, long) RGWGetObj_Decompress::handle_data(ceph::buffer::v15_2_0::list&, long, long) 2024-08-27T04:01:05.249 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-27T04:01:05.249 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-27T04:01:05.251 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-27T04:01:05.324 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-27T04:01:05.334 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-27T04:01:05.334 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-27T04:01:05.340 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-27T04:01:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2024-08-27T04:01:05.355 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2024-08-27T04:01:05.355 INFO:teuthology.orchestra.run.smithi143.stdout:*hv01.front.sepi 67.205.162.81 3 u 63 64 377 0.104 -0.656 0.212 2024-08-27T04:01:05.355 INFO:teuthology.orchestra.run.smithi143.stdout:+hv02.front.sepi 63.231.80.2 3 u 54 64 377 0.105 -0.364 0.246 2024-08-27T04:01:05.355 INFO:teuthology.orchestra.run.smithi143.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.083 -1.344 0.325 2024-08-27T04:01:05.355 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-08-27T04:01:05.357 INFO:teuthology.orchestra.run.smithi181.stdout: remote refid st t when poll reach delay offset jitter 2024-08-27T04:01:05.357 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================== 2024-08-27T04:01:05.357 INFO:teuthology.orchestra.run.smithi181.stdout:*hv01.front.sepi 67.205.162.81 3 u 8 256 377 0.166 -2.051 1.744 2024-08-27T04:01:05.358 INFO:teuthology.orchestra.run.smithi181.stdout:+hv02.front.sepi 63.231.80.2 3 u 17 256 377 0.178 -3.840 1.149 2024-08-27T04:01:05.358 INFO:teuthology.orchestra.run.smithi181.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 256 377 0.200 -3.425 1.151 2024-08-27T04:01:05.358 INFO:teuthology.orchestra.run.smithi181.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-08-27T04:01:05.359 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-27T04:01:05.369 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-27T04:01:05.369 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-27T04:01:05.379 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-27T04:01:05.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-27T04:01:05.398 INFO:teuthology.task.internal:Duration was 6063.070591 seconds 2024-08-27T04:01:05.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-27T04:01:05.415 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-27T04:01:05.415 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-27T04:01:05.418 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-27T04:01:05.453 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-27T04:01:05.454 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-08-27T04:01:05.454 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-27T04:01:05.506 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-08-27T04:01:05.506 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-27T04:01:05.516 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-27T04:01:05.516 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-27T04:01:05.550 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-27T04:01:05.584 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-27T04:01:05.585 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-27T04:01:05.618 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-27T04:01:05.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-27T04:01:05.696 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-27T04:01:05.696 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-27T04:01:05.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-27T04:01:05.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-27T04:01:05.730 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-27T04:01:05.754 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-27T04:01:05.763 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-08-27T04:01:05.771 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-08-27T04:01:05.793 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-27T04:01:05.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T04:01:05.825 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-27T04:01:05.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-27T04:01:05.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-27T04:01:05.860 INFO:teuthology.task.internal:Transferring archived files... 2024-08-27T04:01:05.861 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/remote/smithi143 2024-08-27T04:01:05.861 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-27T04:01:05.895 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-08-26_22:06:30-rgw-pr-56597-distro-default-smithi/7874755/remote/smithi181 2024-08-27T04:01:05.895 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-27T04:01:05.920 INFO:teuthology.task.internal:Removing archive directory... 2024-08-27T04:01:05.921 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-27T04:01:05.934 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-27T04:01:05.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-27T04:01:05.983 INFO:teuthology.task.internal:Not uploading archives. 2024-08-27T04:01:05.984 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-27T04:01:06.003 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-27T04:01:06.003 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-27T04:01:06.006 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-27T04:01:06.010 INFO:teuthology.orchestra.run.smithi143.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 27 04:01 /home/ubuntu/cephtest 2024-08-27T04:01:06.012 INFO:teuthology.orchestra.run.smithi181.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 27 04:01 /home/ubuntu/cephtest 2024-08-27T04:01:06.014 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-27T04:01:06.033 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-27T04:01:06.052 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: UninitCondition RGWSelectObj_ObjStore_S3::run_s3select_on_csv(char const*, char const*, unsigned long) RGWSelectObj_ObjStore_S3::csv_processing(ceph::buffer::v15_2_0::list&, long, long) RGWGetObj_Decompress::handle_data(ceph::buffer::v15_2_0::list&, long, long) 2024-08-27T04:01:06.055 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 6063.070590734482 failure_reason: 'valgrind error: UninitCondition RGWSelectObj_ObjStore_S3::run_s3select_on_csv(char const*, char const*, unsigned long) RGWSelectObj_ObjStore_S3::csv_processing(ceph::buffer::v15_2_0::list&, long, long) RGWGetObj_Decompress::handle_data(ceph::buffer::v15_2_0::list&, long, long)' flavor: default owner: scheduled_cbodley@teuthology status: fail success: false 2024-08-27T04:01:06.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-27T04:01:06.137 INFO:teuthology.run:FAIL